Abstract
Ensembles of classifiers have recently received a resounding interest due to their successful application in different scenarios. In this paper, our main focus is on using ensembles of one-against-all classifiers in multiclass problems. Current approaches in multiclass problems are often focused in dividing the problem but seldom focus on cooperating strategies between classifiers. We propose a framework based on Support Vector Machines (SVM) one-against-all baseline ensemble classifiers that includes a Multiclass Ensemble Function (MEF) to heuristically incorporate both the predictions of individual classifiers as well as the confidence margin associated with those predictions to determine the final ensemble output. The results achieved with the renown Iris and Wine datasets show the performance improvement achieved by the proposed multiclass ensemble of one-against-all SVM classifiers.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Džeroski, S., Panov, P., Ženko, B.: Ensemble methods in machine learning. In: Encyclopedia of Complexity and Systems Science, pp. 5317–5325 (2009)
Vapnik, V., Cortes, C.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Lefaucheur, P., Nock, R.: Robust multiclass ensemble classifiers via symmetric functions. In: Proceeding of the 18th International Conference on Pattern Recognition, pp. 136–139 (2006)
Mace, M., Abdullah-Al-Mamun, K., Wang, S., Gupta, L., Vaidyanathan, R.: Ensemble classification for robust discrimination of multi-channel, multi-class tongue-movement ear pressure signals. In: International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1733–1736 (2011)
Sainin, M.: A direct ensemble classifier for imbalanced multiclass learning. In: IEEE Conference on Data Mining and Optimization (DMO), pp. 59–66 (2012)
Oong, T., Isa, N.: One-against-all ensemble for multiclass pattern classification. Appl. Soft Comput. 12(4), 1303–1308 (2012)
Polikar, R.: Ensemble based systems in decision making. IEEE Circ. Syst. Mag. 6(3), 21–45 (2006)
Kuncheva, L.: Combining Pattern Classifiers - Methods and Algorithms. Wiley, New York (2004)
Ren, Y., Zhang, L., Suganthan, P.: Ensemble classification and regression - recent developments, applications and future directions. IEEE Comput. Intell. Mag. 11(1), 41–53 (2016)
Dietterich, T.G.: Ensemble methods in machine learning. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 1–15. Springer, Heidelberg (2000)
Gu, S., Chen, R., Jin, Y.: Multi-objective ensemble generation. WIREs Data Min. Knowl. Discov. 5(5), 234–245 (2015)
Silva, C., Ribeiro, B.: Inductive Inference for Large Scale Text Classification. Kernel Machines for Text Classification. SCI, vol. 255, pp. 31–48. Springer, Heidelberg (2010)
Gacquer, D., Piechowiak, S., Delmotte, F., Delcroix, V.: A genetic approach for training diverse classifier ensembles. In: International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, pp. 798–805 (2008)
Hsu, C.W., Lin, C.J.: A comparison of methods for multi-class support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)
Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Eugenics 7(2), 179–188 (1936)
Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manage. 45, 427–437 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Silva, C., Ribeiro, B. (2016). Multiclass Ensemble of One-against-all SVM Classifiers. In: Cheng, L., Liu, Q., Ronzhin, A. (eds) Advances in Neural Networks – ISNN 2016. ISNN 2016. Lecture Notes in Computer Science(), vol 9719. Springer, Cham. https://doi.org/10.1007/978-3-319-40663-3_61
Download citation
DOI: https://doi.org/10.1007/978-3-319-40663-3_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40662-6
Online ISBN: 978-3-319-40663-3
eBook Packages: Computer ScienceComputer Science (R0)