Abstract
Error correcting output codes (ECOC) represent a successful extension of binary classifiers to address the multiclass problem. Lately, the ECOC framework was extended from the binary to the ternary case to allow classes to be ignored by a certain classifier, allowing in this way to increase the number of possible dichotomies to be selected. Nevertheless, the effect of the zero symbol by which dichotomies exclude certain classes from consideration has not been previously enough considered in the definition of the decoding strategies. In this paper, we show that by a special treatment procedure of zeros, and adjusting the weights at the rest of coded positions, the accuracy of the system can be increased. Besides, we extend the main state-of-art decoding strategies from the binary to the ternary case, and we propose two novel approaches: Laplacian and Pessimistic Beta Density Probability approaches. Tests on UCI database repository (with different sparse matrices containing different percentages of zero symbol) show that the ternary decoding techniques proposed outperform the standard decoding strategies.
Chapter PDF
Similar content being viewed by others
References
Vapnik, V.: Estimation of dependences based on empirical data. Springer, Heidelberg (1982)
Vapnik, V.: The nature of statistical learning theory. Springer, Heidelberg (1995)
Breiman, L., Friedman, J.: Classification and Regression Trees, Wadsworth (1984)
Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting (38), 337–374 (1998)
Allwein, E., Schapire, R., Singer, Y.: Reducing multiclass to binary: A unifying approach for margin classifiers (1), 113–141 (2002)
Dietterich, T., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes (2), 263–286 (1995)
Windeatt, T., Ghaderi, R.: Coding and decoding for multi-class learning problems (4), 11–21 (2003)
Dietterich, T., Bakiri, G.: Error-correcting output codes: A general method for improving multiclass inductive learning programs. In: Press, A. (ed.) Ninth National Conference on Artificial Intelligence, pp. 572–577 (1991)
Hastie, T., Tibshirani, R.: Classification by pairwise grouping (26), 451–471 (1998)
Crammer, K., Singer, Y.: On the learnability and design of output codes for multi-class problems (47), 201–233 (2002)
Pujol, O., Radeva, P., Vitrià, J.: Discriminant ECOC: A heuristic method for application dependent design of error correcting output codes (28), 1001–1007 (2006)
Escalera, S., Pujol, O., Radeva, P.: ECOC-ONE: A novel coding and decoding strategy. In: ICPR, Hong Kong, China (in press, 2006)
Escalera, S., Pujol, O., Radeva, P.: Forest extension of error correcting output codes and boosted landmarks. In: ICPR, Hong Kong, China (in press, 2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Escalera, S., Pujol, O., Radeva, P. (2006). Decoding of Ternary Error Correcting Output Codes. In: Martínez-Trinidad, J.F., Carrasco Ochoa, J.A., Kittler, J. (eds) Progress in Pattern Recognition, Image Analysis and Applications. CIARP 2006. Lecture Notes in Computer Science, vol 4225. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11892755_78
Download citation
DOI: https://doi.org/10.1007/11892755_78
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46556-0
Online ISBN: 978-3-540-46557-7
eBook Packages: Computer ScienceComputer Science (R0)