Abstract
In this paper we present an active learning procedure for the two-class supervised classification problem. The utilized methodology exploits the Bayesian modeling and inference paradigm to tackle the problem of kernel-based data classification. This Bayesian methodology is appropriate for both finite and infinite dimensional feature spaces. Parameters are estimated, using the kernel trick, following the evidence Bayesian approach from the marginal distribution of the observations. The proposed active learning procedure uses a criterion based on the entropy of the posterior distribution of the adaptive parameters to select the sample to be included in the training set. A synthetic dataset as well as a real remote sensing classification problem are used to validate the followed approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Babacan, D., Molina, R., Katsaggelos, A.: Bayesian compressive sensing using Laplace priors. IEEE Transactions on Image Processing 19(1), 53–63 (2010)
Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer (2007)
Burges, C.J.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)
Elad, M.: Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing. Springer (2010)
MacKay, D.J.C.: Information-based objective functions for active data selection. Neural Computation 4(4), 590–604 (1992)
Paisley, J., Liao, X., Carin, L.: Active learning and basis selection for kernel-based linear models: A Bayesian perspective. IEEE Transactions on Signal Processing 58, 2686–2700 (2010)
Rasmussen, C.E., Williams, C.K.: Gaussian Processes for Machine Learning. MIT Press, NY (2006)
Schölkopf, B., Smola, A.: Learning with Kernels. MIT Press, Cambrigde (2002)
Seeger, M.W., Nickisch, H.: Compressed sensing and Bayesian experimental design. In: International Conference on Machine Learning 25 (2008)
Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin–Madison (2009)
Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge Univ. Press (2004)
Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)
Tipping, M.E.: The relevance vector machine. Journal of Machine Learning Research 1, 211–244 (2001)
Tuia, D., Volpi, M., Copa, L., Kanevski, M., Muñoz-Marí, J.: A survey of active learning algorithms for supervised remote sensing image classification. IEEE J. Sel. Topics Signal Proc. 4, 606–617 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ruiz, P., Mateos, J., Molina, R., Katsaggelos, A.K. (2012). A Bayesian Active Learning Framework for a Two-Class Classification Problem. In: Salerno, E., Çetin, A.E., Salvetti, O. (eds) Computational Intelligence for Multimedia Understanding. MUSCLE 2011. Lecture Notes in Computer Science, vol 7252. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32436-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-32436-9_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32435-2
Online ISBN: 978-3-642-32436-9
eBook Packages: Computer ScienceComputer Science (R0)