Abstract
In classification problems, many different active learning techniques are often adopted to find the most informative samples for labeling in order to save human labors. Among them, active learning support vector machine (SVM) is one of the most representative approaches, in which model parameter is usually set as a fixed default value during the whole learning process. Note that model parameter is closely related to the training set. Hence dynamic parameter is desirable to make a satisfactory learning performance. To target this issue, we proposed a novel algorithm, called active learning SVM with regularization path, which can fit the entire solution path of SVM for every value of model parameters. In this algorithm, we first traced the entire solution path of the current classifier to find a series of candidate model parameters, and then used unlabeled samples to select the best model parameter. Besides, in the initial phase of training, we constructed a training sample sets by using an improved K-medoids cluster algorithm. Experimental results conducted from real-world data sets showed the effectiveness of the proposed algorithm for image classification problems.
Similar content being viewed by others
References
Gosselin PH, Cord M (2008) Active learning methods for interactive image retrieval. IEEE Trans Image Process 17(7):1200–1211
Hastie T, Rosset S, Tibshirani R, Zhu J (2004) The entire regularization path for the support vector machine. J Mach Learn Res 5:1391–1415
Hoi SC, Rong J, Lyu MR (2006) Large-scale text categorization by batch mode active learning. In: Proceedings of the 15th International Conference on World Wide Web. ACM 633-642
Li X, Wang L, Sung E (2004) Multi-label SVM active learning for image classification. In: Proc Int Conf Image Process 4:2207–2210
Lughofer E (2012) Hybrid active learning for reducing the annotation effort of operators in classification systems. Pattern Recogn 45(2):884–896
Pang Y, Ji Z, Jing P, Li X (2013) Ranking Graph embedding for learning to rerank. IEEE Trans Neural Netw Learn Syst 24(8):1292–1303
Pang Y, Zhang K, Yuan Y, Wang K. Distributed object detection with linear SVMs. IEEE Transactions on Cybernetics, in press. DOI: 10.1109/TCYB.2014.2301453
Qi G-J, Hua X-S, Rui Y, Tang JH, Mei T, Zhang H-J (2007) Correlative multi-label video annotation. In: Proceedings of ACM Multimedia, pp. 17-26
Settles B (2010) Active learning literature survey. University of Wisconsin, Madison
Settles B, Craven M, Ray S (2007) Multiple-instance active learning. In: Proc Neural Inf Process Syst 20:1289–1296
Tian X, Tao D, Hua X-S, Wu X (2010) Active reranking for web image search. IEEE Trans Image Process 19(3):805–820
Tur G, Schapire RE, Hakkani-Tur D (2003) Active learning for spoken language understanding. In: Proc IEEE Int Conf Acoust Speech Signal Process 1:276–279
Wang M, Hua X-S (2011) Active learning in multimedia annotation and retrieval: A survey. ACM Trans Intell Syst Technol (TIST) 2(2):10
Wang M, Hua X-S, Mei T, Tang J, Qi G-J (2007) Interactive video annotation by multi-concept multi-modality active learning. Int J Semant Comput 1(4):459–477
Wang M, Ni B, Hua X-S, Chua T-S (2012) Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Comput Surv (CSUR) 44(4):25
Wang Z, Yan S, Zhang C (2011) Active learning with adaptive regularization. Pattern Recogn 44(10):2375–2383
Yuan J, Zhou X, Zhang J, Wang M, Zhang Q, Wang W, Shi B (2007) Positive sample enhanced angle-diversity active learning for SVM based image retrieval. In: IEEE International Conference on Multimedia and Expo 2202-2205
Zha Z-J, Wang M, Zheng Y-T, Yang Y, Hong R, Chua T.-S. Interactive video indexing with statistical active learning. IEEE Trans Multimedia 14:(1)17-2, 20127
Zhu X, Lafferty J, Ghahramani Z (2003) Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In: ICML 2003 workshop on the continuum from labeled to unlabeled data in machine learning and data mining 58-65
Zhu J, Wang H, Tsou BK, Ma M (2010) Active learning with sampling by uncertainty and density for data annotations. IEEE Trans Audio Speech Lang Process 18(6):1323–1331
Zhu J, Wang H, Yao T, Tsou BK (2008) Active learning with sampling by uncertainty and density for word sense disambiguation and text classification. In: Proc 22nd Int Conf Comput Linguist 1:1137–1144
Acknowledgement
This work is supported by National Natural Science Foundation of China under Grant No. 61272214.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sun, F., Xu, Y. & Zhou, J. Active learning SVM with regularization path for image classification. Multimed Tools Appl 75, 1427–1442 (2016). https://doi.org/10.1007/s11042-014-2141-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2141-9