Skip to main content

Advertisement

Log in

Active learning SVM with regularization path for image classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In classification problems, many different active learning techniques are often adopted to find the most informative samples for labeling in order to save human labors. Among them, active learning support vector machine (SVM) is one of the most representative approaches, in which model parameter is usually set as a fixed default value during the whole learning process. Note that model parameter is closely related to the training set. Hence dynamic parameter is desirable to make a satisfactory learning performance. To target this issue, we proposed a novel algorithm, called active learning SVM with regularization path, which can fit the entire solution path of SVM for every value of model parameters. In this algorithm, we first traced the entire solution path of the current classifier to find a series of candidate model parameters, and then used unlabeled samples to select the best model parameter. Besides, in the initial phase of training, we constructed a training sample sets by using an improved K-medoids cluster algorithm. Experimental results conducted from real-world data sets showed the effectiveness of the proposed algorithm for image classification problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Gosselin PH, Cord M (2008) Active learning methods for interactive image retrieval. IEEE Trans Image Process 17(7):1200–1211

    Article  MathSciNet  Google Scholar 

  2. Hastie T, Rosset S, Tibshirani R, Zhu J (2004) The entire regularization path for the support vector machine. J Mach Learn Res 5:1391–1415

    MathSciNet  MATH  Google Scholar 

  3. Hoi SC, Rong J, Lyu MR (2006) Large-scale text categorization by batch mode active learning. In: Proceedings of the 15th International Conference on World Wide Web. ACM 633-642

  4. Li X, Wang L, Sung E (2004) Multi-label SVM active learning for image classification. In: Proc Int Conf Image Process 4:2207–2210

    Google Scholar 

  5. Lughofer E (2012) Hybrid active learning for reducing the annotation effort of operators in classification systems. Pattern Recogn 45(2):884–896

    Article  Google Scholar 

  6. Pang Y, Ji Z, Jing P, Li X (2013) Ranking Graph embedding for learning to rerank. IEEE Trans Neural Netw Learn Syst 24(8):1292–1303

    Article  Google Scholar 

  7. Pang Y, Zhang K, Yuan Y, Wang K. Distributed object detection with linear SVMs. IEEE Transactions on Cybernetics, in press. DOI: 10.1109/TCYB.2014.2301453

    Article  Google Scholar 

  8. Qi G-J, Hua X-S, Rui Y, Tang JH, Mei T, Zhang H-J (2007) Correlative multi-label video annotation. In: Proceedings of ACM Multimedia, pp. 17-26

  9. Settles B (2010) Active learning literature survey. University of Wisconsin, Madison

    MATH  Google Scholar 

  10. Settles B, Craven M, Ray S (2007) Multiple-instance active learning. In: Proc Neural Inf Process Syst 20:1289–1296

    Google Scholar 

  11. Tian X, Tao D, Hua X-S, Wu X (2010) Active reranking for web image search. IEEE Trans Image Process 19(3):805–820

    Article  MathSciNet  Google Scholar 

  12. Tur G, Schapire RE, Hakkani-Tur D (2003) Active learning for spoken language understanding. In: Proc IEEE Int Conf Acoust Speech Signal Process 1:276–279

    Google Scholar 

  13. Wang M, Hua X-S (2011) Active learning in multimedia annotation and retrieval: A survey. ACM Trans Intell Syst Technol (TIST) 2(2):10

    Google Scholar 

  14. Wang M, Hua X-S, Mei T, Tang J, Qi G-J (2007) Interactive video annotation by multi-concept multi-modality active learning. Int J Semant Comput 1(4):459–477

    Article  Google Scholar 

  15. Wang M, Ni B, Hua X-S, Chua T-S (2012) Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Comput Surv (CSUR) 44(4):25

    Article  Google Scholar 

  16. Wang Z, Yan S, Zhang C (2011) Active learning with adaptive regularization. Pattern Recogn 44(10):2375–2383

    Article  Google Scholar 

  17. Yuan J, Zhou X, Zhang J, Wang M, Zhang Q, Wang W, Shi B (2007) Positive sample enhanced angle-diversity active learning for SVM based image retrieval. In: IEEE International Conference on Multimedia and Expo 2202-2205

  18. Zha Z-J, Wang M, Zheng Y-T, Yang Y, Hong R, Chua T.-S. Interactive video indexing with statistical active learning. IEEE Trans Multimedia 14:(1)17-2, 20127

    Article  Google Scholar 

  19. Zhu X, Lafferty J, Ghahramani Z (2003) Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In: ICML 2003 workshop on the continuum from labeled to unlabeled data in machine learning and data mining 58-65

  20. Zhu J, Wang H, Tsou BK, Ma M (2010) Active learning with sampling by uncertainty and density for data annotations. IEEE Trans Audio Speech Lang Process 18(6):1323–1331

    Article  Google Scholar 

  21. Zhu J, Wang H, Yao T, Tsou BK (2008) Active learning with sampling by uncertainty and density for word sense disambiguation and text classification. In: Proc 22nd Int Conf Comput Linguist 1:1137–1144

    Google Scholar 

Download references

Acknowledgement

This work is supported by National Natural Science Foundation of China under Grant No. 61272214.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fuming Sun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, F., Xu, Y. & Zhou, J. Active learning SVM with regularization path for image classification. Multimed Tools Appl 75, 1427–1442 (2016). https://doi.org/10.1007/s11042-014-2141-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2141-9

Keywords

Navigation