ABSTRACT
Video classification is the first step toward multimedia content understanding. When video is classified into conceptual categories, it is usually desirable to combine evidence from multiple modalities. However, combination strategies in previous studies were usually ad hoc. We investigate a meta-classification combination strategy using Support Vector Machine, and compare it with probability-based strategies. Text features from closed-captions and visual features from images are combined to classify broadcast news video. The experimental results show that combining multimodal classifiers can significantly improve recall and precision, and our meta-classification strategy gives better precision than the approach of taking the product of the posterior probabilities.
- Baeza-Yates, R. and Ribeiro-Neto, B. Modern Information Retrieval. Addison-Wesley, 2000. Google ScholarDigital Library
- Chang, C.-C. and Lin, C.-J. LIBSVM: a library for support vector machines. 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm. Google ScholarDigital Library
- Cristianini, N. and Shawe-Taylor, J. An Introduction to Support Vector Machines and other Kernel-based Learning Methods. Cambridge University Press, 2000. Google ScholarDigital Library
- Dimitrova N., Agnihotri, L. and Wei G. Video Classification Based on HMM Using Text and Faces. European Conference on Signal Processing, Finland, 2000.Google Scholar
- Huang, J., Liu, Z., Wang, Y., Chen, Y. and Wong, E.K. Integration of Multimodal Features for Video Scene Classification Based on HMM. IEEE Third Workshop on Multimedia Signal Processing, Copenhagen, Denmark, 1999.Google Scholar
- Joachims, T. Text Categorization with Support Vector Machines: Learning with Many Relevant Features. In Proceedings of European Conference on Machine Learning, 1998. Google ScholarDigital Library
- Kittler, J., Hatef, M., Duin, R.P.W. and Mates, J. On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3), 1998. Google ScholarDigital Library
- Lin, W.-H., Jin. R. and Hauptmann, A. Meta-classification of Multimedia Classifiers. International Workshop on Knowledge Discovery in Multimedia and Complex Data, Taipei, Taiwan, 2002.Google Scholar
- Liu, Z., Huang, J. and Wang, Y. Classification of TV Programs Based on Audio Information Using Hidden Markov Model. IEEE Workshop on Multimedia Signal Processing, 1998.Google Scholar
- Lu, C., Drew, M.S. and Au, J. Classification of Summarized Videos using Hidden Markov Models on Compressed Chromaticity Signatures. ACM Multimedia, Ottawa, Canada, 2001. Google ScholarDigital Library
- Papageorgiou, C., Oren, M. and Poggio, T. A General Framework for Object Detection. In Proceedings of International Conference on Computer Vision, 1998. Google ScholarDigital Library
- Schölkopf, B., Sung, K.-K., Burges, C., Giroso, F., Niyogi, P., Poggio, T. and Vapnik, V. Comparing Support Vector Machine with Gaussian Kernels to Radial Basis Function Classifiers. IEEE Transactions on Signal Processing, 45(11), 1997. Google ScholarDigital Library
- Vapnik, V.N. The Nature of Statistical Learning Theory. 2nd ed. Springer, New York, 2000. Google ScholarDigital Library
- Wactlar, H.D., Kanade, T., Smith, M.A. and Stevens, S.M., Intelligent Access to Digital Video: Informedia Project. IEEE Computer, 29(5), 1996. Google ScholarDigital Library
- Wang, Y., Liu, Z. and Huang, J.-C. Multimedia Content Analysis Using Both Audio and Visual Clues. IEEE Signal Processing Magazine, 2000.Google Scholar
- M. F. Porter. An algorithm for suffix stripping. Program, 14(3):130--137, July 1980.Google ScholarCross Ref
- News video classification using SVM-based multimodal classifiers and combination strategies
Recommendations
AdaBoost with SVM-based component classifiers
The use of SVM (Support Vector Machine) as component classifier in AdaBoost may seem like going against the grain of the Boosting principle since SVM is not an easy classifier to train. Moreover, Wickramaratna et al. [2001. Performance degradation in ...
AdaBoost classifiers for pecan defect classification
Highlights The performance of AdaBoost algorithms were compared with support vector machine and Bayesian classifiers for pecan defect classification. AdaBoost classifiers took least time and gave best classification accuracy. AdaBoost classifiers ...
Multi-class Support Vector Machine (SVM) Classifiers -- An Application in Hypothyroid Detection and Classification
BIC-TA '11: Proceedings of the 2011 Sixth International Conference on Bio-Inspired Computing: Theories and ApplicationsThe paper presents a Multi-class Support Vector Machine classifier and its application to hypothyroid detection and classification. Support Vector Machines (SVM) have been well known method in the machine learning community for binary classification ...
Comments