Abstract
Most of existing work on sports video analysis concentrates on highlight extraction. Few efforts devoted to the important issue as how to organize the extracted highlights which is adapt for the user preference. In this paper, we propose a novel approach to rank the highlights extracted from broadcast tennis video based on multi-modality analysis and relevance feedback. Firstly, visual and auditory features are employed to construct the mid-level representations for the content of broadcast tennis video. Then, the affective features are extracted from mid-level representations and the multiple ranking models are built using nonlinear regression algorithm. Finally, the ranking models are linearly combined to generate the final highlight ranking results. The relevance feedback technique is employed to effectively capture the user interest in visual and auditory attention spaces to adjust the ranking results being suitable to the user preference. The experimental results are encouraging and demonstrate that our approach is effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gong, Y., Lim, T., Chua, H., Zhang, H., Sakauchi, M.: Automatic parsing of tv soccer programs. In: IEEE International Conference on Multimedia Computing and Systems, pp. 167–174 (1995)
Zhu, G., Huang, Q., Xu, C., Rui, Y., Jiang, S., Gao, W., Yao, H.: Trajectory based event tactics analysis in broadcast sports video. In: ACM International Conference on Multimedia, pp. 58–67 (2007)
Ekin, A., Tekalp, A., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. on Imapge Processing 12(7), 796–807 (2003)
Xie, L., Xu, P., Chang, S., Divakaran, A., Sun, H.: Structure analysis of soccer video with domain knowledge and hidden markov models. Pattern Recognition Letter 25(7), 767–775 (2004)
Zhu, G., Huang, Q., Xu, C., Xing, L., Gao, W., Yao, H.: Human behavior analysis for highlight ranking in broadcast racket sports video. IEEE Trans. on Multimedia 9(6), 1167–1182 (2007)
Rui, Y., Gupta, A., Acero, A.: Automatically extracting highlights for tv baseball programs. In: ACM International Conference on Multimedia, pp. 105–115 (2002)
Assfalg, J., Bertini, M., Colombo, C., Bimbo, A.: Semantic annotation of sports videos. IEEE Multimedia 9(2), 52–60 (2002)
Babaguchi, N., Kawai, Y., Ogura, T., Kitahashi, T.: Personalized abstraction of broadcasted american football video by highlight selection. IEEE Trans. on Multimedia 6(4), 575–586 (2004)
Tong, X., Liu, Q., Zhang, Y., Lu, H.: Highlight ranking for sports video browsing. In: ACM International Conference on Multimedia, pp. 519–522 (2005)
Zheng, Y., Zhu, G., Jiang, S., Huang, Q., Gao, W.: Highlight ranking for rqcquest sports video in user attention subspaces based on relevance feedback. In: IEEE International Conference on Multimedia & Expo., vol. 1, pp. 104–107 (2007)
Treisman, A., Gelande, G.: A feature-integration theory of attention. Congnitive Psychology 12, 97–136 (1980)
Zhu, G., Xu, C., Huang, Q., Gao, W., Xing, L.: Player action recognition in broadcast tennis video with applications to semantic analysis of sports game. In: ACM International Conference on Multimedia, pp. 431–440 (2006)
Zhu, G., Xu, C., Huang, Q., Gao, W.: Automatic multi-player detection and tracking in broadcast sports video using support vector machine and particle filter. In: IEEE International Conference on Multimedia & Expo., vol. 1, pp. 629–632 (2006)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press, Cambridge (2003)
Xu, M., Duan, L., Xu, C., Tian, Q.: A fusion scheme of visual and auditory modalities for event detection in sports video. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 3, pp. 189–192 (2003)
Rui, Y., Huang, T., Ortega, M., Mehrotra, S.: Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. on Circuits and System for Video Technology 8(5), 644–655 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, G., Huang, Q., Gong, Y. (2008). Highlight Ranking for Broadcast Tennis Video Based on Multi-modality Analysis and Relevance Feedback. In: Huang, YM.R., et al. Advances in Multimedia Information Processing - PCM 2008. PCM 2008. Lecture Notes in Computer Science, vol 5353. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89796-5_69
Download citation
DOI: https://doi.org/10.1007/978-3-540-89796-5_69
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89795-8
Online ISBN: 978-3-540-89796-5
eBook Packages: Computer ScienceComputer Science (R0)