Abstract
Attention is a psychological measurement of human reflection against stimulus. We propose a general framework of highlight detection by comparing attention intensity during the watching of sports videos. Three steps are involved: adaptive selection on salient features, unified attention estimation and highlight identification. Adaptive selection computes feature correlation to decide an optimal set of salient features. Unified estimation combines these features by the technique of multi-resolution auto-regressive (MAR) and thus creates a temporal curve of attention intensity. We rank the intensity of attention to discriminate boundaries of highlights. Such a framework alleviates semantic uncertainty around sport highlights and leads to an efficient and effective highlight detection. The advantages are as follows: (1) the capability of using data at coarse temporal resolutions; (2) the robustness against noise caused by modality asynchronism, perception uncertainty and feature mismatch; (3) the employment of Markovian constrains on content presentation, and (4) multi-resolution estimation on attention intensity, which enables the precise allocation of event boundaries.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Besag, J.: Spatial interaction and statistical analysis of lattice system. Journal of Royal Statistical Society 36(2), 192–236 (1974)
Ekin, A., Tekalp, A., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. on Image Processing 12(7), 796–807 (2003)
Hanjalic, A.: Adaptive extraction of highlights from a sport video based on excitement modeling. IEEE Trans. on Multimedia 7(6), 1114–1122 (2005)
Hanjalic, A., Xu, L.Q.: Affective video content repression and model. IEEE Trans on Multimedia 7(1), 143–155 (2005)
Kang, Y., Lim, J., Kankanhalli, M., Xu, C.-S., Tian, Q.: Goal detection in soccer video using audio/visual keywords. In: ICIP 2004, vol. 3, pp. 1629–1632 (2004)
Kokaram, A., Rea, N., Dahyot, R., Tekalp, M., Bouthemy, P., Gros, P., Sezan, I.: Browsing sports video: trends in sports-related indexing and retrieval work. Signal Processing Magazine 23(2), 47–58 (2006)
Lenardi, R., Migliorati, P., Prandini, M.: Semantic indexing of soccer audio-visual sequence: A multimodal approach based on controlled markov chains. IEEE Trans. on Circuits and System for Video Technology 14, 634–643 (2004)
Lesser, M.J., Murray, D.K.C.: Mind as a dynamical system: Implications for autism. In: Durham conference Psychobiology of autism: current research and practice (1998)
Lew, M.S.: Principles of Visual Information Retrieval. Springer, Heidelberg (1996)
Ma, Y., Lu, L., Zhang, H., Li, M.: A user attention model for video summarization. In: ACM Multimedia 2002 (2002)
News, G.: 3g football best mobile service (January 2005)
Ren, R., Jose, J.M., He, Y.: Affective sports highlight detection. In: The 15th European Signal Processing Conference, Poznan, Poland, September 2007, pp. 728–732 (2007)
Tagare, H.D., Toyama, K., Wang, J.G.: A maximum-likelihood strategy for directing attention during visual search. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(5), 490–500 (2001)
Treisman, A.M., Kanwisher, N.G.: Perceiving visually presented objects: recognition, awareness, and modularity. Current Opinion in Neurobiology 8, 218–226 (1988)
Willsky, A.: Multiresolution markov models for signal and image processing. Proceedings of the IEEE 90(8), 1396–1458 (2002)
Xu, C., Wang, J., Wan, K., Li, Y., Duan, L.: Live sports event detection based on broadcast video and web-casting text. In: ACM Multimedia 2006 (2006)
Xu, G., Ma, Y., Zhang, H., Yang, S.: An hmm-based framework for video semantic analysis. IEEE Trans. on Circuits and System for Video Technology 15, 1422–1433 (2005)
Zettl, H.: Sight, Sound, Motion: Applied Media Aesthetics. Wadsworth, Belmont CA (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ren, R., Jose, J.M. (2009). General Highlight Detection in Sport Videos. In: Huet, B., Smeaton, A., Mayer-Patel, K., Avrithis, Y. (eds) Advances in Multimedia Modeling . MMM 2009. Lecture Notes in Computer Science, vol 5371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92892-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-92892-8_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92891-1
Online ISBN: 978-3-540-92892-8
eBook Packages: Computer ScienceComputer Science (R0)