Abstract
We propose an empirical computational model for generating an interpretation of a video shot based on our proposed principle of perceptual prominence. The principle of perceptual prominence captures the key aspects of mise-en-scène required for interpreting a video scene. We present a novel approach for applying perceptual grouping principles to the spatio-temporal domain of video. Our spatio-temporal perceptual grouping scheme, applied on blob tracks, makes use of a specified spatio-temporal coherence model. A high level semantic interpretation of scenes is done using the mise-en-scène features and the perceptual prominence computed for the perceptual clusters.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Itti, L.: Models of Bottom-Up and Top-Down Visual Attention. PhD thesis, California Institute of Technology, Pasadena, California (2000)
Nicolescu, M., Medioni, G.: Perceptual Grouping from Motion Cues Using Tensor Voting in 4-D. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 303–308. Springer, Heidelberg (2002)
Shah, M., Rangarajan, K., Tsai, P.S.: Generation and Segmentation of Motion Trajectories, vol. 1, pp. 74–77 (1992)
Sarkar, S.: Tracking 2D Structures using Perceptual Organization Principles. In: Symposium on Computer Vision SCV 95, 283–288
Sarkar, S., Majchrzak, D., Korimilli, K.: Perceptual Organization Based Computational Model for Robust Segmentation of Moving Objects, vol. 86, pp. 141–170 (2002)
Vasseur, P., Pagard, C., Mouaddib, E.M., Delahoche, L.: Perceptual Organization Approach based on Dempster-Shafer Theory. Pattern Recognition 8, 1449–1462 (1999)
Lowe, D.G.: Perceptual Organization and Visual Recognition. Kluwer, Boston (1985)
Shashua, A., Ullman, S.: Structural Saliency: The Detection of Globally Salient Structures using locally Connected Network, pp. 321–327 (1988)
Leeuwenberg, E.L.J.: Quantification of certain visual pattern properties: Salience, Transparency, Similarity. In: Leeuwenberg, E.L.J., Buffart, J.F.J.M. (eds.) Formal Theories of Visual Perception, pp. 277–298. Wiley, New York (1978)
Lawton, D.T., Connell, C.C.M.: Perceputal Organization using Interestingness. In: Workshop Spatial Reasoning and Multi-Sensor Fusion, pp. 405–419 (1987)
DeMenthon, D., Megret, R.: Spatio-temporal segmentation of video by hierarchical mean shift analysis. Technical Report LAMP-TR-090, University of Maryland, College Park, MD 20742, USA (2002)
Wertheimer, M.: Laws of organization in perceptual forms. In: Ellis, W.B. (ed.) A Sourcebook of Gestalt Psychology, Harcourt, Brace and Company (1938)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Harit, G., Chaudhury, S. (2006). Video Scene Interpretation Using Perceptual Prominence and Mise-en-scène Features. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3852. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612704_57
Download citation
DOI: https://doi.org/10.1007/11612704_57
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31244-4
Online ISBN: 978-3-540-32432-4
eBook Packages: Computer ScienceComputer Science (R0)