Abstract
Video retrieval using high-level indices is more meaningful than querying using low-level features. In this paper, we show how perceptual features such as time-to-collision (TTC) can lead to several high-level categories. Experiments have been conducted to validate our proposed TTC detection algorithm to compute TTC from the divergence of the image velocity field. A simple and novel method named as the pilot cue is used to further refine our algorithm. Our initial system works with a rule-based approach where the extracted TTC shots (low-level feature) are mapped to their corresponding high-level indices. The information conveyed by their neighboring frames or shots (i.e. contextual information) is used to facilitate the mapping process. Several psychological effects (high-level indices) such as intimacy, suspense and terror are recovered as a result.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ball, W., Tronick, E.: Infant Responses to Impending Collision: Optical and Real. Science, New Series 171(3973), 818–820 (1971)
Prince, S.: Movies and Meaning: An Introduction to Film. Allyn & Bacon (1997)
Boggs, J.M.: The Art of Watching Films, 4th edn. Mayfield Publishing Co. (1996)
Mitry, J.: The Aesthetics and Psychology of the Cinema translated by Christopher King. Indiana University Press (1998)
Mamer, B.: Film Production Technique: Creating the Accomplished Image, 2nd edn. Wadsworth – a division of Thomson Learning (1999)
Miller, W.: Screenwriting for Film and Television. Allyn and Bacon (1998)
Peacock, R.B.: The Art of Movie Making: Script to Screen. Prentice-Hall, Englewood Cliffs (2001)
Horn, B.K.P., Schunck, B.G.: Determining Optical Flow. A.I. Memo No. 572 (April 1980)
Proesmans, M., Van Gool, L., Pauwels, E., Oosterlinck, A.: Determining of Optical Flow and its Discontinuities using Non-Linear Diffusion. In: 3rd European Conference on Computer Vision, vol. 2, pp. 295–304 (1994)
Subbarao, M.: Interpretation of Visual Motion: A Computational Study. Pitman Publishing Limited (1988)
Cutting, J.E., Vishton, P.M., Braren, P.A.: How We Avoid Collisions With Stationary and Moving Obstacles. Psychological Review 102(4), 627–651 (1995)
Meyer, F.G.: Time-to-collision from First-order models of the motion fields. IEEE Transactions of robotics and automation, 792–798 (1994)
Marr, D.: Vision: A computational investigation into the human representation and processing of visual information. Freeman, New York (1982)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mittal, A., Sung, WK. (2003). Video Retrieval by Context-Based Interpretation of Time-to-Collision Descriptors. In: Petkov, N., Westenberg, M.A. (eds) Computer Analysis of Images and Patterns. CAIP 2003. Lecture Notes in Computer Science, vol 2756. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45179-2_26
Download citation
DOI: https://doi.org/10.1007/978-3-540-45179-2_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40730-0
Online ISBN: 978-3-540-45179-2
eBook Packages: Springer Book Archive