Abstract
We show that the way people observe video sequences, other than what they observe, is important for the understanding and the prediction of human activities. In this study, we consider 36 surveillance videos, organized in four categories (confront, nothing, fight, play): the videos are observed by 19 people, ten of them are experienced operators and the other nine are novices, and the gaze trajectories of both populations are recorded by an eye tracking device. Due to the proved superior ability of experienced operators in predicting violence in surveillance footage, our aim is to distinguish the two classes of people, highlighting in which respect expert operators differ from novices. Extracting spatio-temporal features from the eye tracking data, and training standard machine learning classifiers, we are able to discriminate the two groups of subjects with an average accuracy of 80.26%. The idea is that expert operators are more focused on few regions of the scene, sampling them with high frequency and low predictability. This can be thought as a first step toward the advanced automated analysis of video surveillance footage, where machines imitate as best as possible the attentive mechanisms of humans.
Chapter PDF
Similar content being viewed by others
References
Bahill, A.T., Clark, M.R., Stark, L.: The main sequence, a tool for studying human eye movements. Math. Biosci. (2) (1975)
Blechko, A., Darker, I., Gale, A.: Skills in detecting gun carrying from CCTV. In: International Carnahan Conference on Security Technology (2008)
Cristani, M., Murino, V., Vinciarelli, A.: Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space. In: CVPRW 2010, pp. 51–58 (2010)
Cristani, M., Raghavendra, R., Del Bue, A., Murino, V.: Human behavior analysis in video surveillance: A social signal processing perspective. Neurocomputing 100, 86–97 (2013)
Hales, G., Lewis, C., Silverstone, D.: Gun Crime: The Market in and Use of Illegal Firearms. Findings (Great Britain. Home Office. Research, Development and Statistics Directorate). Home Office (2006)
Henderson, J.M., Weeks, P.A., Hollingworth, A.: Multi-feature object trajectory clustering for video analysis. IEEE Transactions on Circuits and Systems for Video Technology 18(11), 1555–1564 (2008)
Ji, R., Sun, X., Yao, H.: What are we looking for: Towards statistical modeling of saccadic eye movements and visual saliency. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, vol. (3), pp. 1552–1559 (2012)
Kasarskis, P., Stehwien, J., Hickox, J., Aretz, A., Wickens, C.: Comparison of expert and novice scan behaviors during vfr flight. In: Proceedings of the 11th International Symposium on Aviation Psychology (2001)
Land, M.F., Hayhoe, M.: In what ways do eye movements contribute to everyday activities? Vision research 41(25-26), 3559–3565 (2001)
Land, M.F., Lee, D.N.: Where we look when we steer. Nature 369, 742–744 (1994)
Law, B., Atkins, M.S., Kirkpatrick, A.E., Lomax, A.J.: Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment, pp. 41–48 (2004)
Petrini, K., McAleer, P., Neary, C., Gillard, J., Pollick, F.E.: Experience in judging intent to harm modulates parahippocampal activity: an fmri study with experienced cctv operators. In: European Conference on Visual Perception (2012)
Pratt, J.: Visual fixation offsets affect both the initiation and the kinematic features of saccades. Experimental Brain Research 118(1), 135–138 (1998)
Rayner, K.: Eye movements in reading and information processing: 20 years of research.. Psychological bulletin 124(3), 372–422 (1998)
Torralba, A.: Modeling global scene factors in attention. Journal of the Optical Society of America. A, Optics, image science, and vision 20(5), 1407–1418 (2003)
Torralba, A., Castelhano, M.S., Oliva, A., Henderson, J.M.: Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 113 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Roffo, G., Cristani, M., Pollick, F., Segalin, C., Murino, V. (2013). Statistical Analysis of Visual Attentional Patterns for Video Surveillance. In: Ruiz-Shulcloper, J., Sanniti di Baja, G. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2013. Lecture Notes in Computer Science, vol 8259. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41827-3_65
Download citation
DOI: https://doi.org/10.1007/978-3-642-41827-3_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41826-6
Online ISBN: 978-3-642-41827-3
eBook Packages: Computer ScienceComputer Science (R0)