Abstract
In this paper, we present a robust approach to real-time tracking of multiple objects in mediated environments using a set of calibrated color and IR cameras. Challenges addressed in this paper include robust object tracking in the presence of color projections on the ground plane and partial/complete occlusions. To improve tracking in such complex environment, false candidates introduced by ground plane projection or mismatching of objects between views are removed by using the epipolar constraint and the planar homography. A mixture of Gaussian is learned using the expectation-maximization algorithm for each target to further refine the 3D location estimates. Experimental results demonstrate that the proposed approach is capable of robust and accurate 3D object tracking in a complex environment with a great amount of visual projections and partial/complete occlusions.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ascension, http://www.ascension-tech.com/
Cave, http://en.wikipedia.org/wiki/Cave_Automatic_Virtual_Environment
Intersense, http://www.isense.com/
Birchfield, D., Ciufo, T., Minyard, G., Qian, G., Savenye, W., Sundaram, H., Thornburg, H., Todd, C.: Smallab: a mediated platform for education. In: Proceedings of ACM SIGGRAPH, Boston, MA (2006)
Black, J., Ellis, T., Rosin, P.: Multi view image surveillance and tracking. In: IEEE Workshop on Motion and Video Computing (2002)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Huang, Y., Essa, I.: Tracking multiple objects through occlusions. In: IEEE Conf. on Computer Vision and Pattern Recognition, II, pp. 1051–1058 (2005)
Jurie, F., Dhome, M.: Real time tracking of 3D objects with occultations. In: Int’l Conf. on Image Processing, I, pp. 413–416 (2001)
Moeslund, T.B., Hilton, A., Kruger, V.: A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104(2), 90–126 (2006)
Pan, J., Hu, B.: Robust occlusion handling in object tracking. In: IEEE Workshop on Object Tracking and Classification Beyond the Visible Spectrum, pp. 1–8 (2007)
Svoboda, T., Martinec, D., Pajdla, T.: A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments 14(4), 407–422 (2005)
Wang, L., Hu, W., Tan, T.: Recent development in human motion analysis. Pattern Recognition 36, 585–601 (2003)
Yang, T., Li, S.Z., Pan, Q., Li, J.: Real-time multiple objects tracking with occlusion handling in dynamic scenes. In: IEEE Conf. on Computer Vision and Pattern Recognition, I, pp. 970–975 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jin, H., Qian, G., Birchfield, D. (2008). Real-Time Multi-view Object Tracking in Mediated Environments. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-77409-9_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77407-5
Online ISBN: 978-3-540-77409-9
eBook Packages: Computer ScienceComputer Science (R0)