Abstract
This paper discusses the design of a working system that visually recognizes hand gestures for the control of a window based user interface. We present a method for tracking the fingertip of the index finger using a single camera. Our method is based on CAMSHIFT algorithm and it tracks well particular hand poses used in the system in complex backgrounds. We describe how the location of the fingertip is mapped to a location on the monitor, and how it is both necessary and possible to smooth the path of the fingertip location using a physical model of a mouse pointer. Our method is able to track in real time, yet does not absorb a major share of computational resources. The performance of our system shows a great promise that we will be able to use this methodology to control computers in near future.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Gary R. Bradski, “Computer Vision Face Tracking For Use in a Perceptual User Interface”, Intel Technology Journal Q2, 1998.
R. Kjeldsen and J. Kender “Interaction with On-Screen Objects using Visual Gesture Recognition” IEEE Conference on Computer Vision and Pattern Recognition, pp. 788–793, 1997.
C. Jennings, “Robust finger tracking with multiple cameras”, International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 152–160, 1999.
J. Rehg and T. Kanade, “Visual Analysis of High DOF Articulated Object with Application to Hand Tracking”, CMU Tech. Report CMU-CS-95-138, Carnegie Mellon University, April, 1993.
R. Kjeldsen and J. Kender, “Towards the use of Gesture in Traditional User Interfaces”, International Conference on Automatic Face and Gesture Recognition, pp. 151–156, 1996.
B. K. P. Horn, “Robot vision”, MIT Press, 1986.
Andrew Wu, Mubarak Shah and N. da Vitoria Lobo, “A Virtual 3D Blackboard: 3D Finger Tracking using a Single Camera” Proceedings of the Fourth International Conference on Atomatic Face and Gesture Reconition, pp. 536–543, 2000.
W. T. Freeman, K. Tanaka, J. Ohta and K. Kyuma, “Computer vision for computer games” Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp. 100–105, 1996.
Harvey Gould and Jan Tobochnik, “An Introduction to Computer Simulation Methods”, Addison Wesley Publishing Company, 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, J., Yi, J. (2003). Efficient Fingertip Tracking and Mouse Pointer Control for a Human Mouse. In: Crowley, J.L., Piater, J.H., Vincze, M., Paletta, L. (eds) Computer Vision Systems. ICVS 2003. Lecture Notes in Computer Science, vol 2626. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36592-3_9
Download citation
DOI: https://doi.org/10.1007/3-540-36592-3_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00921-4
Online ISBN: 978-3-540-36592-1
eBook Packages: Springer Book Archive