Abstract
In this paper we present a system to recognize the hand motion of Taiwanese Sign Language (TSL) using the Hidden Markov Models (HMMs) through a vision-based interface. Our hand motion recognition system consists of four phases: construction of color model, hand tracking, trajectory representation, and recognition. Our hand tracking can accurately track the hand positions. Since our system is recognized to hand motions that are variant with rotation, translation, symmetric, and scaling in Cartesian coordinate system, we have chosen invariant features which convert our coordinate system from Cartesian coordinate system to Polar coordinate system. There are nine hand motion patterns defined for TSL. Experimental results show that our proposed method successfully chooses invariant features to recognition with accuracy about 90%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Stokoe, W.C.: Sign Language Structure: An outline of the Visual Communication System of the American Deaf, Buffalo, N.Y., Univ. of Buffalo (1960)
Campbell, L.W., Becker, D.A., Azarbayejani, A., Bobick, A.F., Pentland, A.: Invariant Features for 3-D Gesture Recognition. In: Proc. IEEE Int’l Conf. FG, Zurich, pp. 157–162 (1996)
Montero, J.A.V., Sucar, L.E.S.: Feature Selection for Visual Gesture Recognition Using Hidden Markov Models. In: Proc. IEEE Int’l Conf. Computer Science, Mexican, pp. 196–203 (2004)
Lee, H.K., Kim, J.H.: An HMM-based Threshold Model Approach for Gesture Recognition. IEEE Trans. Pattern Anal. Machine Intell. 21(10), 961–973 (1999)
Habili, N., Lim, C.C., Moini, A.: Segmentation of the Face and Hands in Sign Language Video Sequences Using Color and Motion Cues. IEEE Trans. Circuits Syst. Video Techn. 14(8) (October 2004)
Yoon, H.S., Soh, J., Ming, B.W., Yang, H.S.: Recognition of Alphabetical Hand Gestures Using Hidden Markov Model. IEICE Trans. Fund. Electr. 87, 1358–1366 (1999)
Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. IEEE Trans ASSP 77(2), 257–286 (1989)
Yang, M.H., Ahuja, N., Tabb, M.: Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition. IEEE Trans. Pattern Anal. Machine Intell. 24(8), 1061–1074 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheng, CS., Hsieh, PF., Wu, CH. (2005). Hand Motion Recognition for the Vision-based Taiwanese Sign Language Interpretation. In: Tao, J., Tan, T., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol 3784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573548_21
Download citation
DOI: https://doi.org/10.1007/11573548_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29621-8
Online ISBN: 978-3-540-32273-3
eBook Packages: Computer ScienceComputer Science (R0)