Abstract
With the flourish development of computer vision technology, hand gesture recognition plays a more and more vital role in human-computer interaction for its convenient and nonverbal communication. However, confusion caused by similar gestures brings inherent errors when considering enough meaningful gestures in the database. In this paper, an automatic feature extraction for similar gesture recognition is proposed with respect to confusion arising in similar gestures. Except the orientation feature, four additional innovative features are extracted to distinguish all the similar gestures remarkably in the experimental database containing 10 numbers and 26 letters. Compared with the conventional method that a couple of similar gestures are extracted as a specific feature, the proposed method distinguishes similar gestures with automatic distinctive feature extraction. Experimental results show high recognition rate and versatility of the proposed method.
Similar content being viewed by others
References
H. Liu, Y. Liu, and F. Sun, “Robust exemplar extraction using structured sparse coding,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 8, pp. 1816–1821, Aug. 2015. [click]
E. Elhamifar, G. Sapiro, and R. Vidal, “See all by looking at a few: sparse modeling for finding representative objects” Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1600–1607 2012.
H. Liu, Y. Liu, Y. Yu, and F. Sun, “Diversified key-frame selection using structured L2;1 optimization,” IEEE Transactions on Industrial Informatics, vol. 10, no. 3, pp. 1736–1745, Aug. 2014. [click]
Y. Hong, W. Huang, and C-C Jay Kuo, Cooperative Communications and Networking: Technologies and System Design, Springer Science & Business Media, 2010.
S. I. Han and J. M. Lee, “Backstepping sliding mode control with FWNN for strict output feedback non-smooth nonlinear dynamic system,” International Journal of Control, Automation, and Systems, vol. 11, no. 2, pp. 389–409, 2015.
W. S. Lin and K. R. Liu, “Optimal pricing for mobile video streaming using behavior analysis” IEEE Global Telecommunications Conference (GLOBECOM), pp. 1–4 2010.
W. S. Lin and K. R. Liu, “Pricing game and evolution dynamics for mobile video streaming” Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2348–2351 2011.
H. Cheng, Z. Liu, L. Hou, and J. Yang, “Sparsity-induced similarity measure and its applications,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 4, pp. 613–626, April 2016. [click]
H. Liu, M. Yuan, and F. Sun, “RGB-D action recognition using linear coding,” Neurocomputing, vol. 149, Part A, pp. 79–85, Feb. 2015. [click]
J. Lee, M.-H. Jeong, J. Lee, K. Kim, and B.-J. You, “3D pose tracking using particle filter with back projectionbased sampling,” International Journal of Control, Automation, and Systems, vol. 10, no. 6, pp. 1232–1239, 2012. [click]
Z. Kan, J. M. Shea, and W. E. Dixon, “Influencing emotional behavior in a social network” Proc. of 2012 American Control Conference (ACC), pp. 4072–4077 2012.
H. V. Zhao, W. S. Lin, and K. R. Liu, Behavior Dynamics in Media-Sharing Social Networks, Cambridge University Press, 2011.
M. M. Gharasuie and H. Seyedarabi, “Real-time dynamic hand gesture recognition using hidden Markov models” Proc. of 8th Iranian Conference on Machine Vision and Image Processing (MVIP), pp. 194–199 2013.
T. Fong, I. Nourbakhsh, and K. Dautenhahn, “A survey of socially interactive robots,” Robotics and Autonomous Systems, vol. 42, no. 3-4, pp. 143–166, 2003. [click]
D. Xu, X. Wu, Y.-L. Chen, and Y. Xu, “Online dynamic gesture recognition for human robot interaction,” Journal of Intelligent & Robotic Systems, vol. 77, no. 3, pp. 583–596, 2015. [click]
J. Wang, H. Liu, M. Gao, and F. Sun, “Information fusionbased mobile robot path control” Proc. of 24th Chinese Control and Decision Conference (CCDC), pp. 212–217 2012.
S. Roy, S. Nandy, R. Ray, and S. N. Shome, “Robust path tracking control of nonholonomic wheeled mobile robot: experimental validation,” International Journal of Control, Automation, and Systems, vol. 13, no. 4, pp. 897–905, 2015. [click]
H. Wang, J. Fu, Y. Lu, X. Chen, and S. Li, “Depth sensor assisted real-time gesture recognition for interactive presentation,” Journal of Visual Communication and Image Representation, vol. 24, no. 8, pp. 1458–1468, 2013. [click]
S. Berman and H. Stern, “Sensors for gesture recognition systems,” IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 42, no. 3, pp. 277–290, 2012. [click]
J. Wu, J. Cheng, and W. Feng, “3D dynamic gesture recognition based on improved HMMs with entropy” Proc. of IEEE International Conference on Information and Automation (ICIA), pp. 213–218 2014.
M. Elmezain, “Hand gesture spotting and recognition using HMMs and CRFs in color image sequences,” PhD Thesis, Computer Science Dept., Magdeburg Univ, 2010.
Q. Wang, Y. Xu, X. Bai, D. Xu, Y.-L. Chen, and X. Wu, “Dynamic gesture recognition using 3D trajectory” Proc. of IEEE International Conference on Information Science and Technology (ICIST), pp. 598–601 2014. [click]
H. H. Aviles-Arriaga, L. E. Sucar, and C. E. Mendoza, “Visual recognition of similar gestures” Proc. of 18th International Conference on Pattern Recognition (ICPR), pp. 1100–1103 2006.
Z. Chu and F. Sun, “Robust tracking control of electrical driven free-floating space robot manipulators” Proc. of International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1–6 2006.
B.-W. Choi, S.-H. Lee, and S.-Y. Yi, “Internet coordinated pet robot simulator based on MSRDS” Proc. of ICCASSICE, pp. 2496–2498 2009.
J.-H. Park, D.-J. Kang, M.-S. Shin, S.-J. Lim, S.-C. Yu, K.-S. Lee, J.-E. Ha, and S.-H. Choa, “Easy calibration method of vision system for in-situ measurement of strain of thin films,” Transactions of Nonferrous Metals Society of China, vol. 19, sup. 1, pp. 243–249, 2009.
H. J. Koh, W. J. Lee, and M. G. Chun, “A multimodal iris recognition using Gabor transform and Contourlet” Proc. of 2nd International Conference on Signal Processing and Communication System (ICSPCS), pp. 1–6 2008.
A. Al-Hamadi, M. Elmezain, and B. Michaelis, “Hand gesture recognition based on combined feature extraction,” International Journal of Information and Mathematical Sciences, vol. 6, no. 1, 2010.
C. C. Aggarwal and C. K. Reddy, Data Clustering: Algorithms and Applications, CRC Press, 2013.
S.-F. Tsai, L. Cao, and F. Tang, and T. S. Huang, “Compositional object pattern: a new model for album event recognition” Proceedings of the 19th ACM international conference on Multimedia, pp. 1361–1364 2011.
S.-I. Han and J.-M. Lee, “Decentralized neural network control for guaranteed tracking error constraint of a robot manipulator,” International Journal of Control, Automation, and Systems, vol. 13, no. 4, pp. 906–915, 2015. [click]
L. Yun and Z. Peng, “An automatic hand gesture recognition system based on Viola-Jones method and SVMs” Proc. of Second International Workshop on Computer Science and Engineering (WCSE), pp. 72–76 2009.
B.-W. Min, H.-S. Yoon, J. Soh, Y.-M Yang, and T. Ejima, “Hand gesture recognition using hidden Markov models,” Proc. of IEEE International Conference on Computational Cybernetics and Simulation, vol. 5, pp. 4232–4235, 1997. [click]
W. T. Freeman and M. Roth, “Orientation histograms for hand gesture recognition” International workshop on automatic face and gesture recognition, pp. 296–301 1995.
J. W. Deng and H.-T. Tsui, “An HMM-based approach for gesture segmentation and recognition” Proc. of 15th International Conference on Pattern Recognition, pp. 689–672 2000.
Wahyono and K.-H. Jo, “Information retrieval of LED text on electronic road sign for driver-assistance system using spatial-based feature and Nearest Cluster Neighbor classifier” Proc. of IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 531–536 2014. [click]
Author information
Authors and Affiliations
Corresponding author
Additional information
Recommended by Associate Editor Huaping Liu under the direction of Editor Euntai Kim. The work described in this paper is partially supported by National Science Foundation of China (61403364, 61473277), Shenzhen Fundamental Research Program (JCYJ2014091003939022), Guandong public welfare research and capacity building project (2014A010103020), and Guangdong Innovative Research Team Program (201001D0104648280).
Zeyu Ding received his Master degree from University of Science and Technology of China in 2016, and Bachelor of Engineering degree in Electronic Information Engineering from Hefei university of technology in 2013. His research interests include gesture recognition and computer vision.
Yanmei Chen received her Master degree from Wuyi University in 2016, and Bachelor of Engineering degree in Information and Communication Engineering from Wuyi University in 2013. Her research interests include image processing and computer vision.
Yen-Lun Chen received her B.S. and M.S. degrees from Department of Electrical Engineering at National Taiwan University, and Ph.D. degree from Department of Electrical and Computer Engineering at the Ohio State University. Her research interests include machine learning, pattern recognition, computer vision, and multimedia signal processing.
Xinyu Wu is a Professor at Shenzhen Institutes of Advanced Technology, and an associate director of Center for Intelligent and Biomimetic Systems. He received his BE and ME degrees from Department of Automation, University of Science and Technology of China, in 2001 and 2004, respectively. His PhD degree was awarded at the Chinese University of Hong Kong in 2008. He has published over 80 papers and a monograph. His research interests include computer vision, robotics, and intelligent system.
Rights and permissions
About this article
Cite this article
Ding, Z., Chen, Y., Chen, YL. et al. Similar hand gesture recognition by automatically extracting distinctive features. Int. J. Control Autom. Syst. 15, 1770–1778 (2017). https://doi.org/10.1007/s12555-015-0403-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-015-0403-6