Skip to main content
SpringerLink
Log in

Hand Gesture Recognition Using Infrared Imagery Provided by Leap Motion Controller

  • Conference paper
  • First Online:
Advanced Concepts for Intelligent Vision Systems (ACIVS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10016))

Abstract

Hand gestures are one of the main alternatives for Human-Computer Interaction. For this reason, a hand gesture recognition system using near-infrared imagery acquired by a Leap Motion sensor is proposed. The recognition system directly characterizes the hand gesture by computing a global image descriptor, called Depth Spatiograms of Quantized Patterns, without any hand segmentation stage. To deal with the high dimensionality of the image descriptor, a Compressive Sensing framework is applied, obtaining a manageable image feature vector that almost preserves the original information. Finally, the resulting reduced image descriptors are analyzed by a set of Support Vectors Machines to identify the performed gesture independently of the precise hand location in the image. Promising results have been achieved using a new hand-based near-infrared database.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Achlioptas, D.: Database-friendly random projections: Johnson-Lindenstrauss with binary coins. J. Comput. Syst. Sci. 66(4), 671–687 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  2. Aditya, R., Namrata, V., Santanu, C., Subhashis, B.: Recognition of dynamic hand gestures. Pattern Recogn. 36(9), 2069–2081 (2003)

    Article  MATH  Google Scholar 

  3. Choi, E., Lee, C.: Feature extraction based on the Bhattacharyya distance. Pattern Recogn. 36(8), 1703–1709 (2003)

    Article  Google Scholar 

  4. Deng-Yuan, H., Wu-Chih, H., Sung-Hsiang, C.: Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination. Expert Syst. Appl. 38(5), 6031–6042 (2011)

    Article  Google Scholar 

  5. Eldar, Y.C., Kutyniok, G.: Compressed Sensing: Theory and Applications. Cambridge University Press, Cambridge (2012)

    Book  Google Scholar 

  6. Gieser, S.N., Boisselle, A., Makedon, F.: Real-time static gesture recognition for upper extremity rehabilitation using the leap motion. In: Duffy, V.G. (ed.) DHM 2015. LNCS, vol. 9185, pp. 144–154. Springer, Heidelberg (2015). doi:10.1007/978-3-319-21070-4_15

    Chapter  Google Scholar 

  7. Tran, T.T.H.: How can human communicate with robot by hand gesture? In: International Conference on Computing, Management and Telecommunications, pp. 235–240, January 2013

    Google Scholar 

  8. Jiang, F., Wang, C., Gao, Y., Wu, S., Zhao, D.: Discriminating features learning in hand gesture classification. IET Comput. Vis. 9(5), 673–680 (2015)

    Article  Google Scholar 

  9. Kai-Yin, F., Ganganath, N., Chi-Tsun, C., Tse, C.: A real-time ASL recognition system using Leap Motion sensors. In: International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 411–414, September 2015

    Google Scholar 

  10. Kim, J., Ryu, J., Han, T.: Multimodal interface based on novel HMI UI/UX for in-vehicle infotainment system. ETRI J. 37(4), 793–803 (2015)

    Article  Google Scholar 

  11. Kopinski, T., Geisler, S., Handmann, U.: Gesture-based human-machine interaction for assistance systems. In: IEEE International Conference on Information and Automation, pp. 510–517, August 2015

    Google Scholar 

  12. Kuizhi, M., Lu, X., Boliang, L., Bin, L., Fang, W.: A real-time hand detection system based on multi-feature. Neurocomputing 158, 184–193 (2015)

    Article  Google Scholar 

  13. Mantecon, T., del Blanco, C.R., Jaureguizar, F., Garcia, N.: New generation of human machine interfaces for controlling UAV through depth-based gesture recognition. In: Proceedings of the SPIE, vol. 9084, May 2014

    Google Scholar 

  14. Mantecon, T., Mantecon, A., del Blanco, C., Jaureguizar, F., Garcia, N.: Enhanced gesture-based human-computer interaction through a compressive sensing reduction scheme of very large and efficient depth feature descriptors. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–6, August 2015

    Google Scholar 

  15. Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with Leap Motion and Kinect devices. In: IEEE International Conference on Image Processing, pp. 1565–1569, October 2014

    Google Scholar 

  16. Ng, C.W., Ranganath, S.: Real-time gesture recognition system and application. Image Vis. Comput. 20(1314), 993–1007 (2002)

    Article  Google Scholar 

  17. Nigam, I., Vatsa, M., Singh, R.: Leap signature recognition using HOOF and HOT features. In: IEEE International Conference on Image Processing, pp. 5012–5016, October 2014

    Google Scholar 

  18. Ojala, T., Pietikinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)

    Article  Google Scholar 

  19. Shang, W., Cao, X., Ma, H., Zang, H., Wei, P.: Kinect-based vision system of mine rescue robot for low illuminous environment. J. Sens. 2016, 1–9 (2016)

    Google Scholar 

  20. Singer, Y., Srebro, N.: Pegasos: primal estimated sub-gradient solver for SVM. In: ICML, pp. 807–814, October 2007

    Google Scholar 

  21. Sykora, P., Kamencay, P., Hudec, R.: Comparison of SIFT and SURF methods for use on hand gesture recognition based on depth map. In: AASRI Conference on Circuit and Signal Processing, vol. 9, pp. 19–24, September 2014

    Google Scholar 

  22. Tornow, M., Al-Hamadi, A., Borrmann, V.: Gestic-based human machine interface for robot control. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 2706–2711, October 2013

    Google Scholar 

  23. Yuanrong, X., Qianqian, W., Xiao, B., Yen-Lun, C., Xinyu, W.: A novel feature extracting method for dynamic gesture recognition based on support vector machine. In: IEEE International Conference on Information and Automation, pp. 437–441, Jul 2014

    Google Scholar 

  24. Zhang, P., Li, B., Du, G., Liu, X.: A wearable-based and markerless human-manipulator interface with feedback mechanism and kalman filters. Int. J. Adv. Robot Syst. 12, 164–170 (2015)

    Google Scholar 

Download references

Acknowledgements

This work has been partially supported by the Ministerio de Economía y Competitividad of the Spanish Government under project TEC2013-48453 (MR-UHDTV), and by AIRBUS Defense and Space under project SAVIER.

Author information

Authors and Affiliations

  1. Grupo de Tratamiento de Imágenes, E.T.S.I. de Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain

    Tomás Mantecón, Carlos R. del-Blanco, Fernando Jaureguizar & Narciso García

Authors
  1. Tomás Mantecón
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carlos R. del-Blanco
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fernando Jaureguizar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Narciso García
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tomás Mantecón .

Editor information

Editors and Affiliations

  1. Université Paris-Sud 11 , Orsay, France

    Jacques Blanc-Talon

  2. University of Salento , Lecce, Lecce, Italy

    Cosimo Distante

  3. Ghent University , Gent, Belgium

    Wilfried Philips

  4. CSIRO ICT Centre , Sydney, New South Wales, Australia

    Dan Popescu

  5. University of Antwerp , Wilrijk, Belgium

    Paul Scheunders

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Mantecón, T., del-Blanco, C.R., Jaureguizar, F., García, N. (2016). Hand Gesture Recognition Using Infrared Imagery Provided by Leap Motion Controller. In: Blanc-Talon, J., Distante, C., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2016. Lecture Notes in Computer Science(), vol 10016. Springer, Cham. https://doi.org/10.1007/978-3-319-48680-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48680-2_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48679-6

  • Online ISBN: 978-3-319-48680-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation