Skip to main content

Improving Deaf People Accessibility and Communication Through Automatic Sign Language Recognition Using Novel Technologies

  • Conference paper
  • First Online:
Advances in Design for Inclusion

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 500))

Abstract

Communication is a key for human development. Nevertheless, deaf people have difficulty interacting with hearing and hard of hearing people. On the other hand, new technology allows gesture recognition. This work aims to promote the development of tools to take advantage of 3D camera technology for the benefit of the Deaf Community around the world. This research proposes a sign recognition model using 3d cameras (i.e. Leap Motion and Intel RealSense) and support vector machines (SVM). The goal is to support the communication process between deaf and hearing people. Furthermore, we conduct an experiment determining an appropriate amount of training sample signs to ensure satisfactory results using SVMs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hanson, V.: Computing technologies for deaf and hard of hearing users. In: Sears, A., Jacko, J. (eds.): The Human–Computer Interaction Handbook, 2nd edn. CRC Press (2007)

    Google Scholar 

  2. Leap Motion Home Page (2015) Available: https://www.leapmotion.com/

  3. Intel RealSense Home Page (2016). Available: http://www.intel.com/content/www/us/en/architecture-and-technology/realsense-overview.html

  4. Potter, L., Araullo, J., Carter, L.: The leap motion controller: a view on sign language. In: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, pp. 175–178 (2013)

    Google Scholar 

  5. Chuan, C.-H., Regina, E., Guardino, C.: American sign language recognition using leap motion sensor. In: 2014 13th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 541–544 (2014)

    Google Scholar 

  6. Mohandes, M., Aliyu, S., Deriche, M.: Arabic sign language recognition using the leap motion controller. In: 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE), pp. 960–965 (2014)

    Google Scholar 

  7. Elons, A.S., Ahmed, M., Shedid, H., Tolba, M.F.: Arabic sign language recognition using leap motion sensor. In: 2014 9th International Conference on Computer Engineering and Systems (ICCES), pp. 368–373 (2014)

    Google Scholar 

  8. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)

    MATH  Google Scholar 

  9. Scikit-learn: Machine Learning in Python (2015). Available: http://scikit-learn.org/stable/

  10. Cristianini, N., Shawe-Taylor, J.: An introduction to support vector machines: and other kernel-based learning methods, 1st edn. Estados Unidos, New York (2000)

    Book  MATH  Google Scholar 

  11. Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., Sodnik, J.: An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14(2), 3702–3720 (2014). (Switzerland)

    Article  Google Scholar 

Download references

Acknowledgments

This work was partially supported by the Escuela de Ciencias de la Computación e Informática at Universidad de Costa Rica (ECCI-UCR) grand No. 320-B5-291, by Centro de Investigaciones en Tecnologías de la Información y Comunicación de la Universidad de Costa Rica (CITIC-UCR), and by Ministerio de Ciencia, Tecnología y Telecomunicaciones (MICITT) and Consejo Nacional para Investigaciones Científicas y Tecnológicas (CONICIT) of the Government of Costa Rica.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luis Quesada .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Quesada, L., López, G., Guerrero, L. (2016). Improving Deaf People Accessibility and Communication Through Automatic Sign Language Recognition Using Novel Technologies. In: Di Bucchianico, G., Kercher, P. (eds) Advances in Design for Inclusion. Advances in Intelligent Systems and Computing, vol 500. Springer, Cham. https://doi.org/10.1007/978-3-319-41962-6_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41962-6_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41961-9

  • Online ISBN: 978-3-319-41962-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics