Skip to main content

im4Things: An Ontology-Based Natural Language Interface for Controlling Devices in the Internet of Things

  • Chapter
  • First Online:

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 120))

Abstract

The Internet of Things (IoT) offers opportunities for new applications and services that enable users to access and control their working and home environment from local and remote locations, aiming to perform daily life activities in an easy way. However, the IoT also introduces new challenges, some of which arise from the large range of devices currently available and the heterogeneous interfaces provided for their control. The control and management of this variety of devices and interfaces represent a new challenge for non-expert users, instead of making their life easier. Based on this understanding, in this work we present a natural language interface for the IoT, which takes advantage of Semantic Web technologies to allow non-expert users to control their home environment through an instant messaging application in an easy and intuitive way. We conducted several experiments with a group of end users aiming to evaluate the effectiveness of our approach to control home appliances by means of natural language instructions. The evaluation results proved that without the need for technicalities, the user was able to control the home appliances in an efficient way.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Giusto, D., Iera, A., Morabito, G., Atzori, L. (eds.): The Internet of Things. Springer, New York (2010)

    Google Scholar 

  2. Dow, C.-R., Nguyen, D.-B., Wang, S.-C., Hwang, S.-F., Tsai, M.F., Dow, C.-R., Nguyen, D.-B., Wang, S.-C., Hwang, S.-F., Tsai, M.F.: A geo-aware taxi carrying management system by using location based services and zone queuing techniques on internet of things, a geo-aware taxi carrying management system by using location based services and zone queuing techniques on internet of things. Mob. Inf. Syst. Mob. Inf. Syst. 2016, e9817374 (2016)

    Google Scholar 

  3. Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. Comput. Netw. 54(15), 2787–2805 (2010)

    Article  MATH  Google Scholar 

  4. Jain, S., Vaibhav, A., Goyal, L.: Raspberry Pi based interactive home automation system through e-mail. In: 2014 International Conference on Optimization, Reliabilty, and Information Technology (ICROIT), pp. 277–280 (2014)

    Google Scholar 

  5. Chatzigiannakis, I., Drude, J.P., Hasemann, H., Kröller, A.: Developing smart homes using the internet of things: how to demonstrate your system. In: Streitz, N., Markopoulos, P. (eds.) Distributed, Ambient, and Pervasive Interactions. Springer, pp. 415–426 (2014)

    Google Scholar 

  6. Zhu, J., Jia, X., Mei, X.Q.: Smart home control system based on internet of things. Appl. Mech. Mater. 738–739, 233–237 (2015)

    Google Scholar 

  7. Piyare, R., Tazil, M.: Bluetooth based home automation system using cell phone. In: 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE), pp. 192–195 (2011)

    Google Scholar 

  8. Cimiano, P., Haase, P., Heizmann, J., Mantel, M., Studer, R.: Towards portable natural language interfaces to knowledge bases—the case of the ORAKEL system. Data Knowl. Eng. 65(2), 325–354 (2008)

    Article  Google Scholar 

  9. Studer, R., Benjamins, V.R., Fensel, D.: Knowledge engineering: principles and methods. Data Knowl. Eng. 25(1–2), 161–197 (1998)

    Article  MATH  Google Scholar 

  10. Rodríguez-García, M.Á., Valencia-García, R., García-Sánchez, F., Samper-Zapater, J.J.: Ontology-based annotation and retrieval of services in the cloud. Knowl. -Based Syst. 56, 15–25 (2014)

    Article  Google Scholar 

  11. Colombo-Mendoza, L.O., Valencia-García, R., Rodríguez-González, A., Alor-Hernández, G., Samper-Zapater, J.J.: RecomMetz: a context-aware knowledge-based mobile recommender system for movie showtimes. Expert Syst. Appl. 42(3), 1202–1222 (2015)

    Article  Google Scholar 

  12. García, R., Ángel, M., Valencia García, R., Alcaraz Mármol, G., Carralero, C.: Open Idea: plataforma inteligente para gestión de ideas innovadoras. Open Idea: an intelligent platform for managing innovative ideas, September (2014)

    Google Scholar 

  13. Peñalver-Martinez, I., Garcia-Sanchez, F., Valencia-Garcia, R., Rodríguez-García, M.Á., Moreno, V., Fraga, A., Sánchez-Cervantes, J.L.: Feature-based opinion mining through ontologies. Expert Syst. Appl. 41(13), 5995–6008 (2014)

    Article  Google Scholar 

  14. Katsamanis, A., Rodomagoulakis, I., Potamianos, G., Maragos, P., Tsiami, A.: Robust far-field spoken command recognition for home automation combining adaptation and multichannel processing. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5547–5551 (2014)

    Google Scholar 

  15. Vanus, J., Smolon, M., Koziorek, J., Martinek, R.: Voice control of technical functions in smart home with KNX technology. In: Park, J.J.J.H., Stojmenovic, I., Jeong, H.Y., Yi, G. (eds.) Computer Science and its Applications, pp. 455–462. Springer, Berlin Heidelberg (2015)

    Google Scholar 

  16. Espejo Pérez, G., Ábalos Serrano, N., López-Cózar Delgado, R., Callejas Carrión, Z., Griol Barres, D.: Sistema Mayordomo: uso de un entorno de inteligencia ambiental a través de un sistema de diálogo multimodal. Mayordomo system: using an ambient intelligence environment through a multimodal dialogue system, October 2010

    Google Scholar 

  17. Allen, J.: Natural Language Understanding, 2nd edn. Pearson, Redwood City, Calif (1994)

    MATH  Google Scholar 

  18. Shelby, Z., Hartke, K., Bormann, C.: The constrained application protocol (CoAP). [Online]. Available: https://tools.ietf.org/html/rfc7252. Accessed 26 Apr 2016

  19. Matsuoka, H., Wang, J., Jing, L., Zhou, Y., Wu, Y., Cheng, Z.: Development of a control system for home appliances based on BLE technique. In: 2014 IEEE International Symposium on Independent Computing (ISIC), pp. 1–5 (2014)

    Google Scholar 

  20. Gomez, C., Oller, J., Paradells, J.: Overview and evaluation of bluetooth low energy: an emerging low-power wireless technology. Sensors 12(9), 11734–11753 (2012)

    Article  Google Scholar 

  21. Kumar, S.: Ubiquitous smart home system using android application. Int. J. Comput. Netw. Commun. 6(1), 33–43 (2014)

    MathSciNet  Google Scholar 

  22. Jie, G., Bo, C., Shuai, Z., Junliang, C., Jie, G., Bo, C., Shuai, Z., Junliang, C.: Cross-platform android/iOS-based smart switch control middleware in a digital home, cross-platform android/iOS-based smart switch control middleware in a digital home. Mob. Inf. Syst. Mob. Inf. Syst. 2015(2015), e627859 (2015)

    Google Scholar 

  23. Smith, R.W.: Natural language interfaces. In: Encyclopedia of Language and Linguistics, 2nd edn, pp. 496–503. Elsevier, Oxford (2006)

    Google Scholar 

  24. Saint-Andre, P., Smith, K., Tronçon, R.: XMPP: The Definitive Guide. O’Reilly Media, Inc. (2009)

    Google Scholar 

  25. Alicebot and AIML Documentation (A.L.I.C.E. AI Foundation). [Online]. Available: http://www.alicebot.org/documentation/. Accessed 25 Apr 2016

  26. Marston, S., Li, Z., Bandyopadhyay, S., Zhang, J., Ghalsasi, A.: Cloud computing—the business perspective. Decis. Support Syst. 51(1), 176–189 (2011)

    Article  Google Scholar 

  27. Haro, L.F.D., Cordoba, R., Rojo Rivero, J.I., Diez de la Fuente, J., Avendano Peces, D., Bermudo Mera, J.M.: Low-cost speaker and language recognition systems running on a Raspberry Pi. Lat. Am. Trans. IEEE Rev. IEEE Am. Lat. 12(4), 755–763 (2014)

    Google Scholar 

  28. Augello, A., Pilato, G., Vassallo, G., Gaglio, S.: Chatbots as interface to ontologies. In: Gaglio, S., Re, G.L. (eds.) Advances onto the Internet of Things, pp. 285–299. Springer (2014)

    Google Scholar 

  29. Kaufmann, E., Bernstein, A.: Evaluating the usability of natural language query languages and interfaces to semantic web knowledge bases. Web Semant. Sci. Serv. Agents World Wide Web 8(4), 377–393 (2010)

    Article  Google Scholar 

  30. Yang, Y., Liu, X.: A Re-examination of text categorization methods. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 42–49. New York, NY, USA (1999)

    Google Scholar 

  31. Hripcsak, G., Rothschild, A.S.: Agreement, the F-measure, and reliability in information retrieval. J. Am. Med. Inform. Assoc. JAMIA 12(3), 296–298 (2005)

    Article  Google Scholar 

  32. Advanced Data Mining Techniques. Springer, Berlin Heidelberg (2008)

    Google Scholar 

  33. Pilato, G., Augello, A., Gaglio, S.: Modular knowledge representation in advisor agents for situation awareness. Int. J. Semant. Comput. 5(01), 33–53 (2011)

    Article  Google Scholar 

Download references

Acknowledgements

María Pilar Salas-Zárate and Mario Andrés Paredes-Valverde are supported by the National Council of Science and Technology (CONACyT) and the Mexican government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mario Andrés Paredes-Valverde .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Noguera-Arnaldos, J.Á., Paredes-Valverde, M.A., Salas-Zárate, M.P., Rodríguez-García, M.Á., Valencia-García, R., Ochoa, J.L. (2017). im4Things: An Ontology-Based Natural Language Interface for Controlling Devices in the Internet of Things. In: Alor-Hernández, G., Valencia-García, R. (eds) Current Trends on Knowledge-Based Systems. Intelligent Systems Reference Library, vol 120. Springer, Cham. https://doi.org/10.1007/978-3-319-51905-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-51905-0_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-51904-3

  • Online ISBN: 978-3-319-51905-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics