Skip to main content
SpringerLink
Log in

Dialogue with Robots to Support Symbiotic Autonomy

  • Chapter
  • First Online:
Dialogues with Social Robots

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 427))

Abstract

Service Robotics is finding solutions to enable effective interaction with users. Among the several issues, the need of adapting robots to the way humans usually communicate is becoming a key and challenging task. In this context the design of robots that understand and reply in Natural Language plays a central role, especially when interactions involve untrained users. In particular, this is even more stressed in the framework of Symbiotic Autonomy, where an interaction is always required for the robot to accomplish a given task. In this article, we propose a framework to model dialogues with robotic platforms, enabling effective and natural dialogic interactions. The framework relies on well-known theories as well as on perceptually informed spoken language understanding processors, giving rise to interactions that are tightly bound to the operating scenario.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A video describing this example is available at https://goo.gl/bpXmln and the underlying system is presented in [30].

  2. 2.

    This is currently done by a laser pen.

References

  1. Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through symbiotic human-robot interaction. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 915–922. International Foundation for Autonomous Agents and Multiagent Systems (2010)

    Google Scholar 

  2. Bohus, D., Horvitz, E., Kanda, T., Mutlu, B., Raux, A.: Introduction to the special issue on dialog with robots. AI Mag. 32(4), 15–16 (2011)

    Google Scholar 

  3. Winograd, T.: Procedures as a representation for data in a computer program for understanding natural language. Cogn. Psychol. 3(1), 1–191 (1972)

    Article  Google Scholar 

  4. Zuo, X., Iwahashi, N., Funakoshi, K., Nakano, M., Taguchi, R., Matsuda, S., Sugiura, K., Oka, N.: Detecting robot-directed speech by situated understanding in physical interaction. Trans. Jpn. Soc. Artif. Intell. 25(6), 670–682 (2010)

    Article  Google Scholar 

  5. Kruijff, G., Zender, H., Jensfelt, P., Christensen, H.: Situated dialogue and understanding spatial organization: knowing what is where and what you can do there. In: Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006, ROMAN 2006, pp. 328–333 (2006)

    Google Scholar 

  6. Bastianelli, E., Bloisi, D., Capobianco, R., Cossu, F., Gemignani, G., Iocchi, L., Nardi, D.: On-line semantic mapping. In: Proceedings of the 16th International Conference on Advanced Robotics (ICAR). pp. 1–6 (2013)

    Google Scholar 

  7. Rybski, P.E., Yoon, K., Stolarz, J., Veloso, M.M.: Interactive robot task training through dialog and demonstration. In: Proceedings of the ACM/IEEE International Conference on Human-robot Interaction, pp. 49–56. HRI ’07, ACM, New York, NY, USA (2007)

    Google Scholar 

  8. Gemignani, G., Bastianelli, E., Nardi, D.: Teaching robots parametrized executable plans through spoken interaction. In: Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, pp. 851–859. AAMAS ’15, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2015)

    Google Scholar 

  9. Gemignani, G., Klee, S.D., Veloso, M., Nardi, D.: On task recognition and generalization in long-term robot teaching. In: Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems. pp. 1879–1880. AAMAS ’15, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2015)

    Google Scholar 

  10. Lemaignan, S., Alami, R.: “talking to my robot”: From knowledge grounding to dialogue processing. In: Proceedings of the 8th ACM/IEEE International Conference on Human-robot Interaction. pp. 409–410. HRI ’13, IEEE Press, Piscataway, NJ, USA (2013)

    Google Scholar 

  11. Kollar, T., Tellex, S., Roy, D., Roy, N.: Toward understanding natural language directions. In: Proceedings of the 5th ACM/IEEE International Conference on Human-robot Interaction, pp. 259–266. HRI ’10, IEEE Press, Piscataway, NJ, USA (2010)

    Google Scholar 

  12. MacMahon, M., Stankiewicz, B., Kuipers, B.: Walk the talk: Connecting language, knowledge, and action in route instructions. In: Proceedings of the 21st National Conference on Artificial Intelligence, vol. 2, pp. 1475–1482. AAAI’06, AAAI Press (2006)

    Google Scholar 

  13. Bastianelli, E., Castellucci, G., Croce, D., Basili, R., Nardi, D.: Effective and robust natural language understanding for human-robot interaction. In: Proceedings of 21st European Conference on Artificial Intelligence, pp. 57–62. IOS Press (2014)

    Google Scholar 

  14. Bastianelli, E., Croce, D., Basili, R., Nardi, D.: Using semantic maps for robust natural language interaction with robots. In: Sixteenth Annual Conference of the International Speech Communication Association (2015)

    Google Scholar 

  15. Vanzo, A., Croce, D., Bastianelli, E., Basili, R., Nardi, D.: Robust spoken language understanding for house service robots. In: Proceedings of the 17th International Conference on Intelligent Text Processing and Computational Linguistics CICLing 2016. Konya, Turkey, April 3–9, 2016

    Google Scholar 

  16. Bastianelli, E., Croce, D., Basili, R., Nardi, D.: Using semantic models for robust natural language human robot interaction. In: Gavanelli, M., Lamma, E., Riguzzi, F. (eds.) AI*IA 2015 Advances in Artificial Intelligence: XIVth International Conference of the Italian Association for Artificial Intelligence, pp. 343–356. Springer International Publishing (2015)

    Google Scholar 

  17. Bastianelli, E., Croce, D., Vanzo, A., Basili, R., Nardi, D.: A discriminative approach to grounded spoken language understanding in interactive robotics. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016. New York, USA, July 9–15, 2016

    Google Scholar 

  18. Chernova, S., DePalma, N., Breazeal, C.: Crowdsourcing real world human-robot dialog and teamwork through online multiplayer games. AI Mag. 32(4), 100–111 (2011)

    Google Scholar 

  19. Kollar, T., Perera, V., Nardi, D., Veloso, M.M.: Learning environmental knowledge from task-based human-robot dialog. In: ICRA, pp. 4304–4309. IEEE (2013)

    Google Scholar 

  20. Fang, R., Liu, C., She, L., Chai, J.Y.: Towards situated dialogue: revisiting referring expression generation. In: EMNLP, pp. 392–402 (2013)

    Google Scholar 

  21. Fang, R., Doering, M., Chai, J.Y.: Collaborative models for referring expression generation in situated dialogue. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 1544–1550 (2014)

    Google Scholar 

  22. Stoia, L., Shockley, D.M., Byron, D.K., Fosler-Lussier, E.: Noun phrase generation for situated dialogs. In: Proceedings of the Fourth International Natural Language Generation Conference, pp. 81–88. INLG ’06, Association for Computational Linguistics, Stroudsburg, PA, USA (2006)

    Google Scholar 

  23. Garoufi, K., Koller, A.: Automated planning for situated natural language generation. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1573–1582. ACL ’10, Association for Computational Linguistics, Stroudsburg, PA, USA (2010)

    Google Scholar 

  24. Qu, S., Chai, J.Y.: Context-based word acquisition for situated dialogue in a virtual world. J. Artif. Intell. Res. 247–277 (2010)

    Google Scholar 

  25. Peltason, J., Wrede, B.: The curious robot as a case-study for comparing dialog systems. AI Mag. 32(4), 85–99 (2011)

    Google Scholar 

  26. Marge, M., Rudnicky, A.I.: Miscommunication recovery in physically situated dialogue. In: Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 22 (2015)

    Google Scholar 

  27. Scheutz, M., Cantrell, R., Schermerhorn, P.W.: Toward humanlike task-based dialogue processing for human robot interaction. AI Mag. 32(4), 77–84 (2011)

    Google Scholar 

  28. Brenner, M., Kruijff-Korbayová, I.: A continual multiagent planning approach to situated dialogue. In: Proceedings of the Semantics and Pragmatics of Dialogue (LONDIAL), p. 61 (2008)

    Google Scholar 

  29. Ross, R.J., Bateman, J.: Agency & information state in situated dialogues: analysis & computational modelling. In: Proceedings of the DiaHolmia, p. 113 (2009)

    Google Scholar 

  30. Bastianelli, E., Croce, D., Vanzo, A., Basili, R., Nardi, D.: Perceptually informed spoken language understanding for service robotics. In: Proceedings of the IJCAI2016 Workshop on Autonomous Mobile Service Robots. To appear (2016)

    Google Scholar 

  31. Klee, S.D., Gemignani, G., Nardi, D., Veloso, M.: Graph-based task libraries for robots: generalization and autocompletion. In: Proceedings of the 14th Italian Conference on Artificial Intelligence (2015)

    Google Scholar 

  32. Traum, D., Larsson, S.: The information state approach to dialogue management. In: Current and New Directions in Discourse and Dialogue, Text, Speech and Language Technology, vol. 22, pp. 325–353. Springer, Netherlands (2003)

    Google Scholar 

  33. Stolcke, A., Coccaro, N., Bates, R., Taylor, P., Van Ess-Dykema, C., Ries, K., Shriberg, E., Jurafsky, D., Martin, R., Meteer, M.: Dialogue act modeling for automatic tagging and recognition of conversational speech. Comput. Linguist. 26(3), 339–373 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer, Control and Management Engineering “Antonio Ruberti”, Sapienza University of Rome, Rome, Italy

    Andrea Vanzo, Guglielmo Gemignani & Daniele Nardi

  2. Department of Enterprise Engineering, University of Roma Tor Vergata, Rome, Italy

    Danilo Croce & Roberto Basili

  3. Department of Civil Engineering and Computer Science Engineering, University of Roma Tor Vergata, Rome, Italy

    Emanuele Bastianelli

Authors
  1. Andrea Vanzo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Danilo Croce
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emanuele Bastianelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guglielmo Gemignani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Roberto Basili
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Daniele Nardi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Vanzo .

Editor information

Editors and Affiliations

  1. Institute of Behavioural Sciences, University of Helsinki Institute of Behavioural Sciences, Helsinki, Finland

    Kristiina Jokinen

  2. University of Helsinki , Helsinki, Finland

    Graham Wilcock

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Vanzo, A., Croce, D., Bastianelli, E., Gemignani, G., Basili, R., Nardi, D. (2017). Dialogue with Robots to Support Symbiotic Autonomy. In: Jokinen, K., Wilcock, G. (eds) Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427. Springer, Singapore. https://doi.org/10.1007/978-981-10-2585-3_27

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2585-3_27

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2584-6

  • Online ISBN: 978-981-10-2585-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation