Simone Gallo
ABSTRACT
In the last few years, text and voice-based conversational agents have become more and more popular all over the world as virtual assistants for a variety of tasks. In addition, the deployment on the market of many smart objects connected with these agents has introduced the possibility of controlling and personalising the behaviour of several connected objects using natural language. This has the potential to allow people, also those without a technical background, to effectively control and use the wide variety of connected objects and services. In this paper, we present an analysis of how conversational agents have been used to interact with smart environments (such as smart homes). For this purpose, we have carried out a systematic literature review considering publications selected from the ACM and IEEE digital libraries to investigate the technologies used to design and develop conversational agents for IoT settings, including Artificial Intelligence techniques, the purpose that they have been used for, and the level of user involvement in such studies. The resulting analysis is useful to better understand how this field is evolving and indicate the challenges still open in this area that should be addressed in future research work to allow people to completely benefit from this type of solution.
- Sakib Ahmed, Debashish Paul, Rubaiya Masnun, Minhaz Uddin Ahmed Shanto, and Tanjila Farah. 2020. Smart Home Shield and Automation System Using Facebook Messenger Chatbot. In 2020 IEEE Region 10 Symposium (TENSYMP), 1791–1794. DOI:https://doi.org/10.1109/TENSYMP50017.2020.9230716Google Scholar
Cross Ref
- Anbarasan and Jeannie S.A. Lee. 2018. Speech and Gestures for Smart-Home Control and Interaction for Older Adults. In Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care (HealthMedia’18), Association for Computing Machinery, New York, NY, USA, 49–57. DOI:https://doi.org/10.1145/3264996.3265002Google ScholarDigital Library
- Carmelo Ardito, Giuseppe Desolda, Rosa Lanzilotti, Alessio Malizia, and Maristella Matera. 2020. Analysing trade-offs in frameworks for the design of smart environments. Behaviour & Information Technology 39, 1 (January 2020), 47–71. DOI:https://doi.org/10.1080/0144929X.2019.1634760Google ScholarCross Ref
- Parvaneh Asghari, Amir Masoud Rahmani, and Hamid Haj Seyyed Javadi. 2019. Internet of Things applications: A systematic review. Computer Networks 148, (January 2019), 241–261. DOI:https://doi.org/10.1016/j.comnet.2018.12.008Google ScholarCross Ref
- Zahra Ashktorab, Mohit Jain, Q. Vera Liao, and Justin D. Weisz. 2019. Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, ACM, Glasgow Scotland Uk, 1–12. DOI:https://doi.org/10.1145/3290605.3300484Google ScholarDigital Library
- Cyril Joe Baby, Faizan Ayyub Khan, and J. N. Swathi. 2017. Home automation using IoT and a chatbot using natural language processing. In 2017 Innovations in Power and Advanced Computing Technologies (i-PACT), 1–6. DOI:https://doi.org/10.1109/IPACT.2017.8245185Google ScholarCross Ref
- Cyril Joe Baby, Nalin Munshi, Ankit Malik, Kunal Dogra, and R. Rajesh. 2017. Home automation using web application and speech recognition. In 2017 International conference on Microelectronic Devices, Circuits and Systems (ICMDCS), 1–6. DOI:https://doi.org/10.1109/ICMDCS.2017.8211543Google ScholarCross Ref
- Sara Bardi and Claudio Enrico Palazzi. 2022. Smart Hydroponic Greenhouse: Internet of Things and Soilless Farming. In Conference on Information Technology for Social Good, ACM, Limassol Cyprus, 212–217. DOI:https://doi.org/10.1145/3524458.3547221Google ScholarDigital Library
- Barbara Rita Barricelli, Daniela Fogli, Letizia Iemmolo, and Angela Locoro. 2022. A Multi-Modal Approach to Creating Routines for Smart Speakers. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (AVI 2022), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3531073.3531168Google ScholarDigital Library
- Parabattina Bhagath, Samanvi Parisa, Sasi Dinesh Reddy, and Fareeda Banu. 2021. An Android based Mobile Spoken Dialog System for Telugu language to control Smart appliances. In 2021 IEEE XXVIII International Conference on Electronics, Electrical Engineering and Computing (INTERCON), 1–4. DOI:https://doi.org/10.1109/INTERCON52678.2021.9532783Google ScholarCross Ref
- Shreya Bhutada, Akshata Singh, Kaushiki Upadhyaya, and Purvika Gaikar. 2021. Ru-Urb IoT-AI powered Healthcare Kit. In 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), 417–422. DOI:https://doi.org/10.1109/ICICCS51141.2021.9432257Google ScholarCross Ref
- Simone Borsci, Alessio Malizia, Martin Schmettow, Frank van der Velde, Gunay Tariverdiyeva, Divyaa Balaji, and Alan Chamberlain. 2022. The Chatbot Usability Scale: the Design and Pilot of a Usability Scale for Interaction with AI-Based Conversational Agents. Pers Ubiquit Comput 26, 1 (February 2022), 95–119. DOI:https://doi.org/10.1007/s00779-021-01582-9Google ScholarDigital Library
- Ha-Duong Bui and Nak Young Chong. 2018. An Integrated Approach to Human-Robot-Smart Environment Interaction Interface for Ambient Assisted Living. In 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO), 32–37. DOI:https://doi.org/10.1109/ARSO.2018.8625821Google ScholarDigital Library
- Julio Cabrera, María Mena, Ana Parra, and Eduardo Pinos. 2016. Intelligent assistant to control home power network. In 2016 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC), 1–6. DOI:https://doi.org/10.1109/ROPEC.2016.7830531Google ScholarCross Ref
- Giovanni Campagna, Rakesh Ramesh, Silei Xu, Michael Fischer, and Monica S. Lam. 2017. Almond: The Architecture of an Open, Crowdsourced, Privacy-Preserving, Programmable Virtual Assistant. In Proceedings of the 26th International Conference on World Wide Web (WWW ’17), International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 341–350. DOI:https://doi.org/10.1145/3038912.3052562Google ScholarDigital Library
- Jeffrey S. Chavis, Malcom Doster, Michelle Feng, Syeda Zeeshan, Samantha Fu, Elizabeth Aguirre, Antonio Davila, Kofi Nyarko, Aaron Kunz, Tracy Herriotts, Daniel Syed, Lanier Watkins, Anna Buczak, and Aviel Rubin. 2021. A Voice Assistant for IoT Cybersecurity. In 2021 IEEE Integrated STEM Education Conference (ISEC), 165–172. DOI:https://doi.org/10.1109/ISEC52395.2021.9764005Google ScholarCross Ref
- Hongshen Chen, Xiaorui Liu, Dawei Yin, and Jiliang Tang. 2017. A Survey on Dialogue Systems: Recent Advances and New Frontiers. SIGKDD Explor. Newsl. 19, 2 (November 2017), 25–35. DOI:https://doi.org/10.1145/3166054.3166058Google ScholarDigital Library
- Miguel Angel Contreras-Castañeda, Juan Antonio Holgado-Terriza, Gonzalo Pomboza-Junez, Patricia Paderewski-Rodríguez, and Francisco Luis Gutiérrez-Vela. 2019. Smart Home: Multimodal Interaction for Control of Home Devices. In Proceedings of the XX International Conference on Human Computer Interaction, ACM, Donostia Gipuzkoa Spain, 1–8. DOI:https://doi.org/10.1145/3335595.3335636Google ScholarDigital Library
- Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2020. HeyTAP: Bridging the Gaps Between Users’ Needs and Technology in IF-THEN Rules via Conversation. In Proceedings of the International Conference on Advanced Visual Interfaces, ACM, Salerno Italy, 1–9. DOI:https://doi.org/10.1145/3399715.3399905Google ScholarDigital Library
- Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2021. From Users’ Intentions to IF-THEN Rules in the Internet of Things. ACM Trans. Inf. Syst. 39, 4 (August 2021). DOI:https://doi.org/10.1145/3447264Google ScholarDigital Library
- Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. “What can i help you with?”: infrequent users’ experiences of intelligent personal assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, ACM, Vienna Austria, 1–12. DOI:https://doi.org/10.1145/3098279.3098539Google ScholarDigital Library
- Hanif Fakhrurroja, Ahmad Musnansyah, Muhammad Dewan Satriakamal, Bima Kusuma Wardana, Rizal Kusuma Putra, and Dita Pramesti. 2022. Dialogue System based on Reinforcement Learning in Smart Home Application. In Proceedings of the 2022 International Conference on Computer, Control, Informatics and Its Applications, ACM, Virtual Event Indonesia, 146–152. DOI:https://doi.org/10.1145/3575882.3575911Google ScholarDigital Library
- Renato Ferrero, Mohammad Ghazi Vakili, Edoardo Giusto, Mauro Guerrera, and Vincenzo Randazzo. 2019. Ubiquitous fridge with natural language interaction. In 2019 IEEE International Conference on RFID Technology and Applications (RFID-TA), 404–409. DOI:https://doi.org/10.1109/RFID-TA.2019.8892025Google ScholarCross Ref
- Mina Foosherian, Samuel Kernan Freire, Evangelos Niforatos, Karl A. Hribernik, and Klaus-Dieter Thoben. 2022. Break, Repair, Learn, Break Less: Investigating User Preferences for Assignment of Divergent Phrasing Learning Burden in Human-Agent Interaction to Minimize Conversational Breakdowns. In Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia, ACM, Lisbon Portugal, 151–158. DOI:https://doi.org/10.1145/3568444.3568454Google ScholarDigital Library
- Anna Förster and Julian Block. 2022. User Adoption of Smart Home Systems. In Conference on Information Technology for Social Good, ACM, Limassol Cyprus, 360–365. DOI:https://doi.org/10.1145/3524458.3547118Google ScholarDigital Library
- Simone Gallo, Alessio Malizia, and Fabio Paternò. Towards a Chatbot for Creating Trigger-Action Rules based on ChatGPT and Rasa. In Workshops, Work in Progress Demos and Doctoral Consortium at IS-EUD 2023, CEUR-WS.org, Cagliari. Retrieved from https://ceur-ws.org/Vol-3408/short-s4-01.pdfGoogle Scholar
- Simone Gallo and Fabio Paterno. 2022. A Conversational Agent for Creating Flexible Daily Automation. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (AVI 2022), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3531073.3531090Google ScholarDigital Library
- Alexandru Florin Gavril, Mihai Trascau, and Irina Mocanu. 2017. Multimodal Interface for Ambient Assisted Living. In 2017 21st International Conference on Control Systems and Computer Science (CSCS), 223–230. DOI:https://doi.org/10.1109/CSCS.2017.38Google ScholarCross Ref
- Steven Guamán, Adrián Calvopiña, Pamela Orta, Freddy Tapia, and Sang Guun Yoo. 2018. Device Control System for a Smart Home using Voice Commands: A Practical Case. In Proceedings of the 2018 10th International Conference on Information Management and Engineering, ACM, Salford United Kingdom, 86–89. DOI:https://doi.org/10.1145/3285957.3285977Google ScholarDigital Library
- Reza Gunawan, Ichan Taufik, Edi Mulyana, Opik T Kurahman, Muhammad Ali Ramdhani, and Mahmud. 2019. Chatbot Application on Internet Of Things (IoT) to Support Smart Urban Agriculture. In 2019 IEEE 5th International Conference on Wireless and Telematics (ICWT), 1–6. DOI:https://doi.org/10.1109/ICWT47785.2019.8978223Google ScholarCross Ref
- Kate S. Hone and Robert Graham. 2000. Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI). Nat. Lang. Eng. 6, 3 & 4 (September 2000), 287–303. DOI:https://doi.org/10.1017/S1351324900002497Google ScholarDigital Library
- Cheng-Chi Huang, Alan Liu, and Pei-Chuan Zhou. 2015. Using Ontology Reasoning in Building a Simple and Effective Dialog System for a Smart Home System. In 2015 IEEE International Conference on Systems, Man, and Cybernetics, 1508–1513. DOI:https://doi.org/10.1109/SMC.2015.267Google ScholarDigital Library
- Husain Husain, Herlinda Herlinda, Hasriani Hasriani, Ahyuna Ahyuna, Kasmawaru Kasmawaru, and Ahmad Ahmad. 2021. Increasing the Smart Home Automation by using Facebook Messenger Application. In 2021 3rd International Conference on Cybernetics and Intelligent System (ICORIS), 1–6. DOI:https://doi.org/10.1109/ICORIS52787.2021.9649442Google ScholarCross Ref
- Giancarlo Iannizzotto, Lucia Lo Bello, Andrea Nucita, and Giorgio Mario Grasso. 2018. A Vision and Speech Enabled, Customizable, Virtual Assistant for Smart Environments. In 2018 11th International Conference on Human System Interaction (HSI), 50–56. DOI:https://doi.org/10.1109/HSI.2018.8431232Google ScholarCross Ref
- Andrej Ilievski, Dimitri Dojchinovski, and Marjan Gusev. 2019. Interactive Voice Assisted Home Healthcare Systems. In Proceedings of the 9th Balkan Conference on Informatics (BCI’19), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3351556.3351572Google ScholarDigital Library
- Marco Jahn, Marc Jentsch, Christian R. Prause, Ferry Pramudianto, Amro Al-Akkad, and Rene Reiners. 2010. The Energy Aware Smart Home. In 2010 5th International Conference on Future Information Technology, IEEE, Busan, Korea (South), 1–8. DOI:https://doi.org/10.1109/FUTURETECH.2010.5482712Google ScholarCross Ref
- Akhil Jain, Poonam Tanwar, and Stuti Mehra. 2019. Home Automation System using Internet of Things (IOT). In 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), 300–305. DOI:https://doi.org/10.1109/COMITCon.2019.8862201Google ScholarCross Ref
- Farzeem D. Jivani, Manohar Malvankar, and Radha Shankarmani. 2018. A Voice Controlled Smart Home Solution With a Centralized Management Framework Implemented Using AI and NLP. In 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT), 1–5. DOI:https://doi.org/10.1109/ICCTCT.2018.8550972Google ScholarCross Ref
- Daniel Jurafsky and James H Jr Martin. Chatbots & Dialogue Systems. In Speech and Language Processing. An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (Third Edition draft). Standford Edu. Retrieved from https://web.stanford.edu/∼jurafsky/slp3/Google Scholar
- Charbel El Kaed, Andre Ponnouradjane, and Dhaval Shah. 2018. A Semantic Based Multi-Platform IoT Integration Approach from Sensors to Chatbots. In 2018 Global Internet of Things Summit (GIoTS), 1–6. DOI:https://doi.org/10.1109/GIOTS.2018.8534520Google ScholarCross Ref
- Yao-Chiang Kan, Hsueh-Chun Lin, Han-Yu Wu, and Junghsi Lee. 2020. LoRa-Based Air Quality Monitoring System Using ChatBot. In 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 1561–1565. Retrieved from https://ieeexplore.ieee.org/document/9306463Google Scholar
- Runchang Kang, Anhong Guo, Gierad Laput, Yang Li, and Xiang “Anthony” Chen. 2019. Minuet: Multimodal Interaction with an Internet of Things. In Symposium on Spatial User Interaction (SUI ’19), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3357251.3357581Google ScholarDigital Library
- Maksym Ketsmur, Ant\ónio Teixeira, Nuno Almeida, Samuel Silva, and M\ário Rodrigues. 2018. Conversational Assistant for an Accessible Smart Home: Proof-of-Concept for Portuguese. In Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion (DSAI 2018), Association for Computing Machinery, New York, NY, USA, 55–62. DOI:https://doi.org/10.1145/3218585.3218594Google ScholarDigital Library
- Lachaux Killian, Maitre Julien, Bouchard Kevin, Lussier Maxime, Bottari Carolina, Couture Mélanie, Bier Nathalie, Giroux Sylvain, and Gaboury Sebastien. 2021. Fall Prevention and Detection in Smart Homes Using Monocular Cameras and an Interactive Social Robot. In Proceedings of the Conference on Information Technology for Social Good, ACM, Roma Italy, 7–12. DOI:https://doi.org/10.1145/3462203.3475892Google ScholarDigital Library
- Sanghoon Kim and In-Young Ko. 2022. A Conversational Approach for Modifying Service Mashups in IoT Environments. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3491102.3517655Google ScholarDigital Library
- Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. 2, (January 2007).Google Scholar
- Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2023. Large Language Models are Zero-Shot Reasoners. Retrieved March 14, 2023 from http://arxiv.org/abs/2205.11916Google Scholar
- Satender Kumar, Bipin Kumar, Kamlesh Sharma, Rohan Raj, and Suresh Kumar. 2021. IoT Based Secured Home Automation System Using NLP. In 2021 International Conference on Advancements in Electrical, Electronics, Communication, Computing and Automation (ICAECA), 1–5. DOI:https://doi.org/10.1109/ICAECA52838.2021.9675570Google ScholarCross Ref
- Lee Hoi Leong, Shinsuke Kobayashi, Noboru Koshizuka, and Ken Sakamura. 2005. CASIS: A Context-Aware Speech Interface System. In Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI ’05), Association for Computing Machinery, New York, NY, USA, 231–238. DOI:https://doi.org/10.1145/1040830.1040880Google ScholarDigital Library
- Shi Liu, Shahrier Erfan Harun, Florian Jasche, and Thomas Ludwig. 2021. Supporting the Onboarding of 3D Printers through Conversational Agents. In Mensch Und Computer 2021 (MuC ’21), Association for Computing Machinery, New York, NY, USA, 494–498. DOI:https://doi.org/10.1145/3473856.3474010Google ScholarDigital Library
- Ewa Luger and Abigail Sellen. 2016. “Like Having a Really Bad PA”: The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, San Jose California USA, 5286–5297. DOI:https://doi.org/10.1145/2858036.2858288Google ScholarDigital Library
- Mithil K M, Khatri Bimal Mukesh Kumar, Lalit Sharma, Mohammed Zaki Sayeed Pasha, and Kallinath H D. 2018. An Interactive Voice Controlled Humanoid Smart Home Prototype Using Concepts of Natural Language Processing and Machine Learning. In 2018 3rd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), 1537–1546. DOI:https://doi.org/10.1109/RTEICT42901.2018.9012359Google ScholarCross Ref
- Sinarwati Mohamad Suhaili, Naomie Salim, and Mohamad Nazim Jambli. 2021. Service chatbots: A systematic review. Expert Systems with Applications 184, (December 2021), 115461. DOI:https://doi.org/10.1016/j.eswa.2021.115461Google ScholarDigital Library
- Amr El Mougy, Ahmed Khalaf, Hazem El Agaty, Mariam Mazen, Noureldin Saleh, and Mina Samir. 2017. Xenia: Secure and interoperable smart home system with user pattern recognition. In 2017 International Conference on Internet of Things, Embedded Systems and Communications (IINTEC), 47–52. DOI:https://doi.org/10.1109/IINTEC.2017.8325912Google ScholarCross Ref
- Muhamad Muslih, Somantri, Dedi Supardi, Elpid Multipi, Yusup Maulana Nyaman, Aditya Rismawan, and Gunawansyah. 2018. Developing Smart Workspace Based IOT with Artificial Intelligence Using Telegram Chatbot. In 2018 International Conference on Computing, Engineering, and Design (ICCED), 230–234. DOI:https://doi.org/10.1109/ICCED.2018.00052Google ScholarCross Ref
- Mahmoud Nasr, Fakhri Karray, and Yuri Quintana. 2020. Human Machine Interaction Platform for Home Care Support System. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 4210–4215. DOI:https://doi.org/10.1109/SMC42975.2020.9283095Google ScholarDigital Library
- Trung Nguyen, Barth Lakshmanan, Chengjie Lin, Weihua Sheng, Ye Gu, Meiqin Liu, and Senlin Zhang. 2017. A Miniature Smart Home Testbed for Research and Education. In 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), 1637–1642. DOI:https://doi.org/10.1109/CYBER.2017.8446621Google ScholarCross Ref
- Chinedu Wilfred Okonkwo and Abejide Ade-Ibijola. 2021. Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence 2, (2021), 100033. DOI:https://doi.org/10.1016/j.caeai.2021.100033Google ScholarCross Ref
- Bauyrzhan Ospan, Nawaz Khan, Juan Augusto, Mario Quinde, and Kenzhegali Nurgaliyev. 2018. Context Aware Virtual Assistant with Case-Based Conflict Resolution in Multi-User Smart Home Environment. In 2018 International Conference on Computing and Network Communications (CoCoNet), 36–44. DOI:https://doi.org/10.1109/CoCoNet.2018.8476898Google ScholarCross Ref
- Christina Oumard, Julian Kreimeier, and Timo G\ötzelmann. 2022. Implementation and Evaluation of a Voice User Interface with Offline Speech Processing for People Who Are Blind or Visually Impaired. In Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA ’22), Association for Computing Machinery, New York, NY, USA, 277–285. DOI:https://doi.org/10.1145/3529190.3529197Google ScholarDigital Library
- Biswamoy Pattnaik, Sreya Dey, and B Jaganatha Pandian. 2021. A Secure and Interactive Home Automation System with Machine Learning Based Power Prediction. In 2021 Innovations in Power and Advanced Computing Technologies (i-PACT), IEEE, Kuala Lumpur, Malaysia, 1–6. DOI:https://doi.org/10.1109/i-PACT52855.2021.9696603Google ScholarCross Ref
- Rohit Raj and Nandini Rai. 2018. Voice Controlled Cyber-Physical System for Smart Home. In Proceedings of the Workshop Program of the 19th International Conference on Distributed Computing and Networking (Workshops ICDCN ’18), Association for Computing Machinery, New York, NY, USA. DOI:https://doi.org/10.1145/3170521.3170550Google ScholarDigital Library
- Amon Rapp, Lorenzo Curti, and Arianna Boldi. 2021. The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots. International Journal of Human-Computer Studies 151, (July 2021), 102630. DOI:https://doi.org/10.1016/j.ijhcs.2021.102630Google ScholarCross Ref
- Eugenio Rubio-Drosdov, Daniel Díaz-Sánchez, Florina Almenárez, Patricia Arias-Cabarcos, and Andrés Marín. 2017. Seamless human-device interaction in the internet of things. IEEE Transactions on Consumer Electronics 63, 4 (November 2017), 490–498. DOI:https://doi.org/10.1109/TCE.2017.015076Google ScholarCross Ref
- Sanket Salvi, V Geetha, and S Sowmya Kamath. 2019. Jamura: A Conversational Smart Home Assistant Built on Telegram and Google Dialogflow. In TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON), 1564–1571. DOI:https://doi.org/10.1109/TENCON.2019.8929316Google ScholarCross Ref
- SPSS Sirinayake, Dkak Dasanayake, Tmlu Rodrigo, Wuy Perera, MDJT Hansika Mahaadikara, and Surath Kahandawala. 2021. IOT-Based Intelligent Assistant Mirror For Smart Life & Daily Routine Using Raspberry PI. In 2021 21st International Conference on Advances in ICT for Emerging Regions (ICter), 1–6. DOI:https://doi.org/10.1109/ICter53630.2021.9774788Google ScholarCross Ref
- Evropi Stefanidi, Maria Korozi, Asterios Leonidis, and Margherita Antona. 2018. Programming Intelligent Environments in Natural Language: An Extensible Interactive Approach. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (PETRA ’18), Association for Computing Machinery, New York, NY, USA, 50–57. DOI:https://doi.org/10.1145/3197768.3197776Google ScholarDigital Library
- Chwan-Lu Tseng, Che-Shen Cheng, Yu-Hsien Hsu, and Bing-Hung Yang. 2018. An IoT-Based Home Automation System Using Wi-Fi Wireless Sensor Networks. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2430–2435. DOI:https://doi.org/10.1109/SMC.2018.00417Google ScholarDigital Library
- Lionel Sujay Vailshery. Number of Internet of Things (IoT) connected devices worldwide from 2019 to 2021, with forecasts from 2022 to 2030. Statista. Retrieved from https://www.statista.com/statistics/1183457/iot-connected-devices-worldwide/#:∼:text=Number%20of%20IoT%20connected%20devices,2021,%20with%20forecasts%20to%202030&text=The%20number%20of%20Internet%20of,billion%20IoT%20devices%20in%202030.Google Scholar
- Sai Vemprala, Rogerio Bonatti, Arthur Bucker, and Ashish Kapoor. 2023. ChatGPT for Robotics: Design Principles and Model Abilities. Microsoft. Retrieved from https://www.microsoft.com/en-us/research/publication/chatgpt-for-robotics-design-principles-and-model-abilities/Google Scholar
- Tianwei Xing, Luis Garcia, Federico Cerutti, Lance Kaplan, Alun Preece, and Mani Srivastava. 2021. DeepSQA: Understanding Sensor Data via Question Answering. In Proceedings of the International Conference on Internet-of-Things Design and Implementation (IoTDI ’21), Association for Computing Machinery, New York, NY, USA, 106–118. DOI:https://doi.org/10.1145/3450268.3453529Google ScholarDigital Library
- Lu Xu, Leslie Sanders, Kay Li, and James C L Chow. 2021. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer 7, 4 (November 2021), e27850. DOI:https://doi.org/10.2196/27850Google ScholarCross Ref
- Zhipeng Xu, Hao Wu, Xu Chen, Yongmei Wang, and Zhenyu Yue. 2022. Building a Natural Language Query and Control Interface for IoT Platforms. IEEE Access 10, (2022), 68655–68668. DOI:https://doi.org/10.1109/ACCESS.2022.3186760Google ScholarCross Ref
Index Terms
- Conversational Interfaces in IoT Ecosystems: Where We Are, What Is Still Missing
Recommendations
Conversational Agents: Acting on the Wave of Research and Development
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsIn the last five years, work on software that interacts with people via typed or spoken natural language, called chatbots, intelligent assistants, social bots, virtual companions, non-human players, and so on, increased dramatically. Chatbots burst into ...
Assessment with computer agents that engage in conversational dialogues and trialogues with learners
This article describes conversation-based assessments with computer agents that interact with humans through chat, talking heads, or embodied animated avatars. Some of these agents perform actions, interact with multimedia, hold conversations with ...
Embodied conversational agents in Wizard-of-Oz and multimodal interaction applications
COST 2102'07: Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behavioursEmbodied conversational agents employed in multimodal interaction applications have the potential to achieve similar properties as humans in faceto-face conversation. They enable the inclusion of verbal and nonverbal communication. Thus, the degree of ...
Comments