Matthew Peter Aylett
Joel Fischer
Gisela Reyes-Cruz
ABSTRACT
The emphasis on one-to-one speak/wait spoken conversational interaction with intelligent agents leads to long pauses between conversational turns, undermines the flow and naturalness of the interaction, and undermines the user experience. Despite ground breaking advances in the area of generating and understanding natural language with techniques such as LLMs, conversational interaction has remained relatively overlooked. In this workshop we will discuss and review the challenges, recent work and potential impact of improving conversational interaction with artificial systems. We hope to share experiences of poor human/system interaction, best practices with third party tools, and generate design guidance for the community.
- Matthew P. Aylett and Marta Romeo. 2023. You Don’t Need to Speak, You Need to Listen: Robot Interaction and Human-Like Turn-Taking. In CUI’23.Google Scholar
- Paul T Brady. 1968. A statistical analysis of on-off patterns in 16 conversations. Bell System Technical Journal 47, 1 (1968), 73–91.Google ScholarCross Ref
- Gabriel Skantze. 2021. Turn-taking in conversational systems and human-robot interaction: a review. Computer Speech & Language 67 (2021), 101178.Google ScholarCross Ref
- Vivian Tsai, Timo Baumann, Florian Pecune, and Justine Cassell. 2019. Faster responses are better responses: Introducing incrementality into sociable virtual personal assistants. In 9th International Workshop on Spoken Dialogue System Technology. Springer, 111–118.Google ScholarCross Ref
Index Terms
- Why is my Agent so Slow? Deploying Human-Like Conversational Turn-Taking
Recommendations
A Multi-party Conversational Social Robot Using LLMs
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot InteractionIn this paper, we describe our setting and the architecture of our LLM-based dialogue system embodied in a social robot and able to have multi-party conversations. Each component is detailed, and a video of the full system is available with the ...
You Don’t Need to Speak, You Need to Listen: Robot Interaction and Human-Like Turn-Taking
CUI '23: Proceedings of the 5th International Conference on Conversational User InterfacesThe focus on one-to-one speak/wait conversational interaction with artificial system is partly misguided and partly cynical. Misguided because it pre-supposes that our relationship with such a system should be one-to-one and that human-like turn taking ...
A Pilot Evaluation of a Conversational Listener for Conversational User Interfaces
CUI '23: Proceedings of the 5th International Conference on Conversational User InterfacesCurrent spoken conversational user interfaces (CUIs) are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. Human-human conversation 1) is not sequential, with overlap, interruption and back ...
Comments