In human-human conversations, listeners often convey intentions to their speakers through feedbacks comprising reflexive short responses. The speakers then recognize these intentions and dynamically change the conversational plans to transmit information more efficiently. For the design of spoken dialogue systems that deliver a massive amount of information, such as news, it is essential to accurately capture users’ intentions from reflexive short responses to efficiently select or eliminate the information to be transmitted depending on the user’s needs. However, such short responses from users are normally too short to recognize their actual intentions only from the prosodic and linguistic features of their short responses. In this paper, we propose a user’s short-response intention-recognition model that accounts for the previous system’s utterances as the context of the conversation in addition to prosodic and linguistic features of user’s utterances. To achieve this, we define types of short response intentions in terms of effective information transmission and created new dataset by annotating over the interaction data collected using our spoken dialogue system. Our experimental results demonstrate that the classification accuracy can be improved using the linguistic features of the system’s previous utterances encoded by Bidirectional Encoder Representations from Transformers (BERT) as the conversational context.
Cite as: Takatsu, H., Yokoyama, K., Matsuyama, Y., Honda, H., Fujie, S., Kobayashi, T. (2019) Recognition of Intentions of Users’ Short Responses for Conversational News Delivery System. Proc. Interspeech 2019, 1193-1197, doi: 10.21437/Interspeech.2019-2121
@inproceedings{takatsu19_interspeech,
author={Hiroaki Takatsu and Katsuya Yokoyama and Yoichi Matsuyama and Hiroshi Honda and Shinya Fujie and Tetsunori Kobayashi},
title={{Recognition of Intentions of Users’ Short Responses for Conversational News Delivery System}},
year=2019,
booktitle={Proc. Interspeech 2019},
pages={1193--1197},
doi={10.21437/Interspeech.2019-2121}
}