Laurence Y. Devillers
ABSTRACT
The video of our demonstrator presents a social interaction system for studying humor with the Aldebaran robot NAO. Our application records and analyzes audio and video stream to provide real-time feedback. Using this dialog system during show & tell sessions at Interspeech 2013, we have collected different kind of laughter (positive and negative) from 45 subjects. The participants were involved in a verbal exchange with NAO, including tongue-twisters games and jokes, as well as witty remarks and laughs from the robot. The conversation data captured is used here to study subject behaviors from various personalities and cultural backgrounds.
- Reeves B., Nass, C., The media equation: How people treat computers, television, and new media like real people and places. New York, NY: Cambridge Univ. Press, 1996. Google Scholar
Digital Library
- Schröder, M.. Experimental study of affect bursts, Speech Communication -- Special session on speech and emotion, vol. 40, Issue 1--2. 2003. Google ScholarDigital Library
- Krumhuber E., Scherer, K., Affect bursts: Dynamic patterns of facial expressions, Journal of Emotion. 2011 Aug; 11 (4):742.Google Scholar
- Carter, A., Automatic acoustic laughter detection, Master Thesis, Keele University, 2000.Google Scholar
- Trouvain, J., Segmenting phonetic units in laughter, in conf. Phonetic Sciences, Barcelona, 2003 pp. 2793--2796.Google Scholar
- Schuller, B., Steidl S., Batliner, A., Vinciarelli A., Scherer K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., Mortillaro, M., Salamin, H., Polychroniou, A., Valente F., Kim, S, The INTERSPEECH2013 Computational Paralinguistics Challenge Social Signals, Conflict, Emotion, Autism; Interspeech 2013.Google Scholar
- Devillers, L. Vidrascu L., Positive and negative emotional states behind the laughs in spontaneous spoken dialogs. Workshop Laughter 2007 of ICPHs 2007.Google Scholar
- Szameitat, D. P., et al. Differentiation of Emotions in Laughter at the Behavioral Level. 2009 Emotion 9 (3), 399.Google Scholar
- McKeown, G. Cowie, R., Curran, W., Ruch, W., Douglas-Cowie E., ILHAIRE Laughter Database. Proceedings of the 4th International Workshop on EMOTION SENTIMENT & SOCIAL SIGNALS, LREC 2012, Istanbul, Turkey, ELRA.Google Scholar
- Soury, M., Gossart, C., Adda, M., Devillers L., A tool to elicit and collect multicultural and multimodal laughter, Show & Tell, Proceedings of Interspeech, 2013.Google Scholar
Index Terms
- A social interaction system for studying humor with the Robot NAO
Recommendations
Conversational speech synthesis and the need for some laughter
This paper reports progress in the synthesis of conversational speech, from the viewpoint of work carried out on the analysis of a very large corpus of expressive speech in normal everyday situations. With recent developments in concatenative techniques,...
Classification of social laughter in natural conversational speech
We report progress towards developing a sensor module that categorizes types of laughter for application in dialogue systems or social-skills training situations. The module will also function as a component to measure discourse engagement in natural ...
Looking for Laughs: Gaze Interaction with Laughter Pragmatics and Coordination
ICMI '21: Proceedings of the 2021 International Conference on Multimodal InteractionLaughter and gaze have an important role in managing and coordi-nating social interactions. In the current work, using a multimodal corpus of dyadic taste-testing interactions, we explore whether laughs performing different pragmatic functions are ...
Comments