J. Cassell
T. Bickmore
H. Vilhjálmsson
ABSTRACT
Prior research into embodied interface agents has found that users like them and find them engaging. In this paper, we argue that embodiment can serve an even stronger function if system designers use actual human conversational protocols in the design of the interface. Communicative behaviors such as salutations and farewells, conversational turn-taking with interruptions, and referring to objects using pointing gestures are examples of protocols that all native speakers of a language already know how to perform and that can thus be leveraged in an intelligent interface. We discuss how these protocols are integrated into Rea, an embodied, multi-modal conversational interface agent who acts as a real-estate salesperson, and we show why embodiment is required for their successful implementation.
- 1.Andre, E., Rist, T., Mueller, J. Integrating Reactive and Scripted Behaviors in a Life-Like Presentation Agent. In Proceedings of Agents '98 (Minneapolis/St. Paul, May 1998), ACM Press. Google Scholar
Digital Library
- 2.Azarbayejani, A., Wren, C. and Pentland A. Real-time 3-D tracking of the human body. In Proceedings of IMAGE'COM 96, (Bordeaux, France, May 1996).Google Scholar
- 3.Ball, G., Ling, D., Kurlander, D., Miller, D., Pugh, D., Skelly, T., Stankosky, A., Thiel, D., Van Dantzich, M. and T. Wax. Lifelike computer characters: the persona project at Microsoft Research. In Software Agents, J. M. Bradshaw (ed.), MIT Press, Cambridge, MA, 1997. Google ScholarDigital Library
- 4.Boyle, E., Anderson, A., and Newlands, A. The Effects of Visibility in a Cooperative Problem Solving Task. Language and Speech 37(l), 1994. l-20.Google Scholar
- 5.Cassell, J. "Embodied Conversation: Integrating Face and Gesture into Automatic Spoken Dialogue Systems." In Luperfoy (ed.), Spoken Dialogue Systems. (to appear) Cambridge, MA: MIT Press.Google Scholar
- 6.Cassell, J., Bickmore, J., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., Yan, H. "Embodiment in Conversational Interfaces: Real', ACM CHI 99 Conference Proceedings, Pittsburgh, PA, 1999. Google ScholarDigital Library
- 7.Cassell, J., Bickmore, J., Campbell, L., Vilhjblmsson, H., Yan, H. Human Conversation as a System Framework: Designing Embodied Conversational Agents, in Cassell, J. editor, Embodied Conversational Agents, MIT Press, Cambridge, MA, 1999 Google ScholarDigital Library
- 8.Cassell, J., Pelachaud, C., Badler, N.I., Steedman, M., Achorn, B., Beckett, T., Douville, B., Prevost, S. and Stone, M. Animated conversation: rule-based generation of facial display, gesture and spoken intonation for multiple conversational agents. Computer Graphics (SIGGRAPH '94 Proceedings), 28(4): 413-420. Google ScholarDigital Library
- 9.Cassell, J. and Thbrisson, K. The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. Journal of Applied Art@ial Intelligence, in press.Google Scholar
- 10.Cassell, J., Torres, 0. and Prevost, S. Turn taking vs. Discourse Structure: how best to model multimodal conversation. In Wilks (ed.) Machine Conversations. Kluwer, The Hague, 1998.Google Scholar
- 11.Chovil, N. Discourse-Oriented Facial Displays in Conversation. Research on Language and Social Interaction, 25, 163-I 94, 1992.Google Scholar
- 12.CLIPS Reference Manual Version 6.0. Technical Report, Number JSC-25012, Software Technology Branch, Lyndon B. Johnson Space Center, Houston, TX, 1994.Google Scholar
- 13.Finin, T., Fritzson, R. KQML as an Agent Communication Language. In Proceedings of the Third International Conference on Information and Knowledge Management (CIKM'94, November 1994), ACM Press. Google ScholarDigital Library
- 14.Keisler, S., and Sproull, L. "Social" Human-Computer Interaction. In B. Friedman (Ed) Human Values and the Design of Computer Technology. CSLI Publications, New York, 1997. 191-200. Google ScholarDigital Library
- 15.Kendon, A. Conducting Interaction: Patterns of behavior in focused encounters. Cambridge University Press. New York. 1990.Google Scholar
- 16.Koda, T., and Maes, P. Agents with faces: The effect of personification. Proceedings of the F$h IEEE International Workshop on Robot and Human Communication (RO-MAN '96). 189-l 94.Google Scholar
- 17.Lester, J., Converse, S., Kahler, S., Barlow, S., Stone, B., and Bhogal, R. The Persona Effect: Affective Impact of Animated Pedagogical Agents. In S. Pemberton (Ed.), Human Factors in Computing Systems: CHI'97 Conference Proceedings. 359-366. New York: ACM Press. Google ScholarDigital Library
- 18.McNeil1, D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press. 1992.Google Scholar
- 19.Prevost, S., Hodgson, P., Cook, L., and Churchill, E. Face-to-Face Interfaces. In M. Altom and M. Williams (Eds.), Human Factors in Computing Systems: CHI'99 Extended Abstracts. 244-245. New York: ACM Press. Google ScholarDigital Library
- 20.Ricke1, J., and Johnson, L. Task-Oriented Dialogs with Animated Agents in Virtual Reality. In Proceedings of the Worlcshop on Embodied Conversational Characters (Tahoe City, California, October 1998). 39-46.Google Scholar
- 21.Stone, M. Modality in Dialogue: Planning, Pragmatics, and Computation. PhD Thesis, University of Pennsylvania, 1998. Google ScholarDigital Library
- 22.Thbrisson, K. R. Communicative Humanoids: A Computational Model of Psychosocial Dialogue Skills. PhD Thesis, MIT Media Laboratory, 1996. Google ScholarDigital Library
- 23.Takeuchi, A., and Naito, T. Situated facial displays: Towards social interaction. In I. Katz, R. Mack, L. Marks, M. Rosson, and J. Nielsen (Eds.), Human Factors in Computing Systems: CHI'95 Conference Proceedings. 450-455. New York: ACM Press. Google ScholarDigital Library
Index Terms
- More than just a pretty face: affordances of embodiment
Recommendations
More than just a pretty face: conversational protocols and the affordances of embodiment
Prior research into embodied interface agents has found that users like them and find them engaging. However, results on the effectiveness of these interfaces for task completion have been mixed. In this paper, we argue that embodiment can serve an even ...
Speech and face-to-face communication - An introduction
This issue focuses on face-to-face speech communication. Research works have demonstrated that this communicative situation is essential to language acquisition and development (e.g. naming). Face-to-face communication is in fact much more than speaking ...
Face-to-face interfaces
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing SystemsRecent work on the social nature of human-computer interactions [3] has prompted research on animated, anthropomorphic characters in user interfaces. Such interfaces may simplify user interactions by allowing them to use and interpret natural face-to-...
Comments