Editorial Notes
The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on March 19, 2024. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.
ABSTRACT
In what ways could the future of emotional bonds between humans and conversational AI change us? To explore this question in a multi-faceted manner, designers, engineers, philosophers as separate focus groups were given a design fiction probe— a story of a chatbot’s disappearance from a person’s life. Though articulated in discipline-specific ways, participants expressed similar concerns and hopes: 1) caring for a machine could teach people to emotionally care for themselves and others, 2) the boundary between human and non-human emotions may become blurred when people project their own emotions onto AI, e.g., a bot’s ”breakdown” as one’s own, and 3) people may then intertwine their identities with AI through emotions. We consider ethical ramifications of socially constructed emotions between humans and conversational agents.
Supplemental Material
Available for Download
Version of Record for "Where is Vincent? Expanding our emotional selves with AI" by Lee et al., Proceedings of the 4th Conference on Conversational User Interfaces (CUI '22).
- Mark S. Ackerman. 2000. The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility. Human–Computer Interaction 15, 2-3 (2000), 179–203. https://doi.org/10.1207/S15327051HCI1523_5Google ScholarDigital Library
- Theodor W Adorno. 2005 [1951]. Minima moralia: Reflections on a damaged life. Verso.Google Scholar
- Patrícia Alves-Oliveira, Maria Luce Lupetti, Michal Luria, Diana Löffler, Mafalda Gamboa, Lea Albaugh, Waki Kamino, Anastasia K. Ostrowski, David Puljiz, Pedro Reynolds-Cuéllar, Marcus Scheunemann, Michael Suguitan, and Dan Lockton. 2021. Collection of Metaphors for Human-Robot Interaction. (2021), 1366–1379. https://doi.org/10.1145/3461778.3462060Google ScholarDigital Library
- James R Averill. 1980. A constructivist view of emotion. In Theories of Emotion, Robert Plutchik and Henry Kellerman (Eds.). Academic Press, 305–339. https://doi.org/10.1016/B978-0-12-558701-3.50018-1Google ScholarCross Ref
- Lisa Feldman Barrett, Ralph Adolphs, Stacy Marsella, Aleix M Martinez, and Seth D Pollak. 2019. Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest 20, 1 (2019), 1–68.Google ScholarCross Ref
- BBC. 2019. Why I ’married’ a cartoon character - BBC News. https://www.bbc.com/news/stories-49343280. (Accessed on 01/24/2020).Google Scholar
- Julie Beck. 2013. Married to a Doll: Why One Man Advocates Synthetic Love - The Atlantic. https://www.theatlantic.com/health/archive/2013/09/married-to-a-doll-why-one-man-advocates-synthetic-love/279361/. (Accessed on 01/25/2020).Google Scholar
- Mark Blythe. 2017. Research Fiction: Storytelling, Plot and Design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5400–5411. https://doi.org/10.1145/3025453.3026023Google ScholarDigital Library
- Susanne Bødker. 2006. When Second Wave HCI Meets Third Wave Challenges. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles (Oslo, Norway) (NordiCHI ’06). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/1182475.1182476Google ScholarDigital Library
- Susanne Bødker. 2015. Third-Wave HCI, 10 Years Later—Participation and Sharing. Interactions 22, 5 (Aug 2015), 24–31. https://doi.org/10.1145/2804405Google ScholarDigital Library
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101.Google ScholarCross Ref
- Virginia Braun and Victoria Clarke. 2012. Thematic analysis. In APA Handbook of Research Methods in Psychology: Vol. 2. Research Designs. in Cooper, H. (Eds.). APA, 57–71.Google Scholar
- Cynthia Breazeal. 2004. Social interactions in HRI: the robot view. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 34, 2 (2004), 181–186.Google ScholarDigital Library
- Kimberley Brownlee. 2013. A human right against social deprivation. The Philosophical Quarterly 63, 251 (2013), 199–222.Google ScholarCross Ref
- Kimberley Brownlee. 2014. Ethical dilemmas of sociability. Utilitas (2014), 1–19.Google Scholar
- Tony Buzan and Barry Buzan. 2006. The Mind Map Book. Pearson Education.Google Scholar
- Alain Cardon. 2006. Artificial consciousness, artificial emotions, and autonomous robots. Cognitive Processing 7, 4 (2006), 245–267.Google ScholarCross Ref
- Martha Ann Carey and Mickey W Smith. 1994. Capturing the group effect in focus groups: A special concern in analysis. Qualitative Health Research 4, 1 (1994), 123–127.Google ScholarCross Ref
- EunJeong Cheon, Stephen Tsung-Han Sher, Šelma Sabanović, and Norman Makoto Su. 2019. I Beg to Differ: Soft Conflicts in Collaborative Design Using Design Fictions. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 201–214. https://doi.org/10.1145/3322276.3322350Google ScholarDigital Library
- Minji Cho, Sang-su Lee, and Kun-Pyo Lee. 2019. Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home Are Forgotten. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 1557–1569. https://doi.org/10.1145/3322276.3322332Google ScholarDigital Library
- Nicholas A. Christakis. 2019. Will Robots Change Human Relationships? - The Atlantic. https://www.theatlantic.com/magazine/archive/2019/04/robots-human-relationships/583204/. (Accessed on 09/16/2020).Google Scholar
- Leigh Clark, Phillip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, and Benjamin Cowan. 2019. The State of Speech in HCI: Trends, Themes and Challenges. Interacting with Computers 31, 4 (2019).Google Scholar
- Kate Crawford, Roel Dobbe, Theodora Dryer, Genevieve Fried, Ben Green, Elizabeth Kaziunas, Mathur-Varoon Kak, Amba, Erin McElroy, Andrea Nill Sanchez, Deborah Raji, Joy Lisi rankin, Rashida Richardon, Jason Schultz, Sarah Mysers West, and Meredith Whittaker. 2019. AI now report 2019. AI Now Institute at New York University.Google Scholar
- John Danaher. 2019. Welcoming Robots into the Moral Circle: A Defence of Ethical Behaviourism. Science and Engineering Ethics(2019), 1–27.Google Scholar
- Sabine A Döring. 2003. Explaining action by emotion. The Philosophical Quarterly 53, 211 (2003), 214–230.Google ScholarCross Ref
- Anthony Dunne and Fiona Raby. 2013. Speculative everything: design, fiction, and social dreaming. MIT press.Google ScholarDigital Library
- Paul Ekman. 1992. Are there basic emotions?Psychological Review 99, 3 (1992), 550–553.Google Scholar
- Paul Ekman. 1993. Facial expression and emotion. American Psychologist 48, 4 (1993), 384–392.Google ScholarCross Ref
- Paul Ekman, Wallace V Friesen, and Phoebe Ellsworth. 2013 [1972]. Emotion in the human face: Guidelines for research and an integration of findings. Vol. 11. Elsevier.Google Scholar
- Jonze-S. Ellison, M. and Landay. V.Jonze, S. (Director). 2013. Her [Motion Picture]. United States: Annapurna Pictures.Google Scholar
- Beverley Fehr and James A Russell. 1984. Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General 113, 3 (1984), 464–486.Google ScholarCross Ref
- Nico H Frijda. 1988. The laws of emotion. American Psychologist 43, 5 (1988), 349–358.Google ScholarCross Ref
- Thomas Fuchs. 2017. Intercorporeality and interaffectivity. Intercorporeality: Emerging socialities in interaction (2017), 3–23.Google ScholarCross Ref
- William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a Resource for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 233–240. https://doi.org/10.1145/642611.642653Google ScholarDigital Library
- Maria Gendron and Lisa Feldman Barrett. 2009. Reconstructing the past: A century of ideas about emotion in psychology. Emotion Review 1, 4 (2009), 316–339.Google ScholarCross Ref
- Kenneth J Gergen. 1995. Metaphor and monophony in the 20th-century psychology of emotions. History of the Human Sciences 8, 2 (1995), 1–23.Google ScholarCross Ref
- Erving Goffman. 2006. The presentation of self. Life as theater: A dramaturgical sourcebook(2006).Google Scholar
- Jonathan Haidt. 2003. The moral emotions. Handbook of Affective Sciences 11 (2003), 852–870.Google Scholar
- Byung-Chul Han. 2017. Psychopolitics. Neoliberalism and New Technologies of Power.Google Scholar
- Ursula Hess and Agneta Fischer. 2013. Emotional mimicry as social regulation. Personality and Social Psychology Review 17, 2 (2013), 142–157.Google ScholarCross Ref
- Tiffany Hsu. 2010. https://latimesblogs.latimes.com/technology/2010/11/japanese-pop-star-takes-the-stage-as-a-3-d-hologram.html. https://latimesblogs.latimes.com/technology/2010/11/japanese-pop-star-takes-the-stage-as-a-3-d-hologram.html. (Accessed on 01/29/2020).Google Scholar
- Kazuo Ishiguro. 2021. Klara and the Sun: A novel. Knopf.Google Scholar
- Razan Jaber and Donald McMillan. 2020. Conversational User Interfaces on Mobile Devices: Survey. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI ’20). Association for Computing Machinery, New York, NY, USA, Article 10, 11 pages. https://doi.org/10.1145/3405755.3406130Google ScholarDigital Library
- Cal Jeffrey. 2018. Japanese man marries anime hologram of Hatsune Miku - TechSpot. https://www.techspot.com/news/77385-japanese-man-marries-anime-hologram-hatsune-miku.html. (Accessed on 01/29/2020).Google Scholar
- Dacher Keltner. 1995. Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame.Journal of Personality and Social Psychology 68, 3(1995), 441.Google Scholar
- Jenny Kitzinger. 1995. Qualitative research: Introducing focus groups. BMJ 311, 7000 (1995), 299–302.Google ScholarCross Ref
- Gina Kolata. 2019. You Got a Brain Scan at the Hospital. Someday a Computer May Use It to Identify You. The New York Times. https://www.nytimes.com/2019/10/23/health/brain-scans-personal-identity.html. (Accessed on 01/29/2020).Google Scholar
- Richard A Krueger. 2014. Focus groups: A practical guide for applied research. Sage publications.Google Scholar
- Richard S Lazarus. 2006. Emotions and interpersonal relationships: Toward a person-centered conceptualization of emotions and coping. Journal of Personality 74, 1 (2006), 9–46.Google ScholarCross Ref
- Lucian Leahu and Phoebe Sengers. 2014. Freaky: Performing Hybrid Human-Machine Emotion. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 607–616. https://doi.org/10.1145/2598510.2600879Google ScholarDigital Library
- Minha Lee. 2020. Speech acts redux: Beyond request-response interactions. In Proceedings of the 2nd Conference on Conversational User Interfaces. 1–10.Google ScholarDigital Library
- Minha Lee, Sander Ackermans, Nena van As, Hanwen Chang, Enzo Lucas, and Wijnand IJsselsteijn. 2019. Caring for Vincent: A Chatbot for Self-Compassion. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 702.Google ScholarDigital Library
- Minha Lee, Dimosthenis Kontogiorgos, Ilaria Torre, Michal Luria, Ravi Tejwani, Matthew J. Dennis, and Andre Pereira. 2021. Robo-Identity: Exploring Artificial Identity and Multi-Embodiment. In Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (Boulder, CO, USA) (HRI ’21 Companion). Association for Computing Machinery, New York, NY, USA, 718–720. https://doi.org/10.1145/3434074.3444878Google ScholarDigital Library
- Minha Lee, Renee Noortman, Cristina Zaga, Alain Starke, Gijs Huisman, and Kristina Andersen. 2021. Conversational Futures: Emancipating Conversational Interactions for Futures Worth Wanting. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 298, 13 pages. https://doi.org/10.1145/3411764.3445244Google ScholarDigital Library
- Sunok Lee, Minha Lee, and Sangsu Lee. 2022. What If Artificial Intelligence Become Completely Ambient in Our Daily Lives? Exploring Future Human-AI Interaction through High Fidelity Illustrations. International Journal of Human–Computer Interaction (2022), 1–19.Google ScholarCross Ref
- Su Lei and Jonathan Gratch. 2019. Smiles Signal Surprise in a Social Dilemma. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 627–633.Google ScholarCross Ref
- Joseph Lindley and Paul Coulton. 2015. Back to the Future: 10 Years of Design Fiction. In Proceedings of the 2015 British HCI Conference(Lincoln, Lincolnshire, United Kingdom) (British HCI ’15). Association for Computing Machinery, New York, NY, USA, 210–211. https://doi.org/10.1145/2783446.2783592Google ScholarDigital Library
- Michal Luria and Stuart Candy. 2022. Letters from the Future: Exploring Ethical Dilemmas in the Design of Social Agents. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 419, 13 pages. https://doi.org/10.1145/3491102.3517536Google ScholarDigital Library
- Michal Luria, Judeth Oden Choi, Rachel Gita Karp, John Zimmerman, and Jodi Forlizzi. 2020. Robotic Futures: Learning about Personally-Owned Agents through Performance. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 165–177. https://doi.org/10.1145/3357236.3395488Google ScholarDigital Library
- Michael F Mascolo. 2016. Beyond Objectivity and Subjectivity: The Intersubjective Foundations of Psychological Science. Integrative Psychological and Behavioral Science 50, 4 (2016), 543–554.Google ScholarCross Ref
- Neil McArthur and Markie LC Twist. 2017. The rise of digisexuality: Therapeutic challenges and possibilities. Sexual and Relationship Therapy 32, 3-4 (2017), 334–344.Google ScholarCross Ref
- E Doyle McCarthy. 1994. The social construction of emotions: New directions from culture theory. Social Perspectives on Emotion 2, 1 (1994), 267–279.Google Scholar
- Andrew McStay. 2018. Emotional AI: The rise of empathic media. Sage.Google ScholarCross Ref
- Michael Muller and Thomas Erickson. 2018. In the Data Kitchen: A Review (a Design Fiction on Data Science). In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3170427.3188407Google ScholarDigital Library
- Nel Noddings. 2008. Caring and moral education. In Handbook of Moral and Character Education, Larry P. Nucci and D. Narvaez (Eds.). New York: Routledge, 175–203.Google Scholar
- Martha C Nussbaum. 2001. The fragility of goodness: Luck and ethics in Greek tragedy and philosophy. Cambridge University Press.Google Scholar
- Sven Nyholm and Lily Eva Frank. 2017. From Sex Robots to Love Robots: Is Mutual Love with a Robot Possible?. In Robot Sex: Social and Ethical Implications. in Danaher, J., and McArthur, N. (Eds.). MIT press, 219–243.Google Scholar
- Parmy Olson. 2016. Get Ready For The Chat Bot Revolution: They’re Simple, Cheap And About To Be Everywhere. https://www.forbes.com/sites/parmyolson/2016/02/23/chat-bots-facebook-telegram-wechat/#7ce3f8802068. (Accessed on 12/16/2019).Google Scholar
- Emmi Parviainen and Marie Louise Juul Søndergaard. 2020. Experiential Qualities of Whispering with Voice Assistants. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376187Google ScholarDigital Library
- Rosalind W Picard. 2003. Affective computing: challenges. International Journal of Human-Computer Studies 59, 1-2 (2003), 55–64.Google ScholarDigital Library
- Rosalind Wright Picard. Technical Report 321, MIT Media Lab, Perceptual Computing Group, 1995. Affective computing. (Technical Report 321, MIT Media Lab, Perceptual Computing Group, 1995).Google Scholar
- Anuradha Reddy, A. Baki Kocaballi, Iohanna Nicenboim, Marie Louise Juul Søndergaard, Maria Luce Lupetti, Cayla Key, Chris Speed, Dan Lockton, Elisa Giaccardi, Francisca Grommé, Holly Robbins, Namrata Primlani, Paulina Yurman, Shanti Sumartojo, Thao Phan, Viktor Bedö, and Yolande Strengers. 2021. Making Everyday Things Talk: Speculative Conversations into the Future of Voice Interfaces at Home. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 23, 16 pages. https://doi.org/10.1145/3411763.3450390Google ScholarDigital Library
- Byron Reeves and Clifford Ivar Nass. 1996. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press.Google ScholarDigital Library
- Lauren Rhue. 2018. Racial influence on automated perceptions of emotions. Available at SSRN 3281765(2018).Google Scholar
- Ronda Ringfort-Felner, Matthias Laschke, Shadan Sadeghian, and Marc Hassenzahl. 2022. Kiro: A Design Fiction to Explore Social Conversation with Voice Assistants. Proc. ACM Hum.-Comput. Interact. 6, GROUP, Article 33 (jan 2022), 21 pages. https://doi.org/10.1145/3492852Google ScholarDigital Library
- James A Russell, Jo-Anne Bachorowski, and José-Miguel Fernández-Dols. 2003. Facial and vocal expressions of emotion. Annual Review of Psychology 54, 1 (2003), 329–349.Google ScholarCross Ref
- James A Russell and Lisa Feldman Barrett. 1999. Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. Journal of Personality and Social Psychology 76, 5(1999), 805–819.Google ScholarCross Ref
- Jean-Paul Sartre. 2016. What is Subjectivity?Verso Books.Google Scholar
- Britta F. Schulte, Paul Marshall, and Anna L. Cox. 2016. Homes For Life: A Design Fiction Probe. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 80, 10 pages. https://doi.org/10.1145/2971485.2993925Google ScholarDigital Library
- Julius Sim. 1998. Collecting and analysing qualitative data: Issues raised by the focus group. Journal of Advanced Nursing 28, 2 (1998), 345–352.Google ScholarCross Ref
- Herbert A Simon. 2019. The sciences of the artificial. MIT press.Google ScholarDigital Library
- Timothy Y Sohn. 2004. Community-oriented programming through instant messaging. In 2004 IEEE Symposium on Visual Languages-Human Centric Computing. IEEE, 294–295.Google ScholarDigital Library
- Marie Louise Juul Søndergaard and Lone Koefoed Hansen. 2018. Intimate Futures: Staying with the Trouble of Digital Personal Assistants through Design Fiction. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, 869–880.Google ScholarDigital Library
- Bruce Sterling. 2009. Design fiction. Interactions 16, 3 (2009), 20–24.Google ScholarDigital Library
- Daniela Stier, Katherine Munro, Ulrich Heid, and Wolfgang Minker. 2020. Towards Situation-Adaptive In-Vehicle Voice Output. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI ’20). Association for Computing Machinery, New York, NY, USA, Article 7, 7 pages. https://doi.org/10.1145/3405755.3406127Google ScholarDigital Library
- Peter Frederick Strawson. 1963 [2008]. Freedom and resentment and other essays. Routledge.Google Scholar
- Tsjalling Swierstra, Dirk Stemerding, and Marianne Boenink. 2009. Exploring Techno-Moral Change: The Case of the ObesityPill. Springer Netherlands, Dordrecht, 119–138. https://doi.org/10.1007/978-90-481-2229-5_9Google ScholarCross Ref
- Jianhua Tao and Tieniu Tan. 2005. Affective Computing: A Review. In Affective Computing and Intelligent Interaction, Jianhua Tao, Tieniu Tan, and Rosalind W. Picard (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 981–995.Google ScholarDigital Library
- Sherry Turkle. 1995. Life on the Screen. Phoenix.Google Scholar
- Sherry Turkle. 2007. Authenticity in the age of digital companions. Interaction studies 8, 3 (2007), 501–517.Google Scholar
- Peter-Paul Verbeek. 2006. Materializing morality: Design ethics and technological mediation. Science, Technology, & Human Values 31, 3 (2006), 361–380.Google ScholarCross Ref
- Peter-Paul Verbeek. 2011. Moralizing technology: Understanding and designing the morality of things. University of Chicago Press.Google Scholar
- Ron Wakkary. 2021. Things we could design: For more than human-centered worlds. MIT press.Google Scholar
- Qiaosi Wang, Shan Jing, and Ashok K. Goel. 2022. Co-Designing AI Agents to Support Social Connectedness Among Online Learners: Functionalities, Social Characteristics, and Ethical Challenges. (2022), 541–556. https://doi.org/10.1145/3532106.3533534Google ScholarDigital Library
- Yongdong Wang. 2016. The Chatbot That’s Acing the Largest Turing test in History. http://nautil.us/issue/33/attraction/your-next-new-best-friend-might-be-a-robot. (Accessed on 12/16/2019).Google Scholar
- Stefan Weitz. 2014. Meet XiaoIce, Cortana’s Little Sister | Bing Search Blog. https://blogs.bing.com/search/2014/09/05/meet-xiaoice-cortanas-little-sister. (Accessed on 12/16/2019).Google Scholar
- Joseph Weizenbaum 1966. ELIZA—a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (1966), 36–45.Google ScholarDigital Library
Index Terms
- Where is Vincent? Expanding our emotional selves with AI
Recommendations
Recognizing the emotional state of human and virtual instructors
AbstractStudents' learning from an instructional video could be affected by the instructor's emotional stance during a lesson. A first step in investigating this emotional design hypothesis is to determine whether students perceive the ...
Highlights- This research investigated whether participants are able to recognize the emotional tone of instructors in video clips.
Psychological responses to simulated displays of mismatched emotional expressions
Embodied agents are often designed with the ability to simulate human emotion. This paper investigates the psychological impact of simulated emotional expressions on computer users with a particular emphasis on how mismatched facial and audio ...
Achieving rapport with turn-by-turn, user-responsive emotional coloring
People in dialog use a rich set of nonverbal behaviors, including variations in the prosody of their utterances. Such behaviors, often emotion-related, call for appropriate responses, but today's spoken dialog systems lack the ability to do this. Recent ...
Comments