Qiaosi Wang
Koustuv Saha
Eric Gregori
ABSTRACT
Building conversational agents that can conduct natural and prolonged conversations has been a major technical and design challenge, especially for community-facing conversational agents. We posit Mutual Theory of Mind as a theoretical framework to design for natural long-term human-AI interactions. From this perspective, we explore a community’s perception of a question-answering conversational agent through self-reported surveys and computational linguistic approach in the context of online education. We first examine long-term temporal changes in students’ perception of Jill Watson (JW), a virtual teaching assistant deployed in an online class discussion forum. We then explore the feasibility of inferring students’ perceptions of JW through linguistic features extracted from student-JW dialogues. We find that students’ perception of JW’s anthropomorphism and intelligence changed significantly over time. Regression analyses reveal that linguistic verbosity, readability, sentiment, diversity, and adaptability reflect student perception of JW. We discuss implications for building adaptive community-facing conversational agents as long-term companions and designing towards Mutual Theory of Mind in human-AI interaction.
- Vincent AWMM Aleven and Kenneth R Koedinger. 2002. An effective metacognitive strategy: Learning by doing and explaining with a computer-based cognitive tutor. Cognitive science 26, 2 (2002), 147–179.Google Scholar
- Tim Althoff, Kevin Clark, and Jure Leskovec. 2016. Large-scale analysis of counseling conversations: An application of natural language processing to mental health. TACL (2016).Google Scholar
- Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Zahra Ashktorab, Mohit Jain, Q. Vera Liao, and Justin D. Weisz. 2019. Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–12. https://doi.org/10.1145/3290605.3300484Google ScholarDigital Library
- Simon Baron-Cohen. 1997. Mindblindness: An essay on autism and theory of mind. MIT press.Google Scholar
- Simon Baron-cohen. 1999. Evolution of a Theory of Mind?In The Descent of Mind: Psychological Perspectives on Hominid Evolution. Oxford University Press, 1–31.Google Scholar
- Simon Baron-Cohen, Alan M Leslie, Uta Frith, 1985. Does the autistic child have a “theory of mind”. Cognition 21, 1 (1985), 37–46.Google ScholarCross Ref
- Christoph Bartneck, Dana Kulić, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots. International Journal of Social Robotics 1, 1 (1 2009), 71–81. https://doi.org/10.1007/s12369-008-0001-3Google ScholarCross Ref
- Erin Beneteau, Olivia K Richards, Mingrui Zhang, Julie A Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Emilie Bigras, Marc Antoine Jutras, Sylvain Sénécal, Pierre Majorique Léger, Marc Fredette, Chrystel Black, Nicolas Robitaille, Karine Grande, and Christian Hudon. 2018. Working with a recommendation agent: How recommendation presentation influences users’ perceptions and behaviors. Conference on Human Factors in Computing Systems - Proceedings 2018-April (2018), 1–6. https://doi.org/10.1145/3170427.3188639Google ScholarDigital Library
- Michael Braun, Anja Mainz, Ronee Chadowitz, Bastian Pfleging, and Florian Alt. 2019. At your service: Designing voice assistant personalities to improve automotive user interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.Google ScholarDigital Library
- Peter Carruthers and Peter K Smith. 1996. Theories of theories of mind. Cambridge University Press.Google Scholar
- Justine Cassell and Timothy Bickmore. 2000. External manifestations of trustworthiness in the interface. Commun. ACM 43, 12 (2000), 50–56.Google ScholarDigital Library
- Justine Cassell and Timothy Bickmore. 2003. Negotiated collusion: Modeling social language and its relationship effects in intelligent agents. User Modelling and User-Adapted Interaction 13, 1-2 (2003), 89–132. https://doi.org/10.1023/A:1024026532471Google ScholarDigital Library
- Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The Bag of Communities: Identifying Abusive Behavior Online with Preexisting Internet Data. In Proc. CHI.Google ScholarDigital Library
- Dasom Choi, Daehyun Kwak, Minji Cho, and Sangsu Lee. 2020. ”Nobody Speaks that Fast!” An Empirical Study of Speech Rate in Conversational Agents for People with Vision Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376569Google ScholarDigital Library
- Leon Ciechanowski, Aleksandra Przegalinska, Mikolaj Magnuski, and Peter Gloor. 2019. In the shades of the uncanny valley: An experimental study of human–chatbot interaction. Future Generation Computer Systems 92 (2019), 539–548.Google ScholarDigital Library
- Leigh Clark, Nadia Pantidi, Orla Cooney, Philip Doyle, Diego Garaialde, Justin Edwards, Brendan Spillane, Emer Gilmartin, Christine Murad, Cosmin Munteanu, Vincent Wade, and Benjamin R. Cowan. 2019. What makes a good conversation? Challenges in designing truly conversational agents. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–12. https://doi.org/10.1145/3290605.3300705Google ScholarDigital Library
- Cristian Danescu-Niculescu-Mizil, Michael Gamon, and Susan Dumais. 2011. Mark my words! Linguistic style accommodation in social media. In Proceedings of the 20th international conference on World wide web. 745–754.Google ScholarDigital Library
- Cristian Danescu-Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, and Christopher Potts. 2013. A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078(2013).Google Scholar
- Vedant Das Swain, Koustuv Saha, Manikanta D Reddy, Hemang Rajvanshy, Gregory D Abowd, and Munmun De Choudhury. 2020. Modeling Organizational Culture with Workplace Experiences Shared on Glassdoor. In CHI.Google Scholar
- Robyn M Dawes and Bernard Corrigan. 1974. Linear models in decision making.Psychological bulletin 81, 2 (1974), 95.Google Scholar
- Ewart J De Visser, Samuel S Monfort, Ryan McKendrick, Melissa AB Smith, Patrick E McKnight, Frank Krueger, and Raja Parasuraman. 2016. Almost human: Anthropomorphism increases trust resilience in cognitive agents.Journal of Experimental Psychology: Applied 22, 3 (2016), 331.Google Scholar
- Chris Dede, John Richards, and Bror Saxberg. 2018. Learning Engineering for Online Education: Theoretical Contexts and Design-based Examples. Routledge.Google Scholar
- Sandra Devin and Rachid Alami. 2016. An implemented theory of mind to improve human-robot shared plans execution. ACM/IEEE International Conference on Human-Robot Interaction 2016-April(2016), 319–326. https://doi.org/10.1109/HRI.2016.7451768Google ScholarCross Ref
- Bobbie Eicher, Kathryn Cunningham, Sydni Peterson Marissa Gonzales, and Ashok Goel. 2017. Toward mutual theory of mind as a foundation for co-creation. In International Conference on Computational Creativity, Co-Creation Workshop.Google Scholar
- Sindhu Kiranmai Ernala, Asra F Rizvi, Michael L Birnbaum, John M Kane, and Munmun De Choudhury. 2017. Linguistic markers indicating therapeutic outcomes of social media disclosures of schizophrenia. Proceedings of the ACM on Human-Computer Interaction 1, CSCW(2017), 1–27.Google ScholarDigital Library
- Hao Fang, Hao Cheng, Maarten Sap, Elizabeth Clark, Ari Holtzman, Yejin Choi, Noah A Smith, and Mari Ostendorf. 2018. Sounding board: A user-centric and content-driven social chatbot. arXiv preprint arXiv:1804.10202(2018).Google Scholar
- Jasper Feine, Stefan Morana, and Ulrich Gnewuch. 2019. Measuring Service Encounter Satisfaction with Customer Service Chatbots using Sentiment Analysis. Proceedings of the 14th International Conference on WirtschaftsinformatikDecember(2019), 0–11.Google Scholar
- Radhika Garg and Subhasree Sengupta. 2020. Conversational Technologies for In-home Learning: Using Co-Design to Understand Children’s and Parents’ Perspectives. (2020), 1–13. https://doi.org/10.1145/3313831.3376631Google ScholarDigital Library
- Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2020. Mental Models of AI Agents in a Cooperative Game Setting. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376316Google ScholarDigital Library
- Eun Go and S Shyam Sundar. 2019. Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior 97 (2019), 304–316.Google ScholarDigital Library
- Rachel Gockley, Allison Bruce, Jodi Forlizzi, Marek Michalowski, Anne Mundell, Stephanie Rosenthal, Brennan Sellner, Reid Simmons, Kevin Snipes, Alan C Schultz, 2005. Designing robots for long-term social interaction. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 1338–1343.Google ScholarCross Ref
- Ashok Goel. 2020. AI-Powered Learning: Making Education Accessible, Affordable, and Achievable. arXiv preprint arXiv:2006.01908(2020).Google Scholar
- Ashok K Goel and Lalith Polepeddi. 2016. Jill Watson: A virtual teaching assistant for online education. Technical Report. Georgia Institute of Technology.Google Scholar
- Erving Goffman. 1978. The Presentation of Self in Everyday Life. London: Harmondsworth.Google Scholar
- Alvin I Goldman 2012. Theory of mind. The Oxford handbook of philosophy of cognitive science 1 (2012).Google Scholar
- Alison Gopnik and Henry M Wellman. 1992. Why the child’s theory of mind really is a theory. (1992).Google Scholar
- O Can Görür, Benjamin Rosman, and Guy Hoffman. 2017. Toward Integrating Theory of Mind into Adaptive Decision-Making of Social Robots to Understand Human Intention. In Workshop on the Role of Intentions in Human-Robot Interaction at the International Conference on Human-Robot Interactions. Vienna, Austria.Google Scholar
- Pamela Grimm. 2010. Social desirability bias. Wiley international encyclopedia of marketing (2010).Google ScholarCross Ref
- Shivashankar Halan, Brent Rossen, Michael Crary, and Benjamin Lok. 2012. Constructionism of virtual humans to improve perceptions of conversational partners. (2012), 2387. https://doi.org/10.1145/2212776.2223807Google ScholarDigital Library
- Jeffrey T Hancock, Kailyn Gee, Kevin Ciaccio, and Jennifer Mae-Hwah Lin. 2008. I’m sad you’re sad: emotional contagion in CMC. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. 295–298.Google ScholarDigital Library
- Maaike Harbers, Karel Van Den Bosch, and John Jules Meyer. 2009. Modeling agents with a theory of mind. Proceedings - 2009 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2009 2(2009), 217–224. https://doi.org/10.1109/WI-IAT.2009.153Google ScholarDigital Library
- Laura M. Hiatt, Anthony M. Harrison, and J. Gregory Trafton. 2011. Accommodating human variability in human-robot teams through theory of mind. IJCAI International Joint Conference on Artificial Intelligence (2011), 2066–2071. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-345Google ScholarCross Ref
- Jennifer Hill, W. Randolph Ford, and Ingrid G. Farreras. 2015. Real conversations with artificial intelligence: A comparison between human-human online conversations and human-chatbot conversations. Computers in Human Behavior 49 (2015), 245–250. https://doi.org/10.1016/j.chb.2015.02.026Google ScholarDigital Library
- Kenneth Holstein, Bruce M McLaren, and Vincent Aleven. 2019. Designing for complementarity: Teacher and student needs for orchestration support in ai-enhanced classrooms. In International Conference on Artificial Intelligence in Education. Springer, 157–171.Google ScholarDigital Library
- Claire Hughes and Sue Leekam. 2004. What are the links between theory of mind and social relations? Review, reflections and new directions for studies of typical and atypical development. Social Development 13, 4 (2004), 590–619. https://doi.org/10.1111/j.1467-9507.2004.00285.xGoogle ScholarCross Ref
- C J Hutto and E E Gilbert. 2014. VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. Eighth International Conference on Weblogs and Social Media (ICWSM-14).”. Proceedings of the 8th International Conference on Weblogs and Social Media, ICWSM 2014 (2014). http://sentic.net/Google Scholar
- Kokil Jaidka, Sharath Chandra Guntuku, Anneke Buffone, H Andrew Schwartz, and Lyle H Ungar. 2018. Facebook vs. Twitter: Cross-platform differences in self-disclosure and trait prediction. In Proceedings of the Twelfth International AAAI Conference on Web and Social Media. 141–150.Google Scholar
- Yuin Jeong, Younah Kang, and Juho Lee. 2019. Exploring effects of conversational fillers on user perception of conversational agents. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–6. https://doi.org/10.1145/3290607.3312913Google ScholarDigital Library
- Da-jung Kim and Youn-kyung Lim. 2019. Co-Performing Agent: Design for Building User-Agent Partnership in Learning and Adaptive Services. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–14. https://doi.org/10.1145/3290605.3300714Google ScholarDigital Library
- Kyung-Joong Kim and Hod Lipson. 2009. Towards a simple robotic theory of mind. (2009), 131. https://doi.org/10.1145/1865909.1865937Google ScholarDigital Library
- Soomin Kim, Jinsu Eun, Changhoon Oh, Bongwon Suh, and Joonhwan Lee. 2020. Bot in the Bunch: Facilitating Group Chat Discussion by Improving Efficiency and Participation with a Chatbot. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376785Google ScholarDigital Library
- Anastasia Kuzminykh, Jenny Sun, Nivetha Govindaraju, Jeff Avery, and Edward Lank. 2020. Genie in the Bottle: Anthropomorphized Perceptions of Conversational Agents. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376665Google ScholarDigital Library
- Sunok Lee, Sungbae Kim, and Sangsu Lee. 2019. ”What does your Agent look like?”. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312796Google ScholarDigital Library
- Sangwon Lee, Naeun Lee, and Young June Sah. 2020. Perceiving a Mind in a Chatbot: Effect of Mind Perception and Social Cues on Co-presence, Closeness, and Intention to Use. International Journal of Human-Computer Interaction 36, 10(2020), 930–940. https://doi.org/10.1080/10447318.2019.1699748Google ScholarCross Ref
- Séverin Lemaignan and Pierre Dillenbourg. 2015. Mutual modelling in robotics: Inspirations for the next steps. In 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 303–310.Google ScholarDigital Library
- Q. Vera Liao, Werner Geyer, Muhammed Mas-ud Hussain, Praveen Chandar, Matthew Davis, Yasaman Khazaeni, Marco Patricio Crasso, Dakuo Wang, Michael Muller, and N. Sadat Shami. 2018. All Work and No Play? Conversations with a Question-and-Answer Chatbot in the Wild. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18, Vol. 8. ACM Press, New York, New York, USA, 1–13. https://doi.org/10.1145/3173574.3173577Google ScholarDigital Library
- Shuhong Lin, Boaz Keysar, and Nicholas Epley. 2010. Reflexively mindblind: Using theory of mind to interpret behavior requires effortful attention. Journal of Experimental Social Psychology 46, 3 (2010), 551–556. https://doi.org/10.1016/j.jesp.2009.12.019Google ScholarCross Ref
- Catherine L Lortie and Matthieu J Guitton. 2011. Judgment of the humanness of an interlocutor is in the eye of the beholder. PLoS One 6, 9 (2011), e25085.Google ScholarCross Ref
- Ewa Luger and Abigail Sellen. 2016. ”Like having a really bad PA”: the gulf between user expectation and experience of conversational agents. CHI ’16 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (2016), 5286–5297. https://doi.org/10.1145/2858036.2858288Google ScholarDigital Library
- François Mairesse, Marilyn A Walker, Matthias R Mehl, and Roger K Moore. 2007. Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of artificial intelligence research 30 (2007), 457–500.Google ScholarDigital Library
- Douglas R McCallum and James L Peterson. 1982. Computer-based readability indexes. In Proceedings of the ACM’82 Conference. 44–48.Google ScholarDigital Library
- Patrick E McKight and Julius Najab. 2010. Kruskal-wallis test. The corsini encyclopedia of psychology(2010), 1–1.Google Scholar
- Tomas Mikolov, Ilya Sustskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed Representations ofWords and Phrases and their Compositionality. In Neural Information Processing Systems (NIPS). 3111–3119.Google Scholar
- Masahiro Mori, Karl F MacDorman, and Norri Kageki. 2012. The uncanny valley [from the field]. IEEE Robotics & Automation Magazine 19, 2 (2012), 98–100.Google ScholarCross Ref
- Kellie Morrissey and Jurek Kirakowski. 2013. ’Realness’ in chatbots: Establishing quantifiable criteria. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8007 LNCS, PART 4(2013), 87–96. https://doi.org/10.1007/978-3-642-39330-3_10Google ScholarDigital Library
- Nora A. Murphy. 2007. Appearing smart: The impression management of intelligence, person perception accuracy, and behavior in social interaction. Personality and Social Psychology Bulletin 33, 3 (2007), 325–339. https://doi.org/10.1177/0146167206294871Google ScholarCross Ref
- Clifford Nass and Youngme Moon. 2000. Machines and mindlessness: Social responses to computers.Journal of Social Issues 1, 56 (2000), 81–103.Google Scholar
- Clifford Nass, Jonathan Steuer, and Ellen Tauber. 1994. Computers are Social Actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1994). ACM. https://doi.org/10.1109/VSMM.2014.7136659Google ScholarDigital Library
- Oda Elise Nordberg, Jo Dugstad Wake, Emilie Sektnan Nordby, Eivind Flobak, Tine Nordgreen, Suresh Kumar Mukhiya, and Frode Guribye. 2020. Designing Chatbots for Guiding Online Peer Support Conversations for Adults with ADHD. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11970 LNCS, November(2020), 113–126. https://doi.org/10.1007/978-3-030-39540-7_8Google ScholarDigital Library
- Nicole Novielli, Fiorella de Rosis, and Irene Mazzotta. 2010. User attitude towards an embodied conversational agent: Effects of the interaction mode. Journal of Pragmatics 42, 9 (2010), 2385–2397. https://doi.org/10.1016/j.pragma.2009.12.016Google ScholarCross Ref
- Catherine Pelachaud and Isabella Poggi. 2002. Subtleties of facial expressions in embodied agents. The Journal of Visualization and Computer Animation 13, 5 (2002), 301–312.Google ScholarCross Ref
- Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.Google ScholarCross Ref
- Christopher Peters. 2005. Foundations of an agent theory of mind model for conversation initiation in virtual environments. Virtual Social Agents(2005), 163.Google Scholar
- Matthew D. Pickard, Judee K. Burgoon, and Douglas C. Derrick. 2014. Toward an Objective Linguistic-Based Measure of Perceived Embodied Conversational Agent Power and Likeability. International Journal of Human-Computer Interaction 30, 6(2014), 495–516. https://doi.org/10.1080/10447318.2014.888504Google ScholarCross Ref
- Emily Pitler and Ani Nenkova. 2008. Revisiting readability: A unified framework for predicting text quality. In Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, 186–195.Google ScholarCross Ref
- David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind?Behavioral and brain sciences 1, 4 (1978), 515–526.Google Scholar
- David V. Pynadath and Stacy C. Marsella. 2005. PsychSim: Modeling theory of mind with decision-theoretic agents. IJCAI International Joint Conference on Artificial Intelligence (2005), 1181–1186.Google Scholar
- Stephen Reysen. 2005. Construction of a new scale: The Reysen likability scale. Social Behavior and Personality: an international journal 33, 2(2005), 201–208.Google Scholar
- Tina L Robbins and Angelo S DeNisi. 1994. A closer look at interpersonal affect as a distinct influence on cognitive processing in performance evaluations.Journal of Applied Psychology 79, 3 (1994), 341.Google Scholar
- Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L Murnane, Emma Brunskill, and James A Landay. 2019. Quizbot: A dialogue-based adaptive learning system for factual knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Koustuv Saha, Manikanta D Reddy, Stephen Mattingly, Edward Moskal, Anusha Sirigiri, and Munmun De Choudhury. 2019. Libra: On linkedin based role ambiguity and its relationship with wellbeing and job performance. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–30.Google ScholarDigital Library
- Koustuv Saha and Amit Sharma. 2020. Causal Factors of Effective Psychosocial Outcomes in Online Mental Health Communities. In ICWSM.Google Scholar
- Koustuv Saha, Ingmar Weber, and Munmun De Choudhury. 2018. A Social Media Based Examination of the Effects of Counseling Recommendations After Student Deaths on College Campuses. In ICWSM.Google Scholar
- Joseph Seering, Juan Pablo Flores, Saiph Savage, and Jessica Hammer. 2018. The social roles of bots: Situating bots in discussions in online communities. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018). https://doi.org/10.1145/3274426Google ScholarDigital Library
- Joseph Seering, Michal Luria, Geoff Kaufman, and Jessica Hammer. 2019. Beyond dyadic interactions: Considering chatbots as community members. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3290605.3300680Google ScholarDigital Library
- Joseph Seering, Michal Luria, Connie Ye, Geoff Kaufman, and Jessica Hammer. 2020. It Takes a Village: Integrating an Adaptive Chatbot into an Online Gaming Community. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376708Google ScholarDigital Library
- James Simpson. 2020. Are CUIs Just GUIs with Speech Bubbles?. In Proceedings of the 2nd Conference on Conversational User Interfaces. 1–3.Google ScholarDigital Library
- Marcin Skowron, Stefan Rank, Mathias Theunis, and Julian Sienkiewicz. 2011. The good, the bad and the neutral: affective profile in dialog system-user communication. In International Conference on Affective Computing and Intelligent Interaction. Springer, 337–346.Google ScholarCross Ref
- Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y Lim. 2019. Designing theory-driven user-centric explainable AI. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–15.Google ScholarDigital Library
- Qiaosi Wang, Shan Jing, Ida Camacho, David Joyner, and Ashok Goel. 2020. Jill Watson SA: Design and Evaluation of a Virtual Agent to Build Communities Among Online Learners. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.Google ScholarDigital Library
- Qiaosi Wang, Shan Jing, David Joyner, Lauren Wilcox, Hong Li, Thomas Plötz, and Betsy Disalvo. 2020. Sensing Affect to Empower Students: Learner Perspectives on Affect-Sensitive Technology in Large Educational Contexts. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 63–76.Google ScholarDigital Library
- Henry M Wellman. 1992. The child’s theory of mind.The MIT Press.Google Scholar
- Rainer Winkler, Sebastian Hobert, Antti Salovaara, Matthias Söllner, and Jan Marco Leimeister. 2020. Sara, the Lecturer: Improving Learning in Online Education with a Scaffolding-Based Conversational Agent. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376781Google ScholarDigital Library
- Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A new chatbot for customer service on social media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3506–3510.Google ScholarDigital Library
- Xi Yang, Marco Aurisicchio, and Weston Baxter. 2019. Understanding Affective Experiences with Conversational Agents. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–12. https://doi.org/10.1145/3290605.3300772Google ScholarDigital Library
- Jennifer Zamora. 2017. I’m sorry, dave, i’m afraid i can’t do that: Chatbot perception and expectations. In Proceedings of the 5th International Conference on Human Agent Interaction. 253–260.Google ScholarDigital Library
- Justine Zhang, Jonathan P Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Yiqing Hua, Nithum Thain, and Dario Taraborelli. 2018. Conversations gone awry: Detecting early signs of conversational failure. arXiv preprint arXiv:1805.05345(2018).Google Scholar
Index Terms
- Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant
Index terms have been assigned to the content through auto-classification.
Recommendations
Changes in verbal and nonverbal conversational behavior in long-term interaction
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionWe present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video ...
Natural Language, Mixed-initiative Personal Assistant Agents
IMCOM '18: Proceedings of the 12th International Conference on Ubiquitous Information Management and CommunicationThe increasing popularity and use of personal voice assistant technologies, such as Siri and Google Now, is driving and expanding progress toward the long-term and lofty goal of using artificial intelligence to build human-computer dialog systems ...
Multi-modal Language Models for Human-Robot Interaction
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot InteractionThe recent progress in language models is enabling more flexible and natural conversation abilities for social robots. However, these language models were never made to be used in a physically embodied social agent. They lack the ability to process the ...
Comments