Susanne Schmidt
Frank Steinicke
ABSTRACT
Research on intelligent virtual agents (IVAs) often concerns the implementation of human-like behavior by integrating artificial intelligence algorithms. Thus far, few studies focused on mimicry of cognitive imperfections inherent to humans in IVAs. Neglecting to implement such imperfect behavior in IVAs might result in less believable or engaging human-agent interactions. In this paper, we simulate human imprecision in conversational IVAs’ temporal statements. We conducted a survey to identify temporal statement patterns, transferred them to a conversational IVA, and conducted a user study evaluating the effects of time precision on perceived anthropomorphism and usefulness. Statistical analyses reveal significant interaction between time precision and agents’ use of memory aids, indicating that (i) imprecise agents are perceived as more human-like than precise agents when responding immediately, and (ii) unnaturally high levels of temporal precision can be compensated for by memory aid use. Further findings underscore the value of continued inquiry into cultural variations.
Supplemental Material
Available for Download
- David Ahn, Sisay Fissaha Adafre, and Maarten de Rijke. 2005. Extracting Temporal Information from Open Domain Text: A Comparative Exploration. Journal of Digital Information Management 3, 1 (2005), 14–20.Google Scholar
- Jan Allbeck and Norman I Badler. 2001. Consistent Communication with Control. In Proceedings of the Workshop on Non-Verbal and Verbal Communicative Acts to Achieve Contextual Embodied Agents at the Conference on Autonomous Agents (AGENTS). ACM, New York, NY, US, 1–6.Google Scholar
- Andreas Armborst. 2017. Thematic Proximity in Content Analysis. Sage Open 7, 2 (2017), 1–11.Google ScholarCross Ref
- Christoph Bartneck, Dana Kulić, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots. International Journal of Social Robotics 1, 1 (2009), 71–81.Google ScholarCross Ref
- Timothy Bickmore, Daniel Schulman, and Langxuan Yin. 2009. Engagement vs. Deceit: Virtual Humans with Human Autobiographies. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA). Springer, Berlin, Heidelberg, Germany, 6–19.Google ScholarDigital Library
- Richard A Block. 2003. Psychological Timing Without a Timer: The Roles of Attention and Memory. In Time and Mind II: Information Processing Perspectives. Hogrefe & Huber Publishers, Göttingen, Germany, 41–59.Google Scholar
- Susan E Brennan and Maurice Williams. 1995. The Feeling of Another’s Knowing: Prosody and Filled Pauses as Cues to Listeners About the Metacognitive States of Speakers. Journal of Memory and Language 34, 3 (1995), 383–398.Google ScholarCross Ref
- Stephen Buetow and Katharine Wallis. 2019. The Beauty in Perfect Imperfection. Journal of Medical Humanities 40, 3 (2019), 389–394.Google ScholarCross Ref
- Ondřej Burkert, Cyril Brom, Rudolf Kadlec, and Jiří Lukavskỳ. 2010. Timing in Episodic Memory: Virtual Characters in Action. In Remembering Who We Are – Human Memory for Artificial Agents Symposium. De Montfort University, Leicester, UK, 1–8.Google Scholar
- James Carifio and Rocco Perla. 2008. Resolving the 50-Year Debate Around Using and Misusing Likert Scales. Medical Education 42, 12 (2008), 1150–1152.Google ScholarCross Ref
- W Crawford. 2008. Place and Time Adverbials in Native and Non-Native English Student Writing. In Corpora and Discourse: The Challenges of Different Settings. John Benjamins Publishing Company, Amsterdam, Netherlands, 267–289.Google Scholar
- David Crystal. 1966. Specification and English Tenses. Journal of Linguistics 2, 1 (1966), 1–34.Google ScholarCross Ref
- DeepL. 2021. DeepL Translate: The World’s Most Accurate Translator. https://www.deepl.com/en/translator. Accessed: 2021-12-29.Google Scholar
- Virginie Demeure, Radosław Niewiadomski, and Catherine Pelachaud. 2011. HHow Is Believability of a Virtual Agent Related to Warmth, Competence, Personification, and Embodiment?Presence 20, 5 (2011), 431–448.Google Scholar
- Joao Dias, Wan Ching Ho, Thurid Vogt, Nathalie Beeckman, Ana Paiva, and Elisabeth André. 2007. I Know What I Did Last Summer: Autobiographic Memory in Synthetic Characters. In Proceedings of the International Conference on Affective Computing and Intelligent Interaction (ACII). Springer, Berlin, Heidelberg, Germany, 606–617.Google ScholarDigital Library
- Alexander Eiselmayer, Chat Wacharamanotham, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2019. Touchstone2: An Interactive Environment for Exploring Trade-Offs in HCI Experiment Design. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). ACM, New York, NY, US, 1–11.Google ScholarDigital Library
- Eisko. 2018. Animatable Digital Double of Louise by Eisko©. www.eisko.comGoogle Scholar
- Thomas Erickson, Catalina M. Danis, Wendy A. Kellogg, and Mary E. Helander. 2008. Assistance: The Work Practices of Human Administrative Assistants and Their Implications for IT and Organizations. In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW). ACM, New York, NY, US, 609–618.Google ScholarDigital Library
- Lisa Ferro. 2001. TIDES Instruction Manual for the Annotation of Temporal Expressions. Technical Report. The MITRE Corporation.Google Scholar
- W. Friedman. 2005. Developmental and Cognitive Perspectives on Humans’ Sense of the Times of Past and Future Events. Learning and Motivation 36 (2005), 145–158.Google ScholarCross Ref
- William J Friedman. 2004. Time in Autobiographical Memory. Social Cognition 22, 5: Special issue (2004), 591–605.Google Scholar
- Wael H Gomaa and Aly A Fahmy. 2013. A Survey of Text Similarity Approaches. international Journal of Computer Applications 68, 13(2013), 13–18.Google Scholar
- P Gomes, Ana Paiva, and Carlos Martinho. 2010. Episodic Memory Retrieval Through Re-appraisal of Past Events. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA) - Supplementary Materials. Springer, Philadelphia, US, 26–27.Google Scholar
- Paulo F Gomes, Carlos Martinho, and Ana Paiva. 2011. I’ve Been Here Before! Location and Appraisal in Memory Retrieval. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS) - Volume 3. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, US, 1039–1046.Google Scholar
- Google. 2021. Dialogflow | Google Cloud. cloud.google.com/dialogflow/Google Scholar
- Google. 2021. Google Translate. https://translate.google.com/. Accessed: 2021-12-29.Google Scholar
- Google. 2021. Speech-to-Text: Automatic Speech Recognition | Google Cloud. cloud.google.com/speech-to-text/Google Scholar
- Google. 2021. Text-to-Speech: Lifelike Speech Synthesis | Google Cloud. cloud.google.com/text-to-speech/Google Scholar
- Robert J Graham. 1981. The Role of Perception of Time in Consumer Research. Journal of Consumer Research 7, 4 (1981), 335–342.Google ScholarCross Ref
- David Graus, Paul N Bennett, Ryen W White, and Eric Horvitz. 2016. Analyzing and Predicting Task Reminders. In Proceedings of the Conference on User Modeling Adaptation and Personalization (UMAP). ACM, New York, NY, US, 7–15.Google ScholarDigital Library
- Simon Grondin. 2010. Timing and Time Perception: A Review of Recent Behavioral and Neuroscience Findings and Theoretical Directions. Attention, Perception, & Psychophysics 72, 3 (2010), 561–582.Google ScholarCross Ref
- Charles Hampden-Turner, Fons Trompenaars, and Charles Hampden-Turner. 2020. Riding the Waves of Culture: Understanding Diversity in Global Business. Nicholas Brealey Publishing, Boston, MA, US.Google Scholar
- Martin Haspelmath. 1997. From Space to Time. Lincom Europa, München, Germany, Newcastle, UK.Google Scholar
- Wan Ching Ho and Kerstin Dautenhahn. 2008. Towards a Narrative Mind: The Creation of Coherent Life Stories for Believable Virtual Agents. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA). Springer, Berlin, Heidelberg, Germany, 59–72.Google ScholarDigital Library
- Margaret J Intons-Peterson and JoAnne Fournier. 1986. External and Internal Memory Aids: When and How Often Do We Use Them?Journal of Experimental Psychology: General 115, 3 (1986), 267.Google Scholar
- Margaret Jean Intons-Peterson and George L Newsome. 1992. External Memory Aids: Effects and Effectiveness. In Memory Improvement. Springer, New York, NY, US, 101–121.Google Scholar
- Steve MJ Janssen, Antonio G Chessa, and Jaap MJ Murre. 2006. Memory for Time: How People Date Events. Memory & Cognition 34, 1 (2006), 138–147.Google ScholarCross Ref
- Ryota Kanai, Mia Yuan Dong, Bahador Bahrami, and Geraint Rees. 2011. Distractibility in Daily Life Is Reflected in the Structure and Function of Human Parietal Cortex. Journal of Neuroscience 31, 18 (2011), 6620–6626.Google ScholarCross Ref
- Zerrin Kasap, Maher Ben Moussa, Parag Chaudhuri, and Nadia Magnenat-Thalmann. 2009. Making Them Remember—Emotional Virtual Characters With Memory. Computer Graphics and Applications 29, 2 (2009), 20–29.Google ScholarDigital Library
- Charlyn M Laserna, Yi-Tai Seih, and James W Pennebaker. 2014. Um... Who Like Says You Know: Filler Word Use as a Function of Age, Gender, and Personality. Journal of Language and Social Psychology 33, 3 (2014), 328–338.Google ScholarCross Ref
- Douglas B Lenat. 2009. Building a Machine Smart Enough to Pass the Turing Test. In Parsing the Turing Test. Springer, Dordrecht, Netherlands, 261–282.Google Scholar
- Willem JM Levelt, Graham Richardson, and Wido La Heij. 1985. Pointing and Voicing in Deictic Expressions. Journal of Memory and Language 24, 2 (1985), 133–164.Google ScholarCross Ref
- Robert V Levine and Ara Norenzayan. 1999. The Pace of Life in 31 Countries. Journal of Cross-Cultural Psychology 30, 2 (1999), 178–205.Google ScholarCross Ref
- Microsoft. 2021. Windows Virtual Desktop | Remote Desktop | Microsoft Azure. azure.microsoft.com/en-us/services/virtual-desktop/Google Scholar
- George A Miller. 1995. WordNet: A Lexical Database for English. Commun. ACM 38, 11 (1995), 39–41.Google ScholarDigital Library
- Miro. 2021. The Visual Collaboration Platform for Every Team: Miro. https://miro.com/. Accessed: 2021-12-29.Google Scholar
- Geoff Norman. 2010. Likert Scales, Levels of Measurement and the “Laws” of Statistics. Advances in Health Sciences Education 15, 5 (2010), 625–632.Google ScholarCross Ref
- Nahal Norouzi, Gerd Bruder, Brandon Belna, Stefanie Mutter, Damla Turgut, and Greg Welch. 2019. A Systematic Review of the Convergence of Augmented Reality, Intelligent Virtual Agents, and the Internet of Things. In Artificial Intelligence in IoT. Springer, Cham, 1–24.Google Scholar
- Nahal Norouzi, Kangsoo Kim, Jason Hochreiter, Myungho Lee, Salam Daher, Gerd Bruder, and Greg Welch. 2018. A Systematic Survey of 15 Years of User Studies Published in the Intelligent Virtual Agents Conference. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA). ACM, New York, NY, US, 17–22.Google ScholarDigital Library
- Rafael E Núñez, Benjamin A Motz, and Ursina Teuscher. 2006. Time After Time: The Psychological Reality of the Ego-and Time-Reference-Point Distinction in Metaphorical Construals of Time. Metaphor and Symbol 21, 3 (2006), 133–146.Google ScholarCross Ref
- Asher R Pacht. 1984. Reflections on Perfection. American Psychologist 39, 4 (1984), 386.Google ScholarCross Ref
- Deborah Richards and Karla Bransky. 2014. Forgetmenot: What and How Users Expect Intelligent Virtual Agents to Recall and Forget Personal Conversational Content. International Journal of Human-Computer Studies 72, 5 (2014), 460–476.Google ScholarCross Ref
- José I Rojas-Méndez, Gary Davies, Omer Omer, Paitoon Chetthamrongchai, and Canan Madran. 2002. A Time Attitude Scale for Cross Cultural Research. Journal of Global Marketing 15, 3-4 (2002), 117–147.Google ScholarCross Ref
- Xin Rong, Adam Fourney, Robin N Brewer, Meredith Ringel Morris, and Paul N Bennett. 2017. Managing Uncertainty in Time Expressions for Virtual Assistants. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). ACM, New York, NY, US, 568–579.Google ScholarDigital Library
- Roser Saurı, Jessica Littman, Bob Knippen, Robert Gaizauskas, Andrea Setzer, and James Pustejovsky. 2006. TimeML Annotation Guidelines Version 1.2.1.Google Scholar
- Susanne Schmidt, Oscar Ariza, and Frank Steinicke. 2020. Intelligent Blended Agents: Reality–Virtuality Interaction with Artificially Intelligent Embodied Virtual Humans. Multimodal Technologies and Interaction 4, 4 (2020), 85.Google ScholarCross Ref
- Susanne Schmidt, Gerd Bruder, and Frank Steinicke. 2018. Effects of Embodiment on Generic and Content-Specific Intelligent Virtual Agents as Exhibition Guides. In Proceedings of the International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE). Eurographics Association, Geneve, Switzerland, 13–20.Google Scholar
- Susanne Schmidt, Oscar Javier Ariza Nunez, and Frank Steinicke. 2019. Blended Agents: Manipulation of Physical Objects within Mixed Reality Environments and Beyond. In Proceedings of the Symposium on Spatial User Interaction (SUI). ACM, New York, NY, US, 1–10.Google ScholarDigital Library
- Anna Sircova, Fons JR Van De Vijver, Evgeny Osin, Taciano L Milfont, Nicolas Fieulaine, Altinay Kislali-Erginbilgic, Philip G Zimbardo, 2015. Time Perspective Profiles of Cultures. In Time Perspective Theory; Review, Research and Application. Springer, Cham, Switzerland, 169–187.Google Scholar
- Carlota S Smith. 1978. The Syntax and Interpretation of Temporal Expressions in English. Linguistics and Philosophy 2, 1 (1978), 43–99.Google ScholarCross Ref
- SurveyCircle. 2021. The Largest Community for Online Research. www.surveycircle.com/Google Scholar
- Charles P Thompson. 1982. Memory for Unique Personal Events: The Roommate Study. Memory & Cognition 10, 4 (1982), 324–332.Google ScholarCross Ref
- Charles P Thompson, John J Skowronski, and D John Lee. 1988. Telescoping in Dating Naturally Occurring Events. Memory & Cognition 16, 5 (1988), 461–468.Google ScholarCross Ref
- Catherine Tinsley. 1998. Models of Conflict Resolution in Japanese, German, and American Cultures. Journal of Applied Psychology 83, 2 (1998), 316.Google ScholarCross Ref
- Hegler Tissot, Marcos Didonet Del Fabro, Leon Derczynski, and Angus Roberts. 2019. Normalisation of Imprecise Temporal Expressions Extracted From Text. Knowledge and Information Systems 61, 3 (2019), 1361–1394.Google ScholarDigital Library
- Jean-Claude G Usunier. 1991. Business Time Perceptions and National Cultures: A Comparative Survey. MIR: Management International Review 31, 3 (1991), 197–217.Google Scholar
- Bart Van Den Hooff. 2004. Electronic Coordination and Collective Action: Use and Effects of Electronic Calendaring and Scheduling. Information & Management 42, 1 (2004), 103–114.Google ScholarDigital Library
- Isaac Wang, Jesse Smith, and Jaime Ruiz. 2019. Exploring Virtual Agents for Augmented Reality. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). ACM, New York, NY, US, 1–12.Google ScholarDigital Library
- Dan Zakay and Richard A Block. 2004. Prospective and Retrospective Duration Judgments: An Executive-Control Perspective. Acta Neurobiologiae Experimentalis 64, 3 (2004), 319–328.Google ScholarCross Ref
- Gal Zauberman, B Kyu Kim, Selin A Malkoc, and James R Bettman. 2009. Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences. Journal of Marketing Research 46, 4 (2009), 543–556.Google ScholarCross Ref
- Qing Zhou and Richard Fikes. 2002. A Reusable Time Ontology. In Proceeding of the AAAI Workshop on Ontologies for the Semantic Web. The AAAI Press, Menlo Park, CA, US, 35–40.Google Scholar
- XiaoJia Zhou, HaoMin Li, XuDong Lu, and HuiLong Duan. 2011. Temporal Expression Recognition and Temporal Relationship Extraction from Chinese Narrative Medical Records. In Proceedings of the International Conference on Bioinformatics and Biomedical Engineering (ICBBE). IEEE, New York, NY, US, 1–4.Google ScholarCross Ref
Index Terms
- Simulating Human Imprecision in Temporal Statements of Intelligent Virtual Agents
Recommendations
Governing intelligent virtual agent behaviour with norms
AAMAS '13: Proceedings of the 2013 international conference on Autonomous agents and multi-agent systemsOne requirement by which virtual environments (VEs) are judged, is the believability of the virtual agents (VAs). One aspect of believability, is that agent responses to situations should not create cognitive dissonance and thereby distract the ...
Expectation and complex event handling in BDI-based intelligent virtual agents (demonstration)
AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 3When operating in virtual communities, intelligent agents should maintain a high-level awareness of the physical and social environment around them in order to be more believable and capable. However, due to the inherent differences between virtual ...
How do you like intelligent virtual agents
CompSysTech '10: Proceedings of the 11th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing on International Conference on Computer Systems and TechnologiesBesides in games and entertainment Intelligent Virtual Agents (IVA-s) find application in deriving information, obtaining knowledge, and investigating behavior. This paper reports results concerning the ways of perceiving IVA-s by users, as well as ...
Comments