Skip to main content

Advertisement

SpringerLink
Log in

Computational models of emotions for autonomous agents: major challenges

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

A great number of computational models of emotions (CMEs) have been developed to be included in, or as part of, cognitive agent architectures. These computational models have been designed to provide autonomous agents with appropriate mechanisms for the processing of emotional stimuli, the elicitation of synthetic emotions, and the generation of emotional responses. The research on CMEs has allowed for improvements in several application domains and contributed to progress in areas such as human-computer interaction and artificial intelligence. Nevertheless, despite the wide variety of CMEs proposed in the literature and their success in multiple areas, the complexity and quality of current and future human-centered applications require the development of more flexible and robust CMEs. In this sense, CMEs have yet to face a series of challenges in order to meet such types of requirements. In this paper, we explore key aspects of the development and applications of CMEs for autonomous agents, discuss four major challenges facing their development process, and present a novel approach to deal with these challenges.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Adams N, Field M, Gelenbe E, Hand D, Jennings N, Leslie D, Nicholson D, Ramchurn S, Rogers A (2008) Intelligent agents for disaster management. In: Proceedings of the IARP/EURON workshop on robotics for risky interventions and environmental surveillance (RISE)

  • Anderson JR, Lebiere C (1998) The atomic components of thought. Lawrence Erlbaum Associates, Mahwah, N. J.

  • Arellano D, Varona J, Perales FJ (2008) Generation and visualization of emotional states in virtual characters. Comput Animat Virtual Worlds 19(3–4):259–270

    Article  Google Scholar 

  • Armony JL, Servan-Schreiber D, Cohen JD, LeDoux JE (1997) Computational modeling of emotion: explorations through the anatomy and physiology of fear conditioning. Trends Cogn Sci 1(1):28–34

    Article  Google Scholar 

  • Balkenius C, Morén J, Johansson B, Johnsson M (2010) Ikaros: building cognitive models for robots. Adv Eng Inform 24:40–48

    Article  Google Scholar 

  • Becker-Asano C, Wachsmuth I (2010) Affective computing with primary and secondary emotions in a virtual human. Auton Agents Multi Agent Syst 20(1):32–49

    Article  Google Scholar 

  • Breazeal C (2003a) Emotion and sociable humanoid robots. Int J Hum Comput Stud 59(1–2):119–155

    Article  Google Scholar 

  • Breazeal C (2003b) Toward sociable robots. Robotics Auton Syst 42(3–4):167–175

    Article  MATH  Google Scholar 

  • Breazeal C, Scassellati B (2000) Infant-like social interactions between a robot and a human caregiver. Adapt Behav 8(1):49–74

    Article  Google Scholar 

  • Broekens J, DeGroot D (2004) Scalable and flexible appraisal models for virtual agents. In: Computer games: artificial intelligence, design and education, CGAIDE 2004. Reading, UK, pp 208–215

  • Bui T, Heylen D, Poel M, Nijholt A (2002) Parlee: an adaptive plan based event appraisal model of emotions. In: Jarke M, Lakemeyer G, Koehler J (eds) KI 2002: advances in artificial intelligence, Lecture Notes in Computer Science, vol 2479. Springer, Berlin, pp 129–143

  • Busemeyer JR, Johnson JG (2008) Computational models of decision making. Blackwell, Boston, pp 133–154

  • Byrne JH (ed) (2008) Concise learning and memory, 1st edn. Academic Press, Waltham

  • Dalgleish T (2004) The emotional brain. Nat Rev Neurosci 5:583–589

    Article  Google Scholar 

  • Dalgleish T, Dunn BD, Mobbs D (2009) Affective neuroscience: past, present, and future. Emot Rev 1(4):355–368

    Article  Google Scholar 

  • Damasio AR (1994) Descartes’ error: emotion, reason, and the human brain, 1st edn. Putnam Grosset Books, New York

    Google Scholar 

  • Dang THH, Letellier-Zarshenas S, Duhaut D (2008) Comparison of recent architectures of emotions. In: 10th international conference on control, automation, robotics and vision, 2008. ICARCV 2008, pp 1976–1981

  • Dang THH, Hutzler G, Hoppenot P (2011) Emotion modeling for intelligent agents—towards a unifying framework. In: Proceedings of the 2011 IEEE/WIC/ACM international conferences on Web intelligence and intelligent agent technology, vol 03. IEEE Computer Society, WI-IAT ’11, pp 70–73

  • Dias J, Mascarenhas S, Paiva A (2011) Fatima modular: towards an agent architecture with a generic appraisal framework. In: Workshop proceedings on standards in emotion modelling (SEM2011)

  • Ekman P (1999) Basic emotions. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Wiley, Boston, pp 45–60

  • El-Nasr MS, Ioerger TR, Yen J (1999) Peteei: a pet with evolving emotional intelligence. In: AGENTS ’99: proceedings of the third annual conference on autonomous agents. ACM, New York, NY, USA, pp 9–15. doi:10.1145/301136.301150

  • El-Nasr MS, Yen J, Ioerger TR (2000) Flame-fuzzy logic adaptive model of emotions. Auton Agents Multi Agent Syst 3(3):219–257

    Article  Google Scholar 

  • Fellous JM, Arbib MA (2005) Who needs emotions? The brain meets the robot. Oxford University Press, Oxford

  • Freese JL, Amaral DG (2009) Neuroanatomy of the primate amygdala. In: Whalen PJ, Phelps EA (eds) The human amygdala. The Guilford Press, New York City, pp 3–42

  • Frijda NH, Kuipers P, ter Schure E (1989) Relations among emotion, appraisal, and emotional action readiness. J Pers Soc Psychol 57(2):212–228

    Article  Google Scholar 

  • Fum D, Stocco A (2004) Memory, emotion, and rationality: an act-r interpretation for gambling task results. In: Proceedings of the sixth international conference on cognitive modeling, Pittsburgh, US, pp 106–111

  • Gebhard P (2005) Alma: a layered model of affect. AAMAS, pp 29–36

  • Gebhard P, Kipp KH (2006) Are computer-generated emotions and moods plausible to humans? In: Gratch J, Young M, Aylett R, Ballin D, Olivier P (eds) IVA, Lecture Notes in Computer Science, vol 4133. Springer, Berlin, pp 343–356

  • Gratch J, Marsella S (2005) Evaluating a computational model of emotion. Auton Agents Multi Agent Syst 11(1):23–43. doi:10.1007/s10458-005-1081-1

    Google Scholar 

  • Gray WD (ed) (2007) Integrated models of cognitive systems, 1st edn. Oxford University Press, Oxford

  • Hampson SE (1999) State of the art: personality. Psychol 12(6):284–288

    Google Scholar 

  • Hudlicka E (2002) This time with feeling: integrated model of trait and state effects on cognition and behavior. Appl Artif Intell Int J 16(7–8):611–641

    Article  Google Scholar 

  • Hudlicka E (2004) Beyond cognition: modeling emotion in cognitive architectures. In: Proceedings of the international conference on cognitive modeling (ICCM), CMU, Pittsburgh, PA

  • Hudlicka E (2005) A computational model of emotion and personality: applications to psychotherapy research and practice. In: Proceedings of the 10th annual cybertherapy conference: a decade of virtual reality

  • Hudlicka E (2011) Guidelines for designing computational models of emotions. Int J Synth Emot (IJSE) 2(1):26–79

    Article  Google Scholar 

  • John OP, Robins RW, Pervin LA (2008) Handbook of personality: theory and research. Guilford Press, New York

  • Kandel ER, Schwartz JH, Jessell TM (2000) Principles of neural science, 4th edn. McGraw-Hill, New York

    Google Scholar 

  • Kazemifard M, Ghasem-Aghaee N, Ören TI (2011) Design and implementation of gema: a generic emotional agent. Expert Syst Appl 38(3):2640–2652

    Article  Google Scholar 

  • Laird JE (2008) Extending the soar cognitive architecture. In: Proceeding of the 2008 conference on artificial general intelligence 2008. IOS Press, Amsterdam, pp 224–235

  • Laird JE, Newell A, Rosenbloom PS (1987) Soar: an architecture for general intelligence. Artif Intell 33(1)

  • Lane RD, Nadel L (eds) (2002) Cognitive neuroscience of emotion. Oxford University Press, Oxford

  • Lane RD, Nadel L, Allen JJB, Kaszniak AW (2000) The study of emotion from the perspective of cognitive neuroscience. In: Lane RD, Nadel L (eds) Cognitive neuroscience of emotion. Oxford University Press, New York

    Google Scholar 

  • Langley P, Laird JE, Rogers S (2009) Cognitive architectures: research issues and challenges. Cogn Syst Res 10(2):141–160. doi:10.1016/j.cogsys.2006.07.004

    Article  Google Scholar 

  • LeDoux JE (1993) The emotional brain: the mysterious underpinnings of emotional life. Simon and Schuster, New York

  • LeDoux JE (2000) Emotion circuits in the brain. Annu Rev 23:155–184

    Google Scholar 

  • LeDoux JE, Schiller D (2009) The human amygdala: insights from other animals. In: Whalen PJ, Phelps EA (eds) The human amygdala. The Guilford Press, New York, pp 43–60

  • Lewis M, Sullivan MW, Stanger C, Weiss M (1989) Self development and self-conscious emotions. Child Dev 60(1):146–156

    Article  Google Scholar 

  • Loewenstein G, Lerner JS (2003) The role of affect in decision making. In: Davidson RJ, Scherer K, Hill HH (eds) Handbook of affective sciences. Oxford University Press, New York, pp 619–642

    Google Scholar 

  • Marinier RP, Laird JE, Lewis RL (2009) A computational unification of cognitive behavior and emotion. Cogn Syst Res 10(1):48–69

    Article  Google Scholar 

  • Marsella S, Gratch J, Petta P (2010) Computational models of emotion. In: Scherer KR, Bänziger T, Roesch EB (eds) Blueprint for affective computing: a source book, 1st edn. Oxford University Press, Oxford

  • Marsella SC, Gratch J (2009) Ema: a process model of appraisal dynamics. Cogn Syst Res 10(1):70–90

    Article  Google Scholar 

  • Morén J, Balkenius C (2000) A computational model of emotional learning in the amygdala. In: From animals to animats 6: proceedings of the 6th international conference on the simulation of adaptive behaviour, MIT Press, Cambridge

  • Neto A, da Silva F (2012) A computer architecture for intelligent agents with personality and emotions. In: Zacarias M, de Oliveira JV (eds) Human-computer interaction: the agency perspective, studies in computational intelligence, vol 396. Springer, Berlin, pp 263–285

  • Newell A (1990) Unified theories of cognition. Harvard University Press, Cambridge

  • Ochs M, Niewiadomski R, Pelachaud C, Sadek D (2005) Intelligent expressions of emotions. In: Proceedings of the first international conference on affective computing and intelligent interaction, Springer, ACII’05, pp 707–714

  • Ochsner KN, Barrett LF (2001) A multiprocess perspective on the neuroscience of emotion. In: Mayne TJ, Bonanno GA (eds) Emotions: currrent issues and future directions. Guilford Press, New York, pp 38–81

    Google Scholar 

  • Ortony A (2003) On making believable emotional agents believable. In: Trappl R, Petta P, Payr S (eds) Emotions in humans and artifacts. MIT Press, Cambridge, pp 189–212

    Google Scholar 

  • Ortony A, Clore GL, Collins A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge

  • Panksepp J (1998) Affective neuroscience: the foundations of human and animal emotions. Oxford University Press, New York

    Google Scholar 

  • Phepls EA (2006) Emotion and cognition: insights from studies of the human amygdala. Annu Rev Psychol 57:27–53

    Article  Google Scholar 

  • Phillips RG, LeDoux JE (1992) Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning. Behav Neurosci 106(2):274–285

    Article  Google Scholar 

  • Picard RW (1997) Affective computing. MIT Press, Cambridge

    Google Scholar 

  • Price JL (2003) Comparative aspects of amygdala connectivity. Ann NY Acad Sci 985(1):50–58

    Article  Google Scholar 

  • Reithinger N, Gebhard P, Löckelt M, Ndiaye A, Pfleger N, Klesen M (2006) Virtualhuman: dialogic and affective interaction with virtual characters. In: ICMI ’06: proceedings of the 8th international conference on multimodal interfaces, New York, NY, USA, pp 51–58

  • Rodríguez LF, Ramos F, García G (2011) An integrative computational model of emotions. In: D’Mello S, Graesser A (eds) Proceedings of the 4th international conference on affective computing and intelligent interaction (ACII 2011), vol 2. Springer, Memphis, US, pp 72–79

  • Roseman IJ, Spindel MS, Jose PE (1990) Appraisals of emotion-eliciting events: testing a theory of discrete emotions. J Pers Soc Psychol 59(5):899–915

    Article  Google Scholar 

  • Russell JA (2003) Core affect and the psychological construction of emotion. Psychol Rev 110(1):145–172

    Article  Google Scholar 

  • Russell SJ, Norvig P (2003) Artificial intelligence: a modern approach. Pearson Education

  • Rusting CL (1998) Personality, mood, and cognitive processing of emotional information: three conceptual frameworks. Psychol Bull 124(2):165–196

    Article  Google Scholar 

  • Scherer KR (2000) Psychological models of emotion. In: Borod J (ed) The neuropsychology of emotion. Oxford University Press, New York, pp 137–166

    Google Scholar 

  • Scherer KR (2001) Appraisal considered as a process of multi-level sequential checking. In: Scherer KR, Schorr A, Johnstone T (eds) Appraisal processes in emotion: theory, methods, research. Oxford University Press, New York, pp 92–120

    Google Scholar 

  • Scherer KR (2010a) The component process model: architecture for a comprehensive computational model of emergent emotion. In: Scherer KR, Bänziger T, Roesch EB (eds) Blueprint for affective computing: a source book, 1st edn, Oxford University Press, Oxford

  • Scherer KR (2010b) Emotion and emotional competence: conceptual and theoretical issues for modelling agents. In: Scherer KR, Bänziger T, Roesch EB (eds) Blueprint for affective computing: a source book, Oxford University Press, Oxford

  • Scheutz M (2004) Useful roles of emotions in artificial agents: a case study from artificial life. In: AAAI’04: proceedings of the 19th national conference on artifical intelligence, AAAI Press, New York, pp 42–47

  • Scheutz M, Schermerhorn P (2009) Affective goal and task selection for social robots. In: Vallverdú J, Casacuberta D (eds) The handbook of research on synthetic emotions and sociable robotics, pp 74–87

  • Shepherd GM (2009) Creating modern neuroscience: the revolutionary 1950s. Oxford University Press, Oxford

  • Sollenberger D, Singh M (2010) Koko: an architecture for affect-aware games. Autonomous Agents and Multi-Agent Systems, pp 1–32

  • Sun R (2006a) The clarion cognitive architecture: extending cognitive modeling to social simulation. In: Sun R (ed) Cognition and multi-agent interaction: from cognitive modeling to social simulation. Cambridge University Press, New York

    Google Scholar 

  • Sun R (ed) (2006b) Cognition and multi-agent interaction: from cognitive modeling to social simulation. Cambridge University Press, Cambridge

  • Swartout W, Gratch J, Hill RW, Hovy E, Marsella S, Rickel J, Traum D (2006) Toward virtual humans. AI Mag 27(2):96–108

    Google Scholar 

  • Tanji J, Hoshi E (2001) Behavioral planning in the prefrontal cortex. Elsevier Science Ltd, Amsterdam, pp 11:164–170

  • Tao J, Tan T (2005) Affective computing: a review. In: Tao J, Tan T, Picard R (eds) Proceedings of the international conference on affective computing and intelligent interaction (ACII 2005). Springer, Berlin/Heidelberg, Beijing, China, pp 981–995

    Chapter  Google Scholar 

  • Velásquez JD (1997) Modeling emotions and other motivations in synthetic agents. In: Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on innovative applications of artificial intelligence, AAAI Press, Providence, Rhode Island, pp 10–15

  • Velásquez JD (1998) Modeling emotion-based decision-making. In: Proceedings of the 1998 AAAI fall symposium emotional and intelligent, pp 164–169

  • Wang Y, Wang Y, Patel S, Patel D (2006) A layered reference model of the brain (lrmb). IEEE Trans Syst Man Cybern Part C Appl Rev 36(2):124–133

    Article  Google Scholar 

  • Zald DH (2003) The human amygdala and the emotional evaluation of sensory stimuli. Brain Res Rev 41(1):88–123

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Cinvestav-IPN, Unidad Guadalajara, México, Av. del Bosque 1145, Col. el Bajío, 45019 , Zapopan, Jalisco, México

    Luis-Felipe Rodríguez & Félix Ramos

Authors
  1. Luis-Felipe Rodríguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Félix Ramos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luis-Felipe Rodríguez.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rodríguez, LF., Ramos, F. Computational models of emotions for autonomous agents: major challenges. Artif Intell Rev 43, 437–465 (2015). https://doi.org/10.1007/s10462-012-9380-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-012-9380-9

Keywords

Search

Navigation