Skip to main content
SpringerLink
Log in
Book cover

Emotional Engineering Volume 4 pp 165–187Cite as

Making Emotion and Decision via Affecting Self-Perception

  • Chapter
  • First Online:

Abstract

We propose a model for generating high-level cognitions, especially emotions and decisions. The development of virtual reality (VR) technologies has made it possible to re-create multi-sensory experiences with high accuracy and resolution. Many studies have tried to reproduce not only the environment but also the psychological experience, such as emotion and decision with VR technology. However, VR has not yet been realized to generate the absolute subjective experience because the influence of the environment on the human mind in the human information process has barely been discussed. On the other hand, in psychology or cognitive science, many studies have shown that the psychological state and self-body image interact mutually. The “body image,” which is the representation of one’s body recognized in the brain, is formed based on the perception of self-body (self-perception) through multi-sensory integration received from the environment and one’s body. Given this, appropriately providing artificial sensory stimuli seems capable of generating emotions and decisions in light of the influence of the environment on self-perception. Based on these findings, we propose a methodology “self-perception-based VR” for making emotions and decisions by affecting self-perception. The current paper discusses and offers a guide for “self-perception based VR.”

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Anderson T (1998) Circumplex Models of Personality and Emotion. R. Plutchik & H. R. Conte (Eds). (1997). Washington, DC: American Psychological Association. Psychotherapy Research 8:359–360. doi:10.1080/10503309812331332457

    Google Scholar 

  2. Andersson U (2001) The Tear Machine. http://www.weststarland.com/wp/2011/04/tear-m achine-tearful-reflection/. Accessed 12 Jun 2013

  3. Ando H, Watanabe J, Sato M (2012) Empathetic heartbeat. Proceedings of the 20th ACM international conference on Multimedia - MM ‘12. doi:10.1145/2393347.2396530

  4. Armel K, Ramachandran V (2003) Projecting sensations to external objects: evidence from skin conductance response. Proceedings of the Royal Society B: Biological Sciences 270:1499–1506. doi:10.1098/rspb.2003.2364

    Google Scholar 

  5. Attwood A, Scott-Samuel N, Stothart G, Munafò M (2012) Glass Shape Influences Consumption Rate for Alcoholic Beverages. PLoS ONE 7:e43007. doi:10.1371/journal.pone.0043007

    Google Scholar 

  6. Ban Y, Sakurai S, Narumi T, Tanikawa T, Hirose M (2015) Improving work productivity by controlling the time rate displayed by the virtual clock. Proceedings of the 6th Augmented Human International Conference on - AH ‘15. doi:10.1145/2735711.2735791

  7. Bem D (1967) SELF-PERCEPTION: AN ALTERNATIVE INTERPRETATION OF COGNITIVE DISSONANCE PHENOMENA. Psychological Review 74:183–200. doi:10.1037/h0024835

    Google Scholar 

  8. Berkowitz L (1969) Advances in experimental social psychology. Academic Press, New York

    Google Scholar 

  9. Botvinick M, Cohen J (1998) Rubber hands ‘feel’ touch that eyes see. Nature 391:756–756. doi:10.1038/35784.

    Google Scholar 

  10. Butzlaff R, Hooley J (1998) Expressed Emotion and Psychiatric Relapse. Arch Gen Psychiatry 55:547. doi:10.1001/archpsyc.55.6.547

    Google Scholar 

  11. Card S, Moran T, Newell A (1983) The psychology of human-computer interaction. L. Erlbaum Associates, Hillsdale, N.J.

    Google Scholar 

  12. Carlson N (1977) Physiology of behavior. Allyn and Bacon, Boston

    Google Scholar 

  13. Dalgleish T, Power M (1999) Handbook of cognition and emotion. Wiley, Chichester, England

    Google Scholar 

  14. Davidson A, Bar-Yam Y (2006) Environmental Complexity: Information For Human-Environment Well-Being. Unifying Themes in Complex Systems 157–168. doi:10.1007/978-3-540-35866-4_16

  15. De Castro J (1994) Family and friends produce greater social facilitation of food intake than other companions. Physiology & Behavior 56:445–455. doi:10.1016/0031-9384(94)90286-0

    Google Scholar 

  16. Dimberg U, Söderkvist S (2010) The Voluntary Facial Action Technique: A Method to Test the Facial Feedback Hypothesis. J Nonverbal Behav 35:17–33. doi:10.1007/s10919-010-0098-6

    Google Scholar 

  17. Driver J, Spence C (2000) Multisensory perception: Beyond modularity and convergence. Current Biology 10:R731–R735. doi:10.1016/s0960-9822(00)00740-5

    Google Scholar 

  18. Dutton D, Aron A (1974) Some evidence for heightened sexual attraction under conditions of high anxiety. Journal of Personality and Social Psychology 30:510–517. doi:10.1037/h0037031

    Google Scholar 

  19. Ekman P, Friesen W (1969) The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. Semiotica. doi:10.1515/semi.1969.1.1.49

  20. Ekman P, Levenson R, Friesen W (1983) Autonomic nervous system activity distinguishes among emotions. Science 221:1208–1210. doi:10.1126/science.6612338

    Google Scholar 

  21. Elam M, Wallin B (1987) Skin blood flow responses to mental stress in man depend on body temperature. Acta Physiologica Scandinavica 129:429–431. doi:10.1111/j.1365-201x.1987.tb10609.x

    Google Scholar 

  22. Festinger L (1962) Cognitive Dissonance. Sci Am 207:93–106. doi:10.1038/scientificamerican1062-93

    Google Scholar 

  23. Fukushima S, Kajimoto H (2012) Chilly chair. ACM SIGGRAPH 2012 Emerging Technologies on - SIGGRAPH ‘12. doi:10.1145/2343456.2343461

  24. Gallagher S (2000) Philosophical conceptions of the self: implications for cognitive science. Trends in Cognitive Sciences 4:14–21. doi:10.1016/s1364-6613(99)01417-5

    Google Scholar 

  25. Gibson J (1979) The ecological approach to visual perception. Houghton Mifflin, Boston

    Google Scholar 

  26. Hatfield E, Bensman L, Thornton P, Rapson R (2014) New Perspectives on Emotional Contagion: A Review of Classic and Recent Research on Facial Mimicry and Contagion. Interpersona 8:159–179. doi:10.5964/ijpr.v8i2.162

    Google Scholar 

  27. Hatfield E, Hsee C (1995) The Impact of Vocal Feedback on Emotional Experience and Expression. Journal of Social Behavior and Personality 10:293–313.

    Google Scholar 

  28. Hilbert M (2012) Toward a synthesis of cognitive biases: How noisy information processing can bias human decision making. Psychological Bulletin 138:211–237. doi:10.1037/a0025940

    Google Scholar 

  29. Holmes E, Brown R, Mansell W, Fearon R, Hunter E, Frasquilho F, Oakley D (2005) Are there two qualitatively distinct forms of dissociation? A review and some clinical implications. Clinical Psychology Review 25:1–23. doi:10.1016/j.cpr.2004.08.006

    Google Scholar 

  30. Hökfelt T, Johansson O, Ljungdahl Å, Lundberg J, Schultzberg M (1980) Peptidergic neurones. Nature 284:515–521. doi:10.1038/284515a0

    Google Scholar 

  31. James W (2011) The Principles of Psychology (Volume 2 of 2). Digireads. com Publishing

    Google Scholar 

  32. Jeannerod M (2003) The mechanism of self-recognition in humans. Behavioural Brain Research 142:1–15. doi:10.1016/s0166-4328(02)00384-4

    Google Scholar 

  33. Kleinke C, Peterson T, Rutledge T (1998) Effects of self-generated facial expressions on mood. Journal of Personality and Social Psychology 74:272–279. doi:10.1037//0022-3514.74.1.272

    Google Scholar 

  34. Levenson R, Ekman P, Friesen W (1990) Voluntary Facial Action Generates Emotion-Specific Autonomic Nervous System Activity. Psychophysiology 27:363–384. doi:10.1111/j.1469-8986.1990.tb02330.x

    Google Scholar 

  35. Marshall J, Schnieden H (1966) Effect of adrenaline, noradrenaline, atropine, and nicotine on some types of human tremor. Journal of Neurology, Neurosurgery & Psychiatry 29:214–218. doi:10.1136/jnnp.29.3.214

    Google Scholar 

  36. Naqvi N, Shiv B, Bechara A (2006) The Role of Emotion in Decision Making: A Cognitive Neuroscience Perspective. Current Directions in Psychological Science 15:260–264. doi:10.1111/j.1467-8721.2006.00448.x

    Google Scholar 

  37. Nakazato N, Yoshida S, Sakurai S, Narumi T, Tanikawa T, Hirose M (2014) Smart Face. Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW ‘14. doi:10.1145/2531602.2531637

  38. Narumi T, Ban Y, Kajinami T, Tanikawa T, Hirose M (2012) Augmented perception of satiety. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI ‘12. doi:10.1145/2207676.2207693

  39. Nishimura N, Ishi A, Sato M, Fukushima S, Kajimoto H (2012) Facilitation of affection by tactile feedback of false heratbeat. Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA ‘12. doi:10.1145/2212776.2223796

  40. Nummenmaa L, Glerean E, Hari R, Hietanen J (2013) Bodily maps of emotions. Proceedings of the National Academy of Sciences 111:646–651. doi:10.1073/pnas.1321664111

    Google Scholar 

  41. Ramachandran V, Blakeslee S (1998) Phantoms in the brain. William Morrow, New York

    Google Scholar 

  42. Rolls B, Engell D, Birch L (2000) Serving Portion Size Influences 5-Year-Old but Not 3-Year-Old Children’s Food Intakes. Journal of the American Dietetic Association 100:232–234. doi:10.1016/s0002-8223(00)00070-5

    Google Scholar 

  43. Rolls B, Morris E, Roe L (2002) Portion size of food affects energy intake in normal- weight and overweight men and women. American Journal of Clinical Nutrition 76:1207–1213.

    Google Scholar 

  44. Russell J (1980) A circumplex model of affect. Journal of Personality and Social Psychology 39:1161–1178. doi:10.1037/h0077714

    Google Scholar 

  45. Sakurai S, Ban Y, Katsumura T, Narumi T, Tanikawa T, Hirose M (2014) Communious mouse. SIGGRAPH Asia 2014 Emerging Technologies on - SA ‘14. doi:10.1145/2669047.2669057

  46. Sakurai S, Katsumura T, Narumi T, Tanikawa T, Hirose M (2012) Interactonia Balloon. SIGGRAPH Asia 2012 Emerging Technologies on - SA ‘12. doi:10.1145/2407707.2407722

  47. Sakurai S, Katsumura T, Narumi T, Tanikawa T, Hirose M (2013) Comix: beyond. SIGGRAPH Asia 2013 Emerging Technologies on - SA ‘13. doi:10.1145/2542284.2542287

  48. Sakurai S, Katsumura T, Narumi T, Tanikawa T, Hirose M (2014) Evoking Emotions in a Story Using Tactile Sensations as Pseudo-body Responses with Contextual Cues. Lecture Notes in Computer Science 241–250. doi:10.1007/978-3-319-07731-4_25

    Google Scholar 

  49. Sakurai S, Narumi T, Ban Y, Tanikawa T, Hirose M (2013) Affecting Our Perception of Satiety by Changing the Size of Virtual Dishes Displayed with a Tabletop Display. Virtual, Augmented and Mixed Reality Systems and Applications 90–99. doi:10.1007/978-3-642-39420-1_11

    Google Scholar 

  50. Sakurai S, Narumi T, Katsumura T, Tanikawa T, Hirose M (2015) Basic Study of Evoking Emotion Through Extending One’s Body Image by Integration of Internal Sense and External Sense. Human Interface and the Management of Information Information and Knowledge Design 433–444. doi:10.1007/978-3-319-20612-7_42

    Google Scholar 

  51. Sakurai S, Narumi T, Tanikawa T, Hirose M (2015) A Proposal of a Game Controller for Evoking Emotion by Creating an Illusion of Perception of One’ s Bodily Response around Hand. In: ASIAGRAPH2015. pp 15–19

    Google Scholar 

  52. Sasaki K, Yamada Y, Miura K (2015) Post-determined emotion: motor action retrospectively modulates emotional valence of visual images. Proceedings of the Royal Society B: Biological Sciences 282:20140690-20140690. doi:10.1098/rspb.2014.0690

    Google Scholar 

  53. Schachter S, Singer J (1962) Cognitive, social, and physiological determinants of emotional state. Psychological Review 69:379–399. doi:10.1037/h0046234

    Google Scholar 

  54. Schwoebel J, Coslett HB (2005) Evidence for Multiple, Distinct Representations of the Human Body. Journal of Cognitive Neuroscience 17:543–553. doi:10.1162/0898929053467587

    Google Scholar 

  55. Shimojo S (2001) Sensory modalities are not separate modalities: plasticity and interactions. Current Opinion in Neurobiology 11:505–509. doi:10.1016/s0959-4388(00)00241-5

    Google Scholar 

  56. Shimojo S, Simion C, Shimojo E, Scheier C (2003) Gaze bias both reflects and influences preference. Nature Neuroscience 6:1317–1322. doi:10.1038/nn1150

    Google Scholar 

  57. Simion C, Shimojo S (2007) Interrupting the cascade: Orienting contributes to decision making even in the absence of visual stimulation. Perception & Psychophysics 69:591–595. doi:10.3758/bf03193916

    Google Scholar 

  58. Strack F, Martin L, Stepper S (1988) Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology 54:768–777. doi:10.1037//0022-3514.54.5.768

    Google Scholar 

  59. Suzuki E, Narumi T, Sakurai S, Tanikawa T, Hirose M (2014) Illusion cup. Proceedings of the 5th Augmented Human International Conference on - AH ’14. doi: 10.1145/2582051.2582092

  60. Tomkins S, Karon B (1962) Affect, imagery, consciousness. Springer, New York

    Google Scholar 

  61. Valins S (1966) Cognitive effects of false heart-rate feedback. Journal of Personality and Social Psychology 4:400–408. doi:10.1037/h0023791

    Google Scholar 

  62. Van Ittersum K, Wansink B (2012) Plate Size and Color Suggestibility: The Delboeuf Illusion’s Bias on Serving and Eating Behavior. J Consum Res 39:215–228. doi:10.1086/662615

    Google Scholar 

  63. Wansink B, Painter J, Lee Y (2006) The office candy dish: proximity’s influence on estimated and actual consumption. Int J Obes Relat Metab Disord 30:871–875. doi:10.1038/sj.ijo.0803217

    Google Scholar 

  64. Wansink B, Van Ittersum K, Painter J (2006) Ice Cream Illusions. American Journal of Preventive Medicine 31:240–243. doi:10.1016/j.amepre.2006.04.003

    Google Scholar 

  65. Wolpert D, Ghahramani Z (2000) Computational principles of movement neuroscience. Nat Neurosci 3:1212–1217. doi:10.1038/81497

    Google Scholar 

  66. Watanabe K (2008) Behavioral speed contagion: Automatic modulation of movement timing by observation of body movements. Cognition 106:1514–1524. doi:10.1016/j.cognition.2007.06.001

    Google Scholar 

  67. Yoshida S, Sakurai S, Narumi T, Tanikawa T, Hirose M (2013) Incendiary reflection. ACM SIGGRAPH 2013 Talks on - SIGGRAPH ’13. doi:10.1145/2504459.2504503

Download references

Author information

Authors and Affiliations

  1. The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan

    Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa & Michitaka Hirose

  2. Tokyo Metropolitan University, 6-1-1 Asahigaoka, Hino, Tokyo, Japan

    Sho Sakurai

Authors
  1. Sho Sakurai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Takuji Narumi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomohiro Tanikawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michitaka Hirose
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Sho Sakurai , Takuji Narumi , Tomohiro Tanikawa or Michitaka Hirose .

Editor information

Editors and Affiliations

  1. Musashino, Keio University, Yokohama, Japan

    Shuichi Fukuda

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Sakurai, S., Narumi, T., Tanikawa, T., Hirose, M. (2016). Making Emotion and Decision via Affecting Self-Perception. In: Fukuda, S. (eds) Emotional Engineering Volume 4. Springer, Cham. https://doi.org/10.1007/978-3-319-29433-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29433-9_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29432-2

  • Online ISBN: 978-3-319-29433-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation