Emanuel Felipe Duarte
ABSTRACT
Ubiquitous and pervasive technologies, alongside the expanding role of the computer in our lives, present new dimensions to the concept of embodiment within the Human-Computer Interaction (HCI) field. Interactive installations, in particular, afford the technological and conceptual exploration of embodiment due to a high degree of creative freedom and more open objectives, making it a promising context to be investigated. In this paper, we present a systematic literature review on approaches to embodiment in the context of interactive installations. We searched four major digital libraries and screened a total of 3245 studies following a protocol described in the paper. The final selection consists of 67 entries. Our analysis shows a multitude of theoretical and practical approaches to embodiment in interactive installations, but also significant compatibility and combined use. We present detailed summaries of and discussion on how embodiment is conceptualized, put into practice, and what technologies are involved, revealing new perspectives and possibilities for investigating embodiment in HCI.
- Ruth A. Baer. 2003. Mindfulness Training as a Clinical Intervention: A Conceptual and Empirical Review. Clinical Psychology: Science and Practice 10, 2 (2003), 125--143. Google Scholar
Cross Ref
- Susanne Bødker and Clemens Nylandsted Klokmose. 2011. The Human-Artifact Model: An Activity Theoretical Approach to Artifact Ecologies. Human-Computer Interaction 26, 4 (2011), 315--371. Google ScholarDigital Library
- Kirk Warren Brown and Richard M. Ryan. 2003. The Benefits of Being Present: Mindfulness and Its Role in Psychological Well-Being. Journal of Personality and Social Psychology 84, 4 (2003), 822--848. Google ScholarCross Ref
- Jerome S. Bruner. 1966. Toward a Theory of Instruction. Harvard University Press, Cambridge, MA, USA.Google Scholar
- Eric Deng, Bilge Mutlu, and Maja J Mataric. 2019. Embodiment in Socially Interactive Robots. Foundations and Trends® in Robotics 7, 4 (2019), 251--356. Google ScholarDigital Library
- Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA, USA.Google Scholar
- Greg Downey. 2010. 'Practice without theory': a neuroanthropological perspective on embodied learning. Journal of the Royal Anthropological Institute 16, s1 (2010), S22--S40. Google ScholarCross Ref
- Shaun Gallagher. 2005. How the Body Shapes the Mind. Oxford University Press, Oxford. 294 pages. Google ScholarCross Ref
- James J. Gibson. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA, USA.Google Scholar
- David Gough, Sandy Oliver, and James Thomas. 2012. An Introduction to Systematic Reviews. SAGE Publications, Thousand Oaks, CA, USA.Google Scholar
- Yolande Harris and Bert Bongers. 2002. Approaches to creating interactivated spaces, from intimate to inhabited interfaces. Organised Sound 7, 3 (2002), 239--246. Google ScholarDigital Library
- N. Katherine Hayles. 1996. Embodied Virtuality: Or How to Put Bodies Back into the Picture. In Immersed in Technology: Art and Virtual Environments. MIT Press, Cambridge, MA, USA, 1--28.Google Scholar
- Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 3131--3142. Google ScholarDigital Library
- David Howes. 2013. The Expanding Field of Sensory Studies. http://www.sensorystudies.org/sensorial-investigations/the-expanding-field-of-sensory-studies/ Accessed May 28, 2022.Google Scholar
- Katherine Isbister, Elena Márquez Segura, and Edward F. Melcer. 2018. Social Affordances at Play: Game Design Toward Socio-Technical Innovation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--10. Google ScholarDigital Library
- Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '97). ACM, New York, NY, USA, 234--241. Google ScholarDigital Library
- Mark Johnson. 1987. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, Chicago, IL, USA.Google Scholar
- Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (13 Sep 2011), 433--438. Google ScholarCross Ref
- Jonghwa Kim and Elisabeth André. 2008. Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 12 (2008), 2067--2083. Google ScholarDigital Library
- Scott R. Klemmer, Björn Hartmann, and Leila Takayama. 2006. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of the 6th Conference on Designing Interactive Systems (University Park, PA, USA) (DIS '06). Association for Computing Machinery, New York, NY, USA, 140--149. Google ScholarDigital Library
- Ksenia Kolykhalova, Paolo Alborno, Antonio Camurri, and Gualtiero Volpe. 2016. A Serious Games Platform for Validating Sonification of Human Full-Body Movement Qualities. In Proceedings of the 3rd International Symposium on Movement and Computing (Thessaloniki, GA, Greece) (MOCO '16). Association for Computing Machinery, New York, NY, USA, Article 39, 5 pages. Google ScholarDigital Library
- Carly Kontra, Susan Goldin-Meadow, and Sian L. Beilock. 2012. Embodied Learning Across the Life Span. Topics in Cognitive Science 4, 4 (2012), 731--739. Google ScholarCross Ref
- George Lakoff. 2008. Women, Fire, and Dangerous Things: What Categories Reveal about the Mind. University of Chicago Press, Chicago, IL, USA.Google Scholar
- Michael R. Levenson, Patricia A. Jennings, Carolyn M. Aldwin, and Ray W. Shiraishi. 2005. Self-Transcendence: Conceptualization and Measurement. The International Journal of Aging and Human Development 60, 2 (2005), 127--143. Google ScholarCross Ref
- Robb Lindgren and David DeLiema. 2022. Viewpoint, embodiment, and roles in STEM learning technologies. Educational technology research and development 70, 3 (01 Jun 2022), 1009--1034. Google ScholarCross Ref
- Robb Lindgren and Mina Johnson-Glenberg. 2013. Emboldened by Embodiment: Six Precepts for Research on Embodied Learning and Mixed Reality. Educational Researcher 42, 8 (2013), 445--452. Google ScholarCross Ref
- V. Magagnin, M. Mauri, P. Cipresso, L. Mainardi, En Brown, S. Cerutti, M. Villamira, and R. Barbieri. 2010. Heart Rate Variability and Respiratory Sinus Arrhythmia Assessment of Affective States by Bivariate Autoregressive Spectral Analysis. Computing in cardiology 37, 5737930 (2010), 145--148. https://pubmed.ncbi.nlm.nih.gov/22158520Google Scholar
- Maurice Merleau-Ponty. 1962. Phenomenology of Perception. Routledge, Abingdon, UK.Google Scholar
- David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, and The PRISMA Group. 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Medicine 6, 7 (07 2009), 1--6. Google Scholar
- Lizzie Muller, Greg Turner, George Khut, and Ernest Edmonds. 2006. Creating Affective Visualisations for a Physiologically Interactive Artwork. In Tenth International Conference on Information Visualisation (IV'06). IEEE, New York, NY, USA, 651--657. Google ScholarDigital Library
- Karen Nakamura. 2013. Making Sense of Sensory Ethnography: The Sensual and the Multisensory. American Anthropologist 115, 1 (2013), 132--135. Google ScholarCross Ref
- Alva Noë. 2004. Action in Perception. MIT Press, Cambridge, MA, USA.Google Scholar
- Alva Noë. 2009. Out of Our Heads: Why You Are Not Your Brain, and Other Lessons from the Biology of Consciousness. Farrar, Straus and Giroux, New York, NY, USA.Google Scholar
- Donald A. Norman. 1988. The Design of Everyday Things. Doubleday, New York, NY, USA.Google ScholarDigital Library
- Rosalind W. Picard. 2000. Affective Computing. MIT Press, Cambridge, MA, USA.Google ScholarDigital Library
- Matthew Reason and Dee Reynolds. 2010. Kinesthesia, Empathy, and Related Pleasures: An Inquiry into Audience Experiences of Watching Dance. Dance Research Journal 42, 2 (2010), 49--75. Google ScholarCross Ref
- Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the Body! Designing a Mobile Stress Management Application Encouraging Personal Reflection. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (Aarhus, Denmark) (DIS '10). Association for Computing Machinery, New York, NY, USA, 47--56. Google ScholarDigital Library
- Maria V. Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nature Reviews Neuroscience 6, 4 (01 Apr 2005), 332--339. Google ScholarCross Ref
- Thecla Schiphorst. 2009. Soft(n): Toward a Somaesthetics of Touch. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA) (CHI EA '09). Association for Computing Machinery, New York, NY, USA, 2427--2438. Google ScholarDigital Library
- Mark S. Schwartz and Frank Andrasik. 2017. Biofeedback, Fourth Edition: A Practitioner's Guide. Guilford Publications, New York, NY, USA.Google Scholar
- Richard Shusterman. 2012. Thinking Through the Body: Essays in Somaesthetics. Cambridge University Press, Cambridge, UK.Google Scholar
- Jonathan Steuer. 2006. Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication 42, 4 (02 2006), 73--93. Google ScholarCross Ref
- Dag Svanæs. 2013. Interaction Design for and with the Lived Body: Some Implications of Merleau-Ponty's Phenomenology. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 8 (apr 2013), 30 pages. Google ScholarDigital Library
- Jelle Van Dijk. 2018. Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction 2, 1 (2018), 1--21. Google ScholarCross Ref
- Francisco J. Varela, Evan Thompson, and Eleanor Rosch. 1993. The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge, MA, USA.Google Scholar
- Mark Weiser. 1991. The Computer for the 21st Century. Scientific American 265, 3 (1991), 94--104. Google ScholarCross Ref
- Margaret Wilson. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review 9, 4 (01 Dec 2002), 625--636. Google ScholarCross Ref
Index Terms
- Embodiment in interactive installations: results from a systematic literature review
Recommendations
Interactive installations as performance: inspiration for HCI
TEI '14: Proceedings of the 8th International Conference on Tangible, Embedded and Embodied InteractionThis paper identifies a theoretical framework of interactive installations as inspirational artistic probes for human-computer interaction (HCI). It develops interstices of interactive installations by drawing from new media and digital art. Performance ...
Workshop on embodied interaction: theory and practice in HCI
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsFor over ten years researchers in human-computer interaction (HCI) have explored an embodied perspective that seeks to describe and explain the fundamental role played by the physical body in how we experience, interact with and understand computation ...
Evaluation in scenarios of ubiquity of technology: a systematic literature review on interactive installations
AbstractLiterature in the field of human–computer interaction (HCI) has shown a long tradition of evaluation methods for and along with interactive systems design. We have experienced in the last years an impressive development in ubiquitous and pervasive ...
Comments