research-article

Open Access

My Heart Will Go On: Implicitly Increasing Social Connectedness by Visualizing Asynchronous Players’ Heartbeats in VR Games

Authors:
Linda Hirsch

LMU Munich, Munich, Germany

LMU Munich, Munich, Germany

0000-0001-7239-7084
View Profile

,
Florian Müller

LMU Munich, Munich, Germany

LMU Munich, Munich, Germany

0000-0002-9621-6214
View Profile

,
Francesco Chiossi

LMU Munich, Munich, Germany

LMU Munich, Munich, Germany

0000-0003-2987-7634
View Profile

,
Theodor Benga

LMU Munich, Munich, Germany

LMU Munich, Munich, Germany

0009-0004-8397-2565
View Profile

,
Andreas Martin Butz

LMU Munich, Munich, Germany

LMU Munich, Munich, Germany

0000-0002-9007-9888
View Profile

Proceedings of the ACM on Human-Computer Interaction Volume 7 Issue CHI PLAYArticle No.: 411pp 976–1001https://doi.org/10.1145/3611057

Published:04 October 2023Publication History

Proceedings of the ACM on Human-Computer Interaction

Abstract

Social games benefit from social connectedness between players because it improves the gaming experience and increases enjoyment. In virtual reality (VR), various approaches, such as avatars, are developed for multi-player games to increase social connectedness. However, these approaches are lacking in single-player games. To increase social connectedness in such games, our work explores the visualization of physiological data from asynchronous players, i.e., electrocardiogram (ECG). We identified two visualization dimensions, the number of players, and the visualization style, after a design workshop with experts (N=4) and explored them in a single-user virtual escape room game. We spatially and temporally integrated the visualizations and compared two times two visualizations against a baseline condition without visualization in a within-subject lab study (N=34). All but one visualization significantly increased participants’ feelings of social connectedness. Heart icons triggered the strongest feeling of connectedness, understanding, and perceived support in playing the game.

References

Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies, 135 (2020), 102370. issn:1071-5819 https://doi.org/10.1016/j.ijhcs.2019.102370 Google ScholarDigital Library
Alaa Alahmadi, Alan Davies, Jennifer Royle, Markel Vigo, and Caroline Jay. 2019. Evaluating the Impact of Pseudo-Colour and Coordinate System on the Detection of Medication-Induced ECG Changes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:9781450359702 https://doi.org/10.1145/3290605.3300353 Google ScholarDigital Library
Emilie Maria Nybo Arendttorp, Heike Winschiers-Theophilus, Helvi Itenge, and Milo Marsfeldt Skovfoged. 2022. Save the Yummy Candyland: An Asymmetric Virtual Reality Game. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA. 221–227. isbn:9781450392112 https://doi.org/10.1145/3505270.3558319 Google ScholarDigital Library
A. Aron, E.N. Aron, and D. Smollan. 1992. Inclusion of Other in the Self Scale and the structure of interpersonal closeness. Journal of Personality and Social Psychology, 4 (1992), 596–612. https://doi.org/10.1037/0022-3514.63.4.596 Google ScholarCross Ref
Rogério Augusto Bordini and Oliver Korn. 2021. Noneliness: A Gamified Mobile App to Reduce Loneliness Among University Students. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA. 87–93. isbn:9781450383561 https://doi.org/10.1145/3450337.3483480 Google ScholarDigital Library
Roger Bakeman. 2005. Recommended effect size statistics for repeated measures designs. Behavior Research Methods, 37, 3 (2005), aug, 379–384. issn:1554-351X https://doi.org/10.3758/BF03192707 Google ScholarCross Ref
Saskia Bakker. 2013. Design for peripheral interaction. Ph. D. Dissertation. Department of Industrial Design. isbn:978-90-386-3382-4 https://doi.org/10.6100/IR754544 Google ScholarCross Ref
L.F. Barrett. 2017. How Emotions Are Made: The Secret Life of the Brain. HarperCollins. isbn:9780544129962 lccn:2017004323 Google Scholar
Nicole A Beres, Julian Frommel, Elizabeth Reid, Regan L Mandryk, and Madison Klarkowski. 2021. Don’t You Know That You’Re Toxic: Normalization of Toxicity in Online Gaming. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 438, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445157 Google ScholarDigital Library
Guillermo Bernal and Pattie Maes. 2017. Emotional Beasts: Visually Expressing Emotions through Avatars in VR. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’17). Association for Computing Machinery, New York, NY, USA. 2395–2402. isbn:9781450346566 https://doi.org/10.1145/3027063.3053207 Google ScholarDigital Library
Lindsay Blackwell, Nicole Ellison, Natasha Elliott-Deflo, and Raz Schwartz. 2019. Harassment in Social Virtual Reality: Challenges for Platform Governance. Proc. ACM Hum.-Comput. Interact., 3, CSCW (2019), Article 100, nov, 25 pages. https://doi.org/10.1145/3359202 Google ScholarDigital Library
Sarah Blum, Daniel Hölle, Martin Georg Bleichner, and Stefan Debener. 2021. Pocketable Labs for Everyone: Synchronized Multi-Sensor Data Streaming and Recording on Smartphones with the Lab Streaming Layer. Sensors, 21, 23 (2021), issn:1424-8220 https://doi.org/10.3390/s21238135 Google ScholarCross Ref
Virginia Braun, Victoria Clarke, Nikki Hayfield, and Gareth Terry. 2019. Thematic Analysis BT - Handbook of Research Methods in Health Social Sciences. 843–860. https://doi.org/10.1007/978-981-10-5251-4_103 Google ScholarCross Ref
Nathalie Bressa, Kendra Wannamaker, Henrik Korsgaard, Wesley Willett, and Jo Vermeulen. 2019. Sketching and Ideation Activities for Situated Visualization Design. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS ’19). Association for Computing Machinery, New York, NY, USA. 173–185. isbn:9781450358507 https://doi.org/10.1145/3322276.3322326 Google ScholarDigital Library
R. Brondi, G. Avveduto, L. Alem, C. Faita, M. Carrozzino, F. Tecchia, Y. Pisan, and M. Bergamasco. 2015. Evaluating the Effects of Competition vs Collaboration on User Engagement in an Immersive Game Using Natural Interaction. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (VRST ’15). Association for Computing Machinery, New York, NY, USA. 191. isbn:9781450339902 https://doi.org/10.1145/2821592.2821643 Google ScholarDigital Library
Wolfgang Büschel, Anke Lehmann, and Raimund Dachselt. 2021. MIRIA: A Mixed Reality Toolkit for the In-Situ Visualization and Analysis of Spatio-Temporal Interaction Data. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 470, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445651 Google ScholarDigital Library
John T Cacioppo, Louis G Tassinary, and Gary Berntson. 2007. Handbook of psychophysiology. Cambridge university press. https://doi.org/10.1017/9781107415782 Google ScholarCross Ref
Paul Cairns, Anna L. Cox, Matthew Day, Hayley Martin, and Thomas Perryman. 2013. Who but not where: The effect of social play on immersion in digital games. International Journal of Human-Computer Studies, 71, 11 (2013), 1069–1077. issn:1071-5819 https://doi.org/10.1016/j.ijhcs.2013.08.015 Google ScholarDigital Library
Hao Chen, Arindam Dey, Mark Billinghurst, and Robert W. Lindeman. 2017. Exploring the Design Space for Multi-Sensory Heart Rate Feedback in Immersive Virtual Reality. In Proceedings of the 29th Australian Conference on Computer-Human Interaction (OZCHI ’17). Association for Computing Machinery, New York, NY, USA. 108–116. isbn:9781450353793 https://doi.org/10.1145/3152771.3152783 Google ScholarDigital Library
Francesco Chiossi and Sven Mayer. 2023. How Can Mixed Reality Benefit From Physiologically-Adaptive Systems? Challenges and Opportunities for Human Factors Applications. Proceedings of Workshop on the Future of Computational Approaches for Understanding and Adapting User Interfaces, https://doi.org/10.48550/arXiv.2303.17978 Google Scholar
Francesco Chiossi, Changkun Ou, and Sven Mayer. 2023. Exploring Physiological Correlates of Visual Complexity Adaptation: Insights from EDA, ECG, and EEG Data for Adaptation Evaluation in VR Adaptive Systems. In ACM Conference on Human-Computer Interaction (CHI ’23 Extended Abstracts). Association for Computing Machinery, Hamburg, Germany. https://doi.org/10.1145/3544549.3585624 Google ScholarDigital Library
Francesco Chiossi, Yagiz Turgut, Robin Welsch, and Sven Mayer. 2023. Adapting Visual Complexity Based on Electrodermal Activity Improves Working Memory Performance in Virtual Reality. Proc. ACM Hum.-Comput. Interact., 7, MHCI (2023), Article 296, sep, 26 pages. https://doi.org/10.1145/3604243 Google ScholarDigital Library
Kevin Chow, Caitlin Coyiuto, Cuong Nguyen, and Dongwook Yoon. 2019. Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR. Proc. ACM Hum.-Comput. Interact., 3, CSCW (2019), Article 40, Nov., 24 pages. https://doi.org/10.1145/3359142 Google ScholarDigital Library
Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Routledge. isbn:9780203771587 https://doi.org/10.4324/9780203771587 Google ScholarCross Ref
Giorgia Cona, Francesco Chiossi, Silvia Di Tomasso, Giovanni Pellegrino, Francesco Piccione, Patrizia Bisiacchi, and Giorgio Arcara. 2020. Theta and alpha oscillations as signatures of internal and external attention to delayed intentions: A magnetoencephalography (MEG) study. NeuroImage, 205 (2020), Jan., 116295. issn:1053-8119 https://doi.org/10.1016/j.neuroimage.2019.116295 Google ScholarCross Ref
HTC Corporation. 2021 (last visited July 21st 2022.). Vive Pro. https://business.vive.com/de/product/vive-pro/ Google Scholar
Jennifer M. Cunningham. 2015. Mechanizing People and Pedagogy: Establishing Social Presence in the Online Classroom. Journal of Asynchronous Learning Network, 19 (2015), 06, https://doi.org/10.24059/olj.v19i3.667 Google ScholarCross Ref
Max T. Curran and John Chuang. 2022. Social Distancing and Social Biosensing: Intersubjectivity from Afar. Computer Supported Cooperative Work, https://doi.org/0.1007/s10606-022-09428-5 Google Scholar
Yvonne De Kort, Wijnand Ijsselsteijn, and Karolien Poels. 2007. Digital Games as Social Presence Technology: Development of the Social Presence in Gaming Questionnaire (SPGQ). Journal of Applied Mechanics-transactions of The Asme - J APPL MECH. Google Scholar
Arindam Dey, Hao Chen, Mark Billinghurst, and Robert W. Lindeman. 2018. Effects of Manipulating Physiological Feedback in Immersive Virtual Environments. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA. 101–111. isbn:9781450356244 https://doi.org/10.1145/3242671.3242676 Google ScholarDigital Library
Arindam Dey, Hao Chen, Ashkan Hayati, Mark Billinghurst, and Robert W. Lindeman. 2019. Sharing Manipulated Heart Rate Feedback in Collaborative Virtual Environments. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 248–257. https://doi.org/10.1109/ISMAR.2019.00022 Google ScholarCross Ref
Arindam Dey, Thammathip Piumsomboon, Youngho Lee, and Mark Billinghurst. 2017. Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA. 4045–4056. isbn:9781450346559 https://doi.org/10.1145/3025453.3026028 Google ScholarDigital Library
Dennis Dietz, Carl Oechsner, Changkun Ou, Francesco Chiossi, Fabio Sarto, Sven Mayer, and Andreas Butz. 2022. Walk This Beam: Impact of Different Balance Assistance Strategies and Height Exposure on Performance and Physiological Arousal in VR. In 28th ACM Symposium on Virtual Reality Software and Technology (VRST ’22). Association for Computing Machinery, New York, NY, USA. Article 32, 12 pages. isbn:9781450398893 https://doi.org/10.1145/3562939.3567818 Google ScholarDigital Library
Paul Dourish and Victoria Bellotti. 1992. Awareness and Coordination in Shared Workspaces. In Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work (CSCW ’92). Association for Computing Machinery, New York, NY, USA. 107–114. isbn:0897915429 https://doi.org/10.1145/143457.143468 Google ScholarDigital Library
Paul Dourish and Sara Bly. 1992. Portholes: Supporting Awareness in a Distributed Work Group. CHI ’92. Association for Computing Machinery, New York, NY, USA. 541–547. isbn:0897915135 https://doi.org/10.1145/142750.142982 Google ScholarDigital Library
Aidan D’Souza, Bernd Ploderer, Madison Klarkowski, and Peta Wyeth. 2018. Augmenting Co-Located Social Play with Biofeedback: An Interactional Approach. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA. 113–125. isbn:9781450356244 https://doi.org/10.1145/3242671.3242679 Google ScholarDigital Library
Julia Dugnol, Estibaliz Jimenez, María Ruiz-Fernández, David Fernández-Valera, Allen Mok, and Jesús Merayo-Lloves. 2021. A collaborative escape room as gamification strategy to increase learning motivation and develop curricular skills of occupational therapy students. BMC Medical Education, 21 (2021), 10, https://doi.org/10.1186/s12909-021-02973-5 Google ScholarCross Ref
Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21), October 10-14, 2021, Virtual Event, USA. 1, Association for Computing Machinery. isbn:9781450386357 https://doi.org/10.1145/3472749.3474784 arxiv:2102.11824. Google ScholarDigital Library
Milou A. Feijt, Joyce H.D.M. Westerink, Yvonne A.W. De Kort, and Wijnand A. IJsselsteijn. 2021. Sharing biosignals: An analysis of the experiential and communication properties of interpersonal psychophysiology. Human–Computer Interaction, 0, 0 (2021), 1–30. https://doi.org/10.1080/07370024.2021.1913164 Google ScholarCross Ref
Interaction Design Foundation. last accessed August 28th 2022. Skeuomorphism. https://www.interaction-design.org/literature/topics/skeuomorphism Google Scholar
Jérémy Frey. 2016. Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). Association for Computing Machinery, New York, NY, USA. 1865–1871. isbn:9781450340823 https://doi.org/10.1145/2851581.2892391 Google ScholarDigital Library
Ceenu George, Malin Eiband, Michael Hufnagel, and Heinrich Hussmann. 2018. Trusting Strangers in Immersive Virtual Reality. 1–2. https://doi.org/10.1145/3180308.3180355 Google ScholarDigital Library
Ceenu George and Mariam Hassib. 2019. Towards Augmenting IVR Communication with Physiological Sensing Data. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA. 1–6. isbn:9781450359719 https://doi.org/10.1145/3290607.3313082 Google ScholarDigital Library
Stefan Gradl, Markus Wirth, Tobias Zillig, and Bjoern M Eskofier. 2018. Visualization of heart activity in virtual reality: A biofeedback application using wearable sensors. In 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN). 152–155. https://doi.org/10.1109/BSN.2018.8329681 Google ScholarCross Ref
Linda Graf, Maximilian Altmeyer, Katharina Emmerich, Marc Herrlich, Andrey Krekhov, and Katta Spiel. 2022. Development and Validation of a German Version of the Player Experience Inventory (PXI). In Mensch und Computer 2022 - Tagungsband, Bastian Pfleging, Kathrin Gerling, and Sven Mayer (Eds.). ACM, New York. 265–265. https://doi.org/10.1145/3543758.3543763 Google ScholarDigital Library
Fairouz Grioui and Tanja Blascheck. 2021. Study of Heart Rate Visualizations on a Virtual Smartwatch. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST ’21). Association for Computing Machinery, New York, NY, USA. Article 96, 3 pages. isbn:9781450390927 https://doi.org/10.1145/3489849.3489913 Google ScholarDigital Library
Manuel Guimarães, Rui Prada, Pedro A. Santos, João Dias, Arnav Jhala, and Samuel Mascarenhas. 2020. The Impact of Virtual Reality in the Social Presence of a Virtual Agent. Association for Computing Machinery, New York, NY, USA. isbn:9781450375863 Google Scholar
Charlie Gullström and Joke Kort. 2016. Where Did My Office Go? Is It in the Cloud!? Workshop on Spatial and Social Connectedness in Virtual and Mediated Work Environments. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW ’16 Companion). Association for Computing Machinery, New York, NY, USA. 457–464. isbn:9781450339506 https://doi.org/10.1145/2818052.2855525 Google ScholarDigital Library
Simon Gächter, Chris Starmer, and Fabio Tufano. 2015. Measuring the Closeness of Relationships: A Comprehensive Evaluation of the ’Inclusion of the Other in the Self’ Scale. PLOS ONE, 10 (2015), 06, e0129478. https://doi.org/10.1371/journal.pone.0129478 Google ScholarCross Ref
P. Hamilton. 2002. Open source ECG analysis. In Computers in Cardiology. IEEE, Memphis, TN, USA. 101–104. issn:0276-6547 https://doi.org/10.1109/CIC.2002.1166717 Google ScholarCross Ref
Leif Handberg, Charlie Gullströ, Joke Kort, and Jimmy Nyström. 2016. Spatial and Social Connectedness in Web-Based Work Collaboration. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW ’16 Companion). Association for Computing Machinery, New York, NY, USA. 45–48. isbn:9781450339506 https://doi.org/10.1145/2818052.2874321 Google ScholarDigital Library
John Harris and Mark Hancock. 2019. To Asymmetry and Beyond! Improving Social Connectedness by Increasing Designed Interdependence in Cooperative Play. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA. 1–12. isbn:9781450359702 https://doi.org/10.1145/3290605.3300239 Google ScholarDigital Library
Louise Hawkley, Mary Hughes, Linda Waite, Christopher Masi, Ronald Thisted, and John Cacioppo. 2008. From Social Structural Factors to Perceptions of Relationship Quality and Loneliness: The Chicago Health, Aging, and Social Relations Study. Journal of Gerontology: Social Sciences, 63B (2008), 11, S375–84. https://doi.org/10.1093/geronb/63.6.S375 Google ScholarCross Ref
Hello Games. 2016 (last accessed October 29th, 2021). No Man’s Sky, https://www.nomanssky.com/. https://www.nomanssky.com/beyond-update/?cli_action=1635529112.09 Google Scholar
Linda Hirsch, Ceenu George, and Andreas Butz. 2022. Traces in Virtual Environments: A Framework and Exploration to Conceptualize the Design of Social Virtual Environments. In Proceedings of the 2022 ISMAR (ISMAR ’22). IEEE, tbd. Article 00, 00 pages. https://doi.org/10.1109/TVCG.2022.3203092 Google ScholarCross Ref
Noura Howell, Laura Devendorf, Tomás Alfonso Vega Gálvez, Rundong Tian, and Kimiko Ryokai. 2018. Tensions of Data-Driven Reflection: A Case Study of Real-Time Emotional Biosensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:9781450356206 https://doi.org/10.1145/3173574.3174005 Google ScholarDigital Library
Noura Howell, Greg Niemeyer, and Kimiko Ryokai. 2019. Life-Affirming Biosensing in Public: Sounding Heartbeats on a Red Bench. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA. 1–16. isbn:9781450359702 https://doi.org/10.1145/3290605.3300910 Google ScholarDigital Library
W.A. IJsselsteijn, Y.A.W. de Kort, and K. Poels. 2013. The Game Experience Questionnaire. Technische Universiteit Eindhoven. Google Scholar
Katherine Isbister. 2016. How Games Move Us: Emotion by Design. isbn:9780262333238 https://doi.org/10.7551/mitpress/9267.001.0001 Google ScholarCross Ref
Alaul Islam, Anastasia Bezerianos, Bongshin Lee, Tanja Blascheck, and Petra Isenberg. 2020. Visualizing Information on Watch Faces: A Survey with Smartwatch Users. In 2020 IEEE Visualization Conference (VIS). 156–160. https://doi.org/10.1109/VIS47514.2020.00038 Google ScholarCross Ref
Simo Järvelä, Benjamin Cowley, Mikko Salminen, Giulio Jacucci, Juho Hamari, and Niklas Ravaja. 2021. Augmented Virtual Reality Meditation: Shared Dyadic Biofeedback Increases Social Presence Via Respiratory Synchrony. Trans. Soc. Comput., 4, 2 (2021), Article 6, May, 19 pages. issn:2469-7818 https://doi.org/10.1145/3449358 Google ScholarDigital Library
Mohd Javaid and Ibrahim Haleem Khan. 2022. Virtual Reality (VR) Applications in Cardiology: A Review. Journal of Industrial Integration and Management, 07, 02 (2022), 183–202. https://doi.org/10.1142/S2424862221300015 Google ScholarCross Ref
Martin Johannes Dechant, Julian Frommel, and Regan Mandryk. 2021. Assessing Social Anxiety Through Digital Biomarkers Embedded in a Gaming Task. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 544, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445238 Google ScholarDigital Library
James H. Fowler John T. Cacioppo and Nicholas A. Christakis. 2009. Alone in the crowd: the structure and spread of loneliness in a large social network. Journal of Personal and Social Psychology, 97, 6 (2009), jan, 977–991. https://doi.org/10.1037/a0016076 Google ScholarCross Ref
Marcel Jonas, Steven Said, Daniel Yu, Chris Aiello, Nicholas Furlo, and Douglas Zytko. 2019. Towards a Taxonomy of Social VR Application Design. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY ’19 Extended Abstracts). Association for Computing Machinery, New York, NY, USA. 437–444. isbn:9781450368711 https://doi.org/10.1145/3341215.3356271 Google ScholarDigital Library
Sukran Karaosmanoglu, Katja Rogers, Dennis Wolf, Enrico Rukzio, Frank Steinicke, and Lennart E. Nacke. 2021. Feels like Team Spirit: Biometric and Strategic Interdependence in Asymmetric Multiplayer VR Games. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 443, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445492 Google ScholarDigital Library
David Kaufman and Louise Sauve. 2019. Digital Gaming by Older Adults: Can It Enhance Social Connectedness? In Human Aspects of IT for the Aged Population. Social Media, Games and Assistive Environments, Jia Zhou and Gavriel Salvendy (Eds.). Springer International Publishing, Cham. 167–176. isbn:978-3-030-22015-0 Google Scholar
S Kaufman, I Poupyrev, E Miller, Mark Billinghurst, Peter Oppenheimer, and S Weghorst. 1997. New interface metaphors for complex information space visualization: an ECG monitor object prototype. Studies in health technology and informatics, 39 (1997), 02, 131–40. Google Scholar
Kojima Productions. 2019 (last accessed October 29th, 2021). Death Stranding, https://www.epicgames.com/store/p/death-stranding. https://www.epicgames.com/store/p/death-stranding Google Scholar
Andrey Krekhov, Katharina Emmerich, Ronja Rotthaler, and Jens Krueger. 2021. Puzzles Unpuzzled: Towards a Unified Taxonomy for Analog and Digital Escape Room Games. Proc. ACM Hum.-Comput. Interact., 5, CHI PLAY (2021), Article 269, oct, 24 pages. https://doi.org/10.1145/3474696 Google ScholarDigital Library
Devender Kumar, Raju Maharjan, Alban Maxhuni, Helena Dominguez, Anne Frølich, and Jakob E. Bardram. 2022. MCardia: A Context-Aware ECG Collection System for Ambulatory Arrhythmia Screening. ACM Trans. Comput. Healthcare, 3, 2 (2022), Article 20, mar, 28 pages. issn:2691-1957 https://doi.org/10.1145/3494581 Google ScholarDigital Library
Alexandra Kuznetsova, Per B. Brockhoff, and Rune H. B. Christensen. 2017. lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software, 82, 13 (2017), 1–26. https://doi.org/10.18637/jss.v082.i13 Google ScholarCross Ref
J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, 33, 1 (1977), mar, 159. issn:0006341X https://doi.org/10.2307/2529310 Google ScholarCross Ref
Sueyoon Lee, Abdallah El Ali, Maarten Wijntjes, and Pablo Cesar. 2022. Understanding and Designing Avatar Biosignal Visualizations for Social Virtual Reality Entertainment. In CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. Article 425, 15 pages. isbn:9781450391573 https://doi.org/10.1145/3491102.3517451 Google ScholarDigital Library
Stefan Liszio, Katharina Emmerich, and Maic Masuch. 2017. The Influence of Social Entities in Virtual Reality Games on Player Experience and Immersion. In Proceedings of the 12th International Conference on the Foundations of Digital Games (FDG ’17). Association for Computing Machinery, New York, NY, USA. Article 35, 10 pages. isbn:9781450353199 https://doi.org/10.1145/3102071.3102086 Google ScholarDigital Library
Fannie Liu. 2019. Expressive Biosignals: Authentic Social Cues for Social Connection. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA. 1–5. isbn:9781450359719 https://doi.org/10.1145/3290607.3299081 Google ScholarDigital Library
Fannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai, Laura Dabbish, Geoff Kaufman, and Andrés Monroy-Hernández. 2021. Significant Otter: Understanding the Role of Biosignals in Communication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 334, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445200 Google ScholarDigital Library
Dominique Makowski, Tam Pham, Zen J. Lau, Jan C. Brammer, François Lespinasse, Hung Pham, Christopher Schölzel, and SH Chen. 2021. NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior research methods, 53, 4 (2021), 1689–1696. https://doi.org/10.3758/s13428-020-01516-y Google ScholarCross Ref
Regan L. Mandryk, Julian Frommel, Ashley Armstrong, and Daniel Johnson. 2020. How Passion for Playing World of Warcraft Predicts In-Game Social Capital, Loneliness, and Wellbeing. Frontiers in Psychology, 11 (2020), issn:1664-1078 https://doi.org/10.3389/fpsyg.2020.02165 Google ScholarCross Ref
Igor Mayer. 2016. Playful Organisations & Learning Systems. isbn:978-90-825477-0-2 Google Scholar
Nick Merrill and Coye Cheshire. 2017. Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW ’17). Association for Computing Machinery, New York, NY, USA. 2–12. isbn:9781450343350 https://doi.org/10.1145/2998181.2998286 Google ScholarDigital Library
Deniz Mevlevioğlu, David Murphy, and Sabin Tabirca. 2021. Visual Respiratory Feedback in Virtual Reality Exposure Therapy: A Pilot Study. In ACM International Conference on Interactive Media Experiences (IMX ’21). Association for Computing Machinery, New York, NY, USA. 1–6. isbn:9781450383899 https://doi.org/10.1145/3452918.3458799 Google ScholarDigital Library
Seulki Min, Jung-geun Moon, Chul-Hyun Cho, and Gerard J. Kim. 2020. Effects of Immersive Virtual Reality Content Type to Mindfulness and Physiological Parameters. In 26th ACM Symposium on Virtual Reality Software and Technology (VRST ’20). Association for Computing Machinery, New York, NY, USA. Article 24, 9 pages. isbn:9781450376198 https://doi.org/10.1145/3385956.3418942 Google ScholarDigital Library
Clara Moge, Katherine Wang, and Youngjun Cho. 2022. Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. Article 301, 16 pages. isbn:9781450391573 https://doi.org/10.1145/3491102.3517495 Google ScholarDigital Library
Mikhail Morozov, Alexey Gerasimov, Mikhail Fominykh, and Andrey Smorkalov. 2013. Asynchronous Immersive Classes in a 3D Virtual World: Extended Description of vAcademia. 81–100. isbn:9783642388026 https://doi.org/10.1007/978-3-642-38803-3_5 Google ScholarCross Ref
Kent Norman. 2013. GEQ (Game Engagement/Experience Questionnaire): A Review of Two Papers. Interacting with Computers, 25 (2013), 06, 278–283. https://doi.org/10.1093/iwc/iwt009 Google ScholarCross Ref
Thomas R. Pedersen, Iveta Ivanova, Michael Hjørringgaard, Julie Fredsgård, Freya K. B. Cornelius, Oliver Esman Pust, and Henning Pohl. 2022. Eggventures: Strengthening Connectedness through Coop-Play. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA. 70–74. isbn:9781450392112 https://doi.org/10.1145/3505270.3558326 Google ScholarDigital Library
Andres Pinilla, Jaime Garcia, William Raffe, Jan-Niklas Voigt-Antons, Robert P. Spang, and Sebastian Möller. 2021. Affective Visualization in Virtual Reality: An Integrative Review. Frontiers in Virtual Reality, 2 (2021), issn:2673-4192 https://doi.org/10.3389/frvir.2021.630731 Google ScholarCross Ref
Luis Quintero, John E. Muñoz, Jeroen de Mooij, and Michael Gaebler. 2021. Excite-O-Meter: Software Framework to Integrate Heart Activity in Virtual Reality. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 357–366. https://doi.org/10.1109/ISMAR52148.2021.00052 Google ScholarCross Ref
David Deritei Rebeka O. Szabo, Sandeep Chowdhary and Federico Battiston. 2022. The anatomy of social dynamics in escape rooms. Scientific Reports, 12 (2022), https://doi.org/10.1038/s41598-022-13929-0 Google ScholarCross Ref
Patrick Renner and Thies Pfeiffer. 2017. Attention guiding techniques using peripheral vision and eye tracking for feedback in augmented-reality-based assistance systems. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, Parramatta NSW Australia. 186–194. https://doi.org/10.1109/3DUI.2017.7893338 Google ScholarCross Ref
Raquel Breejon Robinson, Ricardo Rheeder, Madison Klarkowski, and Regan L Mandryk. 2022. ”Chat Has No Chill”: A Novel Physiological Interaction For Engaging Live Streaming Audiences. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. Article 562, 18 pages. isbn:9781450391573 https://doi.org/10.1145/3491102.3501934 Google ScholarDigital Library
Daniel Roth, Gary Bente, Peter Kullmann, David Mal, Chris Felix Purps, Kai Vogeley, and Marc Erich Latoschik. 2019. Technologies for Social Augmentations in User-Embodied Virtual Reality. In 25th ACM Symposium on Virtual Reality Software and Technology (VRST ’19). Association for Computing Machinery, New York, NY, USA. Article 5, 12 pages. isbn:9781450370011 https://doi.org/10.1145/3359996.3364269 Google ScholarDigital Library
Daniel Roth, Kristoffer Waldow, Felix Stetter, Gary Bente, Marc Latoschik, and Arnulph Fuhrmann. 2016. SIAM-C: A Socially Immersive Avatar Mediated Communication Platform. 357–358. https://doi.org/10.1145/2993369.2996302 Google ScholarDigital Library
David Saffo, Sara Di Bartolomeo, Caglar Yildirim, and Cody Dunne. 2021. Remote and Collaborative Virtual Reality Experiments via Social VR Platforms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. Article 523, 15 pages. isbn:9781450380966 https://doi.org/10.1145/3411764.3445426 Google ScholarDigital Library
Mikko Salminen, Simo Järvelä, Antti Ruonala, Janne Timonen, Kristiina Mannermaa, Niklas Ravaja, and Giulio Jacucci. 2018. Bio-Adaptive Social VR to Evoke Affective Interdependence: DYNECOM. In 23rd International Conference on Intelligent User Interfaces (IUI ’18). Association for Computing Machinery, New York, NY, USA. 73–77. isbn:9781450349451 https://doi.org/10.1145/3172944.3172991 Google ScholarDigital Library
Mikko Salminen, Simo Järvelä, Antti Ruonala, Ville J. Harjunen, Juho Hamari, Giulio Jacucci, and Niklas Ravaja. 2022. Evoking Physiological Synchrony and Empathy Using Social VR With Biofeedback. IEEE Transactions on Affective Computing, 13, 2 (2022), 746–755. https://doi.org/10.1109/TAFFC.2019.2958657 Google ScholarCross Ref
Mel Slater, Solène Neyret, Tania Johnston, Guillermo Iruretagoyena, Mercè Álvarez de la Campa, Miquel Alabernia, Bernhard Spanlang, and Guillem Feixas. 2019. An experimental study of a virtual reality counselling paradigm using embodied self-dialogue. Scientific Reports, 9 (2019), 07, 10903. https://doi.org/10.1038/s41598-019-46877-3 Google ScholarCross Ref
Mel Slater, Anthony Steed, John McCarthy, and Francesco Maringelli. 1998. The Influence of Body Movement on Subjective Presence in Virtual Environments. Human Factors, 40, 3 (1998), 469–477. https://doi.org/10.1518/001872098779591368 PMID: 9849105 Google ScholarCross Ref
Petr Slovák, Joris Janssen, and Geraldine Fitzpatrick. 2012. Understanding Heart Rate Sharing: Towards Unpacking Physiosocial Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). Association for Computing Machinery, New York, NY, USA. 859–868. isbn:9781450310154 https://doi.org/10.1145/2207676.2208526 Google ScholarDigital Library
Harrison Jesse Smith and Michael Neff. 2018. Communication Behavior in Embodied Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). Association for Computing Machinery, New York, NY, USA. 1–12. isbn:9781450356206 https://doi.org/10.1145/3173574.3173863 Google ScholarDigital Library
Jaakko Stenros, Janne Paavilainen, and Frans Mäyrä. 2009. The Many Faces of Sociability and Social Play in Games. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era (MindTrek ’09). Association for Computing Machinery, New York, NY, USA. 82–89. isbn:9781605586335 https://doi.org/10.1145/1621841.1621857 Google ScholarDigital Library
Ekaterina R. Stepanova, John Desnoyers-Stewart, Philippe Pasquier, and Bernhard E. Riecke. 2020. JeL: Breathing Together to Connect with Others and Nature. Association for Computing Machinery, New York, NY, USA. 641–654. isbn:9781450369749 Google Scholar
Chiew Seng Sean Tan, Kris Luyten, Jan Van Den Bergh, Johannes Schöning, and Karin Coninx. 2014. The Role of Physiological Cues during Remote Collaboration. Presence: Teleoper. Virtual Environ., 23, 1 (2014), feb, 90–107. issn:1054-7460 https://doi.org/10.1162/PRES_a_00168 Google ScholarDigital Library
Jane Turner and Ann Morrison. 2021. Designing Slow Cities for More Than Human Enrichment: Dog Tales—Using Narrative Methods to Understand Co-Performative Place-Making. Multimodal Technologies and Interaction, 5, 1 (2021), issn:2414-4088 https://doi.org/10.3390/mti5010001 Google ScholarCross Ref
Harald Warmelink, Igor Mayer, Jessika Weber, Bram Heijligers, Mata Haggis, Erwin Peters, and Max Louwerse. 2017. AMELIO: Evaluating the Team-Building Potential of a Mixed Reality Escape Room Game. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’17 Extended Abstracts). Association for Computing Machinery, New York, NY, USA. 111–123. isbn:9781450351119 https://doi.org/10.1145/3130859.3131436 Google ScholarDigital Library
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA. 143–146. isbn:9781450302289 https://doi.org/10.1145/1978942.1978963 Google ScholarDigital Library
Peggy Wu, Jacquelyn Morie, Pete Wall, Tammy Ott, and Kim Binsted. 2016. ANSIBLE: Virtual Reality for Behavioral Health. Procedia Engineering, 159 (2016), 108–111. issn:1877-7058 https://doi.org/10.1016/j.proeng.2016.08.132 Humanitarian Technology: Science, Systems and Global Impact 2016, HumTech2016 Google ScholarCross Ref
Peggy Wu, Tammy Ott, and Jacki Morie. 2016. ANSIBLE: Social Connectedness through a Virtual World in an Isolated Mars Simulation Mission. In Proceedings of the 2016 Virtual Reality International Conference (VRIC ’16). Association for Computing Machinery, New York, NY, USA. Article 28, 4 pages. isbn:9781450341806 https://doi.org/10.1145/2927929.2927933 Google ScholarDigital Library
Ting Zhang, Jing Yang, Nade Liang, Brandon J. Pitts, Kwaku O. Prakah-Asante, Reates Curry, Bradley S. Duerstock, Juan P. Wachs, and Denny Yu. 2020. Physiological Measurements of Situation Awareness: A Systematic Review. Human Factors, 0, 0 (2020), 0018720820969071. https://doi.org/10.1177/0018720820969071 PMID: 33241945 Google ScholarCross Ref
Zhuoming Zhou, Elena Márquez Segura, Jared Duval, Michael John, and Katherine Isbister. 2019. Astaire: A Collaborative Mixed Reality Dance Game for Collocated Players. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’19). Association for Computing Machinery, New York, NY, USA. 5–18. isbn:9781450366885 https://doi.org/10.1145/3311350.3347152 Google ScholarDigital Library

Index Terms

My Heart Will Go On: Implicitly Increasing Social Connectedness by Visualizing Asynchronous Players’ Heartbeats in VR Games
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction paradigms
      1. Virtual reality

Recommendations

The many faces of sociability and social play in games
MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era

In the past, social interaction has been discussed mostly in the context of multiplayer games, ignoring the implicit forms of sociability in single player games. This paper distinguishes between the sociability around the playing of a game and the ...
Read More
The differences in motivations of online game players and offline game players: A combined analysis of three studies at higher education level

Computer games have become a highly popular form of entertainment and have had a large impact on how University students spend their leisure time. Due to their highly motivating properties computer games have come to the attention of educationalists who ...
Read More
Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison
Sandbox '11: Proceedings of the 2011 ACM SIGGRAPH Symposium on Video Games

As video games become more popular, there is an urge for procedures that can support the analysis and understanding of players' behaviors within game environments. Such data would inform game and level designers of game design issues that should be ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue CHI PLAY
November 2023
1360 pages
EISSN:2573-0142
DOI:10.1145/3554313
Editor:
Jeffrey Nichols
Apple, USA
Issue’s Table of Contents
Copyright © 2023 Owner/Author
This work is licensed under a Creative Commons Attribution 4.0 International License.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 4 October 2023
Published in pacmhci Volume 7, Issue CHI PLAY

Permissions
Request permissions about this article.
Request Permissions

Check for updates
Author Tags
VR game
asynchronous
escape room
heartbeat
physiological data
shared biodata
single player
social VR
visualization
Qualifiers
- research-article
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 1
  Total Citations
  View Citations
- 446
  Total Downloads
- Downloads (Last 12 months)446
- Downloads (Last 6 weeks)98
Other Metrics
View Author Metrics
Cited By
View all

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

My Heart Will Go On: Implicitly Increasing Social Connectedness by Visualizing Asynchronous Players’ Heartbeats in VR Games

Proceedings of the ACM on Human-Computer Interaction

Abstract

References

Cited By

Index Terms

Recommendations

The many faces of sociability and social play in games

The differences in motivations of online game players and offline game players: A combined analysis of three studies at higher education level

Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison

Comments

Login options

Full Access

Published in

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Funding Sources

Other Metrics

Article Metrics

Other Metrics

Cited By

PDF Format

eReader

Digital Edition

Caption

My Heart Will Go On: Implicitly Increasing Social Connectedness by Visualizing Asynchronous Players’ Heartbeats in VR Games

Proceedings of the ACM on Human-Computer Interaction

Abstract

References

Cited By

Index Terms

Recommendations

The many faces of sociability and social play in games

The differences in motivations of online game players and offline game players: A combined analysis of three studies at higher education level

Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison

Comments

Login options

Full Access

Published in

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Funding Sources

Article Metrics

Other Metrics

PDF Format

eReader

Digital Edition

Share this Publication link

Share on Social Media