ABSTRACT
We present a virtual reality (VR) experience designed to raise awareness towards the impact of low-vision conditions on social interactions for patients. Specifically, we look at age-related macular degeneration (AMD) that results in the loss of central visual field acuity (a.k.a. a scotoma), which hinders AMD patients from perceiving facial expressions and gestures, and can bring about awkward interactions, misunderstandings, and feelings of isolation. Using VR, we co-designed an experience composed of four scenes from the life of AMD patients through structured interviews with the patients and orthoptists. The experience takes the perspective of a patient, and throughout the scenarios, provides voiceovers on their feelings, the challenges they face, how they adapt to their situation, and also bits of advice on how their quality of life was improved through considerate actions from people in their social circles. A virtual scotoma is designed to follow the gaze of the user using the HTC Vive Focus 3 headset with an eye-tracking module. Setting out from a formal definition of awareness, we evaluate our experience on three components of awareness – knowledge, engagement, and empathy – through established questionnaires, continuous measures of gaze and skin conductance, and qualitative feedback. Carrying out a experiment with 29 participants, we found not only that our experience had a positive and strong impact on the awareness of participants towards AMD, but also that the scotoma and events had observable influences on gaze activity and emotions. We believe this work outlines the advantages of immersive technologies for public awareness towards conditions such as AMD, and opens avenues to conducting studies with fine-grained, multimodal analysis of user behaviour for designing more engaging experiences.
- Sun Joo (Grace) Ahn. 2021. 9. Designing for Persuasion through Embodied Experiences in Virtual Reality. In Persuasive Gaming in Context. Amsterdam University Press, Amsterdam, The Netherlands.Google Scholar
- Sun Joo (Grace) Ahn, Jeremy N. Bailenson, and Dooyeon Park. 2014. Short- and long-term effects of embodied experiences in immersive virtual environments on environmental locus of control and behavior. Computers in Human Behavior 39 (Oct. 2014), 235–245. https://www.sciencedirect.com/science/article/pii/S0747563214003999Google Scholar
- Amy E. Bennion, Rachel L. Shaw, and Jonathan M. Gibson. 2012. What do we know about the experience of age related macular degeneration? A systematic review and meta-synthesis of qualitative research. Social Science & Medicine 75, 6 (Sept. 2012), 976–985. https://linkinghub.elsevier.com/retrieve/pii/S0277953612003796Google ScholarCross Ref
- Federico Bizzarri, Alessandro Giuliani, and Chiara Mocenni. 2022. Awareness: An empirical model. Front Psychol 13 (Dec. 2022), 933183. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9780538/Google Scholar
- Jason J Braithwaite, Diana Patrícia Zethelius Watson, R. O. Jones, and Michael A. Rowe. 2015. Guide for Analysing Electrodermal Activity & Skin Conductance Responses for Psychological Experiments. Technical Report. University of Birmingham.Google Scholar
- Javier Cabedo-Peris, Manuel Martí-Vilar, César Merino-Soto, and Mafalda Ortiz-Morán. 2022. Basic Empathy Scale: A Systematic Review and Reliability Generalization Meta-Analysis. Healthcare 10, 1 (2022). https://www.mdpi.com/2227-9032/10/1/29Google Scholar
- Aurélie Calabrese, Jean-Baptiste Bernard, Louis Hoffart, Géraldine Faure, Fatiha Barouch, John Conrath, and Eric Castet. 2011. Wet versus dry age-related macular degeneration in patients with central field loss: different effects on maximum reading speed. Investigative ophthalmology & visual science 52, 5 (2011), 2417–2424.Google Scholar
- Roser Cañigueral and Antonia F. de C. Hamilton. 2019. The Role of Eye Gaze During Natural Social Interactions in Typical and Autistic People. Frontiers in Psychology 10 (2019). https://www.frontiersin.org/articles/10.3389/fpsyg.2019.00560Google Scholar
- Ayoung Cho, Sung Park, Hyunwoo Lee, and Mincheol Whang. 2021. Non-Contact Measurement of Empathy Based on Micro-Movement Synchronization. Sensors (Basel) 21, 23 (Nov. 2021), 7818.Google ScholarCross Ref
- Nonny De la Peña, Peggy Weil, Joan Llobera, Bernhard Spanlang, Doron Friedman, Maria V Sanchez-Vives, and Mel Slater. 2010. Immersive journalism: Immersive virtual reality for the first-person experience of news. Presence 19, 4 (2010), 291–301.Google ScholarDigital Library
- Gordon Lee Gillespie, Sharon Farra, Saundra L. Regan, and Susan V. Brammer. 2021. Impact of immersive virtual reality simulations for changing knowledge, attitudes, and behaviors. Nurse Education Today 105 (Oct. 2021), 105025. https://www.sciencedirect.com/science/article/pii/S0260691721002823Google Scholar
- Quentin Guimard, Florent Robert, Camille Bauce, Aldric Ducreux, Lucile Sassatelli, Hui-Yin Wu, Marco Winckler, and Auriane Gros. 2022. PEM360: a dataset of 360° videos with continuous physiological measurements, subjective emotional ratings and motion traces. In Proceedings of the 13th ACM Multimedia Systems Conference. ACM, Athlone Ireland, 252–258. https://dl.acm.org/doi/10.1145/3524273.3532895Google ScholarDigital Library
- J B Hassell, E L Lamoureux, and J E Keeffe. 2006. Impact of age related macular degeneration on quality of life. Br J Ophthalmol 90, 5 (May 2006), 593–596. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1857044/Google ScholarCross Ref
- Kat Holmes. 2020. Mismatch: How inclusion shapes design. The MIT Press, Cambridge, MA.Google Scholar
- Pete R. Jones and Giovanni Ometto. 2018. Degraded Reality: Using VR/AR to simulate visual impairments. In 2018 IEEE Workshop on Augmented and Virtual Realities for Good (VAR4Good). IEEE, Reutlingen, Germany, 1–4. https://doi.org/10.1109/VAR4GOOD.2018.8576885Google ScholarCross Ref
- Pete R Jones, Tamás Somoskeöy, Hugo Chow-Wing-Bom, and David P Crabb. 2020. Seeing other perspectives: evaluating the use of virtual and augmented reality to simulate visual impairments (OpenVisSim). NPJ digital medicine 3, 1 (2020), 32.Google Scholar
- Justin Kasowski, Byron A. Johnson, Ryan Neydavood, Anvitha Akkaraju, and Michael Beyeler. 2023. A systematic review of extended reality (XR) for understanding and augmenting vision loss. Journal of Vision 23, 5 (May 2023), 5–5. https://jov.arvojournals.org/article.aspx?articleid=2785592 Publisher: The Association for Research in Vision and Ophthalmology.Google ScholarCross Ref
- Jo Lane, Emilie M. F. Rohan, Faran Sabeti, Rohan W. Essex, Ted Maddess, Amy Dawel, Rachel A. Robbins, Nick Barnes, Xuming He, and Elinor McKone. 2018. Impacts of impaired face perception on social interactions and quality of life in age-related macular degeneration: A qualitative study and new community resources. PLoS One 13, 12 (2018), e0209218.Google ScholarCross Ref
- P M Livingston, C A McCarty, and H R Taylor. 1998. Knowledge, attitudes, and self care practices associated with age related eye disease in Australia. British Journal of Ophthalmology 82, 7 (July 1998), 780–785. https://bjo.bmj.com/lookup/doi/10.1136/bjo.82.7.780Google ScholarCross Ref
- Andrew J. Logan, Gael E. Gordon, and Gunter Loffler. 2020. The Effect of Age-Related Macular Degeneration on Components of Face Perception. Invest Ophthalmol Vis Sci 61, 6 (June 2020), 38. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7415315/Google ScholarCross Ref
- Anne Macnamara, Celia Chen, Victor R. Schinazi, Dimitrios Saredakis, and Tobias Loetscher. 2021. Simulating Macular Degeneration to Investigate Activities of Daily Living: A Systematic Review. Front. Neurosci. 15 (Aug. 2021), 663062. https://www.frontiersin.org/articles/10.3389/fnins.2021.663062/fullGoogle ScholarCross Ref
- Dominique Makowski. 2016. Neurokit: A python toolbox for statistics and neurophysiological signal processing (eeg, eda, ecg, emg...). Memory and Cognition Lab’Day 1 (2016).Google Scholar
- Edmond Marc and Dominique Picard. 2002. Interaction. In Vocabulaire de psychosociologie. Érès, Toulouse, France, 189–196. https://www.cairn.info/vocabulaire-de-psychosociologie-2002–9782749206851-page-189.htm?ref=doiGoogle ScholarCross Ref
- Rahel Maué and Rahel Flechtner. 2022. “Hopohopo”: A Virtual Reality Awareness Application about Social Anxiety Disorder. In Proceedings of Mensch und Computer 2022(MuC ’22). Association for Computing Machinery, New York, NY, USA, 420–424. https://doi.org/10.1145/3543758.3547550Google ScholarDigital Library
- Albert Mehrabian and Morton Wiener. 1967. Decoding of inconsistent communications.Journal of personality and social psychology 6, 1 (1967), 109.Google Scholar
- Masahiro Mori, Karl F. MacDorman, and Norri Kageki. 2012. The Uncanny Valley [From the Field]. IEEE Robotics & Automation Magazine 19, 2 (June 2012), 98–100. Conference Name: IEEE Robotics & Automation Magazine.Google Scholar
- A. Nikolaou, A. Schwabe, and H. Boomgaarden. 2022. Changing social attitudes with virtual reality: a systematic review and meta-analysis. Annals of the International Communication Association 46, 1 (Jan. 2022), 30–61. https://doi.org/10.1080/23808985.2022.2064324 Publisher: Routledge _eprint: https://doi.org/10.1080/23808985.2022.2064324.Google ScholarCross Ref
- Florent Robert, Hui-Yin Wu, Lucile Sassatelli, Stephen Ramanoel, Auriane Gros, and Marco Winckler. 2023. An integrated framework for understanding multimodal embodied experiences in interactive virtual reality. In Proceedings of the 2023 ACM International Conference on Interactive Media Experiences (Nantes, France). ACM, New York, NY, USA, 14–26.Google ScholarDigital Library
- Dario D. Salvucci and Joseph H. Goldberg. 2000. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 Symposium on Eye Tracking Research & Applications (Palm Beach Gardens, Florida, USA) (ETRA ’00). Association for Computing Machinery, New York, NY, USA, 71–78. https://doi.org/10.1145/355017.355028Google ScholarDigital Library
- Dong-Hee Shin. 2017. The role of affordance in the experience of virtual reality learning: Technological and affective affordances in virtual reality. Telematics and Informatics 34, 8 (Dec. 2017), 1826–1836. https://www.sciencedirect.com/science/article/pii/S0736585317301223Google ScholarDigital Library
- Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (Dec. 2009), 3549–3557. https://royalsocietypublishing.org/doi/full/10.1098/rstb.2009.0138 Publisher: Royal Society.Google ScholarCross Ref
- Hyeonjin Soh. 2014. Measuring Consumer Empathic Response to Advertising Drama. The Journal of the Korea Contents Association 14, 11 (Nov. 2014), 133–142. http://koreascience.or.kr/journal/view.jsp?kj=CCTHCV&py=2014&vnc=v14n11&sp=133Google ScholarCross Ref
- Deanna J. Taylor, Laura A. Edwards, Alison M. Binns, and David P. Crabb. 2018. Seeing it differently: self-reported description of vision loss in dry age-related macular degeneration. Ophthalmic Physiol Opt 38, 1 (Jan. 2018), 98–105.Google ScholarCross Ref
- Wan Ling Wong, Xinyi Su, Xiang Li, Chui Ming G Cheung, Ronald Klein, Ching-Yu Cheng, and Tien Yin Wong. 2014. Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: a systematic review and meta-analysis. The Lancet Global Health 2, 2 (Feb. 2014), e106–e116. https://linkinghub.elsevier.com/retrieve/pii/S2214109X13701451Google ScholarCross Ref
- Haojie Wu, Daniel H Ashmead, Haley Adams, and Bobby Bodenheimer. 2018. Using virtual reality to assess the street crossing behavior of pedestrians with simulated macular degeneration at a roundabout. Frontiers in ICT 5 (2018), 27.Google ScholarCross Ref
- Hui-Yin Wu, Johanna Delachambre, Lucile Sassatelli, and Marco Winckler. 2021. Through the Eyes of Women in Engineering. In Texts of Discomfort. Carnegie Mellon University: ETC Press, Pittsburgh, Pennsylvania, 387. https://inria.hal.science/hal-03515116Google Scholar
- Tong Xue, Abdallah El Ali, Tianyi Zhang, Gangyi Ding, and Pablo Cesar. 2021. CEAP-360VR: A Continuous Physiological and Behavioral Emotion Annotation Dataset for 360° VR Videos. IEEE Transactions on Multimedia 25 (2021), 243–255. https://doi.org/10.1109/TMM.2021.3124080Google ScholarCross Ref
- Majid Zare-Bidaki, Alireza Ehteshampour, Masoud Reisaliakbarighomi, Robabeh Mazinani, Mohammad Reza Khodaie Ardakani, Arash Mirabzadeh, Rosa Alikhani, Mehdi Noroozi, Fereshteh Momeni, Amir Dehghani Samani, Mohammad Mahdi Mehrabi Tavana, Aliakbar Esmaeili, and S. Bentolhoda Mousavi. 2022. Evaluating the Effects of Experiencing Virtual Reality Simulation of Psychosis on Mental Illness Stigma, Empathy, and Knowledge in Medical Students. Front Psychiatry 13 (2022), 880331.Google ScholarCross Ref
Index Terms
- AMD Journee: A Patient Co-designed VR Experience to Raise Awareness Towards the Impact of AMD on Social Interactions
Recommendations
Re-Evaluating VR User Awareness Needs During Bystander Interactions
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsVirtual reality (VR) users are often around bystanders, i.e. people in the real world the VR user may want to interact with. To facilitate bystander-VR user interactions, technology-mediated awareness systems have been introduced to increase a user’s ...
Estimating VR Sickness and user experience using different HMD technologies: An evaluation study
AbstractThis paper presents results of a user study of the effects of virtual reality technology on VR Sickness and User Experience. In our study the participants watched two different panoramic (360) videos, one with relaxing content (beach ...
Highlights- Assessing VR Sickness discomfort levels using the SSQ and Questionnaire.
- User ...
Towards Balancing VR Immersion and Bystander Awareness
ISSHead-mounted displays (HMDs) increase immersion into virtual worlds. The problem is that this limits headset users' awareness of bystanders: headset users cannot attend to bystanders' presence and activities. We call this the HMD boundary. We explore how ...
Comments