Taeyeon Kim
Woontack Woo
ABSTRACT
Assessing a patient’s social and environmental factors is crucial in medical treatment due to their impact on overall quality of life and treatment outcomes. However, current industrial solutions and research on augmented reality and virtual reality telehealth have primarily focused on training or physician collaboration, thereby overlooking the importance of assessing patients’ non-medical factors in the consulting environment. To address this issue, we propose a holistic patient assessment system in an extended reality (XR) teleconsultation environment, based on clinical evidence from the literature. By utilizing the digital twin (DT) of the patient’s environment and a physical examination assistance tool, healthcare professionals can effectively assess non-medical factors and enhance diagnosis accuracy. Through evaluations by current healthcare professionals, our system has been medically validated for its adequate integration of crucial factors in medicine and potential for real-world deployment. We believe that our system could envision a new line of research in future XR telehealth, particularly in the context of patient-centered and inclusive care.
- Leslie B Altimier. 2004. Healing environments: for patients and providers. Newborn and Infant Nursing Reviews 4, 2 (2004), 89–92.Google Scholar
Cross Ref
- Augmedix. 2024. Home. https://augmedix.com/ Accessed on 2024-02-18.Google Scholar
- Nilufar Baghaei, Lehan Stemmet, Imran Khaliq, Atefeh Ahmadi, Ilona Halim, Hai-Ning Liang, Wenge Xu, Mark Billinghurst, and Richard Porter. 2021. Designing individualised virtual reality applications for supporting depression: A feasibility study. In Companion of the 2021 ACM SIGCHI symposium on engineering interactive computing systems. 6–11.Google ScholarDigital Library
- Nazleen Bharmal, Kathryn Pitkin Derose, Melissa Felician, and Margaret M Weden. 2015. Understanding the upstream social determinants of health. California: RAND (2015), 1–18.Google Scholar
- Paula Braveman, Susan Egerter, and David R Williams. 2011. The social determinants of health: coming of age. Annual review of public health 32 (2011), 381–398.Google Scholar
- Cassandra Siyun Chen, Sally Wai-Chi Chan, Moon Fai Chan, Suk Foon Yap, Wenru Wang, and Yanika Kowitlawakul. 2017. Nurses’ perceptions of psychosocial care and barriers to its provision: A qualitative study. Journal of nursing research 25, 6 (2017), 411–418.Google ScholarCross Ref
- Isabel De La Torre-Díez, Miguel López-Coronado, Cesar Vaca, Jesús Saez Aguado, and Carlos de Castro. 2015. Cost-utility and cost-effectiveness studies of telemedicine, electronic, and mobile health systems in the literature: a systematic review. Telemedicine and e-Health 21, 2 (2015), 81–85.Google ScholarCross Ref
- Vito Del Vecchio, Mariangela Lazoi, and Marianna Lezzi. 2023. Digital Twin and Extended Reality in Industrial Contexts: A Bibliometric Review. In International Conference on Extended Reality. Springer, 269–283.Google Scholar
- Susana Dinis, Emília Duarte, Paulo Noriega, Luís Teixeira, Elisângela Vilar, and Francisco Rebelo. 2013. Evaluating emotional responses to the interior design of a hospital room: A study using virtual reality. In Design, User Experience, and Usability. User Experience in Novel Technological Environments: Second International Conference, DUXU 2013, Held as Part of HCI International 2013, Las Vegas, NV, USA, July 21-26, 2013, Proceedings, Part III 2. Springer, 475–483.Google ScholarCross Ref
- E Ray Dorsey, Meredith A Achey, Christopher A Beck, Denise B Beran, Kevin M Biglan, Cynthia M Boyd, Peter N Schmidt, Richard Simone, Allison W Willis, Nicholas B Galifianakis, 2016. National randomized controlled trial of virtual house calls for people with Parkinson’s disease: interest and barriers. Telemedicine and e-Health 22, 7 (2016), 590–598.Google ScholarCross Ref
- Christian Fikar and Patrick Hirsch. 2017. Home health care routing and scheduling: A review. Computers & Operations Research 77 (2017), 86–95.Google ScholarDigital Library
- Shilpa N Gajarawala and Jessica N Pelkowski. 2021. Telehealth benefits and barriers. The Journal for Nurse Practitioners 17, 2 (2021), 218–221.Google ScholarCross Ref
- Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, 2021. ARTEMIS: A collaborative mixed-reality system for immersive surgical telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
- James S Gordon. 1982. Holistic medicine: advances and shortcomings. Western Journal of Medicine 136, 6 (1982), 546.Google Scholar
- Raz Gross, Yehuda Sasson, and Joseph Zohar. 1998. Healing environment in psychiatric hospital design. General hospital psychiatry 20, 2 (1998), 108–114.Google Scholar
- Tobias Grundgeiger, Alea Münz, Paul Schlosser, and Oliver Happel. 2023. Supervising Multiple Operating Rooms Using a Head-Worn display: A Longitudinal Evaluation of the Experience of Supervising Anesthesiologists and Their Co-Workers. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.Google ScholarDigital Library
- Aslı Günay. 2017. Conceptualization of positive pregnancy experience with the integration of mobile health technologies. (2017).Google Scholar
- Bradley D Hunter, Brad Neiger, and Joshua West. 2011. The importance of addressing social determinants of health at the local level: the case for social capital. Health & social care in the community 19, 5 (2011), 522–530.Google Scholar
- Md Serajul Islam. 2018. Treat patient, not just the disease: holistic needs assessment for haematological cancer patients. Oncology reviews 12, 2 (2018).Google Scholar
- Timothy Onosahwo Iyendo, Patrick Chukwuemeke Uwajeh, and Ezennia Stephen Ikenna. 2016. The therapeutic impacts of environmental design interventions on wellness in clinical settings: a narrative review. Complementary therapies in clinical practice 24 (2016), 174–188.Google Scholar
- Simon Kimmel, Vanessa Cobus, and Wilko Heuten. 2021. opticARe-Augmented Reality Mobile Patient Monitoring in Intensive Care Units. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. 1–11.Google ScholarDigital Library
- Tara Kiran and Andrew D Pinto. 2016. Swimming ‘upstream’to tackle the social determinants of health., 138–140 pages.Google Scholar
- Clemens Scott Kruse, Nicole Krowski, Blanca Rodriguez, Lan Tran, Jackeline Vela, and Matthew Brooks. 2017. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ open 7, 8 (2017), e016242.Google Scholar
- Steven A Lavender, Carolyn M Sommerich, Elizabeth B-N Sanders, Kevin D Evans, Jing Li, Radin Zaid Radin Umar, and Emily S Patterson. 2020. Developing evidence-based design guidelines for medical/surgical hospital patient rooms that meet the needs of staff, patients, and visitors. HERD: Health Environments Research & Design Journal 13, 1 (2020), 145–178.Google ScholarCross Ref
- Jie Li, Guo Chen, Huib De Ridder, and Pablo Cesar. 2020. Designing a social vr clinic for medical consultations. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1–9.Google Scholar
- Sophie Maria, Helena M Mentis, Geoffroy Canlorbe, and Ignacio Avellino. 2023. Supporting Collaborative Discussions In Surgical Teleconsulting Through Augmented Reality Head Mounted Displays. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Patti A Mataxen and L Denise Webb. 2019. Telehealth nursing: More than just a phone call. Nursing2022 49, 4 (2019), 11–13.Google Scholar
- Nicola Mead and Peter Bower. 2000. Patient-centredness: a conceptual framework and review of the empirical literature. Social science & medicine 51, 7 (2000), 1087–1110.Google Scholar
- Medical Xpress. 2020. The hand-made tale of an Indian amputee and his limbs. https://medicalxpress.com/news/2020-03-hand-made-tale-indian-amputee-limbs.html Accessed on 2024-01-02.Google Scholar
- Ian James Mills. 2017. A person-centred approach to holistic assessment. Primary dental journal 6, 3 (2017), 18–23.Google Scholar
- Jennifer J Moffatt and Diann S Eley. 2010. The reported benefits of telehealth for rural Australians. Australian Health Review 34, 3 (2010), 276–281.Google ScholarCross Ref
- Hyeongil Nam, Chanhee Kim, Kangsoo Kim, Ji-Young Yeo, and Jong-Il Park. 2022. An Emotionally Responsive Virtual Parent for Pediatric Nursing Education: A Framework for Multimodal Momentary and Accumulated Interventions. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 365–374.Google Scholar
- World Health Organization 2010. A conceptual framework for action on the social determinants of health. (2010).Google Scholar
- World Health Organization 2010. Telemedicine: opportunities and developments in member states. Report on the second global survey on eHealth.World Health Organization.Google Scholar
- Pamela J Potter and Noreen Frisch. 2007. Holistic assessment and care: presence in the process. Nursing Clinics of North America 42, 2 (2007), 213–228.Google ScholarCross Ref
- Vickie Ragsdale and Graham J McDougall Jr. 2008. The changing face of long-term care: looking at the past decade. Issues in Mental Health Nursing 29, 9 (2008), 992–1001.Google ScholarCross Ref
- Ready Player Me. 2023. Ready Player Me - Virtual Reality Avatars. https://readyplayer.me/ Accessed on 2023-12-14.Google Scholar
- Haya R Rubin. 1998. Status report–an investigation to determine whether the built environment affects patients’ medical outcomes.. In Journal of healthcare design: proceedings from the... Symposium on Healthcare Design. Symposium on Healthcare Design, Vol. 10. National Symposium on Healthcare Design, Inc., 11–13.Google Scholar
- Parisa Sabetsarvestani, Fateme Mohammadi, Banafsheh Tehranineshat, Mostafa Bijani, and Zhila Fereidouni. 2022. Barriers to efficient management of in-home care: A qualitative content analysis. Nursing Open 9, 2 (2022), 1200–1209.Google ScholarCross Ref
- Yasir Saleem, Anshuman Darbari, Rahul Sharma, Amit Vashisth, and Anish Gupta. 2022. Recent advancements in pediatric cardiopulmonary bypass technology for better outcomes of pediatric cardiac surgery. The Cardiothoracic Surgeon 30, 1 (2022), 1–10.Google ScholarCross Ref
- Danny Schott, Matthias Kunz, Tom Wunderling, Florian Heinrich, Rüdiger Braun-Dullaeus, and Christian Hansen. 2023. CardioGenesis4D: Interactive Morphological Transitions of Embryonic Heart Development in a Virtual Learning Environment. IEEE Transactions on Visualization and Computer Graphics 29, 5 (2023), 2615–2625.Google ScholarDigital Library
- Qilei Sun, Jiayou Huang, Haodong Zhang, Paul Craig, Lingyun Yu, and Eng Gee Lim. 2023. Design and Development of a Mixed Reality Acupuncture Training System. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 265–275.Google ScholarCross Ref
- Roger S Ulrich. 1984. View through a window may influence recovery from surgery. science 224, 4647 (1984), 420–421.Google Scholar
- Unity Asset Store. 2023. Male Human Body Anatomy Systems. https://assetstore.unity.com/packages/3d/characters/male-human-body-anatomy-systems-186588 Accessed on 2023-12-14.Google Scholar
- Unity Technologies. 2024. Unity. https://unity.com/kr Accessed on 2024-01-02.Google Scholar
- U.S. Department of Health and Human Services. 2024. Social Determinants of Health. https://health.gov/healthypeople/priority-areas/social-determinants-health Accessed on 2024-02-16.Google Scholar
- Yao-Chin Wang, Bilegjin Ganzorig, Chieh-Chen Wu, Usman Iqbal, Hafsah Arshed Ali Khan, Wan-Shan Hsieh, Wen-Shan Jian, and Yu-Chuan Jack Li. 2018. Patient satisfaction with dermatology teleconsultation by using MedX. Computer Methods and Programs in Biomedicine 167 (2018), 37–42.Google ScholarDigital Library
- David R Williams, Manuela V Costa, Adebola O Odunlami, and Selina A Mohammed. 2008. Moving upstream: how interventions that address the social determinants of health can improve health and reduce disparities. Journal of public health management and practice: JPHMP 14, Suppl (2008), S8.Google ScholarCross Ref
- World Health Organization. 2023. Tenth Global Conference on Health Promotion. https://www.who.int/teams/health-promotion/enhanced-wellbeing/tenth-global-conference-on-health-promotion Accessed on 2023-12-12.Google Scholar
- World Health Organization. 2024. Health Equity. https://www.who.int/health-topics/health-equity#tab=tab_1 Accessed on 2024-01-02.Google Scholar
- XRHealth. 2023. Home. https://www.xr.health/ Accessed on 2024-02-18.Google Scholar
- Kevin Yu, Ulrich Eck, Frieder Pankratz, Marc Lazarovici, Dirk Wilhelm, and Nassir Navab. 2022. Duplicated reality for co-located augmented reality collaboration. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 2190–2200.Google ScholarCross Ref
- Kevin Yu, Daniel Roth, Robin Strak, Frieder Pankratz, Julia Reichling, Clemens Kraetsch, Simon Weidert, Marc Lazarovici, Nassir Navab, and Ulrich Eck. 2023. Mixed Reality 3D Teleconsultation for Emergency Decompressive Craniotomy: An Evaluation with Medical Residents. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 662–671.Google ScholarCross Ref
- Zoom Video Communications. 2023. Zoom. https://www.zoom.us Accessed on 2023-12-12.Google Scholar
Index Terms
- Holistic Patient Assessment System using Digital Twin for XR Medical Teleconsultation
Recommendations
Designing Patient-Centered Personal Health Records (PHRs): Health Care Professionals' Perspective on Patient-Generated Data
Currently, patients not only want access to various medical records their health care providers keep about them, but they also are willing to become active participants in managing their own health information and the health information of the ones they ...
Challenges When Engaging Diabetic Patients and Their Clinicians in Using E-Health Technologies to Improve Clinical Outcomes
Proceedings of the 8th International Conference on Universal Access in Human-Computer Interaction. Aging and Assistive Environments - Volume 8515Diabetes mellitus DM is a chronic disease affecting more than 285 people worldwide and the fourth leading cause of death. Increasing evidence suggests that many DM patients have poor adherence with prescribed medication therapies, impacting clinical ...
Perioperative Smartphone Apps and Devices for Patient-Centered Care
Smartphones have grown in ubiquity and computing power, and they play an ever-increasing role in patient-centered health care. The "medicalized smartphone" not only enables web-based access to patient health resources, but also can run patient-oriented ...
Comments