ABSTRACT
Due to the current pandemic, the elderly in care homes are greatly affected by the lack of contact with their families, resulting in various mental conditions (e.g., depression, feelings of loneliness) and deterioration of mental health for dementia patients. In response, residents and family members increasingly resorted to mediated communication to maintain social contact. To facilitate high-quality mediated social contact between residents in nursing homes and remote family members, we developed an Augmented Reality (AR)-based communication tool. The proposed demonstrator improved this situation by providing a working communication tool that enables the elderly to feel being together with their family by means of AR techniques. A complete end-to-end-chain architecture is defined, where the aspects of capture, transmission, and rendering are thoroughly investigated to fit the purpose of the use case. Based on an extensive user study comprising user experience (UX) and quality of service (QoS) measurements, each module is presented with the improvements made and the resulting higher quality AR communication platform.
Supplemental Material
Available for Download
Teaser, modules, video
- R. Furukawa and M. Driessnack. 2013. Video-mediated communication to support distant family connectedness. Clin Nurs Res 22, 1 (2013), 82–94. https://doi.org/10.1177/1054773812446150Google ScholarCross Ref
- S.N.B Gunkel, Stokking H., T. De Koninck, and OA Niamut. 2019. Everyday Photo-Realistic Social VR: Communicate and Collaborate with an Enhanced Co-Presence and Immersion. In Technical Papers International Broadcasting Convention (IBC).Google Scholar
- Microsoft. 2021. Introducing Microsoft Mesh. Retrieved March, 2021 from https://www.microsoft.com/en-us/meshGoogle Scholar
- M. Mori, K. F. MacDorman, and N. Kageki. 2012. The Uncanny Valley [From the Field]. IEEE Robotics Automation Magazine 19, 2 (2012), 98–100. https://doi.org/10.1109/MRA.2012.2192811Google ScholarCross Ref
- Robby Nadler. 2020. Understanding “Zoom fatigue”: Theorizing spatial dynamics as third skins in computer-mediated communication. Computers and Composition 58 (2020), 102613. https://doi.org/10.1016/j.compcom.2020.102613Google ScholarCross Ref
- Spatial. 2018. Spatial: Collaborate from Anywhere in AR. Retrieved 2018 from https://spatial.io/Google Scholar
- Sonam Zamir, Catherine Hagan Hennessy, Adrian H. Taylor, and Ray B. Jones. 2018. Video-calls to reduce loneliness and social isolation within care environments for older people: an implementation study using collaborative action research. BMC Geriatrics 18, 1 (2018), 62. https://doi.org/10.1186/s12877-018-0746-yGoogle ScholarCross Ref
Recommendations
Augmented Reality-Based Remote Family Visits in Nursing Homes
IMX '21: Proceedings of the 2021 ACM International Conference on Interactive Media ExperiencesDuring the COVID-19 pandemic, many nursing homes had to restrict visitations. This had a major negative impact on the wellbeing of residents and their family members. In response, residents and family members increasingly resorted to mediated ...
VRComm: an end-to-end web system for real-time photorealistic social VR communication
MMSys '21: Proceedings of the 12th ACM Multimedia Systems ConferenceTools and platforms that enable remote communication and collaboration provide a strong contribution to societal challenges. Virtual meetings and conferencing, in particular, can help to reduce commutes and lower our ecological footprint, and can ...
Building and Employing Cross-Reality
This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...
Comments