Abstract
Game-based virtual reality systems have been shown to enhance motor function, motivation and therapy adherence in cerebral palsy (CP) children. In these systems, several types of virtual body representations have been implemented, however without conclusive support of guidelines nor the most appropriate choice for enhancing motor performance. Thus, the purpose of this study is to examine how the subjective experience of seeing and controlling a half-body avatar, or an abstract hand representation in a moderate immersion virtual environment (VE), for training upper limb movements may affect CP children’s motor performance. To achieve that purpose, a game-like VE for training the reaching-releasing of objects was designed. Unlike previous studies, relevant task performance and cost function metrics were obtained from the analysis of kinematic and kinetic parameters of movement. Results show that visualizing the hand movement through an abstract object makes children perform faster, correct less to produce smoother movements, and use less mechanical energy than visualizing the arm movement through a realistic Avatar. These effects were more noticeable in the reaching than in the releasing phase of the task. Based on these findings, some recommendations are provided for the effective design and use of VE’s for upper limb rehabilitation of CP children.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aboelnasr EA, Hegazy FA, Altalway HA (2017) Kinematic characteristics of reaching in children with hemiplegic cerebral palsy: a comparative study. Brain Injury 31(1):83–89. https://doi.org/10.1080/02699052.2016.1210230
Acosta AM, Dewald HA, Dewald JP (2011) Pilot study to test effectiveness of video game on reaching performance in stroke. J Rehabil Res Dev 48(4):431–44. https://doi.org/10.1682/jrrd.2010.04.0052
Adamovich SV, August K, Merians A, Tunik E (2009) A virtual reality-based system integrated with FMRI to study neural mechanisms of action observation-execution: a proof of concept study. Restor Neurol Neurosci 27(3):209–223. https://doi.org/10.3233/RNN-2009-0471
Adams RJ, Lichter MD, Ellington A, White M, Armstead K, Patrie JT, Diamond PT (2018) Virtual activities of daily living for recovery of upper extremity motor function. IEEE Trans Neural Syst Rehabil Eng 26(1):252–260. https://doi.org/10.1109/TNSRE.2017.2771272
Ajami S, Maghsodlorad AA (2015) National cerebral palsy minimum data set. J Res Med Sci 20(4):321–322
Argelaguet F, Hoyet L, Trico M, Lecuyer A (2016) The role of interaction in virtual embodiment: effects of the virtual hand representation. In: IEEE virtual reality (VR), pp 3–10. https://doi.org/10.1109/VR.2016.7504682
Bank PJM, Cidota MA, Ouwehand PEW, Lukosch SG (2018) Patient-tailored augmented reality games for assessing upper extremity motor impairments in Parkinson’s disease and stroke. J Med Syst 42(12):246–246. https://doi.org/10.1007/s10916-018-1100-9
Bartolo M, De Nunzio AM, Sebastiano F, Spicciato F, Tortola P, Nilsson J, Pierelli F (2014) Arm weight support training improves functional motor outcome and movement smoothness after stroke. Funct Neurol 29(1):15–21
Bergamasco M, Alessi AA, Arceri V, Calcara M, Caruso S, Conte PG, Hell L, Natalini A (1996) A tactile feedback system for VE applications. Virtual Real 2(1):129–139. https://doi.org/10.1007/BF02534446
Berret B, Darlot C, Jean F, Pozzo T, Papaxanthis C, Gauthier JP (2008) The inactivation principle: mathematical solutions minimizing the absolute work and biological implications for the planning of arm movements. PLoS Comput Biol 4(10):e1000194. https://doi.org/10.1371/journal.pcbi.1000194
Berret B, Chiovetto E, Nori F, Pozzo T (2011) Evidence for composite cost functions in arm movement planning: an inverse optimal control approach. PLoS Comput Biol 7(10):e1002183. https://doi.org/10.1371/journal.pcbi.1002183
Bianchi-Berthouze N (2013) Understanding the role of body movement in player engagement. Hum Comput Interact 28(1):40–75. https://doi.org/10.1080/07370024.2012.688468
Cabrera R, Molina A, Gómez I, García-Heras J (2017) Kinect as an access device for people with cerebral palsy: a preliminary study. Int J Hum Comput Stud 108:62–69. https://doi.org/10.1016/j.ijhcs.2017.07.004
Cameirao MS, Badia SB, Oller ED, Verschure PF (2010) Neurorehabilitation using the virtual reality based rehabilitation gaming system: methodology, design, psychometrics, usability and validation. J Neuroeng Rehabil 7:48. https://doi.org/10.1186/1743-0003-7-48
Camporesi C, Kallmann M (2016) The effects of avatars, stereo vision and display size on reaching and motion reproduction. IEEE Trans Vis Comput Graph 22(5):1592–604. https://doi.org/10.1109/tvcg.2015.2440231
Caserman P, Garcia-Agundez A, Konrad R, Göbel S, Steinmetz R (2019) Real-time body tracking in virtual reality using a vive tracker. Virtual Real 23(2):155–168. https://doi.org/10.1007/s10055-018-0374-z
Chen YP, Kang LJ, Chuang TY, Doong JL, Lee SJ, Tsai MW, Jeng SF, Sung WH (2007) Use of virtual reality to improve upper-extremity control in children with cerebral palsy: a single-subject design. Phys Ther 87(11):1441–1457. https://doi.org/10.2522/ptj.20060062
Collins KC, Kennedy NC, Clark A, Pomeroy VM (2018) Kinematic components of the reach-to-target movement after stroke for focused rehabilitation interventions: systematic review and meta-analysis. Front Neurol. https://doi.org/10.3389/fneur.2018.00472
Coluccini M, Maini ES, Martelloni C, Sgandurra G, Cioni G (2007) Kinematic characterization of functional reach to grasp in normal and in motor disabled children. Gait Posture 25(4):493–501
Cordeiro d’Ornellas M, Cargnin DJ, Cervi Prado AL (2015) Evaluating the impact of player experience in the design of a serious game for upper extremity stroke rehabilitation. Stud Health Technol Inform 216:363–7
Craig JJ (1989) Introduction to robotics : mechanics and control. Pearson Education, London
Crocetta TB, de Araújo LV, Guarnieri R, Massetti T, Ferreira FHIB, de Abreu LC, de Mello Monteiro CB (2018) Virtual reality software package for implementing motor learning and rehabilitation experiments. Virtual Real 22(3):199–209. https://doi.org/10.1007/s10055-017-0323-2
Day B, Ebrahimi E, Hartman LS, Pagano CC, Robb AC, Babu SV (2019) Examining the effects of altered avatars on perception–action in virtual reality. J Exp Psychol Appl 25(1):1–24. https://doi.org/10.1037/xap0000192
de los Reyes-Guzmán A, Dimbwadyo-Terrer I, Trincado-Alonso F, Monasterio-Huelin F, Torricelli D, Gil-Agudo A (2014) Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: a review. Clin Biomech 29(7):719–727. https://doi.org/10.1016/j.clinbiomech.2014.06.013
Eckert M, Gomez-Martinho I, Meneses J, Martinez JF (2017) New approaches to exciting exergame-experiences for people with motor function impairments. Sensors (Basel). https://doi.org/10.3390/s17020354
Escalona F, Martinez-Martin E, Cruz E, Cazorla M, Gomez-Donoso F (2019) Eva: evaluating at-home rehabilitation exercises using augmented reality and low-cost sensors. Virtual Real. https://doi.org/10.1007/s10055-019-00419-4
Farshchiansadegh A, Melendez-Calderon A, Ranganathan R, Murphey TD, Mussa-Ivaldi FA (2016) Sensory agreement guides kinetic energy optimization of arm movements during object manipulation. PLoS Comput Biol 12(4):e1004861. https://doi.org/10.1371/journal.pcbi.1004861
Ferreira dos Santos L, Christ O, Mate K, Schmidt H, Krüger J, Dohle C (2016) Movement visualisation in virtual reality rehabilitation of the lower limb: a systematic review. BioMed Eng OnLine 15(Suppl 3):144. https://doi.org/10.1186/s12938-016-0289-4
Formica D, Petrarca M, Rossi S, Zollo L, Guglielmelli E, Cappa P (2014) Shoulder motor performance assessment in the sagittal plane in children with hemiplegia during single joint pointing tasks. Biomed Eng Online 13:106. https://doi.org/10.1186/1475-925x-13-106
Garcia-Hernandez N, Corona-Cortes J, Garcia-Fuentes L, Gonzalez-Santibanez RD, Parra-Vega V (2019) Biomechanical and functional effects of shoulder kinesio taping((r)) on cerebral palsy children interacting with virtual objects. Comput Methods Biomech Biomed Eng. https://doi.org/10.1080/10255842.2019.1580361
Gerig N, Mayo J, Baur K, Wittmann F, Riener R, Wolf P (2018) Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements. PLoS ONE 13(1):e0189275–e0189275. https://doi.org/10.1371/journal.pone.0189275
Hanh N, Merienne F, Martinez JL (2009) Effects of virtual avatar characteristics on performance of healthy subjects’ training tasks. J Cyber Ther Rehabil 2:221–233
Hedel HJA, Häfliger N, Gerber CN (2016) Quantifying selective elbow movements during an exergame in children with neurological disorders: a pilot study. J Neuro Eng Rehabil 13(1):93
Heinrich C, Cook M, Langlotz T, Regenbrecht H (2020) My hands? importance of personalised virtual hands in a neurorehabilitation scenario. Virtual Real, pp 1–18
Hernoux F, Christmann O (2015) A seamless solution for 3d real-time interaction: design and evaluation. Virtual Real 19(1):1–20. https://doi.org/10.1007/s10055-014-0255-z
Hinton PR, McMurray I, Brownlow C (2004) SPSS explained. Taylor & Francis, New York
Hoffman HG, Hollander A, Schroder K, Rousseau S, Furness T (1998) Physically touching and tasting virtual objects enhances the realism of virtual experiences. Virtual Real 3(4):226–234. https://doi.org/10.1007/BF01408703
Hogan N, Sternad D (2009) Sensitivity of smoothness measures to movement duration, amplitude, and arrests. J Mot Behav 41(6):529–534. https://doi.org/10.3200/35-09-004-RC
Holden M (2005) Virtual environments for motor rehabilitation: review. Cyberpsychol Behav 8(3):187–211
Housman SJ, Scott KM, Reinkensmeyer DJ (2009) A randomized controlled trial of gravity-supported, computer-enhanced arm exercise for individuals with severe hemiparesis. Neurorehabil Neural Repair 23(5):505–14. https://doi.org/10.1177/1545968308331148
Inamura T, Unenaka S, Shibuya S, Ohki Y, Oouchida Y, Si Izumi (2017) Development of VR platform for cloud-based neurorehabilitation and its application to research on sense of agency and ownership. Adv Robot 31(1–2):97–106. https://doi.org/10.1080/01691864.2016.1264885
Kafri M, Myslinski MJ, Gade VK, Deutsch JE (2014) Energy expenditure and exercise intensity of interactive video gaming in individuals poststroke. Neurorehabil Neural Repair 28(1):56–65. https://doi.org/10.1177/1545968313497100
Kim H, Miller LM, Fedulow I, Simkins M, Abrams GM, Byl N, Rosen J (2013) Kinematic data analysis for post-stroke patients following bilateral versus unilateral rehabilitation with an upper limb wearable robotic system. IEEE Trans Neural Syst Rehabil Eng 21(2):153–64. https://doi.org/10.1109/tnsre.2012.2207462
Lacquaniti F, Soechting JF (1982) Coordination of arm and wrist motion during a reaching task. J Neurosci 2(4):399–408. https://doi.org/10.1523/JNEUROSCI.02-04-00399.1982
Lee S, Lee DK (2018) What is the proper way to apply the multiple comparison test? Korean J Anesthesiol 71(5):353–360
Levant A (1998) Robust exact differentiation via sliding mode technique. Automatica 34(3):379–384. https://doi.org/10.1016/S0005-1098(97)00209-4
Lopes S, Magalhães P, Pereira A, Martins J, Magalhães C, Chaleta E, Rosário P (2018) Games used with serious purposes: a systematic review of interventions in patients with cerebral palsy. Front Psychol. https://doi.org/10.3389/fpsyg.2018.01712
Ma S, Varley M, Shark LK, Richards J (2012) Overcoming the information overload problem in a multiform feedback-based virtual reality system for hand motion rehabilitation: Healthy subject case study. Virtual Real 16:325–334. https://doi.org/10.1007/s10055-012-0209-2
Mason AH, Grabowski PJ, Rutherford DN (2019) The role of visual feedback and age when grasping, transferring and passing objects in virtual environments. Int J Hum Comput Interact 35(19):1870–1881. https://doi.org/10.1080/10447318.2019.1574101
Michie S, Yardley L (2017) Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res 19(6):e232. https://doi.org/10.2196/jmir.7126
Mobini A, Behzadipour S, Saadat M (2015) Test–retest reliability of kinect’s measurements for the evaluation of upper body recovery of stroke patients. BioMed Eng OnLine 14(1):75. https://doi.org/10.1186/s12938-015-0070-0
Oguz OS, Zhou Z, Glasauer S, Wollherr D (2018) An inverse optimal control approach to explain human arm reaching control based on multiple internal models. Sci Rep 8(1):5583. https://doi.org/10.1038/s41598-018-23792-7
Özkaya N, Goldsheyder D, Margareta N, Leger D (2016) Fundamentals of biomechanics: equilibrium, motion, and deformation. Springer, Berlin
Perez-Marcos D (2018) Virtual reality experiences, embodiment, videogames and their dimensions in neurorehabilitation. J NeuroEng Rehabil 15(1):113. https://doi.org/10.1186/s12984-018-0461-0
Qiu Q, Ramirez DA, Saleh S, Fluet GG, Parikh HD, Kelly D, Adamovich SV (2009) The new jersey institute of technology robot-assisted virtual rehabilitation (NJIT-RAVR) system for children with cerebral palsy: a feasibility study. J Neuroeng Rehabil 6:40. https://doi.org/10.1186/1743-0003-6-40
Reid D (2004) The influence of virtual reality on playfulness in children with cerebral palsy: a pilot study. Occup Ther Int 11(3):131–44. https://doi.org/10.1002/oti.202
Ren Z, Wu J (2019) The effect of virtual reality games on the gross motor skills of children with cerebral palsy: a meta-analysis of randomized controlled trials. Int J Environ Res Public Health. https://doi.org/10.3390/ijerph16203885
Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, Stein J, Hogan N (2002) Movement smoothness changes during stroke recovery. J Neurosci 22(18):8297–304
Saavedra S, Joshi A, Woollacott M, van Donkelaar P (2009) Eye hand coordination in children with cerebral palsy. Exp Brain Res 192(2):155–165. https://doi.org/10.1007/s00221-008-1549-8
Samaraweera G, Guo R, Quarles J (2013) Latency and avatars in virtual environments and the effects on gait for persons with mobility impairments. In: IEEE symposium on 3D user interfaces (3DUI), pp 23–30. https://doi.org/10.1109/3DUI.2013.6550192
Sandlund M, Waterworth EL, Hager C (2011) Using motion interactive games to promote physical activity and enhance motor performance in children with cerebral palsy. Dev Neurorehabil 14(1):15–21. https://doi.org/10.3109/17518423.2010.533329
Santos LFd, Schmidt H, Krüger J, Dohle C (2013) Visualization of virtual reality neurological motor rehabilitation of the upper limb: a systematic review. In: 2013 international conference on virtual rehabilitation (ICVR), pp 176–177. https://doi.org/10.1109/ICVR.2013.6662113
Schafer AY, Ustinova KI (2013) Does use of a virtual environment change reaching while standing in patients with traumatic brain injury? J Neuroeng Rehabil 10:76. https://doi.org/10.1186/1743-0003-10-76
Sha D, France CR, Thomas JS (2010) Mechanical energy expenditures and movement efficiency in full body reaching movements. J Appl Biomech 26(1):32–44
Singer MJ (1998) Effect of a body model on performance in a virtual environment search task. Army Research Institute for the Behavioral and Social Sciences, Report, U.S
Snider L, Majnemer A, Darsaklis V (2010) Virtual reality as a therapeutic modality for children with cerebral palsy. Dev Neurorehabil 13(2):120–8. https://doi.org/10.3109/17518420903357753
Spong MW, Hutchinson S, Vidyasagar M (2006) Robot modeling and control. Wiley, New York
Subramanian SK, Lourenco CB, Chilingaryan G, Sveistrup H, Levin MF (2013) Arm motor recovery using a virtual reality intervention in chronic stroke: randomized control trial. Neurorehabil Neural Repair 27(1):13–23. https://doi.org/10.1177/1545968312449695
Syed UE, Kamal A (2019) Video game-based and conventional therapies in patients of neurological deficits: an experimental study. Disabil Rehabil Assist Technol. https://doi.org/10.1080/17483107.2019.1679266
Tinderholt Myrhaug H, Øtensjø S, Larun L, Odgaard-Jensen J, Jahnsen R (2014) Intensive training of motor function and functional skills among young children with cerebral palsy: a systematic review and meta-analysis. BMC Pediatr 14(1):292. https://doi.org/10.1186/s12887-014-0292-5
Tyrrell R, Sarig-Bahat H, Williams K, Williams G, Treleaven J (2018) Simulator sickness in patients with neck pain and vestibular pathology during virtual reality tasks. Virtual Real 22(3):211–219. https://doi.org/10.1007/s10055-017-0324-1
Vandenberghe A, Levin O, De Schutter J, Swinnen S, Jonkers I (2010) Three-dimensional reaching tasks: effect of reaching height and width on upper limb kinematics and muscle activity. Gait Posture 32(4):500–7. https://doi.org/10.1016/j.gaitpost.2010.07.009
Viau A, Feldman AG, McFadyen BJ, Levin MF (2004) Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil 1(1):11–11. https://doi.org/10.1186/1743-0003-1-11
Wade DT (2009) Goal setting in rehabilitation: an overview of what, why and how. Clin Rehabil 23(4):291–295. https://doi.org/10.1177/0269215509103551
Wilson PH, Thomas P, Shum D, Duckworth J, Gugliemetti M, Rudolph H, Mumford N, Eldridge R (2006) A multilevel model for movement rehabilitation in traumatic brain injury (TBI) using virtual environments. In: International workshop on virtual rehabilitation, pp 47–52. https://doi.org/10.1109/IWVR.2006.1707526
Winter DA (2005) Biomechanics and motor control of human movement. Wiley, Hoboken
Yildirim C (2019) Don’t make me sick: investigating the incidence of cybersickness in commercial virtual reality headsets. Virtual Real. https://doi.org/10.1007/s10055-019-00401-0
Yoon G, Vargas P (2016) I see myself through my avatar: evidence from east Asia and north America for acculturated effects on virtual representation preference. Asiascape Digit Asia 3:79–96. https://doi.org/10.1163/22142312-12340049
Zhang JJQ, Fong KNK, Welage N, Liu KPY (2018) The activation of the mirror neuron system during action observation and action execution with mirror visual feedback in stroke: a systematic review. Neural Plast 2018:2321045. https://doi.org/10.1155/2018/2321045
Zoccolillo L, Morelli D, Cincotti F, Muzzioli L, Gobbetti T, Paolucci S, Iosa M (2015) Video-game based therapy performed by children with cerebral palsy: a cross-over randomized controlled trial and a cross-sectional quantitative measure of physical activity. Eur J Phys Rehabil Med 51(6):669–76
Acknowledgements
We would like to thank Children’s Rehabilitation Institute of Teleton (CRIT) in Saltillo, Mexico for supporting this research.
Funding
Funding for this work comes from Grant 3309 and Graduate Scholarship 592022, both from the Mexican National Council of Science and Technology (CONACYT) Research Funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Garcia-Hernandez, N., Guzman-Alvarado, M. & Parra-Vega, V. Virtual body representation for rehabilitation influences on motor performance of cerebral palsy children. Virtual Reality 25, 669–680 (2021). https://doi.org/10.1007/s10055-020-00481-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-020-00481-3