Abstract
Immersive systems can be used to capture new data, create new experiences, and provide new insights by generating virtual elements of physical and imagined worlds. Immersive systems are seeing increased application across a broad array of fields. However, in many situations it is unknown if an immersive application performs as well or better than the existing application in accomplishing a specific task. The purpose of this study is to conduct a systematic review of the literature that addresses the performance of immersive systems. This review assesses those applications where experiments, tests, or clinical trials have been performed to evaluate the proposed application. This research addresses a broad range of application areas and considers studies that compared one or more immersive systems with a control group or evaluated performance data for the immersive system pre- and post-test. The results identify those applications that have been successfully tested and also delineate areas of future research where more data may be needed to assess the effectiveness of proposed applications.


Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Availability of data and material
Results of systematic literature search are available.
Code availability
Code used for literature search included as “Appendix.”
References
Abdullah M, Shaikh ZA (2018) An effective virtual reality based remedy for acrophobia. Int J Adv Comput Sci Appl 9(6):162–167
Anstadt S, Bradley S, Burnett A (2013) Virtual worlds: relationship between real life and experience in second life. Int Rev Res Open Distance Learn 14(4):160–190
Azuma R (1997) A survey of augmented reality. Presence: Teleoper Virtual Environ 6(4):355–385
Azuma R, Baillot Y, Behringer R, Feiner S, Julier S, Macintyre B (2001) Recent advances in augmented reality. IEEE Comput Graphics Appl 21:34–47
Blum J, Rockstroh C, Göritz AS (2019) Heart rate variability biofeedback based on slow-paced breathing with immersive virtual reality nature scenery. Front Psychol 10:2172
Boas Y (2013) Overview of virtual reality technologies. School of Electronics and Computer Science, University of Southampton, Southampton, UK. http://static1.squarespace.com/static/537bd8c9e4b0c89881877356/t/5383bc16e4b0bc0d91a758a6/1401142294892/yavb1g12_25879847_finalpaper.pdf. Accessed 1 Aug 2020
Boell S, Cecez-Kecmanovic D (2015) On being ‘systematic’ in literature reviews in IS. J Inf Technol 30(2):161–173
Bogicevica V, Seob S, Kandampullyc J, Liuc S, Rudd N (2019) Virtual reality presence as a preamble of tourism experience: the role of mental imagery. Tour Manag 74:55–64
Bordnick PS, Traylor AC, Carter BL, Graap KM (2012) A feasibility study of virtual reality-based coping skills training for nicotine dependence. Res Soc Work Pract 22(3):293–300
Borsci S, Lawson G, Jha B, Burges M, Salanitri D (2016) Effectiveness of a multidevice 3D virtual environment application to train car service maintenance procedures. Virtual Real 20(1):41–55
Bouzit M, Popescu G, Burdea G, Boian R (2002) The Rutgers master II-ND force feedback glove. In: Proceedings of IEEE VR 2002 haptics symposium, Orlando FL, March, pp 256–263
Bowman D, McMahan R (2007) Virtual reality: how much immersion is enough? Computer 40:36–43
Bramley I, Goode A, Anderson L, Mary E (2018) Researching in-store, at home: using virtual reality within quantitative surveys. Int J Mark Res 60(4):344–351
Cardoş RA, David OA, David DO (2017) Virtual reality exposure therapy in flight anxiety: a quantitative meta-analysis. Comput Hum Behav 72:371–380
Carlson P, Peters A, Gilbert SB, Vance JM, Luse A (2015) Virtual training: learning transfer of assembly tasks. IEEE Trans Visual Comput Gr 21(6):770–782
Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M (2011) Augmented reality technologies, systems and applications. Multimedia Tools Appl 51(1):341–377
Carù A, Cova B (2006) Expériences de marque: comment favoriser l’immersion du consommateur? Décis Mark 41:43–52
Choi S, Cheung H (2008) A versatile virtual prototyping system for rapid product development. Comput Ind 59(5):477–488
Corbetta D, Imeri F, Gatti R (2015) Rehabilitation that incorporates virtual reality is more effective than standard rehabilitation for improving walking speed, balance and mobility after stroke: a systematic review. J Physiother 61(3):117–124
Cruz-Neira C, Sandlikn D, DeFanti T, Kenyon R, Hart J (1992) The CAVE: audio visual experience automatic virtual environment. Commun ACM 35(6):65–72
Cummings J, Bailenson J (2016) How immersive is Enough? A meta-analysis of the effects of immersive technology on user preference. Media Psychol 19:272–309
CyberGlove Systems (2020) CyberGrasp. http://www.cyberglovesystems.com/cybergrasp. Accessed 11 Nov 2020
Czub M, Piskorz J (2018) Body movement reduces pain intensity in virtual reality–based analgesia. Int J Hum-Comput Interact 34(11):1045–1051
de Rooij IJ, van de Port IG, Meijer JWG (2016) Effect of virtual reality training on balance and gait ability in patients with stroke: systematic review and meta-analysis. Phys Ther 96(12):1905–1918
Dobrowolski P, Pochwatko G, Skorko M, Bielecki M (2014) The effects of virtual experience on attitudes toward real brands. Cyberpsychol Behav Soc Netw 17(2):125–128
Dunn J (2017) A visual history of Nintendo’s video game consoles. http://www.businessinsider.com/nintendo-consoles-in-history-photos-switch-2017-1/#before-there-was-the-nes-there-was-the-color-tv-game-nintendo-first-dipped-its-toes-into-console-gaming-by-launching-five-of-these-rectangles-between-1977-and-1980-all-in-its-native-japan-1. Accessed 1 Aug 2020
Ferrer-Garcia M, Pla-Sanjuanelo J, Dakanalis A, Vilalta-Abella F, Riva G, Fernandez-Aranda F, Ribas-Sabaté J (2019) A randomized trial of virtual reality-based cue exposure second-level therapy and cognitive behavior second-level therapy for bulimia nervosa and binge-eating disorder: outcome at six-month follow up. Cyberpsychol Behav Soc Netw 22(1):60–68
Fink A (2005) Conducting research literature reviews: From the Internet to paper. Sage Publications, Thousand Oaks
Flavián C, Ibáñez-Sánchez S, Orús C (2019) Integrating virtual reality devices into the body: effects of technological embodiment on customer engagement and behavioral intentions toward the destination. J Travel Tour Mark 36(7):12. https://doi.org/10.1080/10548408.2019.1618781
Fodor L, Coteț C, Cuijpers P, Szamoskozi Ș, David D, Cristea I (2018) The effectiveness of virtual reality based interventions for symptoms of anxiety and depression: a meta-analysis. Sci Rep 8(1):10323. https://doi.org/10.1038/s41598-018-28113-6
Gerçeker G, Binay Ş, Bilsin E, Kahraman A, Yılmaz H (2018) Effects of virtual reality and external cold and vibration on pain in 7-to 12-year-old children during phlebotomy: a randomized controlled trial. J PeriAnesthesia Nurs 33(6):981–989
Gleasure R, Feller J (2015) A rift in the ground: theorizing the evolution of anchor values in crowdfunding communities through the oculus rift case study. J Assoc Comput Syst 17(1):708–736
Glennon C, McElroy S, Connelly L, Lawson L, Bretches A, Gard A, Newcomer L (2018) Use of virtual reality to distract from pain and anxiety. Oncol Nurs Forum 45(4):545–552. https://doi.org/10.1188/18.ONF.545-552
Glueck A, Han D (2020) Improvement potentials in balance and visuo-motor reaction time after mixed reality action game play: a pilot study. Virt Real 24(2):223–229. https://doi.org/10.1007/s10055-019-00392-y
Gonzalez-Franco M, Pizarro R, Cermeron J, Li K, Thorn J, Hutabarat W, Bermell-Garcia P (2017) Immersive mixed reality for manufacturing training. Frontiers in Robotics and AI, 4. http://journal.frontiersin.org/article/10.3389/frobt.2017.00003/full. Accessed 1 Aug 2020
Gordon NS, Merchant J, Zanbaka C, Hodges LF, Goolkasian P (2011) Interactive gaming reduces experimental pain with or without a head mounted display. Comput Hum Behav 27(6):2123–2128
Gumaa M, Rehan Youssef A (2019) Is virtual reality effective in orthopedic rehabilitation? A systematic review and meta-analysis. Phys Ther 99(10):1304–1325
Guo C, Deng H, Yang J (2015) Effect of virtual reality distraction on pain among patients with hand injury undergoing dressing change. J Clin Nurs 24(1–2):115–120
Huang TL (2019) Psychological mechanisms of brand love and information technology identity in virtual retail environments. J Retail Consum Serv 47:251–264
Igna R, Stefan S, Onac I, Ungur RA, Tatar AS (2014) Mindfulness-based cognitive-behavior therapy (MCBT) versus virtual reality (VR) enhanced CBT, versus treatment as usual for chronic back pain. A clinical trial. J Evid-Based Psychother 14(2):229
igroup.org (2016) igroup presence questionnaire (IPQ) overview. http://www.igroup.org/pq/ipq/index.php Accessed 1 Aug 2020
Israel K, Zerres C, Tscheulin DK (2019) Presenting hotels in virtual reality: does it influence the booking intention? J Hosp Tour Technol 10(3):473–493
Javornik A (2016) Augmented reality: research agenda for studying the impact of its media characteristics on consumer behavior. J Retail Consumer Serv 30:252–261
Jennett C, Cox A, Cairns P, Dhoparee S, Epps A, Tijs T, Walton A (2008) Measuring and defining the experience of immersion in games. Int J Hum Comput Stud 66(9):641–661
Jo D, Kim GJ (2019) IoT + AR: pervasive and augmented environments for “digi-log” shopping experience. Hum-Centric Comput Inf Sci. https://doi.org/10.1186/s13673-018-0162-5
Juan MC, Calatrava J (2011) An augmented reality system for the treatment of phobia to small animals viewed via an optical see-through HMD: comparison with a similar system viewed via a video see-through HMD. Int J Hum–Comput Interact 27(5):436–449
Kalawsky RS (1996) AGOCG Report. Exploiting virtual reality techniques in education and training: technological issues. http://www.agocg.ac.uk/reports/virtual/vrtech/toc.htm Accessed 1 Aug 2020
Karafotias G, Korres G, Teranishi A, Park W, Eid M (2017) Mid-air tactile stimulation for pain distraction. IEEE Trans Haptics 11(2):185–191
Kawulich B, D’Alba A (2019) Teaching qualitative research methods with second life: a 3-dimensional online virtual environment. Virtual Real 23(4):375–384
Kim IC, Lee BH (2012) Effects of augmented reality with functional electric stimulation on muscle strength, balance and gait of stroke patients. J Phys Ther Sci 24(8):755–762
Krumins A (2017) Haptic bodysuits and the strange new landscape of immersive VR. Jan 4, blog entry at https://www.extremetech.com/extreme/241917-haptic-bodysuits-strange-new-landscape-immersive-virtual-reality. Accessed 1 Aug 2020
Ku J, Kim YJ, Cho S, Lim T, Lee HS, Kang YJ (2019) Three-dimensional augmented reality system for balance and mobility rehabilitation in the elderly: a randomized controlled trial. Cyberpsychol Behav Soc Netw 22(2):132–141
Kumar R, Oskiper T, Naroditsky O, Samarasekera S, Zhu Z, Kim J (2017) System and method for generating a mixed reality environment. US Patent No. 9,600,067 B2
Laha B, Sensharma K, Schiffbauer JD, Bowman DA (2012) Effects of immersion on visual analysis of volume data. IEEE Trans Visual Comput Gr 19(4):597–606
Latif U, Shin S (2019) OP-MR: the implementation of order picking based on mixed reality in a smart warehouse. Vis Comput. https://doi.org/10.1007/s00371-019-01745-z
Lau K (2015) Organizational learning goes virtual? A study of employees’ learning achievement in stereoscopic 3D virtual reality. Learn Organ 22(5):289–303
Lee C, Kim Y, Lee B (2014) Augmented reality-based postural control training improves gait function in patients with stroke: randomized controlled trial. Hong Kong Physiother J 32(2):51–57
Lee J, Yoo H, Lee B (2017) Effects of augmented reality-based Otago exercise on balance, gait, and physical factors in elderly women to prevent falls: a randomized controlled trial. J Phys Ther Sci 29(9):1586–1589
Lessiter J, Freeman J, Keogh E, Davidoff J (2001) A cross-media presence questionnaire: the ITC sense of presence inventory. Presence: Teleoper Virtual Environ 10(3):282–297
Li C, Liang W, Quigley C, Zhao Y, Yu L (2017) Earthquake safety training through virtual drills. IEEE Trans Vis Comput Gr 23(4):1275–1284
Liberati N (2013) Improving the embodiment relations by means of phenomenological analysis on the “reality” of ARs. In: 2013 IEEE international symposium on mixed and augmented reality-arts, media, and humanities (ISMAR-AMH) 0, 13–17, 2013. http://doi.ieeecomputersociety.org/10.1109/ISMAR-AMH.2012.6483983
Liberati N (2016) Augmented reality and ubiquitous computing: the hidden potentialities of augmented reality. AI Soc 31(1):17–28
Lima J, McCabe-Bennett H, Antony M (2018) Treatment of storm fears using virtual reality and progressive muscle relaxation. Behav Cognit Psychother 46(2):251–256
Lombard M, Ditton T (1997) At the heart of it all: the concept of presence. J Comput-Med Commun 3(2):1083–6101
Lombard M, Ditton T, Weinstein L (2013) Measuring presence: the temple presence inventory (TPI). Updated September, 15. http://matthewlombard.com/research/p2_ab.html. Accessed 1 Aug 2020
Loreto-Quijada D, Gutiérrez-Maldonado J, Nieto R, Gutiérrez-Martínez O, Ferrer-García M, Saldana C, Liutsko L (2014) Differential effects of two virtual reality interventions: distraction versus pain control. Cyberpsychol Behav Soc Netw 17(6):353–358
Manzoni GM, Cesa GL, Bacchetta M, Castelnuovo G, Conti S, Gaggioli A, Riva G (2016) Virtual reality–enhanced cognitive–behavioral therapy for morbid obesity: a randomized controlled study with 1 year follow-up. Cyberpsychol Behav Soc Netw 19(2):134–140
Martínez-Navarro J, Bigné E, Guixeres J, Alcañiz M, Torrecilla C (2019) The influence of virtual reality in e-commerce. J Bus Res 100:475–482
Maskey M, Rodgers J, Grahame V, Glod M, Honey E, Kinnear J, Parr J (2019) A randomised controlled feasibility trial of immersive virtual reality treatment with cognitive behaviour therapy for specific phobias in young people with autism spectrum disorder. J Autism Dev Disord 49(5):1912–1927
McLay R, Wood D, Webb-Murphy J, Spira J, Wiederhold M, Pyne J, Wiederhold B (2011) A randomized, controlled trial of virtual reality-graded exposure therapy for post-traumatic stress disorder in active duty service members with combat-related post-traumatic stress disorder. Cyberpsychol Behav Soc Netw 14(4):223–229
McLay R, Baird A, Webb-Murphy J, Deal W, Tran L, Anson H, Klam W, Johnston S (2017) A randomized, head-to-head study of virtual reality exposure therapy for posttraumatic stress disorder. Cyberpsychol Behav Soc Netw 20(4):218–224
McMahan A (2003) Immersion, engagement and presence: a method for analyzing 3-D video games. In: Wolf M, Perron B (eds) The video game theory reader, chap 3. Routledge, New York, pp 67–86
Meng F, Zhang W, Yang R (2014) The development of a panorama manifestation virtual reality system for navigation and a usability comparison with a desktop system. Behav Inf Technol 33(2):133–143
Merel T (2017) The reality of VR/AR growth. Tech Crunch. https://techcrunch.com/2017/01/11/the-reality-of-vrar-growth/. Accessed 1 Aug 2020
Michaliszyn D, Marchand A, Bouchard S, Martel M, Poirier-Bisson J (2010) A randomized, controlled clinical trial of in virtuo and in vivo exposure for spider phobia. Cyberpsychol Behav Soc Netw 13(6):689–695
Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst E77-D(12):1321–1329
Montero-López E, Santos-Ruiz A, García-Ríos M, Rodríguez-Blázquez R, Pérez-García M, Peralta-Ramírez M (2016) A virtual reality approach to the Trier Social Stress Test: contrasting two distinct protocols. Behav Res Methods 48(1):223–232
Motraghi T, Seim R, Meyer E, Morissette S (2014) Virtual reality exposure therapy for the treatment of posttraumatic stress disorder: a methodological review using CONSORT guidelines. J Clin Psychol 70(3):197–208
Muhanna M (2015) Virtual reality and the CAVE: taxonomy, interaction challenges and research directions. J King Saud Univ—Comput Inf Sci 27(3):344–361
Murcia-Lopez M, Steed A (2018) A comparison of virtual and physical training transfer of bimanual assembly tasks. IEEE Trans Vis Comput Gr 24(4):1574–1583
Narayan M, Waugh L, Zhang X, Bafna P, Bowman D (2005) Quantifying the benefits of immersion for collaboration in virtual environments. In: Proceedings of the ACM symposium on virtual reality software and technology, Monterey, California, USA, 7–9 November
Neguţ A, Matu S, Sava F, David D (2016) Task difficulty of virtual reality-based assessment tools compared to classical paper-and-pencil or computerized measures: a meta-analytic approach. Comput Hum Behav 54:414–424
Ng Y-L, Ma F, Ho F, Ip P, Fu K-W (2019) Effectiveness of virtual and augmented reality-enhanced exercise on physical activity, psychological outcomes, and physical performance: a systematic review and meta-analysis of randomized controlled trials. Comput Hum Behav 99:278–291
Nilsson S, Johansson B, Jonsson A (2010) Cross-organizational collaboration supported by augmented reality. IEEE Trans Visual Comput Graphics 17(10):1380–1392
Nilsson N, Nordahl R, Serafin S (2016) Immersion revisited: a review of existing definitions of immersion and their relation to different theories of presence. Hum Technol 12(2):108–134
Okoli C, Schabram K (2010) A guide to conducting a systematic literature review of information systems research. Sprouts: working papers on information systems, vol 10, no. 26. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1954824. Accessed 1 Aug 2020
Oleksy T, Wnuk A (2016) Augmented places: an impact of embodied historical experience on attitudes towards places. Comput Hum Behav 57:11–16
Paré G, Jaana M, Sicotte C (2007) Systematic review of home telemonitoring for chronic diseases: the evidence base. J Am Med Inform Assoc 14(3):269–277. https://doi.org/10.1197/jamia.M2270
Paré G, Trudel M-C, Jaana M, Kitsiou S (2015) Synthesizing information systems knowledge: a typology of literature reviews. Inf Manag 52(2):183–199
Paré G, Tate M, Johnstone D, Kitsiou S (2016) Contextualizing the twin concepts of systematicity and transparency in information systems literature reviews. Eur J Inf Syst 25(6):493–508
Parsons T, Gaggioli A, Riva G (2017) Virtual reality research in social neuroscience. Brain Sci 7(4):42
Parveau M, Adda M (2018) 3iVClass: a new classification method for virtual, augmented and mixed realities. Procedia Comput Sci 141:263–270. https://doi.org/10.1016/j.procs.2018.10.180
Perret J, Vander Poorten E (2018) Touching virtual reality: a review of haptic gloves. In: ACTUATOR 2018: 16th international conference on new actuators, June 25–27, pp 270–274
Pickering C, Byrne J (2013) The benefits of publishing systematic quantitative literature reviews for PhD candidates and other early-career researchers. High Educ Res Dev 33(3):534–548. https://doi.org/10.1080/07294360.2013.841651
Pickering C, Grignon J, Steven R, Guitart D, Byrne J (2015) Publishing not perishing: how research students transition from novice to knowledgeable using systematic quantitative literature reviews. Stud High Educ 40(10):1756–1769. https://doi.org/10.1080/03075079.2014.914907
Piskorz J, Czub M (2014) Distraction of attention with the use of virtual reality. Influence of the level of game complexity on the level of experienced pain. Pol Psychol Bull 45(4):480–487
Regenbrecht H, Schubert T (2002) Real and illusory interactions enhance presence in virtual environments. Presence: Teleoper Virtual Environ 11(4):425–434
Reger G, Koenen-Woods P, Zetocha K, Smolenski D, Holloway K, Rothbaum B, Gahm G (2016) Randomized controlled trial of prolonged exposure using imaginal exposure vs. virtual reality exposure in active duty soldiers with deployment-related posttraumatic stress disorder (PTSD). J Consul Clin Psychol 84(11):946–959
Rehman U, Cao S (2019) Comparative evaluation of augmented reality-based assistance for procedural tasks: a simulated control room study. Behav Inf Technol. https://doi.org/10.1080/0144929X.2019.1660805
Repetto C, Gaggioli A, Pallavicini F, Cipresso P, Raspelli S, Riva G (2013) Virtual reality and mobile phones in the treatment of generalized anxiety disorders: a phase-2 clinical trial. Pers Ubiquit Comput 17(2):253–260
Riva G, Waterworth JA (2003) Presence and the self: a cognitive neuroscience approach. Presence-Connect, 3(3)
Rodríguez C, Areces D, Garcia T, Cueli M, González Castro P (2018) Comparison between two continuous performance tests for identifying ADHD: traditional vs. virtual reality. Int J Clin Health Psychol 18:254–263
Ronchi E, Mayorga D, Lovreglio R, Wahlqvist J, Nilsson D (2019) Mobile-powered head-mounted displays versus cave automatic virtual environment experiments for evacuation research. Comput Anim Virtual Worlds 30(6):e1873. https://doi.org/10.1002/cav.1873
Rowe F (2014) What literature review is not: diversity, boundaries, and recommendations. Eur J Inf Syst 23(3):241–255
Sacks R, Perlman A, Barak R (2013) Construction safety training using immersive virtual reality. Constr Manag Econ 31(9):1005–1017. https://doi.org/10.1080/01446193.2013.828844
Sadowsky W, Stanney K (2002) Measuring and managing presence in virtual environments. In: Stanney K (ed) Handbook of virtual environments technology. Lawrence Erlbaum Associates, Mahway, pp 791–806
Schoonheim M, Heyden R, Wiecha JM, Henden T (2014) Use of a virtual world computer environment for international distance education: lessons from a pilot project using second life. BMC Med Educ. https://doi.org/10.1186/1472-6920-14-36
Schroeder R (1996) Possible worlds: the social dynamic of virtual reality technologies. Westview Press, Boulder
Schryen G (2015) Writing qualitative IS literature reviews—guidelines for synthesis, interpretation and guidance of research. Commun Assoc Inf Syst 37:286–325
Schryen G, Benlian A, Rowe F, Shirley G, Larsen K, Petter S, Wagner G, Haag S, Yasasin E (2017) Literature reviews in IS research: what can be learnt from the past and other fields? Commun Assoc Inf Syst. https://doi.org/10.17705/1CAIS.04130
Schubert T, Friedmann F, Regenbrecht H (2001) The experience of presence: factor analytic insights. Teleoper Virtual Environ 10(3):266–281
Shu Y, Huang YZ, Chang SH, Chen MY (2019) Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Real 23(4):437–446
Slater M (2003) A note on presence terminology. Presence Connect 3(3):1–5
Slater M, Wilbur S (1997) A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence: Teleoper Virtual Environ 6(6):603–616
Slater M, Usoh M, Steed A (1994) Depth of presence in virtual environments. Presence: Teleoper Virtual Environ 3(2):130–144
Smink A, Frowijn S, van Reijmersdal E, van Noort G, Neijens P (2019) Try online before you buy: how does shopping with augmented reality affect brand responses and personal data disclosure. Electron Commer Res Appl 35:100854
Solomon B (2014) Facebook buys oculus, virtual reality gaming startup, for $2 billion. https://www.forbes.com/sites/briansolomon/2014/03/25/facebook-buys-oculus-virtual-reality-gaming-startup-for-2-billion/#d8d8b7024984. Accessed 1 Aug 2020
Suh A, Prophet J (2018) The state of immersive technology research: a literature analysis. Comput Hum Behav 86:77–90
Suso-Ribera C, Fernández-Álvarez J, García-Palacios A, Hoffman HG, Bretón-López J, Banos RM, Botella C (2019) Virtual reality, augmented reality, and in vivo exposure therapy: a preliminary comparison of treatment efficacy in small animal phobia. Cyberpsychol Behav Soc Netw 22(1):31–38
Tang Y, Au K, Lau H, Ho G, Wu G (2020) Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Real. https://doi.org/10.1007/s10055-020-00427-9
Teel E, Gay M, Johnson B, Slobounov S (2016) Determining sensitivity/specificity of virtual reality-based neuropsychological tool for detecting residual abnormalities following sport-related concussion. Neuropsychology 30(4):474–483
Templier M, Paré G (2018) Transparency in literature reviews: an assessment of reporting practices across review types and genres in top IS journals. Eur J Inf Syst 27(5):503–550. https://doi.org/10.1080/0960085X.2017.1398880
Thompson C (2017) Stereographs were the original virtual reality. Smithsonian Magazine. https://www.smithsonianmag.com/innovation/sterographs-original-virtual-reality-180964771/. Accessed 1 Aug 2020
Thompson T, Steffert T, Steed A, Gruzelier J (2011) A randomized controlled trial of the effects of hypnosis with 3-d virtual reality animation on tiredness, mood, and salivary cortisol. Int J Clin Exp Hypn 59(1):122–142
Turk V (2016) Face electrodes let you taste and chew in virtual reality. https://www.newscientist.com/article/2111371-face-electrodes-let-you-taste-and-chew-in-virtual-reality/. Accessed 1 Aug 2020
UQO Cyberpsychology Lab. Presence Questionnaire. (2002). http://w3.uqo.ca/cyberpsy/wp-content/uploads/2019/04/QEP_vf.pdf. Accessed August 1, 2020
Valtchanov D, Barton KR, Ellard C (2010) Restorative effects of virtual nature settings. Cyberpsychol Behav Soc Netw 13(5):503–512
Van Baren J, IJsselsteijn W (2004) Measuring presence: a guide to current measurement approaches. http://www8.informatik.umu.se/~jwworth/PresenceMeasurement.pdf. Accessed 1 Aug 2020
Van Kerrebroeck H, Brengman M, Willems K (2017) When brands come to life: experimental research on the vividness effect of virtual reality in transformational marketing communications. Virtual Real 21(4):177–191
vom Brocke J, Simons A, Riemer K, Niehaves B, Plattfaut R, Cleven A (2015) Standing on the shoulders of giants: challenges and recommendations of literature search in information systems research. Commun Assoc Inf Syst 37:205–224
Webster J, Watson RT (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Q 26(2):xiii–xxiii
Wechsler TF, Mühlberger A, Kümpers F (2019) Inferiority or even superiority of virtual reality exposure therapy in phobias?—A systematic review and quantitative meta-analysis on randomized controlled trials specifically comparing the efficacy of virtual reality exposure to gold standard in vivo exposure in agoraphobia, specific phobia and social phobia. Front Psychol 10:1758. https://doi.org/10.3389/fpsyg.2019.01758
Westerfield G, Mitrovic A, Billinghurst M (2015) Intelligent augmented reality training for motherboard assembly. Int J Artif Intell Educ 25(1):157–172
Wiederhold M, Crisci M, Patel V, Nonaka M, Wiederhold B (2019) Physiological monitoring during augmented reality exercise confirms advantages to health and well-being. Cyberpsychol Behav Soc Netw 22(2):122–126
Wilkerson W, Avstreih D, Gruppen L, Beier K-P, Woolliscroft J (2008) Using immersive simulation for training first responders for mass casualty incidents. Acad Emerg Med 15(11):1152–1159. https://doi.org/10.1111/j.1553-2712.2008.00223.x
Wissmath B, Weibel D, Mast F (2010) Measuring presence with verbal versus pictorial scales: a comparison between online- and ex post- ratings. Virtual Real 14(1):43–53
Witmer B, Singer M (1998) Measuring presence in virtual environments: a presence questionnaire. Presence: Teleoper Virtual Environ 7(3):225–240
Witmer B, Jerome C, Singer M (2005) The factor structure of the presence questionnaire. Presence 14(3):298–312
Yang S, Xiong G (2019) Try it on! Contingency effects of virtual fitting rooms. J Manag Inf Syst 36(3):789–822
Yang Z, Shi J, Jiang W, Sui Y, Wu Y, Ma S, Li H (2019) Influences of augmented reality assistance on performance and cognitive loads in different stages of assembly task. Front Psychol 10:1703. https://doi.org/10.3389/fpsyg.2019.01703
Yoo SC, Drumwright M (2018) Nonprofit fundraising with virtual reality. Nonprofit Manag Leadersh 29(1):11–27
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
Both authors contributed equally to this research.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix: Keywords used in Scopus literature search
Appendix: Keywords used in Scopus literature search
((TITLE (“immersive system” OR “virtual reality” OR “mixed reality” OR “augmented reality”) OR ABS (“immersive system” OR “virtual reality” OR “mixed reality” OR “augmented reality”))) AND ((TITLE (“experiment” OR “trial” OR “test”) OR ABS (“experiment” OR “trial” OR “test”))) AND (LIMIT-TO (SRCTYPE, “j”)) AND (EXCLUDE (SUBJAREA, “MEDI”) OR EXCLUDE (SUBJAREA, “MATH”) OR EXCLUDE (SUBJAREA, “PHYS”) OR EXCLUDE (SUBJAREA, “NEUR”) OR EXCLUDE (SUBJAREA, “MATE”) OR EXCLUDE (SUBJAREA, “BIOC”) OR EXCLUDE (SUBJAREA, “AGRI”) OR EXCLUDE (SUBJAREA, “EART”) OR EXCLUDE (SUBJAREA, “ENVI”) OR EXCLUDE (SUBJAREA, “CENG”) OR EXCLUDE (SUBJAREA, “IMMU”) OR EXCLUDE (SUBJAREA, “DENT”) OR EXCLUDE (SUBJAREA, “PHAR”) OR EXCLUDE (SUBJAREA, “VETE”) OR EXCLUDE (SUBJAREA, “Undefined”) OR EXCLUDE (SUBJAREA, “ENER”) OR EXCLUDE (SUBJAREA, “CHEM”) OR EXCLUDE (SUBJAREA, “ENGI”)) AND (EXCLUDE (PUBYEAR, 2009) OR EXCLUDE (PUBYEAR, 2008) OR EXCLUDE (PUBYEAR, 2007) OR EXCLUDE (PUBYEAR, 2006) OR EXCLUDE (PUBYEAR, 2005) OR EXCLUDE (PUBYEAR, 2004) OR EXCLUDE (PUBYEAR, 2003) OR EXCLUDE (PUBYEAR, 2002) OR EXCLUDE (PUBYEAR, 2001) OR EXCLUDE (PUBYEAR, 2000) OR EXCLUDE (PUBYEAR, 1999) OR EXCLUDE (PUBYEAR, 1998) OR EXCLUDE (PUBYEAR, 1997) OR EXCLUDE (PUBYEAR, 1996) OR EXCLUDE (PUBYEAR, 1995) OR EXCLUDE (PUBYEAR, 1994) OR EXCLUDE (PUBYEAR, 1993) OR EXCLUDE (PUBYEAR, 1992) OR EXCLUDE (PUBYEAR, 1991) OR EXCLUDE (PUBYEAR, 1984)) AND (EXCLUDE (EXACTSRCTITLE, “Computers And Education”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Advanced Oxidation Technologies”) OR EXCLUDE (EXACTSRCTITLE, “Computer Applications In Engineering Education”) OR EXCLUDE (EXACTSRCTITLE, “International Journal Of Online Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Computing In Civil Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Turkish Online Journal Of Educational Technology”) OR EXCLUDE (EXACTSRCTITLE, “International Journal Of recent Technology And Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Advanced Engineering Informatics”) OR EXCLUDE (EXACTSRCTITLE, “Computers In Education Journal”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Computing And Information Science In Engineering”) OR EXCLUDE (EXACTSRCTITLE, “AES Journal Of The Audio Engineering Society”) OR EXCLUDE (EXACTSRCTITLE, “Advances In Mechanical Engineering”) OR EXCLUDE (EXACTSRCTITLE, “IEEE Transactions On Biomedical Engineering”) OR EXCLUDE (EXACTSRCTITLE, “International Journal Of Multimedia And Ubiquitous Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Telecommunication Electronic And Computer Engineering”) OR EXCLUDE (EXACTSRCTITLE, “British Journal Of Educational Technology”) OR EXCLUDE (EXACTSRCTITLE, “Educational Technology And Society”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Advanced Research In Dynamical And Control Systems”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Medical And Biological Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Professional Issues In Engineering Education And Practice”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Science Education And Technology”) OR EXCLUDE (EXACTSRCTITLE, “IEEE Journal On Emerging And Selected Topics In Circuits And Systems”) OR EXCLUDE (EXACTSRCTITLE, “International Journal Of Innovative Technology And Exploring Engineering”) OR EXCLUDE (EXACTSRCTITLE, “Journal Of Educational Computing Research”) OR EXCLUDE (EXACTSRCTITLE, “Annals Of Biomedical Engineering”) OR EXCLUDE (EXACTSRCTITLE, “IEEE Transactions On Circuits And Systems For Video Technology”) OR EXCLUDE (EXACTSRCTITLE, “Interactive Technology And Smart Education”) OR EXCLUDE (EXACTSRCTITLE, “International Journal Of Applied Engineering Research”) OR EXCLUDE (EXACTSRCTITLE, “Asia Pacific Education Researcher”)) AND (LIMIT-TO (LANGUAGE, “English”)) AND (LIMIT-TO (DOCTYPE, “ar”) OR LIMIT-TO (DOCTYPE, “re”)).
Rights and permissions
About this article
Cite this article
Liberatore, M.J., Wagner, W.P. Virtual, mixed, and augmented reality: a systematic review for immersive systems research. Virtual Reality 25, 773–799 (2021). https://doi.org/10.1007/s10055-020-00492-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-020-00492-0