skip to main content
10.1145/3544548.3581063acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

I think I don’t feel sick: Exploring the Relationship Between Cognitive Demand and Cybersickness in Virtual Reality using fNIRS

Published:19 April 2023Publication History

ABSTRACT

Virtual Reality (VR) applications commonly use the illusion of self-motion (vection) to simulate experiences such as running, driving, or flying. However, this can lead to cybersickness, which diminishes the experience of users, and can even lead to disengagement with this platform. In this paper we present a study in which we show that users performing a cognitive task while experiencing a VR rollercoaster reported reduced symptoms of cybersickness. Furthermore, we collected and analysed brain activity data from our participants during their experience using functional near infra-red spectroscopy (fNIRS): preliminary analysis suggests the possibility that this technology may be able to detect the experience of cybersickness. Together, these results can assist the creators of VR experiences, both through mitigation of cybersickness in the design process, and by better understanding the experiences of their users.

Skip Supplemental Material Section

Supplemental Material

3544548.3581063-video-preview.mp4

mp4

15.5 MB

3544548.3581063-talk-video.mp4

mp4

39.9 MB

3544548.3581063-video-figure.mp4

mp4

56.5 MB

References

  1. Androu Abdalmalak, Daniel Milej, Lawrence Yip, Ali R Khan, Mamadou Diop, Adrian M Owen, and Keith St Lawrence. 2020. Assessing time-resolved fNIRS for brain-computer interface applications of mental communication. Frontiers in Neuroscience(2020), 105.Google ScholarGoogle Scholar
  2. Samuel Ang and John Quarles. 2020. GingerVR: An Open Source Repository of Cybersickness Reduction Techniques for Unity. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 460–463.Google ScholarGoogle Scholar
  3. Hasan Ayaz, Patricia A Shewokis, Scott Bunce, Kurtulus Izzetoglu, Ben Willems, and Banu Onaral. 2012. Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 1 (2012), 36–47.Google ScholarGoogle ScholarCross RefCross Ref
  4. J Bacca, S Baldiris, R Fabregat, S Graf, and G Kinshuk. 2014. Augmented Reality Trends in Education: A Systematic Review of Research and Applications. Educational Technology & Society, 17 (4), 133-149.(2014).Google ScholarGoogle Scholar
  5. Jonathan Z Bakdash and Laura R Marusich. 2017. Repeated measures correlation. Frontiers in psychology 8 (2017), 456.Google ScholarGoogle Scholar
  6. Jeffrey W Barker, Ardalan Aarabi, and Theodore J Huppert. 2013. Autoregressive model based algorithm for correcting motion and serially correlated errors in fNIRS. Biomedical optics express 4, 8 (2013), 1366–1379.Google ScholarGoogle Scholar
  7. Robert CA Bendall, Peter Eachus, and Catherine Thompson. 2016. A brief review of research using near-infrared spectroscopy to measure activation of the prefrontal cortex during emotional processing: the importance of experimental design. Frontiers in human neuroscience 10 (2016), 529.Google ScholarGoogle Scholar
  8. Alexandra Bendixen and Søren K Andersen. 2013. Measuring target detection performance in paradigms with high event rates. Clinical Neurophysiology 124, 5 (2013), 928–940.Google ScholarGoogle ScholarCross RefCross Ref
  9. Yoav Benjamini and Yosef Hochberg. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal statistical society: series B (Methodological) 57, 1(1995), 289–300.Google ScholarGoogle ScholarCross RefCross Ref
  10. Jelte E Bos. 2015. Less sickness with more motion and/or mental distraction. Journal of Vestibular Research 25, 1 (2015), 23–33.Google ScholarGoogle ScholarCross RefCross Ref
  11. Marie-Stéphanie Bracq, Estelle Michinov, Bruno Arnaldi, Benoît Caillaud, Bernard Gibaud, Valérie Gouranton, and Pierre Jannin. 2019. Learning procedural skills with a virtual reality simulator: An acceptability study. Nurse education today 79(2019), 153–160.Google ScholarGoogle Scholar
  12. Scott C Bunce, Kurtulus Izzetoglu, Hasan Ayaz, Patricia Shewokis, Meltem Izzetoglu, Kambiz Pourrezaei, and Banu Onaral. 2011. Implementation of fNIRS for monitoring levels of expertise and mental workload. In International Conference on Foundations of Augmented Cognition. Springer, 13–22.Google ScholarGoogle ScholarCross RefCross Ref
  13. Ufuk Celikcan. 2019. Detection and Mitigation of Cybersickness via EEG-Based Visual Comfort Improvement. In 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT). IEEE, 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  14. Yu-Chieh Chen, Jeng-Ren Duann, Shang-Wen Chuang, Chun-Ling Lin, Li-Wei Ko, Tzyy-Ping Jung, and Chin-Teng Lin. 2010. Spatial and temporal EEG dynamics of motion sickness. NeuroImage 49, 3 (2010), 2862–2870.Google ScholarGoogle ScholarCross RefCross Ref
  15. Shang-Wen Chuang, Chun-Hsiang Chuang, Yi-Hsin Yu, Jung-Tai King, and Chin-Teng Lin. 2016. EEG alpha and gamma modulators mediate motion sickness-related spectral responses. International journal of neural systems 26, 02 (2016), 1650007.Google ScholarGoogle ScholarCross RefCross Ref
  16. Xu Cui, Signe Bray, and Allan L Reiss. 2010. Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics. Neuroimage 49, 4 (2010), 3039–3046.Google ScholarGoogle ScholarCross RefCross Ref
  17. James J Cummings and Jeremy N Bailenson. 2016. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media psychology 19, 2 (2016), 272–309.Google ScholarGoogle Scholar
  18. Adrian Curtin and Hasan Ayaz. 2018. The age of neuroergonomics: towards ubiquitous and continuous measurement of brain function with fNIRS. Japanese Psychological Research 60, 4 (2018), 374–386.Google ScholarGoogle ScholarCross RefCross Ref
  19. Joakim Dahlman, Anna Sjörs, Johan Lindström, Torbjörn Ledin, and Torbjörn Falkmer. 2009. Performance and autonomic responses during motion sickness. Human factors 51, 1 (2009), 56–66.Google ScholarGoogle Scholar
  20. Simon Davis, Keith Nesbitt, and Eugene Nalivaiko. 2014. A systematic review of cybersickness. In Proceedings of the 2014 conference on interactive entertainment. 1–9.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Johannes Dichgans and Thomas Brandt. 1978. Visual-vestibular interaction: Effects on self-motion perception and postural control. In Perception. Springer, 755–804.Google ScholarGoogle Scholar
  22. Kim Dockx, Esther MJ Bekkers, Veerle Van den Bergh, Pieter Ginis, Lynn Rochester, Jeffrey M Hausdorff, Anat Mirelman, and Alice Nieuwboer. 2016. Virtual reality for rehabilitation in Parkinson’s disease. Cochrane Database of Systematic Reviews12 (2016).Google ScholarGoogle Scholar
  23. Joshua E Domeyer, Nicholas D Cassavaugh, and Richard W Backs. 2013. The use of adaptation to reduce simulator sickness in driving assessment and research. Accident Analysis & Prevention 53 (2013), 127–132.Google ScholarGoogle ScholarCross RefCross Ref
  24. HB-L Duh, JW Lin, Robert V Kenyon, Donald E Parker, and Thomas A Furness. 2001. Effects of field of view on balance in an immersive environment. In Proceedings IEEE Virtual Reality 2001. IEEE, 235–240.Google ScholarGoogle ScholarCross RefCross Ref
  25. Sharon L Farra, Matthew Gneuhs, Eric Hodgson, Burhan Kawosa, Elaine T Miller, Ashley Simon, Nathan Timm, and Jackie Hausfeld. 2019. Comparative cost of virtual reality training and live exercises for training hospital workers for evacuation. Computers, informatics, nursing: CIN 37, 9 (2019), 446.Google ScholarGoogle Scholar
  26. Ajoy S Fernandes and Steven K Feiner. 2016. Combating VR sickness through subtle dynamic field-of-view modification. In 2016 IEEE symposium on 3D user interfaces (3DUI). IEEE, 201–210.Google ScholarGoogle ScholarCross RefCross Ref
  27. Raul Fernandez Rojas, Xu Huang, and Keng-Liang Ou. 2019. A machine learning approach for the identification of a biomarker of human pain using fNIRS. Scientific reports 9, 1 (2019), 1–12.Google ScholarGoogle Scholar
  28. Frank A Fishburn, Ruth S Ludlum, Chandan J Vaidya, and Andrei V Medvedev. 2019. Temporal derivative distribution repair (TDDR): a motion correction method for fNIRS. Neuroimage 184(2019), 171–179.Google ScholarGoogle ScholarCross RefCross Ref
  29. Liviu A Fodor, Carmen D Coteț, Pim Cuijpers, Ștefan Szamoskozi, Daniel David, and Ioana A Cristea. 2018. The effectiveness of virtual reality based interventions for symptoms of anxiety and depression: A meta-analysis. Scientific reports 8, 1 (2018), 1–13.Google ScholarGoogle ScholarCross RefCross Ref
  30. Schwarz Gideon 1978. Estimating the dimension of a model. The annals of statistics 6, 2 (1978), 461–464.Google ScholarGoogle Scholar
  31. Evelyn Glotzbach, Andreas Mühlberger, Kathrin Gschwendtner, Andreas J Fallgatter, Paul Pauli, and Martin J Herrmann. 2011. Prefrontal brain activation during emotional processing: a functional near infrared spectroscopy study (fNIRS). The open neuroimaging journal 5 (2011), 33.Google ScholarGoogle Scholar
  32. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.Google ScholarGoogle Scholar
  33. Martin J Herrmann, A-C Ehlis, and Andreas J Fallgatter. 2003. Prefrontal activation through task requirements of emotional induction measured with NIRS. Biological psychology 64, 3 (2003), 255–263.Google ScholarGoogle Scholar
  34. Christina Hirth, Hellmuth Obrig, Kersten Villringer, Andeas Thiel, Johannes Bernarding, Werner Mühlnickel, Herta Flor, Ulrich Dirnagl, and Arno Villringer. 1996. Non-invasive functional mapping of the human motor cortex using near-infrared spectroscopy.Neuroreport 7, 12 (1996), 1977–1981.Google ScholarGoogle Scholar
  35. Keum-Shik Hong and M Atif Yaqub. 2019. Application of functional near-infrared spectroscopy in the healthcare industry: A review. Journal of Innovative Optical Health Sciences 12, 06 (2019), 1930012.Google ScholarGoogle ScholarCross RefCross Ref
  36. Xin Hu, Chu Zhuang, Fei Wang, Yong-Jin Liu, Chang-Hwan Im, and Dan Zhang. 2019. fNIRS evidence for recognizably different positive emotions. Frontiers in human neuroscience 13 (2019), 120.Google ScholarGoogle Scholar
  37. Theodore J Huppert. 2016. Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy. Neurophotonics 3, 1 (2016), 010401.Google ScholarGoogle ScholarCross RefCross Ref
  38. Elizaveta Igoshina, Frank A Russo, Robert Shewaga, Bruce Haycock, and Behrang Keshavarz. 2022. The relationship between simulator sickness and driving performance in a high-fidelity simulator. Transportation research part F: traffic psychology and behaviour 89 (2022), 478–487.Google ScholarGoogle Scholar
  39. Frans F Jöbsis. 1977. Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. Science 198, 4323 (1977), 1264–1267.Google ScholarGoogle Scholar
  40. Julian S Joseph, Marvin M Chun, and Ken Nakayama. 1997. Attentional requirements in a ‘preattentive’feature search task. Nature 387, 6635 (1997), 805–807.Google ScholarGoogle Scholar
  41. Alexandra D Kaplan, Jessica Cruit, Mica Endsley, Suzanne M Beers, Ben D Sawyer, and Peter A Hancock. 2021. The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: A meta-analysis. Human factors 63, 4 (2021), 706–726.Google ScholarGoogle ScholarCross RefCross Ref
  42. Robert E Kass and Larry Wasserman. 1995. A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. Journal of the american statistical association 90, 431(1995), 928–934.Google ScholarGoogle ScholarCross RefCross Ref
  43. Sam Kavanagh, Andrew Luxton-Reilly, Burkhard Wuensche, and Beryl Plimmer. 2017. A systematic review of virtual reality in education. Themes in Science and Technology Education 10, 2 (2017), 85–119.Google ScholarGoogle Scholar
  44. Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.Google ScholarGoogle Scholar
  45. Robert S Kennedy, Kay M Stanney, and William P Dunlap. 2000. Duration and exposure to virtual environments: sickness curves during and across sessions. Presence: Teleoperators & Virtual Environments 9, 5(2000), 463–472.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Behrang Keshavarz and Heiko Hecht. 2011. Validating an efficient method to quantify motion sickness. Human factors 53, 4 (2011), 415–426.Google ScholarGoogle Scholar
  47. Behrang Keshavarz and Heiko Hecht. 2014. Pleasant music as a countermeasure against visually induced motion sickness. Applied ergonomics 45, 3 (2014), 521–527.Google ScholarGoogle Scholar
  48. Behrang Keshavarz, Aaron Emile Philipp-Muller, Wanja Hemmerich, Bernhard E Riecke, and Jennifer L Campos. 2019. The effect of visual motion stimulus characteristics on vection and visually induced motion sickness. Displays 58(2019), 71–81.Google ScholarGoogle ScholarCross RefCross Ref
  49. Behrang Keshavarz, Bernhard E Riecke, Lawrence J Hettinger, and Jennifer L Campos. 2015. Vection and visually induced motion sickness: how are they related?Frontiers in psychology 6 (2015), 472.Google ScholarGoogle Scholar
  50. Young Youn Kim, Hyun Ju Kim, Eun Nam Kim, Hee Dong Ko, and Hyun Taek Kim. 2005. Characteristic changes in the physiological components of cybersickness. Psychophysiology 42, 5 (2005), 616–625.Google ScholarGoogle ScholarCross RefCross Ref
  51. Thomas Kosch, Albrecht Schmidt, Simon Thanheiser, and Lewis L Chuang. 2020. One does not simply RSVP: mental workload to select speed reading parameters using electroencephalography. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Eric Krokos and Amitabh Varshney. 2022. Quantifying VR cybersickness using EEG. Virtual Reality 26, 1 (2022), 77–89.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Charlene Krueger and Lili Tian. 2004. A comparison of the general linear mixed model and repeated measures ANOVA using a dataset with multiple missing data points. Biological research for nursing 6, 2 (2004), 151–157.Google ScholarGoogle Scholar
  54. Nilli Lavie, Aleksandra Hirst, Jan W De Fockert, and Essi Viding. 2004. Load theory of selective attention and cognitive control.Journal of experimental psychology: General 133, 3 (2004), 339.Google ScholarGoogle Scholar
  55. Chin-Teng Lin, Shang-Wen Chuang, Yu-Chieh Chen, Li-Wei Ko, Sheng-Fu Liang, and Tzyy-Ping Jung. 2007. EEG effects of motion sickness induced in a dynamic virtual reality environment. In 2007 29th annual international conference of the IEEE engineering in medicine and biology society. IEEE, 3872–3875.Google ScholarGoogle Scholar
  56. Wei-Kai Liou and Chun-Yen Chang. 2018. Virtual reality classroom applied to science education. In 2018 23rd International Scientific-Professional Conference on Information Technology (IT). IEEE, 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  57. Kartik Logishetty, Branavan Rudran, and Justin P Cobb. 2019. Virtual reality training improves trainee performance in total hip arthroplasty: a randomized controlled trial. The bone & joint journal 101, 12 (2019), 1585–1592.Google ScholarGoogle Scholar
  58. Julie Lorah. 2018. Effect size measures for multilevel models: Definition, interpretation, and TIMSS example. Large-Scale Assessments in Education 6, 1 (2018), 1–11.Google ScholarGoogle ScholarCross RefCross Ref
  59. Horia A. Maior, Richard Ramchurn, Sarah Martindale, Ming Cai, Max L. Wilson, and Steve Benford. 2019. FNIRS and Neurocinematics. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk). Association for Computing Machinery, New York, NY, USA, 1–6.Google ScholarGoogle Scholar
  60. Horia A Maior, Max L Wilson, and Sarah Sharples. 2018. Workload alerts—using physiological measures of mental workload to provide feedback during tasks. ACM Transactions on Computer-Human Interaction 25, 2(2018).Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Divine Maloney, Guo Freeman, and Andrew Robb. 2021. Social Virtual Reality: Ethical Considerations and Future Directions for An Emerging Research Space. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 271–277.Google ScholarGoogle Scholar
  62. Kevin Mandrick, Gérard Derosiere, Gérard Dray, Denis Coulon, Jean-Paul Micallef, and Stéphane Perrey. 2013. Prefrontal cortex activity during motor tasks with additional mental load requiring attentional demand: a near-infrared spectroscopy study. Neuroscience research 76, 3 (2013), 156–162.Google ScholarGoogle Scholar
  63. Panagiotis Matsangas, Michael E McCauley, and William Becker. 2014. The effect of mild motion sickness and sopite syndrome on multitasking cognitive performance. Human factors 56, 6 (2014), 1124–1135.Google ScholarGoogle Scholar
  64. Serena Midha, Horia A Maior, Max L Wilson, and Sarah Sharples. 2021. Measuring mental workload variations in office work tasks using fNIRS. International Journal of Human-Computer Studies 147 (2021), 102580.Google ScholarGoogle ScholarCross RefCross Ref
  65. Serena Midha, Max L Wilson, and Sarah Sharples. 2022. Ethical Concerns and Perceptions of Consumer Neurotechnology from Lived Experiences of Mental Workload Tracking. life 25(2022), 28.Google ScholarGoogle Scholar
  66. Byung-Chan Min, Soon-Cheol Chung, Yoon-Ki Min, and Kazuyoshi Sakamoto. 2004. Psychophysiological evaluation of simulator sickness evoked by a graphic simulator. Applied ergonomics 35, 6 (2004), 549–556.Google ScholarGoogle Scholar
  67. Jungo Miyazaki, Hiroki Yamamoto, Yoshikatsu Ichimura, Hiroyuki Yamashiro, Tomokazu Murase, Tetsuya Yamamoto, Masahiro Umeda, and Toshihiro Higuchi. 2015. Inter-hemispheric desynchronization of the human MT+ during visually induced motion sickness. Experimental brain research 233, 8 (2015), 2421–2431.Google ScholarGoogle Scholar
  68. Vitaly Napadow, James D Sheehan, Jieun Kim, Lauren T LaCount, Kyungmo Park, Ted J Kaptchuk, Bruce R Rosen, and Braden Kuo. 2013. The brain circuitry underlying the temporal evolution of nausea in humans. Cerebral cortex 23, 4 (2013), 806–813.Google ScholarGoogle Scholar
  69. Suzanne AE Nooij, Christopher J Bockisch, Heinrich H Bülthoff, and Dominik Straumann. 2021. Beyond sensory conflict: The role of beliefs and perception in motion sickness. PLoS One 16, 1 (2021), e0245295.Google ScholarGoogle ScholarCross RefCross Ref
  70. Stephen Palmisano, Robert S Allison, and Juno Kim. 2020. Cybersickness in head-mounted displays is caused by differences in the user’s virtual and physical head pose. Frontiers in Virtual Reality 1 (2020), 587698.Google ScholarGoogle ScholarCross RefCross Ref
  71. Merle G Paule, John J Chelonis, Donna J Blake, and John L Dornhoffer. 2004. Effects of drug countermeasures for space motion sickness on working memory in humans. Neurotoxicology and teratology 26, 6 (2004), 825–837.Google ScholarGoogle Scholar
  72. Evan M Peck, Daniel Afergan, Beste F Yuksel, Francine Lalooses, and Robert JK Jacob. 2014. Using fNIRS to measure mental workload in the real world. In Advances in physiological computing. Springer, 117–139.Google ScholarGoogle Scholar
  73. Evan M M Peck, Beste F Yuksel, Alvitta Ottley, Robert JK Jacob, and Remco Chang. 2013. Using fNIRS brain sensing to evaluate information visualization interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 473–482.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Katlyn Peck, Frank Russo, Jennifer L Campos, and Behrang Keshavarz. 2020. Examining potential effects of arousal, valence, and likability of music on visually induced motion sickness. Experimental Brain Research 238, 10 (2020), 2347–2358.Google ScholarGoogle ScholarCross RefCross Ref
  75. Melissa Peskin, Brittany Mello, Judith Cukor, Megan Olden, and JoAnn Difede. 2019. Virtual reality applications to treat posttraumatic stress disorder. In Virtual Reality for Psychological and Neurocognitive Interventions. Springer, 85–102.Google ScholarGoogle Scholar
  76. Paola Pinti, Ilias Tachtsidis, Antonia Hamilton, Joy Hirsch, Clarisse Aichelburg, Sam Gilbert, and Paul W Burgess. 2020. The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience. Annals of the New York Academy of Sciences 1464, 1 (2020), 5–29.Google ScholarGoogle ScholarCross RefCross Ref
  77. Michael M Plichta, Antje BM Gerdes, Georg W Alpers, Wilma Harnisch, S Brill, Matthias J Wieser, and Andreas J Fallgatter. 2011. Auditory cortex activation is modulated by emotion: a functional near-infrared spectroscopy (fNIRS) study. Neuroimage 55, 3 (2011), 1200–1207.Google ScholarGoogle ScholarCross RefCross Ref
  78. Felix Putze, Susanne Putze, Merle Sagehorn, Christopher Micek, and Erin T Solovey. 2022. Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4(2022), 1–43.Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Jane E Raymond, Kimron L Shapiro, and Karen M Arnell. 1992. Temporary suppression of visual processing in an RSVP task: An attentional blink?Journal of experimental psychology: Human perception and performance 18, 3(1992), 849.Google ScholarGoogle Scholar
  80. James T Reason. 1978. Motion sickness adaptation: a neural mismatch model. Journal of the Royal Society of Medicine 71, 11 (1978), 819–829.Google ScholarGoogle ScholarCross RefCross Ref
  81. James T Reason and Joseph John Brand. 1975. Motion sickness.Academic press.Google ScholarGoogle Scholar
  82. René Reinhard, Ender Tutulmaz, Hans M Rutrecht, Patricia Hengstenberg, Britta Geissler, Heiko Hecht, and Axel Muttray. 2019. Effects of visually induced motion sickness on emergency braking reaction times in a driving simulator. Human factors 61, 6 (2019), 1004–1018.Google ScholarGoogle Scholar
  83. Hiroyuki Sakai, Takumi Harada, Stephen K Larroque, Athena Demertzi, Tomoko Sugawara, Taeko Ito, Yoshiro Wada, Masaki Fukunaga, Norihiro Sadato, and Steven Laureys. 2022. Left parietal involvement in motion sickness susceptibility revealed by multimodal magnetic resonance imaging. Human brain mapping 43, 3 (2022), 1103–1111.Google ScholarGoogle Scholar
  84. Débora P Salgado, Thiago B Rodrigues, Felipe R Martins, Eduardo LM Naves, Ronan Flynn, and Niall Murray. 2019. The Effect of Cybersickness of an Immersive Wheelchair Simulator. Procedia Computer Science 160 (2019), 665–670.Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Hendrik Santosa, Xuetong Zhai, Frank Fishburn, and Theodore Huppert. 2018. The NIRS brain AnalyzIR toolbox. Algorithms 11, 5 (2018), 73.Google ScholarGoogle ScholarCross RefCross Ref
  86. Matias N Selzer, Nicolas F Gazcon, and Martin L Larrea. 2019. Effects of virtual presence and learning outcome using low-end virtual reality systems. Displays 59(2019), 9–15.Google ScholarGoogle ScholarCross RefCross Ref
  87. Kimron L Shapiro, Jane E Raymond, and Karen M Arnell. 1994. Attention to visual pattern information produces the attentional blink in rapid serial visual presentation.Journal of Experimental psychology: Human perception and performance 20, 2(1994), 357.Google ScholarGoogle Scholar
  88. Ranganatha Sitaram, Haihong Zhang, Cuntai Guan, Manoj Thulasidas, Yoko Hoshi, Akihiro Ishikawa, Koji Shimizu, and Niels Birbaumer. 2007. Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface. NeuroImage 34, 4 (2007), 1416–1427.Google ScholarGoogle ScholarCross RefCross Ref
  89. Joseph Smyth, Stewart Birrell, Alex Mouzakitis, and Paul Jennings. 2018. Motion sickness and human performance–exploring the impact of driving simulator user trials. In International Conference on Applied Human Factors and Ergonomics. Springer, 445–457.Google ScholarGoogle Scholar
  90. Erin Treacy Solovey, Audrey Girouard, Krysta Chauncey, Leanne M Hirshfield, Angelo Sassaroli, Feng Zheng, Sergio Fantini, and Robert JK Jacob. 2009. Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. 157–166.Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Kay M. Stanney, Behrang Keshavarz, Heiko Hecht, and Ben D Lawson. 2014.. CRC Press Inc.Google ScholarGoogle Scholar
  92. Kay M Stanney, Kelly S Kingdon, David Graeber, and Robert S Kennedy. 2002. Human performance in immersive virtual environments: Effects of exposure duration, user control, and scene complexity. Human performance 15, 4 (2002), 339–366.Google ScholarGoogle Scholar
  93. Gary Strangman, Maria Angela Franceschini, and David A Boas. 2003. Factors affecting the accuracy of near-infrared spectroscopy concentration calculations for focal changes in oxygenation parameters. Neuroimage 18, 4 (2003), 865–879.Google ScholarGoogle ScholarCross RefCross Ref
  94. Hilary Sutcliffe. 2011. A report on responsible research and innovation. MATTER and the European Commission(2011).Google ScholarGoogle Scholar
  95. Sungho Tak and Jong Chul Ye. 2014. Statistical analysis of fNIRS data: a comprehensive review. Neuroimage 85(2014), 72–91.Google ScholarGoogle ScholarCross RefCross Ref
  96. Séamas Weech, Sophie Kenny, and Michael Barnett-Cowan. 2019. Presence and cybersickness in virtual reality are negatively related: a review. Frontiers in psychology 10 (2019), 158.Google ScholarGoogle ScholarCross RefCross Ref
  97. David Weibel and Bartholomäus Wissmath. 2011. Immersion in computer games: The role of spatial presence and flow. International Journal of Computer Games Technology 2011 (2011).Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Max L Wilson, Serena Midha, Horia A Maior, Anna L Cox, Lewis L Chuang, and Lachlan D Urquhart. 2022. SIG: Moving from Brain-Computer Interfaces to Personal Cognitive Informatics. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  99. Tom Winter. 2013. Lost and Found. Hachette UK.Google ScholarGoogle Scholar
  100. Hiroo Yamamura, Holger Baldauf, and Kai Kunze. 2020. Pleasant Locomotion–Towards Reducing Cybersickness using fNIRS during Walking Events in VR. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology. 56–58.Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Shun-nan Yang, Tawny Schlieski, Brent Selmins, Scott C Cooper, Rina A Doherty, Philip J Corriveau, and James E Sheedy. 2012. Stereoscopic viewing and reported perceived immersion and symptoms. Optometry and vision science 89, 7 (2012), 1068–1080.Google ScholarGoogle Scholar
  102. Fleur D Yen Pik Sang, John F Golding, and Michael A Gresty. 2003. Suppression of sickness by controlled breathing during mildly nauseogenic motion. Aviation, space, and environmental medicine 74, 9 (2003), 998–1002.Google ScholarGoogle Scholar
  103. Sean D Young, Bernard D Adelstein, and Stephen R Ellis. 2007. Demand characteristics in assessing motion sickness in a virtual environment: Or does taking a motion sickness questionnaire make you sick?IEEE transactions on visualization and computer graphics 13, 3(2007), 422–428.Google ScholarGoogle Scholar
  104. Meryem A Yücel, Alexander v Lühmann, Felix Scholkmann, Judit Gervain, Ippeita Dan, Hasan Ayaz, David Boas, Robert J Cooper, Joseph Culver, Clare E Elwell, 2021. Best practices for fNIRS publications. Neurophotonics 8, 1 (2021), 012101.Google ScholarGoogle Scholar
  105. Chenyang Zhang, Shuguang Li, Yaohua Li, Shengbo Eben Li, and Bingbing Nie. 2020. Analysis of motion sickness associated brain activity using fNIRS: a driving simulator study. IEEE Access 8(2020), 207415–207425.Google ScholarGoogle ScholarCross RefCross Ref
  106. Li-Li Zhang, Jun-Qin Wang, Rui-Rui Qi, Lei-Lei Pan, Min Li, and Yi-Ling Cai. 2016. Motion sickness: current knowledge and recent advance. CNS neuroscience & therapeutics 22, 1 (2016), 15–24.Google ScholarGoogle Scholar
  107. Celina Zhou, Clara Luisa Bryan, Evan Wang, N Sertac Artan, and Ziqian Dong. 2019. Cognitive distraction to improve cybersickness in virtual reality environment. In 2019 IEEE 16th International Conference on Mobile Ad Hoc and Sensor Systems Workshops (MASSW). IEEE, 72–76.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. I think I don’t feel sick: Exploring the Relationship Between Cognitive Demand and Cybersickness in Virtual Reality using fNIRS

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
      April 2023
      14911 pages
      ISBN:9781450394215
      DOI:10.1145/3544548

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 April 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI PLAY '24
      The Annual Symposium on Computer-Human Interaction in Play
      October 14 - 17, 2024
      Tampere , Finland

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format