Xinyu Hu
ABSTRACT
Interaction cues inform users about potential actions to take. Tutorials, games, educational systems, and training applications often employ interaction cues to direct users to take specific actions at particular moments. Prior studies have investigated many aspects of interaction cues, such as the feedforward and perceived affordances that often accompany them. However, two less-researched aspects of interaction cues include the effects of their purpose (i.e., the type of task conveyed) and their timing (i.e., when they are presented). In this paper, we present a study that evaluates the effects of interaction cue purpose and timing on performance while learning and retaining tasks with a virtual reality (VR) training application. Our results indicate that participants retained manipulation tasks significantly better than travel or selection tasks, despite both being significantly easier to complete than the manipulation tasks. Our results also indicate that immediate interaction cues afforded significantly faster learning and better retention than delayed interaction cues.
- Shaowen Bardzell. 2008. Systems of Signs and Affordances: Interaction Cues in 3D Games. Extending Experiences. Structure, analysis and design of computer game player experience: 191–209.Google Scholar
- Jared Breakall, Christopher Randles, and Roy Tasker. 2019. Development and use of a multiple-choice item writing flaws evaluation instrument in the context of general chemistry. Chemistry Education Research and Practice 20, 2: 369–382.Google ScholarCross Ref
- Fabio Buttussi and Luca Chittaro. 2008. MOPET: A context-aware and user-adaptive wearable system for fitness training. Artificial Intelligence in Medicine 42, 2: 153–163.Google ScholarDigital Library
- Jacky C.P. Chan, Howard Leung, Jeff K.T. Tang, and Taku Komura. 2011. A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies 4, 2: 187–195.Google ScholarDigital Library
- Kwangsu Cho, Ju-Hwan Lee, Byeong-Taek Lee, and Eunil Park. 2015. Effects of Feedforward in In-Air Remote Pointing. International Journal of Human–Computer Interaction 31, 2: 89–100.Google Scholar
- Sven Coppers, Kris Luyten, Davy Vanacken, David Navarre, Philippe Palanque, and Christine Gris. 2019. Fortunettes: Feedforward about the future state of GUI widgets. Proceedings of the ACM on Human-Computer Interaction 3, EICS.Google ScholarDigital Library
- William Delamare, Thomas Janssoone, Céline Coutrix, and Laurence Nigay. 2016. Designing 3D Gesture Guidance: Visual Feedback and Feedforward Design Options. Proceedings of the International Working Conference on Advanced Visual Interfaces, Association for Computing Machinery, 152–159.Google ScholarDigital Library
- Kody R Dillman, Terrance Tin Hoi Mok, Anthony Tang, Lora Oehlberg, and Alex Mitchell. 2018. A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, 140:1–140:12.Google ScholarDigital Library
- Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How?: On the Creation of Meaning in Interaction Design Through Feedforward and Inherent Feedback. Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, ACM, 285–291.Google ScholarDigital Library
- Olov Engwall. 2012. Analysis of and feedback on phonetic features in pronunciation training with a virtual teacher. Computer Assisted Language Learning 25, 1: 37–64.Google ScholarCross Ref
- Chris Galloway. 2017. Blink and they're gone: PR and the battle for attention. Public Relations Review 43, 5: 969–977.Google ScholarCross Ref
- Rex Hartson. 2003. Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & Information Technology 22, 5: 315–338.Google ScholarCross Ref
- Rex Hartson and Pardha S Pyla. 2012. The UX Book: Process and guidelines for ensuring a quality user experience. Elsevier.Google ScholarDigital Library
- Luis Hernandez, Javier Taibo, Antonio Seoane, Ruben Lopez, and Rocio Lopez. 2004. The experience of the Empty Museum: displaying cultural contents on an immersive, walkable VR room. Proceedings Computer Graphics International, 2004., 436–443.Google ScholarCross Ref
- Michael J. Howell, Nicolas S. Herrera, Alec G. Moore, and Ryan P. McMahan. 2016. A reproducible olfactory display for exploring olfaction in immersive media experiences. Multimedia Tools and Applications 75, 20: 12311–12330.Google ScholarDigital Library
- Xinyu Hu, Alec G. Moore, James Coleman Eubanks, Afham Ahmed Aiyaz, and Ryan P. McMahan. 2020. The Effects of Delayed Interaction Cues in Virtual Reality Training.2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE, 63–69.Google Scholar
- Rajiv Khadka and Amy Banić. 2020. Effects of Egocentric Versus Exocentric Virtual Object Storage Technique on Cognition in Virtual Environments.2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 205–209.Google Scholar
- Bui Minh Khuong, Kiyoshi Kiyokawa, Andrew Miller, Joseph J. LaViola Jr., Tomohiro Mashita, and Haruo Takemura. 2014. The effectiveness of an AR-based context-aware assembly support system in object assembly.2014 IEEE Virtual Reality (VR), 57–62.Google Scholar
- Chengyuan Lai, Ryan P. McMahan, Midori Kitagawa, and Iolani Connolly. 2016. Geometry Explorer: Facilitating Geometry Education with Virtual Reality. International Conference on Virtual, Augmented and Mixed Reality (VAMR), Springer, 702–713.Google Scholar
- Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug Bowman, and Ivan Poupyrev. 2017.3D User Interfaces: Theory and Practice (2nd ed.). Addison-Wesley Professional, Boston.Google Scholar
- Ximena López, Jorge Valenzuela, Miguel Nussbaum, and Chin-Chung Tsai. 2015. Some recommendations for the reporting of quantitative studies. Computers & Education 91: 106–110.Google ScholarDigital Library
- Ryan P. McMahan and Nicolas S. Herrera. 2016. AFFECT: Altered-Fidelity Framework for Enhancing Cognition and Training. Frontiers in ICT 3: 29:1–15.Google ScholarCross Ref
- Ryan P. McMahan, Regis Kopper, and Doug A. Bowman. 2014. Principles for Designing Effective 3D Interaction Techniques. In K.S. Hale and K.M. Stanney, eds., Handbook of Virtual Environments. CRC Press, Boca Raton, 299–325.Google Scholar
- Alec G. Moore, Xinyu Hu, James Coleman Eubanks, Afham Ahmed Aiyaz, and Ryan P. McMahan. 2020. A Formative Evaluation Methodology for VR Training Simulations.2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE, 125–132.Google Scholar
- Alec G. Moore, Marwan Kodeih, Anoushka Singhania, Angelina Wu, Tassneen Bashir, and Ryan P. McMahan. 2019. The Importance of Intersection Disambiguation for Virtual Hand Techniques.2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, 450–457.Google Scholar
- Maria Murcia-López and Anthony Steed. 2018. A Comparison of Virtual and Physical Training Transfer of Bimanual Assembly Tasks. IEEE Transactions on Visualization and Computer Graphics 24, 4: 1574–1583.Google ScholarDigital Library
- Donald A Norman. 1999. Affordance, Conventions, and Design. interactions 6, 3: 38–43.Google Scholar
- Néstor Ordaz, David Romero, Dominic Gorecky, and Héctor R Siller. 2015. Serious Games and Virtual Simulator for Automotive Manufacturing Education & Training. Procedia Computer Science 75: 267–274.Google ScholarCross Ref
- Fred Paas, Alexander Renkl, and John Sweller. 2003. Cognitive Load Theory and Instructional Design: Recent Developments. Educational Psychologist 38, 1: 1–4.Google ScholarCross Ref
- Tabitha C. Peck, Laura E. Sockol, and Sarah M. Hancock. 2020. Mind the Gap: The Underrepresentation of Female Participants and Authors in Virtual Reality Research. IEEE Transactions on Visualization and Computer Graphics 26, 5: 1945–1954.Google ScholarCross Ref
- Philippe Renevier, Laurence Nigay, J Bouchet, and L Pasqualetti. 2005. Generic Interaction Techniques for Mobile Collaborative Mixed Systems BT - Computer-Aided Design of User Interfaces IV. Springer Netherlands, 309–322.Google Scholar
- Michael Rohs and Philipp Zweifel. 2005. A Conceptual Framework for Camera Phone-Based Interaction Techniques BT - Pervasive Computing. Springer Berlin Heidelberg, 171–189.Google Scholar
- Rebecca Polley Sanchez, Chelsea M Bartel, Emily Brown, and Melissa DeRosier. 2014. The acceptability and efficacy of an intelligent social tutoring system. Computers & Education 78: 321–332.Google ScholarDigital Library
- Steven M Smith and Edward Vela. 2001. Environmental context-dependent memory: A review and meta-analysis. Psychonomic Bulletin & Review 8, 2: 203–220.Google ScholarCross Ref
- Evan A Suma, Samantha L Finkelstein, Seth Clark, Paula Goolkasian, and Larry F Hodges. 2010. Effects of travel technique and gender on a divided attention task in a virtual environment.3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings, 27–34.Google Scholar
- Evan Suma, Samantha Finkelstein, Myra Reid, Sabarish Babu, Amy Ulinski, and Larry F. Hodges. 2010. Evaluation of the cognitive effects of travel technique in complex real and virtual environments. IEEE Transactions on Visualization and Computer Graphics 16, 4: 690–702.Google ScholarDigital Library
- F. Tyndiuk, V. Lespinet-Najib, G. Thomas, and C. Schlick. 2004. Impact of Large Displays on Virtual Reality Task Performance. Proceedings of the 3rd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, Association for Computing Machinery, 61–65.Google Scholar
- F. Tyndiuk, G. Thomas, V. Lespinet-Najib, and C. Schlick. 2005. Cognitive Comparison of 3D Interaction in Front of Large vs. Small Displays. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Association for Computing Machinery, 117–123.Google Scholar
- Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the Bridge over Norman's Gulf of Execution: Revealing Feedforward's True Identity. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1931–1940.Google Scholar
- Jia Wang and Robert W. Lindeman. 2015. Object impersonation: Towards effective interaction in tablet- and HMD-based hybrid virtual environments.2015 IEEE Virtual Reality (VR), 111–118.Google Scholar
- S. A. G. Wensveen, J. P. Djajadiningrat, and C. J. Overbeeke. 2004. Interaction Frogger: A Design Framework to Couple Action and Function through Feedback and Feedforward. Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, Association for Computing Machinery, 177–184.Google Scholar
- Andrew Yoshimura, Adil Khokhar, and Christoph W. Borst. 2019. Eye-gaze-triggered Visual Cues to Restore Attention in Educational VR.2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 1255–1256.Google Scholar
Recommendations
A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsBased on an analysis of 49 popular contemporary video games, we develop a descriptive framework of visual interaction cues in video games. These cues are used to inform players what can be interacted with, where to look, and where to go within the game ...
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food InteractionIn the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...
Virtual and augmented reality as spatial ability training tools
CHINZ '06: Proceedings of the 7th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCIVirtual reality (VR) and augmented reality (AR -- overlaying virtual objects onto the real world) offer interesting and wide spread possibilities to study different components of human behaviour and cognitive processes. One aspect of human cognition ...
Comments