Bukeikhan Omarali
ABSTRACT
We explore how human-operators perform manual scaling of virtual reality (VR) scenes used to represent remote physical environments in robotic telemanipulation tasks. In our experiment, 15 human-participants were asked to use manual gesture-based navigation in a VR scene that allowed them to change the virtual-to-real scale of the virtual world and perform a simple pick-and-place task in supervised robot control mode. We have compared the virtual world scale of participants at the beginning of a 3-day experiment when they were considered to be novice teleoperators and at the end of it when they were considered to be expert teleoperators. Expert teleoperators as a group used a smaller virtual world scale that allowed them to perform the experimental task faster than novices, although this behaviour was not exhibited by every teleoperator individually. Our study also demonstrated that participants’ prior video gaming experience affects the virtual world scale as participants with video gaming experience used smaller virtual world scales and performed the experimental task faster.
- Jarosław Andrzejczak, Wiktoria Kozłowicz, Rafał Szrajber, and Adam Wojciechowski. 2021. Factors Affecting the Sense of Scale in Immersive, Realistic Virtual Reality Space. In Computational Science – ICCS 2021, Maciej Paszynski, Dieter Kranzlmüller, Valeria V. Krzhizhanovskaya, Jack J. Dongarra, and Peter M.A. Sloot (Eds.). Springer International Publishing, Cham, 3–16.Google Scholar
- Tamay Aykut, Jingyi Xu, and Eckehard Steinbach. 2019. Realtime 3D 360-Degree Telepresence With Deep-Learning-Based Head-Motion Prediction. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1(2019), 231–244.Google ScholarCross Ref
- Sahand Azarby and Arthur Rice. 2022. Scale Estimation for Design Decisions in Virtual Environments: Understanding the Impact of User Characteristics on Spatial Perception in Immersive Virtual Reality Systems. Buildings 12, 9 (2022).Google Scholar
- Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2019. Locomotion in virtual reality for room scale tracked areas. International Journal of Human Computer Studies 122, August 2018(2019), 38–49.Google ScholarCross Ref
- Helmut Buhler, Sebastian Misztal, and Jonas Schild. 2018. Reducing VR Sickness Through Peripheral Visual Effects. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 517–9.Google Scholar
- Tareq Dardona, Shahab Eslamian, Luke A. Reisner, and Abhilash Pandya. 2019. Remote presence: Development and usability evaluation of a head-mounted display for camera control on the da Vinci Surgical System. Robotics 8, 2 (2019).Google Scholar
- Stephan Feichter and Helmut Hlavacs. 2018. Planar Simplification of Indoor Point-Cloud Environments. In 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, 274–281.Google Scholar
- Google. 2023. Tilt Brush. https://www.tiltbrush.comGoogle Scholar
- Kelleher R. Guerin, Sebastian D. Riedel, Jonathan Bohren, and Gregory D. Hager. 2014. Adjutant: A framework for flexible human-machine collaborative systems. IEEE International Conference on Intelligent Robots and SystemsIros (2014), 1392–1399.Google ScholarCross Ref
- Emil R. Hoeg, Kevin V. Ruder, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2017. An exploration of input conditions for virtual teleportation. In 2017 IEEE Virtual Reality (VR). 341–342.Google Scholar
- Sebastian Kohn, Andreas Blank, David Puljiz, Lothar Zenkel, Oswald Bieber, Bjorn Hein, and Jorg Franke. 2018. Towards a Real-Time Environment Reconstruction for VR-Based Teleoperation Through Model Segmentation. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1–9.Google ScholarDigital Library
- Alexander Kron, Günther Schmidt, Bernd Petzold, Michael I. Zäh, Peter Hinterseer, and Eckehard Steinbach. 2004. Disposal of explosive ordnances by use of a bimanual haptic telepresence system. Proceedings - IEEE International Conference on Robotics and Automation 2004, 2(2004), 1968–1973.Google ScholarCross Ref
- Bukeikhan Omarali, Kaspar Althoefer, Fulvio Mastrogiovanni, Maurizio Valle, and Ildar Farkhatdinov. 2021. Workspace Scaling and Rate Mode Control for Virtual Reality based Robot Teleoperation. Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics (2021), 607–612.Google ScholarDigital Library
- Bukeikhan Omarali, Brice Denoun, Kaspar Althoefer, Lorenzo Jamone, Maurizio Valle, and Ildar Farkhatdinov. 2020. Virtual Reality based Telerobotics Framework with Depth Cameras. 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020 (2020), 1217–1222.Google ScholarCross Ref
- Bukeikhan Omarali, Francesca Palermo, Kaspar Althoefer, Maurizio Valle, and Ildar Farkhatdinov. 2022. Tactile Classification of Object Materials for Virtual Reality based Robot Teleoperation. Proceedings - IEEE International Conference on Robotics and Automation (2022), 9288–9294.Google ScholarDigital Library
- Mikhail Ostanin, Stanislav Mikhel, Alexey Evlampiev, Valeria Skvortsova, and Alexandr Klimchik. 2020. Human-robot interaction for robotic manipulator programming in Mixed Reality. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2805–2811.Google ScholarCross Ref
- Ata Otaran and Ildar Farkhatdinov. 2022. Haptic Ankle Platform for Interactive Walking in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 28, 12(2022), 3974–3985.Google ScholarDigital Library
- Chanho Park and Kyungho Jang. 2019. Investigation of Visual Self-Representation for a Walking-in-Place Navigation System in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 1114–1115.Google ScholarCross Ref
- Michael Rietzler, Martin Deubzer, Thomas Dreja, and Enrico Rukzio. 2020. Telewalk: Towards Free and Endless Walking in Room-Scale Virtual Reality. Conference on Human Factors in Computing Systems - Proceedings (2020), 1–9.Google Scholar
- Tobias Rodehutskors, Max Schwarz, and Sven Behnke. 2015. Intuitive bimanual telemanipulation under communication restrictions by immersive 3D visualization and motion tracking. IEEE-RAS International Conference on Humanoid Robots 2015-Decem (2015), 276–283.Google ScholarDigital Library
- Matthew Sammut, Mark Sammut, and Predrag Andrejevic. 2017. The benefits of being a video gamer in laparoscopic surgery. International Journal of Surgery 45 (2017), 42–46.Google ScholarCross Ref
- Sebastian Stadler, Henriette Cornet, and Fritz Frenkler. 2019. A study in virtual reality on (non-)gamers’ attitudes and behaviors. 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - ProceedingsFebruary(2019), 1169–1170.Google ScholarCross Ref
- John Thomason, Photchara Ratsamee, Jason Orlosky, Kiyoshi Kiyokawa, Tomohiro Mashita, Yuki Uranishi, and Haruo Takemura. 2019. A Comparison of Adaptive View Techniques for Exploratory 3D Drone Teleoperation. ACM Transactions on Interactive Intelligent Systems 9, 2-3 (2019), 1–19.Google ScholarDigital Library
- Balazs Vagvolgyi, Wenlong Niu, Zihan Chen, Paul Wilkening, and Peter Kazanzides. 2017. Augmented virtuality for model-based teleoperation. IEEE International Conference on Intelligent Robots and Systems 2017-Septe (2017), 3826–3833.Google ScholarDigital Library
- Ivan Vitanov, Ildar Farkhatdinov, Brice Denoun, Francesca Palermo, Ata Otaran, Joshua Brown, Bukeikhan Omarali, Taqi Abrar, Miles Hansard, Changjae Oh, 2021. A Suite of Robotic Solutions for Nuclear Waste Decommissioning. Robotics 10, 4 (2021), 112.Google ScholarCross Ref
- Wai-keung Fung, Wang-tai Lo, Yun-hui Liu, and Ning Xi. 2005. A case study of 3D stereoscopic vs. 2D monoscopic tele-reality in real-time dexterous teleoperation. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 181–186.Google Scholar
- Dong Wei, Bidan Huang, and Qiang Li. 2021. Multi-view merging for robot teleoperation with virtual reality. IEEE Robotics and Automation Letters 6, 4 (2021), 8537–8544.Google ScholarCross Ref
- David Whitney, Eric Rosen, Daniel Ullman, Elizabeth Phillips, and Stefanie Tellex. 2018. ROS Reality: A Virtual Reality Framework Using Consumer-Grade Hardware for ROS-Enabled Robots. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1–9.Google Scholar
- Tianhao Zhang, Zoe McCarthy, Owen Jow, Dennis Lee, Xi Chen, Ken Goldberg, and Pieter Abbeel. 2018. Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation. In 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1–8. arXiv:1710.04615Google ScholarDigital Library
- Tianyu Zhou, Qi Zhu, and Jing Du. 2020. Intuitive robot teleoperation for civil engineering operations with virtual reality and deep learning scene reconstruction. Advanced Engineering Informatics 46, July (2020), 101170.Google ScholarCross Ref
Index Terms
- Workspace Scaling in Virtual Reality based Robot Teleoperation
Recommendations
Comparing a Graphical User Interface, Hand Gestures and Controller in Virtual Reality for Robot Teleoperation
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot InteractionRobot teleoperation is being explored in a number of application areas, where combining human adaptive intelligence and high precision of robots can provide access to dangerous or inaccessible places, or augment human dexterity. Using virtual reality (VR)...
Assisting Manipulation and Grasping in Robot Teleoperation with Augmented Reality Visual Cues
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsTeleoperating industrial manipulators in co-located spaces can be challenging. Facilitating robot teleoperation by providing additional visual information about the environment and the robot affordances using augmented reality (AR), can improve task ...
Assessing the Suitability and Effectiveness of Mixed Reality Interfaces for Accurate Robot Teleoperation
VRST '20: Proceedings of the 26th ACM Symposium on Virtual Reality Software and TechnologyIn this work, a Mixed Reality (MR) system is evaluated to assess whether it can be efficiently used in teleoperation tasks that require an accurate control of the robot end-effector. The robot and its local environment are captured using multiple RGB-D ...
Comments