ABSTRACT
As the use of Augmented Reality (AR) to enhance interactions between human agents and robotic systems in a work environment continues to grow, robots must communicate their intents in informative yet straightforward ways. This improves the human agent's feeling of trust and safety in the work environment while also reducing task completion time. To this end, we discuss a set of guidelines for the systematic design of AR interfaces for Human-Robot Interaction (HRI) systems. Furthermore, we develop design frameworks that would ride on these guidelines and serve as a base for researchers seeking to explore this direction further. We develop a series of designs for visually representing the robot's planned path and reactions, which we evaluate by conducting a user survey involving 14 participants. Subjects were given different design representations to review and rate based on their intuitiveness and informativeness. The collated results showed that our design representations significantly improved the participants' ease of understanding the robot's intents over the baselines for the robot's proposed navigation path, planned arm trajectory, and reactions.
Supplemental Material
- Oscar Danielsson. 2016. Designing Augmented Reality Interfaces for Human-Robot Collaboration in Engine Assembly: Research Proposal.Google Scholar
- Andreas Dünser, Raphaël Grasset, Hartmut Seichter, and Mark Billinghurst. 2007. Applying HCI principles to AR systems design.Google Scholar
- Hoda A ElMaraghy. 2005. Flexible and reconfigurable manufacturing systems paradigms. International journal of flexible manufacturing systems, Vol. 17, 4 (2005), 261--276.Google ScholarCross Ref
- HC Fang, SK Ong, and AYC Nee. 2012. Interactive robot trajectory planning and simulation using augmented reality. Robotics and Computer-Integrated Manufacturing, Vol. 28, 2 (2012), 227--237.Google ScholarDigital Library
- Mario Hermann, Tobias Pentek, and Boris Otto. 2016. Design Principles for Industrie 4.0 Scenarios. In 2016 49th Hawaii International Conference on System Sciences (HICSS). 3928--3937.Google ScholarDigital Library
- Juan David Hernández, Shlok Sobti, Anthony Sciola, Mark Moll, and Lydia E. Kavraki. 2020. Increasing Robot Autonomy via Motion Planning and an Augmented Reality Interface. IEEE Robotics and Automation Letters, Vol. 5, 2 (2020), 1017--1023.Google ScholarCross Ref
- Konstantinos Lotsaris, Nikos Fousekis, Spyridon Koukas, Sotiris Aivaliotis, Niki Kousi, George Michalos, and Sotiris Makris. 2021. Augmented reality (ar) based framework for supporting human workers in flexible manufacturing. Procedia CIRP, Vol. 96 (2021), 301--306.Google ScholarCross Ref
- Sotiris Makris, Panagiotis Karagiannis, Spyridon Koukas, and Aleksandros-Stereos Matthaiakis. 2016. Augmented reality system for operator support in human--robot collaborative assembly. CIRP Annals, Vol. 65, 1 (2016), 61--64.Google ScholarCross Ref
- George Michalos, Panagiotis Karagiannis, Sotiris Makris, Önder Tokçalar, and George Chryssolouris. 2016. Augmented reality (AR) applications for supporting human-robot interactive cooperation. Procedia CIRP, Vol. 41 (2016), 370--375.Google ScholarCross Ref
- Niryo. 2022. Niryo One, a collaborative and open source 6-axis robot. https://niryo.com/fr/product/niryo-one/ [Online; 08. March 2022].Google Scholar
- Rafael Radkowski, Jordan Herrema, and James H. Oliver. 2015. Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty. International Journal of Human-Computer Interaction, Vol. 31 (2015), 337--349.Google ScholarCross Ref
- Georgios Tsamis, Georgios Chantziaras, Dimitrios Giakoumis, Ioannis Kostavelis, Andreas Kargakos, Athanasios Tsakiris, and Dimitrios Tzovaras. 2021. Intuitive and Safe Interaction in Multi-User Human Robot Collaboration Environments through Augmented Reality Displays. In 2021 30th IEEE International Conference on Robot Human Interactive Communication (RO-MAN). 520--526.Google ScholarDigital Library
- Unity-Technologies. 2022. Pick-and-Place Tutorial. https://github.com/Unity-Technologies/Unity-Robotics-Hub/tree/main/tutorials/pick_and_place [Online; 03. March 2022].Google Scholar
- Michael Walker, Hooman Hedayati, Jennifer Lee, and Daniel Szafir. 2018. Communicating Robot Motion Intent with Augmented Reality. In 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 316--324.Google Scholar
- Alexander Wilkinson, Michael Gonzales, Patrick Hoey, David Kontak, Dian Wang, Noah Torname, Sam Laderoute, Zhao Han, Jordan Allspaw, Robert Platt, and Holly Yanco. 2021. Design guidelines for human-robot interaction with assistive robot manipulation systems. Paladyn, Journal of Behavioral Robotics, Vol. 12, 1 (2021), 392--401.Google ScholarCross Ref
- Chung Xue Er Shamaine, Yuansong Qiao, John Henry, Ken McNevin, and Niall Murray. 2020. RoSTAR: ROS-based Telerobotic Control via Augmented Reality. In 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP). 1--6.Google ScholarCross Ref
Index Terms
- Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations
Recommendations
Virtual, Augmented, and Mixed Reality for Human-Robot Interaction
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot InteractionThe 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI) will bring together HRI, Robotics, Artificial Intelligence, and Mixed Reality researchers to identify challenges in mixed reality interactions ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI)
HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot InteractionThe 4th International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) will bring together HRI, robotics, and mixed reality researchers to address challenges in mixed reality interactions between humans and robots. ...
Comments