skip to main content
10.1145/3568294.3580089acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
short-paper

Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

Published:13 March 2023Publication History

ABSTRACT

As the use of Augmented Reality (AR) to enhance interactions between human agents and robotic systems in a work environment continues to grow, robots must communicate their intents in informative yet straightforward ways. This improves the human agent's feeling of trust and safety in the work environment while also reducing task completion time. To this end, we discuss a set of guidelines for the systematic design of AR interfaces for Human-Robot Interaction (HRI) systems. Furthermore, we develop design frameworks that would ride on these guidelines and serve as a base for researchers seeking to explore this direction further. We develop a series of designs for visually representing the robot's planned path and reactions, which we evaluate by conducting a user survey involving 14 participants. Subjects were given different design representations to review and rate based on their intuitiveness and informativeness. The collated results showed that our design representations significantly improved the participants' ease of understanding the robot's intents over the baselines for the robot's proposed navigation path, planned arm trajectory, and reactions.

Skip Supplemental Material Section

Supplemental Material

Enhancing Human-Robot Collaboration By Exploring Intuitive Augmented Reality Design Representations.mp4

mp4

3.9 MB

References

  1. Oscar Danielsson. 2016. Designing Augmented Reality Interfaces for Human-Robot Collaboration in Engine Assembly: Research Proposal.Google ScholarGoogle Scholar
  2. Andreas Dünser, Raphaël Grasset, Hartmut Seichter, and Mark Billinghurst. 2007. Applying HCI principles to AR systems design.Google ScholarGoogle Scholar
  3. Hoda A ElMaraghy. 2005. Flexible and reconfigurable manufacturing systems paradigms. International journal of flexible manufacturing systems, Vol. 17, 4 (2005), 261--276.Google ScholarGoogle ScholarCross RefCross Ref
  4. HC Fang, SK Ong, and AYC Nee. 2012. Interactive robot trajectory planning and simulation using augmented reality. Robotics and Computer-Integrated Manufacturing, Vol. 28, 2 (2012), 227--237.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Mario Hermann, Tobias Pentek, and Boris Otto. 2016. Design Principles for Industrie 4.0 Scenarios. In 2016 49th Hawaii International Conference on System Sciences (HICSS). 3928--3937.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Juan David Hernández, Shlok Sobti, Anthony Sciola, Mark Moll, and Lydia E. Kavraki. 2020. Increasing Robot Autonomy via Motion Planning and an Augmented Reality Interface. IEEE Robotics and Automation Letters, Vol. 5, 2 (2020), 1017--1023.Google ScholarGoogle ScholarCross RefCross Ref
  7. Konstantinos Lotsaris, Nikos Fousekis, Spyridon Koukas, Sotiris Aivaliotis, Niki Kousi, George Michalos, and Sotiris Makris. 2021. Augmented reality (ar) based framework for supporting human workers in flexible manufacturing. Procedia CIRP, Vol. 96 (2021), 301--306.Google ScholarGoogle ScholarCross RefCross Ref
  8. Sotiris Makris, Panagiotis Karagiannis, Spyridon Koukas, and Aleksandros-Stereos Matthaiakis. 2016. Augmented reality system for operator support in human--robot collaborative assembly. CIRP Annals, Vol. 65, 1 (2016), 61--64.Google ScholarGoogle ScholarCross RefCross Ref
  9. George Michalos, Panagiotis Karagiannis, Sotiris Makris, Önder Tokçalar, and George Chryssolouris. 2016. Augmented reality (AR) applications for supporting human-robot interactive cooperation. Procedia CIRP, Vol. 41 (2016), 370--375.Google ScholarGoogle ScholarCross RefCross Ref
  10. Niryo. 2022. Niryo One, a collaborative and open source 6-axis robot. https://niryo.com/fr/product/niryo-one/ [Online; 08. March 2022].Google ScholarGoogle Scholar
  11. Rafael Radkowski, Jordan Herrema, and James H. Oliver. 2015. Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty. International Journal of Human-Computer Interaction, Vol. 31 (2015), 337--349.Google ScholarGoogle ScholarCross RefCross Ref
  12. Georgios Tsamis, Georgios Chantziaras, Dimitrios Giakoumis, Ioannis Kostavelis, Andreas Kargakos, Athanasios Tsakiris, and Dimitrios Tzovaras. 2021. Intuitive and Safe Interaction in Multi-User Human Robot Collaboration Environments through Augmented Reality Displays. In 2021 30th IEEE International Conference on Robot Human Interactive Communication (RO-MAN). 520--526.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Unity-Technologies. 2022. Pick-and-Place Tutorial. https://github.com/Unity-Technologies/Unity-Robotics-Hub/tree/main/tutorials/pick_and_place [Online; 03. March 2022].Google ScholarGoogle Scholar
  14. Michael Walker, Hooman Hedayati, Jennifer Lee, and Daniel Szafir. 2018. Communicating Robot Motion Intent with Augmented Reality. In 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 316--324.Google ScholarGoogle Scholar
  15. Alexander Wilkinson, Michael Gonzales, Patrick Hoey, David Kontak, Dian Wang, Noah Torname, Sam Laderoute, Zhao Han, Jordan Allspaw, Robert Platt, and Holly Yanco. 2021. Design guidelines for human-robot interaction with assistive robot manipulation systems. Paladyn, Journal of Behavioral Robotics, Vol. 12, 1 (2021), 392--401.Google ScholarGoogle ScholarCross RefCross Ref
  16. Chung Xue Er Shamaine, Yuansong Qiao, John Henry, Ken McNevin, and Niall Murray. 2020. RoSTAR: ROS-based Telerobotic Control via Augmented Reality. In 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP). 1--6.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
        March 2023
        612 pages
        ISBN:9781450399708
        DOI:10.1145/3568294

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 March 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        Overall Acceptance Rate242of1,000submissions,24%
      • Article Metrics

        • Downloads (Last 12 months)76
        • Downloads (Last 6 weeks)8

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader