Keiichi Ihara
Ryo Suzuki
ABSTRACT
This paper introduces HoloBots, a mixed reality remote collaboration system that augments holographic telepresence with synchronized mobile robots. Beyond existing mixed reality telepresence, HoloBots lets remote users not only be visually and spatially present, but also physically engage with local users and their environment. HoloBots allows the users to touch, grasp, manipulate, and interact with the remote physical environment as if they were co-located in the same shared space. We achieve this by synchronizing holographic user motion (Hololens 2 and Azure Kinect) with tabletop mobile robots (Sony Toio). Beyond the existing physical telepresence, HoloBots contributes to an exploration of broader design space, such as object actuation, virtual hand physicalization, world-in-miniature exploration, shared tangible interfaces, embodied guidance, and haptic communication. We evaluate our system with twelve participants by comparing it with hologram-only and robot-only conditions. Both quantitative and qualitative results confirm that our system significantly enhances the level of co-presence and shared experience, compared to the other conditions.
Supplemental Material
Available for Download
zip
3606727.zip (76.3 MB)
Supplemental File
- Sigurdur Orn Adalgeirsson and Cynthia Breazeal. 2010. MeBot: A robotic platform for socially embodied telepresence. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 15–22.Google Scholar
Cross Ref
- Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand challenges in shape-changing interface research. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–14.Google ScholarDigital Library
- Takafumi Aoki, Takashi Matsushita, Yuichiro Iio, Hironori Mitake, Takashi Toyama, Shoichi Hasegawa, Rikiya Ayukawa, Hiroshi Ichikawa, Makoto Sato, Takatsugu Kuriyama, 2005. Kobito: virtual brownies. In ACM SIGGRAPH 2005 emerging technologies. 11–es.Google ScholarDigital Library
- Huidong Bai, Prasanth Sasikumar, Jing Yang, and Mark Billinghurst. 2020. A user study on mixed reality remote collaboration with eye gaze and hand gesture sharing. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Scott Brave and Andrew Dahley. 1997. inTouch: a medium for haptic interpersonal communication. In CHI’97 Extended Abstracts on Human Factors in Computing Systems. 363–364.Google Scholar
- Scott Brave, Hiroshi Ishii, and Andrew Dahley. 1998. Tangible interfaces for remote collaboration and communication. In Proceedings of the 1998 ACM conference on Computer supported cooperative work. 169–178.Google ScholarDigital Library
- John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).Google Scholar
- Yuanzhi Cao, Xun Qian, Tianyi Wang, Rachel Lee, Ke Huo, and Karthik Ramani. 2020. An exploratory study of augmented reality presence for tutoring machine tasks. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Angela Chang, Sile O’Modhrain, Rob Jacob, Eric Gunther, and Hiroshi Ishii. 2002. ComTouch: design of a vibrotactile communication device. In Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques. 312–320.Google ScholarDigital Library
- Marcelo Coelho and Jamie Zigelbaum. 2011. Shape-changing interfaces. Personal and Ubiquitous Computing 15, 2 (2011), 161–173.Google ScholarDigital Library
- Samin Farajian, Hiroki Kaimoto, and Ryo Suzuki. 2022. Swarm Fabrication: Reconfigurable 3D Printers and Drawing Plotters Made of Swarm Robots. arXiv preprint arXiv:2202.10978 (2022).Google Scholar
- Mehrad Faridan, Bheesha Kumari, and Ryo Suzuki. 2023. ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on Classrooms. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Charith Lasantha Fernando, Masahiro Furukawa, Tadatoshi Kurogi, Sho Kamuro, Kouta Minamizawa, Susumu Tachi, 2012. Design of TELESAR V for transferring bodily consciousness in telexistence. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 5112–5118.Google ScholarCross Ref
- Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation.. In Uist, Vol. 13. 2501–988.Google Scholar
- Danilo Gasques, Janet G Johnson, Tommy Sharkey, Yuanyuan Feng, Ru Wang, Zhuoqun Robin Xu, Enrique Zavala, Yifei Zhang, Wanze Xie, Xinming Zhang, 2021. ARTEMIS: A collaborative mixed-reality system for immersive surgical telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
- Chad Harms and Frank Biocca. 2006. Internal Consistency and Reliability of the Networked Minds Social Presence Measure.Google Scholar
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9Google ScholarCross Ref
- Zhenyi He, Ruofei Du, and Ken Perlin. 2020. Collabovr: A reconfigurable framework for creative collaboration in virtual reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 542–554.Google ScholarCross Ref
- Zhenyi He, Fengyuan Zhu, and Ken Perlin. 2017. Physhare: Sharing physical interaction in virtual reality. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology. 17–19.Google ScholarDigital Library
- Hikaru Ibayashi, Yuta Sugiura, Daisuke Sakamoto, Natsuki Miyata, Mitsunori Tada, Takashi Okuma, Takeshi Kurata, Masaaki Mochimaru, and Takeo Igarashi. 2015. Dollhouse vr: a multi-view, multi-user collaborative design workspace with vr technology. In SIGGRAPH Asia 2015 Emerging Technologies. 1–2.Google Scholar
- Yunwoo Jeong, Han-Jong Kim, Gyeongwon Yun, and Tek-Jin Nam. 2020. WIKA: A projected augmented reality workbench for interactive kinetic art. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 999–1009.Google ScholarDigital Library
- Brennan Jones, Yaying Zhang, Priscilla NY Wong, and Sean Rintel. 2020. Vroom: virtual robot overlay for online meetings. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–10.Google ScholarDigital Library
- Brennan Jones, Yaying Zhang, Priscilla NY Wong, and Sean Rintel. 2021. Belonging there: VROOM-ing into the uncanny valley of XR telepresence. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–31.Google ScholarDigital Library
- Hiroki Kaimoto, Kyzyl Monteiro, Mehrad Faridan, Jiatong Li, Samin Farajian, Yasuaki Kakehi, Ken Nakagaki, and Ryo Suzuki. 2022. Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–12.Google ScholarDigital Library
- Shunichi Kasahara, Ryuma Niiyama, Valentin Heun, and Hiroshi Ishii. 2013. exTouch: spatially-aware embodied manipulation of actuated objects mediated by augmented reality. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. 223–228.Google ScholarDigital Library
- Florian Kennel-Maushart, Roi Poranne, and Stelian Coros. 2023. Interacting with Multi-Robot Systems via Mixed Reality. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE.Google ScholarCross Ref
- Han-Jong Kim, Ju-Whan Kim, and Tek-Jin Nam. 2016. Ministudio: Designers’ tool for prototyping ubicomp space with interactive miniature. In Proceedings of the 2016 CHI Conference on human factors in computing systems. 213–224.Google ScholarDigital Library
- Kangsoo Kim, Luke Boelling, Steffen Haesler, Jeremy Bailenson, Gerd Bruder, and Greg F Welch. 2018. Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in AR. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 105–114.Google ScholarCross Ref
- Lawrence H Kim, Daniel S Drew, Veronika Domova, and Sean Follmer. 2020. User-defined swarm robot control. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Lawrence H Kim and Sean Follmer. 2019. Swarmhaptics: Haptic display with swarm robots. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Seungwon Kim, Gun Lee, Mark Billinghurst, and Weidong Huang. 2020. The combination of visual communication cues in mixed reality remote collaboration. Journal on Multimodal User Interfaces 14, 4 (2020), 321–335.Google ScholarCross Ref
- Seungwon Kim, Gun Lee, Weidong Huang, Hayun Kim, Woontack Woo, and Mark Billinghurst. 2019. Evaluating the combination of visual communication cues for HMD-based mixed reality remote collaboration. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Minoru Kojima, Maki Sugimoto, Akihiro Nakamura, Masahiro Tomita, Hideaki Nii, and Masahiko Inami. 2006. Augmented coliseum: An augmented game environment with small vehicles. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’06). IEEE, 6–pp.Google ScholarDigital Library
- Hideaki Kuzuoka, Shinya Oyama, Keiichi Yamazaki, Kenji Suzuki, and Mamoru Mitsuishi. 2000. GestureMan: A mobile robot that embodies a remote instructor’s actions. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. 155–162.Google ScholarDigital Library
- Mathieu Le Goc, Lawrence H Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building blocks for swarm user interfaces. In Proceedings of the 29th annual symposium on user interface software and technology. 97–109.Google ScholarDigital Library
- Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 327–336.Google ScholarDigital Library
- Myungho Lee, Nahal Norouzi, Gerd Bruder, Pamela J Wisniewski, and Gregory F Welch. 2018. The physical-virtual table: exploring the effects of a virtual human’s physical influence on social interaction. In Proceedings of the 24th ACM symposium on virtual reality software and technology. 1–11.Google ScholarDigital Library
- Min Kyung Lee and Leila Takayama. 2011. "Now, i have a body" uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI conference on human factors in computing systems. 33–42.Google ScholarDigital Library
- Yujin Lee, Myeongseong Kim, and Hyunjung Kim. 2020. Rolling Pixels: Robotic Steinmetz Solids for Creating Physical Animations. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. 557–564.Google ScholarDigital Library
- Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 461–470.Google ScholarDigital Library
- Jakob Leitner, Michael Haller, Kyungdahm Yun, Woontack Woo, Maki Sugimoto, and Masahiko Inami. 2008. IncreTable, a mixed reality tabletop game experience. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology. 9–16.Google ScholarDigital Library
- Jiannan Li, Maurício Sousa, Chu Li, Jessie Liu, Yan Chen, Ravin Balakrishnan, and Tovi Grossman. 2022. ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration. In CHI Conference on Human Factors in Computing Systems. 1–14.Google Scholar
- Jiatong Li, Ryo Suzuki, and Ken Nakagaki. 2023. Physica: Interactive Tangible Physics Simulation based on Tabletop Mobile Robots Towards Explorable Physics Education. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 1485–1499.Google ScholarDigital Library
- Mark Marshall, Thomas Carter, Jason Alexander, and Sriram Subramanian. 2012. Ultra-tangibles: creating movable tangible objects on interactive tables. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2185–2188.Google ScholarDigital Library
- Thomas Muender, Anke V Reinschluessel, Sean Drewes, Dirk Wenig, Tanja Döring, and Rainer Malaka. 2019. Does it feel real? Using tangibles with different fidelities to build and explore scenes in virtual reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Ken Nakagaki, Joanne Leong, Jordan L Tappa, João Wilbert, and Hiroshi Ishii. 2020. Hermits: Dynamically reconfiguring the interactivity of self-propelled tuis with mechanical shell add-ons. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 882–896.Google ScholarDigital Library
- Ken Nakagaki, Jordan L Tappa, Yi Zheng, Jack Forman, Joanne Leong, Sven Koenig, and Hiroshi Ishii. 2022. (Dis) Appearables: A Concept and Method for Actuated Tangible UIs to Appear and Disappear based on Stages. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Hideyuki Nakanishi, Kei Kato, and Hiroshi Ishiguro. 2011. Zoom cameras and movable displays enhance social telepresence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 63–72.Google ScholarDigital Library
- Diana Nowacka, Karim Ladha, Nils Y Hammerla, Daniel Jackson, Cassim Ladha, Enrico Rukzio, and Patrick Olivier. 2013. Touchbugs: Actuated tangibles on multi-touch tables. In Proceedings of the SIGCHI conference on human factors in computing systems. 759–762.Google ScholarDigital Library
- Kohei Ogawa, Shuichi Nishio, Kensuke Koda, Giuseppe Balistreri, Tetsuya Watanabe, and Hiroshi Ishiguro. 2011. Exploring the natural reaction of young and aged person with telenoid in a real world.J. Adv. Comput. Intell. Intell. Informatics 15, 5 (2011), 592–597.Google ScholarCross Ref
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th annual symposium on user interface software and technology. 741–754.Google ScholarDigital Library
- Eimei Oyama, Kohei Tokoi, Ryo Suzuki, Sousuke Nakamura, Naoji Shiroma, Norifumi Watanabe, Arvin Agah, Hiroyuki Okada, and Takashi Omori. 2021. Augmented reality and mixed reality behavior navigation system for telexistence remote assistance. Advanced Robotics 35, 20 (2021), 1223–1241.Google ScholarCross Ref
- Eimei Oyama, Motoki Yodowatari, Sousuke Nakamura, Kohei Tokoi, Arvin Agah, Hiroyuki Okada, and Takashi Omori. 2021. Integrating AR/MR/DR technology in remote seal to maintain confidentiality of information. Advanced Robotics 35, 11 (2021), 704–714.Google ScholarCross Ref
- Gian Pangaro, Dan Maynes-Aminzade, and Hiroshi Ishii. 2002. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. In Proceedings of the 15th annual ACM symposium on User interface software and technology. 181–190.Google ScholarDigital Library
- James Patten and Hiroshi Ishii. 2007. Mechanical constraints as computational constraints in tabletop tangible interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 809–818.Google ScholarDigital Library
- Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2room: Enabling life-size telepresence in a projected augmented reality environment. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing. 1716–1725.Google ScholarDigital Library
- Thammathip Piumsomboon, Gun A Lee, Jonathon D Hart, Barrett Ens, Robert W Lindeman, Bruce H Thomas, and Mark Billinghurst. 2018. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Thammathip Piumsomboon, Gun A Lee, Andrew Irlitti, Barrett Ens, Bruce H Thomas, and Mark Billinghurst. 2019. On the shoulder of the giant: A multi-scale mixed reality collaboration with 360 video sharing and tangible interaction. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–17.Google ScholarDigital Library
- Ivan Poupyrev, Tatsushi Nashida, and Makoto Okabe. 2007. Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays. In Proceedings of the 1st international conference on Tangible and embedded interaction. 205–212.Google ScholarDigital Library
- Iulian Radu, Tugce Joy, and Bertrand Schneider. 2021. Virtual makerspaces: merging AR/VR/MR to enable remote collaborations in physical maker activities. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–5.Google ScholarDigital Library
- Irene Rae, Bilge Mutlu, and Leila Takayama. 2014. Bodies in motion: mobility, presence, and task awareness in telepresence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2153–2162.Google ScholarDigital Library
- Majken K Rasmussen, Esben W Pedersen, Marianne G Petersen, and Kasper Hornbæk. 2012. Shape-changing interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 735–744.Google ScholarDigital Library
- Dan Rosenfeld, Michael Zawadzki, Jeremi Sudol, and Ken Perlin. 2004. Physical objects as bidirectional user interface elements. IEEE Computer Graphics and Applications 24, 1 (2004), 44–49.Google ScholarDigital Library
- Daisuke Sakamoto, Takayuki Kanda, Tetsuo Ono, Hiroshi Ishiguro, and Norihiro Hagita. 2007. Android as a telecommunication medium with a human-like presence. In 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 193–200.Google ScholarDigital Library
- Mose Sakashita, Tatsuya Minagawa, Amy Koike, Ippei Suzuki, Keisuke Kawahara, and Yoichi Ochiai. 2017. You as a puppet: evaluation of telepresence user interface for puppetry. In Proceedings of the 30th annual ACM symposium on user Interface software and technology. 217–228.Google ScholarDigital Library
- Mose Sakashita, E Andy Ricci, Jatin Arora, and François Guimbretière. 2022. RemoteCoDe: Robotic Embodiment for Enhancing Peripheral Awareness in Remote Collaboration Tasks. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1–22.Google ScholarDigital Library
- J. Sauro. 2011. A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices. Measuring Usability LLC.Google Scholar
- Alexa F Siu, Shenli Yuan, Hieu Pham, Eric Gonzalez, Lawrence H Kim, Mathieu Le Goc, and Sean Follmer. 2018. Investigating tangible collaboration for design towards augmented physical telepresence. In Design thinking research. Springer, 131–145.Google Scholar
- Ryo Suzuki, Hooman Hedayati, Clement Zheng, James L. Bohn, Daniel Szafir, Ellen Yi-Luen Do, Mark D. Gross, and Daniel Leithinger. 2020. RoomShift: Room-Scale Dynamic Haptics for VR with Furniture-Moving Swarm Robots. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.Google ScholarDigital Library
- Ryo Suzuki, Adnan Karim, Tian Xia, Hooman Hedayati, and Nicolai Marquardt. 2022. Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–32. https://doi.org/10.1145/1122445.1122456Google ScholarDigital Library
- Ryo Suzuki, Jun Kato, Mark D Gross, and Tom Yeh. 2018. Reactile: Programming swarm user interfaces through direct physical manipulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Ryo Suzuki, Eyal Ofek, Mike Sinclair, Daniel Leithinger, and Mar Gonzalez-Franco. 2021. HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile Robots. In The 34th Annual ACM Symposium on User Interface Software and Technology. 1269–1281.Google Scholar
- Ryo Suzuki, Abigale Stangl, Mark D Gross, and Tom Yeh. 2017. Fluxmarker: Enhancing tactile graphics with dynamic tactile markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. 190–199.Google ScholarDigital Library
- Ryo Suzuki, Clement Zheng, Yasuaki Kakehi, Tom Yeh, Ellen Yi-Luen Do, Mark D Gross, and Daniel Leithinger. 2019. Shapebots: Shape-changing swarm robots. In Proceedings of the 32nd annual ACM symposium on user interface software and technology. 493–505.Google ScholarDigital Library
- Balasaravanan Thoravi Kumaravel, Fraser Anderson, George Fitzmaurice, Bjoern Hartmann, and Tovi Grossman. 2019. Loki: Facilitating remote instruction of physical tasks using bi-directional mixed-reality telepresence. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 161–174.Google ScholarDigital Library
- Ana M Villanueva, Ziyi Liu, Zhengzhe Zhu, Xin Du, Joey Huang, Kylie A Peppler, and Karthik Ramani. 2021. Robotar: An augmented reality compatible teleconsulting robotics toolkit for augmented makerspace experiences. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Junichi Yamaoka and Yasuaki Kakehi. 2013. dePENd: augmented handwriting system using ferromagnetism of a ballpoint pen. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 203–210.Google ScholarDigital Library
- Lilith Yu, Chenfeng Gao, David Wu, and Ken Nakagaki. 2023. AeroRigUI: Actuated TUIs for Spatial Interaction using Rigging Swarm Robots on Ceilings in Everyday Space. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.Google ScholarDigital Library
- Xiangyu Zhang, Xiaoliang Bai, Shusheng Zhang, Weiping He, Peng Wang, Zhuo Wang, Yuxiang Yan, and Quan Yu. 2022. Real-time 3D video-based MR remote collaboration using gesture cues and virtual replicas. The International Journal of Advanced Manufacturing Technology (2022), 1–23.Google Scholar
- Yiwei Zhao, Lawrence H Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic assembly of haptic proxy objects for tangible interaction and virtual reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 82–91.Google ScholarDigital Library
- Zhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang, Xun Qian, Pashin Farsak Raja, Ana Villanueva, and Karthik Ramani. 2022. MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-time. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–16.Google ScholarDigital Library
- Jakob Zillner, Christoph Rhemann, Shahram Izadi, and Michael Haller. 2014. 3D-board: a whole-body remote collaborative whiteboard. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 471–479.Google ScholarDigital Library
Index Terms
- HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed Reality
Recommendations
Real-time visual representations for mobile mixed reality remote collaboration
SA '18: SIGGRAPH Asia 2018 Virtual & Augmented RealityIn this study we present a Mixed-Reality based mobile remote collaboration system that enables an expert providing real-time assistance over a physical distance. By using the Google ARCore position tracking, we can integrate the keyframes captured with ...
Exploring enhancements for remote mixed reality collaboration
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsIn this paper, we explore techniques for enhancing remote Mixed Reality (MR) collaboration in terms of communication and interaction. We created CoVAR, a MR system for remote collaboration between an Augmented Reality (AR) and Augmented Virtuality (AV) ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Comments