Thomas Fröhlich
Tanja Döring
ABSTRACT
Augmented sandboxes have been used as playful and educative tools to create, explore and understand complex models. However, current solutions lack interactive capabilities, missing more immersive experiences such as exploring the sand landscape from a first person perspective. We extend the interaction space of augmented sandboxes into virtual reality (VR) to offer a VR-environment that contains a landscape, which the user designs via interacting with real sand while wearing a virtual reality head-mounted display (HMD). In this paper, we present our current VR-sandbox system consisting of a box with sand, triple Kinect depth sensing, a virtual reality HMD, and hand tracking, as well as an interactive world simulation use case for exploration and evaluation. Our work explores the important and timely topics how to integrate rich haptic interaction with natural materials into VR and how to track and present real physical materials in VR. In a qualitative evaluation with nine experts from computer graphics, game design, and didactics we identified potentials, limitations as well as future application scenarios.
- AUDI AG. 2017. Enter Sandbox. (2017).Google Scholar
- Steffi Beckhaus, Roland Schröder-Kroll, and Martin Berghoff. 2008. Back to the Sandbox : Playful Interaction with Granules Landscapes. In Proceedings of the 2Nd International Conference on Tangible and Embedded Interaction (TEI '08). ACM, New York, NY, USA, 141--144. Google ScholarDigital Library
- Jean-Yves Bouguet. 2004. Camera Calibration Toolbox for Matlab. (2004).Google Scholar
- J. Brooke. 1996. SUS : A "Quick and Dirty" Usability Scale. In Usability Evaluation in Industry , P. W. Jordan, B. Thomas, B. A. Weerdmester, and I. McClelland (Eds.). Taylor & Francis, London, 189--194. 0000Google Scholar
- Cristiano Carvalheiro, Rui Nóbrega, Hugo da Silva, and Rui Rodrigues. 2016. User Redirection and Direct Haptics in Virtual Environments. In Proceedings of the 2016 ACM on Multimedia Conference (MM '16). ACM, New York, NY, USA, 1146--1155. Google ScholarDigital Library
- Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. TurkDeck: Physical Virtual Reality Based on People. ACM Press, 417--426. Google ScholarDigital Library
- Colossal Order and Karoliina Korppoo. 2015. Cities: Skylines. Game {PC}, (10 March 2015). Paradox Interactive, Stockholm, Sweden. Last played May 2017.Google Scholar
- Joel Couture. 2017. Alt.CTRL .GDC Showcase: Sand Garden. (2017).Google Scholar
- Tanja Döring, Axel Sylvester, and Albrecht Schmidt. 2013. A Design Space for Ephemeral User Interfaces. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 75--82. Google ScholarDigital Library
- Jonna Häkkila, Yun He, and Ashley Colley. 2015. Experiencing the Elements -- User Study with Natural Material Probes. In Human-Computer Interaction -- INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Springer International Publishing, Cham, 324--331.Google ScholarDigital Library
- Daniel Harley, Alexander Verni, Mackenzie Willis, Ashley Ng, Lucas Bozzo, and Ali Mazalek. 2018. Sensory VR: Smelling, Touching, and Eating Virtual Reality. ACM Press, 386--397. Google ScholarDigital Library
- H. G. Hoffman. 1998. Physically Touching Virtual Objects Using Tactile Augmentation Enhances the Realism of Virtual Environments. In Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180 ). 59--63. Google ScholarDigital Library
- H. Ishii, C. Ratti, B. Piper, Y. Wang, A. Biderman, and E. Ben-Joseph. 2004. Bringing Clay and Sand into Digital Design textemdash Continuous Tangible User Interfaces. BT Technology Journal 22, 4 (Oct. 2004), 287--299. Google ScholarDigital Library
- Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. ACM Press, 234--241. Google ScholarDigital Library
- Paul James. 2014. 'Kintinuous ' Fuses Virtual and Reality with the Oculus Rift and Kinect. (June 2014).Google Scholar
- Olga Jarrett, Stacey French-Lee, Nermin Bulunuz, and Mizrap Bulunuz. 2010. Play in the Sandpit: A University and a Child-Care Center Collaborate in Facilitated-Action Research. American Journal of Play 3, 2 (2010), 221--237. https://eric.ed.gov/?id=EJ1070242Google Scholar
- Eike Langbehn and Frank Steinicke. 2018. Redirected Walking in Virtual Reality. (2018).Google Scholar
- Markus Persson and Jens Bergensten. 2009. Minecraft. Game {PC}, (18 Nov. 2009). Mojang, Stockholm, Sweden. Last played August 2017.Google Scholar
- Niels Christian Nilsson, Stefania Serafin, Frank Steinicke, and Rolf Nordahl. 2018. Natural Walking in Virtual Reality: A Review. Comput. Entertain. 16, 2, Article 8 (April 2018), 22 pages. Google ScholarDigital Library
- Peter Molyneux. 2001. Black & White. Guildford, UK.Google Scholar
- Marissa Díaz Pier and Isaac Rudomín Goldberg. 2005. Using Water as Interface Media in VR Applications. ACM Press, 162--169. Google ScholarDigital Library
- Ben Piper, Carlo Ratti, and Hiroshi Ishii. 2002. Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. ACM Press, 355. Google ScholarDigital Library
- Sharif Razzaque, Zachariah Kohn, and Mary C Whitton. 2001. Redirected walking. In Proceedings of EUROGRAPHICS, Vol. 9. Citeseer, 105--106.Google ScholarDigital Library
- SE Reed, O Kreylos, S Hsi, LH Kellogg, G Schladow, MB Yikilmaz, H Segale, J Silverman, S Yalowitz, and E Sato. 2014. Shaping Watersheds Exhibit: An Interactive, Augmented Reality Sandbox for Advancing Earth Science Education. In AGU Fall Meeting Abstracts , Vol. 1. 01.Google Scholar
- Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner Garden: Connecting Inner States to a Mixed Reality Sandbox for Mindfulness. ACM Press, 1459--1470. Google ScholarDigital Library
- Sergio Álvarez Sánchez, Laura Delgado Mart'in, Miguel Ángel Gimeno-González, Teresa Mart'in-Garcia, Fernando Almaraz-Menéndez, and Camilo Ruiz. 2016. Augmented Reality Sandbox: A Platform for Educative Experiences. In Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality. ACM, 599--602. Google ScholarDigital Library
- Dorothé Smit, Thomas Grah, Martin Murer, Vincent van Rheden, and Manfred Tscheligi. 2018. MacroScope: First -Person Perspective in Physical Scale Models. ACM Press, 253--259. Google ScholarDigital Library
- M. Sra, S. Garrido-Jurado, and P. Maes. 2018. Oasis: Procedurally Generated Social Virtual Spaces from 3D Scanned Real Spaces. IEEE Transactions on Visualization and Computer Graphics (2018), 1--1. http://dx.doi.org/10/gc3kmnGoogle Scholar
- Z. Zhang. 2000. A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 11 (Nov. 2000), 1330--1334. Google ScholarDigital Library
Index Terms
- VRBox: A Virtual Reality Augmented Sandbox for Immersive Playfulness, Creativity and Exploration
Recommendations
Demonstrating VRBox: A Virtual Reality Augmented Sandbox
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsWe present VRBox--an interactive sandbox for playful and immersive terraforming that combines the approach of augmented sandboxes with virtual reality technology and mid-air gestures. Our interactive demonstration offers a virtual reality (VR) ...
Developing an augmented reality racing game
INTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINmentAugmented reality (AR) makes it possible to create games in which virtual objects are overlaid on the real world, and real objects are tracked and used to control virtual ones. We describe the development of an AR racing game created by modifying an ...
Tangible VR: Traversing Space in XR to Grow a Virtual Butterfly
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User InteractionImmersive reality technologies have been widely utilized in the area of cultural heritage, also known as Virtual Heritage. We present a tangible Virtual Reality (VR) interaction demo that allows users to freely walk in the physical space while engaging ...
Comments