ABSTRACT
We develop and formally evaluate a metaphor for smartphone interaction with 3D environments: Tiltcasting. Under the Tiltcasting metaphor, users interact within a rotatable 2D plane that is "cast" from their phone's interactive display into 3D space. Through an empirical validation, we show that Tiltcasting supports efficient pointing, interaction with occluded objects, disambiguation between nearby objects, and object selection and manipulation in fully addressable 3D space. Our technique out-performs existing target agnostic pointing implementations, and approaches the performance of physical pointing with an off-the-shelf smartphone.
Supplemental Material
- Hrvoje Benko and Steven Feiner. 2007. Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. In 3D User Interfaces, 2007. 3DUI'07. IEEE Symposium on. IEEE.Google Scholar
- Kruijff Ernstm LaViola Joseph J. Bowman, Doug A. and Ivan Poupyrev. 2004. 3D user interfaces: theory and practice. Addison-Wesley. Google ScholarDigital Library
- Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proc. UIST. ACM, 173--182. Google ScholarDigital Library
- Zeynep Cipiloglu, Abdullah Bulbul, and Tolga Capin. 2010. A framework for enhancing depth perception in computer graphics. Proc. APGV 1 (2010), 141. Google ScholarDigital Library
- Norman D Cook, Asami Yutsudo, Naoki Fujimoto, and Mayu Murata. 2008. Factors contributing to depth perception: behavioral studies on the reverse perspective illusion. Spat. Vis. 21 (2008), 397--405.Google ScholarCross Ref
- Niklas Elmqvist and Philippas Tsigas. 2008. A taxonomy of 3D occlusion management for visualization. IEEE TVCG 14 (2008), 1095--1109. Google ScholarDigital Library
- Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays. Proc. UIST (2006), 3. Google ScholarDigital Library
- Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proc CHI (CHI '15). ACM, 3653--3656. Google ScholarDigital Library
- Nicholas Katzakis, Kiyoshi Kiyokawa, and Haruo Takemura. 2013. Plane-Casting: 3D Cursor Control With A SmartPhone. In Proc APCHI. ACM, 199--200. Google ScholarDigital Library
- Nicholas Katzakis, Robert J Teather, Kiyoshi Kiyokawa, and Haruo Takemura. 2015. INSPECT: Extending Plane-Casting for 6-DOF Control. In 3DUI.Google Scholar
- Mikko Kytö, Aleksi Mäkinen, Jukka Häkkinen, and Pirkko Oittinen. 2013. Improving relative depth judgments in augmented reality with auxiliary augmentations. ACM TAP 10, 1 (Feb. 2013), 1--21. Google ScholarDigital Library
- Michael Mauderer, Simone Conte, Miguel Nacenta, and Dhanraj Vishwanath. 2014. Depth perception with gaze-contingent depth of field. Proc. CHI (2014), 217--226. Google ScholarDigital Library
- Krzysztof Pietroszek, Anastasia Kuzminykh, James Wallace, and Edward Lank. 2014. Smartcasting: A Discount 3D Interaction Technique for Public Displays. In Proc. OzChi'14. ACM, 1--10. Google ScholarDigital Library
- Krzysztof Pietroszek and Edward Lank. 2012. Clicking Blindly: Using Spatial Correspondence to Select Targets in Multi-device Environments. In Proc. MobileHCI. ACM, 331--334. Google ScholarDigital Library
- Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-draw: A tool for designing 3d shapes. (1991).Google Scholar
- A R Travis. 1990. Autostereoscopic 3-D display. Applied Optics 29 (1990), 4341--4342.Google ScholarCross Ref
- Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments. Proc 3DUI (2007), 117--124.Google ScholarCross Ref
- L.R. Wanger, J.A. Ferwerda, and D.P. Greenberg. 1992. Perceiving spatial relationships in computer-generated images. CG&A 12 (1992). Google ScholarDigital Library
- HP Wyss, Roland Blach, and Matthias Bues. 2006. iSith Intersection-based spatial interaction for two hands. Proc 3DUI (2006), 59--61. Google ScholarCross Ref
Index Terms
- Tiltcasting: 3D Interaction on Large Displays using a Mobile Device
Recommendations
Interacting with 3D Content on Stereoscopic Displays
PerDis '14: Proceedings of The International Symposium on Pervasive DisplaysAlong with the number of pervasive displays in urban environments, recent advances in technology allow to display three-dimensional (3D) content on these displays. However, current input techniques for pervasive displays usually focus on interaction ...
Extending a mobile device's interaction space through body-centric interaction
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and servicesModern mobile devices rely on the screen as a primary input modality. Yet the small screen real-estate limits interaction possibilities, motivating researchers to explore alternate input techniques. Within this arena, our goal is to develop Body-Centric ...
TMAR: extension of a tabletop interface using mobile augmented reality
Transactions on edutainment IRecently, many researchers have worked on tabletop systems. One issue with tabletop interfaces is how to control the table without using conventional desktop input devices such as a keyboard or mouse. A second issue is allowing multiple users to ...
Comments