skip to main content
10.1145/2807442.2807471acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Tiltcasting: 3D Interaction on Large Displays using a Mobile Device

Published:05 November 2015Publication History

ABSTRACT

We develop and formally evaluate a metaphor for smartphone interaction with 3D environments: Tiltcasting. Under the Tiltcasting metaphor, users interact within a rotatable 2D plane that is "cast" from their phone's interactive display into 3D space. Through an empirical validation, we show that Tiltcasting supports efficient pointing, interaction with occluded objects, disambiguation between nearby objects, and object selection and manipulation in fully addressable 3D space. Our technique out-performs existing target agnostic pointing implementations, and approaches the performance of physical pointing with an off-the-shelf smartphone.

Skip Supplemental Material Section

Supplemental Material

p57.mp4

mp4

50.4 MB

References

  1. Hrvoje Benko and Steven Feiner. 2007. Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. In 3D User Interfaces, 2007. 3DUI'07. IEEE Symposium on. IEEE.Google ScholarGoogle Scholar
  2. Kruijff Ernstm LaViola Joseph J. Bowman, Doug A. and Ivan Poupyrev. 2004. 3D user interfaces: theory and practice. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proc. UIST. ACM, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Zeynep Cipiloglu, Abdullah Bulbul, and Tolga Capin. 2010. A framework for enhancing depth perception in computer graphics. Proc. APGV 1 (2010), 141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Norman D Cook, Asami Yutsudo, Naoki Fujimoto, and Mayu Murata. 2008. Factors contributing to depth perception: behavioral studies on the reverse perspective illusion. Spat. Vis. 21 (2008), 397--405.Google ScholarGoogle ScholarCross RefCross Ref
  6. Niklas Elmqvist and Philippas Tsigas. 2008. A taxonomy of 3D occlusion management for visualization. IEEE TVCG 14 (2008), 1095--1109. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays. Proc. UIST (2006), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proc CHI (CHI '15). ACM, 3653--3656. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Nicholas Katzakis, Kiyoshi Kiyokawa, and Haruo Takemura. 2013. Plane-Casting: 3D Cursor Control With A SmartPhone. In Proc APCHI. ACM, 199--200. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Nicholas Katzakis, Robert J Teather, Kiyoshi Kiyokawa, and Haruo Takemura. 2015. INSPECT: Extending Plane-Casting for 6-DOF Control. In 3DUI.Google ScholarGoogle Scholar
  11. Mikko Kytö, Aleksi Mäkinen, Jukka Häkkinen, and Pirkko Oittinen. 2013. Improving relative depth judgments in augmented reality with auxiliary augmentations. ACM TAP 10, 1 (Feb. 2013), 1--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Michael Mauderer, Simone Conte, Miguel Nacenta, and Dhanraj Vishwanath. 2014. Depth perception with gaze-contingent depth of field. Proc. CHI (2014), 217--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Krzysztof Pietroszek, Anastasia Kuzminykh, James Wallace, and Edward Lank. 2014. Smartcasting: A Discount 3D Interaction Technique for Public Displays. In Proc. OzChi'14. ACM, 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Krzysztof Pietroszek and Edward Lank. 2012. Clicking Blindly: Using Spatial Correspondence to Select Targets in Multi-device Environments. In Proc. MobileHCI. ACM, 331--334. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-draw: A tool for designing 3d shapes. (1991).Google ScholarGoogle Scholar
  16. A R Travis. 1990. Autostereoscopic 3-D display. Applied Optics 29 (1990), 4341--4342.Google ScholarGoogle ScholarCross RefCross Ref
  17. Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments. Proc 3DUI (2007), 117--124.Google ScholarGoogle ScholarCross RefCross Ref
  18. L.R. Wanger, J.A. Ferwerda, and D.P. Greenberg. 1992. Perceiving spatial relationships in computer-generated images. CG&A 12 (1992). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. HP Wyss, Roland Blach, and Matthias Bues. 2006. iSith Intersection-based spatial interaction for two hands. Proc 3DUI (2006), 59--61. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Tiltcasting: 3D Interaction on Large Displays using a Mobile Device

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology
      November 2015
      686 pages
      ISBN:9781450337793
      DOI:10.1145/2807442

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 November 2015

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      UIST '15 Paper Acceptance Rate70of297submissions,24%Overall Acceptance Rate842of3,967submissions,21%

      Upcoming Conference

      UIST '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader