Yuko Unuma
Takashi Komuro
ABSTRACT
In this paper, we propose an interaction system which displays see-through images on the mobile display and that allows a user to interact with virtual objects overlaid on the see-through image using the user's hand. In this system, the camera which tracks the user's viewpoint is attached to the front of the mobile display and the depth camera which captures color and depth images of the user's hand and the background scene is attached to the back of the mobile display. Natural interaction with virtual objects using the user's hand is realized by displaying images so that the appearance of a space through the mobile display is consistent with that of the real space from the user's viewpoint. We implemented two applications to the system and showed the usefulness of this system in various AR applications.
- M. L. Caballero et al., "Behand: Augmented Virtuality Gestural Interaction for Mobile Phones", Proc. MobileHCI 2010, pp. 451--454, 2010. Google Scholar
Digital Library
- M. Tomioka et al., "Approximated User-Perspective Rendering in Tablet-Based Augmented Reality", Proc. ISMAR 2013, pp. 21--28, 2013.Google Scholar
- H. Uchida and T. Komuro, "Geometrically Consistent Mobile AR for 3D Interaction", Proc. AH 2013, pp. 229--230, 2013. Google ScholarDigital Library
- D. Baricevic et al., "A Hand-Held AR Magic Lens with User-Perspective Rendering", Proc. ISMAR 2012, pp. 197--206, 2012. Google ScholarDigital Library
Index Terms
- See-through mobile AR system for natural 3D interaction
Recommendations
Geometrically consistent mobile AR for 3D interaction
AH '13: Proceedings of the 4th Augmented Human International ConferenceIn this study, we propose a method to present an image that maintains geometric consistency between the actual scene outside the mobile display and the camera image. Thereby, we expect that interaction with the virtual object through the mobile display ...
[POSTER] Natural 3D Interaction Using a See-Through Mobile AR System
ISMAR '15: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented RealityIn this paper, we propose an interaction system in which the appearance of the image displayed on a mobile display is consistent with that of the real space and that enables a user to interact with virtual objects overlaid on the image using the user's ...
Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences
Several studies have been carried out on augmented reality (AR)-based environments that deal with user interfaces for manipulating and interacting with virtual objects aimed at improving immersive feeling and natural interaction. Most of these studies ...
Comments