Oscar Kin-Chung Au
ABSTRACT
We present a simple finger registration technique that can distinguish in real-time which hand and fingers of the user are touching the touchscreen. The finger registration process is activated whenever the user places a hand, in any orientation, anywhere on the touchscreen. Such a finger registration technique enables the design of intuitive multitouch interfaces that directly map different combinations of the user's fingers to the interface operations. In this paper, we first study the effectiveness and robustness of the finger registration process. We then demonstrate the usability of our finger registration method for two new interfaces. Specifically, we describe the Palm Menu, which is an intuitive dynamic menu interface that minimizes hand and eye movement during operations, and a virtual mouse interface that enables user to perform mouse operations in multitouch environment. We conducted controlled experiments to compare the performance of the Palm Menu against common command selection interfaces and the virtual mouse against traditional pointing devices.
- Bailly, G., Lecolinet, E., and Guiard, Y. (2010). Finger-Count and Radial-Stroke Shortcuts: Two Techniques for Augmenting Linear Menus. ACM CHI. 591--594. Google Scholar
Digital Library
- Brandl, P., Forlines, C. Wigdor, D., Haller, M., Shen, C. (2008). Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction on Horizontal Interfaces. ACM AVI. 154--161. Google ScholarDigital Library
- Card, S. K. (1982). User perceptual mechanisms in the search of computer command menus. ACM CHI. 190--196. Google ScholarDigital Library
- Davidson, P. L. and Han, J. Y. (2008). Extending 2D object arrangement with pressure-sensitive layering cues. ACM UIST. 8790. Google ScholarDigital Library
- Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST. 219--226. Google ScholarDigital Library
- Fingerworks, Inc. (2008). User's Guide. http://www.fingerworks.com/gesture_guide_mouse.htmlGoogle Scholar
- Esenther, A. and Ryall, K. (2006). Fluid DTMouse: better mouse support for touch-based interactions. In Proceedings of the Working Conference on Advanced Visual interfaces. 112--115. Google ScholarDigital Library
- Holz, C and Baudisch, P. (2010) The Generalized Perceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints, ACM CHI. 581--590. Google ScholarDigital Library
- Hopkins, D. (1991). The design and implementation of pie menus. In Dr. Dobb's J. 16, 12 (Dec. 1991), 16--26. Google ScholarDigital Library
- Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, (2007). ThinSight: integrated optical multi-touch sensing through thin form-factor displays. Proceedings of the 2007 workshop on Emerging displays technologies, vol. 252. Google ScholarDigital Library
- Lepinski, J., Grossman, T., Fitzmaurice, G. (2010). The design and evaluation of multitouch marking menus ACM CHI. 2233--2242. Google ScholarDigital Library
- Malik, S., Ranjan, A., Balakrishnan. R. (2005). Interacting with large displays from a distance with vision-tracked multi-finger gestural input. ACM UIST. 43--52. Google ScholarDigital Library
- Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. (2009). The design and evaluation of multi-finger mouse emulation techniques. ACM CHI. Google ScholarDigital Library
- Moscovich, T., Hughes, J. F. (2006). Multi-finger cursor techniques. Proceedings of Graphics interface. 1--7. Google ScholarDigital Library
- Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI. 113--120. Google ScholarDigital Library
- Wang, F., Ren, X., Cao, X., Irani, P. (2009). Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. ACM UIST. 23--32. Google ScholarDigital Library
- Wilson, A. (2005). PlayAnywhere: A Compact Tabletop Computer Vision System. ACM UIST. 83--92. Google ScholarDigital Library
- Wu, M., Balakrishnan, R. (2003). Multi-finger and whole hand gestural interaction techniques for multiuser tabletop displays. ACM UIST. 193--202. Google ScholarDigital Library
Index Terms
- Multitouch finger registration and its applications
Recommendations
The design and evaluation of multitouch marking menus
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsDespite the considerable quantity of research directed towards multitouch technologies, a set of standardized UI components have not been developed. Menu systems provide a particular challenge, as traditional GUI menus require a level of pointing ...
Multi-finger AR typing interface for mobile devices
IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User InterfacesIn this paper, we propose a user interface that enables multi-finger typing in the space behind a mobile device. By using the augmented reality (AR) technology, a virtual keyboard is superimposed on the rear camera image, and a hand region of the camera ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Comments