Mathias Baglioni
ABSTRACT
This paper introduces JerkTilts, quick back-and-forth gestures that combine device pitch and roll. JerkTilts may serve as gestural self-delimited shortcuts for activating commands. Because they only depend on device acceleration and rely on a parallel and independent input channel, these gestures do not interfere with finger activity on the touch screen. Our experimental data suggest that recognition rates in an eight-choice selection task are as high with JerkTilts as with thumb slides on the touch screen. We also report data confirming that JerkTilts can be combined successfully with simple touch-screen operation. Data from a field study suggest that inadvertent JerkTilts are unlikely to occur in real-life contexts. We describe three illustrative implementations of JerkTilts, which show how the technique helps to simplify and shorten the sequence of actions to reach frequently used commands.
- Bragdon A., Nelson E., Li Y., Hinckley K. 2011. Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments. In Proc. CHI'11. Google Scholar
Digital Library
- Crossan A., Williamson J., Brewster S., Murray-Smith. R 2008. Wrist rotation for interaction in mobile contexts. In Proc. MobileHCI '08. ACM, 435--438. Google ScholarDigital Library
- Dachselt, R., Buchholz, R. 2008. Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays. In Proc. CHI '09 Extended Abstracts. Google ScholarDigital Library
- Dearman, D., Karlson, A., Meyers, B., and Bederson, B. 2010. Multi-modal text entry and selection on a mobile device. In Proc GI'10. Google ScholarDigital Library
- Francone, J., Bailly, G., Lecolinet, E., Mandran, N., and Nigay, L. 2010. Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode. In Proc. AVI'10. ACM. Google ScholarDigital Library
- Harrison, B. L., Fishkin, K. P., Gujar, A., Mochon, C.,Want, R. 1998. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proc. CHI'98, ACM 17--24. Google ScholarDigital Library
- Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proc. UIST'00. ACM, 91--100. Google ScholarDigital Library
- Hinckley K., Song H., 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. In Proc. CHI'11. ACM. Google ScholarDigital Library
- Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. 2010. GesText: accelerometer-based gestural text-entry systems. In Proc. CHI '10. ACM. 2173--2182. Google ScholarDigital Library
- Guiard, Y. 1993. On Fitts' and Hooke's laws : simple harmonic movement in upper-limb cyclical aiming. Acta Psychologica, 82, 139--159.Google ScholarCross Ref
- Kauppila M. 2008. Filler Models for Accelerometer Based Continuous Gesture Recognition. Sc.Thesis, Dept. of Mathematical Sciences, University of Oulu, May 2008.Google Scholar
- KNN: http://en.wikipedia.org/wiki/K_nearest_neighbor_algorithmGoogle Scholar
- Kurtenbach, G. and Buxton, W. 1991. Issues in combining marking and direct manipulation techniques. In Proc UIST '91. ACM, 137--144. Google ScholarDigital Library
- Oakley, I. and Park, J. 2007. A motion-based mark-ing menu system. In Proc. CHI'07. ACM, New York, NY, 2597--2602. Google ScholarDigital Library
- Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., and Want, R. 2002. TiltType: accelerometer-supported text entry for very small devices. In Proc. UIST '02. ACM. Google ScholarDigital Library
- Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E. 2000. Context and interaction in zoomable user interfaces. In Proc. AVI '00. ACM, 227--231. Google ScholarDigital Library
- Rahman, M., Gustafson, S., Irani, P., and Subramanian, S. 2009. Tilt techniques: investigating the dexterity of wrist-based input. In Proc. CHI'09. ACM, 1943--1952. Google ScholarDigital Library
- Rekimoto, J. (1996). Tilting operations for small screen interfaces. In Proc. UIST '96. ACM, 167--168. Google ScholarDigital Library
- Rehm, M., Nikolaus, B., and André, E. 2008. Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions. In Proc. BCS-HCI '08, Vol. 1. British Computer Society, 13--22. Google ScholarDigital Library
- Roudaut A., Baglioni M. et Lecolinet E. 2009. TimeTilt: Using Sensor-Based Gestures to Travel Through Multiple Applications on a Mobile Device. In Proc. INTERACT'09. Springer-Verlag. Google ScholarDigital Library
- Ruiz J., Li Y. 2011 DoubleFlip: A Motion Gesture Delimiter for Mobile Interaction. In Proc. CHI '11. ACM. Google ScholarDigital Library
- Sazawal, V., Want, W., and Borriello, G. 2002. The Unigesture Approach. In Proc. Mobile HCI '02. Fabio Paternè (Ed.). Springer-Verlag, 256--270. Google ScholarDigital Library
- Van Tonder, B., and Wesson, J. 2010. Is tilt interaction better than keypad interaction for mobile map-based applications?. In Proc. SAICSIT '10. ACM,, 322--331. Google ScholarDigital Library
- Wigdor, D. and Balakrishnan, R. 2003. TiltText: using tilt for text input to mobile phones. In Proc. UIST'03. ACM, 81--90. Google ScholarDigital Library
Index Terms
- JerkTilts: using accelerometers for eight-choice selection on mobile devices
Recommendations
Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal InteractionHumans rely on eye gaze and hand manipulations extensively in their everyday activities. Most often, users gaze at an object to perceive it and then use their hands to manipulate it. We propose applying a multimodal, gaze plus free-space gesture ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Impact of mobile tangible slider design and its reachability on pointing performance
IHM '16: Actes de la 28ième conference francophone sur l'Interaction Homme-MachineTouch interaction is almost omnipresent on mobile devices and technological advances have made screens bigger. The users can then interact with more content displayed on screen but it is more difficult for the users to reach all the parts of the screen ...
Comments