Katrin Wolf
ABSTRACT
The idea of capitalizing on the hand's degrees of freedom while grasping for gesture-based control motivates my research. The question is: to what extent can users interact with grasped objects through tiny finger gestures that are performed whilst grasping? This extended abstract is a position paper on developing a paradigm for interacting with everyday objects. I focus on designing ergonomic microinteractions and interfaces regarding human motor abilities, interaction preferences, and the understanding of the users themselves within their environment. The basis of the investigated interaction designs is a taxonomy for microgestures that is developed in an expert study. In proof-of-concept user studies with interactive prototypes, I evaluate microgesture-based interactions and generalize them to a post WIMP paradigm for interacting with grasped objects. The paradigm contains design implications for occluded gestures relying on embodied knowledge about grasping objects.
- Beaudouin-Lafon, M. 2000. Instrumental interaction: An interaction model for designing post-WIMP user interfaces. In Proc. CHI 2000, 446--453. Google Scholar
Digital Library
- Döring, T., Kern, D., Marshall, P., Pfeiffer, M., Schöning, J., Gruhn, V., Schmidt, A. 2011. Gestural interaction on the steering wheel: reducing the visual demand. In Proc. CHI 2011, 483--492. Google ScholarDigital Library
- Graziano, M. S. A., Botvinick, M. M. 2002. How the brain represents the body: Insights from neurophysiology and psychology (2002) Common Mechanisms in Perception and Action: Attention and Performance XIX, 136--157.Google Scholar
- Gustafson, S., Bierwirth, D., Baudisch, P. 2010. Imaginary Interfaces: Spatial Interaction with Empty Hands and Without Visual Feedback. In Proc. UIST 2010, 3--12. Google ScholarDigital Library
- Ishii, H., Ullmer, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proc. CHI 1997, 234--241. Google ScholarDigital Library
- Maravata, A., Spence, C., Driver, J. 2003. Multisensory Integration and the Body Schema: Close to Hand and Within Reach, Current Biology, Vol. 13, July 1, 2003, 531--539. Mistry, P., Maes, P., Chang, L. 2009. WUW - wear Ur world: a wearable gestural interface. In Proc. CHI 2009, 4111--4116. Google ScholarDigital Library
- Van Beers, R. J., Wolpert, D. M., Haggart, P. 2002. When Feeling Is More Important Than Seeing in Sensory Adaption, Current Biology, Vol. 12, May 14, 2002, 834--837.Google Scholar
- Wigdor, D., Forlines. C., Baudisch, P., Barnwell, J., Shen, C. 2007. Lucid touch: a see-through mobile device. In Proc. UIST 2007, 269--278. Google ScholarDigital Library
- Wimmer, R. Grasp Sensing for Human-Computer Interaction, In Proc. TEI 2011, 221--228. Google ScholarDigital Library
- Wobbrock, J. O., Myers, B. A., Aung, H. H. 2008. The performance of hand postures in front- and back-of-device interaction for mobile computing. International Journal of Human-Computer Studies, 2008, 66, 857--875. Google ScholarDigital Library
- Wolf, K., Müller-Tomfelde, C., Cheng, K., Wechsung, I. 2012. PinchPad: Performance of touch-based Gestures while Grasping Devices, In Proc. TEI 2012. Google ScholarDigital Library
- Wolf, K., Naumann, A., Rohs, M., and Mueller, J. 2011. A Taxonomy of Microinteractions: Defining Microgestures based on Ergonomic and Scenario-dependent Requirements, In Proc. INTERACT 2011, 559--575. Google ScholarDigital Library
Index Terms
- What I grasp is what I control: interacting through grasp releases
Recommendations
Grasp sensing for human-computer interaction
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interactionThe way we grasp an object depends on several factors, e.g. the intended goal or the hand's anatomy. Therefore, a grasp can convey meaningful information about its context. Inferring these factors from a grasp allows us to enhance interaction with grasp-...
When hand and device melt into a unit: microgestures on grasped objects
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsI am motivated by the idea to capitalize the hand's abilities for becoming a natural input device. This can be achieved through finger-worn sensors that track their movements. I am particular interested in finger gestures that are feasible while ...
Microinteractions for supporting grasp tasks through usage of spare attentional and motor resources
ECCE '11: Proceedings of the 29th Annual European Conference on Cognitive ErgonomicsThis paper concludes the nine months progress of my Ph.D. project. It specifies its research focus on investigating microinteractions -- a sub-topic of HCI and gesture research -- and on developing a frame work for applications, which use microgestures ...
Comments