ABSTRACT
Physical buttons have the unique ability to provide low-attention and vision-free interactions through their intuitive tactile clues. Unfortunately, the physicality of these interfaces makes them static, limiting the number and types of user interfaces they can support. On the other hand, touch screen technologies provide the ultimate interface flexibility, but offer no inherent tactile qualities. In this paper, we describe a technique that seeks to occupy the space between these two extremes - offering some of the flexibility of touch screens, while retaining the beneficial tactile properties of physical interfaces.
The outcome of our investigations is a visual display that contains deformable areas, able to produce physical buttons and other interface elements. These tactile features can be dynamically brought into and out of the interface, and otherwise manipulated under program control. The surfaces we describe provide the full dynamics of a visual display (through rear projection) as well as allowing for multitouch input (though an infrared lighting and camera setup behind the display). To illustrate the tactile capabilities of the surfaces, we describe a number of variations we uncovered in our exploration and prototyping. These go beyond simple on/off actuation and can be combined to provide a range of different possible tactile expressions. A preliminary user study indicates that our dynamic buttons perform much like physical buttons in tactile search tasks.
- Bah, K., Jæger, M., Skov, M. B., and Thomassen, N. You can touch, but you can't look: interacting with in-vehicle systems. In Proc. CHI '08. ACM Press (2008), 1139--1148. Google ScholarDigital Library
- Benali-Khoudja, M., Hafez, M., Alexandre, J. M., Kheddar, A. Tactile Interfaces: A State of the Art Survey. In Proc. ISR '04. 721--726.Google Scholar
- Benko, H., Wilson, A. D., Balakrishnan, R. Sphere: multi-touch interactions on a spherical display. In Proc. UIST '08. ACM Press (2008), 77--86. Google ScholarDigital Library
- Brewster, S. and Brown, L. M. Tactons: structured tactile messages for non-visual information display. In Proc. AUIC '04. Australian Computer Society (2004), 15--23. Google ScholarDigital Library
- Coelho, M. and Maes, P. Sprout I/O: a texturally rich interface. In Proc. TEI '08. ACM Press (2008), 221--222. Google ScholarDigital Library
- Coelho, M., Ishii, H., and Maes, P. Surflex: a programmable surface for the design of tangible interfaces. In CHI '08 Ext. Abst. ACM Press (2008), 3429--3434. Google ScholarDigital Library
- Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. In Proc. UIST '01. ACM Press (2001), 219--226. Google ScholarDigital Library
- Enriquez, M., Afonin, O., Yager, B., and Maclean, K. 2001. A pneumatic tactile alerting system for the driving environment. In Proc. PUI '01. ACM Press (2001), 1--7. Google ScholarDigital Library
- Fukumoto, M. and Sugimura, T. Active click: tactile feedback for touch panels. In CHI '01 Ext. Abst. ACM Press (2001),121--122. Google ScholarDigital Library
- Han, J. Y. Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection. In Proc. UIST '05. ACM Press (2005), 115--118. Google ScholarDigital Library
- Hashimoto, Y. and Kajimoto, H. A novel interface to present emotional tactile sensation to a palm using air pressure. In CHI '08 Ext. Abst. ACM Press (2008), 2703--2708. Google ScholarDigital Library
- Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. Project FEELEX: adding haptic surface to graphics. In Proc. SIGGRAPH '01. ACM Press (2001), 469--476. Google ScholarDigital Library
- Kim, S., Kim, H., Lee, B., Nam, T., and Lee, W. Inflatable mouse: volume-adjustable mouse with air-pressure-sensitive input and haptic feedback. In Proc. CHI '08. ACM Press (2008), 211--224. Google ScholarDigital Library
- Kodama, S. and M. Takeno. Protrude, Flow. (Electronic Arts and Animation Catalogue) In Proc. SIGGRAPH '01. ACM Press (2001), 138.Google Scholar
- Laitinen, P. Tactile Touch Screen. International Application PCT/EP2006/009377, filed 27 September 2006.Google Scholar
- Lee, J. C., Dietz, P. H., Leigh, D., Yerazunis, W. S., and Hudson, S. E. Haptic pen: a tactile feedback stylus for touch screens. In Proc. UIST '04. ACM Press (2004), 291--294. Google ScholarDigital Library
- Li, K.A. Baudisch, P., Griswold, W.G., Hollan, J.D. Tapping and rubbing: exploring new dimensions of tactile feedback with voice coil motors. In Proc. UIST '08. ACM Press (2008). Google ScholarDigital Library
- Matsushita, N. and Rekimoto, J. HoloWall: designing a finger, hand, body, and object sensitive wall. In Proc. UIST '97. ACM Press (1997), 209--210. Google ScholarDigital Library
- Microsoft surface. http://www.microsoft.com/surface/Google Scholar
- Nakatani, M., Kajimoto, H., Kawakami, N., and Tachi, S. Tactile sensation with high-density pin-matrix. In Proc. APGV '05. ACM Press (2005), 169--169. Google ScholarDigital Library
- Nashel, A. and Razzaque, S. Tactile virtual buttons for mobile devices. In CHI '03 Ext. Abst. ACM press (2003), 854--855. Google ScholarDigital Library
- Otsuka, K. and Wayman, C. M. Eds. Shape Memory Materials. Cambridge University Press, New York, 1999.Google Scholar
- Overholt, D., Pasztor, E., Mazalek, A. A Multipurpose Array of Tactile Rods for Interactive sXpression (Abstracts and Applications), In Proc. SIGGRAPH '01. ACM Press (2001).Google Scholar
- Poupyrev, I. Maruyama, S, and Rekimoto, J. Ambient touch: designing tactile interfaces for handheld devices. In Proc. UIST '02. ACM Press (2002), 51--60. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., Maruyama, S., Rekimoto, J., and Yamaji, Y. Lumen: interactive visual and shape display for calm computing (Emerging Technologies). In Proc. SIGGRAPH '04. ACM Press (2004), 17. Google ScholarDigital Library
- Poupyrev, I., Nashida, T., and Okabe, M. Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays. In Proc. TEI '07. ACM Press (2007), 205--212. Google ScholarDigital Library
- Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. In Proc. CHI '04. ACM Press, 487--494. Google ScholarDigital Library
- Rekimoto, J. and Schwesig, C. PreSenseII: bi-directional touch and pressure sensing interactions with tactile feedback. In CHI '06 Ext. Abst. ACM Press (2006), 1253--1258. Google ScholarDigital Library
- Rockwell, T.H. Spare Visual Capacity in Driving Revisited: New Empirical Results of an Old Idea, in Vision min Vehicles II. Elsevier (1988), 317-324.Google Scholar
- Wagner, C. R, Lederman, S. J., Howe, R.D. A Tactile Shape Display Using RC Servomotors. Electronic Journal of Haptics Research, 3, 4.Google Scholar
- Wickens, C.D. and Hollands, J.G. Engineering Psychology and Human Performance. Prentice Hall, 2000.Google Scholar
Index Terms
- Providing dynamically changeable physical buttons on a visual display
Recommendations
PalmRC: imaginary palm-based remote control for eyes-free television interaction
EuroITV '12: Proceedings of the 10th European Conference on Interactive TV and VideoUser input on television (TV) typically requires a mediator device, such as a handheld remote control. While being a well-established interaction paradigm, a handheld device has serious drawbacks: it can be easily misplaced due to its mobility and in ...
Virtual Buttons for Eyes-Free Interaction: A Study
Human-Computer Interaction – INTERACT 2015AbstractThe touch screen of mobile devices, such as smart phones and tablets, is their primary input mechanism. While designed to be used in conjunction with its output capabilities, eyes-free interaction is also possible and useful on touch screens. ...
The performance of touch screen soft buttons
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe introduction of a new generation of attractive touch screen-based devices raises many basic usability questions whose answers may influence future design and market direction. With a set of current mobile devices, we conducted three experiments ...
Comments