Munehiko Sato
Chris Harrison
ABSTRACT
Touché proposes a novel Swept Frequency Capacitive Sensing technique that can not only detect a touch event, but also recognize complex configurations of the human hands and body. Such contextual information significantly enhances touch interaction in a broad range of applications, from conventional touchscreens to unique contexts and materials. For example, in our explorations we add touch and gesture sensitivity to the human body and liquids. We demonstrate the rich capabilities of Touché with five example setups from different application domains and conduct experimental studies that show gesture classification accuracies of 99% are achievable with our technology.
Supplemental Material
- Barrett, G. and Omote, R. Projected-Capacitive Touch Technology. Information Display. (26) 3, 20 16--21.Google Scholar
- Bau, O., Poupyrev, I., Israr, A., Harrison, C., Teslatouch: electrovibration for touch surfaces. in UIST'10, 283--292. Google ScholarDigital Library
- Buxton, W. and Myers, B., A Study in Two-Handed Input. in CHI'86, 321--326. Google ScholarDigital Library
- Cassinelli, Á., Perrin, S., Ishikawa, M., Smart laser-scanner for 3D human-machine interface. in CHI EA'05, 1138--1139. Google ScholarDigital Library
- Cheney, M., Isaacson, D., Newell, J. C. Electrical impedance tomography. SIAM Review, 41, 1, 1999. 85--101. Google ScholarDigital Library
- Dietz, P. and Leigh, D., DiamondTouch: A Multi-User Touch Technology. in UIST '01, 219--226. Google ScholarDigital Library
- Dietz, P. H., Han, J. Y., Westhues, J., Barnwell, J., Yerazunis, W., Submerging technologies. in SIGGRAPH'06 ETech, 30. Google ScholarDigital Library
- Follmer, S., Johnson, M., Adelson, E., Ishii, H., deForm: an interactive malleable surface for capturing 2.5 D arbitrary objects, tools and touch. in UIST '11, 527--536. Google ScholarDigital Library
- Forlizzi, J., Disalvo, C., Zimmerman, J., Hurst, A., The SenseChair: The lounge chair as an intelligent assistive device for elders. in DUX '05, 1--13. Google ScholarDigital Library
- Foster, K. R. and Lukaski, H. C. Whole-body impedance - what does it measure? The American journal of clinical nutrition, 64 (3). 1996. 388S-396S.Google Scholar
- Gemperle, F., Kasabach, C., Stivoric, J., Bauer, M. , Martin, R. Design for wearability. in IEEE ISWC'98, 116--122. Google ScholarDigital Library
- Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I. H. The WEKA data mining software: an update. SIGKDD Explorations, 11, 1, 2009. 10--18. Google ScholarDigital Library
- Harker, F. R. and Maindonald, J. H. Ripening of Nectarine Fruit. Plant physiology, 106, 1994. 165--171.Google Scholar
- Harrison, B. L., Fishkin, K. P., Gujar, A., Mochon, C., Want, R., Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. in CHI '98, 17--24. Google ScholarDigital Library
- Harrison, C., Benko, H., Wilson, A., OmniTouch: wearable multitouch interaction everywhere. in UIST'11, 441--450. Google ScholarDigital Library
- Harrison, C., Schwarz, J., Hudson, S., TapSense: enhancing finger interaction on touch surfaces. in UIST'11, 627--636. Google ScholarDigital Library
- Harrison, C., Tan, D. , Morris, D., Skinput: Appropriating the Body as an Input Surface. in CHI '10, 453--462. Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., Butz, A., Interactions in the air: adding further depth to interactive tabletops. in UIST '09, 139--148. Google ScholarDigital Library
- Hinkley, K. and Sinclair, M., Touch-sensing input devices. in CHI '99, 223--230. Google ScholarDigital Library
- Kry, P. G. and Pai, D. K. Grasp Recognition and Manipulation with the Tango. in ISER'06. 551--559.Google Scholar
- Lee, S. K., Buxton, W., Smith, K. C., A multi-touch three dimensional touch-sensitive tablet. in CHI '85, 21--25. Google ScholarDigital Library
- Matsushita, N. and Rekimoto, J., HoloWall: designing a finger, hand, body and object sensitive wall. UIST'97, 209--210. Google ScholarDigital Library
- Miyaki, T., Rekimoto, J. GraspZoom: zooming and scrolling control model for single-handed mobile interaction. in MobileHCI '09, 81--84. Google ScholarDigital Library
- Paradiso, J. and Hsiao, K., Swept-frequency, magnetically-coupled resonant tags for realtime, continuous, multiparameter control. in CHI EA '99, 212--213. Google ScholarDigital Library
- Philipp, H. Charge transfer sensing. Sens. Review, 19. 96--105.Google Scholar
- Pier, M. D. and Goldberg, I. R., Using water as interface media in VR applications. in CLIHC '05, ACM, 162--169. Google ScholarDigital Library
- Poupyrev, I. and Maruyama, S., Tactile interfaces for small touch screens. in UIST '03, 217--220. Google ScholarDigital Library
- Poupyrev, I., Oba, H., Ikeda, T., Iwabuchi, E., Designing embodied interfaces for casual sound recording devices. in CHI EA'08, 2129--2134. Google ScholarDigital Library
- Poupyrev, I., Yeo, Z., Griffin, J. D., Hudson, S., Sensing human activities with resonant tuning. in CHI EA '10, 4135--4140. Google ScholarDigital Library
- Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation onInteractive Surfaces. in CHI '02, 113--120. Google ScholarDigital Library
- Rosenberg, I. and Perlin, K. The UnMousePad: an interpolating multi-touch force-sensing input pad. in SIGGRAPH'09, Article 65:1--65:9. Google ScholarDigital Library
- Russo, A., Ahn, B. Y., Adams, J. J., Duoss, E. B., Bernhard, J. T., Lewis, J. A. Pen-on-Paper Flexible Electronics. Advanced materials, (23) 30. 2011. 3426--3430.Google Scholar
- Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., Landay, J. A., Enabling always-available input with musclecomputer interfaces. in UIST '09, 167--176. Google ScholarDigital Library
- Sato, M. Particle display system: a real world display with physically distributable pixels. in CHI EA '08, 3771--3776. Google ScholarDigital Library
- Skulpone, S., Dittman, K. Adjustable proximity sensor. US Patent 3,743,853, 1973.Google Scholar
- Smith, J. R. Field mice: Extracting hand geometry from electric field measurements. IBM Systems Journal, 35. 587--608. Google ScholarDigital Library
- Song, H., Benko, H., Izadi, S., Cao, X., Hinckley, K., Grips and Gestures on a Multi-Touch Pen. in CHI '11, 1323--1332. Google ScholarDigital Library
- Taylor, B. and Bove, V., Graspables: Grasp-recognition as a user interface. in CHI '09, 917--926. Google ScholarDigital Library
- Wang, F. and Ren, X., Empirical evaluation for finger input properties in multi-touch interaction. in CHI '09, 1063--1072. Google ScholarDigital Library
- Wang, R. Y. and Popovic, J. Real-time hand-tracking with a color glove. in SIGGRAPH '09, Article 63, 63:1--63:8 Google ScholarDigital Library
- Watanabe, J., VortexBath: Study of Tangible Interaction with Water in Bathroom for Accessing and Playing Media Files. in HCI '07, 1240--1248. Google ScholarDigital Library
- Webster, J. G. Ed, Medical instrumentation: application and design. Wiley, 2010.Google Scholar
- Weiser, M. The computer for the 21st century. Scientific American (9). 94--104.Google Scholar
- Wimmer, R. and Baudisch, P., Modular and Deformable Touch-Sensitive Surfaces Based on Time Domain Reflectometry. in UIST '11, 517--526. Google ScholarDigital Library
- Yonezawa, T. and Mase, K., Tangible Sound: Musical instrument using fluid media. in ICMC2000.Google Scholar
- Zimmerman, T. G., Smith, J. R., Paradiso, J. A., Allport, D., Gershenfeld, N., Applying electric field sensing to human-computer interfaces. in CHI '95, 280--287. Google ScholarDigital Library
Index Terms
- Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects
Recommendations
Touché: touch and gesture sensing for the real world
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous ComputingTouché proposes a novel Swept Frequency Capacitive Sensing technique that can not only detect a touch event, but also recognize complex configurations of the human hands and body. Such contextual information significantly enhances touch interaction in a ...
Sensor synaesthesia: touch in motion, and motion in touch
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe explore techniques for hand-held devices that leverage the multimodal combination of touch and motion. Hybrid touch + motion gestures exhibit interaction properties that combine the strengths of multi-touch with those of motion-sensing. This affords ...
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Comments