Joseph A. Paradiso
ABSTRACT
We describe a novel interface that locates and characterizes knocks and taps atop a large glass window. Our current setup uses four contact piezoelectric pickups located near the sheet's corners to record the acoustic wavefront coming from the knocks. A digital signal processor extracts relevent characteristics from these signals, such as amplitudes, frequency components and differential timings, which are used to estimate the location of the hit and provide other parameters, including the rough accuracy of this estimate, the nature of each hit (e.g., knuckle knock, metal tap, or fist bang), and the strike intensity. This system requires only simple hardware, needs no special adaptation of the glass pane, and allows all transducers to be mounted on the inner surface, hence it is quite easy to deploy as a retrofit to existing windows. This opens many applications, such as an interactive storefront, with projected content controlled by knocks on the display window.
- Quinnell R.A., "Touchscreen technology improves and extends its options,": EDN, vol. 40, no. 23, 9 Nov. 1995, pp. 52, 54--6, 58, 60, 62, 64.Google Scholar
- Rekimoto, J., Matsushita, N., "Perceptual Surfaces: Towards a Human and Object Sensitive Interactive Display. In Workshop on Perceptual User Interfaces (PUI-97), Banff, October 1997, pp. 30--32.Google Scholar
- Paradiso, J.A., et al, "Sensor Systems for Interactive Surfaces," IBM Systems Journal, Vol. 39, No. 3&4, October 2000, pp. 892--914. Google ScholarDigital Library
- Galyean, T., et al., "Virtual Fish Tank," SIGGRAPH 98,Conf. Abstracts and Applications, ACM Press 1998, p.116. Google ScholarDigital Library
- Ishii, H., Wisneski, C., Orbanes, J., Chun, B., and Paradiso, J., "PingPongPlus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play," in Proceedings of CHI '99, pp. 394--401. Google ScholarDigital Library
- Checka, N., "A Systen for Tracking and Characterizing Acoustic Impacts on Large Interactive Surfaces," MS Thesis, MIT Department of EECS and MIT Media Lab, May 2001.Google Scholar
- Paradiso, J., "Responsive Window," in Take Over, Proc. of 2001 Ars Electronica Festival, Springer Verlag, pp.261--263.Google Scholar
- See: http://identity.media.mit.edu/telephonestory.htmlGoogle Scholar
Recommendations
ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone Smartphones
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology3D position tracking on smartphones has the potential to unlock a variety of novel applications, but has not been made widely available due to limitations in smartphone sensors. In this paper, we propose ReflecTrack, a novel 3D acoustic position ...
An Acoustic Source Localization and Tracking Framework Using Particle Filtering and Information Theory
The problem of detecting the location of an active acoustic source in an enclosure remains subject to a series of difficulties. Algorithms operate repeatedly on small frames of data from microphone recordings and provide estimates of the current source ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Comments