Gierad Laput
Xiang 'Anthony' Chen
Chris Harrison
ABSTRACT
Devices can be made more intelligent if they have the ability to sense their surroundings and physical configuration. However, adding extra, special purpose sensors increases size, price and build complexity. Instead, we use speakers and microphones already present in a wide variety of devices to open new sensing opportunities. Our technique sweeps through a range of inaudible frequencies and measures the intensity of reflected sound to deduce information about the immediate environment, chiefly the materials and geometry of proximate surfaces. We offer several example uses, two of which we implemented as self-contained demos, and conclude with an evaluation that quantifies their performance and demonstrates high accuracy.
Supplemental Material
- Aumi, M., Gupta, S., Goel, M., Larson, E. and Patel, S. DopLink: using the doppler effect for multi-device interaction. In Proc. UbiComp '13. 583--586. Google Scholar
Digital Library
- Brandt, A. (2011). "Noise and Vibration Analysis." John Wiley & Sons, Ltd., UK.Google Scholar
- Buil, V., Hollemans, G., and Wijdeven, S. van de. Headphones with touch control. Proc. MobileHCI '05. 377--378. Google ScholarDigital Library
- Chevron Corporation. "Chevron, GE Form Technology Alliance." Retrieved April 11, 2014 from: http://investor.chevron.com/phoenix.zhtmlfic=130102&p=irol-newsArticle_Print&ID=1895989Google Scholar
- Cocroft, R and Rodríguez, R. The Behavioral Ecology of Insect Vibrational Comm. BioSci.,55. '05. 323--334.Google Scholar
- Cox, T., D'Antonio, P. and Avis, M. Room sizing and optimization at low frequencies. Journal of the Audio Engineering Society, 52(6), 2004, pp. 640--651.Google Scholar
- Gloth, G. and Sinapius, M. Analysis of swept-sine runs during modal identification. Mechanical Systems and Signal Processing, 18(6), Nov. 2004, pp. 1421--1441Google ScholarCross Ref
- Gupta, S., Morris, D., Patel, S. and Tan, D. SoundWave: using the doppler effect to sense gestures. In Proc. CHI '12. 1911--1914. Google ScholarDigital Library
- Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I. The WEKA Data Mining Software: An Update; SIGKDD Explorations, 11(1), 2009. Google ScholarDigital Library
- Harrison, C., Tan, D. and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI '10. 453--462. Google ScholarDigital Library
- Hwang, S., Bianchi, A. and Wohn, K. VibPress: estimating pressure input using vibration absorption on mobile devices. In Proc. MobileHCI '13. 31--34. Google ScholarDigital Library
- Kime, N., Turner, W. and Ryan, M. The transmission of advertisement calls in Central American frogs. Behavioral Ecology, 11(1), 2000, pp. 71--83.Google ScholarCross Ref
- Manabe H. and Fukumoto, M. Headphone taps: a simple technique to add input function to regular headphones. In Proc. MobileHCI '12. 177--180. Google ScholarDigital Library
- Metzger, C., Anderson, M., Starner, T. FreeDigiter: A Contact-free Device for Gesture Control. Proc. ISWC '04. 18--21. Google ScholarDigital Library
- Mujibiya, A., Cao, X., Tan, D., Morris, D., Patel, S. and Rekimoto, J. The sound of touch: on-body touch and gesture sensing based on transdermal ultrasound propagation. In Proc. ITS '13. 189--198. Google ScholarDigital Library
- Ono, M., Shizuki, B. and Tanaka, J. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proc. UIST '13. 31--40. Google ScholarDigital Library
- Peeters, G. A large set of audio features for sound description similarity and classification in the CUIDADO project. Tech. report, ICRAM, 2004.Google Scholar
- Pijanowski, C., Villanueva-Rivera, J., Dumyahn, L., Farina, A., Krause, L., Napoletano, M., Gage, H. and Pieretti, N. Soundscape Ecology: The Science of Sound in the Landscape. BioScience, 61(3), 2001, pp. 203.Google ScholarCross Ref
- Priyantha, N. B., Chakraborty, A., and Balakrishnan, H. The Cricket Location-Support system. In Proc. MobiCom '00. 32--43. Google ScholarDigital Library
- Sato, M., Poupyrev, I. and Harrison, C., Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proc. CHI '12. 483--492. Google ScholarDigital Library
- Sinha, D., Springer, K., Han, W., Lizon, D., and Houlton, R. Swept-frequency acoustic interferometry technique for noninvasive chemical diagnostics. In Proc. 3rd International Conference On-Site Analysis, 1995.Google Scholar
- Takemura, K., Ito, A., Takamatsu, J. and Ogasawara, T. Active bone-conducted sound sensing for wearable interfaces. In Proc. UIST '11 Adjunct. 53--54. Google ScholarDigital Library
- Tarzia, S., Dick, R., Dinda, P. and Memik, G. Sonarbased measurement of user presence and attention. In Proc. Ubicomp '09. 89--92. Google ScholarDigital Library
- Watanabe, H., Terada, T. and Tsukamoto, M. Ultrasound-based movement sensing, gesture-, and contextrecognition. In Proc. ISWC '13. 57--64. Google ScholarDigital Library
Index Terms
- SweepSense: Ad Hoc Configuration Sensing Using Reflected Swept-Frequency Ultrasonics
Recommendations
Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces
UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technologyWe present Scratch Input, an acoustic-based input technique that relies on the unique sound produced when a fingernail is dragged over the surface of a textured material, such as wood, fabric, or wall paint. We employ a simple sensor that can be easily ...
User-defined surface+motion gestures for 3d manipulation of objects at a distance through a mobile device
APCHI '12: Proceedings of the 10th asia pacific conference on Computer human interactionOne form of input for interacting with large shared surfaces is through mobile devices. These personal devices provide interactive displays as well as numerous sensors to effectuate gestures for input. We examine the possibility of using surface and ...
Anywhere surface touch: utilizing any surface as an input area
AH '14: Proceedings of the 5th Augmented Human International ConferenceThe current trend towards smaller and smaller mobile devices may cause considerable difficulties in using them. In this paper, we propose an interface called Anywhere Surface Touch, which allows any flat or curved surface in a real environment to be ...
Comments