Chi Zhang
ABSTRACT
Mobile devices are shrinking their form factors for portability, but user-mobile interaction is becoming increasingly challenging. In this paper, we propose a novel system called Okuli to meet this challenge. Okuli is a compact, low-cost system that can augment a mobile device and extend its interaction workspace to any nearby surface area. Okuli piggybacks on visible light communication modules, and uses a low-power LED and two light sensors to locate user's finger within the workspace. It is built on a light propagation/reflection model that achieves around one-centimeter location precision, with zero run-time training overhead. We have prototyped Okuli as an Android peripheral, with a 3D-printed shroud to host the LED and light sensors. Our experiments demonstrate Okuli's accuracy, stability, energy efficiency, as well as its potential in serving virtual keyboard and trackpad applications.
- J. Wang, D. Vasisht, and D. Katabi, "RF-IDraw: Virtual Touch Screen in the Air using RF Signals," in Proc. of ACM SIGCOMM, 2014. Google Scholar
Digital Library
- S. Agrawal, I. Constandache, S. Gaonkar, R. Roy Choudhury, K. Caves, and F. DeRuyter, "Using Mobile Phones to Write in Air," in Proc. of ACM MobiSys, 2011. Google ScholarDigital Library
- H. Roeber, J. Bacus, and C. Tomasi, "Typing in Thin Air: The Canesta Projection Keyboard - a New Method of Interaction with Electronic Devices," in ACM CHI Extended Abstracts, 2003. Google ScholarDigital Library
- C. Harrison, H. Benko, and A. D. Wilson, "OmniTouch: Wearable Multitouch Interaction Everywhere," in Proc. of ACM UIST, 2011. Google ScholarDigital Library
- J. Wang, K. Zhao, X. Zhang, and C. Peng, "Ubiquitous Keyboard for Small Mobile Devices: Harnessing Multipath Fading for Fine-Grained Keystroke Localization," in Proc. of ACM MobiSys, 2014. Google ScholarDigital Library
- C. Harrison, J. Schwarz, and S. E. Hudson, "TapSense: Enhancing Finger Interaction on Touch Surfaces," in Proc. of ACM UIST, 2011. Google ScholarDigital Library
- H. Elgala, R. Mesleh, and H. Haas, "Indoor Optical Wireless Communication: Potential and State-of-the-Art," IEEE Communications Magazine, vol. 49, no. 9, 2011.Google Scholar
- S. Rajagopal, R. Roberts, and S.-K. Lim, "IEEE 802.15.7 Visible Light Communication: Modulation Schemes and Dimming Support," IEEE Communications Magazine, vol. 50, no. 3, 2012.Google ScholarCross Ref
- Y.-S. Kuo, P. Pannuto, K.-J. Hsiao, and P. Dutta, "Luxapose: Indoor Positioning with Mobile Phones and Visible Light," in Proc. of ACM MobiCom, 2014. Google ScholarDigital Library
- L. Li, P. Hu, C. Peng, G. Shen, and F. Zhao, "Epsilon: A Visible Light Based Positioning System," in Proc. of USENIX NSDI, 2014. Google ScholarDigital Library
- A. Butler, S. Izadi, and S. Hodges, "SideSight: Multi-Touch Interaction Around Small Devices," in Proc. of ACM UIST, 2008. Google ScholarDigital Library
- Z. Ghassemlooy, W. Popoola, and S. Rajbhandari, Optical Wireless Communications: System and Channel Modelling with MATLAB. CRC Press, 2012. Google ScholarDigital Library
- A. Edelstein and M. Rabbat, "Background Subtraction for Online Calibration of Baseline RSS in RF Sensing Networks," Mobile Computing, IEEE Transactions on, vol. 12, no. 12, pp. 2386--2398, Dec 2013. Google ScholarDigital Library
- W. Cui, Z. Cao, and J. Wei, "Dual-Microphone Source Location Method in 2-D Space," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2006.Google Scholar
- A. Papoulis and S. U. Pillai, Probability, random variables, and stochastic processes. Tata McGraw-Hill Education, 2002.Google Scholar
- P. Melgarejo, X. Zhang, P. Ramanathan, and D. Chu, "Leveraging Directional Antenna Capabilities for Fine-grained Gesture Recognition," in ACM UbiComp, 2014. Google ScholarDigital Library
- Monsoon Solutions, Inc., "Monsoon Power Monitor," http://www.msoon.com/LabEquipment/PowerMonitor/.Google Scholar
- A. Carroll and G. Heiser, "An Analysis of Power Consumption in a Smartphone," in Proc. of the USENIX Annual Technical Conference, 2010. Google ScholarDigital Library
- T. Hao, R. Zhou, and G. Xing, "COBRA: Color Barcode Streaming for Smartphone Systems," in Proc. of ACM MobiSys, 2012. Google ScholarDigital Library
- S. D. Perli, N. Ahmed, and D. Katabi, "PixNet: Interference-free Wireless Links Using LCD-camera Pairs," in Proc. of ACM MobiCom, 2010. Google ScholarDigital Library
- M. Ogata, Y. Sugiura, H. Osawa, and M. Imai, "iRing: Intelligent Ring Using Infrared Reflection," in Proc. of ACM UIST, 2012. Google ScholarDigital Library
- C. Harrison and S. E. Hudson, "Abracadabra: Wireless, High-precision, and Unpowered Finger Input for Very Small Mobile Devices," in Proc. of ACM UIST, 2009. Google ScholarDigital Library
- S. Kratz and M. Rohs, "Hoverflow: Exploring Around-device Interaction with IR Distance Sensors," in Proc. of ACM MobileHCI, 2009. Google ScholarDigital Library
- J. Kim, J. He, K. Lyons, and T. Starner, "The Gesture Watch: A Wireless Contact-free Gesture Based Wrist Interface," in Proc. of IEEE International Symposium on Wearable Computers (ISWC), 2007. Google ScholarDigital Library
- J. Moeller and A. Kerne, "ZeroTouch: An Optical Multi-touch and Free-air Interaction Architecture," in Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 2012. Google ScholarDigital Library
- S. Liu and F. Guimbretière, "FlexAura: A Flexible Near-Surface Range Sensor," in Proc. of ACM UIST, 2012. Google ScholarDigital Library
- J. P. Wachs, M. Kölsch, H. Stern, and Y. Edan, "Vision-based Hand-gesture Applications," Communications of the ACM, vol. 54, no. 2, 2011. Google ScholarDigital Library
- A. Sahami Shirazi, Y. Abdelrahman, N. Henze, S. Schneegass, M. Khalilbeigi, and A. Schmidt, "Exploiting Thermal Reflection for Interactive Systems," in Proc. of SIGCHI Conference on Human Factors in Computing Systems (CHI), 2014. Google ScholarDigital Library
- E. Larson, G. Cohn, S. Gupta, X. Ren, B. Harrison, D. Fox, and S. Patel, "HeatWave: Thermal Imaging for Surface User Interaction," in Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 2011. Google ScholarDigital Library
- P. Mistry and P. Maes, "Mouseless: a computer mouse as small as invisible," in Adjunct Proceedings of ACM UIST, 2010. Google ScholarDigital Library
- D. Kim, S. Izadi, J. Dostal, C. Rhemann, C. Keskin, C. Zach, J. Shotton, T. Large, S. Bathiche, M. Niessner, D. A. Butler, S. Fanello, and V. Pradeep, "RetroDepth: 3D Silhouette Sensing for High-precision Input on and Above Physical Surfaces," in Proc. of ACM Conference on Human Factors in Computing Systems (CHI), 2014. Google ScholarDigital Library
- R. Xiao, C. Harrison, K. D. Willis, I. Poupyrev, and S. E. Hudson, "Lumitrack: Low Cost, High Precision, High Speed Tracking with Projected M-sequences," in Proc. of ACM UIST, 2013. Google ScholarDigital Library
- Microsoft Corporation, "Kinect for Windows," 2014. {Online}. Available: http://www.microsoft.com/en-us/kinectforwindows/Google Scholar
- Leap Motion, Inc., "Leap Motion: Mac & PC Gesture Controller for Game, Design and More," 2013. {Online}. Available: https://www.leapmotion.com/Google Scholar
- C. Harrison, D. Tan, and D. Morris, "Skinput: Appropriating the Body As an Input Surface," in Proc. of SIGCHI Conference on Human Factors in Computing Systems (CHI), 2010. Google ScholarDigital Library
- M. Le Goc, S. Taylor, S. Izadi, and C. Keskin, "A Low-cost Transparent Electric Field Sensor for 3D Interaction on Mobile Devices," in Proc. of ACM Conference on Human Factors in Computing Systems (CHI), 2014. Google ScholarDigital Library
- T. Grosse-Puppendahl, S. Herber, R. Wimmer, F. Englert, S. Beck, J. von Wilmsdorff, R. Wichert, and A. Kuijper, "Capacitive Near-field Communication for Ubiquitous Interaction and Perception," in Proc. of ACM UbiComp, 2014. Google ScholarDigital Library
Index Terms
- Extending Mobile Interaction Through Near-Field Visible Light Sensing
Recommendations
Battery-free Visible Light Sensing
VLCS '17: Proceedings of the 4th ACM Workshop on Visible Light Communication SystemsWe present the design of the first Visible Light Sensing (VLS) system that consumes only tens of μWs of power to sense and communicate. Unlike most existing VLS systems, we require no modification to the existing light infrastructure since we use ...
Visible light based activity sensing using ceiling photosensors
VLCS '16: Proceedings of the 3rd Workshop on Visible Light Communication SystemsThis paper explores the feasibility of tracking motion and activities of humans using visible light. Shadows created by casting visible light on humans and objects are sensed using sensors that are embedded along with the light sources. Existing Visible ...
Visible Light Communication, Networking, and Sensing: A Survey, Potential and Challenges
The solid-state lighting is revolutionizing the indoor illumination. Current incandescent and fluorescent lamps are being replaced by the LEDs at a rapid pace. Apart from extremely high energy efficiency, the LEDs have other advantages such as longer ...
Comments