Rajkumar Darbar
ABSTRACT
In recent times, researchers have proposed numerous approaches that allow smartphones to determine user current locations (e.g., home, office, railway station, restaurant, street, supermarket etc.) and their activities (such as sitting, walking, running, bicycling, driving, cutting bread, making coffee, watching television, working at laptop, taking lunch, using water tap, brushing teeth, flushing toilet etc.) in real-time. But, to infer much richer story of context-aware applications, it is necessary to recognize the smartphone surfaces - for example on the sofa, inside the backpack, on the plastic chair, in a drawer or in your pant-pocket. This paper presents SurfaceSense, a two-tier, simple, inexpensive placement-aware technique, that uses smartphone's embedded accelerometer, gyroscope, magnetometer, microphone and proximity sensor to infer where phone is placed. It does not require any external hardware and provides 91.75% recognition accuracy on 13 different surfaces.
- K. Kunze and P. Lukowicz. 2007. Symbolic object localization through active sampling of acceleration and sound signatures. In Proc. of the 9th International Conference on Ubiquitous Computing (UbiComp '07), 163--180. http://dx.doi.org/10.1007/978-3-540-74853-3_10 Google Scholar
- Harrison, C. and Hudson S. 2008. Lightweight material detection for placement-aware mobile computing. In Proc. of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08), 279--282. http://doi.acm.org/10.1145/1449715.1449761 Google ScholarDigital Library
- Breiman, Leo. 2001. Random Forests. In Machine Learning, 45(1), 5--32. Google ScholarDigital Library
- J. Cho, I. Hwang, S. Oh. 2012. Vibration-Based Surface Recognition for Smartphones. In Proc. of IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA '12), 459--464. http://dx.doi.org/10.1109/RTCSA.2012.42 Google ScholarDigital Library
- J. Wiese, T. S. Saponas, A. Brush. 2013. Phoneprioception: enabling mobile phones to infer where they are kept. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2157--2166. http://doi.acm.org/10.1145/2470654.2481296 Google ScholarDigital Library
- S. Hwang and K. Y. Wohn. 2013. VibroTactor: low-cost placement-aware technique using vibration echoes on mobile devices, In Proc. of the International Conference on Intelligent User Interfaces (IUI '13), 73--74. http://doi.acm.org/10.1145/2451176.2451206 Google ScholarDigital Library
- Samuli Hemminki, Petteri Nurmi, and Sasu Tarkoma. 2013. Accelerometer-Based Transportation Mode Detection on Smartphones. In Proc. of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys '13). http://doi.acm.org/10.1145/2517351.2517367 Google ScholarDigital Library
- Jun Yang. 2009. Toward Physical Activity Diary: Motion Recognition Using Simple Acceleration Features with Mobile Phones. In Proc. of the 1st ACM International Workshop on Interactive Multimedia for Consumer Electronics (IMCE '09), 1--10. http://doi.acm.org/10.1145/1631040.1631042 Google ScholarDigital Library
- M. Rossi, S. Feese, O. Amft, N. Braune, S. Martis, and G. Troster. 2013. Ambientsense: A real-time ambient sound recognition system for smartphones. In Proc. of the International Workshop on the Impact of Human Mobility in Pervasive Systems and Applications (PerMoby '13), 230--235. http://dx.doi.org/10.1109/PerComW.2013.6529487Google Scholar
- M. Azizyan, I. Constandache, and R. Roy Choudhury. 2009. SurroundSense: mobile phone localization via ambience fingerprinting. In Proc. of the 15th Annual International Conference on Mobile Computing and Networking (MobiCom '09), 261--272. http://doi.acm.org/10.1145/1614320.1614350 Google ScholarDigital Library
- H. Lu, W. Pan, N. D. Lane, T. Choudhury, and A. T. Campbell. 2009. SoundSense: scalable sound sensing for people-centric applications on mobile phones. In Proc. of the 7th International Conference on Mobile Systems, Applications, and Services (MobiSys '09), 165--178. http://doi.acm.org/10.1145/1555816.1555834 Google ScholarDigital Library
- Mizell, D. 2003. Using gravity to estimate accelerometer orientation. In Proc. of IEEE International Symposium on Wearable Computers (ISWC '03) 252--253. http://dx.doi.org/10.1109/ISWC.2003.1241424 Google Scholar
- Hinckley K., and Horvitz E. 2001. Toward more sensitive mobile phones. In Proc. of the 14st Annual ACM Symposium on User Interface Software and Technology (UIST '01), 191--192. http://doi.acm.org/10.1145/502348.502382 Google ScholarDigital Library
- Ho J., and Intille S. S., 2005. Using context-aware computing to reduce the perceived burden of interruptions from mobile devices. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05), 909--918. http://doi.acm.org/10.1145/1054972.1055100 Google ScholarDigital Library
- F. Wahl, O. Amft. 2014. Personalised phone placement recognition in daily life using RFID tagging. In Proc. of the 1st IEEE Symposium on Activity and Context Modeling and Recognition, 19--26. http://dx.doi.org/10.1109/PerComW.2014.6815159Google ScholarCross Ref
- Jun Yang, Emmanuel Munguia-Tapia, Simon Gibbs. 2013. Efficient In-Pocket Detection with Mobile Phones. In Proc. of the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp '13), 31--34. http://doi.acm.org/10.1145/2494091.2494099 Google ScholarDigital Library
- I. Diaconita, A. Reinhardt, F. Englert, D. Christin and R. Steinmetz. 2014. Do You Hear What I Hear? Using Acoustic Probing to Detect Smartphone Locations. In Proc. of the IEEE Symposium on Activity and Context Modeling and Recognition, 1--9. http://dx.doi.org/10.1109/PerComW.2014.6815157Google Scholar
Recommendations
Recognition of high-level activities with a smartphone
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersThe recognition of high-level activities (such as work, transport and exercise) with a smartphone is a poorly explored topic. This paper presents an approach to such activity recognition that relies on the user's location, physical activity, ambient ...
Real-time activity monitoring with a wristband and a smartphone
Real-time activity monitoring with smartphone and wristband is presented.Smartphone and wristband can be worn freely on the body at any relevant location.Feature vectors use fused data and features of multiple modalities if present.Impact of decision ...
Towards Physical Activity Recognition Using Smartphone Sensors
UIC-ATC '13: Proceedings of the 2013 IEEE 10th International Conference on Ubiquitous Intelligence & Computing and 2013 IEEE 10th International Conference on Autonomic & Trusted ComputingIn recent years, the use of a smartphone accelerometer in physical activity recognition has been well studied. However, the role of a gyroscope and a magnetometer is yet to be explored, both when used alone as well as in combination with an ...
Comments