Abstract
Monitoring aquatic environment is of great interest to the ecosystem, marine life, and human health. This article presents the design and implementation of Samba—an aquatic surveillance robot that integrates an off-the-shelf Android smartphone and a robotic fish to monitor harmful aquatic processes such as oil spills and harmful algal blooms. Using the built-in camera of the smartphone, Samba can detect spatially dispersed aquatic processes in dynamic and complex environment. To reduce the excessive false alarms caused by the nonwater area (e.g., trees on the shore), Samba segments the captured images and performs target detection in the identified water area only. However, a major challenge in the design of Samba is the high energy consumption resulted from continuous image segmentation. We propose a novel approach that leverages the power-efficient inertial sensors on smartphones to assist image processing. In particular, based on the learned mapping models between inertial and visual features, Samba uses real-time inertial sensor readings to estimate the visual features that guide image segmentation, significantly reducing the energy consumption and computation overhead. Samba also features a set of lightweight and robust computer vision algorithms, which detect harmful aquatic processes based on their distinctive color features. Last, Samba employs a feedback-based rotation control algorithm to adapt to spatiotemporal development of the target aquatic process. We have implemented a Samba prototype and evaluated it through extensive field experiments, lab experiments, and trace-driven simulations. The results show that Samba can achieve a 94% detection rate, a 5% false alarm rate, and a lifetime up to nearly 2 months.
- James Ammerman and William Glover. 2000. Continuous underway measurement of microbial ectoenzyme activities in aquatic ecosystems. Marine Ecology Progress Series 201 (2000), 1--12.Google ScholarCross Ref
- Android 2.2 Platform Highlights. 2010. Homepage. Available at http://developer.android.com/guide/topics/sensors/sensors_position.html.Google Scholar
- Android Runtime. 2014. Homepage. Available at http://source.android.com/devices/tech/dalvik/art.html.Google Scholar
- Jeffrey Blum, Daniel Greencorn, and Jeremy Cooperstock. 2013. Smartphone sensor reliability for augmented reality applications. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Systems. 127--138.Google ScholarCross Ref
- Bryan Boyd. 2003. Introduction to Algae. Englewood Cliffs.Google Scholar
- Camilla Brekke and Anne Solberg. 2005. Oil spill detection by satellite remote sensing. Remote Sensing of Environment 95, 1 (2005), 1--13.Google ScholarCross Ref
- Dongyao Chen, Kyong-Tak Cho, Sihui Han, Zhizhuo Jin, and Kang Shin. 2015. Invisible sensing of vehicle steering with smartphones. In Proceedings of the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys). 1--13. Google ScholarDigital Library
- John Crank. 1979. The Mathematics of Diffusion. Oxford University Press.Google Scholar
- Matthew Dunbabin and Alistair Grinham. 2010. Experimental evaluation of an autonomous surface vehicle for water quality and greenhouse gas emission monitoring. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 5268--5274.Google Scholar
- Dumitru Erhan, Christian Szegedy, Alexander Toshev, and Dragomir Anguelov. 2014. Scalable object detection using deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2155--2162. Google ScholarDigital Library
- Matthew Faulkner, Michael Olson, Rishi Chandy, Jonathan Krause, K. Mani Chandy, and Andreas Krause. 2011. The next big one: Detecting earthquakes and other rare events from community-based sensors. In Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 13--24.Google Scholar
- Gliding Robotic Fish. 2013. Homepage. Available at http://nbcnews.to/1fGAomj.Google Scholar
- HABs and Lake Mendota. 2007. Homepage. Available at http://blooms.uwcfl.org/mendota.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 9 (2015), 1904--1916.Google ScholarDigital Library
- Robert Hecky and Peter Kilham. 1988. Nutrient limitation of phytoplankton in freshwater and marine environments: A review of recent evidence on the effects of enrichment. Limnology and Oceanography 33, 4 (1988), 796--822.Google Scholar
- Samuli Hemminki, Petteri Nurmi, and Sasu Tarkoma. 2013. Accelerometer-based transportation mode detection on smartphones. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys). Google ScholarDigital Library
- Chuanmin Hu, Frank Müller-Karger, Charles Taylor, Douglas Myhre, Brock Murch, Ana Odriozola, and Gonzalo Godoy. 2003. MODIS detects oil spills in Lake Maracaibo, Venezuela. Eos, Transactions, American Geophysical Union 84, 33 (2003), 313--319.Google ScholarCross Ref
- Puneet Jain, Justin Manweiler, Arup Achary, and Kirk Beaty. 2013. FOCUS: Clustering crowdsourced videos by line-of-sight. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys). Google ScholarDigital Library
- Shinichiro Kako, Atsuhiko Isobe, and Shinya Magome. 2012. Low altitude remote-sensing method to monitor marine and beach litter of various colors using a balloon equipped with a digital camera. Marine Pollution Bulletin 64, 6 (2012), 1156--1162.Google ScholarCross Ref
- Purushottam Kulkarni, Deepak Ganesan, Prashant Shenoy, and Qifeng Lu. 2005. SensEye: A multi-tier camera sensor network. In Proceedings of the 13th ACM International Conference on Multimedia (MM). 229--238. Google ScholarDigital Library
- Gilles LaRoche, Ronald Eisler, and Clarence Tarzwell. 1970. Bioassay procedures for oil and oil dispersant toxicity evaluation. Water Pollution Control Federation (1970), 1982--1989.Google Scholar
- Dimitrios Lymberopoulos and Andreas Savvides. 2005. XYZ: A motion-enabled, power aware sensor node platform for distributed sensor network applications. In Proceedings of the 4th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 449--454. Google ScholarDigital Library
- Raphael Maree, Pierre Geurts, Justus Piater, and Louis Wehenkel. 2005. Random subwindows for robust image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 34--40. Google ScholarDigital Library
- Tood Moon. 1996. The expectation-maximization algorithm. IEEE Signal Processing Magazine 13, 6 (1996), 47--60.Google ScholarCross Ref
- National Ocean Service. 2014. Homepage. Available at http://oceanservice.noaa.gov.Google Scholar
- Katsuhiko Ogata. 1995. Discrete-Time Control Systems. Prentice Hall. Google ScholarDigital Library
- Ohio Environmental Protection Agency. 2010. Homepage. Available at http://epa.ohio.gov.Google Scholar
- Oil Spills and Disasters. 2010. Available at http://infoplease.com/ipa/A0001451.html.Google Scholar
- Trevor Platt, Fuentes-Yaco Csar, and Frank Kenneth. 2003. Marine ecology: Spring algal bloom and larval fish survival. Nature 423, 6938 (2003), 398--399.Google Scholar
- Power Tech LED. 2014. Homepage. Available at http://swflashlights.com.Google Scholar
- Daniel Rudnick, Russ Davis, Charles Eriksen, David Fratantoni, and Mary Perry. 2004. Underwater gliders for ocean research. Journal of the Marine Technology Society 38, 2 (2004), 73--84.Google ScholarCross Ref
- Linda Shapiro and George Stockman. 2001. Computer Vision. Prentice Hall. Google ScholarDigital Library
- Yiran Shen, Wen Hu, Mingrui Yang, Bo Wei, Simon Lucey, and Chun-Tung Chou. 2014. Face recognition on smartphones via optimised sparse representation classification. In Proceedings of the 13th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 237--248. Google ScholarDigital Library
- John Smith and Shih-Fu Chang. 1997. VisualSEEk: A fully automated content-based image query system. In Proceedings of the 5th ACM International Conference on Multimedia (MM). 87--98. Google ScholarDigital Library
- Southern Regional Water Program. 2011. Homepage. Available at http://srwqis.tamu.edu.Google Scholar
- Stargate User’s Manual. 2014. Homepage. Available at http://xbow.com.Google Scholar
- Thiago Teixeira, Eugenio Culurciello, Joon Park, Dimitrios Lymberopoulos, Andrew Barton-Sweeney, and Andreas Savvides. 2006. Address-event imagers for sensor networks: Evaluation and modeling. In Proceedings of the 5th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 458--466. Google ScholarDigital Library
- Yu Wang, Rui Tan, Guoliang Xing, Jianxun Wang, Xiaobo Tan, Xiaoming Liu, and Xiangmao Chang. 2014. Aquatic debris monitoring using smartphone-based robotic sensors. In Proceedings of the 13th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 13--24. Google ScholarDigital Library
- Yu Wang, Rui Tan, Guoliang Xing, Jianxun Wang, Xiaobo Tan, Xiaoming Liu, and Xiangmao Chang. 2016. Monitoring aquatic debris using smartphone-based robots. IEEE Transactions on Mobile Computing 15, 6 (2016), 1412--1426.Google ScholarCross Ref
- Yan Wang, Jie Yang, Hongbo Liu, Yingying Chen, Marco Gruteser, and Richard Martin. 2013. Sensing vehicle dynamics for determining driver phone use. In Proceedings of the 11th International Conference on Mobile Systems, Applications, and Services (MobiSys). 41--54. Google ScholarDigital Library
Index Terms
- Energy-Efficient Aquatic Environment Monitoring Using Smartphone-Based Robots
Recommendations
Samba: a smartphone-based robot system for energy-efficient aquatic environment monitoring
IPSN '15: Proceedings of the 14th International Conference on Information Processing in Sensor NetworksMonitoring aquatic environment is of great interest to the ecosystem, marine life, and human health. This paper presents the design and implementation of Samba -- an aquatic surveillance robot that integrates an off-the-shelf Android smartphone and a ...
Aquatic debris monitoring using smartphone-based robotic sensors
IPSN '14: Proceedings of the 13th international symposium on Information processing in sensor networksMonitoring aquatic debris is of great interest to the ecosystems, marine life, human health, and water transport. This paper presents the design and implementation of SOAR - a vision-based surveillance robot system that integrates an off-the-shelf ...
Smartphone Energy Drain in the Wild: Analysis and Implications
SIGMETRICS '15: Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer SystemsThe limited battery life of modern smartphones remains a leading factor adversely affecting the mobile experience of millions of smartphone users. In order to extend battery life, it is critical to understand where and how is energy drain happening on ...
Comments