Alex Edgcomb
Abstract
Automated monitoring algorithms operating on live video streamed from a home can effectively aid in several assistive monitoring goals, such as detecting falls or estimating daily energy expenditure. Use of video raises obvious privacy concerns. Several privacy enhancements have been proposed such as modifying a person in video by introducing blur, silhouette, or bounding-box. Person extraction is fundamental in video-based assistive monitoring and degraded in the presence of privacy enhancements; however, privacy enhancements have characteristics that can opportunistically be adapted to. We propose two adaptive algorithms for improving assistive monitoring goal performance with privacy-enhanced video: specific-color hunter and edge-void filler. A nonadaptive algorithm, foregrounding, is used as the default algorithm for the adaptive algorithms. We compare nonadaptive and adaptive algorithms with 5 common privacy enhancements on the effectiveness of 8 automated monitoring goals. The nonadaptive algorithm performance on privacy-enhanced video is degraded from raw video. However, adaptive algorithms can compensate for the degradation. Energy estimation accuracy in our tests degraded from 90.9% to 83.9%, but the adaptive algorithms significantly compensated by bringing the accuracy up to 87.1%. Similarly, fall detection accuracy degraded from 1.0 sensitivity to 0.86 and from 1.0 specificity to 0.79, but the adaptive algorithms compensated accuracy back to 0.92 sensitivity and 0.90 specificity. Additionally, the adaptive algorithms were computationally more efficient than the nonadaptive algorithm, averaging 1.7% more frames processed per second.
- Anderson, D., Luke, R. H., Keller, J. M., Skubic, M., Rantz, M., and Aud, M. 2009. Linguistic summarization of video for fall detection using voxel person and fuzzy logic. In Proceedings of the Conference on ACM Computer Vision and Image Understanding. Google Scholar
Digital Library
- Bodson, M. and Groszkiewicz, J. E. 1997. Multivariable adaptive algorithms for reconfigurable flight control. IEEE Trans. Control Syst. Technol. 5, 2, 217--229.Google ScholarCross Ref
- Bourke, A. K., O’Brien, J. V., and Lyons, G. M. 2007. Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. Gait Posture 26, 194--199.Google ScholarCross Ref
- Crouter, S. E., Schneider, P. L., Karabulut, M., and Bassett Jr., D. R. 2003. Validity of 10 electronic pedometers for measuring steps, distance, and energy cost. Medicine Sci. Sports Exer. 35, 1455--1460.Google ScholarCross Ref
- Demiris, G., Rantz, M. J., Aud, M. A., Marek, K. D., Tyrer, H. W, Skubic, M., and Hussam, A. A. 2004. Older adults’ attitudes towards and perceptions of ‘smart home’ technologies: A pilot study. Med. Inform. Internet Med. 29, 2, 87--94.Google ScholarCross Ref
- Edgcomb, A. and Vahid, F. 2012a. Automated fall detection on privacy-enhanced video. In Conference Proceedings of IEEE Engineering in Medicine and Biology Society.Google Scholar
- Edgcomb, A. and Vahid, F. 2012b. MNFL: The monitoring and notification flow language for assistive monitoring. In Proceedings of the ACM SIGHIT International Health Informatics Symposium. Google ScholarDigital Library
- Edgcomb, A. and Vahid, F. 2012e. Privacy perception and fall detection accuracy for in-home video assistive monitoring with privacy enhancements. ACM SIGHIT (Special Interest Group on Health Informatics) Record. Google ScholarDigital Library
- Edgcomb, A. and Vahid, F. 2013a. Automated in-home assistive monitoring with privacy-enhanced video. In Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI). Google ScholarDigital Library
- Edgcomb, A. and Vahid, F. 2013b. Estimating daily energy expenditure from video for assistive monitoring. In Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI). Google ScholarDigital Library
- Guo, Z., Zhuo, M., and Jiang, G. 2008. Adaptive sensor placement and boundary estimation for monitoring mass objects. IEEE Trans. Syst., Man., Cybern. B, Cybern. 38, 1, 222--232. Google ScholarDigital Library
- Helal, S., Mann, W., El-Zabadani, H., King, J., Kaddoura, Y., and Jansen, E. 2005. The Gator Tech Smart House: A programmable pervasive space. IEEE Trans. Comput. Google ScholarDigital Library
- Jain, R., Kasturi, R., and Schunck, B. G. 1995. Machine Vision. McGraw-Hill. Google ScholarDigital Library
- Jakicic, J. M., Marcus, M., Gallagher, K. I., Randall, C., Thomas, E., Goss, F. L., and Robertson, R. J. 2004. Evaluation of the SenseWear Pro Armband to assess energy expenditure during exercise. Med. Sci. Sports Med. 36, 897--904.Google Scholar
- Kaewtrakulpong, P. and Bowden, R. 2001. An improved adaptive background mixture model for real-time tracking with shadow detection. In Proceedings of the 2nd European Workshop on Advanced Video Based Surveillance Systems (AVBS).Google Scholar
- Kim, K., Chalidabhongse, T. H., Harwood, D., and Davis, L. 2005. Real-time foreground-background segmentation using codebook model. Real-Time Imag. 11, 3, 172--185. Google ScholarDigital Library
- Liu, L., Popescu, M., Skubic, M., Yardibi, T., and Cuddihy, P. 2011. Automatic fall detection based on Doppler radar motion signature. In Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.Google Scholar
- Petersson, O. and Moffat, A. 1992. A framework for adaptive sorting. In Proceedings of the 3rd Scandinavian Workshop on Algorithm Theory. Google ScholarDigital Library
- Rashidi, P. and Cook, D. J. 2009. Keeping the resident in the loop: Adapting the smart home to the user. IEEE Trans. Syst., Man., Cybern. A, Syst., Humans. Google ScholarDigital Library
- Rougier, C., Meunier, J., St-Arnaud, A., and Rousseau, J. 2007. Fall detection from human shape and motion history using video surveillance. In Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops. Google ScholarDigital Library
- Schoeller, D. A., Ravussin, E., Schutz, Y., Acheson, K. J., Baertschi, P., and Jequier, E. 1986. Energy expenditure by doubly labeled water. Amer. J. Physiol.: Regulat., Integr., Comp. Physiol. 240, 823--830.Google Scholar
- Sotoma, I. and Madeira, E. R. M. 2001. Adaptation---Algorithms to adapt fault monitoring and their implementation on CORBA. In Proceedings of the 3rd International Symposium on Distributed Objects and Applications. 219--228. Google ScholarDigital Library
- Stauffer, C. and Grimson, W. E. L. 1999. Adaptive background mixture models for real-time tracking. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. 246--52.Google Scholar
- Wood, A., Virone, G., Doan, T., Cao, Q., Selavo, L., Wu, Y., Fang, L., He, Z., Lin, S., and Stankovic, J. 2006. ALARM-NET: Wireless sensor networks for assistive-living and residential monitoring. Computer Science Department, University of Virginia. Tech. rep.Google Scholar
- Yao, N., Sclabassi, R. J., Liu, Q., Yang, J., Fernstrom, J. D., Fernstrom, M. H., and Sum, M. 2007. A video processing approach to the study of obesity. In Proceedings of the IEEE International Conference on Multimedia & Expo (ICME). 1727--1730.Google Scholar
Index Terms
- Accurate and Efficient Algorithms that Adapt to Privacy-Enhanced Video for Improved Assistive Monitoring
Recommendations
Privacy perception and fall detection accuracy for in-home video assistive monitoring with privacy enhancements
Video of in-home activity provides valuable information for assistive monitoring but raises privacy concerns. Raw video can be privacy-enhanced by obscuring the appearance of a person. We consider five privacy enhancements: blur, silhouette, oval, box, ...
Automated In-Home Assistive Monitoring with Privacy-Enhanced Video
ICHI '13: Proceedings of the 2013 IEEE International Conference on Healthcare InformaticsA privacy-enhanced video obscures the appearance of a person in the video. We consider four privacy enhancements: person blurred, person silhouetted, person covered with a bounding-oval, and person covered by a bounding-box. We demonstrate that privacy-...
Estimating Daily Energy Expenditure from Video for Assistive Monitoring
ICHI '13: Proceedings of the 2013 IEEE International Conference on Healthcare InformaticsAutomatically estimating a person's energy expenditure has numerous uses, including ensuring sufficient daily activity by an elderly live-alone person, such activity shown to have numerous benefits. Most previous work requires a person to wear a sensor ...
Comments