Murtadha Aldeer
Richard E. Howard
ABSTRACT
Cyber-Physical Systems (CPS) continues to add more intelligence to various applications, including healthcare. A recent wave of research included the development of pill logging systems that monitor when a pill is extracted. Automatic pill logging systems are an important technology for medication adherence, medication error prevention, and tracing. However, most existing systems do not consider how multi-bottle settings or long-term bottle use can affect their ability to log accurately, forcing frequent re-training/recalibration. In this paper, we present adaptive learning techniques for subject identification across a pair of smart pill bottle systems. We collect inertial signals from subjects taking medication pills and encode the activity signals by transforming them into 2D texture images. Then we use pre-trained Convolutional Neural Network (CNN) models for image-based classification tasks. We evaluate our approach with experiments executed by 10 subjects and achieved improved differentiation capacity over existing models by using deep learning models, modified through domain adaptation and transfer learning.
- Ali Akbari and Roozbeh Jafari. 2019. Transferring Activity Recognition Models for New Wearable Sensors with Deep Generative Domain Adaptation. In Proceedings of the 18th International Conference on Information Processing in Sensor Networks (IPSN '19). 85--96.Google Scholar
Digital Library
- Murtadha Aldeer, Mehdi Javanmard, and Richard Martin. 2018. A Review of Medication Adherence Monitoring Technologies. Applied System Innovation 1, 2 (2018), 14.Google ScholarCross Ref
- Murtadha Aldeer, Jorge Ortiz, Richard E Howard, and Richard P Martin. 2019. PatientSense: patient discrimination from in-bottle sensors data. In Proceedings of the 16th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. 143--152.Google ScholarDigital Library
- Noha Ferrah, Janaka J. Lovell, and Joseph E. Ibrahim. 2017. Systematic Review of the Prevalence of Medication Errors Resulting in Hospitalization and Death of Nursing Home Residents. Journal of the American Geriatrics Society 65, 2 (Feb. 2017), 433--442.Google ScholarCross Ref
- Bedartha Goswami. 2019. A Brief Introduction to Nonlinear Time Series Analysis and Recurrence Plots. Vibration 2, 4 (2019), 332--368.Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.Google ScholarCross Ref
- Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4700--4708.Google ScholarCross Ref
- Taeho Hur, Jaehun Bang, Jongwon Lee, Jee-In Kim, Sungyoung Lee, et al. 2018. Iss2Image: A novel signal-encoding technique for CNN-based human activity recognition. Sensors 18, 11 (2018), 3910.Google ScholarCross Ref
- Thien Huynh-The, Cam-Hao Hua, and Dong-Seong Kim. 2019. Visualizing Inertial Data For Wearable Sensor Based Daily Life Activity Recognition Using Convolutional Neural Network. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2478--2481.Google Scholar
- Forrest N Iandola, Song Han, Matthew W Moskewicz, Khalid Ashraf, William J Dally, and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size. arXiv preprint arXiv: 1602.07360 (2016).Google Scholar
- Emil Jovanov, BMS Talukder, David Schwebel, and W Evans. 2018. Design and Feasibility of a Safe Pill Bottle. Applied System Innovation 1, 2 (2018), 13.Google ScholarCross Ref
- Md Abdullah Al Hafiz Khan, Nirmalya Roy, and Archan Misra. 2018. Scaling human activity recognition via deep learning-based domain adaptation. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--9.Google ScholarCross Ref
- Jennifer Kim, Kelsy Combs, Jonathan Downs, and F Tillman. 2018. Medication adherence: The elephant in the room. US Pharmacist 43, 1 (2018), 30--34.Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2017. ImageNet Classification with Deep Convolutional Neural Networks. Commun. ACM 60, 6 (May 2017), 84--90.Google ScholarDigital Library
- Yann LeCun and Yoshua Bengio. 1998. Convolutional Networks for Images, Speech, and Time Series. MIT Press, Cambridge, MA, USA, 255--258.Google Scholar
- Jianjie Lu and Kai-Yu Tong. 2019. Robust Single Accelerometer-Based Activity Recognition Using Modified Recurrence Plot. IEEE Sensors Journal 19, 15 (2019), 6317--6324.Google ScholarCross Ref
- Mark Nutter, Catherine H Crawford, and Jorge Ortiz. 2018. Design of novel deep learning models for real-time human activity recognition with mobile phones. In 2018 International Joint Conference on Neural Networks (IJCNN). 1--8.Google ScholarCross Ref
- Sinno Jialin Pan and Qiang Yang. 2009. A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22, 10 (2009), 1345--1359.Google ScholarDigital Library
- Matthew E Peters, Sebastian Ruder, and Noah A Smith. 2019. To tune or not to tune? adapting pretrained representations to diverse tasks. arXiv preprint arXiv:1903.05987 (2019).Google Scholar
- Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4510--4520.Google ScholarCross Ref
- Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In International Conference on Learning Representations.Google Scholar
- John A. Stankovic. 2016. Research Directions for Cyber Physical Systems in Wireless and Mobile Healthcare. ACM Trans. Cyber-Phys. Syst. 1, 1, Article 1 (Nov. 2016), 12 pages.Google Scholar
- Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2818--2826.Google ScholarCross Ref
- Terry T. Um, Franz M. J. Pfister, Daniel Pichler, Satoshi Endo, Muriel Lang, Sandra Hirche, Urban Fietzek, and Dana Kulić. 2017. Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring Using Convolutional Neural Networks. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (ICMI '17). 216--220.Google ScholarDigital Library
- Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems (2020).Google ScholarCross Ref
Index Terms
- Is That You Again?: Adaptive Learning Techniques for User Identification in Smart Pill Bottle Systems
Recommendations
User Identification Across Multiple Smart Pill Bottle Systems: Poster Abstract
IPSN '21: Proceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021)Medication adherence is one of the leading factors that can make the difference between life and death, especially for patients managing chronic conditions [2]. Indeed, these issues have driven a recent wave of research, including the development of ...
User Identification using Smart Pill Bottles: Systems and Machine Learning Models: PhD Forum Abstract
IPSN '21: Proceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021)Medication adherence is one of the leading factors that can make the difference between life and death, especially for patients managing chronic conditions. These issues have driven a recent wave of research, including the development of smart pill ...
Repurposing transfer learning strategy of computer vision for owl sound classification
AbstractAccurately predicting an owl species based on its sound can be helpful for owl conservation. To build an accurate model for owl sound classification, deep learning is currently the most preferred algorithm, due to its excellent performance for ...
Comments