Francisco Gutiérrez
Vero Vanden Abeele
ABSTRACT
Recommender systems are increasingly used in high-risk application domains, including healthcare. It has been shown that explanations are crucial in this context to support decision-making. This paper explores how to explain call recommendations to nursing home staff, providing insights into call priority, notifications, and resident information. We present the design and implementation of a recommender engine and a mobile application designed to support call recommendations and explain these recommendations that may contribute to residents’ safety and quality of care. More specifically, we report on the results of a user-centered design approach with residents (N=12) and healthcare professionals (N=4), and a final evaluation (N=12) after four months of deployment. The results show that our design approach provides a valuable tool for more accurate and efficient decision-making. The overall system encourages nursing home staff to provide feedback and annotate, resulting in more confidence in the system. We discuss usability issues, challenges, and reflections to be considered in future health recommender systems.
- Haneen Ali, Astin Cole, Adam Sienkiewicz, and Tori Ho. 2020. Perspectives of Nursing Homes Staff on the Nature of Residents-Initiated Call Lights. SAGE Open Nursing 6(2020), 2377960820903546. https://doi.org/10.1177/2377960820903546 PMID: 33415269.Google Scholar
Cross Ref
- Haneen Ali and Huiyang Li. 2020. Use of notification and communication technology (call light systems) in nursing homes: Observational study. Journal of medical Internet research 22, 3 (2020), e16252.Google ScholarCross Ref
- Judith Bonomi, Corrine Lindquist, Olivia Lemberger, and Elisabeth Garrison. 2021. Evaluating the effects of a high-tech call system on patient-staff communication. Nursing Management 52, 2 (2021), 13–17.Google ScholarCross Ref
- Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5–32.Google ScholarDigital Library
- Patricia Flatley Brennan and Mary L McHugh. 1988. Clinical decision-making and computer support. Applied Nursing Research 1, 2 (1988), 89–93.Google ScholarCross Ref
- André Calero Valdez, Martina Ziefle, Katrien Verbert, A. Felfernig, and Andreas Holzinger. 2016. Recommender Systems for Health Informatics: State-of-the-Art and Future Perspectives. Lecture Notes in Computer Science 9605 (11 2016). https://doi.org/10.1007/978-3-319-50478-0_20Google ScholarCross Ref
- Joseph N. Cappella, Sijia Yang, and Sungkyoung Lee. 2015. Constructing Recommendation Systems for Effective Health Messages Using Content, Collaborative, and Hybrid Algorithms. The ANNALS of the American Academy of Political and Social Science 659, 1(2015), 290–306.Google ScholarCross Ref
- Gabriella Casalino, Giovanna Castellano, Vincenzo Pasquadibisceglie, and Gianluca Zaza. 2019. Contact-less real-time monitoring of cardiovascular risk using video imaging and fuzzy inference rules. Information 10, 1 (2019), 9.Google ScholarCross Ref
- Lian Duan, W Street, and D Lu. 2008. A nursing care plan recommender system using a data mining approach. In Proceedings of the 3rd INFORMS Workshop on Data Mining and Health Informatics. Citeseer, 1–6.Google Scholar
- R. Farrell, C. Danis, S. Ramakrishnan, W. Kellogg, and T. J. Watson. 2012. Intrapersonal Retrospective Recommendation : Lifestyle Change Recommendations Using Stable Patterns of Personal Behavior.Google Scholar
- Gerald C Gannod, Katherine M Abbott, Kimberly Van Haitsma, Nathan Martindale, and Alexandra Heppner. 2019. A machine learning recommender system to tailor preference assessments to enhance person-centered care among nursing home residents. The Gerontologist 59, 1 (2019), 167–176.Google ScholarCross Ref
- Chen He, Denis Parra, and Katrien Verbert. 2016. Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities. Expert Systems with Applications 56 (2016), 9–27. https://doi.org/10.1016/j.eswa.2016.02.013Google ScholarDigital Library
- Andreas Holzinger. 2016. Interactive machine learning for health informatics: when do we need the human-in-the-loop?Brain Informatics 3, 2 (2016), 119–131.Google ScholarCross Ref
- Yucheng Jin, Nava Tintarev, and Katrien Verbert. 2018. Effects of Personal Characteristics on Music Recommender Systems with Different Levels of Controllability. In Proceedings of the 12th ACM Conference on Recommender Systems (Vancouver, British Columbia, Canada) (RecSys ’18). Association for Computing Machinery, New York, NY, USA, 13–21. https://doi.org/10.1145/3240323.3240358Google ScholarDigital Library
- Bart P Knijnenburg, Martijn C Willemsen, Zeno Gantner, Hakan Soncu, and Chris Newell. 2012. Explaining the user experience of recommender systems. User Modeling and User-Adapted Interaction 22, 4 (2012), 441–504.Google ScholarDigital Library
- Christine M Meade, Amy L Bursell, and Lyn Ketelsen. 2006. Effects of nursing rounds: on patients’ call light use, satisfaction, and safety. AJN The American Journal of Nursing 106, 9 (2006), 58–70.Google ScholarCross Ref
- Dan W Patterson. 1990. Introduction to artificial intelligence and expert systems. Prentice-hall of India.Google Scholar
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.Google ScholarDigital Library
- Pearl Pu, Li Chen, and Rong Hu. 2012. Evaluating recommender systems from the user’s perspective: survey of the state of the art. User Modeling and User-Adapted Interaction 22, 4-5 (2012), 317–355.Google ScholarDigital Library
- Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations as mechanisms for supporting algorithmic transparency. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Sheila A Ryan. 1985. An expert system for nursing practice. Journal of medical systems 9, 1 (1985), 29–41.Google ScholarCross Ref
- Ando Saabas. 2021. TreeInterpreter. https://github.com/andosa/treeinterpreter.Google Scholar
- Hanna Schäfer, Santiago Hors-Fraile, Raghav Pavan Karumur, André Calero Valdez, Alan Said, Helma Torkamaan, Tom Ulmer, and Christoph Trattner. 2017. Towards Health (Aware) Recommender Systems. In Proceedings of the 2017 International Conference on Digital Health (London, United Kingdom) (DH ’17). Association for Computing Machinery, New York, NY, USA, 157–161. https://doi.org/10.1145/3079452.3079499Google ScholarDigital Library
- Emily Seto, Kevin J Leonard, Joseph A Cafazzo, Jan Barnsley, Caterina Masino, and Heather J Ross. 2012. Developing healthcare rule-based expert systems: case study of a heart failure telemonitoring system. International journal of medical informatics 81, 8(2012), 556–565.Google Scholar
- Emre Sezgin and Sevgi Özkan. 2013. A systematic literature review on health recommender systems. In 2013 E-Health and Bioengineering Conference (EHB). IEEE, 1–4.Google ScholarCross Ref
- Jaime Lynn Speiser, Kathryn E Callahan, Denise K Houston, Jason Fanning, Thomas M Gill, Jack M Guralnik, Anne B Newman, Marco Pahor, W Jack Rejeski, and Michael E Miller. 2021. Machine learning in aging: an example of developing prediction models for serious fall injury in older adults. The Journals of Gerontology: Series A 76, 4 (2021), 647–654.Google ScholarCross Ref
- Nava Tintarev and Judith Masthoff. 2015. Explaining recommendations: Design and evaluation. In Recommender systems handbook. Springer, 353–382.Google Scholar
- Kosetsu Tsukuda and Masataka Goto. 2020. Explainable Recommendation for Repeat Consumption. In Fourteenth ACM Conference on Recommender Systems (Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 462–467.Google ScholarDigital Library
- Venmo. 2021. business-rules. https://github.com/venmo/business-rules.Google Scholar
- Martin Wiesner and Daniel Pfeifer. 2014. Health recommender systems: concepts, requirements, technical basics and challenges. International journal of environmental research and public health 11, 3(2014), 2580–2607.Google Scholar
Index Terms
- Explaining Call Recommendations in Nursing Homes: a User-Centered Design Approach for Interacting with Knowledge-Based Health Decision Support Systems
Index terms have been assigned to the content through auto-classification.
Recommendations
Nursing Care Quality in Nursing Homes: Cross-Sectional Versus Longitudinal Analysis
This empirical study of the relationship between nursing care adequacy and nursing care quality demonstrates that a positive relationship exists between the process and outcome dimensions of quality of nursing care. The results from the analysis of ...
Finding best evidence for evidence-based best practice recommendations in health care: the initial decision support system design
A major problem for Canadian health organizations is finding best evidence for evidence-based best practice recommendations. Medications are not always effectively used and misuse may harm patients. Drugs are the fastest-growing element of Canadian ...
Design and evaluation of a knowledge-based clinical decision support system for the psychiatric nursing process
Highlights- The Psy-KBCDSS is an empirical patient-oriented nursing clinical decision-making support system.
Abstract Background and objectivesThe nursing assessment in the psychiatric department differ from those used in other departments considerably. We developed a psychiatric knowledge-based clinical decision support system (Psy-KBCDSS)...
Comments