Predicting hospital admission for older emergency department patients: Insights from machine learning

https://doi.org/10.1016/j.ijmedinf.2020.104163Get rights and content

Highlights

  • Little is known about the performance and utility of ML methods in predicting hospital admission among older ED patients.

  • This is the first study to use ML for predicting hospital admission in older ED patients using geriatric syndromes and functional assessments.

  • ML can accurately predict hospital admission in older ED patients using geriatric syndromes, functional assessments, and baseline care needs.

  • Our predictions can inform decision-making about ED disposition and may expedite admission processes and proactive discharge planning.

Abstract

Background

Emergency departments (ED) are a portal of entry into the hospital and are uniquely positioned to influence the health care trajectories of older adults seeking medical attention. Older adults present to the ED with distinct needs and complex medical histories, which can make disposition planning more challenging. Machine learning (ML) approaches have been previously used to inform decision-making surrounding ED disposition in the general population. However, little is known about the performance and utility of ML methods in predicting hospital admission among older ED patients. We applied a series of ML algorithms to predict ED admission in older adults and discuss their clinical and policy implications.

Materials and methods

We analyzed the Canadian data from the interRAI multinational ED study, the largest prospective cohort study of older ED patients to date. The data included 2274 ED patients 75 years of age and older from eight ED sites across Canada between November 2009 and April 2012. Data were extracted from the interRAI ED Contact Assessment, with predictors including a series of geriatric syndromes, functional assessments, and baseline care needs. We applied a total of five ML algorithms. Models were trained, assessed, and analyzed using 10-fold cross-validation. The performance of predictive models was measured using the area under the receiver operating characteristic curve (AUC). We also report the accuracy, sensitivity, and specificity of each model to supplement performance interpretation.

Results

Gradient boosted trees was the most accurate model to predict older ED patients who would require hospitalization (AUC = 0.80). The five most informative features include home intravenous therapy, time of ED presentation, a requirement for formal support services, independence in walking, and the presence of an unstable medical condition.

Conclusion

To the best of our knowledge, this is the first study to predict hospital admission in older ED patients using a series of geriatric syndromes and functional assessments. We were able to predict hospital admission in older ED patients with good accuracy using the items available in the interRAI ED Contact Assessment. This information can be used to inform decision-making about ED disposition and may expedite admission processes and proactive discharge planning.

Introduction

Health systems around the world are challenged to adapt traditional care pathways to accommodate the complex physical and psychosocial needs of the growing geriatric population. The number of adults aged 65 years and older is expected to double by 2050, reaching 1.6 billion around the world [1]. The demand for health services will continue to increase alongside this demographic shift. Emergency departments (ED) are a common access point for older adults seeking medical attention, with the number of older ED patients increasing annually [2,3]. Older adults constitute a higher percentage of ED visits than younger persons, and they are more likely to visit for an urgent reason, resulting in hospital admission [[4], [5], [6]]. As the portal of entry into the hospital and the first source of contact for many seniors with their health care system, EDs are uniquely positioned to influence the health care trajectories of older adults presenting to the hospital for care [7,8].

The task-oriented and disease-centric focus of traditional emergency care pathways limit the department’s ability to attend to the multifaceted needs of older adults [9,10]. Geriatric complexity and multimorbidity often surpass the conventional ‘one-patient, one-problem’ approach to emergency care [10]. Assessing and treating older adults in the ED is often challenging for emergency clinicians [11,12], as these patients commonly present with heterogeneous symptoms, cognitive impairment, and a complex medical and social history [13]. Furthermore, the time pressures and high patient volumes seen in the ED can impede health care providers from providing comprehensive geriatric assessments and tailored treatment plans [14]. As a result, geriatric syndromes are commonly overlooked by ED clinicians [15,16], and older adults experience high rates of adverse outcomes both during their visit and following discharge [17]. Cognizant of the fact that older adults have distinct health care needs and a greater risk for adverse health events, clinical researchers and machine learning experts commonly aim to study the efficacy of clinical therapies and health services exposures in this vulnerable patient population [[18], [19], [20]]. Following suit, governing bodies responsible for ED accreditation and clinical practice guidelines collaborated in 2014 to create the first geriatric ED guidelines [8].

Determining patient disposition (admission vs. discharge) is an important and sometimes difficult decision for health care providers in the ED [21]. This is especially true for older adults, as they are at greater risk for functional decline, poor outcomes, and delayed discharge during in-patient stays [22,23]. The majority of hospital admissions come through the ED and constitute a significant source of health care spending. Furthermore, many hospital admissions are deemed to be potentially avoidable. As a result, health care providers, policymakers, and key stakeholders have all taken an interest in strategies to decrease inappropriate hospital admissions and extended stays [[24], [25], [26]]. Early identification of ED patients who require hospitalization can expedite admission processes and in-patient treatment [27], allowing for proactive discharge planning from the first patient contact. Both departmental barriers and the hazards associated with an inappropriate ED disposition underscore the utility of clinical decision support for older ED patients.

Machine learning (ML) has previously been used to predict disease, stratify patient risk, and inform clinical decision-making around patient disposition in emergency settings [28,29]. ML approaches are flexible and better able to identify hidden patterns and interactions among predictor variables [30,31]. The heterogeneous and complex presentation of older adults seeking emergency care makes ML an ideal candidate to inform clinical decision-making surrounding hospital admission in this high-risk patient population.

To date, the majority of studies aiming to predict hospital admission in ED patients focus on the general ED population [27,[32], [33], [34], [35], [36], [37], [38], [39]]. Two studies used text-mining and natural language processing to predict hospital admission [32,33], while the rest used non-linguistic methods to produce predictions. A study by Leegon et al. [40] attempted to predict hospital admission in the pediatric population. Only one study to date has attempted to predict hospital admission in older adults [41]. LaMantia and colleagues used demographic data, insurance status, chief complaint, vital signs, and triage acuity from a single hospital to fit a logistic regression model, which was moderately predictive of hospital admission in older ED patients (AUC = 0.73).

With little known about the performance and applications of ML approaches in older ED populations, we set out to identify whether ML could accurately predict hospital admission from the ED. More specifically, the objectives of this study are two-fold. First, we aimed to predict hospital admission using several ML approaches in older patients presenting to the ED for care. Second, we aimed to identify and describe the most important clinical and patient characteristics that are associated with hospital admission in older ED patients. Our study contributes to research in medical informatics, geriatrics, and emergency medicine by reporting on the utilities of ML as well as the importance of a comprehensive set of geriatric syndromes and functional assessments. These clinical assessments are not commonly available in an emergency setting.

Section snippets

Data source

We conducted a secondary data analysis of the Canadian patients in the largest prospective cohort study of older ED patients to date, the interRAI multinational ED study [42]. InterRAI is an international collaborative network that aims to improve the care of medically- or psychosocially-complex individuals. Data were collected on 2274 older adults from eight ED sites across five provinces in Canada (Ontario, Nova Scotia, Manitoba, Saskatchewan, and British Columbia) between November 2009 and

Summary results

Table 1 displays a summary of the clinical profiles of all older patients in the sample. In our data, 1119 (52%) of ED visits resulted in hospitalization. The median age of all patients was 83 (interquartile range [Q1–Q3]=7788), and the majority of the patients were female (61%). Most older adults presented to the ED enrolled in no publicly funded formal support service (78%), with 16% receiving home care services prior to ED arrival and 6% residing in a long-term care home. Approximately 80%

Discussion

Without knowledge of the presenting complaint, emergency diagnosis, or clinical therapies employed in the ED, we were able to predict hospital admission with good predictive accuracy. The GBT was best able to classify patients, producing an AUC of 0.8 and an accuracy of 0.76. Both the sensitivity and specificity of this model are relatively close (0.73 and 0.74, respectively), demonstrating that this algorithm can be used to both rule-in and rule-out older adults who may require

Conclusion

To our knowledge, this was the first study to predict hospital admission in older ED patients using a series of geriatric syndromes, functional assessments, and baseline care needs. We employed a series of ML methods and were able to obtain an AUC of 0.8 and an accuracy of 0.76 using GBT. Furthermore, our study highlighted a number of patient features that are predictive of hospital admission in older adults. This information can be used to inform decision-making about ED disposition and may

Authors’ contributions

Fabrice Mowbray drafted the initial document and conducted all statistical and predictive analytics. Dr. Manaf Zargoush contributed to the design of the machine learning algorithms, oversaw all analyses, and contributed substantial edits through all drafts of this paper. Aaron Jones, Dr. Kerstin de Wit, and Dr. Andrew Costa contributed to the edits of this paper and provided key insights into the clinical and policy implications of our findings.

Summary Points

What was already known on the topic?

  • 1

Declaration of Competing Interest

The authors declare no conflict of interest in this study.

Acknowledgment

We are grateful to MacData Institutefor funding our research. We are also grateful to the colleagues who provided feedback on this study.

References (61)

  • N.W. Sterling et al.

    Prediction of emergency department patient disposition based on natural language processing of triage notes

    Int. J. Med. Inf.

    (2019)
  • C.A. Parker et al.

    Predicting hospital admission at the emergency department triage: a novel prediction model

    Am. J. Emerg. Med.

    (2019)
  • N.I. Wellens et al.

    Interrater reliability of the interRAI Acute Care (interRAI AC)

    Arch. Gerontol. Geriatr.

    (2012)
  • H. Wan et al.

    An Aging World: 2015 (US Census Bureau, International Population Reports, P95/16-1)

    (2016)
  • O.T. Rutschmann et al.

    Pitfalls in the emergency department triage of frail elderly patients without specific complaints

    Swiss Med. Wkly.

    (2005)
  • L.P. Latham et al.

    Emergency department utilization by older adults: a descriptive study

    Can. Geriatr. J.

    (2014)
  • J.M. Pines et al.

    National trends in emergency department use, care patterns, and quality of care of older adults in the United States

    J. Am. Geriatr. Soc.

    (2013)
  • Canadian Institute for Health Information, Health Care in Canada, 2011: A Focus on Seniors and Aging

    (2011)
  • A.C. of E. Physicians, American Geriatrics Society, Emergency Nurses Association, Society for Academic Emergency Medicine, Geriatric Emergency Department Guidelines Task Force

    Geriatric emergency department guidelines

    Ann. Emerg. Med.

    (2014)
  • J.J. McCabe et al.

    Acute care of older patients in the emergency department: strategies to improve patient outcomes

    Open Access Emerg. Med. OAEM

    (2015)
  • T. Snider et al.

    A national survey of Canadian emergency medicine residents’ comfort with geriatric emergency medicine

    Can. J. Emerg. Med.

    (2017)
  • M.J. Bullard et al.

    Guidance when applying the canadian triage and acuity scale (CTAS) to the geriatric patient: executive summary

    Can. J. Emerg. Med.

    (2017)
  • P. Nugus et al.

    Work pressure and patient flow management in the emergency department: findings from an ethnographic study

    Acad. Emerg. Med.

    (2011)
  • C.R. Carpenter et al.

    Physician and nurse acceptance of technicians to screen for geriatric syndromes in the emergency department

    West. J. Emerg. Med.

    (2011)
  • A. Rodríguez-Molinero et al.

    Functional assessment of older patients in the emergency department: comparison between standard instruments, medical records and physicians’ perceptions

    BMC Geriatr.

    (2006)
  • M.C. Odden et al.

    Machine Learning in Aging Research

    (2019)
  • A. Jones et al.

    Predicting hospital and emergency department utilization among community-dwelling older adults: statistical and machine learning approaches

    PLoS One

    (2018)
  • L.A. Calder et al.

    How do emergency physicians make discharge decisions?

    Emerg. Med. J.

    (2015)
  • M.C. Creditor

    Hazards of hospitalization of the elderly

    Ann. Intern. Med.

    (1993)
  • S. Purdey et al.

    Predicting and preventing avoidable hospital admissions: a review., J. R

    Coll. Physicians Edinb.

    (2013)
  • Cited by (22)

    • Imbalanced prediction of emergency department admission using natural language processing and deep neural network

      2022, Journal of Biomedical Informatics
      Citation Excerpt :

      The objective is to solve a series of negative situations, such as increased patient risk, decreased service quality, negative emotions of medical staff, and higher hospital cost management in the ED. Reference [5] used a sequence of geriatric syndromes, functional assessments, and baseline care needs to predict hospital admission for older ED patients. Five machine learning methods exist: classification and regression tree, support vector machine, random forest, gradient boosted trees, and logistic regression (LR).

    • A novel approach for predicting acute hospitalizations among elderly recipients of home care? A model development study

      2022, International Journal of Medical Informatics
      Citation Excerpt :

      A systematic review from 2014 concluded that, in general, models based on administrative and/or routine clinical data from community-dwelling adults performs well [15] and that the best performing models included historical activity and concrete codes for diagnoses and medicine [15]. However, a recent study has found good performance for prediction models based only on triage of functional assessments, care needs and geriatric syndromes from the elderly [16]. The objective of this study was therefore to investigate whether it was possible to predict acute hospitalizations in elderly recipients of home care services based on a newly developed triage tool in Aalborg Municipality in combination with administrative and clinical data routinely collected in the Danish healthcare and social care sector.

    • Impact of multimorbidity and frailty on adverse outcomes among older delayed discharge patients: Implications for healthcare policy

      2022, Health Policy
      Citation Excerpt :

      Because age was highly correlated with the other covariates, it was not used in the models. Prior studies have determined that frailty, and not age, is predictive of hospital admission and readmission in older adults [8,59]. The primary outcomes were 30-day post-discharge readmission and mortality.

    View all citing articles on Scopus
    View full text