Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Emergency department visits and boarding for pediatric patients with suicidality before and during the COVID-19 pandemic

  • Amy R. Zipursky,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America, Division of Emergency Medicine, Boston Children’s Hospital, Boston, Massachusetts, United States of America

  • Karen L. Olson,

    Roles Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America

  • Louisa Bode,

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Hannover, Lower Saxony, Germany

  • Alon Geva,

    Roles Methodology, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America, Division of Critical Care Medicine, Department of Anesthesiology, Critical Care, and Pain Medicine, Boston Children’s Hospital, Boston, Massachusetts, United States of America

  • James Jones,

    Roles Methodology, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America

  • Kenneth D. Mandl ,

    Contributed equally to this work with: Kenneth D. Mandl, Andrew McMurry

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    kenneth.mandl@childrens.harvard.edu

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America, Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America

  • Andrew McMurry

    Contributed equally to this work with: Kenneth D. Mandl, Andrew McMurry

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliations Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America

Abstract

Objective

To quantify the increase in pediatric patients presenting to the emergency department with suicidality before and during the COVID-19 pandemic, and the subsequent impact on emergency department length of stay and boarding.

Methods

This retrospective cohort study from June 1, 2016, to October 31, 2022, identified patients ages 6 to 21 presenting to the emergency department at a pediatric academic medical center with suicidality using ICD-10 codes. Number of emergency department encounters for suicidality, demographic characteristics of patients with suicidality, and emergency department length of stay were compared before and during the COVID-19 pandemic. Unobserved components models were used to describe monthly counts of emergency department encounters for suicidality.

Results

There were 179,736 patient encounters to the emergency department during the study period, 6,215 (3.5%) for suicidality. There were, on average, more encounters for suicidality each month during the COVID-19 pandemic than before the COVID-19 pandemic. A time series unobserved components model demonstrated a temporary drop of 32.7 encounters for suicidality in April and May of 2020 (p<0.001), followed by a sustained increase of 31.2 encounters starting in July 2020 (p = 0.003). The average length of stay for patients that boarded in the emergency department with a diagnosis of suicidality was 37.4 hours longer during the COVID-19 pandemic compared to before the COVID-19 pandemic (p<0.001).

Conclusions

The number of encounters for suicidality among pediatric patients and the emergency department length of stay for psychiatry boarders has increased during the COVID-19 pandemic. There is a need for acute care mental health services and solutions to emergency department capacity issues.

Introduction

Suicide was the second leading cause of death for 10- to 14-year-olds and the third leading cause of death for 15- to 19-year-olds in 2021 [1]. Since the start of the COVID-19 pandemic [28], there has been a documented increase in suicidal ideation and attempt among pediatric patients. This has resulted in an increase in emergency department (ED) visits [7, 9] further straining EDs in the United States [10].

Patients visiting the ED for mental health issues are twice as likely to be hospitalized compared to other patients [11]. Because there is a shortage of inpatient psychiatric beds and limited outpatient mental health services, patients presenting to the ED for mental health reasons often board in the ED for long periods of time [10, 12, 13]. A review of pediatric mental health boarding in 2019 noted that 23 to 58% of patients with mental or behavioral health concerns boarded in the ED and that average boarding duration in the ED was five to 41 hours [13]. This problem has been exacerbated during the COVID-19 pandemic, with increased waiting times for pediatric psychiatric beds [14]. A survey of pediatric hospitalists inquiring about boarding in the ED and inpatient setting in the United States and Canada found that 75% of those that responded noted an increase in boarding duration and 84% an increase in boarding frequency during the COVID-19 pandemic [12]. Patients boarding in the ED often do not have access to the psychiatric services they need for optimal care [12]. The urgent need for solutions to ED boarding and mental health capacity issues has been recognized [10, 15]. Many studies to date have focused on the first year of the pandemic, and have not examined boarding and capacity issues. We sought to quantify the increase in pediatric patients presenting to the ED with suicidality during the COVID-19 pandemic and the subsequent impact on ED length of stay (LOS) and boarding. We additionally sought to describe the population of pediatric patients presenting to the ED with suicidality before and during the COVID-19 pandemic.

Methods

This is a retrospective cohort study using the electronic health records (EHR) of patients who presented to the ED at Boston Children’s Hospital (BCH), a pediatric academic medical center, between June 1, 2016 and October 31, 2022. Patients between 6 and 21 years old were included and age was recorded as an integer [16]. Patients with multiple ED visits were counted once for each visit and could be included in different age groups over the course of the study. The study received exempt status from the Institutional Review Board at BCH.

Suicidality is defined using International Classification of Diseases, 10th Revision (ICD-10) codes selected from those used in prior studies [1725]. We included discharge diagnosis and billing codes for suicidal ideation (R45.851), suicide attempt (T14.91*), and codes for intentional self-harm (S1 Table in S1 File). Codes include all those listed in the Suicide and Self-harm group of the Child and Adolescent Mental Health Disorders Classification System (CAMHD-CS) from the Children’s Hospital Association [26]. All patients 12 years of age or older presenting to the ED were screened for suicidal ideation using the Ask Suicide-Screening Questions (ASQ) Toolkit [27].

ED LOS is defined as the time between ED check-in and check-out. Prolonged LOS was defined as more than 24 hours.

Psychiatry boarders are patients who remained in the ED for 24 hours or more and/or needed a higher level of psychiatric care (i.e. inpatient psychiatric services) before discharge from the ED. They were identified by the existence of a standard psychiatry boarder form in the EHR that was completed by a psychiatry resource specialist after the patient was assessed by the emergency psychiatric service. Some patients remained in the ED awaiting inpatient psychiatric care and others were transferred to a medical ward awaiting inpatient psychiatric care depending on inpatient bed availability. This study focused solely on boarding time in the ED and did not examine boarding time spent on a medical ward.

COVID-19 pandemic periods were defined as pre-COVID-19 (June 1, 2016 to February 29, 2020) and COVID-19 (March 1, 2020 to October 31, 2022) [28].

Race and ethnicity were self-reported by patients or their parents or guardians at intake. They could select one or more racial categories including other and indicate their ethnicity as Hispanic or Latino if applicable. For this study, race and ethnicity were coded as mutually exclusive categories: Hispanic/Latino (any race group), and Non-Hispanic/Latino groups: Asian, Black/African American, Multiracial, Other Race, White, and a final category for Unknown.

Preferred language was self-reported by patients or their parents or guardians at intake. For this study, responses were coded into four mutually exclusive categories: English, Spanish, Other language, and Unknown.

Seasons were defined as winter (January, February, March), spring (April, May, June), summer (July, August, September), and fall (October, November, December). Seasonality often characterizes data associated with calendar dates. A recent study of pediatric mental health related ED visits from 2016 to 2021 showed that fewer visits occurred in July and August, except during 2020 [29].

Analysis

The number of ED encounters with ICD-10 codes for suicidal ideation, suicide attempt, and intentional self-harm pre-COVID-19 and during COVID-19 were compared. We also compared the demographic characteristics of patients during these two time periods. ED LOS for encounters with suicidality diagnoses were compared for those with and without psychiatry boarders during the two time periods. Analyses used Chi-square and analysis of variance (ANOVA) with post-hoc Tukey tests. Least squares means (LSM) and 95% confidence limits (CL) or differences between LSMs are reported for ANOVA results. Analyses were performed using SAS 9.4 (SAS Institute Inc., Cary, NC).

Unobserved components models (UCM) were used to describe monthly counts of ED encounters for suicidality. Time series can be described in terms of their components such as trend, seasonality, and cycles, and can include regression effects [3033]. Our initial model included components for trend and seasonality. Regression variables were added to assess the impact of COVID-19 in 2020, with April 2020 as the initial month of impact. Statistical change point analysis was used to evaluate other notable trend changes. Analyses were performed using the UCM Procedure in SAS 9.4. P values less than 0.05 were considered significant.

Results

There were 179,736 ED encounters during the study period and 6,215 (3.5%) had an ICD-10 code for suicidality. ANOVA revealed main effects for the COVID-19 pandemic period and season (p<0.001 for each) and no significant interaction. On average, there were more suicidality encounters each month during the COVID-19 time period (LSM 101.8, CL95.2, 108.4) than during the pre-COVID-19 time period (LSM 67.3, CL 61.8, 72.8). Compared to summer months, on average there were 19.2 (CL 3.7, 34.7) more suicidality encounters during spring, 30.6 (CL 14.9, 46.4) more during fall, and 33.3 (CL 17.4, 49.2) more during winter months.

Among all ED encounters, we examined how many suicidality encounters versus all others were characterized by a prolonged LOS or a psychiatry boarder form in the EHR. More suicidality encounters (2,916, 46.9%) had a prolonged ED LOS than encounters without that diagnosis (2,616, 1.5%, p<0.001). More suicidality encounters had a completed boarder form (4,723, 76.0%) than other ED encounters (4,701, 2.7%, p<0.001).

The demographic characteristics of patients with a suicidality diagnosis during ED encounters in the pre-COVID-19 and COVID-19 time periods are shown in Table 1. The majority of encounters (84.7%) were with patients 12–18 years old. Differences between the COVID-19 pandemic periods were not significant (p = 0.600). The majority of patients were female, and they comprised a greater percentage of patients during the COVID-19 time period (71.6%) than during the pre-COVID-19 time period (65.4%, p<0.001). Race and ethnicity was reported as White, non-Hispanic for the majority of patients (52.6%) during suicidality encounters, followed by Hispanic/Latino (14.9%) and Black/African American, non-Hispanic (12.4%). The distribution of categories varied somewhat between the time periods (p<0.001). Post-hoc analyses indicated that one category, Unknown, differed by pandemic period. English was reported as the preferred language for the majority of encounters (91.4%), followed by Spanish (4.8%), and other languages (2.5%). Post-hoc analyses indicated that one category, Unknown, differed by pandemic period.

thumbnail
Table 1. Characteristics of patients with a suicidality diagnosis during ED encounters before and during the COVID-19 pandemic.

https://doi.org/10.1371/journal.pone.0286035.t001

Suicide attempt was coded for 322 encounters (5.2%) and these encounters could also include codes for intentional self-harm (126), ideation (62), or both (57). Intentional self-harm codes, without an attempt code, described 1,016 (16.3%) encounters, 456 with an ideation code. Ideation without attempt or intentional self-harm codes described the majority (4,877, 78.5%) of encounters. There were no differences by time period (p = 0.103).

The self-harm diagnosis codes were grouped into injury mechanism categories from the Centers for Disease Control external cause matrix for intentional self-harm [34]. The majority of the 1,199 encounters with intentional self-harm ICD-10 codes observed in our data were from the “Poisoning, Drug” category (75.8%), followed by “Cut/Pierce” (12.2%). Each of the eight injury categories are listed in Table 2, along with the 28 3-character ICD values that describe the self-harm diagnoses (also see S2-S4 Tables in S1 File).

thumbnail
Table 2. Mechanism of injury and diagnosis categories for emergency department encounters with intentional self-harm diagnoses.

https://doi.org/10.1371/journal.pone.0286035.t002

The effect of psychiatry boarder status and COVID-19 pandemic period on ED LOS is shown in Table 3. ANOVA revealed significant main effects for boarder status and time period, and a significant interaction (p<0.001 for all). Encounters without psychiatry boarders were not prolonged and post-hoc analyses showed that ED LOS did not differ between the pre-COVID-19 and COVID-19 time periods. However, encounters with boarders were, on average, prolonged and those during the COVID-19 pandemic were 37.4 hours longer than before the COVID-19 pandemic. Also, before the COVID-19 pandemic, suicidality encounters where the patient was boarding were 22.9 hours longer than encounters without boarding. During the COVID-19 pandemic, this difference was 61.7 hours.

thumbnail
Table 3. The effect of psychiatry boarder status and COVID-19 pandemic period on ED LOS for patients with a suicidality diagnosis.

https://doi.org/10.1371/journal.pone.0286035.t003

A time series of the number of ED suicidality encounters is shown in Fig 1. Seasonality is apparent, with lowest points in summer months, except during 2020. The UCM analysis for suicidality encounters included a trend component modeled as a random walk with drift, deterministic seasonality, and two intervention variables. A smoothed plot of the seasonality component is shown in Fig 2. The estimate for level at its final state was 72.7 encounters (standard error (se) 12.2, p<0.001), while the slope was close to zero (0.2, se 0.6, p = 0.711). The trend was effectively a random walk with little or no drift. Two intervention variables described the impact of COVID-19. A temporary change lasting two months (April-May 2020) had an effect size of -32.7 encounters (se 9.5, p<0.001). A level change beginning in July 2020 had a sustained effect size of 31.2 (se 10.6, p = 0.003). Fig 3 shows the smoothed sum of the trend and regression effects (April-May 2020 drop, increase since July 2020) by isolating these effects from the complete series. A smoothed plot of the sum of all the components and regression effects, minus the irregular term, is shown in Fig 4.

thumbnail
Fig 1. Time series for number of emergency department encounters with suicidality.

Number of encounters per month between June 1, 2016 and October 31, 2022.

https://doi.org/10.1371/journal.pone.0286035.g001

thumbnail
Fig 2. Smoothed seasonal component for emergency department encounters with suicidality.

CL = Confidence limits. Seasonal component of a time series unobserved components model.

https://doi.org/10.1371/journal.pone.0286035.g002

thumbnail
Fig 3. Smoothed trend and regression effects (April-May 2020 drop, July 2020 level shift).

CL = Confidence limits. Sum of effects from a time series unobserved components model for emergency department encounters with suicidality.

https://doi.org/10.1371/journal.pone.0286035.g003

thumbnail
Fig 4. UCM sum of the smoothed trend, regression, and season effects.

CL = Confidence limits. Sum of all components except the irregular term of a time series unobserved components model for emergency department encounters with suicidality. Regression effects are a temporary drop in April and May 2020 and a level shift beginning in July 2020.

https://doi.org/10.1371/journal.pone.0286035.g004

Discussion

After an initial drop at the beginning of the COVID-19 pandemic in April and May 2020, the number of ED encounters for suicidality increased during the COVID-19 pandemic.

Previous studies have shown a decrease in ED visits overall and ED visits for psychiatric issues early in the COVID-19 pandemic [6, 35, 36]. Individuals may have accessed care less frequently early in the COVID-19 pandemic due to fear of contracting COVID-19. The subsequent increase we observed in ED visits for suicidality is consistent with previous literature. Existing literature, mainly focusing on data up to 2021 [2, 47, 14], found an increase in pediatric suicidality during the COVID-19 pandemic as well as increased ED visits [27, 14] and hospitalizations [37]. A number of factors likely contributed to the increase in presentations for suicidality. Early in the pandemic, with stay-at-home orders, there was decreased access to mental health services including school services [38]. With limited access to services, more patients may have had worsening mental health symptoms leading to suicidality. Persistent stressors related to COVID-19 may have resulted in increased suicidality among pediatric patients. The increased presentations could be a result of delayed presentations from early in the COVID-19 pandemic. Our results also describe an increase in the number and duration of ED boarding for those presenting to the ED with suicidality. Previous literature has described an increase in mental health boarding in general through 2021 and has included ED and inpatient unit stays or other temporary location stays in the definition of boarding [12, 14]. This study specifically highlights capacity issues related to the ED and patients presenting with suicidality. Furthermore, with data through October 2022, our study demonstrates the sustained impact of COVID-19 on pediatric suicidality and the need for improved care for patients presenting with suicidality. While solutions to these issues are complex, previous literature has explored possible approaches. To reduce ED capacity, previous studies have supported efficacy of initiatives during ED visits such as suicide prevention interventions [39] and improved primary care provider follow-up [40]. Literature has proposed psychosocial interventions during boarding including psychoeducation, behavioral activation, and relaxation training [41].

This study has some limitations. First, while we chose diagnostic codes used in the published literature to identify patients with suicidality [1725], these ICD-10 codes are nonetheless intended for patient billing. Consistent with previous literature, we included codes for suicide and for intentional self-harm. We recognize the challenge clinically in deciphering whether self-harm is intentional and whether the intention of the patient was to die; this may have resulted in an overestimation of suicidality in our study. Second, though our time series demonstrates a compelling trend, other secular changes during the COVID-19 pandemic may not be accounted for. Pediatric primary care was limited at points during the COVID-19 pandemic due to factors such as access to personal protective equipment and ability to isolate infectious patients [42]. This may have led patients to present to the ED rather than accessing the primary care settings that they would have prior to the COVID-19 pandemic. Finally, our study was in a large, well-resourced children’s hospital in an urban setting. While studies conducted in other settings have found comparable results [2, 47, 35], these findings may not generalize to all settings.

Overall, we demonstrate an increase in patients with suicidality that presented to the ED during the COVID-19 pandemic and the capacity issues facing the ED. Future studies should focus on expanding this work to multiple medical centers. This work supports the need for an increase in acute care mental health services and solutions to ED capacity issues.

Supporting information

S1 File. Contains all supporting tables and data files.

https://doi.org/10.1371/journal.pone.0286035.s001

(XLSX)

References

  1. 1. National Vital Statistics System, Mortality 2018–2021 on CDC WONDER Online Database, released in 2021. Data are from the Multiple Cause of Death Files, 2018–2021, as compiled from data provided by the 57 vital statistics jurisdictions through the Vital Statistics Cooperative Program. In: Centers for Disease Control and Prevention, National Center for Health Statistics. [Internet]. [cited 31 Oct 2022]. Available: http://wonder.cdc.gov/ucd-icd10-expanded.html
  2. 2. Goto R, Okubo Y, Skokauskas N. Reasons and trends in youth’s suicide rates during the COVID-19 pandemic. Lancet Reg Health West Pac. 2022;27: 100567. pmid:35966624
  3. 3. Listernick ZI, Badawy SM. Mental Health Implications of the COVID-19 Pandemic Among Children and Adolescents: What Do We Know so Far? Pediatric Health Med Ther. 2021;12: 543–549. pmid:34984040
  4. 4. Hill RM, Rufino K, Kurian S, Saxena J, Saxena K, Williams L. Suicide Ideation and Attempts in a Pediatric Emergency Department Before and During COVID-19. Pediatrics. 2021;147. pmid:33328339
  5. 5. Arakelyan M, Emond JA, Leyenaar JK. Suicide and Self-Harm in Youth Presenting to a US Rural Hospital During COVID-19. Hosp Pediatr. 2022;12: e336–e342. pmid:36164850
  6. 6. Yard E, Radhakrishnan L, Ballesteros MF, Sheppard M, Gates A, Stein Z, et al. Emergency Department Visits for Suspected Suicide Attempts Among Persons Aged 12–25 Years Before and During the COVID-19 Pandemic—United States, January 2019-May 2021. MMWR Morb Mortal Wkly Rep. 2021;70: 888–894. pmid:34138833
  7. 7. Charpignon M-L, Ontiveros J, Sundaresan S, Puri A, Chandra J, Mandl KD, et al. Evaluation of Suicides Among US Adolescents During the COVID-19 Pandemic. JAMA Pediatr. 2022;176: 724–726. pmid:35467724
  8. 8. Anderson KN, Swedo EA, Trinh E, Ray CM, Krause KH, Verlenden JV, et al. Adverse Childhood Experiences During the COVID-19 Pandemic and Associations with Poor Mental Health and Suicidal Behaviors Among High School Students—Adolescent Behaviors and Experiences Survey, United States, January–June 2021. MMWR. Morbidity and Mortality Weekly Report. 2022. pp. 1301–1305. pmid:36227769
  9. 9. Leeb RT, Bitsko RH, Radhakrishnan L, Martinez P, Njai R, Holland KM. Mental Health-Related Emergency Department Visits Among Children Aged <18 Years During the COVID-19 Pandemic—United States, January 1-October 17, 2020. MMWR Morb Mortal Wkly Rep. 2020;69: 1675–1680.
  10. 10. Cutler GJ, Bergmann KR, Doupnik SK, Hoffmann JA, Neuman MI, Rodean J, et al. Pediatric Mental Health Emergency Department Visits and Access to Inpatient Care: A Crisis Worsened by the COVID-19 Pandemic. Acad Pediatr. 2022;22: 889–891. pmid:35351651
  11. 11. Lin M-Y, Kim J, Sheldrick RC, Bair-Merritt MH, Durham MP, Feinberg E, et al. Five-Year Trends in Pediatric Mental Health Emergency Department Visits in Massachusetts: A Population-Based Cohort Study. J Pediatr. 2022;246: 199–206.e17. pmid:35301021
  12. 12. Leyenaar JK, Freyleue SD, Bordogna A, Wong C, Penwill N, Bode R. Frequency and Duration of Boarding for Pediatric Mental Health Conditions at Acute Care Hospitals in the US. JAMA. 2021;326: 2326–2328. pmid:34792533
  13. 13. McEnany FB, Ojugbele O, Doherty JR, McLaren JL, Leyenaar JK. Pediatric Mental Health Boarding. Pediatrics. 2020;146. pmid:32963020
  14. 14. Ibeziako P, Kaufman K, Scheer KN, Sideridis G. Pediatric Mental Health Presentations and Boarding: First Year of the COVID-19 Pandemic. Hosp Pediatr. 2022;12: 751–760. pmid:35578918
  15. 15. AAP-AACAP-CHA Declaration of a National Emergency in Child and Adolescent Mental Health. In: American Academy of Pediatrics [Internet]. 19 Oct 2021 [cited 31 Oct 2022]. Available: https://www.aap.org/en/advocacy/child-and-adolescent-healthy-mental-development/aap-aacap-cha-declaration-of-a-national-emergency-in-child-and-adolescent-mental-health/
  16. 16. Williams K, Thomson D, Seto I, Contopoulos-Ioannidis DG, Ioannidis JPA, Curtis S, et al. Standard 6: age groups for pediatric trials. Pediatrics. 2012;129 Suppl 3: S153–60. pmid:22661762
  17. 17. Barak-Corren Y, Castro VM, Javitt S, Hoffnagle AG, Dai Y, Perlis RH, et al. Predicting Suicidal Behavior From Longitudinal Electronic Health Records. Am J Psychiatry. 2017;174: 154–162. pmid:27609239
  18. 18. Hedegaard H, Schoenbaum M, Claassen C, Crosby A, Holland K, Proescholdbell S. Issues in Developing a Surveillance Case Definition for Nonfatal Suicide Attempt and Intentional Self-harm Using International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) Coded Data. Natl Health Stat Report. 2018; 1–19. pmid:29616901
  19. 19. Ridout KK, Alavi M, Ridout SJ, Koshy MT, Awsare S, Harris B, et al. Emergency Department Encounters Among Youth With Suicidal Thoughts or Behaviors During the COVID-19 Pandemic. JAMA Psychiatry. 2021;78: 1319–1328. pmid:34468724
  20. 20. Sacco DL, Probst MA, Schultebraucks K, Greene MC, Chang BP. Evaluation of emergency department visits for mental health complaints during the COVID-19 pandemic. J Am Coll Emerg Physicians Open. 2022;3: e12728. pmid:35505927
  21. 21. Tadros A, Sharon M, Crum M, Johnson R, Quedado K, Fang W. Coexistence of Substance Abuse among Emergency Department Patients Presenting with Suicidal Ideation. Biomed Res Int. 2020;2020: 7460701. pmid:33062697
  22. 22. Walsh CG, Johnson KB, Ripperger M, Sperry S, Harris J, Clark N, et al. Prospective Validation of an Electronic Health Record-Based, Real-Time Suicide Risk Model. JAMA Netw Open. 2021;4: e211428. pmid:33710291
  23. 23. Wilimitis D, Turer RW, Ripperger M, McCoy AB, Sperry SH, Fielstein EM, et al. Integration of Face-to-Face Screening With Real-time Machine Learning to Predict Risk of Suicide Among Adults. JAMA Netw Open. 2022;5: e2212095. pmid:35560048
  24. 24. Zhdanava M, Voelker J, Pilon D, Joshi K, Morrison L, Sheehan JJ, et al. Excess healthcare resource utilization and healthcare costs among privately and publicly insured patients with major depressive disorder and acute suicidal ideation or behavior in the United States. J Affect Disord. 2022;311: 303–310. pmid:35597466
  25. 25. Zima BT, Gay JC, Rodean J, Doupnik SK, Rockhill C, Davidson A, et al. Classification System for International Classification of Diseases, Ninth Revision, Clinical Modification and Tenth Revision Pediatric Mental Health Disorders. JAMA Pediatr. 2020;174: 620–622. pmid:32202603
  26. 26. Children’s Hospital Association. Child and adolescent mental health disorders classification system (CAMHD-CS) [coding system]. [cited 4 Aug 2023]. Available: https://www.childrenshospitals.org/content/analytics/toolkit/mental-health-disorder-codes
  27. 27. Horowitz LM, Bridge JA, Teach SJ, Ballard E, Klima J, Rosenstein DL, et al. Ask Suicide-Screening Questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. 2012;166: 1170–1176. pmid:23027429
  28. 28. Hodcroft EB. CoVariants: SARS-CoV-2 Mutations and Variants of Interest. 2021. Available: https://covariants.org/
  29. 29. Beaudry G, Drouin O, Gravel J, Smyrnova A, Bender A, Orri M, et al. A comparative analysis of pediatric mental health-related emergency department utilization in Montréal, Canada, before and during the COVID-19 pandemic. Ann Gen Psychiatry. 2022;21: 17.
  30. 30. The UCM Procedure. In: SAS/ETS Users’ Guide 15.3. Updated 2023. [Internet]. Available: https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/etsug/etsug_ucm_toc.htm
  31. 31. Pelagatti MM. Time series modeling with unobserved components. Boca Raton, CRC Press, Taylor & Francis.; 2016.
  32. 32. Selukar R. Detecting and Adjusting Structural Breaks in Time Series and Panel Data Using the SSM Procedure. SAS Institute Inc.; 2017.
  33. 33. Selukar R. Time Series Modeling with Unobserved Components. International Institute of Forecasters; 2016.
  34. 34. Hedegaard H, Johnson RL, Garnett MF, Thomas KE. The International Classification of Diseases, 10th Revision, Clinical Modification (ICD-10-CM) external cause-of-injury framework for categorizing mechanism and intent of injury. Natl Health Stat Report. 2019; 1–22. pmid:32510317
  35. 35. Erjavac BW, Rolin AI, Gondy K, Cranford JA, Shobassy A, Biermann BJ, et al. Impact of the COVID-19 Pandemic on Children and Adolescents Presenting With a Psychiatric Emergency. Clin Pediatr. 2022; 99228221120288. pmid:36039781
  36. 36. Leff RA, Setzer E, Cicero MX, Auerbach M. Changes in pediatric emergency department visits for mental health during the COVID-19 pandemic: A cross-sectional study. Clin Child Psychol Psychiatry. 2021;26: 33–38. pmid:33183097
  37. 37. Gutiérrez-Sacristán A, Serret-Larmande A, Hutch MR, Sáez C, Aronow BJ, Bhatnagar S, et al. Hospitalizations Associated With Mental Health Conditions Among Adolescents in the US and France During the COVID-19 Pandemic. JAMA Netw Open. 2022;5: e2246548. pmid:36512353
  38. 38. Golberstein E, Wen H, Miller BF. Coronavirus Disease 2019 (COVID-19) and Mental Health for Children and Adolescents. JAMA Pediatr. 2020;174: 819–820. pmid:32286618
  39. 39. Doupnik SK, Rudd B, Schmutte T, Worsley D, Bowden CF, McCarthy E, et al. Association of suicide prevention interventions with subsequent suicide attempts, linkage to follow-up care, and depression symptoms for acute care settings: a systematic review and meta-analysis. JAMA Psychiatry. 2020;77: 1021–1030. pmid:32584936
  40. 40. Esposito JM, Fein JA, Marshall J, Mitchell C, Aredas B, Zorc JJ. Improving Mental Health Communication From the Pediatric Emergency Department to Primary Care. Pediatr Emerg Care. 2020;36: 424–429. pmid:32870615
  41. 41. Brady RE, St Ivany A, Nagarajan MK, Acquilano SC, Craig JT, House SA, et al. Multistakeholder Perspectives on Interventions to Support Youth During Mental Health Boarding. J Pediatr. 2023;253: 286–291.e4. pmid:36220349
  42. 42. Somekh I, Somech R, Pettoello-Mantovani M, Somekh E. Changes in Routine Pediatric Practice in Light of Coronavirus 2019 (COVID-19). J Pediatr. 2020;224: 190–193. pmid:32497546