Skip to main content
  • Research article
  • Open access
  • Published:

CONECT-6: a case-finding tool to identify patients with complex health needs

A Correction to this article was published on 09 April 2021

This article has been updated

Abstract

Background

Early identification of patients with chronic conditions and complex health needs in emergency departments (ED) would enable the provision of services better suited to their needs, such as case management. A case-finding tool would ultimately support ED teams to this end and could reduce the cost of services due to avoidable ED visits and hospitalizations. The aim of this study was to develop and validate a short self-administered case-finding tool in EDs to identify patients with chronic conditions and complex health needs in an adult population.

Methods

This prospective development and initial validation study of a case-finding tool was conducted in four EDs in the province of Quebec (Canada). Adult patients with chronic conditions were approached at their third or more visit to the ED within 12 months to complete a self-administered questionnaire, which included socio-demographics, a comorbidity index, the reference standard INTERMED self-assessment, and 12 questions to develop the case-finding tool. Significant variables in bivariate analysis were included in a multivariate logistic regression analysis and a backward elimination procedure was applied. A receiver operating characteristic (ROC) curve was developed to identify the most appropriate threshold score to identify patients with complex health needs.

Results

Two hundred ninety patients participated in the study. The multivariate analysis yielded a six-question tool, COmplex NEeds Case-finding Tool – 6 (CONECT-6), which evaluates the following variables: low perceived health; limitations due to pain; unmet needs; high self-perceived complexity; low income; and poor social support. With a threshold of two or more positive answers, the sensitivity was 90% and specificity 66%. The positive and negative predictive values were 49 and 95% respectively.

Conclusions

The case-finding process is the essential characteristic of case management effectiveness. This study presents the first case-finding tool to identify adult patients with chronic conditions and complex health needs in ED.

Peer Review reports

Background

Frequent users of emergency departments (ED) represent a small proportion of patients (approximately 5%) who account for 30 to 50% of all ED visits [1,2,3]. Frequent use of ED is often defined as three or four visits or more in the last year [4,5,6,7,8,9,10,11]. Fragmented, episodic and poorly coordinated, the care that these patients receive through the ED is often suboptimal in relation to their needs [12,13,14]. In many cases, this significant use of ED could be avoided by providing adequate care upstream [4, 15]. Over 80% of frequent users of ED present chronic conditions for which adequate ambulatory care can prevent deterioration or complications requiring visits to the ED or hospitalizations [16], and a majority present several conditions simultaneously [17]. According to the Canadian Institute for Health Information [18], these conditions, called ambulatory care sensitive conditions (ACSC), include angina, asthma, chronic obstructive pulmonary disease, diabetes, grand mal status and other epileptic convulsions, heart failure and pulmonary edema, and hypertension. Even though adequate care can prevent complications, a large proportion of hospital activities are devoted to ED visits and hospitalizations linked to these conditions [19].

Importance

For some frequent ED users with ACSC, the simultaneous presence of psychological and/or social issues can create a complexity that ends up interfering with usual care [20,21,22,23]. The Agency for Healthcare Research and Quality Multiple Chronic Conditions Research Network conceptualizes complexity as the gap between an individual’s needs and the ability of health services to meet those needs [24]. The greater the complexity, i.e. the greater the gap between an individual’s needs and the ability of services increases, the greater the challenge in adjusting care to bridge this gap. These patients may attempt unsuccessfully to fulfill their unmet health needs by using care and services, such as the ED, generating considerable costs, and present poorer health indicators including high mortality rates [25]. Early identification of frequent ED users with complex health needs using a case-finding tool could enable intervening upstream and offering services better suited to their needs. Case management, for example, is increasingly recognized internationally as an appropriate intervention, in complex situations, to improve services and the healthcare system’s capacity to satisfy the particular needs of some patients [1, 26,27,28,29,30].

Goals of this investigation

While a few clinical tools are available in ED to identify certain at-risk patients, such as older adults at risk of losing their autonomy or exhibiting frailty (e.g. Program on Research for Integrating Services for the Maintenance of Autonomy - PRISMA 7, Identification of Seniors at Risk - ISAR) [31, 32] none enable the specific identification of patients with complex health needs. A recent scoping review to find a short (less than 15 min) and valid screening tool for identifying all adults with complex health needs at risk of high use of healthcare services concluded that most tools targeted older adults [33]. The only questionnaire available for an adult population was the INTERMED Self-Assessment – IMSA [34]. However, despite its validity and interest in terms of complexity measure, administration length and score calculation are too long for a case finding purpose in EDs [33]. The aim of this study was to develop and validate a case-finding tool to identify patients with complex health needs, in an adult population with chronic conditions. Our purpose was to develop a rapid (less than 2 min), self-administered 6–8-item (yes or no answers) case-finding tool.

Methods

Study design and settings

This was a multi-centre prospective development and initial validation study of a self-administered questionnaire. The study was approved by the Ethics Review Board of the Estrie Integrated University Health and Social Services Centre (CIUSSS de l’Estrie) - Sherbrooke University Hospital Centre.

Selection of participants

The study was conducted in four EDs affiliated with the Estrie Integrated University Health and Social Services Centre (IUHSSC) and the Saguenay-Lac-Saint-Jean IUHSSC, in two Quebec (Canada) regions. The four EDs are located in three urban areas [35], with a population of respectively 26,669, 145,949 and 161,323 inhabitants in 2016 [36]. Participants were identified at their third or more visit to the ED within 12 months. This cut-off was chosen to increase prevalence of complexity in the sample and avoid screening patients with low risk of complexity. They were approached to participate if they were adults (≥ 18 years), had three or more visits to the ED within 12 months and presented at least one ACSC (angina, asthma, chronic obstructive pulmonary disease, diabetes, grand mal status and other epileptic convulsions, heart failure and pulmonary edema, or hypertension). They were excluded if they had a critical situation requiring urgent care or if they had already participated in this study because of a previous ED visit during the data collection period.

Interventions

Four research assistants (registered nurses) were present in the EDs (one per ED) 35 h a week, at different moments of the day or evening, for consecutive sampling [37] between January and April 2019. They had access to the electronic registries of the ED to identify eligible participants, including their ACSCs diagnosis. They received 3 h of training on the study and completion of the questionnaire from the research team. For every person approached meeting the inclusion criteria (electronic medical record), research assistants had to complete a recruitment sheet to collect information about how many people completed the questionnaire, how many had to leave or how many refused to participate and for which reason.

After explaining the study and obtaining informed consent, the patient was invited by the research assistant to complete the self-administered questionnaire, in French or in English. The participant did this in a quiet room while they were waiting or at a more appropriate moment later on to avoid interfering with ED care. For participants with low literacy, the research assistant could assist them with the questionnaire.

Measurements

The questionnaire included socio-demographics (age, sex, native language, occupation, marital status, income), the Disease Burden Morbidity Assessment (DBMA) [38, 39] (comorbidity score), the reference standard IMSA [34, 35], and 12 preliminary questions to develop the case-finding tool, which are available in Additional file 1. Data collection took approximately 40 min per patient (time to explain the study, obtain consent, complete the questionnaire).

Questions included in the development of the case-finding tool

We selected 12 questions, already validated, that are associated with complex health needs, based on previous work [40,41,42,43]. These questions concerned perceived healthcare status (Statistics Canada) [44], insurance healthcare plan [45], social support (Statistics Canada) [46], limitations due to chronic pain (Statistics Canada) [47], psychological distress (K6) [48], alcohol consumption (Statistics Canada) [46], drug use (Statistics Canada) [46], income (Statistics Canada) [49], perception of financial status (Statistics Canada) [50], met or unmet health needs (new question), feeling of having complicated problems (new question), self-efficacy for managing health (new question). Most questions were initially rated on a 4–5 categorical scale (except for alcohol consumption and drug use).

Reference standard: INTERMED self-assessment

IMSA is a self-administered version of the INTERMED questionnaire that helps to measure the complexity of health needs in an adult patient by evaluating the medical, psychological and social spheres. The first version of INTERMED was developed in the 1990s by an international team that combined their research expertise on complexity in order to empirically develop a measuring instrument [51]. Its psychometric qualities [52,53,54] are well documented. INTERMED presents good validity to predict greater use of services [55,56,57].

IMSA, which was used in this study, has been available since 2016 [34]. It includes 20 questions subdivided into four domains: Biological, Psychological, Social, and Health system. Every domain is divided into three-time segments: History, Current State, and Vulnerability/Prognosis. Three of the questions have one or more sub-questions. All IMSA items are scored on a four-level rating scale. The rating scores range from 0 to 3, representing no evidence of a symptom, disturbance or healthcare need (0) to evidence of complex symptoms or healthcare needs (3). The maximum total score of the IMSA is 60. A score of 19 or higher indicates complex health needs. A French-language version is available as well as a guide explaining how to complete the questionnaire [58]. The correlations between the total score and the subscales of the IMSA, as compared to the initial INTERMED questionnaire, were high (total score: r = 0.79) (95%-CI: [0.70; 0.85]). Cronbach’s α was 0.77, and construct validity was high (SF-36 mental component score: r = − 0.57; HADS Depression: r = 0.59) [34].

Analysis

We described continuous variables (age, comorbidity score, IMSA score) using mean +/− standard deviation (SD) and categorical variables (sex, primary language, occupation, marital status, income, and all questions to develop the case-finding tool) using proportions. We tested the 12 selected questions to develop the case-finding tool in bivariate logistic regressions with complexity as measured by the measurement standard (IMSA), as the dependent variable. Significant variables were dichotomized using 2 × 2 tables, based on statistics and team consensus.

These dichotomized variables were then included in a multivariate logistic regression analysis, adjusted for age and sex, and a backward elimination procedure was applied to eliminate those that ceased to be significant in the presence of others. We computed variance inflated factors to check for multicollinearity among the independent variables [59]. We estimated sensitivity and specificity of the different scoring thresholds (number of yes responses) of the case-finding tool when compared to the complex/non-complex classification established by the measurement standard (IMSA). A ROC curve was developed and the area under the curve (AUC) was calculated. We identified the most appropriate threshold score to identify patients with complex health needs [60]. The selected threshold score was the one offering the best compromise between sensitivity and specificity.

To estimate a sensitivity of at least 70% with a 95% confidence level and an accuracy of 10%, 81 complex cases were required (nQuery Advisor® 7.0). Based on previous experience, estimating that the prevalence of patients with complex needs would represent 30% of patients identified, 270 participants had to be recruited. The 189 patients with non-complex needs would provide an accuracy of 6.5% to estimate a specificity of at least 70% [61].

Results

Characteristics of the study subjects

Five hundred twenty-two patients were approached to participate in the study, 79 were not eligible, 113 refused to participate, and 40 had incomplete questionnaires. Two hundred ninety patients participated in the study (see Fig. 1 for flow of participants). Table 1 shows their characteristics. Mean age of participants was 67 (SD = 20.0). Sixty-one percent were female. The primary language of 94.5% of participants was French. Twenty-one percent of the sample were employed. Almost half of the participants were married or living with a partner (45.2%). The average score of the DBMA was 11.8 (SD = 7.2), which corresponded to a high burden [62]. Twenty-six percent of participants (n = 75) had complex needs based on the IMSA.

Fig. 1
figure 1

Flow chart of participants

Table 1 Patients characteristics

Main results

From the initial 12 questions, three were excluded in the bivariate regression, and three others in the multivariate model (see Table 2), yielding a six-question tool, COmplex NEeds Case-finding Tool – 6 (CONECT-6) (see Table 3). All variance inflated factors were lower than 2, showing no sign of multicollinearity. Figure 2 illustrates the ROC curve, with an AUC of 0.84. Using a threshold of two or more positive answers in the six-question tool resulted in a sensitivity and specificity of 90 and 66% respectively. The positive and negative predictive values were 49 and 95% respectively.

Table 2 Bivariate and multivariate logistic regressions with complexity as the dependent variable
Table 3 The CONECT-6 case-finding tool to identify patients with complex health needs
Fig. 2
figure 2

ROC curve with 95% confidence interval

Discussion

Case management effectiveness relies on the case-finding process, that is to say the ability of identifying the patients most in need of the intervention [63]. To date, the primary criterion to be recruited in case management programs has mainly relied on a threshold of ED visits. This way of doing presents the advantage of easy measurement, most health centre information systems making this information easily available. However, evidence recommends not only basing the case-finding process on frequent service use, but also on patients’ complex health needs [63]. Indeed, only approximately 35% of frequent users of ED will remain high users in the subsequent year [64, 65]. Moreover, identifying them before their fifth, sixth or more visits to the ED would enable timelier intervention [27].

This study presents the first case-finding tool to identify adult patients with ACSC and complex health needs in EDs. The self-administered format enables the measurement of variables that are not available in electronic medical records or databases, by capturing the patient’s perception (perceived health, social support, met needs, etc.). By using a threshold of 3 ED visits, which is lower than in most reported case management studies [4,5,6,7,8,9,10,11], our case-finding tool helps to identify patients with complex needs upstream and to intervene before they are caught in a vicious cycle of ED frequent use. The sensitivity of these six “yes or no” questions is high (90%), enabling the identification of most frequent users with complex health needs. With a positive predictive value of 49%, approximately one out of two identified patients will obtain a score of complexity on the IMSA. Therefore, a confirmation of complexity is suggested before enrolling them in case management programs. The combination of the case-finding tool and the clinical judgment of healthcare professionals could be a good approach to identify patients for whom case management will likely be most beneficial [63, 66]. Sensitivity, specificity, and positive and negative predictive values are comparable to values obtained for PRISMA-7, a case-finding tool often used to identify older adults with moderate or severe disabilities [31].

Implications for practice and research

Clinicians and researchers should focus on case-finding processes when implementing or conducting case management [63]. When frequent users of ED with 3 or more visits to the ED are identified as having complex health needs with CONECT-6 (2 yes or more among the 6 questions), they could be referred to a case manager or their primary care team to evaluate the potential benefits of case management if available or other intervention to improve coordination and self-management support [63, 66]. Knowing which questions were answered “yes” could also inform the primary care team on which aspects seem more complex and orient further services. The IMSA could also be used to provide a more accurate picture of complexity in the medical, psychological and social spheres.

Limitations

Basing this work on the solid expertise of a team conducting research on frequent users, complex needs and case management for many years, we were able to select questions with high potential to build the tool and obtain a 6-question self-administered tool with very good psychometric properties. Four research assistants were involved in data collection and received 3 hours of training for standardization.

This study also has a few limitations. The questions were dichotomized after data collection, and validation was conducted on the same sample than development of the tool. Further validation could be done with this new version of the tool in a different population. We should keep in mind that the tool was validated among patients with ACSC in ED settings. The project was carried out in the winter season, which could have influenced reasons for consultation. But we do not think the seasonal effect had a major impact on results. The study was also carried out in only 2 regions of Quebec. However, the EDs represent a variety of urban sizes, which will help achieve good external validity.

Conclusions

The case-finding process is the essential characteristic of case management effectiveness. This study presents the first case-finding tool to identify adult patients with ACSC and complex health needs in ED. Other research projects could provide further evidence of the validity of the CONECT-6 tool in contexts other than the ED, and among patients with problems other than ACSC (e.g. mental health problems or other chronic diseases).

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available due to the ethics approval but are available from the corresponding author on reasonable request.

Change history

Abbreviations

ACSC:

Ambulatory care sensitive condition

AUC:

Area under the curve

COPD:

Chronic obstructive pulmonary disease

DBMA:

Disease Burden Morbidity Assessment

ED:

Emergency department

FUED:

Frequent user of emergency department

HBP:

High blood pressure

IMSA:

INTERMED Self-Assessment

ROC:

Receiver operating characteristic

References

  1. Althaus F, Paroz S, Hugli O, Ghali WA, Daeppen JB, Peytremann-Bridevaux I, et al. Effectiveness of interventions targeting frequent users of emergency departments: a systematic review. Ann Emerg Med. 2011;58:41–52 e42.

    Article  PubMed  Google Scholar 

  2. Blank FS, Li H, Henneman PL, Smithline HA, Santoro JS, Provost D, et al. A descriptive study of heavy emergency department users at an academic emergency department reveals heavy ED users have better access to care than average users. J Emerg Nurs. 2005;31:139–44.

    Article  PubMed  Google Scholar 

  3. Doupe MB, Palatnick W, Day S, Chateau D, Soodeen RA, Burchill C, et al. Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med. 2012;60:24–32.

    Article  PubMed  Google Scholar 

  4. Hunt KA, Weber EJ, Showstack JA, Colby DC, Callaham ML. Characteristics of frequent users of emergency departments. Ann Emerg Med. 2006;48:1–8.

    Article  PubMed  Google Scholar 

  5. Hansagi H, Olsson M, Sjoberg S, Tomson Y, Goransson S. Frequent use of the hospital emergency department is indicative of high use of other health care services. Ann Emerg Med. 2001;37:561–7.

    Article  CAS  PubMed  Google Scholar 

  6. Freeman JL, Fetter RB, Park H, Schneider KC, Lichtenstein JL, Hughes JS, et al. Diagnosis-related group refinement with diagnosis- and procedure-specific comorbidities and complications. Med Care. 1995;33:806–27.

    Article  CAS  PubMed  Google Scholar 

  7. Bieler G, Paroz S, Faouzi M, Trueb L, Vaucher P, Althaus F, et al. Social and medical vulnerability factors of emergency department frequent users in a universal health insurance system. Acad Emerg Med. 2012;19:63–8.

    Article  PubMed  Google Scholar 

  8. Andrén KG, Rosenqvist U. Heavy users of an emergency department—a two year follow-up study. Soc Sci Med. 1987;25:825–31.

    Article  Google Scholar 

  9. Friedman BW, Serrano D, Reed M, Diamond M, Lipton RB. Use of the emergency department for severe headache. A population-based study. Headache. 2009;49:21–30.

    Article  PubMed  Google Scholar 

  10. Huang JA, Tsai WC, Chen YC, Hu WH, Yang DY. Factors associated with frequent use of emergency services in a medical center. J Formos Med Assoc. 2003;102:222–8.

    PubMed  Google Scholar 

  11. Sun BC, Burstin HR, Brennan TA. Predictors and outcomes of frequent emergency department users. Acad Emerg Med. 2003;10:320–8.

    Article  PubMed  Google Scholar 

  12. Skinner J, Carter L, Haxton C. Case management of patients who frequently present to a Scottish emergency department. Emerg Med J. 2009;26:103–5.

    Article  CAS  PubMed  Google Scholar 

  13. Dale J, Green J, Reid F, Glucksman E. Primary care in the accident and emergency department: I. Prospective identification of patients. BMJ. 1995;311:423–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Shumway M, Boccellari A, O'Brien K, Okin RL. Cost-effectiveness of clinical case management for ED frequent users: results of a randomized trial. Am J Emerg Med. 2008;26:155–64.

    Article  PubMed  Google Scholar 

  15. Ruger JP, Richter CJ, Spitznagel EL, Lewis LM. Analysis of costs, length of stay, and utilization of emergency department services by frequent users: implications for health policy. Acad Emerg Med. 2004;11:1311–7.

    Article  PubMed  Google Scholar 

  16. Caminal J, Starfield B, Sanchez E, Casanova C, Morales M. The role of primary care in preventing ambulatory care sensitive conditions. Eur J Pub Health. 2004;14:246–51.

    Article  Google Scholar 

  17. Billings J, Raven MC. Dispelling an urban legend: frequent emergency department users have substantial burden of disease. Health Aff. 2013;32:2099–108.

    Article  Google Scholar 

  18. Canadian Institute for Health Information. Health indicators Ottawa 2008 [Available from: https://secure.cihi.ca/free_products/HealthIndicators2008_ENGweb.pdf].

    Google Scholar 

  19. Naylor C, Imison C, Addicott R, Buck D, Goodwin N, Harrison T, et al. Transforming our health care system. London: The King’s Fund; 2015.

    Google Scholar 

  20. Fuda KK, Immekus R. Frequent users of Massachusetts emergency departments: a statewide analysis. Ann Emerg Med. 2006;48:9–16.

    Article  PubMed  Google Scholar 

  21. Matzer F, Wisiak UV, Graninger M, Sollner W, Stilling HP, Glawischnig-Goschnik M, et al. Biopsychosocial health care needs at the emergency room: challenge of complexity. PLoS One. 2012;7:e41775.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. de Jonge P, Huyse FJ, Stiefel FC. Case and care complexity in the medically ill. Med Clin North Am. 2006;90:679–92.

    Article  PubMed  Google Scholar 

  23. Hudon C, Chouinard MC, Bayliss E, Nothelle S, Senn N, Shadmi E. Challenges and next steps for primary care research. Towards better health, social, and community-based services integration for patients with chronic conditions and complex care needs. Ann Fam Med. 2018;16:85–6.

    Article  PubMed Central  Google Scholar 

  24. Grembowski D, Schaefer J, Johnson KE, Fischer H, Moore SL, Tai-Seale M, et al. A conceptual model of the role of complexity in the care of patients with multiple chronic conditions. Med Care. 2014;52(Suppl 3):S7–s14.

    Article  PubMed  Google Scholar 

  25. Schoen C, Osborn R, Squires D, Doty M, Pierson R, Applebaum S. New 2011 survey of patients with complex care needs in eleven countries finds that care is often poorly coordinated. Health Aff. 2011;30:2437–48.

    Article  Google Scholar 

  26. Haroun D, Smits F, van Etten-Jamaludin F, Schene A, van Weert H, Ter Riet G. The effects of interventions on quality of life, morbidity and consultation frequency in frequent attenders in primary care: a systematic review. Eur J Gen Pract. 2016;22:71–82.

    Article  PubMed  Google Scholar 

  27. Moe J, Kirkland SW, Rawe E, Ospina MB, Vandermeer B, Campbell S, et al. Effectiveness of interventions to decrease emergency department visits by adult frequent users: a systematic review. Acad Emerg Med. 2017;24:40–52.

    Article  PubMed  Google Scholar 

  28. Soril LJ, Leggett LE, Lorenzetti DL, Noseworthy TW, Clement FM. Reducing frequent visits to the emergency department: a systematic review of interventions. PLoS One. 2015;10:e0123660.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Raven MC, Kushel M, Ko MJ, Penko J, Bindman AB. The effectiveness of emergency department visit reduction programs: a systematic review. Ann Emerg Med. 2016;68:467–83 e15.

    Article  PubMed  Google Scholar 

  30. Van den Heede K, Van de Voorde C. Interventions to reduce emergency department utilisation: a review of reviews. Health Policy. 2016;120:1337–49.

    Article  PubMed  Google Scholar 

  31. Raiche M, Hebert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr. 2008;47:9–18.

    Article  PubMed  Google Scholar 

  32. Hoogendijk EO, van der Horst HE, Deeg DJ, Frijters DH, Prins BA, Jansen AP, et al. The identification of frail older adults in primary care: comparing the accuracy of five simple instruments. Age Ageing. 2013;42:262–5.

    Article  PubMed  Google Scholar 

  33. Marcoux V, Chouinard MC, Diadiou F, Dufour I, Hudon C. Screening tools to identify patients with complex health needs at risk of high use of health care services: a scoping review. PLoS One. 2017;12:e0188663.

    Article  PubMed  PubMed Central  Google Scholar 

  34. van Reedt Dortland AKB, Peters LL, Boenink AD, Smit JH, Slaets JPJ, Hoogendoorn AW, et al. Assessment of biopsychosocial complexity and health care needs: measurement properties of the INTERMED self-assessment version. Psychosom Med. 2017;79:485–92.

    Article  PubMed  Google Scholar 

  35. Institut national de santé publique du Quebec. Milieux ruraux et urbains: Quelles différences de santé au Québec? Quebec: Gouvernement du Quebec; 2019. [Available from: https://www.inspq.qc.ca/santescope/milieux-ruraux-urbains?fbclid=IwAR2l-xVGxS8YubDN7dofcMeEvIM4H-xA9M46Dq3fDNq1oUj17mTc67NvuBw. Accessed 4 Jun 2020

    Google Scholar 

  36. Statistics Canada. Focus on geography series, 2016 census. Ottawa: Governement of Canada; 2016. [Available from: https://www12statcangcca/census-recensement/2016/as-sa/fogs-spg/Index-engcfm] Accessed 4 Jun 2020

    Google Scholar 

  37. Polit DF, Beck CT. Essentials of nursing research: appraising evidence for nursing practice. 7th ed. Philadelphia: Lippincott Williams & Wilkins; 2011.

    Google Scholar 

  38. Bayliss EA, Ellis JL, Steiner JF. Subjective assessments of comorbidity correlate with quality of life health outcomes: initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes. 2005;3:51.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Poitras ME, Fortin M, Hudon C, Haggerty J, Almirall J. Validation of the disease burden morbidity assessment by self-report in a French-speaking population. BMC Health Serv Res. 2012;12:35.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Krieg C, Hudon C, Chouinard MC, Dufour I. Individual predictors of frequent emergency department use: a scoping review. BMC Health Serv Res. 2016;16:594.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Hudon C, Courteau J, Krieg C, Vanasse A. Factors associated with chronic frequent emergency department utilization in a population with diabetes living in metropolitan areas: a population-based retrospective cohort study. BMC Health Serv Res. 2017;17:525.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Margo-Dermer E, Depelteau A, Girard A, Hudon C. Psychological distress in frequent users of primary health care and emergency departments: a scoping review. Public Health. 2019;172:1–7.

    Article  CAS  PubMed  Google Scholar 

  43. Depelteau A, Racine-Hemmings F, Lagueux E, Hudon C. Chronic pain and frequent use of emergency department: a systematic review. Am J Emerg Med. 2019;38(2):358–63.

    Article  PubMed  Google Scholar 

  44. Statistics Canada, Government of Canada. Perceived health. https://www150.statcan.gc.ca/n1/pub/82-229-x/2009001/status/phx-eng.htm. Accessed 5 Jun 2020.

  45. Régie de l’assurance maladie du Québec (RAMQ), Government of Québec. Données et statistiques. http://www.ramq.gouv.qc.ca/fr/donnees-et-statistiques/donnees-sur-demande/Pages/modalites-et-domaines-de-valeurs.aspx. Accessed 4 Jun 2020.

  46. Statistics Canada, Government of Canada. Canadian community health survey - annual component (CCHS). http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=3226. Accessed 4 Jun 2020.

  47. Statistics Canada, Government of Canada. Pain or discomfort that prevents activities. https://www150.statcan.gc.ca/n1/pub/82-229-x/2009001/status/pdl-eng.htm. Accessed 5 Jun 2020.

  48. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60:184–9.

    Article  PubMed  Google Scholar 

  49. Statistics Canada, Governement of Canada. Total income of private household.https://www23.statcan.gc.ca/imdb/p3Var.pl?Function=DEC&Id=252173. Accessed5 Jun 2020.

  50. Institut de la statistique du Québec. Direction de la santé du Québec. Études auprès des communautés culturelles 1998-1999. Livre des codes [Cultural Community Studies 1998-1999. Code book]. https://statistique.quebec.ca/fr/enquetes/realisees/etude-aupres-des-communautes-culturelles-1998-1999. Accessed 5 Jun 2020.

  51. Stiefel FC, de Jonge P, Huyse FJ, Guex P, Slaets JP, Lyons JS, et al. “INTERMED”: a method to assess health service needs. II. Results on its validity and clinical use. Gen Hosp Psychiatry. 1999;21(1):49–56.

    Article  CAS  PubMed  Google Scholar 

  52. de Jonge P, Hoogervorst EL, Huyse FJ, Polman CH. INTERMED: a measure of biopsychosocial case complexity: one year stability in multiple sclerosis patients. Gen Hosp Psychiatry. 2004;26(2):147–52.

    Article  PubMed  Google Scholar 

  53. de Jonge P, Stiefel F. Internal consistency of the INTERMED in patients with somatic diseases. J Psychosom Res. 2003;54(5):497–9.

    Article  PubMed  Google Scholar 

  54. de Jonge P, Latour C, Huyse FJ. Interrater reliability of the INTERMED in a heterogeneous somatic population. J Psychosom Res. 2002;52(1):25–7.

    Article  PubMed  Google Scholar 

  55. Fischer CJ, Stiefel FC, De Jonge P, Guex P, Troendle A, Bulliard C, et al. Case complexity and clinical outcome in diabetes mellitus. A prospective study using the INTERMED. Diabetes Metab. 2000;26:295–302.

    CAS  PubMed  Google Scholar 

  56. Koch N, Stiefel F, de Jonge P, Fransen J, Chamot AM, Gerster JC, et al. Identification of case complexity and increased health care utilization in patients with rheumatoid arthritis. Arthritis Rheum. 2001;45:216–21.

    Article  CAS  PubMed  Google Scholar 

  57. de Jonge P, Bauer I, Huyse FJ, Latour CH. Medical inpatients at risk of extended hospital stay and poor discharge health status: detection with COMPRI and INTERMED. Psychosom Med. 2003;65:534–41.

    Article  PubMed  Google Scholar 

  58. Caarls P, Latour C, Boenink A. Manual for interpreting the INTERMED Self-Assessment (IM-SA). In: Consortium I, ed. 2017.

  59. Harrell FE Jr. Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis. Berlin: Springer; 2015.

    Book  Google Scholar 

  60. Florkowski CM. Sensitivity, specificity, receiver-operating characteristic (ROC) curves and likelihood ratios: communicating the performance of diagnostic tests. Clin Biochem Rev. 2008;29(Suppl 1):S83–87.59.

  61. Dixon W, Massey F. Introduction to statistical analysis. 4th ed. New York: McGraw-Hill; 1983.

    Google Scholar 

  62. D'Hoore W, Bouckaert A, Tilquin C. Practical considerations on the use of the Charlson comorbidity index with administrative data bases. J Clin Epidemiol. 1996;49(12):1429–33.

    Article  CAS  PubMed  Google Scholar 

  63. Hudon C, Chouinard MC, Pluye P, El Sherif R, Bush PL, Rihoux B, et al. Characteristics of case management in primary care associated with positive outcomes for frequent users of health care: a systematic review. Ann Fam Med. 2019;17:448–58.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Mandelberg JH, Kuhn RE, Kohn MA. Epidemiologic analysis of an urban, public emergency department's frequent users. Acad Emerg Med. 2000;7:637–46.

    Article  CAS  PubMed  Google Scholar 

  65. Chiu Y, Vanasse A, Courteau J, Chouinard MC, Dubois MF, Dubuc N, et al. Persistent frequent emergency department users with chronic ambulatory care sensitive conditions: a population based cohort study. PLoS One. 2020;15:e0229022.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  66. Hong CS, Siegel AL, Ferris TG. Caring for high-need, high-cost patients: what makes for a successful care management program? Issue Brief (Commonw Fund). 2014;19:1–19.

    Google Scholar 

Download references

Acknowledgments

We wish to thank the FRQS and the Quebec SPOR Support Unit for their financial support, the decision makers and managers of the two hospitals, Manon Savard, Claudie Gagnon, Véronique Morency, Linda Renouf, Martin Therrien, Isabelle Therrien and Hélène Loiselle for their collaboration, the Sherbrooke University Hospital Research Centre Clinical and Epidemiological Research Unit for its help in managing the data collection, and research nurses Annie-Pier Gobeil-Lavoie, Émilie Hudon, Myriam Flipot and Louise Robert Petit for the data collection, as well as Bonita Van Doorn for the editorial review.

Funding

This work was supported by Fonds de recherche du Québec – Santé (FRQS) (grant number 318327) and the Quebec SPOR Support Unit. The funding bodies had no role in the design of the study and collection, analysis, and interpretation of data, neither in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

CH, MFD, MCC, ND, NE and AV conceived the study, designed the trial, and obtained research funding. CH supervised the conduct of the trial and MB supervised the data collection. CH and MB undertook recruitment of participating centers and patients and managed the data, including quality control. CH, MFD, YC, MCC, ND, NE, and AV provided statistical advice on study design. CH, MB, MFD, YC and VS analyzed the data. MB was responsible of the data oversight. CH and MB drafted the manuscript, and all authors contributed substantially to its revision. CH takes responsibility for the paper as a whole. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Catherine Hudon.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ethics Review Board of the Estrie Integrated University Health and Social Services Centre (CIUSSS de l’Estrie) - Sherbrooke University Hospital Centre. All participants provided a written informed consent to participate in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: “A percentage in the Results under the Abstract section and Figure 2 have been changed. The author affiliation 2 is a duplicate and has been removed.”

Supplementary Information

Additional file 1.

The 12 preliminary questions to develop the case-finding tool.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hudon, C., Bisson, M., Dubois, MF. et al. CONECT-6: a case-finding tool to identify patients with complex health needs. BMC Health Serv Res 21, 157 (2021). https://doi.org/10.1186/s12913-021-06154-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-021-06154-4

Keywords