Skip to main content

Validity of a novel screen for cognitive impairment and neuropsychiatric symptoms in cardiac rehabilitation

Abstract

Background

Currently, there is no composite screening tool that can efficiently and effectively assess prevalent yet under-recognized cognitive and neuropsychiatric comorbidities in patients with cardiovascular disease. We aimed to determine the validity and feasibility of a novel screen assessing cognitive impairment, anxiety, apathy and depression (CAAD screen) in those attending cardiac rehabilitation (CR).

Methods

All patients diagnosed with cardiovascular disease or cardiovascular risk factors entering CR were screened as part of clinical care. A subset of those patients agreed to complete validation assessments (n = 127). Screen results were compared to widely accepted standards for cognition, anxiety, apathy, and depression using a modified receiver operating characteristic (ROC) and area under the curve analysis.

Results

The screen was completed by 97% of participants in 10 min or less with an average completion time of approximately 5 min. Screening scores adjusted for age, sex and years of education had acceptable or excellent validity compared to widely accepted standard diagnoses: CAAD-Cog (AUC = 0.80); CAAD-Anx (AUC = 0.81); CAAD-Apathy (AUC = 0.79) and CAAD-Dep (AUC = 0.85).

Conclusions

The CAAD screen may be a valid and feasible tool for detecting cognitive impairment, anxiety, apathy and depression in CR settings.

Peer Review reports

Background

Cardiovascular diseases (CVD) account for an estimated 30% of deaths worldwide, with 80% of those due to myocardial infarction and stroke [1, 2]. Management of modifiable cardiovascular risk factors (CVRFs) such as smoking, hypertension, hyperlipidemia and type II diabetes [3, 4] and physical activity are considered an essential component in preventing a subsequent CVD event [5]. As such, referral to an exercise-based cardiac rehabilitation (CR) program is strongly recommended following a CVD event [6, 7] to reduce mortality, hospitalization and improve quality of life [5, 8, 9].

Neuropsychiatric symptoms are under-recognized but particularly important risk factors of CVD. Specifically, the presence of cognitive impairment, anxiety, apathy and depression are associated with poorer quality of life and increased mortality rates [10,11,12]. In addition, the presence of neuropsychiatric comorbidities may be a significant barrier to the known benefits of CR [13]. Cognitive impairment can affect up to 35% of patients with CVD [14]; executive function has been shown to be the most commonly impaired domain in this population [15]. Depression is seen in up to 40% of individuals with CVD [16, 17] while the prevalence of both anxiety and apathy in CVD is approximately 25% [15, 18]. Furthermore, in approximately 50% of CVD patients, anxiety is comorbid with depression, resulting in poorer outcomes such as increased rehospitalisation and mortality rates, compared to those with CVD alone [16, 19,20,21,22].

Best practice guidelines for cardiac care recommend routine screening for cognitive impairment, depression, anxiety and lack of motivation in those undergoing CR [23, 24]. However, previous studies have shown that neuropsychiatric symptoms are frequently missed and not treated [13]. A robust comprehensive screen can improve the identification of at-risk patients and improve utilization of available psychosocial interventions such as counseling, group therapy and stress reduction classes and/or pharmacotherapy if indicated [13]. Current guidelines recommend tools such as the Center for Epidemiological Studies Depression Scale (CES-D) to screen for depressive symptoms, but offer no recommendations for cognition, anxiety and apathy [23]. While multiple tools are available, the combined time to implement individual screens for each comorbidity is prohibitive for routine use. For example, the full Montreal Cognitive Assessment (MoCA) takes approximately 10 min to administer. Given that many CR centres intake thousands of new patients each year, a comprehensive single tool that assesses common neuropsychiatric comorbidities in CVD would be less time and resource consuming in a busy clinical setting such as CR, and would be more favourable for patient acceptability to undergo testing. In support of this, previous studies have shown that a composite screen was useful in identifying neuropsychiatric comorbidities and was predictive of long-term patient outcomes including impaired functioning and poorer community integration in patients post-stroke as well as post-operative delirium and mortality in patients post-transcatheter aortic valve implantation [25,26,27]. Our goal was to develop a screening tool that would distinguish between CVD patients requiring referral (screen positive), those not requiring referral (screen negative) and those who need monitoring (intermediate), which could be administered in 10 min or less with minimal training.

Methods

This study was approved by the institutional research ethics boards at Sunnybrook Health Sciences Centre and the Toronto Rehabilitation Institute (TRI) at University Health Network. Since screening for cognitive and psychiatric comorbidities is recommended by national best practice guidelines [23], a waiver of consent to be screened was approved for patients entering CR to track screening rates and times. Consenting volunteers subsequently underwent a battery of assessments within two weeks of screening.

The CAAD Screen (Cognitive impairment, Anxiety, Apathy, Depression) (Table 1) was created using existing validated screens. We selected the 5-point delayed recall from the MoCA as a brief measure of verbal memory and the Trails B test of the MoCA to assess executive function; both domains are commonly impaired in those with CVD [28,29,30]. The MoCA has been recommended for the assessment of vascular cognitive impairment [31, 32] and abbreviated versions of the MoCA have been shown to have comparable classification accuracy to the standard version [33, 34]. Three items adapted from the six informant items of the General Practitioner Assessment of Cognition (GPCOG) were included to capture subjective memory complaints, a necessary symptom for the diagnosis of mild cognitive impairment [35].

Table 1 CAAD Screen components

Depression was assessed using the Patient Health Questionnaire-2 (PHQ-2) which consists of 2 questions, scored from 0 to 3 (0–6 total). The PHQ-2 is available within the public domain and is recommended by the Canadian best practice guidelines for the assessment of depressive symptoms. The PHQ-2 has been previously validated as a screening tool for depression in those with coronary heart disease, primary care populations and stroke [36,37,38,39] with a sensitivity of 100% and a specificity of 77% among adults aged ≥65 years [38]. Similarly, anxiety was assessed using the 2-item Generalized Anxiety Disorder Scale (GAD-2), which also consists of 2 questions. The GAD-2 reflects the core diagnostic criteria of GAD according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) [40] and has been validated in several patient populations, including those with CVD [41]. Previous studies have demonstrated that with a cut point of two or greater, the GAD-2 has a sensitivity of 67% and specificity of 90% [40].

The 6-item apathy screen, with a maximum possible score of 14, was an abbreviated adaptation of the apathy diagnostic criteria developed by Robert et al. [42]. A two-stage sequential method was used for the apathy questionnaire; participants scoring 0 on items 1–4 were assumed to be non-apathetic and subsequent yes or no items were deemed not applicable. Items 1–4 were scored on a Likert scale ranging from 0 to 3. Items 5 was scored as 1 if it was rated ‘yes’ and item 6 was scored as 1 if it was rated ‘no’. The total score was the sum of all questions. While this abbreviated version has not been used in a CVD population, apathy has been shown to be a strong, independent risk factor for CVD [12, 15, 43] and the use of apathy screening tools is well documented in various populations [12, 44].

Between June 2016 – August 2017, the CAAD screen was administered in a quiet room to all new referrals to the CR program at TRI who were able to speak and understand English and were diagnosed with CVD or CVRFs. Trained research personnel administered the screen using a script to ensure consistency. The 5-word recall and Trails B portions of the screen were administered as interview-based assessments, while the GPCOG, PHQ-2, GAD-2 and 6-item apathy questionnaire were self-administered. Research personnel remained in the room during the screening process to answer questions or clarify any confusion.

While the screen was part of clinical care, a subgroup of screened patients provided written informed consent to participate in validation testing by completing a neuropsychological battery. Cognition was assessed using the 30 min battery recommended by the National Institute of Neurological Disorders Stroke and the Canadian Stroke Network (NINDS-CSN) for the study of vascular cognitive impairment [45]. Tests included the California Verbal Learning Test 2nd Edition (CVLT-II), The Trail Making Test Part B, the Controlled Oral Word Association Test (COWAT) of phonemic fluency and the Stroop test. For all cognitive tasks, a Z-score was determined from published age, sex and education matched norms. Z-scores of tests assessing performance in the same cognitive domain can be summed into composite Z-scores as has been previously reported [46]. The Z-scores of the immediate recall, short delay free recall and long delay free recall of the CVLT-II were combined to create a composite memory score. The Trail Making Test Part B, Stroop, and COWAT Z-scores were combined to create a composite executive function score. Impairment in either cognitive domain was defined by a Z-score ≤ 1.5 standard deviation below the mean [47].

The Structured Clinical Interview for DSM-5 (SCID) disorders was used as it is a widely accepted standard to assess depression and anxiety. Those classified as major depressive disorder (MDD) by the SCID depression module (mood assessed over the last month) were considered to have depression. Similarly, those classified as generalized anxiety disorder (GAD) according to the SCID anxiety module (mood assessed over the last 6 months) were considered to have anxiety. The Apathy Evaluation Scale self-report version (AES-S) was used as the widely accepted standard for the assessment of apathy. The AES is rated on a 4-point Likert scale from 1 (not at all characteristic) to 4 (very characteristic), with higher scores indicating higher levels of apathy [48]. Participants who scored ≥37 were classified as apathetic [49].

The primary outcome was the sensitivity and specificity of the cognitive impairment, depression, anxiety and apathy components of the screen calculated using optimized cut-offs. In order to have 5 participants per item and avoid random error [50], a minimum sample size of 100 participants was targeted for the CAAD screen validation. The secondary outcome was feasibility, defined as 85% of participants completing the screen in 10 min or less [25, 51].

Statistical analyses were performed with IBM SPSS Statistics Version 24.0. Demographics for continuous variables were reported as mean ± standard deviation or number of participants and percentage for categorical variables. Agreement between the CAAD screen components and widely accepted standard assessments were evaluated using receiver operating characteristic (ROC) curves and the area under the curve (AUC) were used to determine optimized cut-offs. An AUC value of 0.8–0.9 was considered excellent and 0.7–0.8 was considered acceptable [52, 53]. While sensitivity and specificity have commonly been evaluated with one cut-off, this approach may favour optimal sensitivity over specificity, which would decrease the accuracy of the CAAD screen to identify those without neuropsychiatric symptoms. A two cut-off approach classifies participants into high, moderate and low risk groups with one cut-off maximizing sensitivity and a second cut-off with a maximum specificity, as previously reported [25]. This approach can create categories relevant to clinical care by identifying– a homogeneous low risk group unlikely to have neuropsychiatric symptoms, those with moderate risk, with possible neuropsychiatric symptoms, who should be further assessed or monitored, and those with high risk of neuropsychiatric symptoms for whom management and treatment may need to be prioritized and/or expedited [54]. Positive predictive value (PPV; true positive/true positive + false positive) and negative predictive value (NPV; true negative/true negative + false negative) were also calculated. Logistic regressions using relevant clinical variables including age, sex and years of education were applied to the ROC curves to control for these factors when predicting outcomes.

Internal consistency for each CAAD screen component was determined using Cronbach’s alpha values, where a Cronbach’s alpha ≥0.90 is excellent, 0.80–0.89 is good, 0.70–0.79 is fair and < 0.70 is unacceptable [55]. For the apathy component, since items 5 and 6 were sub-questions only to be rated if the response to the preceding questions was positive, these items were not included in the analysis.

Results

The participant inclusion process is shown in Fig. 1. During the course of the study, 1120 new referrals meeting eligibility criteria were identified. Of these 254 refused screening or were missed (multiple patients seen by different physicians with limited research personnel). Screens were administered clinically to 866 patients who were subsequently approached to complete detailed testing. Of these, 527 agree to be contacted to undergo validation testing and 127completed validation testing. Participant demographics of the validation population are represented in Table 2. Included subjects were similar in terms of age (63 ± 11 versus 63 ± 13), cardiac diagnoses (MI 25% versus 25%; CABG 17% versus 13%; Stent 35% versus 34%) and vascular risk factors (hypertension 42% versus 44%; BMI 29.2 ± 6.2 versus 28.6 ± 5.9) when compared to participants who were screened only (n = 603). The group that completed validation testing had a significantly higher proportion of males (75.3%) compared to those that were screened only (65%) (χ2 = 9.1, p = 0.002). The screen scores for the 127 participants were as follows: the mean word recall score was 3.96 ± 1.08, 106 (84%) completed the Trails B correctly, the mean three-item GPCOG score was 1.06 ± 1.01, the mean depression score was 1.02 ± 1.38, the mean anxiety score was 0.99 ± 1.35 and the mean apathy score was 3.20 ± 3.22.

Fig. 1
figure 1

Participant selection process

Table 2 Demographic Characteristics of Validation Participants (n = 127)

Validity analyses

Cognitive impairment

A total of 127 participants completed the NINDS-CSN cognitive battery. Of these, 15 participants (11.8%) were determined to have impaired memory and/or executive function. The ROC curves for validation of the cognitive component of the CAAD screen are shown in Fig. 2a and b. Using the two-cut point approach, the unadjusted AUC for the CAAD-Cog was 0.77 (Table 3); the sensitivity was optimized with CAAD-Cog = 6–7 (sensitivity = 95%, specificity 67%, NPV = 97%) and specificity was optimized with CAAD-Cog < 4 (specificity = 87%, sensitivity 49%, PPV = 46%). According to the CAAD-Cog, 9% were classified as high risk for cognitive impairment and 45% were classified as low risk for cognitive impairment. A subset of participants scored 4–5, and were classified as moderate risk for cognitive impairment. Of those in the moderate risk group, 14% were cognitively impaired based on the NINDS-CSN battery. When a logistic regression was applied to the ROC curve analysis controlling for age, sex and years of education, AUC was 0.80 (Table 4) and sensitivity and specificity remained high (sensitivity = 93%, specificity = 97%). The PPV improved from 46 to 57%.

Fig. 2
figure 2

Unadjusted (a) and adjusted (b) ROC curves for the cognitive impairment screen (AUC = 0.77 and 0.80, respectively). b was adjusted for age, sex and total years of education

Table 3 Unadjusted diagnostic characteristics of the CAAD screen components
Table 4 Adjusted diagnostic characteristics of the CAAD screen components

Anxiety

A total of 127 participants completed the SCID anxiety module. Of these 16.5% were classified as having GAD. The ROC curves for the validation of the anxiety portion of the screen are shown in Fig. 3a and b. The unadjusted AUC was acceptable (0.79); sensitivity was optimized with a CAAD-Anx score of 0 (sensitivity 86%, specificity 42%, NPV = 95%) and specificity was optimized with a score ≥ 5 (specificity = 99%, sensitivity 10%, PPV = 67%) (Table 3). The screen identified 2% of the participants as high risk and 51% as low risk for anxiety. A total of 47% were classified as moderate risk. According to the SCID-GAD module, 17% of participants had GAD, and 27% of those in the moderate risk group had GAD. The adjusted AUC was 0.81 and both sensitivity and specificity remained high (95 and 99% respectively). The PPV was highest at 67% using the unadjusted two cut-off method, while the NPV was highest at 98% using the adjusted two cut-off method (Table 4).

Fig. 3
figure 3

Unadjusted (a) and adjusted (b) ROC Curves for the anxiety screen (AUC = 0.79 and 0.81, respectively). b was adjusted for age, sex and total years of education

Apathy

A total of 125 participants completed the AES-S scale. The ROC curves for the validation of the apathy portion of the screen are shown in Fig. 4a and b. The unadjusted AUC was acceptable at 0.79 (Table 3); the sensitivity was optimized at CAAD-Apathy = 0–1 (sensitivity = 94%, specificity 41% NPV = 98%) and specificity was optimized at CAAD-Apathy ≥10 (specificity = 95%, sensitivity 13%, PPV = 25%). According to the screen, 6% of participants were at high risk for apathy while 38% were at low risk for apathy. The remaining 56% scored 2–9 and were classified as moderate risk. According to the AES, 13% had clinically significant apathy and 19% of those in the moderate risk group were apathetic. While the AUC did not change after adjustment for age, sex and years of education, the NPV and PPV were both highest when the adjusted two cut-off method was applied (99 and 40%, respectively) (Table 4).

Fig. 4
figure 4

Unadjusted (a) and adjusted (b) ROC Curves for the apathy screen (AUC = 0.79 and 0.79, respectively). b was adjusted for age, sex and total years of education

Depression

Of the 127 participants who completed the SCID depression module, 14.2% had major depression. The ROC curves for the depression validation are shown in Fig. 5a and b. The unadjusted AUC for the CAAD-Dep was 0.84; the sensitivity was optimized at CAAD-Dep = 0 (sensitivity = 89%, specificity 39%, NPV = 97%) and specificity was optimized at CAAD-Dep ≥ 5 (specificity = 100%, sensitivity 11%, PPV = 100%) (Table 3). The depression screen indicated 3% of participants as having high risk for depression while 54% were classified as having low risk for depression. The remaining 43% scored 1–4 on the screen and were classified as having moderate risk of depression. According to the SCID depression module, 14% were confirmed as depressed and of those in the moderate risk group, 22% were classified as depressed. The AUC adjusted for age, sex and years of education was 0.85 and both the sensitivity and specificity remained high (sensitivity = 94% and specificity = 99%) (Table 4).

Fig. 5
figure 5

Unadjusted (a) and adjusted (b) ROC Curves for the depression screen (AUC = 0.84 and 0.85, respectively). b was adjusted for age, sex and total years of education

Feasibility and internal consistency

Of 102 participants where time was recorded, 97.1% completed the screen in under 10 min with a mean (SD) of 4.9 (1.7) minutes. The internal consistency was good for depression, anxiety and apathy (items 1–4) but unacceptable for the three-item GPCOG (Table 5).

Table 5 Internal Consistency for each screen component

Discussion

This study assessed the validity and feasibility of the CAAD screen, a brief tool to assess risk for cognitive impairment, depression, anxiety and apathy in a CR setting. Current practices for comorbidity screening in a CR setting are not standardized. Specifically at TRI, participants are screened for depressive symptoms using the CES-D [13]. While the CES-D is a well validated and widely used screening tool, it can take up to 10 min to administer [56]. As such, additional time would be needed to obtain data for other important neuropsychiatric comorbidities, which would be burdensome in a busy clinical setting such as CR. Hence, a single tool to measure all four neuropsychiatric comorbidities in a timely manner would be clinically useful.

The CAAD screen was validated using the multiple ROC curve cut-off approach published previously [25]. Study findings show that all components of the screen demonstrated acceptable or excellent diagnostic characteristics. CAAD-Cog displayed strong sensitivity and specificity for detecting cognitive impairment using the two-cut point approach and adjusting for clinical factors (Fig. 2b). Of the large proportion (51%) of participants categorized as moderate risk, 15% of those were impaired according to the NINDS-CSN battery. While up to 35% of patients with CVD may experience cognitive impairment [14], only 12% of participants in this study scored ≤1.5 SD below the mean on tests of memory and/or executive function. We used a cut-off of ≤1.5 SD as it is a more stringent and frequently used cut-off than ≤1 SD [47]. However, if we had chosen a cut-off of ≤1 SD indicative of subtle deficits as has been done before in this population [46], 24% of our participants would have been classified as cognitively impaired, which more closely reflects the prevalence in the literature.

The NPV of the cognition section was excellent, while the PPV was only acceptable. This may suggest that this portion of the screen is likely to incorrectly classify those without cognitive impairment and is more suitable for detecting those who are at a low risk. Studies have demonstrated that there is often a high rate of false positives associated with brief cognitive screens and measures must be taken to find an optimal trade-off between speed and accuracy [57,58,59]. To reduce time and costs associated with extensive neurological follow-up, studies have recommended the administration of a second cognitive screen and that a firm diagnosis be made only if cognitive impairment was evident in multiple domains assessed by validated neuropsychological measures [57, 60].

The CAAD-Anx displayed excellent sensitivity and specificity for detecting GAD using the two cut-point approach. The screen correctly identified two-thirds of those in the high risk group, leaving a large proportion of participants classified as moderate risk similarly to other studies that have screened for anxiety and psychological distress in a CR population [61, 62]. Completing follow-up assessments for all patients in the moderate risk group would add a significant time burden for physicians and patients who ultimately do not have GAD. However, 27% of patients with GAD classified into this group. For those classified as moderate risk, CR staff may consider reassessment after 4 weeks [62] or completing a shorter anxiety screen, such as the GAD-7, before proceeding with a full length follow up assessment.

In comparison to the other portions of the screen, the CAAD-Apathy ROC curve did not show an improved AUC value when adjusted for age, sex and total years of education; however, adjusting for clinical variables reduced the number of participants who scored intermediate-risk from 56 to 41%, while remaining acceptable with excellent sensitivity and specificity. Adjustment for clinical factors also increased the PPV from 25 to 40% suggesting more accurate classification of patients. Previous studies indicated that ethnic differences are associated with apathy and therefore this factor may contribute to improvements in the AUC [63, 64].

The PHQ-2 had the best AUC values in comparison to other screen sections. Both the NPV and PPV were excellent, with 100% of those classified into the high risk group being diagnosed as depressed by the SCID-5. Furthermore, of the 18 participants classified as depressed according to the SCID depression module, only two were categorized into the low risk group. These robust diagnostic characteristics of the PHQ-2 support use of this tool depression in this population. Furthermore, due to the high prevalence and negative health outcomes associated with depressive symptoms in those undergoing CR [13], routine screening will allow referral to healthcare providers to confirm diagnosis and initiate treatment.

While there may be overlap between the screen components of the depression and apathy components of the screen, depression and apathy are now recognized as independent clinical syndromes [65]. They may also influence participation in CR. As previously shown, depression decreases completion and adherence in CR [13]. In addition, we expect that the lack of motivation and interest associated with apathy may also lead to less participation in CR. Hence, the accurate identification of which neuropsychiatric syndrome is impeding participation is critical to inform strategies to improve attendance and adherence to CR.

All components of the screen classified a large proportion of participants into the moderate risk group consistent with previous reports of subtle cognitive deficits and neuropsychiatric symptoms in this population [61, 66,67,68]. While following up with this group would ensure that all participants at risk receive follow up, it may cause those who are incorrectly classified to endure short-term psychological consequences or require physicians to conduct time-consuming assessments. As such, when screening CR participants for these comorbidities, those who score as being at moderate risk may be appropriate for close monitoring and further clinical assessment if necessary.

The CAAD screen was implemented as part of routine clinical care and was completed by all participants suggesting adequate patient acceptability. An overall mean time of completion of 4.9 min indicates that the CAAD screen is efficient in capturing clinically relevant information for all four CVD-related neuropsychiatric comorbidities in a large-volume clinic. Out of 127 participants, the CAAD screen identified 20 for follow-up, which is a feasible number at our site, leaving the majority in the monitoring and no symptoms group.

Findings from this study are consistent with other studies using a combined screen to detect presence of important comorbidities in other populations. For example, the unadjusted AUC for the depression screen (PHQ-2) in the present study was comparable to the AUC for the PHQ-2 in patients with stroke screened for depressive symptoms (0.84 vs. 0.90) [25]. The optimized sensitivity (89% vs. 92%) and specificity (100% vs. 99%) using a two cut-off approach were also similar between the two studies.

Limitations of the study include a single centre study design and the inability to compare adapted screen components to norms. Participants had an average age of 62 years, 16 years of education and were predominantly Caucasian and male. While representative of the CR population [69, 70], the study sample may not represent all patients with CVD. However, results were adjusted for demographic characteristics such as age, sex and years of education and the full versions of the screen components have been validated in diverse populations [71,72,73], which may improve generalizability. In addition, CR participants may be more motivated to exercise and participate in research studies. The possibility that a selection bias in favour of higher functioning and more motivated patients might have been introduced at the recruitment level cannot be ruled out and may explain the lower than expected incidence of neuropsychiatric symptoms in this study. It is important to implement the CAAD screen in multiple clinical centres to determine its generalizability and validity. In addition, although the internal consistency of the depression, anxiety and apathy (questions 1–4) portions of the screen were good, the GPCOG questions included in the CAAD screen used to assess mild cognitive impairment, may not be the most applicable to CR participants, who generally present with subtle early cognitive changes. Other questions on the full length GPCOG, such as trouble recalling conversations a few days later or difficulties in managing medication independently, may be more suitable and future studies should consider these questions as a measure of subjective cognitive function [74]. Future studies could also explore the assessment of biometrical quality of the individual screen items as an alternative approach for the selection of questions in the screening tool.

Conclusions

The CAAD screen had acceptable validity and feasibility for assessing prevalent yet under-recognized comorbidities in those with CVD or CVRFs attending CR. Use of the two cut-off approach resulted in optimized sensitivity and specificity for all portions of the screen and had clinical applicability by identifying those who needed further follow-up, and those who did not. Screening for these important and prevalent neuropsychiatric comorbidities in CVD patients and those with CVRFs can identify patients at risk for non-completion of CR and those who may need additional management.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available since patient consent was not obtained for publication or sharing of patient-level data.

Abbreviations

AES:

Apathy Evaluation Scale

AUC:

Area under the curve

CAAD:

Cognitive impairment, Anxiety, Apathy, Depression

CES-D:

Center of epidemiological studies depression scale

CR:

Cardiac rehabilitation

CVD:

Cardiovascular disease

CVRFs:

Cardiovascular risk factors

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition

GAD-2:

Generalized Anxiety Disorder-2

GPCOG:

General Practitioner Assessment of Cognition

MoCA:

Montreal Cognitive Assessment

NINDS-CSN:

National Institute of Neurological Disorders Stroke and the Canadian Stroke Network

NPV:

Negative Predictive Value

PHQ-2:

Patient Health Questionnaire-2

POI:

Probability of impairment

PPV:

Positive Predictive Value

ROC:

Receiver operating characteristic

SCID-5:

Structured Clinical Interview for DSM-5

References

  1. Naderi SH, Bestwick JP, Wald DS. Adherence to drugs that prevent cardiovascular disease: meta-analysis on 376,162 patients. Am J Med [Internet]. 2012;125(9):882–7. Available from:. https://doi.org/10.1016/j.amjmed.2011.12.013.

    Article  Google Scholar 

  2. World Health Organization. Cardiovascular disease [Internet]. Available from: http://www.who.int/cardiovascular_diseases/en/.

  3. Ambrose JA, Singh M. Pathophysiology of coronary artery disease leading to acute coronary syndromes. F1000Prime Rep [Internet]. 2015;7:08 Available from: http://www.ncbi.nlm.nih.gov/pubmed/25705391%5Cn, http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC4311268.

  4. Scott J. Pathophysiology and biochemistry of cardiovascular disease. Curr Opin Genet Dev. 2004;14(3):271–9.

    Article  CAS  PubMed  Google Scholar 

  5. Thompson PD, Buchner D, Piña IL, Balady GJ, Williams MA, Marcus BH, et al. Eercise and physical activity in the prevention and treatment of atherosclerotic cardiovascular disease: A statement from the council on clinical cardiology (subcommittee on exercise, rehabilitation, and prevention) and the council on nutrition, physical. Circulation. 2003;107(24):3109–16.

    Article  PubMed  Google Scholar 

  6. Smith SC, Benjamin EJ, Bonow RO, Braun LT, Creager MA, Franklin BA, et al. AHA/ACCF secondary prevention and risk reduction therapy for patients with coronary and other atherosclerotic vascular disease: 2011 update: A guideline from the American Heart Association and American College of Cardiology Foundation. Circulation. 2011;124(22):2458–73.

    Article  PubMed  Google Scholar 

  7. Warburton DER, Nicol CW, Bredin SSD. Health benefits of physical activity: the evidence. CMAJ [Internet]. 2006;174(6):801–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/16534088%255Cn, http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC1402378.

  8. Anderson L, Oldridge N, Thompson DR, Zwisler A-D, Rees K, Martin N, et al. Exercise-based cardiac rehabilitation for coronary heart disease: Cochrane systematic review and meta-analysis. J Am Coll Cardiol [Internet]. 2016;67(1):1–12 Available from: http://linkinghub.elsevier.com/retrieve/pii/S0735109715071193.

    Article  Google Scholar 

  9. Jolliffe J, Rees K, Taylor-Rod RS, Thompson DR, Oldridge N, Ebrahim S. Exercise-based rehabilitation for coronary heart disease. JolliffeJudith, ReesKaren, TaylorRodRS, ThompsonDavidR, OldridgeNeil, EbrahimShahExercise based Rehabil Coron Hear Dis Database Syst Rev Rev 2001Issue1 JohnWiley Sons, LtdChichester, UK D. 2001;(1).

  10. Bunevicius A, Staniute M, Brozaitiene J, Pop VJM, Neverauskas J, Bunevicius R. Screening for anxiety disorders in patients with coronary artery disease. Health Qual Life Outcomes [Internet]. 2013;11(1):37 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3601013&tool=pmcentrez&rendertype=abstract.

  11. Lichtman JH, Bigger JT, Blumenthal JA, Frasure-Smith N, Kaufmann PG, Lespérance F, et al. Recommendations for Screening , Referral , and Treatment A Science Advisory From the American Heart Association Prevention Committee of the Council on Cardiovascular Nursing , Council on Clinical. Circulation. 2008;118:1768–75.

    Article  PubMed  Google Scholar 

  12. Ligthart SA, Richard E, Fransen NL, Eurelings LSM, Beem L, Eikelenboom P, et al. Association of Vascular Factors with Apathy in community-dwelling elderly individuals. Arch Gen Psychiatry [Internet]. 2012;69(6):7–9 Available from: http://archpsyc.jamanetwork.com/article.aspx?doi=10.1001/archgenpsychiatry.2011.1858.

  13. Swardfager W, Herrmann N, Marzolini S, Saleem M, Farber SB, Kiss A, et al. Major depressive disorder predicts completion, adherence, and outcomes in cardiac rehabilitation: a prospective cohort study of 195 patients with coronary artery disease. J Clin psychiatry [internet], Available from. 2011, 72(9):1181–8 http://www.ncbi.nlm.nih.gov/pubmed/21208573.

    Article  PubMed  Google Scholar 

  14. Silbert BS, Scott DA, Evered LA, Lewis MS, Maruff PT. Preexisting cognitive impairment in patients scheduled for elective coronary artery bypass graft surgery. Anesth Analg. 2007;104(5):1023–8.

    Article  PubMed  Google Scholar 

  15. van der Mast RC, Vinkers DJ, Stek ML, Bek MC, Westendorp RGJ, Gussekloo J, et al. Vascular disease and apathy in old age. The Leiden 85-plus study. Int J Geriatr Psychiatry. 2008;23(3):266–71.

    Article  PubMed  Google Scholar 

  16. Hare DL, Toukhsati SR, Johansson P, Jaarsma T. Depression and cardiovascular disease: A clinical review. Eur Heart J. 2014;35(21):1365–72.

    Article  PubMed  Google Scholar 

  17. Rutledge T, Reis VA, Linke SE, Greenberg BH, Mills PJ. Depression in Heart Failure. A Meta-Analytic Review of Prevalence, Intervention Effects, and Associations With Clinical Outcomes. J Am Coll Cardiol. 2006;48:1527–37.

    Article  PubMed  Google Scholar 

  18. Bankier B, Januzzi JL, Littman AB. The high prevalence of multiple psychiatric disorders in stable outpatients with coronary heart disease. Psychosom Med [Internet]. 2004;66(5):645–50 Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00006842-200409000-00004.

    Article  PubMed  Google Scholar 

  19. Barth J, Schumacher M, Herrmann-Lingen C. Depression as a risk factor for mortality in patients with coronary heart disease: A meta-analysis. Psychosom Med [Internet]. 2004;66(6):802–13 Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00006842-200411000-00003.

    Article  Google Scholar 

  20. Frasure-Smith N, Lespérance F. Depression and other psychological risks following myocardial infarction. Arch Gen Psychiatry. 2003;60(6):627–36.

    Article  PubMed  Google Scholar 

  21. Khayyam-Nekouei Z, Neshatdoost H, Yousefy A, Sadeghi M, Manshaee G. Psychological factors and coronary heart disease. ARYA Atheroscler [Internet]. 2013;9(1):102–11 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3653260&tool=pmcentrez&rendertype=abstract.

    Google Scholar 

  22. Tully PJ, Harrison NJ, Cheung P, Cosh S. Anxiety and Cardiovascular Disease Risk: a Review. Curr Cardiol Rep [Internet]. 2016;18(12). Available from: https://doi.org/10.1007/s11886-016-0800-3

  23. Cardiac Care Network. Standards for the Provision of Cardiovascular Rehabilitation in Ontario [Internet]. Available from: https://www.corhealthontario.ca/resources-for-healthcare-planners-&-providers/rehabilitation/CCN_Cardiovascular_Rehab_Standards_2014.pdf.

  24. Balady GJ, Williams MA, Ades PA, Bittner V, Comoss P, Foody JM, et al. Core components of cardiac rehabilitation/secondary prevention programs: 2007 update. Circulation [Internet]. 2007;115(20):2675–82 Available from: https://www.ahajournals.org/doi/10.1161/CIRCULATIONAHA.106.180945.

    Article  PubMed  Google Scholar 

  25. Swartz RH, Cayley ML, Lanctôt KL, Murray BJ, Cohen A, Thorpe KE, et al. The “dOC” screen: feasible and valid screening for depression, obstructive sleep apnea (OSA) and cognitive impairment in stroke prevention clinics. PLoS One. 2017;12(4):1–18.

    Article  Google Scholar 

  26. Kapoor A, Lanctot KL, Bayley M, Herrmann N, Murray BJ, Swartz RH. Screening for Post-Stroke Depression and Cognitive Impairment at Baseline Predicts Long-Term Patient-Centered Outcomes After Stroke. J Geriatr Psychiatry Neurol. 2019;32(1):40–48.

    Article  PubMed  Google Scholar 

  27. Khan MM, Lanctot KL, Fremes SE, Wijeysundera HC, Radhakrishnan S, Gallagher D, et al. The value of screening for cognition, depression, and frailty in patients referred for TAVI. Clin Interv Aging. 2019;14:841–8.

    Article  Google Scholar 

  28. Eggermont LHP, de Boer K, Muller M, Jaschke AC, Kamp O, Scherder EJA. cardiac disease and cognitive impairment: a systematic review. Heart. 2012;98(18):1334–40.

    Article  PubMed  Google Scholar 

  29. Zheng L, MacK WJ, Chui HC, Heflin L, Mungas D, Reed B, et al. Coronary artery disease is associated with cognitive decline independent of changes on magnetic resonance imaging in cognitively normal elderly adults. J Am Geriatr Soc. 2012;60(3):499–504.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Gayda M, Gremeaux V, Bherer L, Juneau M, Drigny J, Dupuy O, et al. Cognitive function in patients with stable coronary heart disease: Related cerebrovascular and cardiovascular responses. PLoS One. 2017;12(9):e0183791.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.

    Article  Google Scholar 

  32. Pendlebury ST, Mariz J, Bull L, Mehta Z. Rothwell PM. ACE-R, and MMSE versus the national institute of neurological disorders and stroke-canadian stroke network vascular cognitive impairment harmonization standards neuropsychological battery after TIA and stroke. Stroke: MoCA; 2012.

    Google Scholar 

  33. Horton DK, Hynan LS, Lacritz LH, Rossetti HC, Weiner MF, Cullum CM. An abbreviated Montreal cognitive assessment (MoCA) for dementia screening. Clin Neuropsychol. 2015;29(4):413–25.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Roalf DR, Moore TM, Wolk DA, Arnold SE, Mechanic-Hamilton D, Rick J, et al. Defining and validating a short form Montreal cognitive assessment (s-MoCA) for use in neurodegenerative disease. J Neurol Neurosurg Psychiatry. 2016;87(12):1303–10.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Cheng Y-W, Chen T-F, Chiu M-J. From mild cognitive impairment to subjective cognitive decline: conceptual and methodological evolution. Neuropsychiatr Dis Treat. 2017;13:491–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Arroll B, Goodyear-Smith F, Crengle S, Gunn J, Kerse N, Fishman T, et al. Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. Ann Fam Med. 2010;8(4):348–53.

    Article  PubMed  PubMed Central  Google Scholar 

  37. McManus D, Pipkin SS, Whooley MA. Screening for depression in patients with coronary heart disease (data from the heart and soul study). Am J Cardiol [Internet]. 2005;96(8):1076–81 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2776683&tool=pmcentrez&rendertype=abstract%5Cn, http://www.sciencedirect.com/science/article/pii/S0002914905011665.

    Article  Google Scholar 

  38. Lakkis NA, Mahmassani DM. Screening instruments for depression in primary care: A concise review for clinicians. Postgrad Med. 2015;127:99–106.

    Article  PubMed  Google Scholar 

  39. Prisnie JC, Fiest KM, Coutts SB, Patten SB, CAM A, Blaikie L, et al. Validating screening tools for depression in stroke and transient ischemic attack patients. Int J Psychiatry Med. 2016;51(3):262–77.

    Article  PubMed  Google Scholar 

  40. Wild B, Eckl A, Herzog W, Niehoff D, Lechner S, Maatouk I, et al. Assessing generalized anxiety disorder in elderly people using the GAD-7 and GAD-2 scales: results of a validation study. Am J Geriatr Psychiatry. 2014;22(10):1029–38.

    Article  PubMed  Google Scholar 

  41. Celano CM, Suarez L, Mastromauro C, Januzzi JL, Huffman JC. Feasibility and utility of screening for depression and anxiety disorders in patients with cardiovascular disease. Circ Cardiovasc Qual Outcomes. 2013;6(4):498–504.

    Article  PubMed  Google Scholar 

  42. Robert P, Onyike CU, Leentjens AFG, Dujardin K, Aalten P, Starkstein S, et al. Proposed diagnostic criteria for apathy in Alzheimer’s disease and other neuropsychiatric disorders. Eur Psychiatry. 2009;24(2):98–104.

    Article  CAS  PubMed  Google Scholar 

  43. Eurelings LSM, Ligthart SA, Van Dalen JW, Moll Van Charante EP, Van Gool WA, Richard E. Apathy is an independent risk factor for incident cardiovascular disease in the older individual: A population-based cohort study. Int J Geriatr Psychiatry. 2014;29(5):454–63.

    Article  PubMed  Google Scholar 

  44. Mayo NE, Fellows LK, Scott SC, Cameron J, Wood-Dauphinee S. A longitudinal view of apathy and its impact after stroke. Stroke; 2009.

    Book  Google Scholar 

  45. Hachinski V, Iadecola C, Petersen RC, Breteler MM, Nyenhuis DL, Black SE, et al. National Institute of Neurological Disorders and Stroke-Canadian stroke network vascular cognitive impairment harmonization standards. Stroke. 2006;37(9):2220–41.

    Article  PubMed  Google Scholar 

  46. Rej S, Saleem M, Herrmann N, Stefatos A, Rau A, Lanctôt KL. Serum low-density lipoprotein levels, statin use, and cognition in patients with coronary artery disease. Neuropsychiatr Dis Treat. 2016;12:2913–20.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Bondi MW, Edmonds EC, Jak AJ, Clark LR, Delano-Wood L, McDonald CR, et al. Neuropsychological criteria for mild cognitive impairment improves diagnostic precision, biomarker associations, and progression rates. J Alzheimers Dis. 2014;42(1):275–89.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Marin RS, Biedrzycki RC, Firinciogullari S. Reliability and validity of the apathy evaluation scale. Psychiatry Res. 1991;38(2):143–62.

    Article  CAS  PubMed  Google Scholar 

  49. Clarke DE, Reekum RV, Simard M, Streiner DL, Freedman M, Conn D. Apathy in dementia: an examination of the psychometric properties of the apathy evaluation scale. J Neuropsychiatr [Internet]. 2007;19(1):57–64. Available from:. https://doi.org/10.1176/appi.neuropsych.19.1.57.

    Article  Google Scholar 

  50. Cheng W, Lai C. Satisfaction scale for community nursing: development and validation. J Adv Nurs. 2010;66(10):2331–40.

    Article  PubMed  Google Scholar 

  51. Cullen B, O’Neill B, Evans JJ, Coen RF, Lawlor BA. A review of screening tests for cognitive impairment, vol. 78. Neurosurgery and Psychiatry: J Neurol; 2007. p. 790–9.

    Google Scholar 

  52. Fan J, Upadhye S, Worster A. Understanding receiver operating characteristic (ROC) curves. Can J Emerg Med. 2006;8(1):19–20.

    Google Scholar 

  53. Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol. 2010;5:1315–6.

    Article  PubMed  Google Scholar 

  54. Swartz RH, Cayley ML, Lanctôt KL, Murray BJ, Smith EE, Sahlas DJ, et al. Validating a pragmatic approach to cognitive screening in stroke prevention clinics using the Montreal cognitive assessment. Stroke. 2016;47(3):807–13.

    Article  PubMed  Google Scholar 

  55. Hermans H, van der Pas FH, Evenhuis HM. Instruments assessing anxiety in adults with intellectual disabilities: A systematic review. Res Dev Disabil. 2011;32:861–70.

    Article  PubMed  Google Scholar 

  56. Sharp LK, Lipsky MS. Screening for depression across the lifespan: A review of measures for use in primary care settings. Am Fam Physician. 2002;66(6):1001–8.

    PubMed  Google Scholar 

  57. Klekociuk SZ, Summers JJ, Vickers JC, Summers MJ. Reducing false positive diagnoses in mild cognitive impairment: the importance of comprehensive neuropsychological assessment. Eur J Neurol. 2014;21(10):1330–e83.

    Article  CAS  PubMed  Google Scholar 

  58. Maji B, Larner AJ. Screening for dementia: is one simple question the answer? Clin Med J R Coll Physicians London. 2015;15(1):111–2.

    Google Scholar 

  59. Larner AJ. Speed versus accuracy in cognitive assessment when using CSIs. Prog Neurol Psychiatry. 2015;19(1):21–4.

    Article  Google Scholar 

  60. Fujii D, Hishinuma E, Masaki K, Petrovich H, Ross GW, White L. Dementia screening: can a second administration reduce the number of false positives? Am J Geriatr Psychiatry. 2003;11(4):462–5.

    Article  PubMed  Google Scholar 

  61. Gostoli S, Roncuzzi R, Urbinati S, Rafanelli C. Clinical and Subclinical Distress, Quality of Life, and Psychological Well-Being after Cardiac Rehabilitation. Appl Psychol Heal Well-Being. 2017;9(3):349–69.

    Article  Google Scholar 

  62. Tulloch H, Heenan A, Cupper L, Pelletier R, OʼFarrell P, Pipe A. Depression and anxiety screening and triage protocol for cardiac rehabilitation programs. J Cardiopulm Rehabil Prev. 2018;38(3):159–62.

  63. Binetti G, Mega MS, Magni E, Padovani A, Rozzini L, Bianchetti A, et al. Behavioral disorders in Alzheimer disease: A transcultural perspective. Arch Neurol. 1998;55(4):539–44.

    Article  CAS  PubMed  Google Scholar 

  64. Hargrave R, Stoeklin M, Haan M, Reed B. Clinical aspects of dementia in African-American, Hispanic, and white patients. J Natl Med Assoc [Internet]. 2000;92(1):15–21 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2640513&tool=pmcentrez&rendertype=abstract.

    CAS  Google Scholar 

  65. Lanctôt KL, Agüera-Ortiz L, Brodaty H, Francis PT, Geda YE, Ismail Z, et al. Apathy associated with neurocognitive disorders: recent progress and future directions. Alzheimer’s Dement [Internet]. 2017;13(1):84–100 Available from: http://linkinghub.elsevier.com/retrieve/pii/S1552526016302825.

    Article  Google Scholar 

  66. Sever S, Golder S, Doherty P. Factors associated with acute depressive symptoms in patients with comorbid depression attending cardiac rehabilitation. BMC Cardiovasc Disord. 2018;18(230):1–8.

    Google Scholar 

  67. Swardfager W, Herrmann N, Dowlati Y, Oh P, Kiss A, Lanctôt KL. Relationship between cardiopulmonary fitness and depressive symptoms in cardiac rehabilitation patients with coronary artery disease. J Rehabil Med. 2008;40(3):213–8.

    Article  PubMed  Google Scholar 

  68. Swardfager W, Herrmann N, Marzolini S, Saleem M, Kiss A, Shammi P, et al. Cardiopulmonary fitness is associated with cognitive performance in patients with coronary artery disease. J Am Geriatr Soc. 2010;58(8):1519–25.

    Article  PubMed  Google Scholar 

  69. Dinoff A, Saleem M, Herrmann N, Mielke MM, Oh PI, Venkata SLV, et al. Plasma sphingolipids and depressive symptoms in coronary artery disease. Brain Behav. 2017;7(11):e00836.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Saleem M, Herrmann N, Dinoff A, Mielke MM, Oh PI, Shammi P, et al. A Lipidomics approach to assess the association between plasma sphingolipids and verbal memory performance in coronary artery disease patients undertaking cardiac rehabilitation: A C18:0 signature for cognitive response to exercise. J Alzheimers Dis. 2017;60(3):829–41.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  71. Milani SA, Marsiske M, Striley CW. Discriminative ability of Montreal cognitive assessment subtests and items in racial and ethnic minority groups. Alzheimer Dis Assoc Disord. 2019:1–7.

  72. Goldstein FC, Ashley AV, Miller E, Alexeeva O, Zanders L, King V. Validity of the Montreal cognitive assessment as a screen for mild cognitive impairment and dementia in African Americans. J Geriatr Psychiatry Neurol. 2014;27(3):199–203.

    Article  PubMed  Google Scholar 

  73. Galenkamp H, Stronks K, Snijder MB, Derks EM. Measurement invariance testing of the PHQ-9 in a multi-ethnic population in Europe: the HELIUS study. BMC Psychiatry. 2017;17(1):349.

  74. Brodaty H, Pond D, Kemp NM, Luscombe G, Harding L, Berman K, et al. The GPCOG: A new screening test for dementia designed for general practice. J Am Geriatr Soc. 2002;50(3):530–4.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the staff at TRI for their help with study recruitment and data collection.

Funding

No funding was received.

Author information

Authors and Affiliations

Authors

Contributions

KL and NH were involved in the conceptualization of the study. DM, JB, PC and CE carried out the data collection. DM, NH, MS and KL contributed to the data analysis and data interpretation. DM, NH, RS, PO, MS and KL were involved in drafting and revising the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Krista L. Lanctôt.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the institutional research ethics boards at Sunnybrook Health Sciences Centre and the TRI at University Health Network. Since screening for cognitive and psychiatric comorbidities is recommended by national best practice guidelines [23], a waiver of consent to be screened was approved for patients entering CR to track screening rates and times. A subgroup of screened patients provided written informed consent to participate in validation testing by completing a neuropsychological battery.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohammad, D., Herrmann, N., Saleem, M. et al. Validity of a novel screen for cognitive impairment and neuropsychiatric symptoms in cardiac rehabilitation. BMC Geriatr 19, 163 (2019). https://doi.org/10.1186/s12877-019-1177-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12877-019-1177-0

Keywords