Introduction

Mild cognitive impairment (MCI) in Parkinson’s disease (PD-MCI) has been defined as a prodromal stage of Parkinson’s disease (PD) dementia (PDD) [1]. While PD-MCI patients are at greater risk of developing PDD [2], it is not possible to predict which patients convert within a short time period. Additional markers indicating patients at risk for PDD conversion are therefore urgently needed.

In non-PD cohorts, instrumental activity of daily living (ADL) impairments have been reported to emerge in the transition from MCI to dementia, affecting complex skills such as managing finances [3, 4]. Impairments in these functional abilities are even strong predictors of future conversion to dementia [5]. In PD, research demonstrates that non-demented patients already show functional impairment [6, 7], primarily related to loss of cognitive function [8, 9]. Mild ADL impairment in PD-MCI patients might help to identify those at risk for PDD conversion [7, 8], necessitating an early diagnosis of ADL impairment in the prodromal stage of PDD using sensitive and reliable measures.

One of the most commonly used scales to measure ADL impairment is the Pfeffer Functional Activities Questionnaire (FAQ) [10], which has a high discriminative ability for distinguishing MCI from other diagnostic groups [11]. For non-PD cohorts, a cut-off score of ≥ 5 points has been discussed to define MCI [10, 12], yet only very few studies have examined cut-off values for PD-MCI. A recent paper examining both Alzheimer’s disease and PD patients found that an FAQ score ≥ 3 was able to differentiate cognitively normal PD (PD-CN) and PD-MCI patients, after matching for age, sex, and education [13]. They found a low sensitivity (38.1%) but high specificity (92.9%), attributing this to the fact that only a subgroup of PD-MCI patients presented with ADL dysfunction. A notable limitation of this study was that they did not examine the cognitive profile of PD patients stratified according to this cut-off. Standardized ADL assessments accompanied by neuropsychological testing can further the understanding of how cognitive abilities are related to ADL impairment [14], which is necessary to identify measures that are sensitive to early changes in functional abilities.

The FAQ is most commonly completed by an informant, as statements by relatives about the patient ‘s ADL situation are often of great importance for further clinical decisions. It can also be completed by the patient themselves if no caregiver is available, to provide insight into how cognitive impairment affects their daily life. Previous research has shown that PD patients tend to underestimate their ADL impairment compared to their caregivers [14, 15]. However, not all studies have found differences between informant and self-reporting of ADL function in PD [16, 17]. It is still unclear whether self-reports or informant reports are more useful in the clinical routine for judging cognitive-driven ADL deficits, as the discrepancy between the two types of reports have not been extensively studied.

The aim of this study was to examine the diagnostic abilities of different cut-off scores of the FAQ for differentiating between levels of severity of cognitive impairment in PD, differentiating between informant and self-reports. For this purpose, diagnostic values of cut-offs reported in the literature and the optimal cut-off derived from the current data were examined in an international pooled cohort of patients. Global cognitive function was also compared between groups for each cut-off, to determine how cognition relates to daily functioning in PD.

Methods

Study design and participants

Data of 679 patients were harmonized and analyzed within the frame of the CENTRE-PD project. Patients were recruited from the ABC-PD Study at the University Hospital in Tübingen (n = 226) [8], the Luxembourg Parkinson’s Study at the University of Luxembourg (n = 274) [18], and the OPDC Discovery Cohort at the University of Oxford (n = 179) [19]. All studies received ethical approval from local ethics committees; all patients gave written informed consent for respective study participation at each of the three study centers. For all studies, procedures were in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Inclusion criteria for the analyses were age between 45 and 90 years, and ability to give informed consent. Patients who met the following criteria were excluded: severe cognitive impairment determined by a Montreal Cognitive Assessment (MoCA) score < 18 points (n = 14, 2.1%), major depression defined by a Beck Depression Inventory (BDI)-II score > 19 points after conversion (44, 6.5%,), or missing demographic, FAQ, or MoCA data (32, 4.7%). Data of 589 patients was included in the final data set.

Assessments

Demographics were collected for each patient, and the Unified Parkinson’s Disease Rating Scale-Part III (UPDRS-III) and the Hoehn and Yahr staging scale assessed motor severity [20]. Depressive symptomatology was assessed using the BDI versions I (BDI-I) [21] and II (BDI-II). All BDI-I values were converted to the appropriate BDI-II scores according to the BDI-II manual. The MoCA was used to assess global cognitive functioning [22]. According to Level-I criteria of the Movement Disorders Society [23], patients were classified as PD-CN if they had an MoCA score ≥ 26, or as PD-MCI if they scored between 18 and 25 points. The FAQ, which consists of ten items, each rated from 0 (normal) to 3 (dependent), was used to assess ADL impairment. The total score ranges from 0 to 30 points, with higher scores suggesting greater functional dependence.

Statistical analyses

SPSS version 26 (SPSS Inc., Chicago, IL, USA) was used to conduct statistical analyses, with α levels set at 0.05. The Shapiro–Wilk test was applied to test for normal distribution of variables. Demographics were compared between cognitive groups (PD-CN and PD-MCI) using Chi-squared and Mann–Whitney-U tests where appropriate. A receiver operating characteristic (ROC) analysis was conducted to define the optimal (highest Youden’s Index) FAQ cut-off to define PD-MCI. The FAQ cut-offs chosen for the following analyses were (i) optimal cut-off identified from the ROC curve analysis, (ii) cut-off ≥ 3 shown to differentiate between PD-CN and PD-MCI [13], and (iii) a cut-off for MCI (≥ 5) in the general population [10, 12]. Sensitivity and specificity as well as the positive predictive value (PPV) and negative predictive value (NPV) were calculated for each of the three cuts-offs. This was done separately for informant-rated FAQ and self-rated FAQ to compare the diagnostic abilities of both ratings. Binary logistic regressions examining the effect of the MoCA total score between each FAQ cut-off group while correcting for significant demographic variables were conducted in the informant-rated and self-rated FAQ groups separately. As the FAQ has been found to be dependent on age in older adults [24], we chose to include age as a constant covariate, even if it was not significantly different between groups. It is also important to note that PD is a neurodegenerative disease, and increasing ADL and cognitive impairment has been shown to be associated with motor symptom worsening and higher PD severity [25]. Therefore, disease duration was also included as a covariate in all models.

Results

Of all patients, 225 (38.2%) were classified as PD-MCI and 364 (61.8%) as PD-CN. PD-MCI patients were significantly older, had less formal education, had greater severity of motor symptoms, and showed more impairment with ADL activities than PD-CN (see Table 1). The FAQ was most commonly completed by the patient’s spouse (419, 71.1%), followed by the patient themselves (136, 23.1%), the patient’s child (22, 3.7%), a close friend (7, 1.2%), or a non-specified informant (5, 0.8%).

Table 1 Demographic and clinical characteristics of the pooled sample

The ROC curve analysis of the FAQ total score for diagnosing PD-MCI produced an area under the curve of 0.61 and standard error 0.02, p < 0.001 (95% confidence interval: 0.56–0.66), which was judged to be sufficient [26]. Diagnostic values for differentiating PD-CN from PD-MCI can be found in Table 2 for all three cut-offs. In all patients, 132 (58.7%) of PD-MCI compared to 156 (42.9%) PD-CN patients scored ≥ 1 on the FAQ. Eighty-eight (39.1%) PD-MCI compared to 78 (21.4%) PD-CN patients scored above the cut-off of 3. For FAQ ≥ 5, 57 (25.3%) PD-MCI compared to only 51 (14%) of PD-CN patients scored above the cut-off.

Table 2 Diagnostic values of the FAQ total score for differentiating between PD-CN and PD-MCI according to each chosen cut-off value

Informant analyses

Demographics for groups split according to each of the three cut-offs are shown in Supplementary Table 1. For all cut-offs, significant differences were found for age, disease duration, UPDRS-III, BDI-II, and MoCA total scores, where patients scoring above each cut-off were older, had more severe motor impairment and longer disease durations, increased depressive symptomatology, and lowered cognition. There was a significant effect of sex for the cut-off of 1, with more males scoring above the cut-off. Additionally, patients scoring above the cut-off of 5 had significantly lower formal education years than those scoring below the cut-off. Diagnostic ability for differentiating PD-CN from PD-MCI for all three cut-off values can be found in Table 2.

Binary logistic regressions were used to examine the effect of the MoCA, age, and significant demographic variables on each FAQ cut-off (see Table 3). When correcting for sex, age, disease duration, UPDRS-III, and BDI-II, the regression model for FAQ cut-off of 1 [χ2(6) = 86.23, p < 0.001] was not predicted by the MoCA. Splitting the groups according to the FAQ cut-off 3 [model: χ2(5) = 96.88, p < 0.001], with age, disease duration, UPDRS-III, and the BDI-II as covariates, also did not reveal a significant effect of the MoCA. For the FAQ cut-off of 5 using age, education, disease duration, UPDRS-III, and the BDI-II as covariates [model fit: χ2(6) = 82.31, p < 0.001], the MoCA did not significantly differentiate between groups.

Table 3 Binary logistic regression models between Functional Activities Questionnaire Cut-offs and the Montreal Cognitive Assessment for Informant Ratings

Self-report analyses

Supplementary Table 2 shows the demographics for all three groups split according to the cut-offs. Significant effects were found for all three cut-offs for UPDRS-III and MoCA total scores, with patients scoring below each cut-off showing increased motor severity and lowered cognition. There was a significant effect of the BDI-II for cut-offs 3 and 5, with patients scoring above the cut-off displaying greater depressive symptoms than those below the cut-offs. Additionally, an effect of disease duration was found for the cut-off of 3, where patients scoring above the cut-off had longer disease durations than those below the cut-off. Table 2 shows the diagnostic values for differentiating PD-CN from PD-MCI for all three cut-offs.

Relation between FAQ groups per cut-off and the MoCA, including age and significant demographic variables as covariates, was examined using binary logistic regressions (see Table 4). The model using the FAQ cut-off of 1 and age, disease duration, UPDRS-III, and BDI-II as covariates was stable, χ2(4) = 15.97, p = 0.007, yet the MoCA was not able to differentiate between groups. Splitting the groups according to the FAQ cut-off 3 [model: χ2(5) = 35.49, p < 0.001] using age, disease duration, UPDRS-III, and the BDI-II as covariates showed a significant effect of the MoCA [B =  − 0.31, Exp(B) = 0.74, p = 0.003], where patients with an FAQ ≥ 3 had worse cognition. For the FAQ cut-off of 5 and correcting for age and UPDRS-III [model fit: χ2(3) = 20.74, p < 0.001], the MoCA showed moderate evidence for differentiating between groups, although this did not reach significance.

Table 4 Binary logistic regression models between Functional Activities Questionnaire Cut-offs and the Montreal Cognitive Assessment for Self Ratings

Discussion

Recent studies have shown that PD-MCI patients already show the first signs of ADL dysfunctions [6, 9]; however, the quantification of these deficits remains difficult. The aim of this study was to examine the diagnostic abilities of different cut-off scores of the FAQ (from the current data set as well as the literature) for differentiating not only between cognitive impairment levels but also between informant and self-reports of ADL abilities.

The current results demonstrate that with increasingly higher FAQ cut-offs, for both self and informant reports, specificity increases indicating a higher ability of the cut-off to correctly identify PD-CN patients without ADL impairment. However, sensitivity also decreases, leading to a decrease in true positive patients among the PD-MCI group. In the original study [10], the FAQ presented good sensitivity (0.85) and specificity (0.81) in terms of distinguishing normal healthy individuals and those with cognitive decline. In our international PD sample, we were able to replicate the specificity in both analyses for the cut-offs 3 and 5, yet the sensitivity was lacking for all (< 0.45). This finding of a low sensitivity of the FAQ compared to the higher specifity for ADL impairment in PD-MCI is similar to a recent study which found sensitivity and specificity (38.1% and 92.9%, respectively) using the FAQ cut-off ≥ 3 [13]. One reason for this effect could be that ADL impairment arises in the more advanced disease stage of PD-MCI and is limited to only a subgroup of PD-MCI patients. Mild ADL impairment primarily related to loss of cognitive function has been detected in ~ 30% of PD-MCI with various measurements [8, 9], supporting our hypothesis.

It should also be noted that assessing ADL impairments is difficult in PD, as motor impairments interfere with daily functioning [27]. The progression of motor dysfunction in PD, coupled with increasing age, leads to a poorer ability to execute ADL [28, 29] and a reduced health-related quality of life [30], while cognition and ADL function may decline in parallel [31, 32]. This may suggest that ADL functions simply decline with progression of the disease. However, a recent study examined both motor and cognitive influences on the FAQ in non-demented PD patients [8]. Results showed that PD-MCI patients had more cognitive-driven and motor-driven ADL impairments than PD-CN patients. As disease duration was not significant between the groups, it can be said that ADL impairments are more severe in PD-MCI patients irrespective of disease course. Future studies are needed to evaluate the predicitive value of mild ADL impairment in prodomal stage of PDD with the intention of further characterizing a high-risk group for conversion to dementia in PD and comparing between different types of PD-MCI.

We also investigated associations between the different FAQ cut-offs and the MoCA, a measure of global cognition. These associations were assessed separately for the FAQ rated by informants and the FAQ rated by the patient themselves. The accuracy of both patient and informant perceptions of ADL impairment, especially in the prodromal stage of PDD, has been sparsely studied. For the informant ratings, no FAQ cut-off was significantly associated with the MoCA after adjustment for other covariates. However, the cut-off of 3 in the self-report analyses was able to show a significant association with the MoCA, and the cut-off of 5 showed moderate evidence of an association which did not reach clinical significance. It should be noted that fewer patients scored above the cut-off of 5 than the cut-off of 3, which limits the statistical power in our sample. Our results are strengthened by other studies that have shown that patients can assess their own neuropsychological performance more accurately [33]. However, previous studies have found that informant reports are related to objective neuropsychological performance and more accurate than self-reports [17]. We could not replicate this by using the MoCA score as an external criteria to verify that the classified mild ADL impairment is related to cognitive dysfunction. Caregiver burden, including stress and depression, has been shown to affect informants’ ratings of functional abilities [34, 35]. As these were not measured in our study, it is possible that their influence on informant evaluations led to the null effects found in the current results. Moreover, informants might have the tendency to overestimate motor impairment on ADL performance [15], which could explain the lack of a significant effect on the MoCA score after diving the sample according to type of FAQ informant. Our current data indicate that self-reported ADL impairment assessed by the FAQ showed a relation to the severity of cognitive impairment in PD.

It is possible that ADL scales can serve as screening tools for clinicians to decide which further assessments, such as neuropsychological tests, are necessary [14]. The main advantage of the FAQ is that it is a short and easy to apply measure and could be administered quickly at patient visits by doctors to gauge functional abilities. However, due to the low specificities found for the different cut-offs used, it seems that the FAQ may not be useful as a stand-alone assessment for detecting cognitive impairment and may not offer a significant advantage compared to cognitive tests. We would argue that until a definitive cut-off value with adequate sensitivity and specificity can be identified for each cognitive group, the FAQ should be used in conjunction with neuropsychological tests, in line with the current recommendation of the Movement Disorders Society [23]. Perhaps the FAQ is more useful in detecting subtle changes in ADL function over time, even in different cognitive groups, which would make it an extremely valuable tool for tracking progression. Compared to healthy controls, PD patients are four times more likely to lose functional independence [36]. As this loss is irreversible, future studies should aim to improve the cut-off of the FAQ for identifying patients at risk of rapid decline in ADL function.

Limitations

Some limitations need to be taken into account. The data analyzed were collected from different countries, raising the possibility of cross-cultural differences affecting the results; however, a previous study showed that the FAQ performed well across different ethnic groups [37]. As cognition is negatively influenced by severe depression [38], we excluded patients who showed signs of major depression which limits the generalization of our results to the larger population. Furthermore, to diagnose PD-MCI, only Level-I classification was used, instead of a comprehensive neuropsychological battery (Level-II), which may have led to an over-reporting of PD-MCI in our sample.

Conclusion

This study has taken an important step towards determining a suitable cut-off for ADL dysfunctions in PD-MCI. Our data argue that the presence of mild ADL impairment in PD is associated with cognitive impairment. The utility of the FAQ for diagnosing PD-MCI may therefore be difficult due to the lack of specific criteria defining ADL impariment in PD-MCI. Future studies are needed to verify whether these patients are at greater risk for PDD conversion. If ADL function declines early in the disease course, and possibly reflects faster cognitive decline, it would be paramount to identify when to start treatments and to further research into examining what treatments can be developed.