Skip to content
Publicly Available Published by De Gruyter October 23, 2015

Assessing the commutability of reference material formats for the harmonization of amyloid-β measurements

  • Maria Bjerke , Ulf Andreasson , Julia Kuhlmann , Erik Portelius , Josef Pannee , Piotr Lewczuk , Robert M. Umek , Eugeen Vanmechelen , Hugo Vanderstichele , Erik Stoops , Jennifer Lewis , Manu Vandijck , Vesna Kostanjevecki , Andreas Jeromin , Salvatore J. Salamone , Oliver Schmidt , Anja Matzen , Kairat Madin , Udo Eichenlaub , Tobias Bittner , Leslie M. Shaw , Ingrid Zegers , Henrik Zetterberg and Kaj Blennow EMAIL logo

Abstract

Background: The cerebrospinal fluid (CSF) amyloid-β (Aβ42) peptide is an important biomarker for Alzheimer’s disease (AD). Variability in measured Aβ42 concentrations at different laboratories may be overcome by standardization and establishing traceability to a reference system. Candidate certified reference materials (CRMs) are validated herein for this purpose.

Methods: Commutability of 16 candidate CRM formats was assessed across five CSF Aβ42 immunoassays and one mass spectrometry (MS) method in a set of 48 individual clinical CSF samples. Promising candidate CRM formats (neat CSF and CSF spiked with Aβ42) were identified and subjected to validation across eight (Elecsys, EUROIMMUN, IBL, INNO-BIA AlzBio3, INNOTEST, MSD, Simoa, and Saladax) immunoassays and the MS method in 32 individual CSF samples. Commutability was evaluated by Passing-Bablok regression and the candidate CRM termed commutable when found within the prediction interval (PI). The relative distance to the regression line was assessed.

Results: The neat CSF candidate CRM format was commutable for almost all method comparisons, except for the Simoa/MSD, Simoa/MS and MS/IBL where it was found just outside the 95% PI. However, the neat CSF was found within 5% relative distance to the regression line for MS/IBL, between 5% and 10% for Simoa/MS and between 10% and 15% for Simoa/MSD comparisons.

Conclusions: The neat CSF candidate CRM format was commutable for 33 of 36 method comparisons, only one comparison more than expected given the 95% PI acceptance limit. We conclude that the neat CSF candidate CRM can be used for value assignment of the kit calibrators for the different Aβ42 methods.

Introduction

The 42 amino acid-long amyloid-β (Aβ42) peptide found in cerebrospinal fluid (CSF) is an important biomarker for Alzheimer’s disease (AD). It is used to aid in early clinical diagnosis, for enrichment purposes in clinical trials, to monitor the effect of therapeutics and for research purposes [1, 2]. CSF Aβ42 levels correlate inversely with neuropathological measures of plaque density in Alzheimer brains [3, 4] and show high concordance with amyloid positron emission tomography [5, 6]. Routine clinical use of CSF Aβ42 is part of the diagnostic process in an increasing number of countries and may be used as a surrogate for neuropathology to either support or rule out a diagnosis of AD in memory-impaired individuals [4, 68]. Together with other markers, Aβ42 is included in both the IWG-2 and the NIA-AA research criteria for AD [911]. To identify Aβ pathology early is becoming immensely important for the selection of patients in clinical trials on Aβ-targeting drug candidates and will have a central role in future medical treatment decisions based on knowledge about underlying pathology. The relevance of measuring Aβ42 in CSF is further supported by studies suggesting that it is altered very early in the disease course, when CSF tau levels are only marginally increased [12].

The high variability in Aβ42 concentrations obtained on the same set of samples in different laboratories even when using the same method, previously shown in multicenter studies [13, 14] and in the Alzheimer’s Association quality control (QC) program for CSF biomarkers [15, 16], complicates the straightforward utility of Aβ42 as a biomarker. In addition, different method formats, e.g. ELISA and Luminex xMAP, give different values [17]. This variation precludes the introduction of generally applicable cut-off levels in routine clinical practice. In general, the discrepancy in observed CSF biomarker levels between centers is probably the result of differences in pre-analytical procedures (e.g. lumbar puncture procedure and CSF sample processing), analytical procedures [18], and batch-to-batch variation in the production of biomarker methods [19]. Effects of pre-analytical confounding factors may be reduced by standardization of procedures for lumbar puncture and sample handling [18, 20, 21]. However, the results from the Alzheimer’s Association QC program, in which the same samples are analyzed at multiple sites with multiple lots over time, pinpoint a significant part of the variation to analytical procedures [15, 16]. This may be minimized by standardization of the analytical process at a laboratory, including the establishment of an internal control system and batch-bridging procedures [6], as well as the use of ready-to-use calibrators and transferring manual ELISA methods to automated pipetting robot systems [22, 23].

The immunoassays used for the measurements of Aβ42 are very sensitive and selective. They are useful in a clinical setting since they allow for a fast assessment of the analyte in a large number of samples. All available commercial methods utilize the sandwich antibody technique to increase specificity. The level of analytical sensitivity may depend on the applied detection method [24]. A number of factors contribute to the result of the analysis such as antibody specificity, antigen epitope availability, the antibody antigen reaction kinetics and equilibrium, and the influence of differences in the matrix between calibrators and samples. Moreover, in order to obtain results that are comparable over time and between kits, these techniques depend on a calibrator (recombinant peptide or protein) with a value that is correctly assigned. Due to the lack of a readily available certified reference material (CRM), the value assignment differs among different vendors, which may result in systematic bias of measured concentrations across different kits for Aβ42. Batch-to-batch variation of the calibrator value is a potential source to the variability, which can also be affected by the oligomeric state of Aβ42 in the calibration vials included in the commercial kit and differences in method formats that would affect its degree of aggregation during the analytical procedure. Despite all confounding factors, promising results have been obtained suggesting that it may be possible to harmonize results by the use of calibrators prepared in CSF-like materials [25], but the long-term solution will be the introduction of a CRM.

Comparability of results over time and across formats and platforms can be achieved by standardizing pre-analytical and analytical measurements and establishing traceability to a reference system. CRMs are key components of such reference systems and for establishing traceability (https://ec.europa.eu/jrc/en/research-topic/certified-reference-materials). Commutability of CRMs is a critical property to ensure that they are fit for the intended use. Commutability is defined as the ability of a CRM to show interassay properties that are equivalent to those of representative clinical samples of healthy and diseased individuals respectively. In the present study, we assess the commutability of candidate CRM formats across a broad range of CSF Aβ42 methods, including a selected reaction monitoring (SRM) liquid chromatography-mass spectrometry (LC-MS)-based method for the analyte. The most promising candidate CRM formats were identified and subjected to validation in a new set of CSF samples.

Materials and methods

Method comparisons commutability I

In the first commutability study, five different immunoassays were evaluated at the Clinical Neurochemistry Laboratory of the Sahlgrenska University Hospital, Mölndal, Sweden: 1) MSD® 96-Well MULTI-ARRAY® Human (4G8) Abeta42 Ultra-Sensitive Kit (Meso Scale Discovery, Gaithersburg, MD, USA), 2) Human β Amyloid(1-42) ELISA Kit Wako High-Sensitive (Wako Pure Chemical Industries, Ltd., Osaka, Japan), 3) Human Amyloid β (1-42) (N) assay kit – IBL (Immuno-Biological Laboratories Co., Ltd., Fujioka, Japan, distributed by IBL International GmbH), 4) INNOTEST® β-AMYLOID (1-42) and 5) INNO-BIA AlzBio3 (Fujirebio-Europe, Inc., Ghent, Belgium). Commutability between the immunoassay Aβ42 measurement results and Aβ42 quantification by SRM performed on a triple quadrupole MS (TSQ Vantage, Thermo Scientific, Waltham, MA, USA) was also assessed.

Method comparisons commutability II

The second commutability study assessed eight different immunoassays: 1) MSD®96-Well MULTI-SPOT® Human Aβ42 V-PLEX Kit (Meso Scale Discovery, Gaithersburg, MD, USA), 2) Amyloid-beta (1-42) CSF ELISA (IBL International GmbH, Hamburg, Germany), 3) VITROS® Immunodiagnostic Amyloid Beta 42 Assay (AB-42) (Saladax Biomedical, Bethlehem, PA, USA), 4) Elecsys® β-Amyloid (1-42) immunoassay (Roche Diagnostics, Penzberg, Germany), 5) EUROIMMUN Beta-Amyloid (1-42) (ADx NeuroSciences NV, Gent, Belgium), 6) INNO-BIA AlzBio3 (Fujirebio-Europe, Ghent, Belgium), 7) INNOTEST® β-AMYLOID (1-42) (with ready-to-use calibrators, Fujirebio-Europe), and 8) Simoa Human Aβ42 (Quanterix Corporation, Lexington, MA, USA). The first five methods were run in the facilities of the corresponding manufacturers, the INNO-BIA was analyzed in the Biomarker Research laboratory at Perelman School of Medicine, University of Pennsylvania, PA, USA, and the last two immunoassays and the SRM performed on a triple quadrupole MS (TSQ Vantage, Thermo Scientific, Waltham, MW, USA) were evaluated in the Clinical Neurochemistry laboratory at Sahlgrenska University Hospital, Mölndal, Sweden.

Material and measurement procedure commutability I and II

The immunoassay analyses were performed according to each manufacturer’s protocol. The sample preparation and MS quantification procedure is described elsewhere [26].

For commutability study I, a total of 48 individual CSF samples were selected to cover the clinical spectrum (patient and control sample concentration range) of Aβ42 values. Duplicate samples were analyzed on two plates (plate 1 with samples 1–24 and plate 2 with samples 25–48), each plate also contained duplicates of 16 non-individual samples that were assessed as candidate CRM formats (see Table 1). Both plates were measured at the same time point. Identical samples were measured sequentially by SRM. Briefly, the non-individual samples consisted of neat and detergent diluted (Tween® 20 0.05%, Sigma-Aldrich®, St. Louis, MO, USA) decoded CSF pools with low and high concentration of Aβ42 as determined by INNOTEST® ELISA. One set of the neat and detergent diluted pools were spiked with Aβ42 (rPeptide, Bogat, GA, USA) starting at a concentration of 2000 ng/L and reaching the final concentration of 250 ng/L by serial dilution (factor 1:2). The concentration of the Aβ42 peptide was determined by SRM analysis using the heavy 15N-labeled Aβ42 peptide calibrator. The calibrator concentration was determined by amino acid analysis [26]. Furthermore, artificial CSF (aCSF; pH 7.3) and phosphate buffered saline (PBS) (neat and detergent diluted) were used as a matrices to spike 1000 ng/L of Aβ42 into. The aCSF was prepared according Alzet® Osmotic Pumps protocol (http://www.alzet.com/products/guide_to_use/cfs_preparation.html) with minor modifications, i.e. addition of bovine serum albumin and glucose at a final concentration of 4.5 nM and 4.5 mM, respectively.

Table 1

Non-individual samples assessed as candidate CRM formats in the first commutability study.

No.SymbolsNon individual samplesSpiked Aβ42 concentration, ng/L
Individual CSF samples0
1

2
CSF pool low Aβ42

CSF pool high Aβ42
0

0
3

4
aCSF

PBS
1000

1000
5

6

7

8
CSF pool low Aβ42

CSF pool low Aβ42

CSF pool low Aβ42

CSF pool low Aβ42
2000

1000

500

250
9
CSF pool low Aβ42+0.05% Tween0
10CSF pool high Aβ42+0.05% Tween0
11

12
aCSF + 0.05% Tween

PBS + 0.05% Tween
1000

1000
13

14
CSF pool low Aβ42+0.05% Tween

CSF pool low Aβ42+0.05% Tween
2000

1000
15CSF pool low Aβ42+0.05% Tween500
16CSF pool low Aβ42+0.05% Tween250

For commutability study II, 32 individual CSF samples selected to cover the clinical spectrum of Aβ42 values were analyzed in duplicates (with the exception of Elecsys due to limited availability of samples). For each method also quadruplicates of four pooled (non-individual) samples that were considered as candidate CRM formats were measured. The first non-individual sample was a pool of 24 neat CSF samples with a final Aβ42 concentration of approximately 760 ng/L as determined with INNOTEST. The neat CSF pool was spiked with an Aβ42 calibrator from JRC-IRMM (indicative concentration of stock solution: 86 mg/L) to prepare the other three non-individual samples with the following Aβ42 spiking concentration: 300 ng/L, 800 ng/L, and 1300 ng/L. The SRM method was performed on a triple quadrupole MS as previously described [26], except that calibration was performed using the surrogate analyte approach [27].

All CSF samples were left-over samples from the clinical routine at the Clinical Neurochemistry Laboratory, Sahlgrenska University Hospital, Mölndal, Sweden. The samples were thawed once, CSF pools were immediately prepared and individual and non-individual pooled samples were aliquoted into equal proportions into polypropylene tubes and frozen at –80 °C pending analyses. The samples were de-identified and coded. This procedure follows the Swedish Biobank law and is approved by the Ethical Review Board at University of Gothenburg.

Statistical analysis of commutability

In commutability study I, pair-wise comparisons of the mean values of the individual samples using linear regression was used for method comparisons; the goodness of fit for each method comparison is presented by the coefficient of determination (R2). The calculation of a 95% prediction interval (PI) was done in order to conclude whether the assessed CRM formats were commutable with the clinical individual samples based on the position of its values with respect to the PI.

In commutability study II, Analyze-it® for Microsoft Excel (version 2.30; Leeds, UK) was used for linear and Passing-Bablok regression [28] analyses of mean values of individual samples (only single measurements were available for Elecsys and patient samples 17 and 23 analyzed with Saladax) for method comparisons. The mean values for quadruplicate measurements were used for the candidate CRM formats, with the exception of Elecsys where only duplicate measurements were done. Additionally, the results of the spiked level 3 analyzed with the EUROIMMUN method were out of range for two of the four measurements. Thus only duplicate measurements were used for this method. A commutability software (ACOMED Statistik, Leipzig, Germany) that runs on Microsoft Excel and R software (version 3.0.2) [29] was used in to generate the 95% PI for the Passing-Bablok regression lines.

Results

Commutability study I

Method comparisons

For the immunoassays, the mean coefficient of variation (CV) of the individual CSF duplicate samples varied between 2.5% and 4.4%, while the mean CVs for the CSF non-individual samples distributed on two plates were between 3.2% and 8.5%. For the MS method the mean CV for the CSF individual samples was 8.9%, while the mean CV for the pooled CSF was 10.7%.

The R2 values varied between 0.82 and 0.98 for the immunoassay comparisons of the individual CSF samples; for most of the comparisons the coefficients of determination were above 0.90. The R2 values for the comparisons between the SRM and immunoassays were between 0.77 and 0.89 (see Table 2). These results indicate that the different methods correlate well (p<0.0001). However, the slopes between the different method comparisons varied substantially, from 0.39 to 2.41 (Supplemental Data, Table 1), which is also reflected by the discrepant values for the same CSF samples measured by the different methods.

Table 2

Linear regression of the mean values for the commutability I individual samples.

Linear regressionR2 and number of individual samples
MSDAlzbio3IBLWAKOSRM
INNOTEST0.96

48
0.91

45
0.93

48
0.96

48
0.83

48
MSDx0.85

45
0.98

48
0.94

48
0.88

48
Alzbio3x0.82

45
0.84

45
0.77

45
IBLx0.92

48
0.89

48
WAKOx0.81

48

Values represent correlation coefficient. R2 and number of individual samples included in analyses. All correlations were significant (p<0.0001).

Commutability of candidate CRM formats

Duplicates of 48 individual CSF samples were measured together with quadruplicates of 16 different candidate CRM formats (see Table 1). The neat CSF pools with low or high intrinsic Aβ42 concentration (individual samples combined to form low or high Aβ42 pools) were commutable for all immunoassay combinations and for the immunoassay and SRM method combinations as their values were within the 95% PI (Figure 1). The low Aβ CSF pool with spiked Aβ42 was commutable within the clinical individual sample range for most comparisons. The formats that contained Tween were the least commutable. The aCSF spiked with Aβ42 was only commutable for a few methods (mainly WAKO and AlzBio3) and the measured concentration of Aβ42 spiked PBS was close to the lower limit of detection for most methods. However, the opposite was found in PBS and aCSF when detergent was added, rendering the Aβ42 concentration close to the upper limit of detection in some of the methods.

Figure 1: Linear regression analysis – commutability I.
Figure 1:

Linear regression analysis – commutability I.

Commutability study II

Method comparisons

For the immunoassays, the mean CVs for the CSF individual samples varied between 1.4% and 8.0%, while the mean CVs for the pooled CSF samples were between 2.8% and 7.6%. For the SRM method, the mean CV for the individual CSF and the pooled CSF samples was 11.4% and 13.8%, respectively. There were no significant differences between the intra-assay CVs of the individual and non-individual samples for the above mentioned methods, with the exceptions of EUROIMMUN (p=0.01) and IBL (p=0.04) for which the median CVs of non-individual samples were significantly higher (median CV 5.6% and 2.7%, respectively) though under 10%.

All methods correlated significantly (p<0.0001), with R2 values between 0.67 and 0.98 for the immunoassay comparisons of the individual CSF samples when assessed by Passing-Bablok. The R2 values for the comparisons between the SRM and immunoassays were found to be in the range of 0.71–0.97; for exact values see the lower left corner of Table 3. The coefficients of determination were ≥0.93 for all comparisons except comparisons including AlzBio3 and INNOTEST for which the coefficients of determination were 0.91. These results indicate that the newly developed methods (MSD, Saladax, EUROIMMUN, SRM, Simoa, Elecsys and IBL) correlate well with each other as do the more established methods (INNOTEST and AlzBio3). The correlation between the more established and newly developed methods was somewhat more moderate with the coefficients of determination ranging between 0.81 and 0.92 for INNOTEST and between 0.67 and 0.91 for AlzBio3. The slopes for the different method comparisons varied substantially from 0.15 to 6.6 (Table 4).

Table 3

Linear regression of the mean values for the commutability II individual samples.

Linear regressionR2 and number of individual samples
SaladaxEUROIMMUNINNOTESTSRMSimoaElecsysAlzBio3IBL
MSD0.93

32
0.95

32
0.81

32
0.95

32
0.95

32
0.98

32
0.67

32
0.96

32
Saladaxx0.98

32
0.92

32
0.96

32
0.97

32
0.96

32
0.81

32
0.98

32
EUROIMMUNx0.89

32
0.95

32
0.96

32
0.98

32
0.77

32
0.97

32
INNOTESTx0.87

32
0.87

32
0.84

32
0.91

32
0.87

32
SRMx0.96

32
0.95

32
0.71

32
0.97

32
Simoax0.97

32
0.71

32
0.98

32
Elecsysx0.71

32
0.98

32
AlzBio3x0.73

32

Values represent correlation coefficient. R2 and number of individual samples included in analyses. All correlations were significant (p<0.0001).

Table 4

Slopes of Passing-Bablok regression analyses of pair-wise comparisons between methods.

Passing-Bablok regressionDependent value (x-axis)
IBLSaladaxEUROIMMUNINNOTESTSRMSimoaElecsysMSDAlzBio3
Independent value (y-axis)
 IBLx1.281.041.200.670.820.621.773.75
 Saladax0.78x0.820.960.510.620.491.372.96
 EUROIMMUN0.961.21x1.140.640.770.601.683.63
 INNOTEST0.831.040.87x0.510.640.521.493.21
 SRM1.491.941.560.67x1.180.902.702.26
 Simoa1.221.621.301.960.85x0.772.286.55
 Elecsys1.612.061.661.551.111.30x2.735.15
 MSD0.560.730.600.670.370.440.37x6.15
 AlzBio30.270.340.280.310.150.190.160.44x

Green: 0.50–1.50, yellow: 0.00–0.49 and 1.51–2.00, orange: 2.01–2.50, red: >2.51.

Commutability of candidate CRM formats

The commutability of the candidate CRM formats was evaluated using different statistical approaches. The results obtained using Passing-Bablok regression and comparisons of the means of the results for the formats with the PI are shown in Figure 2. In general, the non-spiked neat CSF pool was highly commutable and the most promising candidate CRM. It was found to behave comparable to the patient CSF samples (i.e. falling within the 95% PI) for almost all method comparisons, except for the comparison between Simoa/MSD, Simoa/SRM and SRM/IBL. For these method combinations the neat CSF pool was found to lack commutability based on its position outside the 95% PI (Figure 2E, AA and AD, respectively, and Table 5). Furthermore, the neat CSF pool was also assessed with respect to its relative distance from the Passing-Bablok regression line. In more than half of the comparisons it was found to be within 5% relative distance to the regression line, while for the rest of the comparisons the neat CSF pool was between 5% and 10% away from the regression line. The exceptions were the method comparisons between Simoa/MSD and MSD/IBL where the neat CSF pool was found at a relative distance of 10%–15% (Table 6A). The CSF pool with the lowest spiked concentration of Aβ42 (spiked level 1) was also highly commutable with respect to falling within the 95% PI for most of the method comparisons, except for Elecsys/EUROIMMUN, Elecsys/AlzBio3, Elecsys/SRM, SRM/Simoa, Simoa/AlzBio3, and AlzBio3/Saladax (Figure 2 and Table 5). This material was also highly commutable with respect to the relative distance from the regression line in half of the method comparisons that ended up within 5% of the relative distance from the line. For approximately 30% of method comparisons the material had a relative distance of 5%–10%, while for the remaining comparisons the material was 10%–15% away from the regression line (Table 6B). The other two materials were spiked with concentrations of Aβ42 (spiked level 2 and 3) that put them in the higher end of the clinical sample interval and were found to lack commutability for most method comparisons with regard to the 95% PI as well as the distance to the Passing-Bablok regression line (Tables 5 and 6C,D and Figure 2).

Figure 2: Passing-Bablok regression analysis – commutability II.
Figure 2:

Passing-Bablok regression analysis – commutability II.

Table 5

Summary of results for Passing-Bablok regression of mean values; assessment of neat CRM commutability (upper right) and number of candidate CRMs within 95% PI (lower left).

Dependent values (x-axis)
MSDSaladaxEUROIMMUNINNOTESTSRMSimoaElecsysAlzBio3IBL
Independent values (y-axis)
 MSDx11110111
 Saladax4x1111111
 EUROIMMUN33x111111
 INNOTEST443x11111
 SRM4444x0110
 Simoa34442x111
 Elecsys331423x11
 AlzBio34133211x1
 IBL44243423x

Upper right corner: 1 indicates commutability, 0 indicates lack of commutability.

Table 6

Relative distance from regression line.

(A) Neat CSF.
Passing-Bablok regressionDependent value (x-axis)
ElecsysIBLEUROIMMUNINNOTESTSRMSaladaxAlzBio3MSDSimoa
Independent value (y-axis)
 Elecsysx2.53.11.13.71.34.24.76.8
 IBL2.4x0.73.13.73.17.510.73.5
 EUROIMMUN2.80.9x1.44.02.37.510.05.5
 INNOTEST1.33.32.0x1.40.65.05.16.0
 SRM3.73.94.21.4x0.45.25.08.6
 Saladax0.73.22.90.60.3x5.97.26.3
 AlzBio34.67.16.95.35.75.6x4.79.3
 MSD4.211.29.55.35.07.24.4x13.1
 Simoa6.93.55.65.58.86.58.613.3x
(B) Spiked level 1.
Passing-Bablok regressionDependent value (x-axis)
MSDSaladaxEUROIMMUNIBLSRMSimoaElecsysAlzBio3INNOTEST
Independent value (y-axis)
 MSDx0.10.63.53.15.03.014.47.6
 Saladax0.1x0.042.54.34.55.99.57.8
 EUROIMMUN0.10.6x2.73.15.75.98.97.3
 IBL3.02.42.6x1.21.74.210.010.4
 SRM3.13.73.01.1x2.05.210.113.3
 Simoa5.24.85.71.72.2x1.910.912.5
 Elecsys3.56.55.74.15.21.9x9.412.1
 AlzBio314.79.28.39.510.511.69.9x3.6
 INNOTEST7.77.97.810.613.313.011.93.4x
(C) Spiked level 2.
Passing-Bablok regressionDependent value (x-axis)
SimoaSaladaxIBLINNOTESTMSDSRMEUROIMMUNAlzBio3Elecsys
Independent value (y-axis)
 Simoax2.62.310.79.01.48.711.010.1
 Saladax2.4x3.78.26.35.45.910.810.5
 IBL2.33.5x11.310.01.19.611.78.2
 INNOTEST11.28.311.6x1.614.92.34.816.8
 MSD8.86.310.61.4x9.30.110.312.4
 SRM1.64.81.014.89.3x9.812.09.6
 EUROIMMUN8.66.59.71.70.69.9x6.216.9
 AlzBio311.710.511.25.010.612.45.5x13.4
 Elecsys10.211.18.116.912.99.616.613.0x
(D) Spiked level 3.
Passing-Bablok regressionDependent value (x-axis)
ElecsysMSDSaladaxEUROIMMUNSimoaIBLINNOTESTSRMAlzBio3
Independent value (y-axis)
 Elecsysx1.62.21.64.66.75.78.48.2
 MSD2.1x2.82.85.67.86.08.818.0
 Saladax2.72.8x5.62.24.310.37.815.0
 EUROIMMUN1.82.36.1x7.79.83.912.210.0
 Simoa4.75.82.47.8x3.312.54.314.2
 IBL6.57.34.29.73.3x13.83.015.7
 INNOTEST5.56.110.44.513.014.0x19.37.2
 SRM8.48.77.212.14.52.919.3x16.4
 AlzBio38.618.314.79.414.915.27.516.8x

Green: 0.0%–5.0%, yellow: 5.1%–10.0%, orange: 10.1%–15.0%, red: 15.1%–20.0%. Comparison of relative distance of the neat CSF pool and the three spike levels (candidate CRM formats) to the Passing-Bablok regression lines. The line equations were calculated with Analyze-it® for Microsoft Excel (version 2.30). The fields of the tables below were colour coded to group assay correlations according to the distance.

Discussion

In the present study it was shown that pooled neat CSF is commutable, and has good potential as a CRM format for the calibration of methods used for Aβ42 quantification in CSF. It was also shown that the results of methods for Aβ42 are highly correlated, which is a prerequisite for being able to achieve comparability of results obtained with different methods.

Standardization efforts are ongoing in the International Federation of Clinical Chemistry and Laboratory Medicine Working Group for CSF proteins (IFCC WG-CSF), and the Alzheimer’s Association Global Biomarker Standardization Consortium (GBSC). The aim of the IFCC WG-CSF is to develop reference measurement procedures (RMPs) and CRMs for the AD CSF biomarkers [30, 31]. One important step in this standardization process is to evaluate the commutability of candidate CRMs for different analytical methods that are used within the field. If the methods give correlating results, the use of a commutable CRM for calibration should make it possible to produce values that are comparable irrespective of analytical method, time or place of measurement [32]. In the present study, it was shown that the majority of the results of the different immunoassays correlate well; and in addition, they also correlate with results from the SRM-based method, which has now been published as candidate SRM-based RMP [27, 33].

The first substudy confirmed that the majority of methods tested were highly correlated (R2>0.9) as shown previously [19]. It is well recognized in the research community that the various available methods for Aβ42 give highly variable concentrations. However, as long as the methods are highly correlated this problem can be solved by the introduction of a commutable CRM that can be used to calibrate the methods. For most of the comparisons the neat CSF pool behaves as the clinical samples and can be found within the PI and in close proximity to the regression line. There were only three comparisons, out of 36, for which the neat CSF pool did not pass the specified criteria for commutability. However, the 95% PI imply that two out of 36 comparisons should fail to be within the acceptance range. In addition, the neat CSF pool candidate CRM was within a relative distance of <15% from the regression line for the three comparisons that did not pass.

The neat CSF and neat CSF spiked with Aβ42 were the candidates that showed the most promise from the first round of the commutability assessments and therefore they were further evaluated in the second commutability study. None of the artificial CRM formats tested was found to be commutable. Neither the aCSF nor the PBS spiked with Aβ42 showed any promise as CRMs. The PBS spiked with 1000 ng/L of recombinant Aβ42 ended up below the clinical sample range when assessed by various methods and the spiked aCSF was often outside the PI. The low commutability for the CSF pools and the artificial systems (spiked aCSF and PBS) that contained detergent might be explained by the fact that the clinical samples did not contain any extra additives, except for what is present in the buffers provided with the various immunoassays. If the CRM format should be commutable for more method comparisons by adding detergents to the neat CSF, the clinical procedure of the CSF sampling would have to be changed and any influence on the candidate RMPs would need to be investigated. This would have a major impact on already ongoing studies and would increase the burden of sample storage. If no other option could have been found this route would have to be further investigated. However, since the neat CSF pool seems to behave well for almost all method comparisons this path was not pursued.

Conclusions

Multiple candidate CRM formats (neat and spiked CSF) were evaluated for commutability of Aβ42 measurements across eight immunoassays and SRM. The commutability across the immunoassays and SRM is a prerequisite for harmonization of Aβ42 cut-off values for different measurement methods. With regard to the candidate CRM formats that were evaluated, the non-spiked candidate CRM was found to be commutable for all comparisons with the exception of the comparisons between IBL/SRM, Simoa/SRM and Simoa/MSD. However, the relative distance from the regression line for these comparisons was less than 15%. The neat CSF can therefore be regarded as the most commutable candidate CRM format for the methods evaluated herein. Since the candidate RMP is based on LC-MS SRM, it can be used to set the value of the neat CSF candidate CRM format, which can be used for value assignment of the kit calibrators. Spiking of neat CSF with recombinant Aβ42 reduced the commutability and is therefore not considered as a candidate CRM format.


Corresponding author: Kaj Blennow, MD, PhD, Clinical Neurochemistry Laboratory, Institute of Neuroscience and Physiology, Department of Psychiatry and Neurochemistry, The Sahlgrenska Academy at University of Gothenburg, 431 80, Mölndal, Sweden, E-mail:

Acknowledgments

This study was supported by grants from the Alzheimer’s Association, the Swedish Brain Foundation, the Sweden-America Foundation, the Swedish Research Council, Swedish State Support for Clinical Research, the Knut and Alice Wallenberg Foundation, the Royal Swedish Academy of Sciences, the Torsten Söderberg Foundation, the Agency for Innovation by Science and Technology (Flanders, IWT O&O 14015) and the JPND BIOMARKAPD project. PL is supported by the German Bundesministerium für Bildung und Forschung (grant 01ED1203D) within the BiomarkAPD Project of the JPND. LMS is supported by the NIA/NIH ADNI grant, the MJ Fox foundation for PD research.

Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.

Research funding: None.

Employment or leadership: OS and AM are employees of IBL International. ES is an employee of ADx NeuroSciences. TB, KM and UE are employees of Roche Diagnostics GmbH. RMU and JL are employees of Meso Scale Discovery. AJ is an employee of Quanterix, Corp. SS is an employee of Saladax Biomedical, Inc. MV and VK are employees of Fujirebio Europe N.V. IZ and JK are employees of the European Commission, Joint Research Centre (JRC), Institute for Reference Materials and Measurements (IRMM).

HV and EVM are co-founders of ADx NeuroSciences and HV is a founder of Biomarkable bvba.

Honorarium: PL received consultation or lecture honoraria from Innogenetics, Roche, Beckman Coulter, AJ Roboscreen, and IBL International. LMS serves as consultant to Eli Lilly, Janssen, and Novartis. KB received consultation or lecture honoraria from Fujirebio Europe, Roche Diagnostics, and IBL International.

Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.

References

1. Hulstaert F, Blennow K, Ivanoiu A, Schoonderwaldt HC, Riemenschneider M, De Deyn PP, et al. Improved discrimination of AD patients using beta-amyloid(1-42) and tau levels in CSF. Neurology 1999;52:1555–62.10.1212/WNL.52.8.1555Search in Google Scholar

2. Blennow K, Hampel H, Weiner M, Zetterberg H. Cerebrospinal fluid and plasma biomarkers in Alzheimer disease. Nat Rev Neurol 2010;6:131–44.10.1038/nrneurol.2010.4Search in Google Scholar

3. Strozyk D, Blennow K, White LR, Launer LJ. CSF Abeta 42 levels correlate with amyloid-neuropathology in a population-based autopsy study. Neurology 2003;60:652–6.10.1212/01.WNL.0000046581.81650.D0Search in Google Scholar

4. Tapiola T, Alafuzoff I, Herukka SK, Parkkinen L, Hartikainen P, Soininen H, et al. Cerebrospinal fluid {beta}-amyloid 42 and tau proteins as biomarkers of Alzheimer-type pathologic changes in the brain. Arch Neurol 2009;66:382–9.10.1001/archneurol.2008.596Search in Google Scholar

5. Landau SM, Lu M, Joshi AD, Pontecorvo M, Mintun MA, Trojanowski JQ, et al. Comparing positron emission tomography imaging and cerebrospinal fluid measurements of beta-amyloid. Ann Neurol 2013;74:826–36.10.1002/ana.23908Search in Google Scholar

6. Palmqvist S, Zetterberg H, Blennow K, Vestberg S, Andreasson U, Brooks DJ, et al. Accuracy of brain amyloid detection in clinical practice using cerebrospinal fluid beta-amyloid 42: a cross-validation study against amyloid positron emission tomography. J Am Med Assoc Neurol 2014;71:1282–9.Search in Google Scholar

7. Andreasen N, Minthon L, Davidsson P, Vanmechelen E, Vanderstichele H, Winblad B, et al. Evaluation of CSF-tau and CSF-Abeta42 as diagnostic markers for Alzheimer disease in clinical practice. Arch Neurol 2001;58:373–9.10.1001/archneur.58.3.373Search in Google Scholar

8. Duits FH, Prins ND, Lemstra AW, Pijnenburg YA, Bouwman FH, Teunissen CE, et al. Diagnostic impact of CSF biomarkers for Alzheimer’s disease in a tertiary memory clinic. Alzheimers Dement 2015;11:523–32.10.1016/j.jalz.2014.05.1753Search in Google Scholar

9. Dubois B, Feldman HH, Jacova C, Hampel H, Molinuevo JL, Blennow K, et al. Advancing research diagnostic criteria for Alzheimer’s disease: the IWG-2 criteria. Lancet Neurol 2014;13:614–29.10.1016/S1474-4422(14)70090-0Search in Google Scholar

10. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Jr., Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 2011;7:263–9.10.1016/j.jalz.2011.03.005Search in Google Scholar PubMed PubMed Central

11. Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 2011;7:270–9.10.1016/j.jalz.2011.03.008Search in Google Scholar PubMed PubMed Central

12. Buchhave P, Minthon L, Zetterberg H, Wallin AK, Blennow K, Hansson O. Cerebrospinal fluid levels of beta-amyloid 1-42, but not of tau, are fully changed already 5 to 10 years before the onset of Alzheimer dementia. Arch Gen Psychiatry 2012;69:98–106.10.1001/archgenpsychiatry.2011.155Search in Google Scholar PubMed

13. Lewczuk P, Beck G, Ganslandt O, Esselmann H, Deisenhammer F, Regeniter A, et al. International quality control survey of neurochemical dementia diagnostics. Neurosci Lett 2006;409:1–4.10.1016/j.neulet.2006.07.009Search in Google Scholar PubMed

14. Verwey NA, van der Flier WM, Blennow K, Clark C, Sokolow S, De Deyn PP, et al. A worldwide multicentre comparison of assays for cerebrospinal fluid biomarkers in Alzheimer’s disease. Ann Clin Biochem 2009;46(Pt 3):235–40.10.1258/acb.2009.008232Search in Google Scholar PubMed

15. Mattsson N, Andreasson U, Persson S, Arai H, Batish SD, Bernardini S, et al. The Alzheimer’s Association external quality control program for cerebrospinal fluid biomarkers. Alzheimers Dement 2011;7:386–95. e6.10.1016/j.jalz.2011.05.2243Search in Google Scholar PubMed PubMed Central

16. Mattsson N, Andreasson U, Persson S, Carrillo MC, Collins S, Chalbot S, et al. CSF biomarker variability in the Alzheimer’s Association quality control program. Alzheimers Dement 2013;9:251–61.10.1016/j.jalz.2013.01.010Search in Google Scholar PubMed PubMed Central

17. Olsson A, Vanderstichele H, Andreasen N, De Meyer G, Wallin A, Holmberg B, et al. Simultaneous measurement of beta-amyloid(1-42), total tau, and phosphorylated tau (Thr181) in cerebrospinal fluid by the xMAP technology. Clin Chem 2005;51:336–45.10.1373/clinchem.2004.039347Search in Google Scholar PubMed

18. Teunissen CE, Verwey NA, Kester MI, van Uffelen K, Blankenstein MA. Standardization of assay procedures for analysis of the CSF biomarkers amyloid beta((1-42)), tau, and phosphorylated tau in Alzheimer’s disease: Report of an International Workshop. Int J Alzheimers Disease 2010;2010. pii: 635053.10.4061/2010/635053Search in Google Scholar PubMed PubMed Central

19. Bjerke M, Portelius E, Minthon L, Wallin A, Anckarsater H, Anckarsater R, et al. Confounding factors influencing amyloid Beta concentration in cerebrospinal fluid. Int J Alzheimers Disease 2010;2010. pii: 986310.10.4061/2010/986310Search in Google Scholar PubMed PubMed Central

20. Vanderstichele H, Bibl M, Engelborghs S, Le Bastard N, Lewczuk P, Molinuevo JL, et al. Standardization of preanalytical aspects of cerebrospinal fluid biomarker testing for Alzheimer’s disease diagnosis: a consensus paper from the Alzheimer’s Biomarkers Standardization Initiative. Alzheimers Dement 2012;8:65–73.10.1016/j.jalz.2011.07.004Search in Google Scholar PubMed

21. del Campo M, Mollenhauer B, Bertolotto A, Engelborghs S, Hampel H, Simonsen AH, et al. Recommendations to standardize preanalytical confounding factors in Alzheimer’s and Parkinson’s disease cerebrospinal fluid biomarkers: an update. Biomark Med 2012;6:419–30.10.2217/bmm.12.46Search in Google Scholar PubMed

22. Petzold A, Verwey NA, van Uffelen K, Blankenstein MA, Teunissen C. Batch prepared protein standards for cerebrospinal fluid (CSF) biomarkers for neurodegeneration. J Neurosci Meth 2010;193:296–9.10.1016/j.jneumeth.2010.08.028Search in Google Scholar PubMed

23. Vanderstichele H, De Meyer G, Shapiro F, Engelborghs S, De Deyn P, Shaw L, et al. Alzheimer’s disease biomarkers: from concept to clinical utility In: Galimberti D, Scarpini E, editors. BioMarkers for early diagnosis of Alzheimer’s disease. Nova Science Publishers, Inc., 2008:81–122.Search in Google Scholar

24. Andreasson U, Vanmechelen E, Shaw LM, Zetterberg H, Vanderstichele H. Analytical aspects of molecular Alzheimer’s disease biomarkers. Biomark Med 2012;6:377–89.10.2217/bmm.12.44Search in Google Scholar PubMed

25. Vanderstichele HM, Shaw L, Vandijck M, Jeromin A, Zetterberg H, Blennow K, et al. Alzheimer disease biomarker testing in cerebrospinal fluid: a method to harmonize assay platforms in the absence of an absolute reference standard. Clin Chem 2013;59:710–2.10.1373/clinchem.2012.201830Search in Google Scholar PubMed

26. Pannee J, Portelius E, Oppermann M, Atkins A, Hornshaw M, Zegers I, et al. A selected reaction monitoring (SRM)-based method for absolute quantification of Abeta38, Abeta40, and Abeta42 in cerebrospinal fluid of Alzheimer’s disease patients and healthy controls. J Alzheimers Dis 2013;33:1021–32.10.3233/JAD-2012-121471Search in Google Scholar PubMed

27. Leinenbach A, Pannee J, Dulffer T, Huber A, Bittner T, Andreasson U, et al. Mass spectrometry-based candidate reference measurement procedure for quantification of amyloid-beta in cerebrospinal fluid. Clin Chem 2014;60:987–94.10.1373/clinchem.2013.220392Search in Google Scholar PubMed

28. Passing H, Bablok. A new biometrical procedure for testing the equality of measurements from two different analytical methods. Application of linear regression procedures for method comparison studies in clinical chemistry, Part I. J Clin Chem Clin Biochem 1983;21:709–20.10.1515/cclm.1983.21.11.709Search in Google Scholar PubMed

29. R Core Team. A language and environment for statistical computing. 2013, R Foundation for Statistical Computing: Vienna, Austria. URL http://www.R-project.org/.Search in Google Scholar

30. Mattsson N, Zegers I, Andreasson U, Bjerke M, Blankenstein MA, Bowser R, et al. Reference measurement procedures for Alzheimer’s disease cerebrospinal fluid biomarkers: definitions and approaches with focus on amyloid beta42. Biomark Med 2012;6:409–17.10.2217/bmm.12.39Search in Google Scholar PubMed

31. Carrillo MC, Blennow K, Soares H, Lewczuk P, Mattsson N, Oberoi P, et al. Global standardization measurement of cerebral spinal fluid for Alzheimer’s disease: an update from the Alzheimer’s Association Global Biomarkers Consortium. Alzheimers Dement 2013;9:137–40.10.1016/j.jalz.2012.11.003Search in Google Scholar PubMed

32. Zegers I, Beetham R, Keller T, Sheldon J, Bullock D, MacKenzie F, et al. The importance of commutability of reference materials used as calibrators: the example of ceruloplasmin. Clin Chem 2013;59:1322–9.10.1373/clinchem.2012.201954Search in Google Scholar PubMed

33. Korecka M, Waligorska T, Figurski M, Toledo JB, Arnold SE, Grossman M, et al. Qualification of a surrogate matrix-based absolute quantification method for amyloid-beta(4)(2) in human cerebrospinal fluid using 2D UPLC-tandem mass spectrometry. J Alzheimers Dis 2014;41:441–51.10.3233/JAD-132489Search in Google Scholar PubMed PubMed Central


Supplemental Material:

The online version of this article (DOI: 10.1515/cclm-2015-0733) offers supplementary material, available to authorized users.


Received: 2015-7-28
Accepted: 2015-8-29
Published Online: 2015-10-23
Published in Print: 2016-7-1

©2016 by De Gruyter

Downloaded on 19.4.2024 from https://www.degruyter.com/document/doi/10.1515/cclm-2015-0733/html
Scroll to top button