Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Prediction of preeclampsia risk in first time pregnant women: Metabolite biomarkers for a clinical test

Abstract

Preeclampsia remains a leading cause of maternal and perinatal morbidity and mortality. Accurate prediction of preeclampsia risk would enable more effective, risk-based prenatal care pathways. Current risk assessment algorithms depend on clinical risk factors largely unavailable for first-time pregnant women. Delivering accurate preeclampsia risk assessment to this cohort of women, therefore requires for novel biomarkers. Here, we evaluated the relevance of metabolite biomarker candidates for their selection into a prototype rapid, quantitative Liquid Chromatography-tandem Mass Spectrometry (LC-MS/MS) based clinical screening assay. First, a library of targeted LC-MS/MS assays for metabolite biomarker candidates was developed, using a medium-throughput translational metabolomics workflow, to verify biomarker potential in the Screening-for-Pregnancy-Endpoints (SCOPE, European branch) study. A variable pre-selection step was followed by the development of multivariable prediction models for pre-defined clinical use cases, i.e., prediction of preterm preeclampsia risk and of any preeclampsia risk. Within a large set of metabolite biomarker candidates, we confirmed the potential of dilinoleoyl-glycerol and heptadecanoyl-2-hydroxy-sn-glycero-3-phosphocholine to effectively complement Placental Growth Factor, an established preeclampsia biomarker, for the prediction of preeclampsia risk in first-time pregnancies without overt risk factors. These metabolites will be considered for integration in a prototype rapid, quantitative LC-MS/MS assay, and subsequent validation in an independent cohort.

Introduction

Preeclampsia remains a leading cause of maternal death throughout the world and is responsible for considerable neonatal morbidity and mortality [1]. Management of preeclampsia risk throughout pregnancy therefore remains a key aspect of prenatal care worldwide. The accurate prediction of preeclampsia risk early in pregnancy has been flagged as a research priority in many clinical guidelines [2, 3] as it would enable risk-based prenatal care pathways, and hence more effective utilisation of prenatal care resources. The possible patient benefits of accurate preeclampsia risk prediction have recently been reaffirmed in the ASPRE trial, which reported that aspirin prophylaxis in women identified to be at risk of preeclampsia before 37 weeks of gestation, so-called preterm preeclampsia, reduced the incidence rate of preterm preeclampsia by 62% [4].

The National Institute for Health and Clinical Excellence (NICE) in England and the American College of Obstetricians and Gynecologists (ACOG) in the United States recommend the use of maternal demographic, obstetrical history and overt medical risk factors in simple dichotomous classifications to determine low or high risk status for the development of preeclampsia [5, 6]. However, the prediction accuracy of such approaches is limited. Using the NICE guidelines, sensitivity of 39% for preterm preeclampsia and 34% for term preeclampsia at 10.3% false positive rate (FPR) were reported; the corresponding sensitivity using the ACOG recommendations were 90% and 89%, but at 64.3% FPR [5, 7, 8]. This led clinical researchers to develop multivariable models which utilize these clinical risk factors to compute risk scores, as recently reviewed by Brunelli et al [9]. Several of these were subjected to external validation in two recent Dutch studies [10, 11], showing such models do have some moderate risk prediction ability, with some likely to outperform clinical guidelines [10]. However, these studies also re-iterated that the predictive performance decreased significantly in first-time pregnant women. Myers et al. further corroborated this finding by showing that in a population of low risk nulliparous women, detection rates for preterm preeclampsia were only 16.1%, 26.5% and 22.2% for respectively the NICE classifier [5], the maternal risk based competing risk model underpinning the classifier used in the Combined Multimarker Screening and Randomized Patient Treatment with Aspirin for Evidence-Based Preeclampsia Prevention (ASPRE) trial [12], and an alternative risk scoring method as proposed by Sovio et al [13, 14].

The need for novel biomarkers to improve preeclampsia prediction in nulliparous women without apparent risk factor is further emphasized by the fact that nulliparity is associated with increased risk (RR = 2.1 (1.9 to 2.4)) and accounts for the largest single population attributable fraction (32.3%) for preeclampsia [15].

To date, the most studied biomarker in preeclampsia is Placental Growth Factor (PlGF), the levels of which tend to drop in a sub-group of women destined to develop preeclampsia [16], and which has some demonstrated risk prediction potential [17]. Its use, in combination with maternal characteristics, medical history, obstetric history, blood pressure and, where available, uterine artery doppler measurements, is gaining acceptance for prediction of preterm preeclampsia risk in the general pregnancy population [18]. Yet additional biomarkers are still required to complement PlGF to improve preeclampsia risk prediction in nulliparous women without apparent risk factors.

The aim of this work was to inform the development of a novel biomarker-assisted test for the early and accurate prediction of preeclampsia risk in low-risk nulliparous women. With preeclampsia recognised as being a syndromic condition, accurate prediction of preeclampsia will require for several biomarkers to account for different preeclampsia subtypes and/or patient risk profiles [1921]. Because liquid chromatography-triple quadrupole mass spectrometry (LC-QqQ-MS) is a well-established analytic technique used in clinical laboratories worldwide for multiplex metabolite analysis, such as neonatal screening for inborn errors of metabolism [22], we set metabolite “assay-ability” by LC-QqQ-MS as a stage-gate biomarker selection criterion. This will ensure that any biomarker panel identified will be easily portable to in vitro diagnostic workflows already operated in clinical laboratories.

We previously reported a metabolomic biomarker discovery study for early pregnancy prediction of later preeclampsia [23]. Building on these results (and those of others; S1 File & S1 Table), we set out to consolidate a panel of metabolite biomarkers which could be used in conjunction with PlGF to deliver accurate preeclampsia prediction in nulliparous women.

Firstly we developed a translational research workflow based on LC-QqQ-MS based metabolite quantification; only candidate biomarkers amenable to this workflow were considered for further analysis in a case-control study. Biomarkers with univariable prediction merits were pre-selected for the development of risk predictor models. Models were evaluated in function of two pre-defined clinical use scenarios: (1) identify women at risk of developing preterm preeclampsia (primary objective), and (2) identify women at risk of developing preeclampsia at any stage of the pregnancy (secondary objective). We found that combining dilinoleoyl-glycerol (DLG) with PlGF effectively predicted increased preterm preeclampsia risk at ca. 15 weeks of gestation. The further addition of heptadecanoyl-2-hydroxy-sn-glycero-3-phosphocholine (1-HGP) expanded the capacity to also identify pregnant women at decreased risk of developing any form of preeclampsia. PlGF, DLG and 1-HGP were therefore proposed for progression to the final development stage of a risk prediction test for (preterm) preeclampsia and subsequent validation in the IMproved Pregnancy Outcomes by Early Detection (IMPROvED) study [24].

Materials and methods

Study design

Previously reported metabolomic biomarkers discovered in plasma samples from participants of the New Zealand and Australian Cohort of the Screening for Pregnancy Endpoints (SCOPE) study were considered [23]. A curation was performed to address any metabolite identification uncertainty, followed by a pragmatic purging of metabolites without readily available reference materials. The resulting metabolite candidates were selected for LC-MS/MS assay development. Upon establishment of the Analytical Workflow (see below), the selection was supplemented with some additional putative metabolite biomarkers as reported by others; plausibility, ready availability of reference materials, and workflow compatibility were considered (S1 File & S1 Table). The resulting panel of putative metabolite biomarkers was then further assessed for its potential to meet pre-defined clinical use cases in a case-control study (see below).

Study population

All samples were obtained from participants in the European centres of the SCOPE study (Cork, Ireland; Leeds, London and Manchester, UK) between November 2004 and August 2008. Blood samples were prospectively collected from low-risk nulliparous women between 14 weeks and zero days and 16 weeks and six days gestation (or 15±1 week). The diagnosis of preeclampsia was made at any stage during pregnancy after recruitment until delivery, or in the first 2 weeks postpartum.

Preeclampsia was defined according to the International Society for the study of Hypertension in Pregnancy (ISSHP) [25] (S2 File). Clinical data on known preeclampsia risk factors were collected at 15±1 and 20±1 weeks of gestation by interview and examination of the women. Ultrasound data were obtained at 20 weeks on fetal measurements, anatomy, uterine and umbilical artery Doppler, and cervical length. Fetal growth, uterine and umbilical Dopplers were measured at 24 weeks. Pregnancy outcome was tracked and each woman seen within 48 hours of delivery at which stage new-born measurements were obtained [26]. Customised birthweight centiles were based on the UK customised centiles, adjustments were made for maternal height, weight at 15±1 weeks visit, ethnicity, sex and weight of the new-born and gestation at delivery [27].

Inclusion and exclusion criteria.

The inclusion criteria were nulliparity, singleton pregnancy, gestational age between 14 weeks and zero days and 16 weeks and six days, and informed consent to participate. The exclusion criteria applied included: i) uncertainty of last menstrual period (LMP) and unwillingness to have an ultrasound scan at ≤ 20 weeks’ gestation; ii) known major fetal anomaly or abnormal karyotype; iii) underlying medical conditions (essential hypertension treated pre-pregnancy, moderate-severe hypertension at booking [≥160/100 mmHg], diabetes, renal disease, systemic lupus erythematosus, anti-phospholipid syndrome, sickle cell disease, HIV positive), previous knife cone biopsy, ≥3 miscarriages or ≥3 terminations, current ruptured membranes, major uterine anomaly, cervical suture; and iv) treatment with: long term steroids, low-dose aspirin, calcium (>1 g/24h), eicosopentaenoic acid, vitamin C ≥1000 mg, vitamin E ≥ 400 IU, or low molecular weight heparin.

Ethical considerations.

Ethics approval was gained from local ethics committees of each participating centre (Manchester, Leeds, and London 06/MRE01/98, Cork ECM5 (10) 05/02/08) and written informed consent was obtained from all participants. Collection of data and biological samples complied with standardised procedures in all participating centres and was conducted in accordance with the principles of the Declaration of Helsinki.

Case-control study.

Biobanked EDTA plasma samples from all participants with a confirmed pregnancy outcome of the European branch of SCOPE were available. Within the n = 2364 cohort of pregnant women, 97 developed preeclampsia and 2266 did not develop preeclampsia. EDTA plasma samples from the 97 preeclampsia case patients and 335 randomly selected non-preeclampsia control patients were considered for analysis in the case-control study. The demographic and clinical characteristics of the control population selected for the study were compared pairwise and the lack of significant bias was verified (p<0.01, multiple testing correction, Chi square, Mann Whitney U test, Kruskal-Wallis test and Spearman correlation test as applicable).

Clinical use cases

In consultation with a panel of clinicians, two relevant clinical use scenarios were established for stratifying nulliparous pregnant women without overt risk factors to their preeclampsia risk. These translated to three performance criteria for eventual predictor models relevant to the intended use population: (1) a rule-in classification to identify women at high risk of developing preterm preeclampsia (risk ≥ 5%, Positive Predictive Value (PPV) ≥0.05); (2a) a rule-in classification identifying women at high risk of developing preeclampsia at any stage of the pregnancy (risk ≥15%, PPV≥0,15); and (2b) a rule-out classification identifying women at low risk of developing preeclampsia at any stage of the pregnancy (risk ≤1%, Negative Predictive Value (NPV) ≥0.99). Given that the target pregnancy population constitutes healthy first-time pregnant women, the comparator for the different classifications was defined as prediction models constituting any of the following established predictors: PlGF, body mass index (BMI) and Mean Arterial Pressure (MAP): the second set of blood pressure measurements was used to calculate MAP, as reported earlier [28].

Reagents and instrumentation

Chemicals and reagents used were of high-performance liquid chromatography (HPLC) and mass spectrometry (MS) grade or higher (Fischer Scientific, Blanchardstown, Ireland). Metabolite reference substances and stable isotope-labelled standards were purchased from Fluka (Arklow, Ireland), Fischer Scientific (Blanchardstown, Ireland), IsoSciences (King of Prussia, PA, USA), Sigma-Aldrich (Wicklow, Ireland), Avanti Lipids (Alabaster, Alabama, USA), QMX Laboratories (Thaxted, UK), LGC (Teddington, U.K), Alfa Chemistry (Holtsville, NY, USA), Generon (Maidenhead, UK), Larodan (Solna, Sweden) and R&D Systems (Abingdon, UK).

For sample preparation, a liquid handling robot, equipped with a 96 LT disposable Tip Head, an orbital shaker station and a Peltier Thermal Station, was used (Agilent Bravo Automated Liquid Handling Platform, Agilent Technologies, Santa Clara, CA, USA).

Targeted metabolite LC-MS/MS analysis was performed using a 1260 Infinity LC system (Agilent Technologies, Waldbronn, Germany) coupled to an Agilent Triple Quadrupole 6460 mass spectrometer (QqQ-MS) equipped with a JetStream Electrospray Ionisation (ESI) source (Agilent Technologies, Santa Clara, CA, USA).

Analytical workflow

An analytical workflow which complied with pre-defined requirements (outlined in S3 File) was developed. A library of targeted LC-MS/MS assays, based on Multiple Reaction Monitoring (MRM), was established for the pre-selected metabolites and, if commercially available, corresponding stable-isotope labelled metabolite internal standards (SIL-IS). The panel of metabolites and SIL-IS were distributed over two multi-analyte LC-MS/MS methods. These featured two complementary chromatographic separations, i.e., Reversed Phase Liquid Chromatography (RPLC) and Hydrophilic Interaction Liquid Chromatography (HILIC). For RPLC, Zorbax Eclipse Plus C18 Rapid Resolution HD 2.1mm x 50mm, 1.8-Micron (P.N. 959757, Agilent Technologies) columns were used, and for HILIC, Ascentis Express HILIC 15cm x 2.1mm, 2.7 Micron (P.N. 53946-U, Sigma-Aldrich) columns. Both chromatographic methods used 10-minute gradient elution programs and solvent systems enabling direct hyphenation with ElectroSpray Ionisation (ESI)-MS detection. ESI polarity switching was applied in function of metabolite ionisation characteristics. Mass spectrometry instrument parameters were optimised, and LC-MRM assay parameters established for all metabolites and SIL-IS. Further details on the assays and LC-MRM parameters are available in S4 File and S2, S3 Tables respectively.

Sample analysis

Clinical samples (40 μL), calibrators and Quality Control samples (QCs) were re-configured in analytical batches of 96 samples. The positions of Calibrators (n = 8), Analytical QCs (2*3), and study pool QCs (n = 9) were kept identical across batches. Fifteen percent of clinical samples were selected for duplicate analysis. The samples, inclusive the duplicate samples, were randomised for the analytical process using stratified randomisation over clinical centre, ethnicity, and preeclampsia. The absence of potential sources of experimentally induced bias was confirmed by computing pairwise dependencies between the randomisation outputs (selection, batch, order) and clinical parameters; no significant associations were found. Further information on the study and sample preparation is given in S5 File and S4, S5 Tables.

All batches were first analysed by RPLC-MS/MS and then by HILIC-MS/MS. Following mass spectrometric analysis, the mass spectrometric signals of all measured quantifier and qualifier transitions of the 54 assay-able metabolites and 38 SIL-IS were quantified using a pre-defined quantification method compiled in Masshunter Quant Software vB.07.00 (Agilent Technologies, Santa Clare, CA, USA) across all the samples analysed in the study. All data were then reviewed by two independent analysts and any erroneous signal integration calls made by the software curated; all manual curation was recorded for data integrity purposes.

PlGF was analysed earlier as part of a large-scale assessment of putative protein biomarkers within the SCOPE study using a Luminex Sandwich assay [28]. The latter data were made available by the SCOPE consortium for this study.

Data pre-processing and quality assurance

All laboratory personnel were blinded to sample status (case or control) at all stages of the study. Structured review of the calibrator signal data and signal data across all sample types was performed to confirm metabolite quantifier transition selection, absence of interference in the SIL-IS transitions, and final metabolite quantification metric. Next, pairwise dependencies between metabolite quantification metrics and recorded experimental variables were computed using the appropriate statistical tests; no aberrant correlations were found other than some minor inter-day batch effects in some of the quantifications. For the metabolite quantifications exhibiting batch-to-batch differences, the relative concentrations were scaled per batch using the ratio of the median concentration for the given batch over the overall median concentration (S6 Table).

Data missingness and imprecision criteria were assessed: data missingness for a given metabolite quantification should be < 20% across all clinical samples, with the exception of cotinine, a reporter metabolite for smoking status. Two imprecision metrics, expressed as coefficient of variance (CV), were calculated: 1) for the replicate study-QC pool samples across all batches and 2) for the 15% technical duplicates (randomly distributed across all samples). Metabolites were selected when %CV ≤ 25% for both metrics. Summary of the assay selection for biomarker analyses based on quality assurance evaluation is provided in S6 Table.

Statistical analysis

Statistical analyses were performed using the statistical software R version 3.5 [29].

Predictor selection.

In a first phase, variables were evaluated based on their stand-alone predictive performance for preterm preeclampsia (<37 weeks of gestation), term preeclampsia (> = 37 weeks of gestation) and preeclampsia. Variables considered were: all analytes as well as the established risk factors for preeclampsia, blood pressure (MAP) and BMI. The discriminative performance of each individual variable was quantified using the area under the receiver operating curve (AUROC) [30]. Variables with a lower limit of the 95% confidence interval of AUROC greater or equal to 0.50 (p≤0.05) and AUROC greater than 0.60 were selected as potential predictive markers for preeclampsia. In addition, false discovery rates (FDR) were evaluated across the outcomes using label permutation as described by Storey and Tibshirani using a conservative value for the proportion of truly null values, π0, of 1 and 2 x 104 permutations [31].

Modelling.

The concentrations and relative concentrations of analytes were log-transformed before any modelling. Analysis was performed on complete cases.

First, multivariable models were developed for the outcome ‘any preeclampsia’ using partial least squares–discriminant analysis (PLS-DA) [32]. Comparator models based on any combination of PlGF, MAP and BMI were generated and evaluated in view of the clinical use cases defined (S7 Table). Then, PLS-DA models for all preeclampsia were generated for all combinations of PlGF, DLG and 1-HGP, followed by their evaluation. Secondly, recursive partitioning was applied [33, 34] as an approximation for a Bayesian approach. Models were trained for each of the two outcomes with all combinations of one to three of the preselected predictors. Two to three partitions were made. PlGF was imposed as the first partition step. One to two predictors per step were allowed. When two predictors were used in a partition, these were combined using PLS-DA. To bias these PLS-DA models on non-placental preeclampsia, they were trained on patients with high PlGF, defined as a PlGF concentration higher or equal to the concentration corresponding to the observed maximum accuracy for the prediction of any preeclampsia. Again, comparator models using PlGF, MAP and BMI were generated (Table 3 and S7 Table) as well as partitioning models based on combinations of PlGF, DLG and 1-HGP.

All models were evaluated for the clinical use cases defined. For all models, cut-off values for concentrations and scores were selected based on the rule-in PPV and rule-out NPV criteria. PPV, NPV, sensitivity and specificity, and their respective 95% confidence intervals were estimated at the given cut-offs using bootstrapping. For each model, the superiority of the rule-in sensitivity and rule-out superiority as compared to reference models was computed by estimating a difference in sensitivity or specificity using bootstrapping and paired T test (2,000 replicates, one-tailed test, Bonferroni correction for multiple testing, p<0.05). The reference models were the single marker PlGF, the linear model PlGF+DLG and the recursive partitioning models PlGF||DLG and PlGF||MAP||BMI respectively.

Results

Study population

A nested case-control study (n = 432) was performed within the 2364 women recruited into the European SCOPE cohort, for whom pregnancy outcomes were known. Twenty-three women developed preterm preeclampsia (1%) and seventy-four (4%) developed term preeclampsia. Background characteristics and outcomes of pregnancy in women who did and did not develop preeclampsia are shown in Table 1. Mean age, and gestational age at sampling did not differ significantly among the groups. Significant differences are observed for BMI and blood pressure at sampling. Gestational age at delivery was lower in preeclampsia cases compared with controls (no preeclampsia). Likewise, the babies born to preeclamptic women were significantly lighter than the babies in the control group.

thumbnail
Table 1. Baseline characteristics of the study population.

https://doi.org/10.1371/journal.pone.0244369.t001

Metabolite selection

Initially, 58 previously identified putative metabolite biomarkers were selected as inputs for this translational research; metabolites without ready-accessible reference materials available were excluded, except for sphinganine-1-phosphate for which assay parameters could be inferred from sphingosine-1-phosphate, leaving fifty-two metabolites for assay development. An additional set of 20 putative metabolite biomarkers from other sources (S1 Table), deemed compatible with the analytical workflow and with reference materials available, were chosen for assay development. Eighteen metabolites were lost as they were found to be “non-assayable” with the analytical workflow developed for this translational work.

From the fifty-four (54) metabolites analysed in the case-control study, forty-two complied with the pre-set quality assurance criteria. Two exceptions were allowed, 25-Hydroxyvitamin D3 and Eicosapentaenoic acid, which missed the criterion in one of the two types of QC samples considered. One assay was removed due to being non-specific: the signal constituted contributions of 2-methylglutaric acid, glutamine and an unknown metabolite. Also, one opportunistic marker was assessed: there were no detectable levels for 1,2-Dioctanoyl-sn-glycero-3-phosphocholine, yet the same assay delivered a consistent signal at a slightly different retention time. Comparison with reference materials confirmed this compound to be 1-heptadecanoyl-glycero-3-phosphocholine, the latter was therefore analysed. This resulted in data for forty-three metabolites being progressed to biomarker evaluation (S6 Table).

Predictor selection

Biomarkers and biometric variables selected based on their stand-alone prediction performance of preterm, term or any preeclampsia are shown in Table 2. Mean Arterial Pressure (MAP) showed significant discriminative performance for term and all preeclampsia (AUROC = 0.67 and 0.69 respectively). BMI delivered similar discrimination for preterm, term and all preeclampsia (AUROC = 0.63 and 0.65 respectively). DLG and PlGF stand-alone prediction performances were higher for preterm preeclampsia (AUROC = 0.70 and 0.73 respectively). 1-HGP showed similar discriminative performance for both preterm and term preeclampsia (AUC = 0.61) but this performance was only significantly superior to 0.50 for term preeclampsia (p<0.05). With high FDR associated with the predictor selections for preterm preeclampsia and term preeclampsia, only the predictors as selected for preeclampsia were considered as variables for modelling.

thumbnail
Table 2. Selection of predictors for multivariable modelling.

https://doi.org/10.1371/journal.pone.0244369.t002

Modelling

Model development was targeted to answer two pre-set outcome based clinical use scenarios (preterm preeclampsia and any preeclampsia), and three associated minimal performance requirements, expressed as Positive and Negative Predictive Value thresholds (PPV and NPV, as detailed in Methods–Clinical use cases). The multivariable models developed within this framework are shown in Table 3; the comparator models based on the classic predictors MAP, BMI and PlGF are available in S7 Table. For the primary objective, i.e., the detection of women at increased risk for preterm preeclampsia at a pre-set PPV cut-off of ≥ 0.05, the observed sensitivity using only PlGF was 48% (PPV = 0.05), and up to 61% for the comparator models combining PlGF with MAP and/or BMI. Combining PlGF with DLG by means of recursive partitioning increased the sensitivity significantly to 74% (PPV = 0.06). The resulting partitioning rule-in model (PlGF || DLG) is shown in Fig 1. Predictor cut-off values in each partition step were 0.00526 ng/mL and 2.26 relative concentration (RC) for PlGF and DLG respectively. By combining PlGF with a two-predictor partial least squares discriminant analysis (PLS-DA) model constituting DLG and 1-HGP (PlGF || (DLG+1-HGP)), the sensitivity could be increased further to 78% (PPV = 0.05; S1 Fig).

thumbnail
Fig 1. Partitioning rule-in model (PlGF || DLG).

(A) Partition 1: PlGF concentration (ng/mL) versus clinical outcome PlGF cut-off value = 0.00526 (dotted line). (B) Partition 2: DLG relative concentration versus clinical outcome for patients ruled-out in partition 1. DLG cut-off value = 2.26 (dotted line). (C) Partitions 1 and 2: DLG relative concentration versus PlGF concentration (red stars: preterm preeclampsia, orange triangles: term preeclampsia, blue circles: no preeclampsia). Dotted line: DLG and PlGF cut-off values. (D) Estimated predictive performance of the model for 10,000 patients.

https://doi.org/10.1371/journal.pone.0244369.g001

thumbnail
Table 3. Prediction models for the pre-set clinical use scenarios.

https://doi.org/10.1371/journal.pone.0244369.t003

With regards to predicting increased risk for any type of preeclampsia at a pre-set PPV cut-off of ≥ 0.15 (secondary objective), comprehensive analysis of the generated prediction models revealed that no classifier compliant with the PPV≥0.15 requirement could be identified.

In models developed to meet the “rule-out” performance criteria (Table 3), specificity at the target NPV≥0.99 for preeclampsia improved from 0.02 (PlGF only) to 0.37 when combining PlGF, DLG and 1-HGP predictors using recursive partitioning. The resulting partitioning rule-out model (PlGF || DLG || 1-HGP) and the estimated predictive performance are shown in Fig 2. Predictor cut-off values in each partition step were 0.00702 ng/mL, 1.12 RC and 0.458 RC for PlGF, DLG and 1-HGP respectively. This model compares favourably to the comparator models combining PlGF with MAP and/or BMI; the best comparator model, i.e., the recursive partitioning model PlGF || BMI || MAP delivers a rule-out specificity of 0.32.

thumbnail
Fig 2. Partitioning rule-out model (PlGF || DLG || 1-HGP).

(A) Partition 1: PlGF (ng/mL) versus clinical outcome. PlGF cut-off value = 0.00702 (dotted line). (B) Partition 2: DLG relative concentration vs clinical outcome for patients ruled-out in partition 1. DLG cut-off value = 1.12 (dotted line). (C) Partition 3: 1-HGP relative concentration versus clinical outcome for patients ruled-out in partitions 1 and 2. 1-HGP cut-off value = 0.458 (dotted line). (D) Estimated predictive performance of the model for 10,000 patients.

https://doi.org/10.1371/journal.pone.0244369.g002

Discussion

In this study we re-evaluated the relevance of a set of putative metabolite biomarkers to further inform the development of a test to predict preeclampsia in nulliparous women without apparent risk factors. Upon application of both technical assay-ability and data quality assurance criteria, forty-three metabolites, PlGF and the biometric variables MAP and BMI, well-known to associate with preeclampsia, were retained as predictors for consideration.

In line with the findings that placental pathology is more common in preterm preeclampsia [35], we adopted the hypothesis that within the group of women who developed preterm preeclampsia, there would be a greater prevalence of preeclampsia associated with placental insufficiency, whereas the group of women developing term preeclampsia would be more reflective of preeclampsia of maternal origin [36]. Hence, in addition to the outcome preeclampsia, we considered the outcomes preterm and term preeclampsia as two disease subtypes in the process of pre-selecting variables.

This led to an initial selection of twelve predictors, comprising the clinical risk factors relevant in the low-risk population studied (e.g., MAP and BMI), PlGF and nine metabolites from the original set of forty-three quantified metabolites. For all predictors but BMI, the single variables showed discriminative performance which aligned with the prediction of either preterm preeclampsia or term preeclampsia. This observation supports the assumption that in this study population the two disease subtypes considered do indeed align well with distinct underlying physiological pathways. Interestingly, we note that in this study population, MAP is only a stand-alone predictor for term preeclampsia and not for preterm preeclampsia, whereas typically MAP is reported to be a strong stand-alone predictor for preterm preeclampsia [37]. With high FDR associated with the predictors selected for preterm and term preeclampsia, we restricted the final predictor selection for modelling to these predictors which showed performances when assessed for all preeclampsia prediction, i.e., the biometric predictors MAP and BMI and the biomarkers PlGF, DLG and 1-HGP.

Consultation with a panel of clinicians (IMPROvED Consortium meeting, London 2018; see also Acknowledgements) established two relevant clinical use scenarios for stratifying nulliparous pregnant women without overt risk factors to their preeclampsia risk. The primary clinical use scenario was a rule-in classification to identify women at high risk of developing preterm preeclampsia. The secondary clinical use scenario was delivering the same preeclampsia risk information to nulliparous pregnant women without overt risk factors, as the risk information available to parous women based on their obstetrics history [38].

In risk stratification, the clinical usefulness of a test is best expressed in terms of positive and negative predictive values [38]. Hence, to establish robust performance targets for the prognostic test(s) for the identified clinical use scenarios, we derived these risk probabilities from published large clinical studies reporting risk probabilities for well-powered population studies. The ASPRE study, involving a cohort of 25,797 pregnancies with mixed prior risk profiles and parity who were screened for preterm preeclampsia, provided a rule-in classification threshold of PPV ≥ 0.05 [39]. The population-based study of Hernandez-Diaz included data from 504,849 parous pregnancies. These authors reported a preeclampsia risk of 14.7% in the second pregnancy for women with a history of preeclampsia, whereas the risk of preeclampsia for parous women without a history of preeclampsia was 1.1% [40].

Considering these “target” inputs led to the establishment of a set of hierarchical goals for the development of predictive models for preeclampsia in nulliparous women without apparent risk factors. The primary goal was defined as the identification of pregnant women at increased risk for preterm preeclampsia with a post-test risk ≥ 0.05 (or PPV ≥ 0.05). Secondary to this, the establishment of generic risk for developing preeclampsia at any stage of pregnancy. For the latter, both the identification of women at high risk, defined as a post-test risk ≥ 15% (PPV ≥ 0.15), and the identification of women at low risk, defined as a post-test risk ≤ 1% (NPV ≥ 0.99), were considered of interest to clinical practice.

Among all preeclampsia biomarkers studied, PlGF is the best understood. Low PlGF levels throughout pregnancy are associated with a disease phenotype which has placental insufficiency as a key characteristic [16, 4144]. Indeed, it has been shown that low PlGF levels early in pregnancy has some preeclampsia risk prediction merits, especially for preterm preeclampsia wherein placental compromise is more common [16].

Given the multi-factorial nature of preeclampsia, a Bayesian modelling approach may deliver more accurate predictive models than PLS-DA [12, 45]. However, the available number of patients prevented calibration and therefore the use of probabilistic methods. For this reason, recursive partitioning was considered as an alternative as it does not necessitate calibration. In the absence of calibration, generalisability of the models developed cannot be gauged in this study; this will be assessed in a readily available independent cohort [24].

We indeed found that recursive partitioning delivered better prediction than PLS-DA models. By establishing PlGF as the first independent predictor, the recursive partitioning modelling allowed us to align the model development with the pre-defined classification objectives. We found that complementing PlGF with a single metabolite biomarker (DLG) increased the sensitivity of the test from 48% (at PPV = 0.05) to 74% (at PPV = 0.06) for predicting preterm preeclampsia risk in nulliparous women without overt risk factors. Preliminary results show combining 1-HGP with DLG in the second partition may further improve the prediction of preterm preeclampsia, increasing the sensitivity to 78%.

Developing recursive partitioning models with three splits suggested that 1-HGP may also be a third independent predictor. Adding 1-HGP enabled identification of significant fraction of women at low risk of developing preeclampsia (specificity = 36%) in accordance with the pre-set rule-out target of NPV = 0.99.

In this data set we were unable to establish a prediction model which also complied with the other secondary goal: the identification of a sizeable group of women with a post-test risk ≥ 15% of developing any type of preeclampsia in their pregnancy. This may be explained in the context of the competing risk model concept as established for preeclampsia by Wright et al. In this model, pregnant women at risk of developing preeclampsia may experience an uncomplicated pregnancy, as their pregnancy (naturally) concluded prior to their preeclampsia risk coming to expression [46].

It is however noted that the list of putative biomarkers considered here was primarily informed by our earlier work [23] and from findings other groups around the same time (S1 Table). Additional putative metabolite biomarkers are still being identified in de-novo metabolomics biomarker studies within other pregnancy demographics [4750]. Evaluation of these metabolites within the technical and clinical use framework established here, may lead to further prediction improvements and achieving the secondary goal in full.

A review of the literature reveals that DLG and 1-HGP may map onto different but complementary pathways relative to PlGF. Genetic studies have provided new insights into the mechanisms that link intracellular diacylglycerol concentrations to insulin resistance [51, 52], which associates with preeclampsia risk [53]. Erion & Shulman reported that increases in intracellular diacylglycerol content could lead to activation of new protein kinase C which in turn, inhibits insulin action in liver and skeletal muscle [54]. Diacylglycerols in plasma were reported as the basis of a biomarker profile of metabolic syndrome onset in rhesus monkeys; diacylglycerol-derived linoleate levels were markedly upregulated in insulin-resistant metabolic syndrome animals [55]. The physiological metabolic alterations occurring in normal pregnancy: transient excursion into insulin resistance, hyperlipidemia, and increased coagulation are essentially the hallmarks of metabolic syndrome, and are exacerbated in preeclampsia [56, 57]. With the metabolic syndrome manifesting in women with preeclampsia typically associated with insulin resistance and endothelial dysfunction [58], it is therefore plausible that DLG levels reflect risk pathway for the development of preeclampsia that is associated with a pregnancy-specific disposition for metabolic syndrome [56]. With reference to 1-HGP, previous studies have shown that lysophosphatidic acid (LPA), the hydrolysed form of 1-HGP, is a potent mediator of the immune response and could contribute to improper immune activation upregulating the production of inflammatory cytokines [59, 60]. Studies in humans and animal models have indicated that the development of hypertension in preeclampsia has a strong pro-inflammatory component and that placental ischemia is the stimulus for this immune activation [6164]. In this context, 1-HGP may be related to vascular inflammation and dysfunction. Recently, Fujii et al. reported that LPA signalling may be directly involved in placental homeostasis. They found that dysregulation of LPA signalling as mediated by LPA specific G-protein-coupled receptors (LPAR), and more specifically LPAR3, may be associated with placental dysfunction in preeclampsia [65]. Circulating 1-HGP levels may therefore be indicate LPA signalling issues which in turn could be directly or indirectly be associated with the risk of developing preeclampsia.

Based on the data generated in this study, DLG and 1-HGP are selected as the key markers for the development of a dedicated, rapid, quantitative LC-MS/MS assay prototype.

Conclusions

In this study, we adopted an end-user focused translational research methodology for the prioritization of putative metabolite biomarkers for further development into a clinical test for preeclampsia risk prediction. Three key determinants were considered in the selection process: compatibility with LC-MS/MS technology already available in clinical laboratories, ability to improve the prediction of the established preeclampsia biomarker PlGF, and ability to meet patient stratification requirements as identified by clinical practitioners.

Using this translational research framework to re-evaluate fifty-eight metabolite biomarker candidates, we were able to prioritise two metabolite biomarkers from an initial pre-selection of nine metabolites, for development of a clinical assay. We found that the metabolites DLG and 1-HGP effectively complemented PlGF in a prediction model for (preterm) preeclampsia in nulliparous women without over risk factors. A review of the literature supports that PlGF, DLG and 1-HGP may represent separate pathways for preeclampsia risk in the population studied.

A strength of this study lies in the well-defined pregnancy risk profile within the SCOPE study, allowing us to focus this translation biomarker research to the pregnancy population most in need for biomarker-assisted risk prediction. In addition, a rational approach considering both technical usability and clinical utility criteria for refining the selection of previously identified putative biomarkers of interest for further test development, was adopted to increase the chance of successfully porting novel biomarkers into clinical practice.

A limitation of this work lies within the ethnic make-up of the SCOPE-Europe study; most of the women were of white ethnicity. In line with the hypothesis that different pregnancy populations may constitute different patient risk profiles, there may be a need for additional biomarkers, representing additional preeclampsia risk pathways, to improve prediction for other ethnicities. Another limitation of this study is the gestational age considered; risk prediction involved samples taken early in the second trimester of pregnancy (15 +/- 1 week of gestation), whereas there is trend to consolidate prenatal risk screening at the end of the first trimester. However, we note that none of the verified metabolite biomarkers show any dependency on gestational age of sampling (S2 Fig).

The next steps in our test development work will involve developing a multiplex clinical assay for the selected markers, as well as further assessment of their generalisability to complement PlGF for the prediction in preeclampsia in other pregnancy populations. In a first instance, the markers will be assessed in IMPROvED; a pan-European multi-centre phase 2A clinical study which recruited ca 4000 low risk primiparous women for the purposes of assessing and refining innovative biomarker-assisted prototype predictive tests [24].

Supporting information

S1 File. Metabolite input selection process.

https://doi.org/10.1371/journal.pone.0244369.s001

(DOCX)

S3 File. Analytical workflow requirements.

https://doi.org/10.1371/journal.pone.0244369.s003

(DOCX)

S5 File. Experimental details of case-control study.

https://doi.org/10.1371/journal.pone.0244369.s005

(DOCX)

S2 Table. LC-MRM parameters and instrument specific ionization source settings for the hydrophobic metabolites and associated SIL-IS.

https://doi.org/10.1371/journal.pone.0244369.s007

(DOCX)

S3 Table. LC-MRM parameters and instrument specific ionization source settings for the hydrophilic metabolites and associated SIL-IS.

https://doi.org/10.1371/journal.pone.0244369.s008

(DOCX)

S4 Table. Composition and concentrations of fortification spike mixture.

https://doi.org/10.1371/journal.pone.0244369.s009

(DOCX)

S5 Table. Composition and concentrations of SIL-IS mixture.

https://doi.org/10.1371/journal.pone.0244369.s010

(DOCX)

S6 Table. Quantification metric selection and assay selection for biomarker analyses.

https://doi.org/10.1371/journal.pone.0244369.s011

(DOCX)

S7 Table. Comparator predictors for the pre-set clinical use scenarios.

https://doi.org/10.1371/journal.pone.0244369.s012

(DOCX)

S1 Fig. Partitioning rule-in model (PlGF || DLG + 1-HGP).

https://doi.org/10.1371/journal.pone.0244369.s013

(DOCX)

S2 Fig. Biomarker concentrations in function of gestational age at blood sampling.

https://doi.org/10.1371/journal.pone.0244369.s014

(DOCX)

Acknowledgments

The Authors Louise C. Kenny (Louise.Kenny@liverpool.ac.uk), Lucilla Poston, Jenny E. Myers, Nigel A.B. Simpson, Fergus P. McCarthy and Philip N. Baker contributed to this work on behalf of the Screening for Pregnancy Endpoints (SCOPE) Consortium.

The investigators thank the pregnant women who participated in the SCOPE study for their indispensable contribution. Clinicians from the IMPROvED (Improved Pregnancy Outcomes by Early Detection) study who attended the IMPROvED meeting in London (April 2018) are acknowledged for their contribution: Dr. F. McCarthy (Cork University Maternity Hospital, Ireland), Pr. Z. Alfirevic (University of Liverpool, UK), Dr. K. Navaratnam (University of Liverpool, UK), Dr. J.J. Duvekot (Erasmus MC, Netherlands), Pr. S. O’Brien (Keele University, UK) and Dr. P. Wu (Keele University, UK). Paloma Muñiz-Ortea PhD and Caroline Nolan (Metabolomic Diagnostics) are acknowledged for the assistance in the preparation of the study samples; Paloma Muñiz-Ortea for an independent review of LC-MS/MS data. Some writing assistance for the preparation of this manuscript was provided under the direction of the authors by Carmen Romera PhD (Metabolomic Diagnostics).

References

  1. 1. Mol BWJ, Roberts CT, Thangaratinam S, Magee LA, de Groot CJM, Hofmeyr GJ. Pre-eclampsia. Lancet. 2016;387(10022): 999–1011. pmid:26342729
  2. 2. National Institute for Health and Care Excellence. Hypertension in pregnancy: diagnosis and management. [Internet]. [London]: NICE; 2019 [published 2019 Jun; cited 2020 Aug 23] (NICE guideline [NG133]). Available from: https://www.nice.org.uk/guidance/ng133
  3. 3. American College of Obstetricians and Gynecologists. ACOG Practice Bulletin No. 202: Gestational Hypertension and Preeclampsia. Obstet Gynecol. 2019;133(1): e1–25. pmid:30575675
  4. 4. Rolnik DL, Wright D, Poon LC, O’Gorman N, Syngelaki A, de Paco Matallana C, et al. Aspirin versus Placebo in Pregnancies at High Risk for Preterm Preeclampsia. N Engl J Med. 2017;377(7): 613–622. pmid:28657417
  5. 5. National Institute for Health and Care Excellence. Antenatal care for uncomplicated pregnancies [Internet]. [London]: NICE; 2008 [updated 2019 Feb; cited 2020 Aug 23]. (Clinical guideline [CG62]). Available from: https://www.nice.org.uk/guidance/cg62
  6. 6. American College of Obstetricians and Gynecologists. ACOG Committee Opinion No. 743 Summary. Obstet Gynecol. 2018;132(1): 254–256. pmid:29939936
  7. 7. American College of Obstetricians and Gynecologists, Task Force on Hypertension in Pregnancy. Hypertension in Pregnancy. Obstet Gynecol. 2013;122(5): 1122–1131. pmid:24150027
  8. 8. O’Gorman N, Wright D, Poon LC, Rolnik DL, Syngelaki A, de Alvarado M, et al. Multicenter screening for pre-eclampsia by maternal factors and biomarkers at 11–13 weeks’ gestation: comparison with NICE guidelines and ACOG recommendations. Ultrasound Obstet Gynecol. 2017;49(6): 756–760. pmid:28295782
  9. 9. Brunelli VB, Prefumo F. Quality of first trimester risk prediction models for pre-eclampsia: A systematic review. BJOG An Int J Obstet Gynaecol. 2015;122(7): 904–914. pmid:25761437
  10. 10. Meertens LJE, Scheepers HCJ, van Kuijk SMJ, Aardenburg R, van Dooren IMA, Langenveld J, et al. External Validation and Clinical Usefulness of First Trimester Prediction Models for the Risk of Preeclampsia: A Prospective Cohort Study. Fetal Diagn Ther. 2019;45(6): 381–393. pmid:30021205
  11. 11. Lamain-de Ruiter M, Kwee A, Naaktgeboren CA, Louhanepessy RD, De Groot I, Evers IM, et al. External validation of prognostic models for preeclampsia in a Dutch multicenter prospective cohort. Hypertens Pregnancy. 2019;38(2): 78–88. pmid:30892981
  12. 12. Wright D, Syngelaki A, Akolekar R, Poon LC, Nicolaides KH. Competing risks model in screening for preeclampsia by maternal characteristics and medical history. Am J Obstet Gynecol. 2015;213(1): 62.e1–62.e10. pmid:25724400
  13. 13. Sovio U, Smith G. Evaluation of a simple risk score to predict preterm pre-eclampsia using maternal characteristics: a prospective cohort study. BJOG. 2019;126(8): 963–970. pmid:30801934
  14. 14. Myers J. Screening performance of a simple risk score using maternal characteristics for the prediction of preterm preeclampsia in a healthy nulliparous population. Pregnancy Hypertens. 2019;17: S21.
  15. 15. Bartsch E, Medcalf KE, Park AL, Ray JG, High Risk of Pre-eclampsia Identification Group. Clinical risk factors for pre-eclampsia determined in early pregnancy: systematic review and meta-analysis of large cohort studies. BMJ. 2016;353: i1753. pmid:27094586
  16. 16. Powers RW, Roberts JM, Plymire DA, Pucci D, Datwyler SA, Laird DM, et al. Low placental growth factor across pregnancy identifies a subset of women with preterm Preeclampsia type 1 versus type 2 preeclampsia? Hypertension. 2012;60(1): 239–246. pmid:22647886
  17. 17. Agrawal S, Shinar S, Cerdeira AS, Redman C, Vatish M. Predictive Performance of PlGF (Placental Growth Factor) for Screening Preeclampsia in Asymptomatic Women. Hypertension. 2019;74(5): 1124–1135. pmid:31522621
  18. 18. Poon LC, Shennan A, Hyett JA, Kapur A, Hadar E, Divakar H, et al. The International Federation of Gynecology and Obstetrics (FIGO) initiative on pre‐eclampsia: A pragmatic guide for first‐trimester screening and prevention. Int J Gynecol Obstet. 2019;145(S1): 1–33.
  19. 19. Myatt L, Roberts JM. Preeclampsia: Syndrome or Disease? Curr Hypertens Rep. 2015;17(11):83. pmid:26362531
  20. 20. Steegers EA, von Dadelszen P, Duvekot JJ, Pijnenborg R. Pre-eclampsia. Lancet. 2010;376(9741): 631–644. pmid:20598363
  21. 21. Roberts JM, Bell MJ. If we know so much about preeclampsia, why haven’t we cured the disease? J Reprod Immunol. 2013;99(1–2): 1–9. pmid:23890710
  22. 22. Wilcken B, Wiley V, Hammond J, Carpenter K. Screening newborns for inborn errors of metabolism by tandem mass spectrometry. N Engl J Med. 2003;348(23): 2304–2312. pmid:12788994
  23. 23. Kenny LC, Broadhurst DI, Dunn W, Brown M, North R a, L Mccowan, et al. Robust early pregnancy prediction of later preeclampsia using metabolomic biomarkers. Hypertension. 2010;56(4): 741–749. pmid:20837882
  24. 24. Navaratnam K, Alfirevic Z, Baker PN, Gluud C, Grüttner B, Kublickiene K, et al. A multi-centre phase IIa clinical study of predictive testing for preeclampsia: improved pregnancy outcomes via early detection (IMPROvED). BMC Pregnancy Childbirth. 2013;13(1): 226.
  25. 25. Brown MA, Magee LA, Kenny LC, Karumanchi SA, McCarthy FP, Saito S, et al. Hypertensive Disorders of Pregnancy. Hypertension. 2018;72(1): 24–43. pmid:29899139
  26. 26. North RA, McCowan LME, Dekker GA, Poston L, Chan EHY, Stewart AW, et al. Clinical risk prediction for pre-eclampsia in nulliparous women: development of model in international prospective cohort. BMJ. 2011;342: d1875. pmid:21474517
  27. 27. McCowan LME, Roberts CT, Dekker GA, Taylor RS, Chan EHY, Kenny LC, et al. Risk factors for small-for-gestational-age infants by customised birthweight centiles: Data from an international prospective cohort study. BJOG An Int J Obstet Gynaecol. 2010;117(13): 1599–1607. pmid:21078055
  28. 28. Kenny LC, Black MA, Poston L, Taylor R, Myers JE, Baker PN, et al. Early Pregnancy Prediction of Preeclampsia in Nulliparous Women, Combining Clinical Risk and Biomarkers: The Screening for Pregnancy Endpoints (SCOPE) International Cohort Study. Hypertension. 2014;64(3): 644–652. pmid:25122928
  29. 29. R Core Team (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org/.
  30. 30. Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem. 1993;39(4): 561–577. pmid:8472349
  31. 31. Storey JD, Tibshirani R. Statistical significance for genomewide studies. Proc Natl Acad Sci. 2003;100(16): 9440–9445. pmid:12883005
  32. 32. Brereton RG, Lloyd GR. Partial least squares discriminant analysis: taking the magic away. J Chemom. 2014;28(4):213–225.
  33. 33. Devroye L, Györfi L, Lugosi G. A Probabilistic Theory of Pattern Recognition. New York, NY: Springer New York; 1996. (Stochastic Modelling and Applied Probability; vol. 31).
  34. 34. Gayat E, Caillard A, Laribi S, Mueller C, Sadoune M, Seronde M-F, et al. Soluble CD146, a new endothelial biomarker of acutely decompensated heart failure. Int J Cardiol. 2015;199: 241–247. pmid:26209827
  35. 35. Roberts DJ, Post MD. The placenta in pre-eclampsia and intrauterine growth restriction. J Clin Pathol. 2008;61(12): 1254–1260. pmid:18641412
  36. 36. Roberts JM, Hubel CA. The Two Stage Model of Preeclampsia: Variations on the Theme. Placenta. 2009;30: 32–37. pmid:19070896
  37. 37. Akolekar R, Syngelaki A, Poon L, Wright D, Nicolaides KH. Competing Risks Model in Early Screening for Preeclampsia by Biophysical and Biochemical Markers. Fetal Diagn Ther. 2013;33(1): 8–15. pmid:22906914
  38. 38. Thomas G, Kenny LC, Baker PN, Tuytten R. A novel method for interrogating receiver operating characteristic curves for assessing prognostic tests. Diagnostic Progn Res. 2017;1(1): 17. pmid:31093546
  39. 39. Rolnik DL, Wright D, Poon LCY, Syngelaki A, O’Gorman N, de Paco Matallana C, et al. ASPRE trial: performance of screening for preterm pre-eclampsia. Ultrasound Obstet Gynecol. 2017;50(4):492–495. pmid:28741785
  40. 40. Hernandez-Diaz S, Toh S, Cnattingius S. Risk of pre-eclampsia in first and subsequent pregnancies: prospective cohort study. BMJ. 2009;338: b2255. pmid:19541696
  41. 41. Benton SJ, McCowan LM, Heazell AEP, Grynspan D, Hutcheon JA, Senger C, et al. Placental growth factor as a marker of fetal growth restriction caused by placental dysfunction. Placenta. 2016;42: 1–8. pmid:27238707
  42. 42. Ribatti D. The discovery of the placental growth factor and its role in angiogenesis: a historical review. Angiogenesis. 2008;11(3): 215–221. pmid:18568405
  43. 43. Levine RJ, Maynard SE, Qian C, Lim K-H, England LJ, Yu KF, et al. Circulating Angiogenic Factors and the Risk of Preeclampsia. N Engl J Med. 2004;350(7): 672–683. pmid:14764923
  44. 44. Chau K, Hennessy A, Makris A. Placental growth factor and pre-eclampsia. J Hum Hypertens. 2017;31(12): 782–786. pmid:29115294
  45. 45. Considine EC. The Search for Clinically Useful Biomarkers of Complex Disease: A Data Analysis Perspective. Metabolites. 2019;9(7): 126. pmid:31269649
  46. 46. Wright D, Akolekar R, Syngelaki A, Poon LCY, Nicolaides KH. A Competing Risks Model in Early Screening for Preeclampsia. Fetal Diagn Ther. 2012;32(3):171–8. pmid:22846473
  47. 47. Lee SM, Kang Y, Lee EM, Jung YM, Hong S, Park SJ, et al. Metabolomic biomarkers in midtrimester maternal plasma can accurately predict the development of preeclampsia. Sci Rep. 2020;10(1): 1–11. pmid:31913322
  48. 48. Ross KM, Baer RJ, Ryckman K, Feuer SK, Bandoli G, Chambers C, et al. Second trimester inflammatory and metabolic markers in women delivering preterm with and without preeclampsia. J Perinatol. 2019;39(2): 314–320. pmid:30518800
  49. 49. Kyozuka H, Fukuda T, Murata T, Endo Y, Kanno A, Yasuda S, et al. Comprehensive metabolomic analysis of first-trimester serum identifies biomarkers of early-onset hypertensive disorder of pregnancy. Sci Rep. 2020;10(1): 1–9. pmid:32807817
  50. 50. Bahado-Singh R, Poon LC, Yilmaz A, Syngelaki A, Turkoglu O, Kumar P, et al. Integrated Proteomic and Metabolomic prediction of Term Preeclampsia. Sci Rep. 2017;7(1): 1–10. pmid:28127051
  51. 51. Kim JK, Fillmore JJ, Chen Y, Yu C, Moore IK, Pypaert M, et al. Tissue-specific overexpression of lipoprotein lipase causes tissue-specific insulin resistance. Proc Natl Acad Sci. 2001;98(13): 7522–7527. pmid:11390966
  52. 52. Liu L, Zhang Y, Chen N, Shi X, Tsang B, Yu Y-H. Upregulation of myocellular DGAT1 augments triglyceride synthesis in skeletal muscle and protects against fat-induced insulin resistance. J Clin Invest. 2007;117(6): 1679–1689. pmid:17510710
  53. 53. Hauth JC, Clifton RG, Roberts JM, Myatt L, Spong CY, Leveno KJ, et al. Maternal insulin resistance and preeclampsia. Am J Obstet Gynecol. 2011;204(4): 327.e1–6. pmid:21458622
  54. 54. Erion DM, Shulman GI. Diacylglycerol-mediated insulin resistance. Nat Med. 2010;16(4): 400–402. pmid:20376053
  55. 55. Polewski MA, Burhans MS, Zhao M, Colman RJ, Shanmuganayagam D, Lindstrom MJ, et al. Plasma diacylglycerol composition is a biomarker of metabolic syndrome onset in rhesus monkeys. J Lipid Res. 2015;56(8):1461–1470. pmid:26063458
  56. 56. Ness RB, Sibai BM. Shared and disparate components of the pathophysiologies of fetal growth restriction and preeclampsia. Am J Obstet Gynecol. 2006;195(1):40–9. pmid:16813742
  57. 57. Catalano PM. Obesity, insulin resistance, and pregnancy outcome. Reproduction. 2010;140(3):365–371. pmid:20457594
  58. 58. Scioscia M, Karumanchi SA, Goldman-Wohl D, Robillard PY. Endothelial dysfunction and metabolic syndrome in preeclampsia: An alternative viewpoint. J Reprod Immunol. 2015;108: 42–47. pmid:25766966
  59. 59. Yung YC, Stoddard NC, Chun J. LPA receptor signaling: Pharmacology, physiology, and pathophysiology. J Lipid Res. 2014;55(7): 1192–1214. pmid:24643338
  60. 60. North EJ, Osborne DA, Bridson PK, Baker DL, Parrill AL. Autotaxin structure–activity relationships revealed through lysophosphatidylcholine analogs. Bioorg Med Chem. 2009;17(9): 3433–3442. pmid:19345587
  61. 61. LaMarca B, Cornelius D, Wallace K. Elucidating Immune Mechanisms Causing Hypertension During Pregnancy. Physiology. 2013;28(4): 225–233. pmid:23817797
  62. 62. Freeman DJ, McManus F, Brown EA, Cherry L, Norrie J, Ramsay JE, et al. Short- and Long-Term Changes in Plasma Inflammatory Markers Associated With Preeclampsia. Hypertension. 2004;44(5): 708–714. pmid:15452036
  63. 63. Prins JR, Boelens HM, Heimweg J, Van der Heide S, Dubois AE, Van Oosterhout AJ, et al. Preeclampsia is Associated with Lower Percentages of Regulatory T Cells in Maternal Blood. Hypertens Pregnancy. 2009;28(3): 300–311. pmid:19412837
  64. 64. Redman CWG, Sargent IL. Immunology of Pre-Eclampsia. Am J Reprod Immunol. 2010;63(6): 534–543. pmid:20331588
  65. 65. Fujii T, Nagamatsu T, Schust DJ, Ichikawa M, Kumasawa K, Yabe S, et al. Placental expression of lysophosphatidic acid receptors in normal pregnancy and preeclampsia. Am J Reprod Immunol. 2019;82(5): 1–9. pmid:31357233