Skip to main content

Urine NGAL as a biomarker for septic AKI: a critical appraisal of clinical utility—data from the observational FINNAKI study

Abstract

Background

Neutrophil gelatinase-associated lipocalin (NGAL) is released from kidney tubular cells under stress as well as from neutrophils during inflammation. It has been suggested as a biomarker for acute kidney injury (AKI) in critically ill patients with sepsis. To evaluate clinical usefulness of urine NGAL (uNGAL), we post-hoc applied recently introduced statistical methods to a sub-cohort of septic patients from the prospective observational Finnish Acute Kidney Injury (FINNAKI) study. Accordingly, in 484 adult intensive care unit patients with sepsis by Sepsis-3 criteria, we calculated areas under the receiver operating characteristic curves (AUCs) for the first available uNGAL to assess discrimination for four outcomes: AKI defined by Kidney Disease: Improving Global Outcomes (KDIGO) criteria, severe (KDIGO 2–3) AKI, and renal replacement therapy (RRT) during the first 3 days of intensive care, and mortality at day 90. We constructed clinical prediction models for the outcomes and used risk assessment plots and decision curve analysis with predefined threshold probabilities to test whether adding uNGAL to the models improved reclassification or decision making in clinical practice.

Results

Incidences of AKI, severe AKI, RRT, and mortality were 44.8% (217/484), 27.7% (134/484), 9.5% (46/484), and 28.1% (136/484). Corresponding AUCs for uNGAL were 0.690, 0.728, 0.769, and 0.600. Adding uNGAL to the clinical prediction models improved discrimination of AKI, severe AKI, and RRT. However, the net benefits for the new models were only 1.4% (severe AKI and RRT) to 2.5% (AKI), and the number of patients needed to be tested per one extra true-positive varied from 40 (AKI) to 74 (RRT) at the predefined threshold probabilities.

Conclusions

The results of the recommended new statistical methods do not support the use of uNGAL in critically ill septic patients to predict AKI or clinical outcomes.

Background

Neutrophil gelatinase-associated lipocalin (NGAL) has been studied extensively as a biomarker for detection and evolution of acute kidney injury (AKI) as well as outcome [1, 2]. NGAL is a protein first found in neutrophil granules [3], but synthesized in numerous human tissues in addition to kidney epithelium—e.g., respiratory tract, stomach, and colon. All in vivo functions of NGAL are not plausibly unraveled. It increases rapidly in serum and urine not only in conjunction with renal tubular injury, but also in bacterial infections, non-infectious systemic inflammatory response syndrome, and chronic and systemic diseases without bacterial infection [4]. Consequently, inflammation is considered a confounding factor hindering the routine use of NGAL as a biomarker of AKI in intensive care patients with sepsis [5,6,7].

In a recent meta-analysis, urine NGAL (uNGAL) predicted septic AKI with an area under the receiver operating characteristic curve (AUC) of 0.90 [8], but the individual studies were rather small, the sample sizes varying between 45 and 168. Besides, generalizability of the meta-analysis may be questioned since 65% of the sepsis patients were from Asia. Furthermore, currently used statistical methods have several shortcomings: AUCs are not very suitable for evaluating the incremental value of biomarkers [9] or assessing clinical usefulness [10]. Newer reclassification methods may even make useless biomarkers appear applicable [11]. Although there is obvious need for better tools than urine output and serum creatinine for early detection and classification of AKI, the existing data on any kidney injury biomarker for AKI diagnosis, staging, prognosis, or treatment are inadequate [12].

We have previously tested the ability of uNGAL to predict AKI, renal replacement therapy (RRT), and 90-day mortality in a large non-selected cohort of 1042 adult intensive care patients [13]. Patients with sepsis comprised 46% of the study population. In comparison to the previous meta-analysis [8], this is by far the largest cohort of septic patients with uNGAL measurements. Since we did not report the septic patients separately, they could not be included in the meta-analysis [8]. We now extended our analyses to evaluate the usefulness of uNGAL in predicting AKI, RRT, and 90-day mortality in septic patients using more sophisticated statistical methods: risk assessment plot (RAP) [14] and decision curve analysis (DCA) [10]. Accordingly, we tested the hypothesis that uNGAL improves the performance of clinical risk models for AKI, RRT, and 90-day mortality in a homogeneous and clinically important group of critically ill septic patients using these new statistical methods. We are not aware of a similar detailed analysis of uNGAL or its clinical usefulness in the literature.

Methods

Patients

We analyzed the urine of septic patients of this FINNAKI NGAL—substudy [13]. The Ethics Committee of the Department of Surgery in Helsinki University Hospital gave a nationwide approval for the FINNAKI study [15] with a deferred consent policy, confirmed by a written consent from each patient or his/her proxy.

Data

The patients of the original study [13] were prospectively screened for sepsis defined by the American College of Chest Physicians/Society of Critical Care Medicine (ACCP/SCCM) criteria [16]. To increase the generalizability of the results, we now reclassified these patients using the recent Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) criteria [17]. We included patients fulfilling the criteria during the first 3 days of intensive care.

We defined AKI according to Kidney Disease: Improving Global Outcomes (KDIGO) criteria including both plasma creatinine and urine output criteria [18]. Urine output was measured hourly and plasma creatinine daily. The last available plasma creatinine value from the preceding year up to 1 week before intensive care unit (ICU) admission was used as the baseline value. When not available, we estimated the baseline creatinine value using the Modification of Diet in Renal Disease equation assuming a glomerular filtration rate of 75 ml/min/1.73 m2 [19]. We included data on AKI and RRT during the first 3 days of ICU stay, choosing the highest stage for the final KDIGO stage of each patient for the analyses. We obtained 90-day mortality data from the Finnish Population Register Centre.

Measurement of uNGAL

The urine samples were collected on ICU admission (0 h), at 12 and 24 h, and stored as described elsewhere [13]. The person who analyzed the samples in duplicate with NGAL ELISA Rapid Kit (BioPorto® Gentofte, Denmark) was blinded to patient records. The validated enzyme-linked immunosorbent assay (ELISA) method has a good intra- and inter-assay precision [20] and a measurement range of 10–1000 ng/ml. For the analyses, values below 10 ng/ml were registered as the lowest measurable value (10 ng/ml) and values above 1000 ng/ml as the highest measurable value (1000 ng/ml). For predictive calculations, we chose the first available uNGAL measurement (0, 12 or 24 h) for each patient.

Statistical analyses

We tested four different outcomes: (1) AKI by original KDIGO classification (KDIGO stages 1–3), (2) “severe” AKI (KDIGO stages 2–3), (3) RRT, and (4) 90-day mortality. To simulate clinical decision making, we constructed clinical risk models for these outcomes using clinical variables available at the time of ICU admission. We tested associations of these variables with the outcomes using Mann–Whitney U, Chi square or Fisher’s exact test (with a two-sided p value), as appropriate. We conducted multivariable logistic regression analyses entering variables with the strongest associations (shown in Additional file 1: Table S1) simultaneously. We restricted the number of covariates to 1 per 8 dependent endpoints to avoid overfitting [21] and imputed missing values (Additional file 1: Table S1) as recommended [22]. To ensure that the assumptions for multivariable logistic regression were met, we checked the correlations between the variables and conducted multiple regression analysis to rule out multicollinearity (Additional file 2). We used Hosmer–Lemeshow test to evaluate model goodness of fit. Thereafter, we added uNGAL to the clinical risk models and gained new risk models for the four outcomes (Additional file 3). We calculated AUCs with 95% confidence intervals (CIs) for uNGAL alone, for the clinical risk models, and for the new risk models including uNGAL. To evaluate the predictive value of uNGAL, we calculated category-free net reclassification improvement (cfNRI) [23] and integrated discrimination improvement (IDI) [24], and draw RAPs [14] for each outcome. We describe these metrics in detail in Additional file 4: Statistical methods.

We also conducted DCAs [10] for the outcomes to illustrate the net benefit of adding uNGAL to the clinical prediction models. DCA plots net benefit against threshold probability. Net benefit delineates gained new true-positive results without false-positive results and varies according to the chosen threshold probability, that is, the probability above which the patient is offered treatment (e.g., ICU admission). For example, with threshold probabilities of 0, 1, or 0.1, we would admit all patients, none of the patients, or those having a risk of ≥ 10%, respectively. A threshold probability is chosen according to the significance of false-negative versus false-positive results. Threshold probability of 0.1 means that we consider the harm of a false-negative result (denial of necessary ICU admission) 9 times (1–0.1/0.1) worse than a false-positive result (unnecessary ICU admission). For more serious outcomes, false-negative results are considered more harmful and the threshold lowered. Accordingly, for AKI, severe AKI, RRT, and 90-day mortality, we prospectively chose threshold probabilities of 0.3, 0.2, 0.1, and 0.05, respectively. We calculated test trade-offs to determine the minimum number of patients to be tested per one extra true-positive classification [25]. Finally, we performed a sensitivity analysis excluding patients that did not have 0-h urine sample.

We present the data as medians with interquartile ranges (IQRs) or absolute numbers (percentage with 95% CIs). Statistical analyses were conducted using SPSS 22 software (SPSS Inc., Chicago, IL, USA), MedCalc Statistical Software version 18 (MedCalc Software bvba, Ostend, Belgium; http://www.medcalc.org; 2018) and R 3.4.3 (R Development Core Team, Vienna, Austria).

Results

We included 484 patients fulfilling the Sepsis-3 definition (Fig. 1). Table 1 presents the patient characteristics. Of AKI patients, 115/217 (53%) developed AKI on day 1, 87/217 (40%) on day 2, and 15/217 (7%) on day 3. Of 46 patients treated with RRT during the first 3 days in ICU, 20 (43%) commenced RRT on the first ICU day, 19 (41%) on day 2, and 7 (15%) on day 3. The uNGAL measurement used for prediction of outcomes was the 0-h sample in 460 (95%) of 484 patients, 12-h sample in 9 (2%), and 24-h sample in 15 (3%) patients. The first measured uNGAL was below the detection limit in 48 patients (10%) and above it in 110 patients (23%).

Fig. 1
figure 1

Study flowchart

Table 1 Characteristics of 484 critically ill sepsis patients

AUC

The AUCs for uNGAL predicting AKI, severe AKI, and RRT during the 3 first days in ICU, and death by day 90 are shown in Table 2. Adding uNGAL to the clinical risk model yielded statistically significant model improvement for the outcomes AKI, severe AKI, and RRT (p < 0.05 for all), but not for 90-day mortality (Table 2).

Table 2 Model improvement with urine NGAL added to the clinical risk models for the endpoints

cfNRI, IDI, and RAP

The combined cfNRI and IDI values indicate that the models changed to the right direction when uNGAL was added. The model improved most prominently for RRT (Table 2, Fig. 2c). RAPs showed variable effects with AKI and severe AKI (Fig. 2 a, b), a more sustained effect with RRT (Fig. 2c), but negligible improvement in 90-day mortality prediction (Fig. 2d).

Fig. 2
figure 2

Risk assessment plots showing model enhancement in a AKI, b severe (KDIGO 2–3) AKI, c RRT, and d 90-day mortality. Dashed lines (baseline model) represent clinical risk models and solid lines represent new risk models with uNGAL. The gray areas between the solid and the dashed lines represent IDIevents (area between black lines) and IDInonevents (area between red lines). a Visually estimated from the curves, adding uNGAL to the clinical risk model improves separation of patients who will develop AKI when the risk of the event is more than ≈ 45%, and discrimination of patients who will not develop AKI when the risk of the event is less than ≈ 50%. b With severe AKI, uNGAL added to the clinical risk model improves distinguishing KDIGO 2–3 patients when the risk of the event (= severe AKI) is more than ≈ 25% and helps separating those with KDIGO stage 0–1 when the risk of the event is less than ≈ 30%. c Adding uNGAL to the clinical risk model improves the performance for assigning individuals that will end up with RRT when the risk of the event is lower than ≈ 40%, and enhances discrimination of those not ending up with RRT when the risk of the event is lower than ≈ 10%. d Corresponding statistics in Table 2, RAPs for the clinical 90-day mortality risk model and for the new model with uNGAL added illustrate that uNGAL offers only minimal enhancement separating those who will die by day 90 when the risk of the event is > 40%

Decision curve analysis (DCA) and net benefit

At the pre-defined threshold probability of 0.3, there was a 2.5% (95% CI 0.2–4.6%) net benefit of adding uNGAL to the clinical AKI risk model (Fig. 3a). For severe AKI (threshold probability of 0.2) and RRT (threshold probability of 0.1), net benefits were 1.4% (0.4–4.1%, Fig. 3b) and 1.4% (0.1–2.8%, Fig. 3c), respectively. 90-day mortality prediction did not improve at threshold probability of 0.05 (Fig. 3d). The test trade-offs (minimum patient numbers to be tested for one extra true-positive, reciprocal of net benefit) were 40 for AKI, 71 for severe AKI, and 74 for RRT. Repeating the analyses excluding those 24 patients who did not have the 0-h sample did not change the results (see Additional file 5).

Fig. 3
figure 3

Decision curve analysis for a AKI, b severe (KDIGO 2–3), AKI, c RRT, and d 90-day mortality. Dashed black lines (baseline model) represent clinical risk models and dashed red lines represent new models with uNGAL. Black solid line: assume no patient has the outcome. Gray solid line: assume all patients have the outcome. a As the new model curve runs higher than the baseline curve, DCA shows a net benefit (NB) in identifying patients who will develop AKI at threshold probabilities of ≈ 0.25–0.35. The magnitude of the NB is 2.5% (95% CI 0.2–4.6%) at the predefined threshold probability of 0.30. However, at a threshold probability of 0.4, there is no NB at all. Note that if the models do not diverge from the gray line of “all expected positive”, neither of them adds anything to the strategy of expecting all to be positive at that threshold probability and should not be used. b With severe AKI, there is a 1.4% (95% CI 0.4–4.1%) NB at a threshold probability of 0.2. As with AKI, the NB does not persist within the area of clinically relevant threshold probabilities. c Adding uNGAL to the clinical RRT risk model gives a NB of 1.4% (95% CI 0.1–2.8%) in identifying patients who will end up in RRT at a threshold probability of 0.10. Note that at a threshold probability of ≈ 0.35 the curves intersect. d Decision curves for the clinical 90-day mortality risk model and for the clinical model including uNGAL do not diverge at a risk threshold of 0.05 thus showing no NB for adding uNGAL to the clinical risk model

Discussion

In this extended statistical analysis comprising 484 critically ill septic patients, we found that uNGAL alone predicts AKI poorly—not better than a clinical prediction model using data on ICU admission. Adding uNGAL to the clinical prediction model improved the prediction of AKI, severe AKI, and RRT slightly, but the magnitude of the improvement is not clinically meaningful. These findings profoundly contradict the conclusions of the current meta-analysis and do not support the usefulness of uNGAL in critically ill septic patients.

AUCs for uNGAL

In this study of sepsis patients, the first available uNGAL obtained in the ICU presented an AUC of 0.690 for AKI, resembling the AUC of 0.733 for the highest uNGAL of the first 24 h in 1042 non-selected ICU patients from the FINNAKI study [13]. Our result is in disagreement with the pooled AUC (0.90) of the 12 studies included in a recent meta-analysis evaluating performance of NGAL in septic patients [8]. Importantly, the individual studies in the meta-analysis by Zhang et al. [8] were small—the largest one enrolled 168 patients. Generalizability of the meta-analysis may be questioned since nearly two-thirds of a total of 1263 included study patients were from one country, China. Besides, two of the included studies (228 patients) were conducted in the emergency department—not in the ICU. Disease severity and prevalence of comorbidities like chronic kidney disease in the study population may differ from ours. According to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) criteria, the risk of bias was not dealt properly in the majority of the individual studies [8]. Of the included studies, our results were comparable to the Danish study by Hjortrup and colleagues [26], which may result from similarities in case mix and care representing current clinical practice in high-income countries. In the present sepsis cohort, corresponding the original FINNAKI NGAL—substudy [13], the point estimate AUC for uNGAL seemed to be best for prediction of RRT (AUC 0.769). However, according to our results, uNGAL alone is not adequate to predict AKI, RRT, or 90-day mortality in septic patients.

Improvement of the clinical prediction model

Based on IDI values, adding uNGAL to clinical reference models resulted in improved prediction of the outcomes. IDI and cfNRI values are somewhat difficult to interpret, but RAPs illustrate these metrics in patients with and without the event revealing model improvement or worsening across different risks of the event. The curves showed that model improvement varied depending on the risk of the event.

Clinical usefulness of uNGAL

The widely used and easily interpreted AUC plots the true-positive rate (sensitivity) against the false-positive rate (1 – specificity) giving us consecutive cut-offs for the predicted risk. To guide decision making in clinical practice, a cut-off for a biomarker (or a decision threshold) is needed to divide patients to low- and high-risk groups, but such a value is not always reported in biomarker studies [8]. AUC enables comparison of the overall performance of different tests for the same condition but does not tell us the ability of a marker to add value to a pre-existing risk prediction model or, if such is lacking, to clinical judgment.

We used DCA graph [10], which illustrates the net benefit of a model in a range of different threshold probabilities of the event. DCA enables the comparison of the clinical and the new model including NGAL. DCA graphs, especially of AKI and severe AKI, show that the increase of net benefit after adding uNGAL to the clinical risk model varies over the range of clinically relevant threshold probabilities. The clinician chooses the optimal threshold probability, balancing between the harm of a false-positive and a false-negative classification. We chose decreasing threshold along with increasing severity of the event. Test trade-offs between 40 (for AKI) and 74 (for RRT), indicating minimum patient numbers to be tested for one extra true-positive, are hardly acceptable as no specific preventive or curative treatment for AKI exists and the criteria for RRT initiation are still under investigation [27].

Limitations and strengths

Some obvious limitations of the present study need to be considered. First, as this was a post-hoc analysis of a subgroup of septic patients from a larger FINNAKI NGAL study [13], we were not able to influence sample size. Thus our results, especially the predictive value of uNGAL for RRT, must be interpreted with caution due to small number of events. Furthermore, varying clinical practice in the use of RRT in different countries diminishes the generalizability of our findings. However, to the best of our knowledge, this is the largest multicenter cohort of consecutive intensive care patients studying uNGAL in sepsis. Second, although the study patients were originally screened using the former ACCP/SCCM criteria for sepsis, we now included only those with sepsis according to the recent Sepsis-3 definition. This may have led to exclusion of patients fulfilling Sepsis-3 criteria but not the former criteria. Third, some patients may have had existing AKI already at the time of measurement, a problem in all predictive biomarker studies. We performed a sensitivity analysis excluding those 24 patients that did not have a 0-h urine sample but this did not change the results. Fourth, we did not normalize uNGAL for urinary creatinine [28]. Finally, the purpose of the presented clinical risk models was to enable evaluation of the incremental value of uNGAL, that is, what uNGAL adds on clinical reasoning. Importantly, no model should be used in clinical practice before independent external validation. Even though the results of Hosmer–Lemeshow goodness of fit test and restricting the number of variables in the models did not support overfitting, it cannot be ruled out.

Our study has also some strength. To simulate clinical applicability and to perform a fair comparison, we limited the variables for the clinical risk models to those available on ICU admission. We performed an extended statistical analysis to scrutinize clinical usefulness of a suggested AKI biomarker using the most recently proposed statistical methods including variable weighing of false-negatives and false-positives as recommended [25, 29, 30]. We consider our detailed analysis of 484 patients adds significantly on existing combined uNGAL data from 1263 septic patients [8].

Conclusions

We conclude that in critically ill adult sepsis patients, the performance of uNGAL alone was inadequate in predicting AKI, RRT, and 90-day mortality. The detailed statistical analyses do not support the clinical usefulness of uNGAL in this patient population.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

NGAL:

Neutrophil gelatinase-associated lipocalin

AKI:

Acute kidney injury

uNGAL:

Urine neutrophil gelatinase-associated lipocalin

FINNAKI study:

Finnish Acute Kidney Injury study

AUC:

Area under the receiver operating characteristic curve

KDIGO:

Kidney Disease: Improving Global Outcomes

RRT:

Renal replacement therapy

RAP:

Risk assessment plot

DCA:

Decision curve analysis

ACCP/SCCM:

American College of Chest Physicians/Society of Critical Care Medicine

Sepsis-3:

Third International Consensus Definitions for Sepsis and Septic Shock

ICU:

Intensive care unit

ELISA:

Enzyme-linked immunosorbent assay

CI:

Confidence interval

cfNRI:

Category-free net reclassification improvement

IDI:

Integrated discrimination improvement

IQR:

Interquartile range

QUADAS-2:

Quality Assessment of Diagnostic Accuracy Studies 2

APACHE II:

Physiologic data including Acute Physiology and Chronic Health Evaluation II

SAPS II:

Simplified Acute Physiology Score

SOFA:

Sequential Organ Failure Assessment

References

  1. Haase M, Bellomo R, Devarajan P, Schlattmann P, Haase-Fielitz A, NGAL Meta-analysis Investigator Group. Accuracy of neutrophil gelatinase-associated lipocalin (NGAL) in diagnosis and prognosis in acute kidney injury: a systematic review and meta-analysis. Am J Kidney Dis. 2009;54(6):1012–24.

    Article  CAS  PubMed  Google Scholar 

  2. Hjortrup PB, Haase N, Wetterslev M, Perner A. Clinical review: predictive value of neutrophil gelatinase-associated lipocalin for acute kidney injury in intensive care patients. Crit Care. 2013;17(2):211.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Xu SY, Carlson M, Engstrom A, Garcia R, Peterson CG, Venge P. Purification and characterization of a human neutrophil lipocalin (HNL) from the secondary granules of human neutrophils. Scand J Clin Lab Invest. 1994;54(5):365–76.

    Article  CAS  PubMed  Google Scholar 

  4. Schmidt-Ott KM, Mori K, Li JY, Kalandadze A, Cohen DJ, Devarajan P, et al. Dual action of neutrophil gelatinase-associated lipocalin. J Am Soc Nephrol. 2007;18(2):407–13.

    Article  CAS  PubMed  Google Scholar 

  5. Mårtensson J, Bell M, Oldner A, Xu S, Venge P, Martling C-R. Neutrophil gelatinase-associated lipocalin in adult septic patients with and without acute kidney injury. Intensive Care Med. 2010;36(8):1333–40.

    Article  PubMed  Google Scholar 

  6. Mårtensson J, Bell M, Xu S, Bottai M, Ravn B, Venge P, et al. Association of plasma neutrophil gelatinase-associated lipocalin (NGAL) with sepsis and acute kidney dysfunction. Biomarkers. 2013;18(4):349–56.

    Article  PubMed  Google Scholar 

  7. Otto GP, Hurtado-Oliveros J, Chung H-Y, Knoll K, Neumann T, Müller HJ, et al. Plasma neutrophil gelatinase-associated lipocalin is primarily related to inflammation during sepsis: a translational approach. PLoS ONE. 2015;10(4):e0124429-e.

    Article  Google Scholar 

  8. Zhang A, Cai Y, Wang P-F, Qu J-N, Luo Z-C, Chen X-D, et al. Diagnosis and prognosis of neutrophil gelatinase-associated lipocalin for acute kidney injury with sepsis: a systematic review and meta-analysis. Crit Care. 2016;20:41.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ray P, Manach Yannick L, Riou B, Houle Tim T. Statistical evaluation of a biomarker. Anesthesiology. 2010;112(4):1023–40.

    Article  PubMed  Google Scholar 

  10. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26(6):565–74.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Kerr KF, Wang Z, Janes H, McClelland RL, Psaty BM, Pepe MS. Net reclassification indices for evaluating risk prediction instruments: a critical review. Epidemiology. 2014;25(1):114–21.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Vanmassenhove J, Kielstein J, Ostermann M. Have renal biomarkers failed in acute kidney injury? Yes. Intensive Care Med. 2017;43:883–6.

    Article  PubMed  Google Scholar 

  13. Nisula S, Yang R, Kaukonen K-M, Vaara ST, Kuitunen A, Tenhunen J, et al. The urine protein NGAL predicts renal replacement therapy, but not acute kidney injury or 90-day mortality in critically iII adult patients. Anesth Analg. 2014;119(1):95–102.

    Article  CAS  PubMed  Google Scholar 

  14. Pickering JW, Endre ZH. New metrics for assessing diagnostic potential of candidate biomarkers. Clin J Am Soc Nephrol. 2012;7(8):1355–64.

    Article  PubMed  Google Scholar 

  15. Nisula S, Kaukonen K-M, Vaara ST, Korhonen A-M, Poukkanen M, Karlsson S, et al. Incidence, risk factors and 90-day mortality of patients with acute kidney injury in Finnish intensive care units: the FINNAKI study. Intensive Care Med. 2013;39(3):420–8.

    Article  PubMed  Google Scholar 

  16. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101(6):1644–55.

    Article  CAS  PubMed  Google Scholar 

  17. Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. 2016;315(8):801–10.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Kellum JA, Lameire N, Aspelin P, Barsoum RS, Burdmann EA, Goldstein SL, et al. Kidney disease: improving global outcomes (KDIGO) acute kidney injury work group. KDIGO clinical practice guideline for acute kidney injury. Kidney Int Suppl. 2012;2(1):1–138.

    Article  Google Scholar 

  19. Levey AS, Coresh J, Balk E, Kausz AT, Levin A, Steffes MW, et al. National kidney foundation practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Ann Intern Med. 2003;139(2):137–47.

    Article  PubMed  Google Scholar 

  20. Pedersen KR, Ravn HB, Hjortdal VE, Nørregaard R, Povlsen JV. Neutrophil gelatinase-associated lipocalin (NGAL): validation of commercially available ELISA. Scand J Clin Lab Invest. 2010;70(5):374–82.

    Article  CAS  PubMed  Google Scholar 

  21. Biondi-Zoccai G, Romagnoli E, Agostoni P, Capodanno D, Castagno D, D’Ascenzo F, et al. Are propensity scores really superior to standard multivariable analysis? Contemp Clin Trials. 2011;32(5):731–40.

    Article  PubMed  Google Scholar 

  22. Vesin A, Azoulay E, Ruckly S, Vignoud L, Rusinovà K, Benoit D, et al. Reporting and handling missing values in clinical studies in intensive care units. Intensive Care Med. 2013;39(8):1396–404.

    Article  PubMed  Google Scholar 

  23. Pencina MJ, D’Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011;30(1):11–21.

    Article  PubMed  Google Scholar 

  24. Pencina MJ, D’ Agostino RB, D’ Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2):157–72.

    Article  PubMed  Google Scholar 

  25. Van Calster B, Wynants L, Verbeek JFM, Verbakel JY, Christodoulou E, Vickers AJ, et al. Reporting and interpreting decision curve analysis: a guide for investigators. Eur Urol. 2018;74(6):796–804.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Hjortrup PB, Haase N, Treschow F, Møller MH, Perner A. Predictive value of NGAL for use of renal replacement therapy in patients with severe sepsis. Acta Anaesthesiol Scand. 2015;59(1):25–34.

    Article  CAS  PubMed  Google Scholar 

  27. Investigators S-A. Standard versus accelerated initiation of renal replacement therapy in acute kidney injury: study protocol for a multi-national, multi-center, randomized controlled trial. Can J Kidney Health Dis. 2019;6:2054358119852937.

    Google Scholar 

  28. Md Ralib A, Pickering JW, Shaw GM, Devarajan P, Edelstein CL, Bonventre JV, et al. Test characteristics of urinary biomarkers depend on quantitation method in acute kidney injury. J Am Soc Nephrol. 2012;23(2):322–33.

    Article  PubMed Central  Google Scholar 

  29. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925–31.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Kerr KF, Meisner A, Thiessen-Philbrook H, Coca SG, Parikh CR. Developing risk prediction models for kidney injury and assessing incremental value for novel biomarkers. Clin J Am Soc Nephrol. 2014;9(8):1488–96.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank the FINNAKI study group for collecting the data.

The FINNAKI Study Group

Central Finland Central Hospital: Raili Laru-Sompa, Anni Pulkkinen, Minna Saarelainen, Mikko Reilama, Sinikka Tolmunen, Ulla Rantalainen, Marja Miettinen. East Savo Central Hospital: Markku Suvela, Katrine Pesola, Pekka Saastamoinen, Sirpa Kauppinen. Helsinki University Central Hospital: Ville Pettilä, Kirsi-Maija Kaukonen, Anna-Maija Korhonen, Sara Nisula, Suvi Vaara, Raili Suojaranta-Ylinen, Leena Mildh, Mikko Haapio, Laura Nurminen, Sari Sutinen, Leena Pettilä, Helinä Laitinen, Heidi Syrjä, Kirsi Henttonen, Elina Lappi, Hillevi Boman. Jorvi Central Hospital: Tero Varpula, Päivi Porkka, Mirka Sivula, Mira Rahkonen, Anne Tsurkka, Taina Nieminen, Niina Prittinen. Kanta-Häme Central hospital: Ari Alaspää, Ville Salanto, Hanna Juntunen, Teija Sanisalo. Kuopio University Hospital: Ilkka Parviainen, Ari Uusaro, Esko Ruokonen, Stepani Bendel, Niina Rissanen, Maarit Lång, Sari Rahikainen, Saija Rissanen, Merja Ahonen, Elina Halonen, Eija Vaskelainen. Lapland Central Hospital: Meri Poukkanen, Esa Lintula, Sirpa Suominen. Länsi Pohja Central Hospital: Jorma Heikkinen, Timo Lavander, Kirsi Heinonen, Anne-Mari Juopperi. Middle Ostrobothnia Central Hospital: Tadeusz Kaminski, Fiia Gäddnäs, Tuija Kuusela, Jane Roiko. North Karelia Central Hospital: Sari Karlsson, Matti Reinikainen, Tero Surakka, Helena Jyrkönen, Tanja Eiserbeck, Jaana Kallinen. Satakunta Hospital district: Vesa Lund, Päivi Tuominen, Pauliina Perkola, Riikka Tuominen, Marika Hietaranta, Satu Johansson. South Karelia Central Hospital: Seppo Hovilehto, Anne Kirsi, Pekka Tiainen, Tuija Myllärinen, Pirjo Leino, Anne Toropainen. Tampere University Hospital: Anne Kuitunen, Ilona Leppänen, Markus Levoranta, Sanna Hoppu, Jukka Sauranen, Jyrki Tenhunen, Atte Kukkurainen, Samuli Kortelainen, Simo Varila. Turku University Hospital: Outi Inkinen, Niina Koivuviita, Jutta Kotamäki, Anu Laine. Oulu University Hospital: Tero Ala-Kokko, Jouko Laurila, Sinikka Sälkiö. Vaasa Central Hospital: Simo-Pekka Koivisto, Raku Hautamäki, Maria Skinnar.

Funding

The study received Clinical Research funding from the state (VTR) TYH 2017241 and Y102011091 from Helsinki University Hospital (VP). STV has received funding for Clinical Researchers (317061) from the Academy of Finland.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

All authors took part in designing the study. ST, LP, and EP analyzed and interpreted the results and drafted the manuscript. SN and STV handled the FINNAKI data. All authors revised the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Sanna Törnblom.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of the Department of Surgery in Helsinki University Hospital approved the study (18/13/03/02/2010). Each participant or his/her proxy gave a written informed consent, and withdrawing from the study was possible at any time.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

Associations of variables explored in the univariable models with outcomes.

Additional file 2:

Correlations between the variables and multicollinearity test results.

Additional file 3:

Multivariable models and decision curve analysis results.

Additional file 4:

Statistical methods.

Additional file 5:

Sensitivity analysis (raw data).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Törnblom, S., Nisula, S., Petäjä, L. et al. Urine NGAL as a biomarker for septic AKI: a critical appraisal of clinical utility—data from the observational FINNAKI study. Ann. Intensive Care 10, 51 (2020). https://doi.org/10.1186/s13613-020-00667-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13613-020-00667-7

Keywords