Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Radiomic features of axillary lymph nodes based on pharmacokinetic modeling DCE-MRI allow preoperative diagnosis of their metastatic status in breast cancer

  • Hong-Bing Luo ,

    Contributed equally to this work with: Hong-Bing Luo, Yuan-Yuan Liu

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Yuan-Yuan Liu ,

    Contributed equally to this work with: Hong-Bing Luo, Yuan-Yuan Liu

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – review & editing

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Chun-hua Wang,

    Roles Conceptualization, Data curation, Investigation, Methodology, Validation

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Hao-Miao Qing,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Software

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Min Wang,

    Roles Data curation, Investigation, Methodology, Supervision

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Xin Zhang,

    Roles Formal analysis, Software

    Affiliation Pharmaceutical Diagnostic Team, GE Healthcare, Life Sciences, Beijing, China

  • Xiao-Yu Chen,

    Roles Investigation, Methodology, Software

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Guo-Hui Xu,

    Roles Project administration, Supervision

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Peng Zhou ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Project administration, Resources, Software, Supervision, Visualization

    13880611648@163.com (JR); penghyzhou@126.com (PZ)

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

  • Jing Ren

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing

    13880611648@163.com (JR); penghyzhou@126.com (PZ)

    Affiliation Department of Radiology, Sichuan Cancer Hospital & Institute, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China

Abstract

Objective

To study the feasibility of use of radiomic features extracted from axillary lymph nodes for diagnosis of their metastatic status in patients with breast cancer.

Materials and methods

A total of 176 axillary lymph nodes of patients with breast cancer, consisting of 87 metastatic axillary lymph nodes (ALNM) and 89 negative axillary lymph nodes proven by surgery, were retrospectively reviewed from the database of our cancer center. For each selected axillary lymph node, 106 radiomic features based on preoperative pharmacokinetic modeling dynamic contrast enhanced magnetic resonance imaging (PK-DCE-MRI) and 5 conventional image features were obtained. The least absolute shrinkage and selection operator (LASSO) regression was used to select useful radiomic features. Logistic regression was used to develop diagnostic models for ALNM. Delong test was used to compare the diagnostic performance of different models.

Results

The 106 radiomic features were reduced to 4 ALNM diagnosis–related features by LASSO. Four diagnostic models including conventional model, pharmacokinetic model, radiomic model, and a combined model (integrating the Rad-score in the radiomic model with the conventional image features) were developed and validated. Delong test showed that the combined model had the best diagnostic performance: area under the curve (AUC), 0.972 (95% CI [0.947–0.997]) in the training cohort and 0.979 (95% CI [0.952–1]) in the validation cohort. The diagnostic performance of the combined model and the radiomic model were better than that of pharmacokinetic model and conventional model (P<0.05).

Conclusion

Radiomic features extracted from PK-DCE-MRI images of axillary lymph nodes showed promising application for diagnosis of ALNM in patients with breast cancer.

Introduction

Breast cancer is the most common malignant cancer in women worldwide as well as in China, and has a high mortality rate [1, 2]. Lymphatic metastasis is the first step in the transition of breast cancer patients to metastatic state, and axillary lymphatic node metastasis is an important predictor of breast cancer recurrence [3]. Therefore, pre-treatment diagnosis of metastatic axillary lymph node (ALNM) is crucial for prognostic assessment and treatment decision-making [47]. Currently, lymphadenectomy and/or biopsy is the gold standard for differentiating ALNM from normal lymph nodes; however, these are invasive procedures associated with low repeatability and potential complications [5, 8]. Therefore, development of alternative noninvasive and repeatable methods for preoperative identification of ALNM is a key imperative.

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is widely used for preoperative evaluation of axillary lymph node status in patients with breast cancer and shows superior performance than other techniques [9, 10]. The traditional DCE-MRI diagnostic criteria for ALNM are based on visual assessment of morphological features [11]. Radiomics provides an innovative quantitative method to predict ALNM in patients with breast cancer [7, 1219].

Radiomics refers to the science of converting medical images to high-throughput and mineable quantitative features by data characterisation algorithms [20]. These features, termed radiomic features, have the potential to decode the invisible disease characteristics, which are useful for individualized treatment. It is different from the traditional medical images, which are subject to visual interpretation. Use of modern analytical software and artificial intelligence technology has helped unravel an increasing number of useful features obtained through radiomic method, especially in the field of cancer research [21].

Breast cancer is known to be a heterogeneous disease caused by variations in local micro-environment that are mainly governed by spatial and temporal changes in blood flow. Tumor heterogeneity may be represented by different contrast-enhancement patterns on DCE-MRI and amenable to quantitative assessment using radiomic methods based on PK-DCE-MRI [2225]. Some recent studies have shown that radiomic features extracted from primary breast cancer mass may be used to predict metastases in the sentinel lymph node [15, 16] and axillary lymph nodes [18, 19]. However, to the best of our knowledge, the role of radiomic features extracted from axillary lymph nodes for diagnosis of their metastatic status is still not studied.

The ALNM of breast cancer, which is similar to the tumor itself, may also exhibit heterogeneity; the heterogeneous characteristics on PK-DCE-MRI can be decoded by radiomic method. Our hypothesis is that the radiomic features extracted from PK-DCE-MRI images of axillary lymph nodes can help diagnose ALNM in patients with breast cancer.

Materials and methods

Subjects

The Medical Ethics Committee of the Sichuan Cancer Hospital & Institute approved this study. The requirement for informed consent of subjects was waived off. We retrospectively reviewed our database to select consecutive women with proven breast cancer by surgical pathology and who underwent DCE-MRI examination before surgery between August 2015 and June 2019. The exclusion criteria were: patients who had received neo-adjuvant chemotherapy; patients for whom quantitative parameters could not be acquired due to data-processing errors.

To ensure that axillary lymph nodes included in radiomic analyses were pathologically metastatic nodes, cases recruited to the ALNM group were required to qualify the following two conditions. First, at least 3 metastatic axillary lymph nodes were confirmed by pathology after axillary lymphadenectomy. Second, there was at least one highly suspicious axillary lymph node on DCE-MRI images in the ipsilateral axilla, which was visible to radiologists. Finally, two radiologists with 8 and 6 years of experience in the interpretation of breast MRI, respectively, reviewed the surgical pathology reports and MRI images together, and selected only one largest and highly suspicious axillary lymph node for each recruited patient for radiomic analysis.

To ensure that axillary lymph nodes included in radiomic analyses were pathologically negative for metastasis, cases recruited to the negative axillary lymph nodes group for control (ALNC) were required to qualify the following conditions. First, all axillary lymph nodes of the patients with negative sentinel lymph node biopsy were considered negative [13]. Second, we only chose the largest visible ipsilateral axillary lymph node of these patients for radiomic analysis.

MRI acquisition

The MRI acquisition (as briefly described below) in this study were not specific to the current research and have been described extensively in our previous study [26]. All DCE-MRI examinations were performed using a 3.0-T Skyra device (Siemens Healthcare, Erlangen, Germany) with a dedicated breast coil (16-channel breast array; Siemens Healthcare, Erlangen, Germany). With the patient in a prone position, Axial T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI) and DCE-MRI sequences were obtained. The DCE-MRI included T1 mapping and 26 consecutive phases fast dynamic MR acquisition, using the CAIPIRINHA-Dixon-TWIST-VIBE sequence with the temporal resolution 11.8 s/phase and TA 5 min 12 s. Gadodiamide (0.1 mmol/kg; Omniscan, GE Healthcare, Milwaukee, WI) was intravenously administered using a power injector (rate, 2.5 mL/s) at the end of T1 mapping. Then, a 20-mL saline flush was injected (rate, 2.5 mL/s).

Post-processing of MRI images and radiomic analysis

Raw DCE-MRI data were imported into a dedicated post-processing software (Omni-Kinetics, GE Healthcare, Milwaukee, WI). The enhancement kinetics were analyzed using the reference region model [27]. With the reference region set to pectoralis major muscle, voxel-wise perfusion maps were automatically generated.

A schematic illustration of the radiomic analysis process is shown in Fig 1; the process consisted of 3D whole lymph node segmentation, features extraction, features selection, model building, and evaluation.

Whole lymph node segmentation.

For extracting the radiomic features of each selected lymph node, the same two radiologists manually drew the regions of interest (ROIs) that included the whole lymph node in the early stage of postcontrast image of DCE-MRI. The radiologist with 8 years of experience performed all definitive measurements. Subsequently, all ROIs were merged into one 3D volume of interest (VOI).

Features extraction.

A total of 106 radiomic features were extracted and automatically outputted by the software from the VOI, including 1 total voxel number of VOI, 30 standard pharmacokinetic parameters with their corresponding histogram features: (1) Ktrans (min−1), the volume-transfer constant (wash-in rate), which reflects vascular permeability and perfusion; (2) Kep (min−1), the washout-rate constant, which reflects contrast-agent reflux back to the vessels; (3) Vp, the plasma fraction. The histogram features, i.e., the maximum, minimum, median, mean, Std, 10%, 25%, 50%, 75%, and 90% values, of each quantitative parameter, and 75 texture features of T1-weighted images of dynamic contrast enhanced-magnetic resonance imaging (T1 DCE-MRI) (S1 Table), consisting of 12 first-order statistical features, 15 histogram features, 13 Gray-level co-occurrence matrix (GLCM) features, 10 Haralick features, 16 Run length matrix (RLM) features and 9 Morphology metrics features.

Features selection and radiomic model building.

First, the training and validation cases were separated at a ratio of 7 to 3. We employed the least absolute shrinkage and selection operator (LASSO) technique and leave-one-out cross-validation (LOOCV) method to select and rank the optimal radiomic features from the primary date set in the training cohort. Tunning minimum criteria selection in the LASSO model used 10-fold cross validation via minimum criteria in the study. Then we used logistic regression to build a pharmacokinetic model (PK-model) based on pharmacokinetic parameters with their corresponding histogram features and a radiomic model based on radiomic features. The Radiomics score (Rad-score) was calculated for each patient according the coefficients of the radiomic model, which was defined as a radiomic signature. The performance was then validated in the validation cohort.

Conventional model building.

For conventional model building, some conventional image features of every selected node (including the long and short axis length, short-long axis ratio, fatty hilum status on T2WI sequence, signal intensity on diffusion weighted imaging (DWI), and heterogenous enhancement feature on DCE-MRI sequences) were assessed by the same two radiologists. We used univariate analyses to compare these features between ALNM and ALNC (Table 1). We used logistic regression to build a conventional model based on these candidate features with p < 0.05 in the univariate analyses. The performance was then validated in the validation cohort.

thumbnail
Table 1. Difference of conventional image features between ALNM and ALNC.

https://doi.org/10.1371/journal.pone.0247074.t001

Combined model building.

Integrating the Rad-score in the radiomic model with the conventional image features, the combined model was built using the multivariable logistic regression method. The performance of the combined model was validated in the validation cohort.

Comparison of models.

Receiver operating characteristic (ROC) curve analysis was used to evaluate the diagnostic performance of the above models in diagnosing ALNM. The Delong test was used to compare the diagnostic performance of the conventional model, radiomic model, and the combined model according to the area under the curve (AUC) values.

Establishment of nomogram.

To provide an individualized tool for ALNM diagnosis, a nomogram based on the combined model was plotted. The calibration of the nomogram was assessed using calibration curve, accompanied with the Hosmer–Lemeshow test. Harrell’s C-index was measured to quantify the discriminative ability of the nomogram.

Clinical use.

Decision curve analysis was conducted to determine the clinical usefulness of the nomogram by quantifying the net benefits at different threshold probabilities in the validation dataset.

Statistical analysis

R statistical software (version 3.6.1) was used for statistical analyses. P values < 0.05 were considered indicative of statistical significance.

Results

Patients and axillary nodes in the study

Finally, a total of 176 axillary lymph nodes (87 ALNM breast cancer patients [mean age, 50.7 years; range, 28–78] and 89 ALNC breast cancer patients [mean age, 50.0 years; range, 30–76] were selected for radiomic analyses.

Radiomic features selection and radiomic signature building

The 106 radiomic features of each selected axillary lymph node were reduced to 4 ALNM diagnosis–related features by LASSO (Fig 2). They were all texture features of T1 DCE-MRI, including Haralick Correlation, Difference Variance, DifferenceEntropy and LongRunEmphasis. A radiomic signature containing these features was constructed. The diagnostic performance of the radiomic signature was excellent. The optimal cutoff value of 0.38 was associated with an AUC of 0.971 (95% CI [0.947–0.995]) in the training cohort and 0.966 (95% CI [0.925–1]) in the validation cohort. The accuracy in the training and validation cohorts was 91.8% and 90.7%, respectively. The sensitivity of the radiomic signature in the training and validation cohorts was 90% and 92.6%, respectively; the specificity was good (93.5% in the training cohort and 88.9% in the validation cohort.

thumbnail
Fig 2. LASSO regression for radiomic feature selection.

(A) Selection of the parameter (λ) in the LASSO model by 10-fold cross-validation based on minimum criteria. The y-axis indicates binomial deviances. The lower x-axis indicates the log(λ). Red dots indicate the average deviance values for each model with a given λ, and vertical bars through the red dots show the upper and lower values of the deviances. The dotted vertical lines define the optimal values of λ, where the model provides the best fit to the data. (B) A coefficient profile plot was produced against the log (l) sequence. Vertical line was drawn at the value selected using 10-fold cross-validation, where optimal λ resulted in non-zero coefficients.

https://doi.org/10.1371/journal.pone.0247074.g002

Building of diagnostic models

The conventional model based on conventional image features, PK-model based on pharmacokinetic parameters with their corresponding histogram features, radiomic model based on all radiomic features, and the combined model integrating radiomic features with conventional image features were built. The diagnostic performance of these models is shown in Table 2. The combined model showed the best diagnostic performance; the optimal cutoff value of 0.671 was associated with an AUC of 0.972 (95% CI [0.947–0.997]) in the training cohort and 0.979 (95% CI [0.952–1]) in the validation cohort. The accuracy in the training and validation cohorts was 92.6% and 92.6%, respectively. The sensitivity of the radiomic signature in the training and validation cohorts was 91.7% and 96.3%, respectively; the specificity was good (93.5% in the training cohort and 88.9% in the validation cohort).

thumbnail
Table 2. Diagnostic performance of all models for detection of metastatic axillary lymph node.

https://doi.org/10.1371/journal.pone.0247074.t002

Comparison of models and development of nomogram

The diagnostic performance of combined model and radiomic model was better than that of the conventional model (Delong test, p<0.05). However, the diagnostic performance of the combined model was not better than that of the radiomic model (p>0.05). The ROC curves of the four models are shown in Fig 3. We developed a nomogram based on the radiomic signature and conventional image features (Fig 4). The calibration curve for the nomogram was tested by Hosmer-Lemeshow test, which yielded a non-significant result (χ2 = 3, p>0.05) showing good calibration (Fig 5).

thumbnail
Fig 3.

Receiver operating characteristic (ROC) curves of conventional model, pharmacokinetic model (PK-model), radiomic model, and the combined model for diagnosis of metastatic axillary lymph nodes in the training (A) and validation (B) group at a ratio of 7 to 3.

https://doi.org/10.1371/journal.pone.0247074.g003

thumbnail
Fig 4. Nomogram for diagnosis of metastatic axillary nodes.

The values for each variable correspond to a point at the top of the graph, and the sum of the points for all the variables corresponds to a total point; a line drawn from the total points to the bottom line shows the probability of axillary lymph nodes metastasis. Heterogenous enhancement feature (HEF) is a conventional image feature.

https://doi.org/10.1371/journal.pone.0247074.g004

thumbnail
Fig 5.

Calibration curve of the nomogram for the training (red) and validation (blue) cohorts at a ratio of 7 to 3. The X-axis represents the probability that nomogram diagnosed the axillary lymph nodes metastasis, while Y-axis represents the actual rate of axillary lymph nodes metastasis.

https://doi.org/10.1371/journal.pone.0247074.g005

Clinical use

The decision curve analyses for the nomogram and conventional model are presented in Fig 6. The results showed that the net benefit of using the radiomics nomogram for diagnosis of ALNM was greater than that of the conventional model.

thumbnail
Fig 6. Decision curve analysis of the nomogram of combined model and conventional model.

The y-axis measures the net benefit. The red line represents the nomogram of the combined model. The blue line represents the conventional model. The thin grey line represents the assumption that all patients have axillary lymph nodes metastases. The black line represents the assumption that none of the patients have axillary lymph nodes metastases.

https://doi.org/10.1371/journal.pone.0247074.g006

Discussion

The results of this study, though preliminary in scope, reveal that the radiomic features extracted from preoperative PK-DCE-MRI of axillary lymph nodes can be used to diagnose ALNM in patients with breast cancer. In addition, in this study, the texture features depicting heterogeneity were found more helpful than pharmacokinetic quantitative and their histogram features for diagnosis of metastatic axillary nodes.

Use of radiomics analysis for diagnosis and prognostic assessment in the context of breast cancer is a contemporary research hotspot. Most of the studies have focused on discriminating malignant from benign breast tumors [2830] or on predicting the chemotherapeutic response [31, 32]. Some recent studies have investigated the feasibility of differentiating ALNM by radiomic features, most of these studies were focused on the predictive value of radiomic features extracted from primary breast tumors [1719]. The radiomic features of breast tumors may be used to predict the ALNM; however, these can not be directly used to diagnose ALNM. Therefore, we designed this study to assess the feasibility of use of radiomic features extracted from axillary lymph nodes for diagnosis of their metastasis status. Our results show that the diagnostic performance of radiomic model for detecting ALNM was better than that of the conventional model. Although not better than radiomic model, the combined model showed the best diagnostic performance among the four models. The accuracy was improved from 0.877 of conventional model to 0.926 of the combined model. These results implied that the radiomic features of axillary lymph node itself are promising bio-markers for helping diagnosing its metastasis status. Besides, all the 4 top-rank radiomic features for discrimination between positive and negative axillary nodes by LASSO regression were texture features of T1 DCE-MRI. This suggests that the texture features have a more prominent discriminative performance than the pharmacokinetic parameters and their corresponding histogram features. These findings are consistent with those a previous study by Schacht et al in which kinetic features showed poorer performance in distinguishing between positive and negative lymph nodes [13]; this was attributable to the fact that some normal axillary lymph nodes may also exhibit patterns of rapid uptake and washout kinetics. The results implied that heterogeneity may be the most important characteristic of ALNM in breast cancer, which is difficult to interpret on visual examination of conventional images; however, it can be depicted by radiomic methods through whole-tumor and voxel-wise quantitative analysis based on PK-DCE-MRI. This is concordant with our hypothesis that ALNM are spatially more heterogeneous than the negative ones. The heterogeneous characteristics of axillary lymph nodes could be comprehensively decoded through radiomic methods on the basis of PK-DCE-MRI in vivo; this could be used as an effective supplement to traditional medical images for diagnosis of ALNM of breast cancer in future.

This study had certain limitations. First, the effect of selection bias on our results cannot be ruled out, as it is difficult to accurately match the selected axillary lymph nodes for radiomic analyses visible on DCE-MRI with the metastatic nodes proven by resection and biopsy. To minimize this bias, we only recruited patients for whom at least 3 axillary lymph nodes metastases were confirmed by pathology after axillary lymphadenectomy; subsequently, we selected only one of the most likely axillary lymph nodes in the ipsilateral axilla as ALNM. Second, the semi-automatic features extraction approach may cause some inter-observer variability. With advances in software and algorithms, the detection and segmentation method should be combined with computer vision algorithms for automated specification of the VOI beyond human perception. Such approaches may theoretically be easily implemented in clinical workflow. Finally, although our results were based on high-field strength MRI and the CDT-VIBE sequence protocol, which has high temporal and spatial resolution essential for PK-DCE-MRI, this was only a single-center study. Thus, our findings need to be verified in a multi-center study with different imaging equipments and protocols.

Conclusions

Based on the preliminary results of our study, it may be inferred that the ALNM of breast cancer are more heterogeneous than the negative nodes. Radiomic methods can be used to decode the heterogeneity of axillary lymph nodes. Our findings provide impetus for further radiomic research to develop a non-invasive tool for diagnosis of metastatic lymph node and individualized treatment.

Supporting information

S1 Table. Texture features of T1 DCE-MRI in the study.

https://doi.org/10.1371/journal.pone.0247074.s001

(DOC)

References

  1. 1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin 2016;66(1):7–30. pmid:26742998
  2. 2. Chen W, Zheng R, Baade PD, Zhang S, Zeng H, Bray F, et al. Cancer statistics in China, 2015. CA Cancer J Clin 2016;66(2):115–32. pmid:26808342
  3. 3. He N, Xie C, Wei W, Pan C, Wang W, Lv N, et al. A new, preoperative, MRI-based scoring system for diagnosing malignant axillary lymph nodes in women evaluated for breast cancer. Eur J Radiol 2012;81(10):2602–12. pmid:22525596
  4. 4. Giuliano AE, Ballman K, McCall L, Beitsch P, Whitworth PW, Blumencranz P, et al. Locoregional Recurrence After Sentinel Lymph Node Dissection With or Without Axillary Dissection in Patients With Sentinel Lymph Node Metastases: Long-term Follow-up From the American College of Surgeons Oncology Group (Alliance) ACOSOG Z0011 Randomized Trial. Ann Surg 2016;264(3):413–20. pmid:27513155
  5. 5. Giuliano AE, Ballman KV, McCall L, Beitsch PD, Brennan MB, Kelemen PR, et al. Effect of Axillary Dissection vs No Axillary Dissection on 10-Year Overall Survival Among Women With Invasive Breast Cancer and Sentinel Node Metastasis: The ACOSOG Z0011 (Alliance) Randomized Clinical Trial. Jama 2017;318(10):918–26. pmid:28898379
  6. 6. Giuliano AE, Hunt KK, Ballman KV, Beitsch PD, Whitworth PW, Blumencranz PW, et al. Axillary dissection vs no axillary dissection in women with invasive breast cancer and sentinel node metastasis: a randomized clinical trial. Jama 2011;305(6):569–75. pmid:21304082
  7. 7. Fusco R, Sansone M, Granata V, Di Bonito M, Avino F, Catalano O, et al. Use of Quantitative Morphological and Functional Features for Assessment of Axillary Lymph Node in Breast Dynamic Contrast-Enhanced Magnetic Resonance Imaging. Biomed Res Int 2018;30(2610801). pmid:30003092
  8. 8. Warmuth MA, Bowen G, Prosnitz LR, Chu L, Broadwater G, Peterson B, et al. Complications of axillary lymph node dissection for carcinoma of the breast: a report based on a patient survey. Cancer 1998;83(7):1362–8. pmid:9762937
  9. 9. Valente SA, Levine GM, Silverstein MJ, Rayhanabad JA, Weng-Grumley JG, Ji L, et al. Accuracy of predicting axillary lymph node positivity by physical examination, mammography, ultrasonography, and magnetic resonance imaging. Ann Surg Oncol 2012;19(6):1825–30. pmid:22227922
  10. 10. Liang X, Yu J, Wen B, Xie J, Cai Q, Yang Q. MRI and FDG-PET/CT based assessment of axillary lymph node metastasis in early breast cancer: a meta-analysis. Clin Radiol 2017;72(4):295–301. pmid:28139203
  11. 11. Harnan SE, Cooper KL, Meng Y, Ward SE, Fitzgerald P, Papaioannou D, et al. Magnetic resonance for assessment of axillary lymph node status in early breast cancer: a systematic review and meta-analysis. Eur J Surg Oncol 2011;37(11):928–36. pmid:21855267
  12. 12. Rose CJ, Mills SJ, O’Connor JP, Buonaccorsi GA, Roberts C, Watson Y, et al. Quantifying spatial heterogeneity in dynamic contrast-enhanced MRI parameter maps. Magn Reson Med 2009;62(2):488–99. pmid:19466747
  13. 13. Schacht DV, Drukker K, Pak I, Abe H, Giger ML. Using quantitative image analysis to classify axillary lymph nodes on breast MRI: a new application for the Z 0011 Era. Eur J Radiol 2015;84(3):392–7. pmid:25547328
  14. 14. Loiselle C, Eby PR, Kim JN, Calhoun KE, Allison KH, Gadi VK, et al. Preoperative MRI improves prediction of extensive occult axillary lymph node metastases in breast cancer patients with a positive sentinel lymph node biopsy. Acad Radiol 2014;21(1):92–8. pmid:24331270
  15. 15. Dong Y, Feng Q, Yang W, Lu Z, Deng C, Zhang L, et al. Preoperative prediction of sentinel lymph node metastasis in breast cancer based on radiomics of T2-weighted fat-suppression and diffusion-weighted MRI. Eur Radiol 2018;28(2):582–91. pmid:28828635
  16. 16. Liu C, Ding J, Spuhler K, Gao Y, Serrano Sosa M, Moriarty M, et al. Preoperative prediction of sentinel lymph node metastasis in breast cancer by radiomic signatures from dynamic contrast-enhanced MRI. J Magn Reson Imaging 2019;49(1):131–40. pmid:30171822
  17. 17. Han L, Zhu Y, Liu Z, Yu T, He C, Jiang W, et al. Radiomic nomogram for prediction of axillary lymph node metastasis in breast cancer. Eur Radiol 2019;30(10):018–5981. pmid:30701328
  18. 18. Cui X, Wang N, Zhao Y, Chen S, Li S, Xu M, et al. Preoperative Prediction of Axillary Lymph Node Metastasis in Breast Cancer using Radiomics Features of DCE-MRI. Sci Rep 2019;9(1):019–38502. pmid:30783148
  19. 19. Chai R, Ma H, Xu M, Arefan D, Cui X, Liu Y, et al. Differentiating axillary lymph node metastasis in invasive breast cancer patients: A comparison of radiomic signatures from multiparametric breast MR sequences. J Magn Reson Imaging 2019;7(10):26701. pmid:30848041
  20. 20. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data. Radiology 2016;278(2):563–77. pmid:26579733
  21. 21. Bi WL, Hosny A, Schabath MB, Giger ML, Birkbak NJ, Mehrtash A, et al. Artificial intelligence in cancer imaging: Clinical challenges and applications. CA Cancer J Clin 2019;5(10):21552. pmid:30720861
  22. 22. Gerlinger M, Rowan AJ, Horswell S, Math M, Larkin J, Endesfelder D, et al. Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N Engl J Med 2012;366(10):883–92. pmid:22397650
  23. 23. Kim JH, Ko ES, Lim Y, Lee KS, Han BK, Ko EY, et al. Breast Cancer Heterogeneity: MR Imaging Texture Analysis and Survival Outcomes. Radiology 2017;282(3):665–75. pmid:27700229
  24. 24. Koren S, Bentires-Alj M. Breast Tumor Heterogeneity: Source of Fitness, Hurdle for Therapy. Mol Cell 2015;60(4):537–46. pmid:26590713
  25. 25. Martelotto LG, Ng CK, Piscuoglio S, Weigelt B, Reis-Filho JS. Breast cancer intra-tumor heterogeneity. Breast Cancer Res 2014;16(3). pmid:25928070
  26. 26. Luo HB, Du MY, Liu YY, Wang M, Qing HM, Wen ZP, et al. Differentiation between Luminal A and B Molecular Subtypes of Breast Cancer Using Pharmacokinetic Quantitative Parameters with Histogram and Texture Features on Preoperative Dynamic Contrast-Enhanced Magnetic Resonance Imaging. Acad Radiol 2020;27(3):e35–e44. pmid:31151899
  27. 27. Yankeelov TE, Luci JJ, Lepage M, Li R, Debusk L, Lin PC, et al. Quantitative pharmacokinetic analysis of DCE-MRI data without an arterial input function: a reference region model. Magn Reson Imaging 2005;23(4):519–29. pmid:15919597
  28. 28. Karahaliou A, Vassiou K, Arikidis NS, Skiadopoulos S, Kanavou T, Costaridou L. Assessing heterogeneity of lesion enhancement kinetics in dynamic contrast-enhanced MRI for breast cancer diagnosis. Br J Radiol 2010;83(988):296–309. pmid:20335440
  29. 29. Wang TC, Huang YH, Huang CS, Chen JH, Huang GY, Chang YC, et al. Computer-aided diagnosis of breast DCE-MRI using pharmacokinetic model and 3-D morphology analysis. Magn Reson Imaging 2014;32(3):197–205. pmid:24439361
  30. 30. Li Z, Ai T, Hu Y, Yan X, Nickel MD, Xu X, et al. Application of whole-lesion histogram analysis of pharmacokinetic parameters in dynamic contrast-enhanced MRI of breast lesions with the CAIPIRINHA-Dixon-TWIST-VIBE technique. J Magn Reson Imaging 2018;47(1):91–6. pmid:28577335
  31. 31. Ahmed A, Gibbs P, Pickles M, Turnbull L. Texture analysis in assessment and prediction of chemotherapy response in breast cancer. J Magn Reson Imaging 2013;38(1):89–101. pmid:23238914
  32. 32. Parikh J, Selmi M, Charles-Edwards G, Glendenning J, Ganeshan B, Verma H, et al. Changes in primary breast cancer heterogeneity may augment midtreatment MR imaging assessment of response to neoadjuvant chemotherapy. Radiology 2014;272(1):100–12. pmid:24654970