Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

3 Tesla breast MR imaging as a problem-solving tool: Diagnostic performance and incidental lesions

  • Claudio Spick,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna (AKH), Vienna, Austria

  • Dieter H. M. Szolar,

    Roles Investigation, Resources, Supervision, Writing – review & editing

    Affiliation Diagnostikum Graz, Graz, Austria

  • Klaus W. Preidler,

    Roles Investigation, Resources, Supervision, Writing – review & editing

    Affiliation Diagnostikum Graz, Graz, Austria

  • Pia Reittner,

    Roles Investigation, Resources, Supervision, Writing – review & editing

    Affiliation Diagnostikum Graz, Graz, Austria

  • Katharina Rauch,

    Roles Data curation, Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Diagnostikum Graz, Graz, Austria

  • Peter Brader,

    Roles Investigation, Resources, Supervision, Writing – review & editing

    Affiliation Diagnostikum Graz, Graz, Austria

  • Manfred Tillich ,

    Roles Conceptualization, Data curation, Investigation, Resources, Supervision, Writing – review & editing

    manfred.tillich@diagnostikum-graz.at

    Affiliation Diagnostikum Graz, Graz, Austria

  • Pascal A. Baltzer

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna (AKH), Vienna, Austria

Abstract

Purpose

To investigate the diagnostic performance and incidental lesion yield of 3T breast MRI if used as a problem-solving tool.

Methods

This retrospective, IRB-approved, cross-sectional, single-center study comprised 302 consecutive women (mean: 50±12 years; range: 20–79 years) who were undergoing 3T breast MRI between 03/2013-12/2014 for further workup of conventional and clinical breast findings. Images were read by experienced, board-certified radiologists. The reference standard was histopathology or follow-up ≥ two years. Sensitivity, specificity, PPV, and NPV were calculated. Results were stratified by conventional and clinical breast findings.

Results

The reference standard revealed 53 true-positive, 243 true-negative, 20 false-positive, and two false-negative breast MRI findings, resulting in a sensitivity, specificity, PPV, and NPV of 96.4% (53/55), 92.4% (243/263), 72.6% (53/73), and 99.2% (243/245), respectively. In 5.3% (16/302) of all patients, incidental MRI lesions classified BI-RADS 3–5 were detected, 37.5% (6/16) of which were malignant. Breast composition and the imaging findings that had led to referral had no significant influence on the diagnostic performance of breast MR imaging (p>0.05).

Conclusion

3T breast MRI yields excellent diagnostic results if used as a problem-solving tool independent of referral reasons. The number of suspicious incidental lesions detected by MRI is low, but is associated with a substantial malignancy rate.

Introduction

Mammography and ultrasound are established tests in the diagnosis of breast cancer [13]. Still, these imaging modalities regularly yield inconclusive findings where the presence of breast cancer cannot be confirmed or excluded. In these cases, image-guided biopsies are performed to establish a diagnosis. Biopsy, however, is challenging if findings are difficult to localize, as is the case in architectural distortions or diffuse and multiple lesions. In this uncommon but diagnostic challenging setting, breast MR imaging can be used as a problem-solving tool, which can either help guide or avoid biopsies due to its high sensitivity and soft tissue contrast. This indication for MR imaging is, however, controversial in the imaging community [47]. While breast MR imaging provides a very high sensitivity and negative predictive value, particularly in non-calcified breast lesions [5,8], a recent meta-analysis highlighted important research gaps: problem-solving definitions are not well-defined and the empirical evidence about specific indications, such as architectural distortions, is sparse [5,9,10]. In addition, it remains unclear whether MR imaging actually facilitates the work-up of inconclusive cases or not. Additional MR imaging findings that are unrelated to the reason for the original referral require further work-up, which is justified if additional cancer lesions are detected, but is ultimately unnecessary in case of benign lesions.

Consequently, the purpose of this study was to evaluate the diagnostic performance and incidental lesion yield of breast MR imaging if used as a problem-solving tool and align these results with original referral reasons.

Materials and methods

Case selection and reference standard

Eligible for this retrospective, single-center, IRB-approved study were women who were consecutively referred to our institution (Diagnostikum Graz), an independent cross-sectional imaging centre receiving outpatients from multiple referring physicians. Patients were referred for breast MR examinations due to findings on digital mammography and/or ultrasound between March 2013 and December 2014. Specifically, we included those patients in that according with our national health care system regulations received an interim BI-RADS 0 category (further imaging assessment required) assignment. This problem-solving indication includes a variety of findings such as discrepancies between MG and US such as asymmetric densities without US correlate, lesions with discrepant size in both modalities, lesions with equivocal morphology in either both or one of these modalities and multiple lesions. The indication for MR imaging in this setting is assessed by the representative physicians of the medical authorities, in compliance with national health regulations. This study was conducted according to STARD (S1 File).

Included in this study were those women who had a reference standard of either histopathology or imaging follow-up at 24 months. Histopathological diagnosis was established either by image-guided biopsy (ultrasound-guided core biopsy or vacuum-assisted biopsy under mammography/MR imaging guidance) or open surgery. Experienced breast pathologists performed the breast tissue specimen work-up. Lesions classified as benign by imaging or histopathology were followed up by imaging (mammography, ultrasound, or MR imaging, as appropriate) for at least 24 months. Excluded were patients with contraindications against MR imaging or incomplete MR imaging scans.

MR imaging

MR imaging was performed on a 3T magnet (Magnetom Skyra, Siemens Medical Solutions®, Erlangen, Germany) using the vendor-supplied, 16-channel dedicated breast coil. Breast MR imaging examinations were generally scheduled in the second week of the menstrual cycle in premenopausal women. Menopausal patients who were receiving hormonal replacement therapy were requested to cease treatment one month before the examination [11].

The imaging protocol encompassed an axial T2w-TSE sequence (Turbo Spin Echo DIXON fast, TR 6500 ms, TE 81 ms, flip angle 120°, spatial resolution 4 mm3, 35 slices, time of acquisition 2:10 minutes), and a readout-segmented, multi-shot echo planar imaging-based, diffusion-weighted imaging sequence (RESOLVE, TR 5500 ms, TE1 56 ms, TE2 88 ms, b-values 0 and 800 s/mm2, spatial resolution 1.9 x 1.9 x 5 mm 18 mm3, 28 slices, no interslice gap, three orthogonal directions, one average, acquisition time 3:36 min). The scanner software (Syngo MR E11, release number: N_4VE11C) automatically calculated the Apparent Diffusion Coefficient (ADC) maps. T1-weighted images were acquired as follows: FLASH 3D; SPAIR fat saturation; TR 4.89 ms; TE 1.81 ms; flip angle 10°; spatial resolution 0.9 x 0.9 x 1.8 mm 1.5 mm3; and time of acquisition 1:10 minutes per measurement. These were obtained once before and four times after the intravenous injection of 0.1 mmol/kg gadoteridol (Prohance®, BRACCO, Milano, Italy). Between postcontrast measurements 3 and 4, an interleaved, isotropic, high-resolution T1w sequence was acquired (FLASH 3D, SPAIR fat saturation, TR 7.33 ms, TE 3.73 ms, flip angle 15°, spatial resolution 0.9 mm isotropic, time of acquisition 2:26). Image subtractions were calculated in-line by the scanner software (Syngo MR E11, release number: N_4VE11C). Overall acquisition magnet time for this protocol was less than 15 minutes.

MR image interpretation

All imaging data was read during routine clinical practice by one of four board-certified radiologists with >10 years of experience. Results were saved in a prospectively populated database within our institution´s electronic information system. Image interpretation was performed according to the American College of Radiology BI-RADS® lexicon using morphologic and dynamic enhancement criteria [12] before any histopathological sampling. Signal intensity time curves were measured by Regions-of-Interest placed in the most enhancing part of the lesion [13]. Image interpretation during routine clinical practice considered the results of prior images as this facilitates image interpretation [14]. In addition, lesions showing high ADC values were considered benign as suggested in the literature [1518]. Lesions without contrast-enhancement on MRI were generally considered benign.

Data analysis

Data were extracted from our institutional prospectively populated database into a computerized spreadsheet (Excel: Microsoft, Redmond, WA).

Receiver-Operating-Characteristics (ROC) analysis was performed using BI-RADS as the classification variable and final diagnosis, based on the reference standard (benign versus malignant), as the reference variable. Lesions were considered malignant if image-guided biopsy or surgery, or both, confirmed invasive carcinoma or DCIS. The reference standard for benign lesions was histopathology (biopsy and/or surgery) and imaging follow-up of at least two years or only imaging follow-up of at least two years. Histopathological diagnoses were established by board-certified breast pathologists.

MR imaging reading results were compared to reference standard results to calculate true positive (TP), true negative (TN), false positive (FP), and false negative (FN) findings. For this purpose, BI-RADS category assignments 1–3 were considered negative and 4–5 positive. Additional evaluation of diagnostic parameters was performed considering BI-RADS category assignments 1 and 2 negative and 3–5 positive.

The diagnostic parameters sensitivity TP/(TP+FN), specificity TN/(TN+FP), positive predictive value (PPV) TP/(TP+FP), and negative predictive value (NPV) TN/(TN+FN) were stratified by clinical presentation, conventional imaging findings, and breast density, and were compared using McNemar tests. A P-value ≤0.05 was considered to indicate a significant result.

Results

Patients and lesions

Of 322 patients, 302 women (mean age, 50±12 years; range, 20–79 years) fulfilled the inclusion criteria, and comprised the study cohort. Twenty patients (6%) with MR imaging BI-RADS 2 (n = 18) and MR imaging BI-RADS 3 (n = 2) ratings were lost to follow-up. Thus, 302 patients were included in the analysis. Indications for the examination are listed in Table 1.

thumbnail
Table 1. Summary of the results of this study: MRI findings are stratified by conventional imaging findings, clinical presentation, and ACR breast composition.

Resulting cancer prevalence, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) considering BI-RADS 4 and 5 as positive and BI-RADS 1–3 as negative MRI results.

https://doi.org/10.1371/journal.pone.0190287.t001

Breast MR imaging revealed 144 (45.3%) mass lesions that demonstrated a mean size of 15.3 mm ± 14.3 mm (SD; range, 4–95 mm). Further, there were 44 (13.8%) non-mass enhancements with a mean size of 29.2 mm ± 23.1 mm (SD; range, 4–75 mm).

Final lesion diagnoses were malignant in 55 of 318 lesions (44 mass and 11 non-mass), and benign in 263 (100 mass, 33 non-mass lesions, and 130 without contrast-enhancing correlates in MR imaging). Malignant histopathological diagnoses were: invasive ductal carcinoma (IDC) in 43 (35 mass and eight non-mass); and ductal carcinoma in situ (DCIS) in 12 (nine mass and three non-mass) cases. BI-RADS ratings were assigned as follows: BI-RADS 1/2: 184 (0 malignant); BI-RADS 3: 61 (two malignant); BI-RADS 4: 39 (20 malignant); and BI-RADS 5: 34 (33 malignant). Twenty lesions classified as MR imaging BI-RADS 4/5 showed benign histopathology after image-guided biopsy.

The prevalence of malignancy was 17.3% (55 of 318). The malignancy rate tended to be higher in mass lesions (30.6%, 44 of 144) compared to non-mass lesions (25%, 11 of 44) though this was not statistically significant (P = 0.599). None of the 130 conventional findings without an enhancing MR imaging correlate was malignant.

Malignancy rates differed according to clinical and conventional findings (Table 1). Lesions that presented as a mammographic mass with architectural distortion had the highest probability for malignancy (42.1%), while pure architectural distortions and microcalcifications had the lowest malignancy rates (11.6% and 11.5%, respectively). Details on MR imaging results stratified by clinical presentation and imaging findings are given in Table 1.

Diagnostic performance

ROC analysis (Fig 1) revealed an area under the ROC curve of 0.977 (95% CI: 0.963–0.992). Considering BI-RADS 4 and 5 malignant and 1–3 benign the reference standard revealed 53 true-positive, 243 true-negative, 20 false-positive, and two false-negative breast MR imaging findings (Fig 2). All underlying data are given in the S2 File. The sensitivity, specificity, and positive and negative predictive values were calculated as: 96.4% (95% CI: 87.5–99.6%), 92.4% (95% CI: 88.5–95.3%), 72.6% (95% CI 60.9–82.4%), and 99.2% (95% CI: 97.1–99.0%), respectively. Upon subgroup analysis, no significant differences in diagnostic parameters were found when stratified by conventional imaging findings, clinical presentation, and breast density (P>0.05). Both false-negative findings were assigned BI-RADS 3 and diagnosed due to changes after short-term follow-up.

thumbnail
Fig 1. ROC plot of BI-RADS ratings against the reference standard.

At a cut-off of >BI-RADS 3, the sensitivity and specificity were 96.4% and 92.4%, respectively. In addition, at a cut-off of >BI-RADS 2 the sensitivity and specificity were 100% and 70.3%, respectively.

https://doi.org/10.1371/journal.pone.0190287.g001

thumbnail
Fig 2.

A 52-year-old patient referred for problem-solving due to newly diagnosed architectural distortion in the left breast (A; white circles on mammography images). 3T contrast-enhanced MR imaging (B; top: T2w image, middle: early contrast-enhanced image, bottom: late contrast-enhanced image) shows the architectural distortion (white circle) demonstrating only mild background enhancement. The lesion was classified as BI-RADS 2, definitely benign. Follow-up of two years did not reveal malignancy.

https://doi.org/10.1371/journal.pone.0190287.g002

Considering BI-RADS 3–5 malignant and 1 and 2 benign the reference standard revealed 55 true-positive, 185 true-negative, 78 false-positive, and no false-negative breast MR imaging findings. The sensitivity, specificity, and positive and negative predictive values were calculated as: 100% (95% CI: 93.5–100%), 70.3% (95% CI: 64.4–75.8%), 41.4% (95% CI 36.9–45.9%), and 100%, respectively.

Incidental MR imaging lesions

Incidental lesions identified by MR imaging and assigned BI-RADS 3–5 categories were identified in 16 of 302 patients (5.3%). Of these, six lesions (37.5%, 6/16) proved to be malignant. One lesion was assigned a false-negative BI-RADS 3 and the lesion was upgraded upon six-month follow-up, which was initiated due to the MR imaging findings. Consequently, 10.9% (6/55) of all malignant lesions were detected only by MR imaging and presented multifocal or multicentric disease that did not show any conventional imaging correlates. All these lesions measured ≤10 mm. All other lesions detected outside the area of the conventional imaging findings by MR imaging were given BI-RADS category 2 assignments and not considered as incidental lesions for this analysis.

Discussion

Breast MR imaging yields excellent diagnostic results if used as a problem-solving tool independent of referral reasons. The number of suspicious incidental lesions detected by MR imaging is low, but has a substantial malignancy rate. Our study population included the largest number to date, to our knowledge, of patients undergoing 3 Tesla breast MR imaging for problem-solving. Breast MR imaging had a high negative predictive value of 99.2% and a high PPV of 72.6%. In other words, only three of 10 biopsies recommended based on positive breast MR imaging (BI-RADS 4 and 5) findings were false-positive, and thus, unnecessary, while in eight of 10 patients with a negative MRI result (BI-RADS 1–3), biopsies or further follow-up examinations could be avoided. This came at the cost of two false-negative findings—both of which, however, were detected by short-term follow-up examinations that were initiated due to breast MR imaging BI-RADS 3 lesions, and one of which was detected exclusively by MR imaging. Therefore, all cancers were visualized as enhancing lesions by breast MR imaging. These findings validate that MR imaging is a safe diagnostic instrument if applied as a problem-solving tool in inconclusive cases, as malignancy can be reliably excluded. Furthermore, the number of incidental MR imaging findings that required follow-up or invasive diagnostic procedures was as low as 5.3%, but yielded a substantial malignancy rate of 37.5%. Our multiparametric breast MR imaging protocol is a fast diagnostic test, allowing the examination of up to four patients per hour. Image interpretation and reporting takes only a few minutes and results in high sensitivity and negative predictive values. Thus, breast MR imaging as a problem-solving tool improves patient care by avoiding the anxiety related to follow-up examinations and possibly missed cancer diagnoses.

The indication “problem-solving” for breast MR imaging has been a controversial topic. While a recent meta-analysis corroborated the ability of breast MR imaging to exclude cancer in non-calcified lesions [5], MR imaging might not be as accurate in lesions that present as microcalcifications [8]. Although, based on a rather small study population, our results demonstrated excellent sensitivity and NPV in calcified lesions, a fact that might be explained by the more modern equipment, namely, 3 Tesla in combination with a multichannel coil and high-resolution 3D gradient-echo, T2w, and DWI imaging. None of previous studies investigated this clinical setting exclusively with 3 Tesla breast MR imaging [5,10]. These results are particularly interesting as stereotactically-guided biopsies are more invasive and expensive than US-guided biopsies. Here, MRI would be a valuable test for risk stratification to avoid or guide biopsy in case of multiple or equivocal microcalcifications.

The aforementioned meta-analysis concluded that problem-solving definitions are not well-formulated and the empirical evidence about the performance of breast MR imaging in specific imaging findings that lead to MR imaging, e.g., such as architectural distortions, is sparse [4,5,10,19]. Here, our study directly adds data, as it provides a detailed analysis of the findings that led to the breast MR imaging examination and associates these findings with diagnostic outcomes. Of note, breast MR imaging performance was similar across different indications. Variations were seen regarding malignancy rates and subsequent PPVs, but malignancy could be excluded with high certainty independent of specific indications. Therefore, this study confirms that problem-solving MR imaging is a reliable tool that performs well under varying conditions. Based on our results, we consider all the indications for breast MR imaging investigated in this work as appropriate. Still, we need to stress that breast MR imaging should not generally be used for further evaluation of conventional lesions that can definitely be clarified by US-guided biopsy [9,10,13]. Problem-solving in such lesions would be necessary in case of multiple or difficult to localize lesions that are likely to be missed by immediate biopsy. Although a general application of MR imaging in such lesions has demonstrated excellent diagnostic performance, percutaneous biopsy is readily available, easily tolerated, and leads to a faster definite diagnosis [19, 20, 21].

Breast MR imaging is known to detect more cancers than conventional tests, such as mammography and ultrasound. A common concern among breast imagers is that the inherent higher sensitivity of breast MR imaging will lead to the detection of multiple additional lesions that require further workup. Our data show that this number is, first, as low as 5.3% and, second, entails a substantial malignancy rate of 38%. A recent study showed a similar malignancy rate of 33% (7/22) in suspicious MRI-only lesions [10]. Consequently, our results do not show a relevant number of additional recalls due to the application of MR imaging in the investigated setting. However, suspicious MRI-only lesions warrant further evaluation. Prior studies showed higher rates of incidental recalls between 8.3%-15.6%, with a malignancy rate of these lesions ranging from 0–17% [19,22,23]. The lower recall rate and higher prevalence of malignancy in our cohort is likely due to the exclusive use of 3T multiparametric MR imaging.

We are obliged to mention the limitations of the current study. Twenty patients (6.2%) were lost to follow-up. While this rate is well within the acceptable range, false-negative findings could have been missed, resulting in the low possibility of overestimating sensitivity. The retrospective character of this study did not allow an assessment of inter-reader agreement. However, all examinations were read under routine clinical conditions by experienced breast radiologists. The performance of experienced radiologists has been shown to be superior to that of non-experienced radiologists in the interpretation of breast MR imaging [24]. Further, breast MR images were interpreted considering conventional imaging and clinical findings, an approach that has been recommended, as it improves diagnostic accuracy in non-mass lesions [14]. Accordingly, our audit reflects the actual clinical setting, and thus, provides more representative results as a retrospective reader study under research conditions. Our results were obtained using a fast (<15 min) multiparametric breast MR imaging protocol (T2w, DWI and DCE-MR imaging) at 3 Tesla, using multichannel coil technology. Again, the retrospective character of our study does not allow conclusions on the respective contribution of individual parameters to the final diagnosis. Our experience is, however, in line with prior publications that showed high specificity when T2w or DWI sequences were applied [15,16,18,25].

In conclusion, breast MR imaging yields excellent diagnostic results if used as a problem-solving tool independent of referral reasons. The number of suspicious incidental lesions detected by MR imaging is low, but has a substantial malignancy rate.

Supporting information

S2 File. SPSS table of the raw study data.

https://doi.org/10.1371/journal.pone.0190287.s002

(SAV)

References

  1. 1. Perry N, Broeders M, Wolf C de, Törnberg S, Holland R, Karsa L von. European guidelines for quality assurance in breast cancer screening and diagnosis. Fourth edition—summary document. Ann Oncol. 2008 Apr 1;19(4):614–22. pmid:18024988
  2. 2. NCCN Clinical Practice Guidelines in Oncology. Breast Cancer Version 2.2017 [https://www.nccn.org/professionals/physician_gls/pdf/breast.pdf]. National Comprehensive Cancer Network website.
  3. 3. Early and locally advanced breast cancer: diagnosis and treatment | Guidance and guidelines | NICE [https://www.nice.org.uk/guidance/cg80]. [cited 2016 Feb 21].
  4. 4. Giess CS, Chikarmane SA, Sippo DA, Birdwell RL. Breast MR Imaging for Equivocal Mammographic Findings: Help or Hindrance? Radiogr Rev Publ Radiol Soc N Am Inc. 2016 Aug;36(4):943–56.
  5. 5. Bennani-Baiti B, Bennani-Baiti N, Baltzer PA. Diagnostic Performance of Breast Magnetic Resonance Imaging in Non-Calcified Equivocal Breast Findings: Results from a Systematic Review and Meta-Analysis. PloS One. 2016;11(8):e0160346. pmid:27482715
  6. 6. American College of Radiology (ACR). ACR practice parameter for the performance of contrast-enhanced magnetic resonance imaging (MRI) of the breast [https://www.acr.org/-/media/ACR/Files/Practice-Parameters/mr-contrast-breast.pdf?la=en].
  7. 7. Sardanelli F, Boetes C, Borisch B, Decker T, Federico M, Gilbert FJ, et al. Magnetic resonance imaging of the breast: recommendations from the EUSOMA working group. Eur J Cancer Oxf Engl 1990. 2010 May;46(8):1296–316.
  8. 8. Bennani-Baiti B, Baltzer PA. MR Imaging for Diagnosis of Malignancy in Mammographic Microcalcifications: A Systematic Review and Meta-Analysis. Radiology. 2016 Oct 27;161106.
  9. 9. Spick C, Szolar DHM, Preidler KW, Tillich M, Reittner P, Baltzer PA. Breast MRI used as a problem-solving tool reliably excludes malignancy. Eur J Radiol. 2015 Jan;84(1):61–4. pmid:25454098
  10. 10. Giess CS, Chikarmane SA, Sippo DA, Birdwell RL. Clinical Utility of Breast MRI in the Diagnosis of Malignancy After Inconclusive or Equivocal Mammographic Diagnostic Evaluation. Am J Roentgenol. 2017 Mar 7;1–8.
  11. 11. Mann RM, Kuhl CK, Kinkel K, Boetes C. Breast MRI: guidelines from the European Society of Breast Imaging. Eur Radiol. 2008 Jul;18(7):1307–18. pmid:18389253
  12. 12. American College of Radiology. American College of Radiology. Breast Imaging Reporting and Data System (BI-RADS®). 2003.
  13. 13. Baltzer PAT, Freiberg C, Beger S, Vag T, Dietzel M, Herzog AB, et al. Clinical MR-mammography: are computer-assisted methods superior to visual or manual measurements for curve type analysis? A systematic approach. Acad Radiol. 2009 Sep;16(9):1070–6. pmid:19523854
  14. 14. Thomassin-Naggara I, Trop I, Chopier J, David J, Lalonde L, Darai E, et al. Nonmasslike enhancement at breast MR imaging: the added value of mammography and US for lesion categorization. Radiology. 2011 Oct;261(1):69–79. pmid:21771958
  15. 15. Spick C, Pinker-Domenig K, Rudas M, Helbich TH, Baltzer PA. MRI-only lesions: application of diffusion-weighted imaging obviates unnecessary MR-guided breast biopsies. Eur Radiol. 2014 Jun;24(6):1204–10. pmid:24706105
  16. 16. Baltzer A, Dietzel M, Kaiser CG, Baltzer PA. Combined reading of Contrast Enhanced and Diffusion Weighted Magnetic Resonance Imaging by using a simple sum score. Eur Radiol. 2016 Mar;26(3):884–91. pmid:26115653
  17. 17. Partridge SC, DeMartini WB, Kurland BF, Eby PR, White SW, Lehman CD. Quantitative diffusion-weighted imaging as an adjunct to conventional breast MRI for improved positive predictive value. AJR Am J Roentgenol. 2009 Dec;193(6):1716–22. pmid:19933670
  18. 18. Pinker K, Bickel H, Helbich TH, Gruber S, Dubsky P, Pluschnig U, et al. Combined contrast-enhanced magnetic resonance and diffusion-weighted imaging reading adapted to the “Breast Imaging Reporting and Data System” for multiparametric 3-T imaging of breast lesions. Eur Radiol. 2013 Jul;23(7):1791–802. pmid:23504036
  19. 19. Yeh ED, Giess CS. Problem Solving Breast MRI for Mammographic, Sonographic, or Clinical Findings. In: Heller SL, Moy L, editors. Breast Oncology: Techniques, Indications, and Interpretation. Springer International Publishing; 2017. p. 141–61. http://link.springer.com/chapter/10.1007/978-3-319-42563-4_7
  20. 20. Lee CH. Problem solving MR imaging of the breast. Radiol Clin North Am. 2004 Sep;42(5):919–934, vii. pmid:15337425
  21. 21. Strobel K, Schrading S, Hansen NL, Barabasch A, Kuhl CK. Assessment of BI-RADS category 4 lesions detected with screening mammography and screening US: utility of MR imaging. Radiology. 2015 Feb;274(2):343–51. pmid:25271857
  22. 22. Lee CH, Smith RC, Levine JA, Troiano RN, Tocino I. Clinical usefulness of MR imaging of the breast in the evaluation of the problematic mammogram. AJR Am J Roentgenol. 1999 Nov;173(5):1323–9. pmid:10541112
  23. 23. Moy L, Elias K, Patel V, Lee J, Babb JS, Toth HK, et al. Is breast MRI helpful in the evaluation of inconclusive mammographic findings? AJR Am J Roentgenol. 2009 Oct;193(4):986–93. pmid:19770320
  24. 24. Baltzer PAT, Kaiser WA, Dietzel M. Lesion type and reader experience affect the diagnostic accuracy of breast MRI: A multiple reader ROC study. Eur J Radiol. 2015 Jan;84(1):86–91. pmid:25466772
  25. 25. Baltzer PAT, Dietzel M, Kaiser WA. Nonmass lesions in magnetic resonance imaging of the breast: additional T2-weighted images improve diagnostic accuracy. J Comput Assist Tomogr. 2011 Jun;35(3):361–6. pmid:21586932