Skip to main content
SpringerLink
Log in

Intra- and inter-rater reliability of ultrasound measures of the anterior cruciate ligament

  • Original Paper
  • Published:
Journal of Ultrasound Aims and scope Submit manuscript

Abstract

Diagnostic ultrasound has accurately and reliably been utilized by clinicians to determine ACL morphology at the tibial insertion site, specifically measuring the entire ACL diameter, the anteromedial bundle (AM), and the posterolateral bundle. However, intra- and inter-rater reliability of these measures in a research setting is unknown. The purpose of this study was to determine intra- and inter-rater reliability of ultrasound measures of ACL diameter and AM diameter in researchers with low-to-moderate ultrasound experience. We hypothesized that intra- and inter-rater reliability of ACL and AM diameters would reach acceptable levels, a minimal intraclass correlation (ICC) of 0.6 and a desired ICC of 0.8 with an α of 0.05 and β of 0.20. Fourteen volunteers participated in this study. During the ACL ultrasound measures, participants were seated with their knee flexed to at least 90°. Each rater recorded two images of both the right and left ACL and AM bundles. Next, participants were re-examined by rater one for intra-rater reliability analyses. Two-way random ICCs were conducted for intra-rater (between sessions) and inter-rater reliability for both the full ACL and the AM bundle diameters. Standard errors between sessions for Rater 1’s AM bundle and ACL diameters were less than 0.03 cm. Intra-rater reliability was higher in AM bundles compared to full ACL, 0.76 versus 0.59, respectively. Standard errors between Rater 1 and Rater 2 were less than 0.03 cm. Inter-rater reliability was higher in AM bundles compared to full ACL, 0.71 versus 0.41, respectively. The results of the study indicate researchers with low-to-moderate training with ultrasound measures can locate and measure the ACL, but with greater reliability using the AM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Ardern CL, Taylor NF, Feller JA, Webster KE (2012) Return-to-sport outcomes at 2 to 7 years after anterior cruciate ligament reconstruction surgery. Am J Sports Med 40(1):41–48

    Article  Google Scholar 

  2. Griffin LY, Albohm MJ, Arendt EA et al (2006) Understanding and preventing noncontact anterior cruciate ligament injuries: a review of the Hunt Valley II meeting, January 2005. Am J Sports Med 34(9):1512–1532

    Article  Google Scholar 

  3. Maffulli N, Longo UG, Gougoulias N, Loppini M, Denaro V (2010) Long-term health outcomes of youth sports injuries. Br J Sports Med 44(1):21–25

    Article  CAS  Google Scholar 

  4. Hewett TE, Ford KR, Hoogenboom BJ, Myer GD (2010) Understanding and preventing acl injuries: current biomechanical and epidemiologic considerations—update 2010. N Am J Sports Phys Ther 5(4):234–251

    PubMed  PubMed Central  Google Scholar 

  5. Levine JW, Kiapour AM, Quatman CE et al (2013) Clinically relevant injury patterns after an anterior cruciate ligament injury provide insight into injury mechanisms. Am J Sports Med 41(2):385–395

    Article  Google Scholar 

  6. Hewett TE, Myer GD, Ford KR (2006) Anterior cruciate ligament injuries in female athletes: part 1, mechanisms and risk factors. Am J Sports Med 34(2):299–311

    Article  Google Scholar 

  7. Myer GD, Ford KR, Hewett TE (2005) The effects of gender on quadriceps muscle activation strategies during a maneuver that mimics a high ACL injury risk position. J Electromyogr Kinesiol 15(2):181–189

    Article  Google Scholar 

  8. Mahajan PS, Chandra P, Negi VC, Jayaram AP, Hussein SA (2015) Smaller anterior cruciate ligament diameter is a predictor of subjects prone to ligament injuries: an ultrasound study. Biomed Res Int 2015:845689

    Article  Google Scholar 

  9. Anderson AF, Dome DC, Gautam S, Awh MH, Rennirt GW (2001) Correlation of anthropometric measurements, strength, anterior cruciate ligament size, and intercondylar notch characteristics to sex differences in anterior cruciate ligament tear rates. Am J Sports Med 29(1):58–66

    Article  CAS  Google Scholar 

  10. Crawford R, Walley G, Bridgman S, Maffulli N (2007) Magnetic resonance imaging versus arthroscopy in the diagnosis of knee pathology, concentrating on meniscal lesions and ACL tears: a systematic review. Br Med Bull 84:5–23

    Article  Google Scholar 

  11. Friemert B, Oberlander Y, Schwarz W et al (2004) Diagnosis of chondral lesions of the knee joint: can MRI replace arthroscopy? A prospective study. Knee Surg Sports Traumatol Arthrosc 12(1):58–64

    Article  CAS  Google Scholar 

  12. Pobozy T, Kielar M (2016) A review of ultrasonographic methods for the assessment of the anterior cruciate ligament in patients with knee instability—diagnostics using a posterior approach. J Ultrason 16(66):288–295

    Article  Google Scholar 

  13. Cholewinski JJ, Kusz DJ, Wojciechowski P, Cielinski LS, Zoladz MP (2008) Ultrasound measurement of rotator cuff thickness and acromio-humeral distance in the diagnosis of subacromial impingement syndrome of the shoulder. Knee Surg Sports Traumatol Arthrosc 16(4):408–414

    Article  Google Scholar 

  14. Khan K, Forster B, Robinson J et al (2003) Are ultrasound and magnetic resonance imaging of value in assessment of Achilles tendon disorders? A two year prospective study. Br J Sports Med 37(2):149–153

    Article  CAS  Google Scholar 

  15. Tsai W-H, Chiang Y-P, Lew RJ (2015) Sonographic examination of knee ligaments. Am Journal Phys Med Rehabil 94(8):e77–e79

    Article  Google Scholar 

  16. Hodgson R, O’Connor P, Grainger A (2012) Tendon and ligament imaging. Br J Radiol 85:1157–1172

    Article  CAS  Google Scholar 

  17. Kho JS, Almeer G, McGarry S, James SL, Botchu R (2019) Technical report: dynamic assessment of plantar fasciitis and plantar fascia tears utilising dorsiflexion of the great toe. J Ultrasound. https://doi.org/10.1007/s40477-019-00411-3

    Article  PubMed  Google Scholar 

  18. Precerutti M, Bonardi M, Ferrozzi G, Draghi F (2014) Sonographic anatomy of the ankle. J Ultrasound 17(2):79–87

    Article  CAS  Google Scholar 

  19. Galletti L, Ricci V, Andreoli E, Galletti S (2019) Treatment of a calcific bursitis of the medial collateral ligament: a rare cause of painful knee. J Ultrasound 22(4):471–476

    Article  Google Scholar 

  20. Chen P-T, Wu C-H, Yu C-W et al (2013) Sonography of the normal anterior cruciate ligament: a preliminary report. J Med Ultrason 21(1):16–20

    Article  CAS  Google Scholar 

  21. Walter SD, Eliasziw M, Donner A (1998) Sample size and optimal designs for reliability studies. Stat Med 17(1):101–110

    Article  CAS  Google Scholar 

  22. Bennett HJ, Rider PM, Domire ZJ, DeVita P, Kulas AS (2014) Heterogeneous fascicle behavior within the biceps femoris long head at different muscle activation levels. J Biomech 47(12):3050–3055

    Article  Google Scholar 

  23. Suzuki S, Kasahara K, Futami T, Iwasaki R, Ueo T, Yamamuro T (1991) Ultrasound diagnosis of pathology of the anterior and posterior cruciate ligaments of the knee joint. Arch Orthop Trauma Surg 110(4):200–203

    Article  CAS  Google Scholar 

  24. Smith J, Hackel JG, Khan U, Pawlina W, Sellon JL (2015) Sonographically guided anterior cruciate ligament injection: technique and validation. PM&R 7(7):736–745

    Article  Google Scholar 

  25. Scanlan SF, Lai J, Donahue JP, Andriacchi TP (2012) Variations in the three-dimensional location and orientation of the ACL in healthy subjects relative to patients after transtibial ACL reconstruction. J Orthop Res 30(6):910–918

    Article  Google Scholar 

  26. Abràmoff MD, Magalhães PJ, Ram SJ (2004) Image processing with ImageJ. Biophoton Intern 11(7):36–42

    Google Scholar 

  27. Gellhorn AC, Carlson MJ (2013) Inter-rater, intra-rater, and inter-machine reliability of quantitative ultrasound measurements of the patellar tendon. Ultrasound Med Biol 39(5):791–796

    Article  Google Scholar 

  28. Giavarina D (2015) Understanding bland altman analysis. Biochem Med 25(2):141–151

    Article  Google Scholar 

  29. Cohen SB, VanBeek C, Starman JS, Armfield D, Irrgang JJ, Fu FH (2009) MRI measurement of the 2 bundles of the normal anterior cruciate ligament. Orthopedics 32(9):687

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Human Movement Sciences, 2016 Student Recreation Center, Old Dominion University, Norfolk, VA, 23529, USA

    Zachary A. Sievert & Hunter J. Bennett

  2. Department of Kinesiology, Recreation, and Sport Studies, The University of Tennessee, 322 HPER Building, 1914 Andy Holt Avenue, Knoxville, TN, 37996-2700, USA

    Joshua T. Weinhandl

Authors
  1. Zachary A. Sievert
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hunter J. Bennett
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joshua T. Weinhandl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hunter J. Bennett.

Ethics declarations

Conflict of interest

The authors affirm that there is no conflict of interest for this research.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent from all participants was obtained before any participation occurred for this research study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sievert, Z.A., Bennett, H.J. & Weinhandl, J.T. Intra- and inter-rater reliability of ultrasound measures of the anterior cruciate ligament. J Ultrasound 24, 49–55 (2021). https://doi.org/10.1007/s40477-020-00450-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40477-020-00450-1

Keywords

Search

Navigation