Abstract
At present, ‘gold standard’ diagnosis of autism spectrum disorders (ASD) is a lengthy and time consuming process that requires suitably qualified multi-disciplinary team (MDT) personnel to assess behavioural, historical, and parent-report information to determine a diagnosis. A number of different tools have been developed to assist in determination. To optimise the diagnostic procedures, the best diagnostic instruments need to be identified. This study is a systematic review addressing the accuracy, reliability, validity and utility of reported diagnostic tools and assessments. To be included in this review, studies must have (1) identified an ASD diagnostic tool; (2) investigated either diagnostic procedure or the tools or personnel required; (3) be presented in English; (4) be conducted in the Western world; (5) be one of three types of studies [adapted from Samtani et al. in Cochrane Database Syst Rev 3:1–13, 2011], viz. (a) cohort studies or cross-sectional studies, (b) randomised studies of test accuracy, (c) case–control studies. MEDLINE, PsychINFO, Scopus, EMBASE, and Cochrane Library databases were scrutinised for relevant literature published from 2000 inclusive on 20th January 2012. In total, 68 articles were included. 17 tools were assessed. However, many lacked an evidence base of high quality-independent studies. The Autism Diagnostic Interview-Revised (ADI-R) and Autism Diagnostic Observation Schedule (ADOS) stood out with the largest evidence base and highest sensitivity and specificity. When the ADI-R and ADOS were used in combination they revealed levels of accuracy very similar to the correct classification rates for the current ‘gold standard’ diagnostic procedure viz. 80.8 % for ASD. There is scope for future studies on the use of the ADI-R and ADOS in combination.


Similar content being viewed by others
Abbreviations
- MDT:
-
Multi-disciplinary team
- ADOS:
-
Autism diagnostic observation schedule
- ADI-R:
-
Autism diagnostic interview-revised
References
American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorders, 4th edn. APA, Washington, DC
World Health Organisation (1993) The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research. WHO, Geneva
Ritvo RA, Ritvo ER (2008) Clinical evidence that Asperger’s disorder is a mild form of autism. Compr Psychiatry 49(1):1–5
Wing L, Gould J, Gillberg C (2011) Autism spectrum disorders in the DSM-V: better or worse than the DSM-IV? Res Dev Disabil 32(2):768–773. doi:10.1016/j.ridd.2010.11.003
Kabot S, Masi W, Segal M (2003) Advancs in the diagnostic treatment of Autism spectrum disorders. Prof Psychol Res Pract 34(1):26–33
Filipek PA, Acardo PJ, Ashwal S (2000) Practice parameter: screening and diagnosis of autsim: report of the quality standards subcommittee of the American Academy of Neurology and the Child Neurology Society. Neurology 55:468–479
Matson JL, Wilkins J, Gonzalez ML (2007) Early identification and diagnosis in autism spectrum disorders in young children and infants: how early is too early? Res Autism Spectr Disord 2:75–84
Sikora DM, Hall TA, Hartley SL, Gerrard-Morris AE, Cagle S (2008) Does parent report of behavior differ across ADOS-G classifications: analysis of scores from the CBCL and GARS. J Autism Dev Disord 38(3):440–448
South M, Williams BJ, McMahon WM, Owley T, Filipek PA, Shernoff E, Corsello C, Lainhart JE, Landa R, Ozonoff S (2002) Utility of the Gilliam Autism Rating Scale in research and clinical populations. J Autism Dev Disord 32(6):593–599
Mayes SD, Calhoun SL, Murray MJ, Morrow JD, Yurich KKL, Mahr F, Cothren S, Purichia H, Bouder JN, Petersen C (2009) Comparison of scores on the checklist for Autism Spectrum disorder, Childhood Autism Rating Scale, and Gilliam Asperger’s Disorder Scale for children with low functioning autism, high functioning autism, Asperger’s disorder, ADHD, and typical development. J Autism Dev Disord 39(12):1682–1693
Samtani A, Sterling-Levis K, Scholten R, Woolfenden S, Hooft L, Williams K (2011) Diagnostic tests for Autism Spectrum Disorders (ASD) in preschool children. Cochrane Database Syst Rev 3:1–13
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174
Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6(4):284–290
Chlebowski C, Green JA, Barton ML, Fein D (2010) Using the childhood autism rating scale to diagnose autism spectrum disorders. J Autism Dev Disord 40(7):787–799
Ozonoff S (2005) Evidence-Based Assessment of Autism Spectrum Disorders in Children and Adolescents. J clin child adolesc psychol 34(3):523–540
Le Couteur A, Haden G, Hammal D, McComachie H (2008) Diagnosing Autism Spectrum disorders in pre-school children using two standardised assessment instruments: the ADI-R and the ADOS. J Autism Dev Disord 38(2):362–372
Woolfenden S, Sarkozy V, Ridley G, Williams K (2012) A systematic review of the diagnostic stability of Autism Spectrum Disorder. Res Autism Spectr Disord 6:345–354
Chlebowski C, Green JA, Barton ML, Fein D (2010) Using the Childhood Autism Rating Scale to diagnose Autism Spectrum Disorders. J Autism Dev Disord 40(7):787–799
Norris M, Lecavalier L (2010) Screening accuracy of level 2 Autism Spectrum Disorder rating scales: a review of selected instruments. Autism 14(4):263–284
National Institute of Health and Clinical Excellence Clinical Guideline (2011) Autism: Recognition, referral and diagnosis of children and young people on the autism spectrum. RCOG Press, London
Bishop DVM, Norbury CF (2002) Exploring the borderlands of autistic disorder and specific language impairment: a study using standardised diagnostic instruments. J Child Psychol Psychiatry 43(7):917–929
Kim SH, Lord C (2012) Combining information from multiple sources for the diagnosis of Autism Spectrum Disorders for toddler and young preschoolers from 12 to 47 months of age. J Child Psychol Psychiatry 53(2):143–151
Risi S, Lord C, Gotham K, Corsello C, Chrysler C, Szatmari P, Cook E, Leventhal B, Pickles A (2006) Combining information from multiple sources in the diagnosis of Autism Spectrum Disorders. J Am Acad Child Adolesc Psychiatry 45(9):1094–1103
Klein Tasman BP, Risi S, Lord CE (2007) Effect of language and task demands on the diagnostic effectiveness of the Autism Diagnostic Observation schedule: the impact of module choice. J Autism Dev Disord 37(7):1224–1234
Tomanik SS, Pearson DA, Loveland KA, Lane DM, Shaw JB (2007) Improving the reliability of autism diagnoses: examining the utility of adaptive behavior. J Autism Dev Disord 37(5):921–928
Kleinman JM, Ventola PE, Pandey J, Verbalis AD, Barton ML, Hodgson S, Green JA, Dumont-Mathieu T, Robins DL, Fein D (2008) Diagnostic stability in very young children with Autism Spectrum Disorders. J Autism Dev Disord 38(4):606–615
Wiggins LD, Robins DL (2008) Brief report: excluding the ADI-R behavioral domain improves diagnostic agreement in toddlers. J Autism Dev Disord 38(5):972–976
Lord C, Risi S, Lambrecht L, Cook EHJ, Leventhal BL, DiLavore PC, Pickles A, Rutter M (2000) The Autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord 30(3):205–223
Noterdaeme M, Mildenberger K, Sitter S, Amorosa H (2002) Parent information and direct observation in the diagnosis of pervasive and specific developmental disorders. Autism 6(2):159–168
Ventola PE, Kleinman JM, Pandey J, Barton ML, Allen S, Green JA, Robins DL, Fein D (2006) Agreement among four diagnostic instruments for Autism Spectrum Disorders in toddlers. J Autism Dev Disord 36(7):839–847
Mazefsky CA, Oswald DP (2006) The discriminative ability and diagnostic utility of the ADOS-G, ADI-R, and GARS for children in a clinical setting. Autism 10(6):533–549
Chawarska K, Klin A, Paul R, Volkmar F (2007) Autism Spectrum disorder in the second year: stability and change in syndrome expression. J Child Psychol Psychiatry 48(2):128–138
Sikora DM, Hartley SL, McCoy R, Gerrard-Morris AE, Dill K (2008) The performance of children with mental health disorders on the ADOS-G: a question of diagnostic utility. Res Autism Spectr Disord 2(1):188–197
Papanikolaou K, Paliokosta E, Houliaras G, Vgenopoulou S, Giouroukou E, Pehlivanidis A, Tomaras V, Tsiantis I (2009) Using the Autism diagnostic interview-revised and the Autism diagnostic observation schedule-generic for the diagnosis of Autism spectrum disorders in a Greek sample with a wide range of intellectual abilities. J Autism Dev Disord 39(3):414–420
de Bildt A, Sytema S, Ketelaars C, Kraijer D, Mulder E, Volkmar F, Minderaa R (2004) Interrelationship between Autism diagnostic observation schedule-generic (ADOS-G), Autism diagnostic interview-revised (ADI-R), and the diagnostic and statistical manual of mental disorders (DSM-IV-TR) classification in children and adolescents with mental retardation. J Autism Dev Disord 34(2):129–137
Gotham K, Risi S, Pickles A, Lord C (2007) The Autism diagnostic observation schedule: revised algorithms for improved diagnostic validity. J Autism Dev Disord 37(4):613–627
Gray KM, Tonge BJ, Sweeney DJ (2008) Using the Autism diagnostic interview-revised and the Autism diagnostic observation schedule with young children with developmental delay: evaluating diagnostic validity. J Autism Dev Disord 38(4):657–667
Gotham K, Risi S, Dawson G, Tager-Flusber H, Joseph R, Certer A, Hepburn S, McMahon W, Rodier P, Hyman SL, Sigman M, Rogers S, Landa R, Spence A, Osann K, Flodman P, Volkmar F, Holllander E, Buxbaum J, Pickles A, Lord C (2008) A replication of the Autism diagnostic observation schedule (ADOS) revised algorithms. J Am Acad Child Adolesc Psychiatry 47(6):642–651
de Bildt A, Systema S, van Lang NDJ, Minderaa RB, van Engeland H, de Jonge MV (2009) Evaluation of the ADOS revised algorithm: the applicability in 558 dutch children and adolescents. J Autism Dev Disord 39(9):1350–1358
Oosterling I, Ros S, de Bildt A, Rommelse N, de Jonge M, Visser J, Lappenschaar M, Swinkels S, Jan van der Gaag R, Buitellar J (2010) Improved diagnostic validity of the ADOS revised algorithms: a replication study in an independent sample. J Autism Dev Disord 40(6):689–703
Molloy CA, Murray DS, Akers R, Mitchel T, Manning-Courtney P (2011) Use of the Autism diagnostic observation schedule (ADOS) in a clinical setting. Autism 15(2):143–162
Bastiaansen JA, Meffert H, Hein S, Huizinga P, Ketelaars C, Pijnenborg M, Bartels A, Minderaa R, Keysers C, de Bildt A (2011) Diagnosing Autism spectrum disorders in adults: the use of Autism diagnostic observation schedule (ADOS) module 4. J Autism Dev Disord 41(9):1256–1266
Luyster R, Gotham K, Guthrie W, Coffing M, Petrak R, Pierce K, Bishop S, Esler A, Hus V, Oti R, Richler J, Risi S, Lord C (2009) The Autism diagnostic observation schedule-toddler module: a new module of a standardized diagnostic measure for Autism spectrum disorders. J Autism Dev Disord 39(9):1305–1320
Berument SK, Starr E, Pickles A, Tomlins M, Papanikolaou K, Lord C, Rutter M (2005) Pre-linguistic autism diagnostic observation schedule adapted for older individuals with severe to profound mental retardation: a pilot study. J Autism Dev Disord 35(6):821–829
Lord C, Risi S, DiLavore PS, Shulman C, Thurm A, Pickles A (2006) Autism from 2 to 9 years of age. Arch Gen Psychiatry 63(6):694–701
Bryson SE, Zwaigenbaum L, McDermott C, Rombough V, Brian J (2008) The Autism observation scale for infants: scale development and reliability data. J Autism Dev Disord 38(4):731–738
Absoud M, Parr JR, Salt A, Dale N (2011) Developing a schedule to identify social communication difficulties and Autism spectrum disorder in young children with visual impairment. Dev Med Child Neurol 53(3):285–288
Saemundsen E, Magnusson P, Smari J, Sigurdardottir S (2003) Autism diagnostic interview-revised and the childhood Autism rating scale: convergence and discrepancy in diagnosing autism. J Autism Dev Disord 33(3):319–328
Soke GN, Philofsky A, Diguiseppi C, Lezotte D, Rogers S, Hepburn S (2011) Longitudinal changes in scores on the Autism diagnostic interview-revised (ADI-R) in pre-school children with autism: implications for diagnostic classification and symptom stability. Autism 15(5):545–562
Cicchetti DV, Lord C, Koenig K, Klin A, Volkmar FR (2008) Reliability of the ADI-R: multiple examiners evaluate a single case. J Autism Dev Disord 38(4):764–770
Ward-King J, Cohen IL, Penning H, Holden JJA (2010) Brief report: telephone administration of the Autism diagnostic interview-revised: reliability and suitability for use in research. J Autism Dev Disord 40(10):1285–1290
Matson JL, Hess JA, Mahan S, Fodstad JC (2010) Convergent validity of the Autism spectrum disorder diagnostic for children (ASD-DC) and Autism diagnostic interview-revised (ADI-R). Res Autism Spectr Disord 4:741–745
Boelte S, Poustka F (2000) Diagnosis of autism: the connection between current and historical information. Autism 4(4):382–390
Moss J, Magiati I, Charman T, Howlin P (2008) Stability of the Autism diagnostic interview-revised from pre-school to elementary school age in children with Autism spectrum disorders. J Autism Dev Disord 38(6):1081–1091
Mildenberger K, Sitter S, Noterdaeme M, Amorosa H (2001) The use of the ADI-R as a diagnostic tool in the differential diagnosis of children with infantile autism and children with a receptive language disorder. Eur Child Adolesc Psychiatry 10(4):248–255
Hill A, Boelte S, Petroca G, Beltcheva D, Tacheva S, Poustka F (2001) Stability and interpersonal agreement of the interview-based diagnosis of autism. Psychopathology 34(4):187–191
Lecavalier L, Aman MG, Scahill L, McDougle C, McCracken JT, Vitiello B, Tierney E, Arnold LE, Ghuman J, Loftin R, Cronin P, Koenig K, Posey D, Martin A, Holllander E, Lee LS, Kau ASM (2006) Validity of the Autism diagnostic interview-revised. Am J Ment Retard 111(3):199–215
Matson JL, Gonzalez ML, Wilkins J, Rivet TT (2008) Reliability of the Autism spectrum disorder-diagnostic for children (ASD-DC). Res Autism Spectr Disord 2(3):533–545
Matson JL, Gonzalez ML, Wilkins J (2009) Validity study of the Autism spectrum disorders-diagnostic for children (ASD-DC). Res Autism Spectr Disord 3(1):196–206
Matson JL, Boisjoli J, Dempsey T (2009) Factor structure of the Autism spectrum disorders-diagnostic for children (ASD-DC). J Dev Phys Disabil 21(3):195–211
Matson JL, Hess JA, Mahan S, Fodstad JC, Neal D (2010) Convergent validity of the Autism spectrum disorder-diagnostic for children (ASD-DC) and Childhood Autism rating scales (CARS). Res Autism Spectr Disord 4(4):633–638
Matson JL, Wilkins J, Gonzalez ML (2007) Reliability and factor structure of the Autism spectrum disorders—Diagnosis scale for intellectually disabled adults (ASD-DA). J Dev Phys Disabil 19(6):565–577
Leekam SR, Libby SJ, Wing L, Gould J, Taylor C (2002) The Diagnostic interview for social and communication disorders: algorithms for ICD-10 childhood autism and Wing and Gould Autistic spectrum disorder. J Child Psychol Psychiatry 43(3):327–342
Wing L, Leekam SR, Libby SJ, Gould J, Larcombe M (2002) The Diagnostic interview for social and communication disorders: background, inter-rater reliability and clinical use. J Child Psychol Psychiatry 43(3):307–325
Nygren G, Hagberg B, Billstedt E, Skoglund A, Gilberg C, Johansson M (2009) The Swedish version of the diagnostic interview for social and communication disorders (DISCO-10). Psychometric properties. J Autism Dev Disord 39(5):730–741
Ritvo RA, Ritvo ER, Guthrie D, Yuwiler A, Ritvo MJ, Weisbender L (2008) A scale to assist the diagnosis of autism and Asperger’s Disorder in adults (RAADS): a pilot study. J Autism Dev Disord 38(2):213–223
Ritvo RA, Ritvo ER, Guthrie D, Ritvo MJ, Hufnagel DH, McMahon W, Tonge B, Mataix-Cols D, Jassi A, Attwood T, Eloff J (2011) The Ritvo Autism asperger diagnostic scale-revised (RAADS-R): a scale to assist the diagnosis of Autism spectrum disorder in adults: an international validation study. J Autism Dev Disord 41(8):1076–1089
Skuse D, Warrington R, Bishop D, Chowdhury U, Lau J, Mandy W, Place M (2004) The developmental, dimensional and diagnostic interview (3di): a novel computerized assessment for Autism spectrum disorders. J Am Acad Child Adolesc Psychiatry 43(5):548–558
Santosh PJ, Mandy WPL, Puura K, Kaartinen M, Warrington R, Skuse DH (2009) The construction and validation of a short form of the developmental, diagnostic and dimensional interview. Eur Child Adolesc Psychiatry 18(8):521–524
Tachimori H, Osada H, Kurita H (2003) Childhood autism rating scale—Tokyo version for screening pervasive developmental disorders. Psychiatry Clin Neurosci 57(1):113–118
Rellini E, Tortolani D, Trillo S, Carbone S, Montecchi F (2004) Childhood Autism rating scale (CARS) and Autism behavior checklist (ABC) correspondence and conflicts with DSM-IV criteria in diagnosis of autism. J Autism Dev Disord 34(6):703–708
Perry A, Condillac RA, Freeman NL, Dunn-Geier J, Belair J (2005) Multi-site study of the Childhood Autism rating scale (CARS) in five clinical groups of young children. J Autism Dev Disord 35(5):625–634
Mayes SD, Calhoun SL, Crites DL (2001) Does DSM-IV Asperger’s disorder exist? J Abnorm Child Psychol 29(3):263–271
Murray MJ, Mayes SD, Smith LA (2011) Brief report: excellent agreement between two brief autism scales (Checklist for Autism spectrum disorder and social responsiveness scale) completed independently by parents and the Autism diagnostic interview-revised. J Autism Dev Disord 41(11):1586–1590
Lecavalier L (2005) An evaluation of the Gilliam Autism rating scale. J Autism Dev Disord 35(6):795–805
Cohen IL (2003) Criterion-related validity of the PDD behavior inventory. J Autism Dev Disord 33(1):47–53
Cohen IL, Schmidt-Leckner S, Romanczyk R, Sudhalter V (2003) The PDD behavior inventory: a rating scale for assessing response to intervention in children with pervasive developmental disorder. J Autism Dev Disord 33(1):31–45
Cohen IL, Gomez TR, Gonzalez MG, Lennon EM, Karmel BZ, GJ M (2010) Parent PDD Behavior Inventory profiles of young children classified according to Autism diagnostic observation schedule-generic and Autism diagnostic interview-revised criteria. J Autism Dev Disord 40(2):246–254
Reel KH, Lecavalier L, Butter E, Mulick JA (2012) Diagnostic utility of the pervasive developmental disorder behavior inventory. Res Autism Spectr Disord 6(1):458–465
Matson JL, Dempsey T, Rivet T (2008) A comparison of Asperger symptom rating scales with children and adolescents. Res Autism Spectr Disord 2(4):643–650
Boggs KM, Gross AM, Gohm CL (2006) Validity of the Asperger syndrome diagnostic scale. J Dev Phys Disabil 18(2):163–182
Gillberg Gillberg C, Rastam M, Wentz E (2001) The Asperger syndrome (and high-functioning autism)—diagnostic interview (ASDI): a preliminary study of a new structured clinical interview. Autism 5(1):57–66
Baron Cohen S, Wheelwright S, Robinson J, Woodbury-Smith M (2005) The Adult asperger assessment (AAA): a diagnostic method. J Autism Dev Disord 35(6):807–819
Acknowledgments
We would like to thank Magdalena Öström, Linköping University Library, Linköping University, Sweden, for her assistance with sourcing articles and Rhianna Benson, PhD student, School of Occupational Therapy and Social Work, Curtin University, WA, for her assistance to the review. This research was funded and supported by the Disabilities Service Commission of Western Australia. The funders had no input into the selection or analysis of data or the content of the final manuscript.
Conflict of interest
No support was received from any organization for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous 3 years; and any other relationships or activities that could appear to have influenced the submitted work.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Falkmer, T., Anderson, K., Falkmer, M. et al. Diagnostic procedures in autism spectrum disorders: a systematic literature review. Eur Child Adolesc Psychiatry 22, 329–340 (2013). https://doi.org/10.1007/s00787-013-0375-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00787-013-0375-0