Abstract
Little attention has been paid to evaluating the use of DSM-III-R with preschool children. Children (N = 510) ages 2 to 5 years who were screened at the time of a pediatric visit were selected to participate in an evaluation which included questionnaires, a semistructured interview, developmental testing, and a play observation. Following the evaluation, two clinical child psychologists independently assigned DSM-III-R diagnoses. For each diagnostic category, kappa and Ycoefficients were calculated; Ycoefficients are less sensitive to base rates of disorders. For overall agreement, the weighted mean kappa (.61), and mean Y(.66) were moderately high. Overall agreement that the child had at least one of the disruptive disorders was substantial (kappa =.64; Y =.65);agreement that there was at least one of the emotional disorders was moderate for kappa (.54), but substantial for Y(.70). Kappa coefficients were higher for major categories of disorder than for specific disorders; however, Ycoefficients did not show a decline for specific disorders. Interrater reliability of DSM-III-R appears to be similar for preschoolers and older children.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Achenbach, T. M., & Edelbrock, C. S. (1983).Manual for the Child Behavior Checklist. Burlington: University of Vermont.
Achenbach, T. M., Edelbrock, C., & Howell, C. T. (1987). Empirically based assessment of the behavior/emotional problems of 2- and 3-year-old children.Journal of Abnormal Child Psychology, 15, 629–650.
American Psychiatric Association. (1980).Diagnostic and Statistical Manual of Mental Disorders (3rd ed.). Washington, DC: Author.
American Psychiatric Association. (1987).Diagnostic and Statistical Manual of Mental Disorders (3rd ed. rev.) Washington, DC: Author.
Anderson, J. C., Williams, S., McGee, R., & Silva, P. A. (1987). DSM-III disorders in preadolescent children.Archives of General Psychiatry, 1987, 44, 69–75.
Bayley, N. (1969).Manual of the Bayley Scales of Mental Development. New York: Psychological Corporation.
Beitchman, J. H., Wekerle, C., & Hood, J. (1987). Diagnostic continuity from preschool to middle childhood.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 694–699.
Campbell, S. B. (1990).Behavior problems in preschool children. New York: Guilford Press.
Cantwell, D. P., & Baker, L. (1989). Stability and natural history of DSM-III childhood diagnoses.Journal of the American Academy of Child and Adolescent Psychiatry, 28, 691–700.
Cantwell, D. P., Russell, A. T., Mattison, R., & Will, L. (1979). A comparison of DSM-II and DSM-III in the diagnosis of childhood psychiatric disorders. I. Agreement with expected diagnosis.Archives of General Psychiatry, 36, 1208–1213.
Cohen, J. (1960). A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 20, 37–46.
Costello, A. J., Edelbrock, C. S., Kalas, R., Kessler, M. K., & Klaric, S. A. (1982).National Institute of Mental Health Diagnostic Interview Schedule for Children. Bethesda, MD: National Institute of Mental Health.
Dalton, R., Forman, M. A., Daul, G. C., & Bolding, D. (1987). Psychiatric hospitalization of preschool children: Admission factors and discharge implications.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 308–312.
Earls, F. (1982). Application of DSM-III in an epidemiological study of preschool children.American Journal of Psychiatry, 139, 242–243.
Forehand, R. L., & McMahon, R. J. (1981).Helping the noncompliant child. New York: Guilford Press.
Hooks, M. Y., Mayes, L. C., & Volkmar, F. R. (1988). Psychiatric disorders among preschool children.Journal of the American Academy of Child and Adolescent Psychiatry, 27, 623–627.
Jones, F. H. (1977). The Rochester Adaptive Behavior Inventory: A parallel series of instruments for assessing social competence during early and middle childhood and adolescence. In J. S. Strauss & N. M. Babigian (Eds.),The origins and causes of psychopathology (pp. 249–281). New York: Plenum Press.
Kashani, J. H., Horwitz, E., Ray, J. S., & Reid, J. C. (1986). DSM-III diagnostic classification of 100 preschoolers in a child development unit.Child Psychiatry and Human Development, 16, 137–147.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data.Biometrics, 33, 159–174.
Lavigne, J. V., Binns, H. J., Christoffel, K. K., Rosenbaum, D., Arend, R., Smith, K., Hayford, J. R., McGuire, P. A., & the Pediatric Research Group. (1993). Behavior and emotional problems among preschool children in pediatric primary care: Prevalence and pediatricians' recognition.Pediatrics, 91, 1–7.
Lee, B. J. (1987). Multidisciplinary evaluation of preschool children and its demography in a military psychiatric clinic.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 313–316.
Loeber, R., Lahey, B. B., & Thomas, C. (1991). Diagnostic conundrum of oppositional defiant disorder and conduct disorder.Journal of Abnormal Psychology, 100, 379–390.
Mattison, R., Cantwell, D. P., Russell, A. T., & Will, L. (1979). A comparison of DSM-II and DSM-III in the diagnosis of childhood psychiatric disorders. II. Interrater agreement.Archives of General Psychiatry, 36, 1217–1222.
McCarthy, D. (1972).Manual for the McCarthy Scales of Children's Abilities. New York: Psychological Corporation.
Quay, H.C. (1986). Classification. In H. C. Quay & J. S. Werry (Eds.),Psychopathological disorders of childhood (2nd ed.) (pp. 1–42). New York: Wiley.
Seifer, R., Sameroff, A. J., & Jones, F. (1981). Adaptive behavior in young children of emotionally disturbed women.Journal of Applied Developmental Psychology, 1, 251–276.
Spitzer, R. L., Forman, J. B. W., & Nee, J. (1979). DSM-III field trials: I. Initial interrater diagnostic reliability.American Journal of Psychiatry, 136, 815–820.
Spitznagel, E. L., & Helzer, J. E. (1985). A proposed solution to the base rate problem in the kappa statistic.Archives of General Psychiatry, 42, 725–728.
Strober, M., Green, J., & Carlson, G. (1981). The reliability of psychiatric diagnosis in hospitalized adolescents: Interrater agreement using the DSM-III.Archives of General Psychiatry, 38, 141–145.
Werry, J. S. (1992). Child psychiatric disorders: Are they classifiable?British Journal of Psychiatry, 161, 472–480.
Werry, J. S., Methven, R. J., Fitzpatrick, J., & Dixon, H. (1983). The interrater reliability of DSM-III in children.Journal of Abnormal Child Psychology, 11, 341–354.
Author information
Authors and Affiliations
Additional information
This study was supported by grant MH46089 from the National Institute of Mental Health.
Rights and permissions
About this article
Cite this article
Lavigne, J.V., Arend, R., Rosenbaum, D. et al. Interrater reliability of the DSM-III-R with preschool children. J Abnorm Child Psychol 22, 679–690 (1994). https://doi.org/10.1007/BF02171995
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02171995