Abstract
Students with oppositional defiant disorder (ODD) and other emotional and behavioral disorders (EBD) often have significant academic needs, particularly in the area of writing. There is currently a need to identify intervention strategies that can be efficiently implemented in the school setting to improve the writing fluency outcomes of students from this population. Performance feedback has been successfully used to improve typically developing students’ writing fluency; however, its isolated effects for students with ODD are unknown. The purpose of this study was to examine whether the writing fluency gains of an evidence-based performance feedback intervention could be replicated with a sample of students with ODD. Results of a multiple baseline design failed to demonstrate three replications supporting its effectiveness. Implications for practice are discussed in the context of the unique behavioral needs of students with ODD.
Similar content being viewed by others
References
AIMSweb®, Inc. (2014). AIMSweb. Retrieved July 30, 2014, from https://aimswebtraining.pearson.com/pdfs/7/1/1P04Story%20Starters_11062006.pdf.
Anderson, J. A., Kutash, K., & Duchnowski, A. J. (2001). A comparison of the academic progress of students with EBD and students with LD. Journal of Emotional and Behavioral Disorders, 9, 106–115.
Bailey, S., Whittle, N., Farnworth, P., & Smedley, K. (2007). A developmental approach to violence, hostile attributions, and paranoid thinking in adolescence. Behavioral Sciences & the Law, 25(6), 913–929. https://doi.org/10.1002/bsl.776.
Berninger, V. W., Hart, T., Abbott, R. D., & Karovsky, P. (1992). Defining reading and writing disabilities with and without IQ: a flexible, developmental perspective. Learning Disability Quarterly, 15, 103–118.
Berninger, V. W., Vaughan, K. B., Abbott, R. D., Abbott, S. P., Rogan, L. W., Brooks, A., Reed, E., & Graham, S. (1997). Treatment of handwriting problems in beginning writers: transfer from handwriting to composition. Journal of Educational Psychology, 89, 652–666.
Berninger, V. W., Vaughan, K., Abbott, R. D., Begay, K., Byrd Coleman, K., Curtin, G., et al. (2002). Teaching spelling and composition alone and together: implications for the simple view of writing. Journal of Educational Psychology, 94, 291–304.
Berninger, V. W., Rutberg, J. E., Abbott, R. D., Garcia, N., Anderson-Youngstrom, M., Brooks, A., & Fulton, C. (2006). Tier 1 and tier 2 early intervention for handwriting and composing. Journal of School Psychology, 22, 3–30.
Bradley, R., Doolittle, J., & Bartolotta, R. (2008). Building on the data and adding to the discussion: the experiences and outcomes of students with emotional disturbance. Journal of Behavioral Education, 17(1), 4–23.
Carr, S. C., & Punzo, R. P. (1993). The effects of self-monitoring of academic accuracy and productivity on the performance of students with behavioral disorders. Behavioral Disorders, 18(4), 241–250.
Common Core State Standards: National Governors Association Center for Best Practices, Council of Chief State School Officers (2010). Retrieved February 6, 2017 from http://www.corestandards.org.
Eckert, T. L., Lovett, B. J., Rosenthal, B. D., Jiao, J., Ricci, L. J., & Truckenmiller, A. J. (2006). Classwide instructional feedback: improving children’s academic skill development. In S. Randall (Ed.), Learning disabilities: new research (pp. 271–285). Hauppauge: Nova Science.
Eckert, T. L., Hier, B. O., Hamsho, N. F., & Malandrino, R. D. (2017). Assessing children’s perceptions of academic interventions: the kids intervention profile. School Psychology Quarterly, 32(2), 268–281. https://doi.org/10.1037/spq0000200.
Ennis, R. P., Jolivette, K., Terry, N. P., Fredrick, L. D., & Alberto, P. A. (2015). Classwide teacher implementation of self-regulated strategy development for writing with students with E/BD in a residential facility. Journal of Behavioral Education, 24(1), 88–111.
Espin, C. A., Skare, S., Shin, J., Deno, S. L., Robinson, S., & Benner, B. (2000). Identifying indicators of written expression proficiency for middle school students. Journal of Special Education, 34, 140–153.
Faykus, S. P., & McCurdy, B. L. (1998). Evaluating the sensitivity of the maze as an index of reading proficiency for students who are severely deficient in reading. Education and Treatment of Children, 21(1), 1–21.
Furey, W. M., Marcotte, A. M., Hintze, J. M., & Shackett, C. M. (2016). Concurrent validity and classification accuracy of curriculum-based measurement for written expression. School Psychology Quarterly, 31(3), 369–382. https://doi.org/10.1037/spq0000138.
Gadaire, D. M., Fisher, W. W., & Steege, M. (2014). The effects of presenting delays before and after task completion on self-control responding in children with behavior disorders. Journal of Applied Behavior Analysis, 47(1), 192–197.
Gansle, K. A., Noell, G. H., VanDerHeyden, A. M., Naquin, G. M., & Slider, N. J. (2002). Moving beyond total words written: the reliability, criterion validity, and time cost of alternate measures for curriculum-based measurement in writing. School Psychology Review, 31(4), 477–497.
Gast, D. L. (2010). Single subject research methodology in behavioral sciences. New York: Routledge.
Graham, S., Berninger, V. W., Abbott, R. D., Abbott, S. P., & Whitaker, D. (1997). Role of mechanics in composing of elementary school students: a new methodological approach. Journal of Educational Psychology, 89(1), 170–182.
Gwinn, M. M., Derby, K. M., Fisher, W., Kurtz, P., Fahs, A., Augustine, M., & McLaughlin, T. F. (2005). Effects of increased response effort and reinforcer delay on choice and aberrant behavior. Behavior Modification, 29(4), 642–652.
Harris, K. R., Graham, S., Reid, R., McElroy, K., & Stern Hamby, R. (1994). Self-monitoring of attention versus self-monitoring of performance: replication and cross-task comparison studies. Learning Disability Quarterly, 17, 121–139.
Hier, B. O., & Eckert, T. L. (2014). Evaluating elementary-aged students’ abilities to generalize and maintain fluency gains of a performance feedback writing intervention. School Psychology Quarterly, 29(4), 488–502. https://doi.org/10.1037/spq0000040.
Hier, B. O., & Eckert, T. L. (2016). Programming generality into a performance feedback writing intervention: a randomized controlled trial. Journal of School Psychology, 56, 111–131. https://doi.org/10.1016/j.jsp.2016.03.003.
Hobson, C. W., Scott, S., & Rubia, K. (2011). Investigation of cool and hot executive function in ODD/CD independently of ADHD. Journal of Child Psychology and Psychiatry, 52(10), 1035–1043.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179.
Hummer, T. A., Wang, Y., Kronenberger, W. G., Dunn, D. W., & Mathews, V. P. (2015). The relationship of brain structure to age and executive functioning in adolescent disruptive behavior disorder. Psychiatry Research: Neuroimaging, 231(3), 210–217.
Jewell, J., & Malecki, C. K. (2005). The utility of CBM written language indices: an investigation of production-dependent, production- independent, and accurate-production scores. School Psychology Review, 34(1), 27–44.
Kazdin, A. E. (2011). Single case research designs: methods for clinical and applied settings (2nd ed.). New York: Oxford University Press.
Keller-Margulis, M. A., Mercer, S. H., Payan, A., & McGee, W. (2015). Measuring annual growth using written expression curriculum-based measurement: an examination of seasonal and gender differences. School Psychology Quarterly, 30(2), 276–288. https://doi.org/10.1037/spq0000086.
Koenig, E. A., Eckert, T. L., & Hier, B. O. (2016). Using performance feedback and goal setting to improve elementary students’ writing fluency: a randomized controlled trial. School Psychology Review, 45(3), 275–295. https://doi.org/10.17105/SPR45-3.275-295.
Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
Lane, K. L., Gresham, F. M., & O’Shaughnessy, T. E. (2002). Serving students with or at-risk for emotional and behavior disorders: Future challenges. Education and Treatment of Children, 25(4), 507–521.
Lane, K. L., Barton-Arwood, S. M., Nelson, J. R., & Wehby, J. (2008). Academic performance of students with emotional and behavioral disorders served in a self-contained setting. Journal of Behavioral Education, 17(1), 43–62.
Mace, F. C., Neef, N. A., Shade, D., & Mauro, B. C. (1994). Limited matching on concurrent-schedule reinforcement of academic behavior. Journal of Applied Behavior Analysis, 27(4), 585–596.
Malecki, C. K., & Jewell, J. (2003). Developmental, gender, and practical considerations in scoring curriculum-based measurement writing probes. Psychology in the Schools, 40(4), 379–390.
Martens, B. K., Daly, E. J., Begeny, J. C., & Sullivan, W. E. (in press). Behavioral approaches to education. In W. Fisher, C. Piazza, & H. Roane (Eds.), Handbook of applied behavior analysis (2nd ed.). New York: Guilford.
Mason, L. H., & Shriner, J. G. (2008). Self-regulated strategy development instruction for writing an opinion essay: effects for six students with emotional/behavior disorders. Reading and Writing, 21(1–2), 71–93.
Mastropieri, M. A., Scruggs, T. E., Mills, S., Cerar, N. I., Cuenca-Sanchez, Y., Allen-Bronaugh, D., Thompson, C., Guckert, M., & Regan, K. (2009). Persuading students with emotional disabilities to write fluently. Behavioral Disorders, 35(1), 19–40.
Mastropieri, M. A., Scruggs, T. E., Cerar, N. I., Allen-Bronaugh, D., Thompson, C., Guckert, M., Leins, P., Hauth, C., & Cuenca-Sanchez, Y. (2014). Fluent persuasive writing with counterarguments for students with emotional disturbance. The Journal of Special Education, 48(1), 17–31.
Matthys, W., Vanderschuren, L. J., Schutter, D. G., & Lochman, J. E. (2012). Impaired neurocognitive functions affect social learning processes in oppositional defiant disorder and conduct disorder: implications for interventions. Clinical Child and Family Psychology Review, 15(3), 234–246.
McMaster, K. L., Wayman, M. M., Deno, S. L., Espin, C. A., & Yeo, S. (2010). Examining technical features of progress monitoring across grade levels in writing (Technical Report No. 38). Minneapolis, MN: University of Minnesota, Research Institute on Progress Monitoring.
Monroe, M., & Sherman, E. E. (1966). Monroe-Sherman Group Diagnostic Reading Aptitude and Achievement Test. Bradenton: C.H. Nevins.
National Center for Education Statistics. (2012). The Nation’s Report Card: Writing 2011 (NCES 2012–470). Washington, DC: Institute of Education Sciences, U.S. Department of Education.
Neef, N. A., & Lutz, M. N. (2001). A brief computer-based assessment of reinforcer dimensions affecting choice. Journal of Applied Behavior Analysis, 34(1), 57–60. https://doi.org/10.1901/jaba.2001.34-57.
Neef, N. A., Shade, D., & Miller, M. S. (1994). Assessing influential dimensions of reinforcers on choice in students with serious emotional disturbance. Journal of Applied Behavior Analysis, 27(4), 575–583.
Pearson. (2009). Wechsler Individual Achievement Test- Third Edition. San Antonio, TX: PsychCorp.
Reid, R., Gonzalez, J. E., Nordness, P. D., Trout, A., & Epstein, M. H. (2004). A meta-analysis of the academic status of students with emotional/behavioral disturbance. The Journal of Special Education, 38, 130–143.
Rhodes, S. M., Park, J., Seth, S., & Coghill, D. R. (2012). A comprehensive investigation of memory impairment in attention deficit hyperactivity disorder and oppositional defiant disorder. Journal of Child Psychology and Psychiatry, 53(2), 128–137.
Rubia, K., Halari, R., Cubillo, A., Smith, A., Mohammed, A.-M., Scott, S., et al. (2010). Disorder-specific inferior prefrontal hypofunction in boys with pure attention-deficit/hyperactivity disorder compared to boys with pure conduct disorder during cognitive flexibility. Human Brain Mapping, 31, 1823–1833.
Schumacher, S., Kirschbaum, C., Fydrich, T., & Ströhle, A. (2013). Is salivary alpha-amylase an indicator of autonomic nervous system dysregulations in mental disorders?—a review of preliminary findings and the interactions with cortisol. Psychoneuroendocrinology, 38, 729–743.
Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). Early intervention for behaviorally disordered children: the synthesis of single subject research. In R. J. Rutherford, C. M. Nelson, S. R. Forness, R. J. Rutherford, C. M. Nelson, & S. R. Forness (Eds.), Severe behavior disorders of children and youth (pp. 122–132). Boston: College-Hill Press/Little, Brown & Co..
Shadish, W. R., Hedges, L. V., Horner, R. H., & Odom, S. L. (2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research (NCER 2015–002). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education This report is available on the Institute website at http://ies.ed.gov/.
Shapiro, E. S. (2010). Academic skill problems: direct assessment and intervention. New York: Guilford.
Stokes, T. F., & Osnes, P. G. (1989). An operant pursuit of generalization. Behavior Therapy, 20(3), 337–355. https://doi.org/10.1016/S0005-7894(89)80054-1.
Strand, P. S. (2000). A modern behavioral perspective on child conduct disorder: integrating behavioral momentum and matching theory. Clinical Psychology Review, 20(5), 593–615.
Sutherland, K. S., Wehby, J. H., & Yoder, P. J. (2002). Examination of the relationship between teacher praise and opportunities for students with EBD to respond to academic requests. Journal of Emotional and Behavioral Disorders, 10(1), 5–13. https://doi.org/10.1177/106342660201000102.
Sutherland, K. S., Alder, N., & Gunter, P. L. (2003). The effect of varying rates of opportunities to respond to academic requests on the classroom behavior of students with EBD. Journal of Emotional and Behavioral Disorders, 11(4), 239–248.
Truckenmiller, A. J., Eckert, T. L., Codding, R. S., & Petscher, Y. (2014). Evaluating the impact of feedback on elementary aged students’ fluency growth in written expression: a randomized controlled trial. Journal of School Psychology, 52(6), 531–548. https://doi.org/10.1016/j.jsp.2014.09.001.
Weissenburger, J. W., & Espin, C. A. (2005). Curriculum-based measures of writing across grade levels. Journal of School Psychology, 43(2), 153–169. https://doi.org/10.1016/j.jsp.2005.03.002.
Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III Tests of Achievement. Itasca: Riverside Publishing.
Yell, M. L., Meadows, N. B., Drasgow, E., & Shriner, J. S. (2009). Evidence-based practices for educating students with emotional and behavioral disorders. Upper Saddle River, NJ: Pearson/Merrill Education.
Funding
This study was funded by the Devereux Institute of Clinical and Professional Training and Research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent and student assent was obtained for all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hier, B.O., McCurdy, B.L. Effects of Performance Feedback on the Writing Fluency of Students with Oppositional Defiant Disorder. Contemp School Psychol 24, 41–51 (2020). https://doi.org/10.1007/s40688-019-00235-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40688-019-00235-2