Abstract
The aim of the study was to investigate what kinds of assessment practices classroom teachers and special educational needs (SEN) teachers use in assessing first grade students' pre-reading skills (letter knowledge and phonological skills). Further, we investigated to what extent teachers were able to identify difficulties in pre-reading skills of the children with the lowest achievement scores. The accuracy of teacher ratings of students' pre-reading skills was studied by comparing teacher ratings to actual test scores. The data from two Finnish longitudinal studies were used: JLD sample (class teachers, n = 91; SEN teachers, n = 51; 200 students) and First Steps sample (class teachers, n = 136; SEN teachers, n = 34; 598 students). Results showed first, that most classroom teachers used qualitative assessment and SEN teachers also relied on tests. Secondly, although teacher ratings correlated with the test scores, closer investigation of sensitivity and specificity of the teacher ratings revealed that a number of children in need of extra support for their early reading development according to test scores remained unidentified. Moreover, there were some students identified by the teacher to have difficulties despite test scores not confirming that. The findings underline the importance for developing more specific and reliable assessment tools for teachers to use for pedagogical purposes, and respectively, the need to pay more attention to early identification of reading difficulties in teacher training program curricula.
Similar content being viewed by others
References
Aro, M. (2006). Learning to read: The effect of orthography. In R. M. Joshi & P. G. Aaron (Eds.), Handbook of orthography and literacy (pp. 531–550). Mahwah, NJ: Lawrence Erlbaum Associates.
Bailey, A. L., Cano, L., Fischer, D., Freeman, S., Jacobs, J., Heritage, M., et al. (2001). The LDC manual: A guide to using the Literacy Development Checklist (Rev. ed.). Los Angeles: University of California Regents.
Bailey, A. L., & Drummond, K. V. (2006). Who is at risk and why? Teachers’ reasons for concern and their understanding and assessment of early literacy. Educational Assessment, 11, 149–178. doi:10.1207/s15326977ea1103&4_2.
Bates, C., & Nettlebeck, T. (2001). Primary school teachers’ judgements of reading achievement. Educational Psychology, 21(2), 177–187. doi:10.1080/01443410020043878.
Begeny, J. C., Krouse, H. E., Brown, K. G., & Mann, C. M. (2011). Teacher judgments of students’ reading abilities across a continuum of rating methods and achievement measures. School Psychology Review, 40(1), 23–38.
Beswick, J. F., Willms, J. D., & Sloat, E. A. (2005). A comparative study of teacher ratings of emergent literacy skills and student performance on a standardized measure. Education, 126(1), 116–138.
Björn, P., Aro, M., Koponen, T. K., Fuchs, L. S., & Fuchs, D. H. (2016). The many faces of special education within RTI frameworks in the United States and Finland. Learning Disability Quarterly, 39(1), 58–66. doi:10.1177/0731948715594787.
Catts, H. W., Nielsen, D. C., Bridges, M. S., Liu, Y. S., & Bontempo, D. E. (2015). Early identification of reading disabilities within an RTI framework. Journal of Learning Disabilities, 48(3), 281–297.
Compton, D. L., Fuchs, D., Fuchs, L. S., Bouton, B., Gilbert, J. K., Barquero, L. A., … Crouch, R. C. (2010). Selecting at-risk first-grade readers for early intervention: Eliminating false positives and exploring the promise of a two-stage gated screening process. Journal of Educational Psychology, 102(2), 327–340.
Davis, G. N., Lindo, E. J., & Compton, D. L. (2007). Children at risk for reading failure. Teaching Exceptional Children, 39(5), 32–37.
Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52(3), 219–232.
Deno, S. L. (2003). Developments in curriculum-based measurement. The Journal of Special Education, 37, 184–192. doi:10.1177/00224669030370030801.
Eklund, K., Torppa, M., Aro, M., Leppänen, P. H. T., & Lyytinen, H. (2015). Literacy skill development of children with familial risk for dyslexia through grades 2, 3, and 8. Journal of Educational Psychology, 107(1), 126–140.
Feinberg, A. B., & Shapiro, E. S. (2003). Accuracy of teacher judgments in predicting oral reading fluency. School Psychology Quarterly, 18, 52–65. doi:10.1521/scpq.18.1.52.20876.
Fletcher, J., & Satz, P. (1984). Test-based versus teacher-based predictions of academic achievement. A three-year longitudinal follow-up. Journal of Pediatric Psychology, 9(2), 193–201. doi:10.1093/jpepsy/9.2.103.
Flynn, J. M., & Rahbar, M. H. (1998). Improving teacher prediction of children at risk for reading failure. Psychology in the Schools, 35(2), 163–172.
Graney, S. B. (2008). General education teacher judgments of their low-performing students’ short-term reading progress. Psychology in the Schools, 45(6), 537–549.
Hintikka, S., Landerl, K., Aro, M., & Lyytinen, H. (2008). Training reading fluency: Is it important to practice reading aloud and is generalization possible? Annals of Dyslexia, 58, 59–79. doi:10.1007/s11881-008-0012-7.
Hoge, R. D., & Coladarci, T. (1989). Teacher-based judgments of academic achievement: A review of literature. Review of Educational Research, 59, 297–313. doi:10.2307/1170184.
Holopainen, L., Ahonen, T., & Lyytinen, H. (2001). Predicting reading delay in reading achievement in a highly transparent language. Journal of Learning Disabilities, 34(5), 401–414.
Jenkins, J. R., Hudson, R. F., & Johnson, E. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36(4), 582–600.
Johnson, E. S., Jenkins, J. R., Petscher, Y., & Catts, H. W. (2009). How can we improve the accuracy of screening instruments? Learning Disabilities Research and Practice, 24(4), 174–185.
Kikas, E., Silinskas, G., & Soodla, P. (2015). The effects of children’s reading skills and interest on teacher perceptions of children’s skills and individualized support. International Journal of Behavioral Development, 39(5), 402–412.
Kiuru, N., Lerkkanen, M.-K., Niemi, P., Poskiparta, E., Ahonen, T., Poikkeus, A.-M., & Nurmi, J.-E. (2013). The role of reading disability risk and environmental protective factors in students’ reading fluency in grade 4. Reading Research Quarterly, 48(4), 349–368.
Leinonen, S., Müller, K., Leppänen, P. H. T., Aro, M., Ahonen, T., & Lyytinen, H. (2001). Heterogeneity in adult dyslexic readers: Relating processing skills to the speed and accuracy of oral text reading. Reading and Writing: An Interdisciplinary Journal, 14, 265–296. doi:10.1023/A:1011117620895.
Lerkkanen, M.-K. (2007). The beginning phases of reading literacy instruction in Finland. In P. Linnakylä & I. Arffman (Eds.), Finnish reading literacy. When quality and equity meet (pp. 155–174). Jyväskylä: University of Jyväskylä, Institute for Educational Research.
Lerkkanen, M.-K., Ahonen, T., & Poikkeus, A.-M. (2011). The development of reading skills and motivation and identification of risk at school entry. In M. Veisson, E. Hujala, P. K. Smith, M. Waniganayake & E. Kikas (Eds.), Global perspectives in early childhood education: Diversity, challenges and possibilities (pp. 237–238). Frankfurt am Main: Peter Lang.
Lerkkanen, M.-K., Niemi, P., Poikkeus, A.-M., Poskiparta, M., Siekkinen, M., & Nurmi, J.-E. (2006). The first steps study [Alkuportaat], ongoing. Finland: University of Jyväskylä.
Lerkkanen, M.-K., Poikkeus, A.-M., & Ketonen, R. (2006). ARMI. Luku- ja kirjoitustaidon arviointimateriaali 1. luokalle. [ARMI—a tool for assessing reading and writing skills in grade 1]. Helsinki: WSOY.
Lerkkanen, M.-K., Rasku-Puttonen, H., Aunola, K., & Nurmi, J. E. (2004). Reading performance and its developmental trajectories during the first and the second grade. Learning and Instruction, 14(2), 111–130. doi:10.1016/j.learninstruc.2004.01.006.
Lyytinen, H., Erskine, J., Tolvanen, A., Torppa, M., Poikkeus, A.-M., & Lyytinen, P. (2006). Trajectories of reading development: a follow-up from birth to school age of children with and without risk for dyslexia. Merrill-Palmer Quarterly, 52(3), 514–546.
Madelaine, A., & Wheldall, K. (2005). Identifying low-progress readers: Comparing teacher judgment with a curriculum-based measurement procedure. International Journal of Disability, Development and Education, 52, 33–42. doi:10.1080/10349120500071886.
Martin, S. D., & Shapiro, E. S. (2011). Examining the accuracy of teachers’ judgments of DIBELS performance. Psychology in the Schools, 48(4), 343–356. doi:10.1002/pits.20558.
Mesmer, E. M., & Mesmer, H. A. E. (2008). Response to intervention (RTI): What teachers of reading need to know. The Reading Teacher, 62(4), 280–290. doi:10.1598/RT.62.4.1.
Parrila, R., Aunola, K., Kirby, J. R., Leskinen, E., & Nurmi, J. E. (2005). Development of individual differences in reading: Results from longitudinal studies in English and Finnish. Journal of Educational Psychology, 97(3), 299–319. doi:10.1037/0022-0663.973.299.
Poskiparta, E., Niemi, P., & Lepola, J. (1994). Diagnostiset testit 1. Lukeminen ja kirjoittaminen. Turku: Turun yliopisto, Oppimistutkimuksen keskus. [Diagnostic Tests 1, Reading and Writing].
Puolakanaho, A., Ahonen, T., Aro, M., Eklund, K., Leppänen, P. H. T., Poikkeus, A.-M., & Lyytinen, H. (2007). Very early phonological and language skills: estimating individual risk of reading disability. Journal of Child Psychology and Psychiatry, 48(9), 923–931. doi:10.1111/j.1469-7610.2007.01763.x.
Seymour, P. H. K., Aro, M., & Erskine, J. M. (2003). Foundation literacy acquisition in European orthographies. British Journal of Psychology, 94(2), 143–174.
Snowling, M. J., Duff, F., Petrou, A., & Schiffeldrin, J. (2011). Identification of children at risk of dyslexia: the validity of teacher judgments using ‘Phonic Phases’. Journal of Research in Reading, 34(2), 157–170. doi:10.1111/j.1467-9817.2011.01492.x.
Soodla, P., & Kikas, E. (2010). Teachers’ judgment of students’ reading difficulties and factors related to its accuracy. In A. Toomela (Ed.), Systemic Person-Oriented Study of Child Development in Early Primary School (pp. 73–94). Pieterlen: Peter Lang.
Soodla, P., Lerkkanen, M.-K., Niemi, P., Kikas, E., Silinskas, G., & Nurmi, J.-E. (2015). Does early reading instruction promote the rate of acquisition? A comparison of two transparent orthographies. Learning and Instruction, 38, 14–23. doi:10.1016/j.learninstruc.2015.02.002.
Speece, D. L., Schatschneider, C., Silverman, R., Case, L. P., Cooper, D. H., & Jacobs, D. M. (2011). Identification of reading problems in first grade within a response-to-intervention framework. The Elementary School Journal, 111(4), 585–607.
Stecker, P. M., Fuchs, L. S., & Fuchs, D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42(8), 795–819. doi:10.1002/pits.20113.
Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology, 104(3), 743–762. doi:10.1037/a0027627.
Takala, M., & Ahl, A. (2014). Special education in Swedish and Finnish schools: Seeing the forest or the trees? British Journal of Special Education, 41(1), 59–81. doi:10.1111/1467-8578.12049.
Torppa, M., Eklund, K., van Bergen, E., & Lyytinen, H. (2015). Late-emerging and resolving dyslexia: A follow-up study from age 3 to 14. Journal of Abnormal Child Psychology, 43(7), 1389–1401. doi:10.1007/s10802-015-0003-1.
Torppa, M., Poikkeus, A.-M., Laakso, M.-L., Eklund, K., & Lyytinen, H. (2006). Predicting delayed letter name knowledge and its relation to grade 1 reading achievement in children with and without familial risk for dyslexia. Developmental Psychology, 42(6), 1128–1142.
Zumeta, R. O., Compton, D. L., & Fuchs, L. S. (2012). Using word identification fluency to monitor first-grade reading development. Exceptional Children, 78(2), 210–220.
Acknowledgements
This study has been carried out in the Centre of Excellence in Learning and Motivation Research, and financed by the Academy of Finland (No. 213486 for 2006–2011) and other grants from the same funding agency for the authors (Nos. 292466 for 2015–2019, 268586 for 2013–2017).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Virinkoski, R., Lerkkanen, MK., Holopainen, L. et al. Teachers’ Ability to Identify Children at Early Risk for Reading Difficulties in Grade 1. Early Childhood Educ J 46, 497–509 (2018). https://doi.org/10.1007/s10643-017-0883-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10643-017-0883-5