Skip to main content
SpringerLink
Log in

Assessing Learning Gains

  • Conference paper
  • First Online:
Technology Enhanced Assessment (TEA 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 653))

Included in the following conference series:

Abstract

Over the last 30 years a range of assessment strategies have been developed aiming to effectively capture students’ learning in Higher Education and one such strategy is measuring students’ learning gains. The main goal of this study was to examine whether academic performance within modules is a valid proxy for estimating students’ learning gains. A total of 17,700 Science and Social Science students in 111 modules at the Open University UK were included in our three-level linear growth-curve model. Results indicated that for students studying in Science disciplines modules, module accounted for 33% of variance in students’ initial achievements, and 26% of variance in subsequent learning gains, whereas for students studying in Social Science disciplines modules, module accounted for 6% of variance in initial achievements, and 19% or variance in subsequent learning gains. The importance of the nature of the consistent, high quality assessments in predicting learning gains is discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brown, G.A., Bull, J., Pendlebury, M.: Assessing Student Learning in Higher Education. Routledge, London (2013)

    Google Scholar 

  2. Boud, D., Falchikov, N.: Aligning assessment with long-term learning. Assess. Eval. High. Educ. 31, 399–413 (2006)

    Article  Google Scholar 

  3. Nicol, D.: From monologue to dialogue: improving written feedback processes in mass higher education. Assess. Eval. High. Educ. 35, 501–517 (2010)

    Article  Google Scholar 

  4. Tempelaar, D.T., Rienties, B., Giesbers, B.: In search for the most informative data for feedback generation: learning analytics in a data-rich context. Comput. Hum. Behav. 47, 157–167 (2015)

    Article  Google Scholar 

  5. Whitelock, D., Richardson, J., Field, D., Van Labeke, N., Pulman, S.: Designing and testing visual representations of draft essays for higher education students. In: Presented at the Paper presented at the Learning Analytics Knowledge Conference, Indianapolis (2014)

    Google Scholar 

  6. Segers, M., Dochy, F., Cascallar, E. (eds.): Optimising New Modes of Assessment: In Search of Qualities and Standards. Kluwer Academic Publishers, Dordrecht (2003)

    Google Scholar 

  7. Hattie, J.: Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. Routledge, London (2008)

    Google Scholar 

  8. Lehmann, T., Hähnlein, I., Ifenthaler, D.: Cognitive, metacognitive and motivational perspectives on preflection in self-regulated online learning. Comput. Hum. Behav. 32, 313–323 (2014)

    Article  Google Scholar 

  9. Cronbach, L.J., Furby, L.: How we should measure “change”: or should we? Psychol. Bull. 74, 68–80 (1970)

    Article  Google Scholar 

  10. Linn, R.L., Slinde, J.A.: The determination of the significance of change between pre- and posttesting periods. Rev. Educ. Res. 47, 121–150 (1977)

    Article  Google Scholar 

  11. Lord, F.M.: The measurement of growth. ETS Res. Bull. Ser. 1956, i-22 (1956)

    Google Scholar 

  12. Lord, F.M.: Further problems in the measurement of growth. Educ. Psychol. Meas. 18, 437–451 (1958)

    Article  Google Scholar 

  13. Hake, R.R.: Interactive-engagement versus traditional methods: a six-thousand-student survey of mechanics test data for introductory physics courses. Am. J. Phys. 66, 64–74 (1998)

    Article  Google Scholar 

  14. Beck, C.W., Blumer, L.S.: Inquiry-based ecology laboratory courses improve student confidence and scientific reasoning skills. Ecosphere, 3, UNSP 112 (2012)

    Google Scholar 

  15. Coil, D., Wenderoth, M.P., Cunningham, M., Dirks, C.: Teaching the process of science: faculty perceptions and an effective methodology. CBE-Life Sci. Educ. 9, 524–535 (2010)

    Article  Google Scholar 

  16. Mortensen, C.J., Nicholson, A.M.: The flipped classroom stimulates greater learning and is a modern 21st century approach to teaching today’s undergraduates. J. Anim. Sci. 93, 3722–3731 (2015)

    Article  Google Scholar 

  17. Gill, T.G., Mullarkey, M.T.: Taking a case method capstone course online: a comparative case study. J. Inf. Technol. Educ.-Res. 14, 189–218 (2015)

    Google Scholar 

  18. Mayhew, M.J.: A multilevel examination of the influence of institutional type on the moral reasoning development of first-year students. J. High. Educ. 83, 367–388 (2012)

    Article  Google Scholar 

  19. Riutta, S., Teodorescu, D.: Leadership development on a diverse campus. J. Coll. Stud. Dev. 55, 830–836 (2014)

    Article  Google Scholar 

  20. Pascarella, E.T., Salisbury, M.H., Martin, G.L., Blaich, C.: Some complexities in the effects of diversity experiences on orientation toward social/political activism and political views in the first year of college. J. High. Educ. 83, 467–496 (2012)

    Article  Google Scholar 

  21. Bowman, N.A.: The development of psychological well-being among first-year college students. J. Coll. Stud. Dev. 51, 180–200 (2010)

    Article  Google Scholar 

  22. Trolian, T.L., Jach, E.A., Hanson, J.M., Pascarella, E.T.: Influencing academic motivation: the effects of student-faculty interaction. J. Coll. Stud. Dev. (in press)

    Google Scholar 

  23. Andrews, T.M., Leonard, M.J., Colgrove, C.A., Kalinowski, S.T.: Active learning not associated with student learning in a random sample of college biology courses. CBE-Life Sci. Educ. 10, 394–405 (2011)

    Article  Google Scholar 

  24. Cahill, M.J., Hynes, K.M., Trousil, R., Brooks, L.A., McDaniel, M.A., Repice, M., Zhao, J., Frey, R.F.: Multiyear, multi-instructor evaluation of a large-class interactive-engagement curriculum. Phys. Rev. Spec. Top.-Phys. Educ. Res. 10, 020101–020119 (2014)

    Article  Google Scholar 

  25. Rogaten, J., Rienties, B, Sharpe, R., Cross, S., Whitelock, D., Lygo-Baker, S., Littlejohn, A.: Reviewing affective, behavioural and cognitive learning gains in higher education. (Submitted)

    Google Scholar 

  26. Anderson, A.: An assessment of the perception of learning gains of freshmen students in an introductory course in nutrition and food science. J. Food Sci. Educ. 5, 25–30 (2006)

    Article  Google Scholar 

  27. Ojennus, D.D.: Assessment of learning gains in a flipped biochemistry classroom. Biochem. Mol. Biol. Educ. 44, 20–27 (2016)

    Article  Google Scholar 

  28. Hodgson, Y., Varsavsky, C., Matthews, K.E.: Assessment and teaching of science skills: whole of programme perceptions of graduating students. Assess. Eval. High. Educ. 39, 515–530 (2014)

    Article  Google Scholar 

  29. Varsavsky, C., Matthews, K.E., Hodgson, Y.: Perceptions of science graduating students on their learning gains. Int. J. Sci. Educ. 36, 929–951 (2014)

    Article  Google Scholar 

  30. Douglass, J.A., Thomson, G., Zhao, C.-M.: The learning outcomes race: the value of self-reported gains in large research universities. High. Educ. 64, 317–335 (2012)

    Article  Google Scholar 

  31. Richardson, J.T.E.: The attainment of white and ethnic minority students in distance education. Assess. Eval. High. Educ. 37, 393–408 (2012)

    Article  Google Scholar 

  32. Farrington, D.P.: Longitudinal research strategies: advantages, problems, and prospects. J. Am. Acad. Child Adolesc. Psychiatry 30, 369–374 (1991)

    Article  Google Scholar 

  33. Anaya, G.: College impact on student learning: comparing the use of self-reported gains, standardized test scores, and college grades. Res. High. Educ. 40, 499–526 (1999)

    Article  Google Scholar 

  34. Bowman, N.A.: Can 1st-year college students accurately report their learning and development? Am. Educ. Res. J. 47, 466–496 (2010)

    Article  Google Scholar 

  35. Gonyea, R.M.: Self-reported data in institutional research: review and recommendations. New Dir. Institutional Res. 2005, 73–89 (2005)

    Article  Google Scholar 

  36. Biggs, J., Tang, C.: Teaching For Quality Learning at University. McGraw-Hill Education, UK (2011)

    Google Scholar 

  37. Carless, D., Salter, D., Yang, M., Lam, J.: Developing sustainable feedback practices. Stud. High. Educ. 36, 395–407 (2011)

    Article  Google Scholar 

  38. Carless, D.: Trust, distrust and their impact on assessment reform. Assess. Eval. High. Educ. 34, 79–89 (2009)

    Article  Google Scholar 

  39. Ras, E., Whitelock, D., Kalz, M.: The promise and potential of e-Assessment for learning. In: Reimann, P., Bull, S., Kickmeier-Rust, M.D., Vatrapu, R., Wasson, B. (eds.) Measuring and Visualising Learning in the Information-Rich Classroom, pp. 21–40. Routledge, London (2016)

    Google Scholar 

  40. Terzis, V., Economides, A.A.: The acceptance and use of computer based assessment. Comput. Educ. 56, 1032–1044 (2011)

    Article  Google Scholar 

  41. Koedinger, K.R., Booth, J.L., Klahr, D.: Instructional complexity and the science to constrain it. Science 342, 935–937 (2013)

    Article  Google Scholar 

  42. Scherer, R., Meßinger-Koppelt, J., Tiemann, R.: Developing a computer-based assessment of complex problem solving in Chemistry. Int. J. STEM Educ. 1, 2 (2014)

    Article  Google Scholar 

  43. Whitelock, D.: Maximising student success with automatic formative feedback for both teachers and students. In: Ras, E., Joosten-ten Brinke, D. (eds.) CAA 2015. CCIS, vol. 571, pp. 142–148. Springer, Cham (2015). doi:10.1007/978-3-319-27704-2_14

    Chapter  Google Scholar 

  44. Price, M., O’Donovan, B., Rust, C., Carroll, J.: Assessment standards: a manifesto for change. Brookes eJournal Learn. Teach. 2, 1–2 (2008)

    Google Scholar 

  45. van Zundert, M., Sluijsmans, D., van Merriënboer, J.: Effective peer assessment processes: Research findings and future directions. Learn. Instr. 20, 270–279 (2010)

    Article  Google Scholar 

  46. Whitelock, D., Gilbert, L., Gale, V.: e-Assessment tales: what types of literature are informing day-to-day practice? Int. J. E-Assess. 3, (2013)

    Google Scholar 

  47. Hattie, J., Yates, G.C.R.: Visible Learning and the Science of How We Learn. Routledge, New York (2013)

    Google Scholar 

  48. Whitelock, D.: Activating assessment for learning: are we on the way with web 2.0? In: Lee, M.J.W., McLoughlin, C. (eds.) Web 2.0-Based e-Learning: Applying Social Informatics for Tertiary Teaching. IGI Global (2010)

    Google Scholar 

  49. Jensen, J.L., Kummer, T.A., Godoy, P.D.D.M.: Improvements from a flipped classroom may simply be the fruits of active learning. CBE-Life Sci. Educ. 14, 1–12 (2015)

    Article  Google Scholar 

  50. Yalaki, Y.: Simple formative assessment, high learning gains in college general chemistry. Egitim Arastirmalari-Eurasian J. Educ. Res. 10, 223–243 (2010)

    Google Scholar 

  51. Bao, L.: Theoretical comparisons of average normalized gain calculations. Am. J. Phys. 74, 917–922 (2006)

    Article  Google Scholar 

  52. Dimitrov, D.M., Rumrill Jr., P.D.: Pretest-posttest designs and measurement of change. Work 20, 159–165 (2003)

    Google Scholar 

  53. Marx, J.D., Cummings, K.: Normalized change. Am. J. Phys. 75, 87–91 (2007)

    Article  Google Scholar 

  54. Pike, G.R.: Lies, damn lies, and statistics revisited a comparison of three methods of representing change. Res. High. Educ. 33, 71–84 (1992)

    Article  Google Scholar 

  55. Hake, R.R.: Lessons From the Physics-Education Reform Effort (2001). arXiv:physics/0106087

  56. Snijders, T.A.B., Bosker, R.: Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. Sage Publications Ltd., London (2011)

    Book  MATH  Google Scholar 

  57. Rienties, B., Toetenel, L.: The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Comput. Hum. Behav. 60, 333–341 (2016)

    Article  Google Scholar 

  58. Mellanby, J., Martin, M., O’Doherty, J.: The “gender gap” in final examination results at Oxford University. Br. J. Psychol. 91, 377–390 (2000)

    Article  Google Scholar 

  59. Conger, D., Long, M.C.: Why are men falling behind? Gender gaps in college performance and persistence. Ann. Am. Acad. Pol. Soc. Sci. 627, 184–214 (2010)

    Article  Google Scholar 

  60. Kao, G., Thompson, J.S.: Racial and ethnic stratification in educational achievement and attainment. Ann. Rev. Sociol. 29, 417–442 (2003)

    Article  Google Scholar 

  61. Richardson, J.T.E.: The under-attainment of ethnic minority students in UK higher education: what we know and what we don’t know. J. Furth. High. Educ. 39, 278–291 (2015)

    Article  Google Scholar 

  62. Plant, E.A., Ericsson, K.A., Hill, L., Asberg, K.: Why study time does not predict grade point average across college students: implications of deliberate practice for academic performance. Contemp. Educ. Psychol. 30, 96–116 (2005)

    Article  Google Scholar 

  63. Rogaten, J., Moneta, G.B.: Positive and negative structures and processes underlying academic performance: a chained mediation model. J. Happiness Stud. 1–25 (2016)

    Google Scholar 

  64. Horn, C.: Standardized assessments and the flow of students into the college admission pool. Educ. Policy. 19, 331–348 (2005)

    Article  Google Scholar 

  65. Rasbash, J., Charlton, C., Browne, W.J., Healy, M., Cameron, B.: MLwiN Version 2.02. University of Bristol, Centre for Multilevel Modelling (2005)

    Google Scholar 

  66. Rasbash, J., Steele, F., Browne, W.J., Goldstein, H.: A User’s Guide to MLwiN. Cent. Multilevel Model. Univ. Bristol, 296 (2009)

    Google Scholar 

  67. Sanders, J., Rose-Adams, J.: Black and minority ethnic student attainment: a survey of research and exploration of the importance of teacher and student expectations. Widening Particip. Lifelong Learn. 16, 5–27 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Open University, Milton Keynes, UK

    Jekaterina Rogaten, Bart Rienties & Denise Whitelock

Authors
  1. Jekaterina Rogaten
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bart Rienties
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Denise Whitelock
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jekaterina Rogaten .

Editor information

Editors and Affiliations

  1. Fontys University of Applied Sciences, Welten Institute Open University, Heerlen, The Netherlands

    Desirée Joosten-ten Brinke

  2. Tallinn University, Tallinn, Estonia

    Mart Laanpere

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Rogaten, J., Rienties, B., Whitelock, D. (2017). Assessing Learning Gains. In: Joosten-ten Brinke, D., Laanpere, M. (eds) Technology Enhanced Assessment. TEA 2016. Communications in Computer and Information Science, vol 653. Springer, Cham. https://doi.org/10.1007/978-3-319-57744-9_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-57744-9_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-57743-2

  • Online ISBN: 978-3-319-57744-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation