Skip to main content
SpringerLink
Log in

Modeling Learning Data for Feedback and Assessment

  • Chapter
  • First Online:
Domain-Specific Conceptual Modeling

Abstract

This chapter describes the application of metamodeling concepts to the case of modeling formative assessment methods and their deployment. It builds on Evidence-Centred Assessment Design (ECD) as the approach to conceptualizing the process of assessment design. We describe how we extended ECD by expressing its logic with concepts from metamodeling, and how we developed tool support for the modeling as well as the deployment step in the context of the NEXT-TELL project: the ADVISOR modeling toolkit. To illustrate how this platform-independent approach to assessment design can be utilized to address typical assessment challenges, examples from language learning are provided.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wayman, J.C., Stringfield, S., Yakimowski, M.: Software Enabling School Improvement Through Analysis of Student Data (CRESPAR Tech.Rep. No. 67). John Hopkins University, Baltimore (2004)

    Google Scholar 

  2. Wayman, J.C., Stringfield, S.: Technology-supported involvement of entire faculties in examination of student data for instructional improvement. Am. J. Edu. 112, 549–571 (2006)

    Article  Google Scholar 

  3. Shute, V.J.: Focus on formative feedback. Rev. Edu. Res. 78(1), 153–189 (2008)

    Article  Google Scholar 

  4. Cowie, B., Bell, B.: A model of formative assessment in science education. Assess. Education 6, 101–111 (1999)

    Article  Google Scholar 

  5. Mandinach, E.B.: A perfect time for data use: using data-driven decision making to inform practice. Edu. Psychol. 47(2), 71–85 (2012)

    Article  Google Scholar 

  6. Kowalski, T.J., Lasley, T.J.H. (eds.): Handbook of Data-based Decision Making in Education. Routledge, New York (2009)

    Google Scholar 

  7. Firestone, W.A., Schorr, R.Y., Monfils, L.F. (eds.): The Ambiguity of Teaching to the Test. Erlbaum, Mahwah (2004)

    Google Scholar 

  8. No Child Left Behind Act of 2001, U.S.C., Editor (2001)

    Google Scholar 

  9. Mandinach, E.B., Gummer, E.S.: A systematic view of implementing data literacy in educator preparation. Edu. Res. 42, 30–37 (2013)

    Article  Google Scholar 

  10. Young, V.M.: Supporting teachers’ use of data: the role of organization and policy. In: Mandinach, E.B., Honey, M. (eds.) Data-driven School Improvement, pp. 87–106. Teachers College Press, New York (2008)

    Google Scholar 

  11. King, S.P., Amon, C.: Assessment data: a tool for student and teacher growth. In: Mandinach, E.B., Honey, M. (eds.) Data-driven School Improvement, pp. 71–86. Teachers College Press, New York (2008)

    Google Scholar 

  12. Karagiannis, D., Kühn, H.: Metamodelling platforms. In: 3rd International Conference EC-Web 2002—Dexa 2002, Aix-en-Provence (2002)

    Google Scholar 

  13. Karagiannis, D: Agile modeling method engineering. Panhellenic Conference on Informatics, pp. 5–10 (2015)

    Google Scholar 

  14. Mislevy, R.J., Steinberg, L., Almond, R.G.: On the structure of educational assessments. Meas. Interdiscip. Res. Perspect., 1, 3–67 (2003)

    Google Scholar 

  15. Reimann, P., et al.: Specification of ECAAD methodology. Next-Tell Consortium, Graz, Austria (2011)

    Google Scholar 

  16. Utz, W., Reimann, P., Karagiannis, D.: Capturing learning activities in heterogeneous environments: a model-based approach for data marshalling. In: IEEE 14th International Conference on 2014 Advanced Learning Technologies (ICALT). IEEE Conference Publications, Athens (2014)

    Google Scholar 

  17. Shron, M.: Thinking with Data—How to Turn Information into Insights, p. 93 (2014)

    Google Scholar 

  18. Mislevy, R.J., Riscontente, M.M.: Evidence-centred assessment design. In: Downing, S.M., Haladyna, T.M. (eds.) Handbook of Test Development, pp. 61–90. Lawrence Erlbaum, Mahwah (2006)

    Google Scholar 

  19. Mislevy, R.J., Riscontente, M.M.: Evidence-centred Assessment Design: Layers, Structures, and Terminology (PADI Technical Report #9). SRI International, Palo Alto (2009)

    Google Scholar 

  20. Reigeluth, C.M., (ed.): Instructional-Design Theories and Models. vol. 2. Lawrence Erlbaum Associates, Hillsdale (1999)

    Google Scholar 

  21. Goodyear, P., Retalis, S. (eds.): Technology-Enhanced Learning: Design Patterns and Pattern Languages. Sense Publishers, Rotterdam (2010)

    Google Scholar 

  22. Alexander, C.: The Timeless Way of Building. Oxford University Press, New York (1979)

    Google Scholar 

  23. Mislevy, R.J., et al.: Design Patterns for Assessing Science Inquiry (PADI Technical Report 1). SRI International, Menlo Park (2003)

    Google Scholar 

  24. Riscontente, M.M., Mislevy, R.J., Hamel, L.: An introduction to PADI task templates. (Principled assessment designs for inquiry technical report 3). In: Principled Assessment Designs for Inquiry Technical Report 3 (2007)

    Google Scholar 

  25. Downing, S.M., Haladyna, T.M. (eds.): Handbook of Test Design, pp. 61–90. Lawrence Erlbaum, Mahwah (2006)

    Google Scholar 

  26. Laumer, S., Stetten, A., Eckhardt, A.: E-Assessment. Bus. Inf. Syst. Eng. 1(3), 263–265 (2009)

    Article  Google Scholar 

  27. Fill, H.-G., Redmond, T., Karagiannis, D.: Formalizing meta models with FDMM: the ADOxx case. ICEIS 2012: pp. 429–451 (2012)

    Google Scholar 

  28. On the Conceptualisation of Modelling Methods Using the ADOxx Meta Modelling Platform. Enterprise Modelling and Information Systems Architectures 8(1), 4–25 (2013)

    Google Scholar 

  29. Reimann, P., Kickmeier-Rust, M., Albert, D.: Problem solving learning environments and assessment: the knowledge space theory approach. Comput. Educ. 64, 183–193 (2013)

    Article  Google Scholar 

Download references

Tool Download

http://www.omilab.org/advisor.

Author information

Authors and Affiliations

  1. Faculty of Education and Social Work, The University of Sydney, Sydney, NSW, 2006, Australia

    Peter Reimann

  2. Research Group Knowledge Engineering, University of Vienna, 1090, Vienna, Austria

    Wilfrid Utz

Authors
  1. Peter Reimann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wilfrid Utz
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Computer Science, Research Group Knowledge Engineering, University of Vienna, Wien, Austria

    Dimitris Karagiannis

  2. Institute of Applied Informatics, Alpen-Adria-Universität Klagenfurt Institute of Applied Informatics, Klagenfurt, Austria

    Heinrich C. Mayr

  3. University of Trento , Trento, Italy

    John Mylopoulos

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Reimann, P., Utz, W. (2016). Modeling Learning Data for Feedback and Assessment. In: Karagiannis, D., Mayr, H., Mylopoulos, J. (eds) Domain-Specific Conceptual Modeling. Springer, Cham. https://doi.org/10.1007/978-3-319-39417-6_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-39417-6_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-39416-9

  • Online ISBN: 978-3-319-39417-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation