Abstract
This paper deals with authoring assessments of complex competence involving open-ended questions. We present, PépiGen, a multi-criteria automatic assessor for school algebra, via a walkthrough of an example. PépiGen is based on our previous work on Pépite, an automatic cognitive diagnosis tool that capitalizes on educational research results. From that prototype, we derived patterns of diagnosis tasks. A pattern models (i) a class of exercises, (ii) the different students’ points of view on the solutions reported in the literature or observed in a corpus, (iii) and a multidimensional assessment for each solution approach. To adapt an assessment to a specific classroom context (e.g. level of difficulty, time, learning objectives) an interface allows an IT non expert (e.g. a teacher) to generate new instances of exercises by filling the pattern parameters. The originality of our research lies in the fact that our system generates the automatic analysis of students’ simple or complex answers, such as algebraic reasoning. This is an ongoing work but preliminary evaluation shows that PépiGen is already successful in generating and analyzing most answers on several classes of problems.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Artigue, M., Assude, T., Grugeon, B., Lenfant, A.: Teaching and Learning Algebra: approaching complexity through complementary perspectives. In: ICMI Study Conference, Melbourne, pp. 21–32 (2001)
Delozanne, É., Prévit, D., Grugeon, B., Jacoboni, P.: Supporting teachers when diagnosing their students in algebra. In: AIED supplementary proceedings, pp. 461–470 (2003)
Delozanne, É., Vincent, C., Grugeon, B., Gélis, J.-M., Rogalski, J., Coulange, L.: From errors to stereotypes: Different levels of cognitive models in school algebra. E-learn, 262–269 (2005)
Delozanne, É., Le Calvez, F., Merceron, A., Labat, J.-M.: A Structured set of Design Patterns for Learners’ Assessment. JILR 18(2), 309–333 (2007)
Grugeon, B.: Design and development of a multidimensional grid of analysis in algebra. RDM 17(2), 167–210 (1997)
Hakem, K., Sander, E., Labat, J.-M.: DIANE, a diagnosis system for arithmetical problem solving. AIED, 258–265 (2005)
IMS Question & Test Interoperability, http://www.imsglobal.org/question/index.cfm
Joosten-ten Brinke, D., van Bruggen, J., Hermans, H., Burgers, J., Giesbers, B., Koper, R., Latour, I.: Modeling assessment for re-use of traditional and new types of assessment. Computers in Human Behavior 23(6), 2721–2741 (2007)
Koedinger, K.R., Anderson, J.R.: Intelligent Tutoring Goes to School in the Big City. IJAIED (8), 30–43 (1997)
LeActiveMath project, http://www.leactivemath.org/
Nicaud, J.F., Chaachoua, H., Bittar, M.: Automatic calculation of students’ conceptions in elementary algebra from Aplusix log files. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 433–442. Springer, Heidelberg (2006)
Murray, T.: An Overview of Intelligent Tutoring System Authoring Tools: Updated analysis of the state of the art. In: Authoring Tools for Advanced Technology Learning Environments, ch.17, Kluwer Academic (2003)
Prévit, D.: PépiGen, un générateur de batteries d’exercices pour un diagnostic cognitif en algèbre élémentaire, PhD dissertation (to appear)
Shapiro, J.: An Algebra Subsystem for Diagnosing Students’ Input in a Physics Tutoring System. IJAIED 15, 205–228 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Delozanne, É., Prévit, D., Grugeon, B., Chenevotot, F. (2008). Automatic Multi-criteria Assessment of Open-Ended Questions: A Case Study in School Algebra. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds) Intelligent Tutoring Systems. ITS 2008. Lecture Notes in Computer Science, vol 5091. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69132-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-69132-7_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69130-3
Online ISBN: 978-3-540-69132-7
eBook Packages: Computer ScienceComputer Science (R0)