Juan Antonio Caballero Hernández
Juan Manuel Dodero
ABSTRACT
Serious games are video games with educational purposes. Players interact in many points during a gameplay. These interactions can be registered, producing data sets with sequence of events which provide relevant information about player's skills. Unfortunately, traditional skill assessment methods present limitations to carry out a detailed analysis of large data sets. Sequence Analysis is a group of techniques which allow to analyze data sets consisting of sequence of events. These techniques have been successfully implemented in different fields, and we consider that they can help overcome these limitations. In this paper, we propose an architecture of skill assessment in learning experiences based on serious games using a set of Sequence Analysis techniques known as Process Mining. First, several in-game events are stored in a log. These events are produced by player's interactions with Key Performance Indicators included in the game. Second, event log is used as input for a Process Mining tool. Discovery process is executed and a behavioural model is provided. Third, an assessment metric must be carried out over the model. Finally, a synthetic experiment is conducted and promising results are obtained.
- Graven, O. H. and MacKinnon, L. 2005. A survey of current state-of-the art support for lifelong learning. In 6th International Conference on Information Technology Based Higher Education and Training 2005 (Santo Domingo, Dominican Republic, 9-9 July 2005). ITHET '05. IEEE, F2C/19-F2C/25.Google Scholar
Cross Ref
- Palés-Argullós, J., Nolla-Domenjó, M., Oriol-Bosch, a., and Gual, a. 2010. Proceso de Bolonia (I): educación orientada a competencias. Educación Médica. 13, 3 (Sep. 2010), 127--135.Google Scholar
- Traverso-Ribón, I., Balderas-Alberico, A., Dodero, J. M., Ruiz-Rube, I., and Palomo-Duarte, M. 2016. Open data framework for sustainable assessment of project-based learning experiences. Program. 50, 4, 380--398.Google ScholarCross Ref
- Berns, A., Isla-Montes, J. L., Palomo-Duarte, M., and Dodero, J. M. 2016. Motivation, students' needs and learning outcomes: a hybrid game-based app for enhanced language learning. SpringerPlus. 5, 1 (Aug. 2016), 1305.Google ScholarCross Ref
- Van Eck, R. (2006). Digital game-based learning: It's not just the digital natives who are restless. EDUCAUSE review, 41(2), 16--30.Google Scholar
- Djaouti, D., Alvarez, J., and Jessel, J. P. 2011. Classifying serious games: the G/P/S model. In Handbook of research on improving learning and motivation through educational games: Multidisciplinary approaches, P. Felicia, Ed. IGI Global. Hershey, PA, 118--136.Google Scholar
- Abbott, A. 1995. Sequence analysis: new methods for old ideas. Annual review of sociology. 21, 1, 93--113.Google Scholar
- van der Aalst, W. M. P., Adriansyah, A., De Medeiros, A. K. A., Arcieri, F., Baier, T., Blickle, T., ... and Burattin, A. 2012. Process mining manifesto. In International Conference on Business Process Management. Berlin, Germany: Springer Heidelberg. BPM '11 Workshops. Springer-Verlag, Berlin, Germany, 99, 169--194.Google Scholar
- Abt, C. C. 1970. Serious games: The art and science of games that simulate life. New York Viking.Google Scholar
- Sawyer, B. 2002. Serious Games: Improving Public Policy through Game-based Learning and Simulation (No. 2002-1). Washington D.C.: Woodrow Wilson International Center for Scholars.Google Scholar
- Zyda, M. 2005. From visual simulation to virtual reality to games. Computer. 38, 9, 25--32. Google ScholarDigital Library
- Michael, D. and Chen, S. 2006. Serious games. Games that educate, train, and inform. Thomson Course Technology, Boston, USA. Google ScholarDigital Library
- Buckingham, D. and Scanlon, M. 2000. That is edutainment: media, pedagogy and the market place. Paper presented to the International Forum of Researchers on Young People and the Media (Sydney, Australia, November).Google Scholar
- Corti, K. 2006. Games-based Learning; a serious business application. Informe de Pixel Learning. 34, 6, 1--20.Google Scholar
- Prensky, M. 2001. Digital game-based learning. McGraw-Hill, USA. Google ScholarDigital Library
- Schmidt, R., Emmerich, K., and Schmidt, B. 2015. Applied Games -- In Search of a New Definition. In 14th International Conference in Entertainment Computing (Trondheim, Norway). ICEC '15. Springer International Publishing, 100--111.Google Scholar
- Crisp, G. T. 2012. Integrative assessment: reframing assessment practice for current and future learning. Assessment & Evaluation in Higher Education. 37, 1, 33--43.Google ScholarCross Ref
- Ifenthaler, D., Eseryel, D., and Ge, X. 2012. Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives. Springer New York, NY, USA. Google ScholarDigital Library
- Chaudy, Y., Connolly, T., and Hainey, T. 2013. Specification and Design of a Generalized Assessment Engine for GBL Applications. In 7th European Conference on Games Based Learning (Oporto, Portugal). ECGBL, 105--114.Google Scholar
- Chen, S. and Michael, D. 2005. Proof of Learning: Assessment in Serious Games. Gamasutra. Retrieved from http://www.gamasutra.com/view/feature/2433/proof_of_learning_assessment_in_.phpGoogle Scholar
- Caballero-Hernández, J. A., Palomo-Duarte, M., Dodero, J. M. 2017. Skill assessment in learning experiences based on serious games: A Systematic Mapping Study. Computers & Education. 113, (Oct. 2017), 42--60.Google Scholar
- Danto, A. C. 1985. Narration and Knowledge. Columbia Univ. Press, New York, NY, USA.Google Scholar
- Chatman, S. 1978. Story and Discourse. Cornell Univ. Press, New York, NY, USA.Google Scholar
- Sampson, R. J. and Laub, J. H. 1993. Crime in the Making. Harvard Univ. Press, Cambridge, Massachusetts.Google Scholar
- Abbott, A. 1997. Of time and space: The contemporary relevance of the Chicago School. Social Forces. 75, 4 (Jun. 1997), 1149--1182.Google ScholarCross Ref
- Oliver, P. E. 1993. Formal models of collective action. Annual Review of Sociology. 19, 1 (Aug. 1993), 271--300.Google ScholarCross Ref
- Abbott, A. 1992. From causes to events notes on narrative positivism. Sociological Methods & Research. 20, 4 (May. 1992), 428--455.Google ScholarCross Ref
- Hamilton, J. D. 1994. Time series analysis (Vol. 2). Princeton university press, Princeton, New Jersey, USA.Google Scholar
- Steele, F. 2005. Event history analysis. ESRC National Centre for Research Methods.Google Scholar
- Batagelj, V., Kejžar, N., Korenjak-Èerne, S., and Zaveršnik, M. 2006. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, New York, NY, USA.Google Scholar
- van der Aalst, W. M. P. 2010. Process Mining Discovery, Conformance and Enhancement of Business Processes. Springer-Verlag, Berlin, Germany. Google ScholarDigital Library
- Raposo, F., Santos, G., and Pereira, J. 2013. SimClinic - An auxiliary tool for evaluation on clinical case settings. In 4th Serious Games Development and Applications (Trondheim, Norway, September 25-27). SGDA '13. Springer Berlin Heidelberg, Germany, 8101, 37--50.Google Scholar
- Petersen, S. and Bedek, M. 2012. Challenges and opportunities in evaluating learning in serious games: A look at behavioural aspects. In 3rd Serious Games Development and Applications (Bremen, Germany, September 26-29). SGDA '12. Springer Berlin Heidelberg, Germany, 7528, 219--230. Google ScholarDigital Library
Index Terms
- An architecture for skill assessment in serious games based on Event Sequence Analysis
Recommendations
Designing collaborative multiplayer serious games
The idea of Computer Supported Collaborative Learning (CSCL) is being investigated for more than twenty years. Since a few years, game-based approaches like video games for learning (Serious Games) offer new fields of application. The combination of ...
Serious Games Modeling
BDCA'17: Proceedings of the 2nd international Conference on Big Data, Cloud and ApplicationsRecently, serious games have become a crucial strategy that is devoted to improve e-learning. Nowadays, they play an important role in attaching player and learner to learn by having fun and to retain as much pedagogical information as possible. As a ...
Guiding Intuitive Learning in Serious Games: An Achievement-Based Approach to Externalized Feedback and Assessment
CISIS '12: Proceedings of the 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)Despite the rapid emergence of game-based learning as a method for conveying educational content, constructing pedagogies which effectively combine elements of entertainment gaming with methods of instruction remains a demanding task. Through the notion ...
Comments