Abstract
Studies on massive open online courses (MOOCs) users discuss the existence of typical profiles and their impact on the learning process of the students. However defining the typical behaviors as well as classifying the users accordingly is a difficult task. In this paper we suggest two methods to model MOOC users behaviour given their log data. We mold their behavior into a Markov Decision Process framework. We associate the user’s intentions with the MDP reward and argue that this allows us to classify them.
Supported by ANR-15-IDFN-0003-04.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Romero, C., Ventura, S.: Educational data science in massive open online courses. Wiley Interdisc. Rev. Data Min. Knowl. Discov. 7, e1187 (2017)
Ramesh, A., Goldwasser, D., Huang, B., Daume III, H., Getoor, L.: Modeling learner engagement in MOOCs using probabilistic soft logic. In: NIPS Workshop on Data Driven Education, p. 62 (2013)
Corrin, L., de Barba, P., Corin, C., Kennedy, G.: Visualizing patterns of student engagement and performance in MOOCs (2014)
Ye, C., Biswas, G.: Early prediction of student dropout and performance in MOOCs using higher granularity temporal information. J. Learn. Anal. 1, 169–172 (2014)
Thompson, C., Brooks, C., Teasley, S.: Towards a general method for building predictive models of learner success using educational time series data. In: Workshops of the International Conference on Learning Analytics and Knowledge (2014)
Geigle, C., Zhai, C.X.: Modeling MOOC student behavior with two-layer hidden Markov models. In: Learning at Scale (2017)
Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. The MIT Press, Cambridge (2005)
Andrew, N., Russell, S.J. : Algorithms for Inverse Reinforcement Learning. In: ICML 2000 Proceedings of the Seventeenth International Conference on Machine Learning (2000)
Wulfmeier, M., Ondruska, P., Posner, I.: Maximum Entropy Deep Inverse Reinforcement Learning (2016)
Levine, S., Popovie, Z., Koltun, V.: Nonlinear inverse reinforcement learning with Gaussian processes. In: Advances in Neural Information Processing Systems 24 (NIPS) (2011)
Surana, A., Srivastava, K.: Bayesian nonparametric inverse reinforcement learning for switched Markov decision processes. In: ICMLA 2014 13th International Conference on Machine Learning and Applications (2014)
Babe, M., Marivate, V.V., Subramanian, K., Littman, M.: Apprenticeship learning about multiple intentions. In: Proceedings of the International Conference on International Conference on Machine Learning (2011)
Ramachandran, D., Amir, E.: Bayesian inverse reinforcement learning. In: IJCAI 2007 Proceedings of the 20th International Joint Conference on Artifical Intelligence (2007)
Fox, E., Sudderth, E., Jordan, M., Willsky, A.: Nonparametric bayesian learning of switching linear dynamical systems. In: Neural Information Processing Systems (2009)
Michini, B., How, J.: Improving the efficiency of Bayesian inverse reinforcement learning. In: ICRA (2012)
Zhu, X., Ghahramani, Z.: Learning from labeled and unlabeled data with label propagation. Technical Report, Carnegie Mellon University (2002)
Viterbi, A.: Error bounds for convolutional codes and an asymptotically optimum decoding algorithm (1967)
Jarboui, F., Rocchisani, V., Kirchenmann, W.: Users behavioural inference with Markovian decision process and active learning. In: IAL@PKDD/ECML (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Jarboui, F. et al. (2019). Markov Decision Process for MOOC Users Behavioral Inference. In: Calise, M., Delgado Kloos, C., Reich, J., Ruiperez-Valiente, J., Wirsing, M. (eds) Digital Education: At the MOOC Crossroads Where the Interests of Academia and Business Converge. EMOOCs 2019. Lecture Notes in Computer Science(), vol 11475. Springer, Cham. https://doi.org/10.1007/978-3-030-19875-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-19875-6_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19874-9
Online ISBN: 978-3-030-19875-6
eBook Packages: Computer ScienceComputer Science (R0)