René F. Kizilcec
Maximillian Chen
ABSTRACT
Mobile learning is expanding rapidly due to its accessibility and affordability, especially in resource-poor parts of the world. Yet how students engage and learn with mobile learning has not been systematically analyzed at scale. This study examines how 93,819 Kenyan students in grades 6, 9, and 12 use a text message-based mobile learning platform that has millions of users across Sub-Saharan Africa. We investigate longitudinal variation in engagement over a one-year period for students in different age groups and check for evidence of learning gains using learning curve analysis. Student engagement is highest during school holidays and leading up to standardized exams, but persistence over time is low: under 25% of students return to the platform after joining. Clustering students into three groups based on their level of activity, we examine variation in their learning behaviors and quiz performance over their first ten days. Highly active students exhibit promising trends in terms of quiz completion, reattempts, and accuracy, but we do not see evidence of learning gains in this study. The findings suggest that students in Kenya use mobile learning either as an ad-hoc resource or a low-cost tutor to complement formal schooling and bridge gaps in instruction.
- Ani Aghababyan, Nicholas Lewkow, and Ryan S Baker. 2018. Enhancing the Clustering of Student Performance Using the Variation in Confidence. In International Conference on Intelligent Tutoring Systems. Springer, 274--279.Google Scholar
- John R Anderson, Albert T Corbett, Kenneth R Koedinger, and Ray Pelletier. 1995. Cognitive tutors: Lessons learned. The journal of the learning sciences 4, 2 (1995), 167--207.Google Scholar
- Elena Bárcena, Timothy Read, Joshua Underwood, Hiroyuki Obari, Diana Cojocnean, Toshiko Koyama, Antonio Pareja-Lora, Cristina Calle, Lourdes Pomposo, Noa Talaván, and others. 2015. State of the art of language learning design using mobile technology: sample apps and some critical reflection. (2015).Google Scholar
- Marcos Alexandre De Melo Barros and John Traxler. 2017. Mobile learning in undergraduate science education students: understanding the uses and strategies. Ense nanza de las ciencias: revista de investigación y experiencias didácticas Extra (2017), 725--730.Google Scholar
- Tom H Brown. 2005. Towards a model for m-learning in Africa. International Journal on E-learning 4, 3 (2005), 299--315.Google Scholar
- Deborah L Butler and Philip H Winne. 1995. Feedback and self-regulated learning: A theoretical synthesis. Review of educational research 65, 3 (1995), 245--281.Google Scholar
- Nathan M. Castillo. 2018a. Hello Hope / Merhaba Umut: case study by UNESCO-Pearson Initiative for Literacy. (2018).Google Scholar
- Nathan M. Castillo. 2018b. The Rainforest Alliance Farmer Training App: case study by UNESCO-Pearson Initative for Literacy. (2018).Google Scholar
- Benjamin L Castleman and Lindsay C Page. 2015. Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates? Journal of Economic Behavior & Organization 115 (2015), 144--160.Google ScholarCross Ref
- Sonya Cates, Daniel Barron, and Patrick Ruddiman. 2017. MobiLearn go: mobile microlearning as an active, location-aware game. In Proceedings of the 19th international conference on human-computer interaction with mobile devices and services. ACM, 103.Google ScholarDigital Library
- Maximillian Chen and René F Kizilcec. 2020. Return of the Student: Predicting Re-Engagement in Mobile Learning. In Proceedings of the Thirteenth International Conference on Educational Data Mining.Google Scholar
- Cody A Coleman, Daniel T Seaton, and Isaac Chuang. 2015. Probabilistic use cases: Discovering behavioral patterns for predicting certification. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale. ACM, 141--148.Google ScholarDigital Library
- Dan Corlett, Mike Sharples, Susan Bull, and Tony Chan. 2005. Evaluation of a mobile learning organiser for university students. Journal of computer assisted learning 21, 3 (2005), 162--170.Google ScholarCross Ref
- Nicola Dell and Neha Kumar. 2016. The ins and outs of HCI for development. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 2220--2232.Google ScholarDigital Library
- Tilman Dingler, Dominik Weber, Martin Pielot, Jennifer Cooper, Chung-Cheng Chang, and Niels Henze. 2017. Language learning on-the-go: opportune moments and design of mobile microlearning sessions. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 28.Google ScholarDigital Library
- Rebecca Ferguson and Doug Clow. 2015. Examining engagement: analysing learner subpopulations in massive open online courses (MOOCs). In Proceedings of the fifth international conference on learning analytics and knowledge. 51--58.Google ScholarDigital Library
- UNESCO Institute for Statistics. 2016. The world needs almost 69 million new teachers to reach the 2030 education goals. Sustainable Development Goals UIS/FS/2016/ED/39, 39 (2016), 1--16.Google Scholar
- UNESCO Institute for Statistics. 2018. One in five children, adolescents and youth is out of school. Sustainable Development Goals UIS/FS/2018/ED/48, 48 (2018), 1--13.Google Scholar
- Rachel Glennerster, Michael Kremer, Isaac Mbiti, and Kudzai Takavarasha. 2011. Access and quality in the Kenyan education system: a review of the progress, challenges and potential solutions. (2011).Google Scholar
- GSM Association. 2018a. The Mobile Economy: Sub-Saharan Africa. (2018). https://www.gsma.com/mobileeconomy/sub-saharan-africa/Google Scholar
- GSM Association. 2018b. More Than Half of Sub-Saharan Africa to be Connected to Mobile by 2025, Finds New GSMA Study. (2018). https://www.gsma.com/newsroom/press-release/more-than-half-of-sub-saharan-africa-to-be-connected-to-mobile-by-2025-finds-new-gsma-study/Google Scholar
- Chris S Hulleman and Kenn E Barron. 2015. Motivation interventions in education. L., Corno, EM Anderman,(Eds.), Handbook of educational psychology (2015), 160.Google Scholar
- Ana Ibanez Moreno, John Traxler, and others. 2016. MALL-based MOOCs for language teachers: challenges and opportunities. (2016).Google Scholar
- René F Kizilcec and Daniel Goldfarb. 2019. Growth Mindset Predicts Student Achievement and Behavior in Mobile Learning. In Proceedings of the ACM Conference on Learning at Scale.Google ScholarDigital Library
- René F Kizilcec and Sherif Halawa. 2015. Attrition and achievement gaps in online learning. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale. 57--66.Google ScholarDigital Library
- René F Kizilcec, Chris Piech, and Emily Schneider. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the third international conference on learning analytics and knowledge. ACM, 170--179.Google ScholarDigital Library
- René F Kizilcec, Justin Reich, Michael Yeomans, Christoph Dann, Emma Brunskill, Glenn Lopez, Selen Turkay, Joseph J Williams, and Dustin Tingley. 2020. Scaling up behavioral science interventions in online education. Proceedings of the National Academy of Sciences (2020).Google ScholarCross Ref
- René F Kizilcec and Emily Schneider. 2015. Motivation as a lens to understand online learners: Toward data-driven design with the OLEI scale. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 2 (2015), 1--24.Google ScholarDigital Library
- Kenneth Koedinger, Kyle Cunningham, Alida Skogsholm, and Brett Leber. 2008. An open repository and analysis tools for fine-grained, longitudinal learner data. In Educational Data Mining 2008.Google Scholar
- Hamid Reza Koohestani, Seyed Kamran Soltani Arabshahi, Fazlollah Ahmadi, and Nayereh Baghcheghi. 2019. The Experiences of Healthcare Professional Students about the Educational Impacts of Mobile Learning. The Qualitative Report 24, 7 (2019), 1593--1609.Google Scholar
- Sean Kross and Philip J Guo. 2018. Students, systems, and interactions: synthesizing the first four years of learning@ scale and charting the future. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. ACM, 2.Google ScholarDigital Library
- Agnes Kukulska-Hulme, John Traxler, and John Pettit. 2007. Designed and user-generated activity in the mobile age. Journal of Learning Design 2, 1 (2007), 52--65.Google ScholarCross Ref
- Agnes Kukulska-Hulme and Olga Viberg. 2018. Mobile collaborative language learning: State of the art. British Journal of Educational Technology 49, 2 (2018), 207--218.Google ScholarCross Ref
- Steven D Levitt, John A List, Susanne Neckermann, and Sally Sadoff. 2016. The behavioralist goes to school: Leveraging behavioral economics to improve educational performance. American Economic Journal: Economic Policy 8, 4 (2016), 183--219.Google ScholarCross Ref
- Michael A Madaio, Fabrice Tanoh, Axel Blahoua Seri, Kaja Jasinska, and Amy Ogan. 2019. "Everyone Brings Their Grain of Salt" Designing for Low-Literate Parental Engagement with a Mobile Literacy Technology in Côte d'Ivoire. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--15.Google ScholarDigital Library
- Harold F O'Neil, Jamal Abedi, Judy Miyoshi, and Ann Mastergeorge. 2005. Monetary incentives for low-stakes tests. Educational Assessment 10, 3 (2005), 185--208.Google ScholarCross Ref
- John Pettit and Agnes Kukulska-Hulme. 2007. Going with the grain: Mobile devices in practice. Australasian Journal of Educational Technology 23, 1 (2007).Google ScholarCross Ref
- Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. In Advances in neural information processing systems. 505--513.Google Scholar
- Iqbal Quadir. 2012. Form, Transform, Platform: How the Ubiquity of Mobile Phones Is Unleashing an Entrepreneurial Revolution. Innovations: Technology, Governance, Globalization 7, 4 (2012), 3--12.Google Scholar
- Dan Richardson, Pradthana Jarusriboonchai, Kyle Montague, and Ahmed Kharrufa. 2018. Parklearn: creating, sharing and engaging with place-based activities for seamless mobile learning. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 25.Google ScholarDigital Library
- Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L Murnane, Emma Brunskill, and James A Landay. 2019. QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Mohamed Sarrab, Mahmoud Elbasir, and Saleh Alnaeli. 2016. Towards a quality model of technical aspects for mobile learning services: An empirical investigation. Computers in Human Behavior 55 (2016), 100--112.Google ScholarDigital Library
- Mike Sharples, Josie Taylor, and Giasemi Vavoula. 2010. A theory of learning for the mobile age. In Medienbildung in neuen Kultuäumen. Springer, 87--99.Google Scholar
- Mohammad Shorfuzzaman, M Shamim Hossain, Amril Nazir, Ghulam Muhammad, and Atif Alamri. 2019. Harnessing the power of big data analytics in the cloud to support learning analytics in mobile learning environment. Computers in Human Behavior 92 (2019), 578--588.Google ScholarDigital Library
- Steven M Smith, Arthur Glenberg, and Robert A Bjork. 1978. Environmental context and human memory. Memory & Cognition 6, 4 (1978), 342--353.Google ScholarCross Ref
- Josie Taylor. 2006. Evaluating mobile learning: What are appropriate methods for evaluating learning in mobile enviroments. Big issues in mobile learning (2006), 25--27.Google Scholar
- John Traxler. 2005. Defining mobile learning. In IADIS International Conference Mobile Learning. 261--266.Google Scholar
- John Traxler. 2007. Defining, Discussing and Evaluating Mobile Learning: The moving finger writes and having writ? In: The International Review of Research in Open and Distance Learning, Vol. 8, Issue 2. Online: http://www. irrodl. org/index. php/irrodl/article/view/346/882,(Accessed: 03 September 2008) (2007).Google ScholarCross Ref
- John Traxler and Philip Dearden. 2005. The potential for using SMS to support learning and organisation in sub-Saharan Africa. In Proceedings of Development Studies Association Conference, Milton Keynes.Google Scholar
- Michael Trucano. 2016. Reflections on the last five years of 'mobile learning', World Bank Blog. (2016). https://blogs.worldbank.org/edutech/reflections-last-five-years-mobile-learningGoogle Scholar
- DA Wagner. 2014. Mobiles for reading: A landscape research review [Technical Report]. Washington, DC: USAID/JBS (2014).Google Scholar
Index Terms
- Student Engagement in Mobile Learning via Text Message
Recommendations
Using Learning Analytics to Promote Student Engagement and Achievement in Blended Learning: An Empirical Study
ICEBT '18: Proceedings of the 2018 2nd International Conference on E-Education, E-Business and E-TechnologyThe emergence of blended learning has huge impact on traditional learning. Blended learning has its own unique characteristics combining the advantages of traditional learning and online learning. However, some problems of blended learning have also ...
Impact of mobile technology on student attitudes, engagement, and learning
Mobile devices and collaborative learning environments are common tools in education but not all collaborative learning is structured the same. This study evaluated student learning in three different collaborative learning environments, both with and ...
Mobile Technology and Student Learning: What Does Current Research Reveal?
As mobile devices become ubiquitous, it is necessary to analyze if and how these devices can be used for learning. This systematic review is part of a larger review that analyzed 21 mobile learning research studies published from 2005-present. Eleven ...
Comments