Erkan Er
Cristina Villa-Torrano
Dragan Gasevic
ABSTRACT
Peer reviews offer many learning benefits. Understanding students’ engagement in them can help design effective practices. Although learning analytics can be effective in generating such insights, its application in peer reviews is scarce. Theory can provide the necessary foundations to inform the design of learning analytics research and the interpretation of its results. In this paper, we followed a theory-based learning analytics approach to identifying students’ engagement patterns in a peer review activity facilitated via a web-based tool called Synergy. Process mining was applied on temporal learning data, traced by Synergy. The theory about peer review helped determine relevant data points and guided the top-down approach employed for their analysis: moving from the global phases to regulation of learning, and then to micro-level actions. The results suggest that theory and learning analytics should mutually relate with each other. Mainly, theory played a critical role in identifying a priori engagement patterns, which provided an informed perspective when interpreting the results. In return, the results of the learning analytics offered critical insights about student behavior that was not expected by the theory (i.e., low levels of co-regulation). The findings provided important implications for refining the grounding theory and its operationalization in Synergy.
- RolaAjjawi and David Boud. 2017. Researching feedback dialogue: An interactional analysis approach. Assess. Eval. High. Educ.42, 2 (2017), 252–265. DOI:https://doi.org/10.1080/02602938.2015.1102863Google Scholar
Cross Ref
- M.Bannert, P. Reimann, and C. Sonnenberg. 2014. Process mining techniques for analysing patterns and strategies in students’ self-regulated learning. Metacognition Learn.9, 2 (2014), 161–185. DOI:https://doi.org/https://doi.org/10.1007/s11409-013-9107-6Google ScholarCross Ref
- ErkanEr, Yannis Dimitriadis, and Dragan Gašević. 2020. A collaborative learning approach to dialogic peer feedback: a theoretical framework. Assess. Eval. High. Educ.Online, (2020).Google Scholar
- ErkanEr, Eduardo Gómez-Sánchez, Yannis Dimitriadis, Miguel L. Bote-Lorenzo, Juan I. Asensio-Pérez, and Susana Álvarez-Álvarez. 2019. Aligning learning design and learning analytics through instructor involvement: A MOOC case study. Interact. Learn. Environ.27, 5–6 (2019), 685–698. DOI:https://doi.org/10.1080/10494820.2019.1610455Google Scholar
- C.W. Günther and W. M. P. van der Aalst. 2007. Fuzzy mining – Adaptive process simplification based on multi-perspective metrics. In Business Process Management, 328–343. DOI:https://doi.org/10.1007/978-3-540-75183-0_24.Google Scholar
- JelenaJovanovi, Dragan Gasesvic, Shane Dawson, Abelardo Pardo, and Negin Mirriahi. 2017. Learning analytics to unveil learning strategies in a flipped classroom. Internet High. Educ.33, (2017), 74–85. DOI:https://doi.org/10.1016/j.iheduc.2017.02.001Google Scholar
- JonnaMalmberg, Sanna Järvelä, and Hanna Järvenoja. 2017. Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemp. Educ. Psychol.49, (2017), 160–174. DOI:https://doi.org/10.1016/j.cedpsych.2017.01.009Google Scholar
- MulderR. A., Pearce J. M., and Baik C. 2014. Peer review in higher education: Student perceptions before and after participation. Act. Learn. High. Educ.15, 2 (2014), 157–171. DOI:https://doi.org/10.1177/1469787414527391Google ScholarCross Ref
- RaoulMulder, Chi Baik, Ryan Naylor, and Jon Pearce. 2014. How does student peer review influence perceptions, engagement and academic outcomes? A case study. Assess. Eval. High. Educ.39, 6 (2014), 657–677.Google ScholarCross Ref
- DavidNicol, Avril Thomson, and Caroline Breslin. 2014. Rethinking feedback practices in higher education: a peer review perspective. Assess. Eval. High. Educ.39, 1 (2014), 102–122. DOI:https://doi.org/10.1080/02602938.2013.795518Google ScholarCross Ref
- PeterReimann. 2016. Connecting learning analytics with learning research: The role of design-based research. Learn. Res. Pract.2, 2 (2016), 130–142. DOI:https://doi.org/10.1080/23735082.2016.1210198Google ScholarCross Ref
- J.Saint, Whitelock-Wainwright A., D. Gasevic, and A Pardo. Trace-SRL: A framework for analysis of micro-level processes of self-regulated learning from trace data. IEEE Trans. Learn. Technol.DOI:https://doi.org/https://doi.org/10.1109/TLT.2020.3027496Google Scholar
- M.Siadaty, D. Gasevic, and M. Hatala. 2016. Trace-based micro-analytic measurement of self-regulated learning processes. J. Learn. Anal.3, 1 (2016), 183–214.Google ScholarCross Ref
- Chia-wenTsai. 2015. The effect of online co-regulated learning in the implementation of team-based learning on improving students’ involvement. High. Educ. Res. Dev.34, 6 (2015), 1270–1280. DOI:https://doi.org/10.1080/07294360.2015.1024631Google ScholarCross Ref
- Chia-wenTsai. 2015. Applying web-based co-regulated learning to develop students’ learning and involvement in a blended computing course. Interact. Learn. Environ.23, 3 (2015), 344–355. DOI:https://doi.org/10.1080/10494820.2013.764323Google ScholarCross Ref
- N.E. Winstone, R. A. Nash, M. Parker, and J. Rowntree. 2017. Supporting learners’ agentic engagement with feedback: A systematic review and a taxonomy of recipience processes. Educ. Psychol.52, 1 (2017), 17–37. DOI:https://doi.org/https://doi.org/10.1080/00461520.2016.1207538Google ScholarCross Ref
- AlyssaFriend Wise and David Williamson Shaffer. 2015. Why theory matters more than ever in the age of big data. J. Learn. Anal.2, 2 (2015), 5–13.Google ScholarCross Ref
- Theory-based learning analytics to explore student engagement patterns in a peer review activity
Recommendations
Deploying multimodal learning analytics models to explore the impact of digital distraction and peer learning on student performance
AbstractSocial media have been extensively incorporated in higher education as an indispensable tool for learning. Nevertheless, research has conflicting findings about its effectiveness due to the highly reported digital distraction and poor ...
Highlights- Multimodal data captures course performance in blended Problem-Based Learning.
- ...
The current state of using learning analytics to measure and support K-12 student engagement: A scoping review
LAK2023: LAK23: 13th International Learning Analytics and Knowledge ConferenceStudent engagement has been identified as a critical construct for understanding and predicting educational success. However, research has shown that it can be hard to align data-driven insights of engagement with observed and self-reported levels of ...
Unpacking the ‘Learning' in Student-Facing Analytics: Metacognition and the Zone of Proximal Development
Founded on the need to help university students develop a greater academic metacognitive capacity, student-facing learning analytics are considered useful tools for making students overtly aware of their own learning processes, helping students to ...
Comments