Skip to main content
SpringerLink
Log in

Understanding EFL students’ chatbot-assisted argumentative writing: An activity theory perspective

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Despite growing interest in exploring the application of chatbots in language education, studies on the process of chatbot-assisted language learning are scant. This qualitative study uses activity theory to understand how English as a foreign language students engage with a chatbot, Argumate, when composing argumentative essays. Five Chinese undergraduate students performed an argumentative writing task with the assistance of Argumate. Screen recordings capturing the students’ writing processes, chat logs between the students and Argumate, the students’ argumentative essays, and their responses to a post-task questionnaire survey were collected and analysed. The results indicated that the students formed a learning community with Argumate in which they used various mediating tools, including online information sources, notes, translation tools, and typing assistants, to facilitate their interaction with the chatbot. Additionally, the student–Argumate collaborative writing was shaped by rules associated with meeting task requirements and following argumentative writing conventions. At the same time, the students’ need for additional scaffolds beyond those offered by Argumate posed challenges to their collaboration. Our findings contribute to a better understanding of the complex interplay among students, chatbots, and other key elements in the activity system of chatbot-assisted writing and generate insights into the application of chatbots to writing pedagogy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the first author, Kai Guo, upon reasonable request.

References

  • Bailey, D. (2019). Chatbots as conversational agents in the context of language learning. In Proceedings of the Fourth Industrial Revolution and Education (32–41).

  • Chaves, A. P., & Gerosa, M. A. (2021). How should my chatbot interact? A survey on social characteristics in human–chatbot interaction design. International Journal of Human-Computer Interaction, 37(8), 729–758. https://doi.org/10.1080/10447318.2020.1841438

    Article  Google Scholar 

  • Chen, X. W., & Lee, I. (2022). Conflicts in peer interaction of collaborative writing–A case study in an EFL context. Journal of Second Language Writing, 58, 100910. https://doi.org/10.1016/j.jslw.2022.100910

    Article  Google Scholar 

  • Chen, H. L., Vicki Widarso, G., & Sutrisno, H. (2020). A chatbot for learning Chinese: Learning achievement and technology acceptance. Journal of Educational Computing Research, 58(6), 1161–1189. https://doi.org/10.1177/0735633120929622

    Article  Google Scholar 

  • Chen, Z., Chen, W., Jia, J., & Le, H. (2022). Exploring AWE-supported writing process: An activity theory perspective. Language Learning & Technology, 26(2), 129–148. https://doi.org/10125/73482

  • Coniam, D. (2008). An evaluation of chatbots as software aids to learning English as a second language. The EUROCALL Review, 13, 2–14. https://doi.org/10.4995/eurocall.2008.16353

    Article  Google Scholar 

  • Engeström, Y. (1987). Learning by expanding: An activity theoretical approach to developmental research. Helsinki: Orienta-Konsultit.

    Google Scholar 

  • Engeström, Y. (1999). Activity theory and individual and social transformation. In Y. Engeström, R. Miettinen, & R.-L. Punamäki (Eds.), Perspective on Activity Theory: Learning in doing: Social, cognitive and computational perspectives (pp. 19–38). Cambridge University Press.

    Google Scholar 

  • Eric, M., Krishnan, L., Charette, F., & Manning, C. D. (2017). Key-value retrieval networks for task-oriented dialogue. In Proceedings of the 18th Annual SIGDial Meeting on Discourse and Dialogue (37–49). https://doi.org/10.48550/arXiv.1705.05414

  • Ferretti, R. P., Lewis, W. E., & Andrews-Weckerly, S. (2009). Do goals affect the structure of students’ argumentative writing strategies? Journal of Educational Psychology, 101(3), 577–589. https://doi.org/10.1037/a0014702

    Article  Google Scholar 

  • Fujioka, M. (2014). L2 student–U.S. professor interactions through disciplinary writing assignments: An activity theory perspective. Journal of Second Language Writing, 25, 40–58. https://doi.org/10.1016/j.jslw.2014.05.004

    Article  Google Scholar 

  • Fryer, L. K., & Carpenter, R. (2006). Bots as language learning tools. Language Learning & Technology, 10, 8–14. https://doi.org/10125/44068

  • Fryer, L. K., Coniam, D., Carpenter, R., & Lăpușneanu, D. (2020). Bots for language learning now: Current and future directions. Language Learning & Technology, 24(2), 8–22. http://hdl.handle.net/10125/44719

  • Guo, K., Gu, M., & Jin, T. (2021). Evaluating sources of evidence for argumentative writing: A collaborative learning design. TESOL Quarterly, 55(3), 1060–1070. https://doi.org/10.1002/tesq.3025

  • Guo, K., Wang, J., & Chu, S. K. W. (2022). Using chatbots to scaffold EFL students’ argumentative writing. Assessing Writing, 54, 100666. https://doi.org/10.1016/j.asw.2022.100666

  • Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023a). Investigating students’ engagement in chatbot-supported classroom debates. Interactive Learning Environments, 1–17. https://doi.org/10.1080/10494820.2023.2207181

  • Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023b). Effects of chatbot-assisted in-class debates on students’ argumentation skills and task motivation. Computers & Education, 203, 104862. https://doi.org/10.1016/j.compedu.2023.104862

  • Li, Y. (2013). Three ESL students writing a policy paper assignment: An activity-analytic perspective. Journal of English for Academic Purposes, 12(2), 73–86. https://doi.org/10.1016/j.jeap.2012.11.006

  • Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041

  • Hadoux, E., & Hunter, A. (2019). Comfort or safety? Gathering and using the concerns of a participant for better persuasion. Argument & Computation, 10(2), 113–147. https://doi.org/10.3233/AAC-191007

    Article  Google Scholar 

  • Han, D. E. (2020). The effects of voice-based AI chatbots on Korean EFL middle school students’ speaking competence and affective domains. Asia-Pacific Journal of Convergent Research Interchange, 6(7), 71–80.

    Article  Google Scholar 

  • Hsu, P. S., Van Dyke, M., Chen, Y., & Smith, T. J. (2015). The effect of a graph-oriented computer-assisted project-based learning environment on argumentation skills. Journal of Computer Assisted Learning, 31(1), 32–58. https://doi.org/10.1111/jcal.12080

    Article  Google Scholar 

  • Huang, W., Hew, K. F., & Fryer, L. K. (2021). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10.1111/jcal.12610

  • Jehn, K. A., & Mannix, E. A. (2001). The dynamic nature of conflict: A longitudinal study of intragroup conflict and group performance. Academy of Management Journal, 44(2), 238–251. https://doi.org/10.5465/3069453

    Article  Google Scholar 

  • Jehn, K. A., Greer, L., Levine, S., & Szulanski, G. (2008). The effects of conflict types, dimensions, and emergent states on group outcomes. Group Decision and Negotiation, 17(6), 465–495. https://doi.org/10.1007/s10726-008-9107-0

    Article  Google Scholar 

  • Jeon, J. (2021). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 1–26. https://doi.org/10.1080/09588221.2021.2021241

  • Jia, J., & Ruan, M. (2008). Use chatbot CSIEC to facilitate the individual learning in English instruction: A case study. In International Conference on Intelligent Tutoring Systems (706–708). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69132-7_84

  • Jin, Y., Jie, W., & Wang, W. (2022). An alignment study on the College English Test (CET) and language standards. Foreign Language World, 2, 24–32.

    Google Scholar 

  • Jin, T., Su, Y., & Lei, J. (2020). Exploring the blended learning design for argumentative writing. Language Learning & Technology, 24(2), 23–34. http://hdl.handle.net/10125/44720

  • Kessler, M. (2020). Technology-mediated writing: Exploring incoming graduate students’ L2 writing strategies with Activity Theory. Computers and Composition, 55, 102542. https://doi.org/10.1016/j.compcom.2020.102542

    Article  Google Scholar 

  • Kılıçkaya, F. (2020). Using a chatbot, Replika, to practice writing through conversations in L2 English: A case study. In M. Kruk, & M. Peterson (Eds.), New Technological Applications for Foreign and Second Language Learning and Teaching (pp. 221–238). IGI Global. https://doi.org/10.4018/978-1-7998-2591-3.ch011

  • Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018. https://doi.org/10.1007/s10639-022-11177-3

    Article  Google Scholar 

  • Le, D. T., Nguyen, C. T., & Nguyen, K. A. (2018). Dave the debater: A retrieval-based and generative argumentative dialogue agent. In Proceedings of the 5th Workshop on Argument Mining (pp. 121–130). https://doi.org/10.18653/v1/W18-5215

  • Lee, M., Liang, P., & Yang, Q. (2022). Coauthor: Designing a human-AI collaborative writing dataset for exploring language model capabilities. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1–19). https://doi.org/10.1145/3491102.3502030

  • Leontöev, A. N. (1978). Activity, consciousness, and personality. Prentice-Hall.

    Google Scholar 

  • Leontöev, A. N. (1981). Problems of the development of the mind. Progress Press.

    Google Scholar 

  • Lin, M. P. C., & Chang, D. (2020). Enhancing post-secondary writers’ writing skills with a chatbot: A mixed-method classroom study. Journal of Educational Technology & Society, 23(1), 78–92.

    Google Scholar 

  • Liu, F., & Stapleton, P. (2020). Counterargumentation at the primary level: An intervention study investigating the argumentative writing of second language learners. System, 89, 102198. https://doi.org/10.1016/j.system.2019.102198

    Article  Google Scholar 

  • Majidi, A. E., Janssen, D., & Graaff, R. D. (2021). The effects of in-class debates on argumentation skills in second language education. System, 101, 102576. https://doi.org/10.1016/j.system.2021.102576

    Article  Google Scholar 

  • Mayweg-Paus, E., Zimmermann, M., Le, N. T., & Pinkwart, N. (2021). A review of technologies for collaborative online information seeking: On the contribution of collaborative argumentation. Education and Information Technologies, 26, 2053–2089. https://doi.org/10.1007/s10639-020-10345-7

    Article  Google Scholar 

  • Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). Sage.

    Google Scholar 

  • Mitchell, S. (2000). Putting argument into the mainstream. In S. Mitchell & R. Andrews (Eds.), Learning to Argue in Higher Education (pp. 146–154). Portsmouth, NH: Boyton/Cook.

    Google Scholar 

  • Mwanza, D. (2002). Conceptualising work activity for CAL systems design. Journal of Computer Assisted Learning, 18(1), 84–92. https://doi.org/10.1046/j.0266-4909.2001.00214.x

    Article  Google Scholar 

  • O’Neill, T. A., & Mclarnon, M. J. (2018). Optimizing team conflict dynamics for high performance teamwork. Human Resource Management Review, 28(4), 378–394. https://doi.org/10.1016/j.hrmr.2017.06.002

    Article  Google Scholar 

  • Osborne, J., Erduran, S., & Simon, S. (2004). Enhancing the quality of argumentation in school science. Journal of Research in Science Teaching, 41(10), 994–1020. https://doi.org/10.1002/tea.20035

    Article  Google Scholar 

  • Qin, J., & Karabacak, E. (2010). The analysis of Toulmin elements in Chinese EFL university argumentative writing. System, 38(3), 444–456. https://doi.org/10.1016/j.system.2010.06.012

    Article  Google Scholar 

  • Rakshit, G., Bowden, K. K., Reed, L., Misra, A., & Walker, M. (2019). Debbie, the debate bot of the future. In Advanced Social Interaction with Agents (pp. 45–52). Springer, Cham. https://doi.org/10.1007/978-3-319-92108-2_5

  • Ren, B., & Zhu, W. (2023). A Chinese EFL student’s strategies in graduation thesis writing: An Activity Theory perspective. Journal of English for Academic Purposes, 61, 101202. https://doi.org/10.1016/j.jeap.2022.101202

    Article  Google Scholar 

  • Shah, P. P., & Jehn, K. A. (1993). Do friends perform better than acquaintances? The interaction of friendship, conflict, and task. Group Decision and Negotiation, 2(2), 149–165. https://doi.org/10.1007/BF01884769

    Article  Google Scholar 

  • Shi, Z., Liu, F., Lai, C., & Jin, T. (2022). Enhancing the use of evidence in argumentative writing through collaborative processing of content-based automated writing evaluation feedback. Language Learning & Technology, 26(2), 106–128. https://doi.org/10125/73481

  • Storch, N. (2005). Collaborative writing: Product, process, and students’ reflections. Journal of Second Language Writing, 14(3), 153–173. https://doi.org/10.1016/j.jslw.2005.05.002

    Article  Google Scholar 

  • Su, Y., Lin, Y., & Lai, C. (2023). Collaborating with ChatGPT in argumentative writing classrooms. Assessing Writing, 57, 100752. https://doi.org/10.1016/j.asw.2023.100752

    Article  Google Scholar 

  • Vygotsky, L. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

    Google Scholar 

  • Woo, D. J., Wang, Y., Susanto, H., & Guo, K. (2023). Understanding English as a foreign language students’ idea generation strategies for creative writing with natural language generation tools. Journal of Educational Computing Research, 1–19. https://doi.org/10.1177/07356331231175999

  • Yin, Q., & Satar, M. (2020). English as a foreign language learner interactions with chatbots: Negotiation for meaning. International Online Journal of Education and Teaching (IOJET), 7(2), 390–410. https://iojet.org/index.php/IOJET/article/view/707

  • Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022). Wordcraft: story writing with large language models. In 27th International Conference on Intelligent User Interfaces (pp. 841–852). https://doi.org/10.1145/3490099.3511105

  • Zhang, R., & Zou, D. (2022). A review of research on technology-enhanced peer feedback for second language writing based on the activity theory framework. Education and Information Technologies, 28(6), 6727–6753. https://doi.org/10.1007/s10639-022-11469-8

  • Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H. (2023). Effect of chatbot-assisted language learning: A meta-analysis. Education and Information Technologies, 1–21. https://doi.org/10.1007/s10639-023-11805-6

Download references

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Faculty of Education, The University of Hong Kong, Hong Kong, China

    Kai Guo, Yongyan Li & Samuel Kai Wah Chu

  2. School of Foreign Studies, South China Normal University, Guangzhou, China

    Yuanke Li

Authors
  1. Kai Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuanke Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yongyan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Samuel Kai Wah Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kai Guo.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, K., Li, Y., Li, Y. et al. Understanding EFL students’ chatbot-assisted argumentative writing: An activity theory perspective. Educ Inf Technol 29, 1–20 (2024). https://doi.org/10.1007/s10639-023-12230-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-023-12230-5

Keyword

Search

Navigation