skip to main content
10.1145/3563657.3596112acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Relevance, Effort, and Perceived Quality: Language Learners’ Experiences with AI-Generated Contextually Personalized Learning Material

Published:10 July 2023Publication History

ABSTRACT

Artificial intelligence has enabled scalable auto-creation of context-aware personalized learning materials. However, it remains unclear how content personalization shapes the learners’ experience. We developed one personalized and two non-personalized, crowdsourced versions of a mobile language learning app: (1) with personalized auto-generated photo flashcards, (2) the same flashcards provided through crowdsourcing, and (3) manually generated flashcards based on the same photos. A two-week in-situ study (n = 64) showed that learners assessed the quality of the non-personalized auto-generated material to be on par with manually generated material, which means that auto-generation is viable. However, when the auto-generation was personalized, the learners’ quality rating was significantly lower. Further analyses suggest that aspects such as prior expectations and required efforts must be addressed before learners can actually benefit from context-aware personalization with auto-generated material. We discuss design implications and provide an outlook on the role of content personalization in AI-supported learning.

References

  1. Victoria Abou-Khalil, Samar Helou, Mei‐Rong Alice Chen, Brendan Flanagan, Louis Lecailliez, Niels Pinkwart, and Hiroaki Ogata. 2021. Vocabulary recommendation approach for forced migrants using informal language learning tools. Universal Access in the Information Society (May 2021). https://doi.org/10.1007/s10209-021-00813-3Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Marilyn P. Arnone, Ruth V. Small, Sarah A. Chauncey, and H. Patricia McKenna. 2011. Curiosity, interest and engagement in technology-pervasive learning environments: a new research agenda. Educational Technology Research and Development 59, 2 (April 2011), 181–198. https://doi.org/10.1007/s11423-011-9190-9Google ScholarGoogle ScholarCross RefCross Ref
  3. Simon P. Bates, Ross K. Galloway, Jonathan Riise, and Danny Homer. 2014. Assessing the quality of a student-generated question repository. Physical Review Special Topics - Physics Education Research 10, 2 (July 2014), 020105. https://doi.org/10.1103/PhysRevSTPER.10.020105Google ScholarGoogle ScholarCross RefCross Ref
  4. Jennifer S. Beaudin, Stephen S. Intille, Emmanuel Munguia Tapia, Randy Rockinson, and Margaret E. Morris. 2007. Context-Sensitive Microlearning of Foreign Language Vocabulary on a Mobile Device. In Ambient Intelligence, David Hutchison, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Moni Naor, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Madhu Sudan, Demetri Terzopoulos, Doug Tygar, Moshe Y. Vardi, Gerhard Weikum, Bernt Schiele, Anind K. Dey, Hans Gellersen, Boris De Ruyter, Manfred Tscheligi, Reiner Wichert, Emile Aarts, and Alejandro Buchmann (Eds.). Vol. 4794. Springer Berlin Heidelberg, Berlin, Heidelberg, 55–72. https://doi.org/10.1007/978-3-540-76652-0_4 Series Title: Lecture Notes in Computer Science.Google ScholarGoogle ScholarCross RefCross Ref
  5. Elizabeth Ligon Bjork, Jeri L. Little, and Benjamin C. Storm. 2014. Multiple-choice testing as a desirable difficulty in the classroom. Journal of Applied Research in Memory and Cognition 3, 3 (Sept. 2014), 165–170. https://doi.org/10.1016/j.jarmac.2014.03.002Google ScholarGoogle ScholarCross RefCross Ref
  6. John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.Google ScholarGoogle Scholar
  7. Judee K. Burgoon. 1993. Interpersonal Expectations, Expectancy Violations, and Emotional Communication. Journal of Language and Social Psychology 12, 1-2 (March 1993), 30–48. https://doi.org/10.1177/0261927X93121003Google ScholarGoogle ScholarCross RefCross Ref
  8. Salvatore G. Chiarella, Giulia Torromino, Dionigi M. Gagliardi, Dario Rossi, Fabio Babiloni, and Giulia Cartocci. 2022. Investigating the negative bias towards artificial intelligence: Effects of prior assignment of AI-authorship on the aesthetic appreciation of abstract paintings. Computers in Human Behavior 137 (Dec. 2022), 107406. https://doi.org/10.1016/j.chb.2022.107406Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Graeme W. Coleman and Nick A. Hine. 2012. Twasebook: a "crowdsourced phrasebook" for language learners using Twitter. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction Making Sense Through Design - NordiCHI ’12. ACM Press, Copenhagen, Denmark, 805. https://doi.org/10.1145/2399016.2399157Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Runmin Cong, Jianjun Lei, Huazhu Fu, Ming-Ming Cheng, Weisi Lin, and Qingming Huang. 2019. Review of Visual Saliency Detection With Comprehensive Information. IEEE Transactions on Circuits and Systems for Video Technology 29, 10 (Oct. 2019), 2941–2959. https://doi.org/10.1109/TCSVT.2018.2870832Google ScholarGoogle ScholarCross RefCross Ref
  11. Gabriel Culbertson, Solace Shen, Erik Andersen, and Malte Jung. 2017. Have your Cake and Eat it Too: Foreign Language Learning with a Crowdsourced Video Captioning System. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland Oregon USA, 286–296. https://doi.org/10.1145/2998181.2998268Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hai Dang, Lukas Mecke, Florian Lehmann, Sven Goller, and Daniel Buschek. 2022. How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models. (2022). https://doi.org/10.48550/ARXIV.2209.01390 Publisher: arXiv Version Number: 1.Google ScholarGoogle ScholarCross RefCross Ref
  13. Florian Daniel, Pavel Kucherbaev, Cinzia Cappiello, Boualem Benatallah, and Mohammad Allahbakhsh. 2018. Quality Control in Crowdsourcing: A Survey of Quality Attributes, Assessment Techniques, and Assurance Actions. Comput. Surveys 51, 1 (Jan. 2018), 1–40. https://doi.org/10.1145/3148148Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Tilman Dingler, Albrecht Schmidt, and Tonja Machulla. 2017. Building Cognition-Aware Systems: A Mobile Toolkit for Extracting Time-of-Day Fluctuations of Cognitive Performance. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 1–15. https://doi.org/10.1145/3132025Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Fiona Draxler, Julia Maria Brenner, Manuela Eska, Albrecht Schmidt, and Lewis L Chuang. 2022. Agenda- and Activity-Based Triggers for Microlearning. In 27th International Conference on Intelligent User Interfaces. ACM, Helsinki Finland, 620–632. https://doi.org/10.1145/3490099.3511133Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Fiona Draxler, Laura Haller, Albrecht Schmidt, and Lewis L. Chuang. 2022. Auto-Generating Multimedia Language Learning Material for Children with Off-the-Shelf AI. In Mensch und Computer 2022 - Tagungsband, Bastian Pfleging, Kathrin Gerling, and Sven Mayer (Eds.). ACM, New York, 96–105. https://doi.org/10.1145/3543758.3543777Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Fiona Draxler, Audrey Labrie, Albrecht Schmidt, and Lewis L. Chuang. 2020. Augmented Reality to Enable Users in Learning Case Grammar from Their Real-World Interactions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–12. https://doi.org/10.1145/3313831.3376537Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Fiona Draxler, Elena Wallwitz, Albrecht Schmidt, and Lewis L. Chuang. 2020. An Environment-Triggered Augmented-Reality Application for Learning Case Grammar. In DELFI 2020 – Die 18. Fachtagung Bildungstechnologien der Gesellschaft für Informatik e.V., Raphael Zender, Dirk Ifenthaler, Thiemo Leonhardt, and Clara Schumacher (Eds.). Gesellschaft für Informatik e.V., Bonn, 389–390.Google ScholarGoogle Scholar
  19. Darren Edge, Elly Searle, Kevin Chiu, Jing Zhao, and James A. Landay. 2011. MicroMandarin: mobile language learning in context. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11. ACM Press, Vancouver, BC, Canada, 3169. https://doi.org/10.1145/1978942.1979413Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Andreas Graefe, Mario Haim, Bastian Haarmann, and Hans-Bernd Brosius. 2018. Readers’ perception of computer-generated news: Credibility, expertise, and readability. Journalism 19, 5 (May 2018), 595–610. https://doi.org/10.1177/1464884916641269Google ScholarGoogle ScholarCross RefCross Ref
  21. Mohammad Nehal Hasnine, Brendan Flanagan, Gokhan Akcapinar, Hiroaki Ogata, Kousuke Mouri, and Noriko Uosaki. 2019. Vocabulary Learning Support System Based on Automatic Image Captioning Technology. In Distributed, Ambient and Pervasive Interactions, Norbert Streitz and Shin’ichi Konomi (Eds.). Vol. 11587. Springer International Publishing, Cham, 346–358. https://doi.org/10.1007/978-3-030-21935-2_26 Series Title: Lecture Notes in Computer Science.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ari Hautasaari, Takeo Hamada, Kuntaro Ishiyama, and Shogo Fukushima. 2019. VocaBura: A Method for Supporting Second Language Vocabulary Learning While Walking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (Dec. 2019), 1–23. https://doi.org/10.1145/3369824Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Yihui He, Chenchen Zhu, Jianren Wang, Marios Savvides, and Xiangyu Zhang. 2019. Bounding Box Regression With Uncertainty for Accurate Object Detection. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Long Beach, CA, USA, 2883–2892. https://doi.org/10.1109/CVPR.2019.00300Google ScholarGoogle ScholarCross RefCross Ref
  24. Neil T. Heffernan, Korinn S. Ostrow, Kim Kelly, Douglas Selent, Eric G. Van Inwegen, Xiaolu Xiong, and Joseph Jay Williams. 2016. The Future of Adaptive Learning: Does the Crowd Hold the Key?International Journal of Artificial Intelligence in Education 26, 2 (June 2016), 615–644. https://doi.org/10.1007/s40593-016-0094-zGoogle ScholarGoogle ScholarCross RefCross Ref
  25. Catherine Regina Heil, Jason S. Wu, Joey J. Lee, and Torben Schmidt. 2016. A Review of Mobile Language Learning Applications: Trends, Challenges, and Opportunities. The EuroCALL Review 24, 2 (Sept. 2016), 32–50. https://doi.org/10.4995/eurocall.2016.6402Google ScholarGoogle ScholarCross RefCross Ref
  26. Suzanne Hidi and K. Ann Renninger. 2006. The Four-Phase Model of Interest Development. Educational Psychologist 41, 2 (June 2006), 111–127. https://doi.org/10.1207/s15326985ep4102_4Google ScholarGoogle ScholarCross RefCross Ref
  27. Joo-Wha Hong, Ignacio Cruz, and Dmitri Williams. 2021. AI, you can drive my car: How we evaluate human drivers vs. self-driving cars. Computers in Human Behavior 125 (Dec. 2021), 106944. https://doi.org/10.1016/j.chb.2021.106944Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Joo Wha Hong, Qiyao Peng, and Dmitri Williams. 2021. Are you ready for artificial Mozart and Skrillex? An experiment testing expectancy violation theory and AI music. New Media & Society 23, 7 (July 2021), 1920–1935. https://doi.org/10.1177/1461444820925798Google ScholarGoogle ScholarCross RefCross Ref
  29. Ching-Kun Hsu. 2015. Learning motivation and adaptive video caption filtering for EFL learners using handheld devices. ReCALL 27, 01 (Jan. 2015), 84–103. https://doi.org/10.1017/S0958344014000214Google ScholarGoogle ScholarCross RefCross Ref
  30. Theo Hug. 2007. Didactics of microlearning. Waxmann Verlag. https://books.google.de/books?hl=de&lr=&id=J0-KAwAAQBAJ&oi=fndGoogle ScholarGoogle Scholar
  31. Brandon Huynh, Jason Orlosky, and Tobias Hollerer. 2019. In-Situ Labeling for Augmented Reality Language Learning. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 1606–1611. https://doi.org/10.1109/VR.2019.8798358Google ScholarGoogle ScholarCross RefCross Ref
  32. Gwo-Jen Hwang, Chin-Chung Tsai, and Stephen JH Yang. 2008. Criteria, strategies and research issues of context-aware ubiquitous learning.Journal of Educational Technology & Society 11, 2 (2008).Google ScholarGoogle Scholar
  33. Adam Ibrahim, Brandon Huynh, Jonathan Downey, Tobias Hollerer, Dorothy Chun, and John O’donovan. 2018. ARbis Pictus: A Study of Vocabulary Learning with Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 24, 11 (Nov. 2018), 2867–2874. https://doi.org/10.1109/TVCG.2018.2868568Google ScholarGoogle ScholarCross RefCross Ref
  34. JASP Team. 2022. JASP (Version 0.16.3)[Computer software]. https://jasp-stats.org/Google ScholarGoogle Scholar
  35. John K. Kruschke and Torrin M. Liddell. 2018. The Bayesian New Statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychonomic Bulletin & Review 25, 1 (Feb. 2018), 178–206. https://doi.org/10.3758/s13423-016-1221-4Google ScholarGoogle ScholarCross RefCross Ref
  36. Sari Kujala, Ruth Mugge, and Talya Miron-Shatz. 2017. The role of expectations in service evaluation: A longitudinal study of a proximity mobile payment service. International Journal of Human-Computer Studies 98 (Feb. 2017), 51–61. https://doi.org/10.1016/j.ijhcs.2016.09.011Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Igor Labutov, Yun Huang, Peter Brusilovsky, and Daqing He. 2017. Semi-Supervised Techniques for Mining Learning Outcomes and Prerequisites. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, Halifax NS Canada, 907–915. https://doi.org/10.1145/3097983.3098187Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. David T. Lee, Emily S. Hamedian, Greg Wolff, and Amy Liu. 2019. Causeway: Scaling Situated Learning with Micro-Role Hierarchies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–12. https://doi.org/10.1145/3290605.3300304Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Sangmin-Michelle Lee. 2022. A systematic review of context-aware technology use in foreign language learning. Computer Assisted Language Learning 35, 3 (March 2022), 294–318. https://doi.org/10.1080/09588221.2019.1688836Google ScholarGoogle ScholarCross RefCross Ref
  40. Stephan Lewandowsky, Ullrich K. H. Ecker, Colleen M. Seifert, Norbert Schwarz, and John Cook. 2012. Misinformation and Its Correction: Continued Influence and Successful Debiasing. Psychological Science in the Public Interest 13, 3 (Dec. 2012), 106–131. https://doi.org/10.1177/1529100612451018Google ScholarGoogle ScholarCross RefCross Ref
  41. Shawn Loewen, Dustin Crowther, Daniel R. Isbell, Kathy Minhye Kim, Jeffrey Maloney, Zachary F. Miller, and Hima Rawal. 2019. Mobile-assisted language learning: A Duolingo case study. ReCALL 31, 3 (Sept. 2019), 293–311. https://doi.org/10.1017/S0958344019000065Google ScholarGoogle ScholarCross RefCross Ref
  42. Richard E. Mayer (Ed.). 2014. The Cambridge handbook of multimedia learning (second edition ed.). Cambridge University Press, New York.Google ScholarGoogle Scholar
  43. Detmar Meurers, Ramon Ziai, Luiz Amaral, Adriane Boyd, Aleksandar Dimitrov, Vanessa Metcalf, and Niels Ott. 2010. Enhancing authentic web pages for language learners. In Proceedings of the NAACL HLT 2010 Fifth Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, 10–18. https://doi.org/10.5555/1866795.1866797Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Hiroaki Ogata, Bin Hou, Noriko Uosaki, Kousuke Mouri, and Songran Liu. 2014. Ubiquitous Learning Project Using Life-logging Technology in Japan. Educational Technology & Society 17 (2014), 85–100.Google ScholarGoogle Scholar
  45. Thomas Olsson and Markus Salo. 2012. Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin Texas USA, 2779–2788. https://doi.org/10.1145/2207676.2208677Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Jahna Otterbacher. 2015. Crowdsourcing Stereotypes: Linguistic Bias in Metadata Generated via GWAP. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, Seoul Republic of Korea, 1955–1964. https://doi.org/10.1145/2702123.2702151Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Jan L. Plass and Shashank Pawar. 2020. Toward a taxonomy of adaptivity for learning. Journal of Research on Technology in Education 52, 3 (July 2020), 275–300. https://doi.org/10.1080/15391523.2020.1719943Google ScholarGoogle ScholarCross RefCross Ref
  48. Yvonne Rogers, Kay Connelly, Lenore Tedesco, William Hazlewood, Andrew Kurtz, Robert E. Hall, Josh Hursey, and Tammy Toscos. 2007. Why It’s Worth the Hassle: The Value of in-Situ Studies When Designing Ubicomp. In Proceedings of the 9th International Conference on Ubiquitous Computing(UbiComp ’07). Springer-Verlag, Berlin, Heidelberg, 336–353. https://doi.org/10.1007/978-3-540-74853-3_20Google ScholarGoogle ScholarCross RefCross Ref
  49. Richard M. Ryan and Edward L. Deci. 2009. Promoting self-determined school engagement: Motivation, learning, and well-being. In Handbook of motivation at school.Routledge/Taylor & Francis Group, New York, NY, US, 171–195.Google ScholarGoogle Scholar
  50. Sylvio Rüdian, Moritz Dittmeyer, and Niels Pinkwart. 2022. Challenges of using auto-correction tools for language learning. In LAK22: 12th International Learning Analytics and Knowledge Conference. ACM, Online USA, 426–431. https://doi.org/10.1145/3506860.3506867Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Burr Settles and Brendan Meeder. 2016. A Trainable Spaced Repetition Model for Language Learning. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany, 1848–1858. https://doi.org/10.18653/v1/P16-1174Google ScholarGoogle ScholarCross RefCross Ref
  52. Rustam Shadiev, Ting-Ting Wu, and Yueh-Min Huang. 2020. Using image-to-text recognition technology to facilitate vocabulary acquisition in authentic contexts. ReCALL 32, 2 (May 2020), 195–212. https://doi.org/10.1017/S0958344020000038Google ScholarGoogle ScholarCross RefCross Ref
  53. Ben Shneiderman. 2020. Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy. International Journal of Human–Computer Interaction 36, 6 (April 2020), 495–504. https://doi.org/10.1080/10447318.2020.1741118Google ScholarGoogle ScholarCross RefCross Ref
  54. Hendrik Thüs, Mohamed Amine Chatti, Esra Yalcin, Christoph Pallasch, Bogdan Kyryliuk, Togrul Mageramov, and Ulrik Schroeder. 2012. Mobile learning in context. International Journal of Technology Enhanced Learning 4, 5/6 (2012), 332. https://doi.org/10.1504/IJTEL.2012.051818Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Andrew Trusty and Khai N. Truong. 2011. Augmenting the web for second language vocabulary learning. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11. ACM Press, Vancouver, BC, Canada, 3179. https://doi.org/10.1145/1978942.1979414Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Carmen Tschofen and Jenny Mackness. 2012. Connectivism and dimensions of individual experience. The International Review of Research in Open and Distributed Learning 13, 1 (Jan. 2012), 124. https://doi.org/10.19173/irrodl.v13i1.1143Google ScholarGoogle ScholarCross RefCross Ref
  57. Christian David Vazquez, Afika Ayanda Nyati, Alexander Luh, Megan Fu, Takako Aikawa, and Pattie Maes. 2017. Serendipitous Language Learning in Mixed Reality. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’17. ACM Press, Denver, Colorado, USA, 2172–2179. https://doi.org/10.1145/3027063.3053098Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Eric-Jan Wagenmakers, Jonathon Love, Maarten Marsman, Tahira Jamil, Alexander Ly, Josine Verhagen, Ravi Selker, Quentin F. Gronau, Damian Dropmann, Bruno Boutin, Frans Meerhoff, Patrick Knight, Akash Raj, Erik-Jan van Kesteren, Johnny van Doorn, Martin Šmíra, Sacha Epskamp, Alexander Etz, Dora Matzke, Tim de Jong, Don van den Bergh, Alexandra Sarafoglou, Helen Steingroever, Koen Derks, Jeffrey N. Rouder, and Richard D. Morey. 2018. Bayesian inference for psychology. Part II: Example applications with JASP. Psychonomic Bulletin & Review 25, 1 (Feb. 2018), 58–76. https://doi.org/10.3758/s13423-017-1323-7Google ScholarGoogle ScholarCross RefCross Ref
  59. Candace Walkington and Matthew L. Bernacki. 2018. Personalization of Instruction: Design Dimensions and Implications for Cognition. The Journal of Experimental Education 86, 1 (Jan. 2018), 50–68. https://doi.org/10.1080/00220973.2017.1380590Google ScholarGoogle ScholarCross RefCross Ref
  60. Candace Walkington and Matthew L. Bernacki. 2020. Appraising research on personalized learning: Definitions, theoretical alignment, advancements, and future directions. Journal of Research on Technology in Education 52, 3 (July 2020), 235–252. https://doi.org/10.1080/15391523.2020.1747757Google ScholarGoogle ScholarCross RefCross Ref
  61. Xu Wang, Srinivasa Teja Talluri, Carolyn Rose, and Kenneth Koedinger. 2019. UpGrade: Sourcing Student Open-Ended Solutions to Create Scalable Learning Opportunities. In Proceedings of the Sixth (2019) ACM Conference on Learning @ Scale. ACM, Chicago IL USA, 1–10. https://doi.org/10.1145/3330430.3333614Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Sarah Weir, Juho Kim, Krzysztof Z. Gajos, and Robert C. Miller. 2015. Learnersourcing Subgoal Labels for How-to Videos. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, Vancouver BC Canada, 405–416. https://doi.org/10.1145/2675133.2675219Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Justin D. Weisz, Michael Muller, Stephanie Houde, John Richards, Steven I. Ross, Fernando Martinez, Mayank Agarwal, and Kartik Talamadupula. 2021. Perfection Not Required? Human-AI Partnerships in Code Translation. In 26th International Conference on Intelligent User Interfaces. ACM, College Station TX USA, 402–412. https://doi.org/10.1145/3397481.3450656Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Ryen W. White and Resa A. Roth. 2009. Exploratory Search: Beyond the Query—Response Paradigm. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-031-02260-9Google ScholarGoogle ScholarCross RefCross Ref
  65. Joseph Jay Williams, Juho Kim, Anna Rafferty, Samuel Maldonado, Krzysztof Z. Gajos, Walter S. Lasecki, and Neil Heffernan. 2016. AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning. In Proceedings of the Third (2016) ACM Conference on Learning @ Scale. ACM, Edinburgh Scotland UK, 379–388. https://doi.org/10.1145/2876034.2876042Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Tzu-Chi Yang, Gwo-Jen Hwang, and Stephen Jen-Hwa Yang. 2013. Development of an adaptive learning system with multiple perspectives based on students’ learning styles and cognitive styles. Journal of Educational Technology & Society 16, 4 (2013), 185.Google ScholarGoogle Scholar

Index Terms

  1. Relevance, Effort, and Perceived Quality: Language Learners’ Experiences with AI-Generated Contextually Personalized Learning Material

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference
          July 2023
          2717 pages
          ISBN:9781450398930
          DOI:10.1145/3563657

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 10 July 2023

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate1,158of4,684submissions,25%

          Upcoming Conference

          DIS '24
          Designing Interactive Systems Conference
          July 1 - 5, 2024
          IT University of Copenhagen , Denmark

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format