Abstract
The implementation of effective pedagogical software is difficult to achieve. In this chapter we describe one possible solution to this problem, the evolutionary development of an Intelligent Tutoring System (ITS). This development process typically involves establishing training practices, developing automated instruction, and then amending motivational elements. While this development cycle can take years for completion because each step requires an iterative process of both execution and evaluation, it also has a greater chance of success. We illustrate such a cycle in this chapter in the evolution of an intelligent tutoring and gaming environment [i.e., interactive Strategy Trainer for Active Reading and Thinking-Motivationally Enhanced (iSTART-ME)] from an ITS (i.e., iSTART), which was originally conceived and tested as a human-delivered intervention (i.e., SERT).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Alexander, P. A., Murphy, P. K., Woods, B. S., Duhon, K. E., & Parker, D. (1997). College instruction and concomitant changes in students’ knowledge, interest, and strategy use: A study of domain learning. Contemporary Educational Psychology, 22, 125–146.
Anderson, J. R., Corbett, A. T., Koedinger, K., & Pelletier, R. (1995). Cognitive tutors: Lessons learned. The Journal of Learning Sciences, 4, 167–207.
Bandura, A. (2000). Self-efficacy: The foundation of agency. In W. Perig & A. Grob (Eds.), Control of human behavior, mental processes, and consciousness: Essays in honor of the 60th birthday of August Flammer (pp. 17–33). Mahwah, NJ: Erlbaum.
Bielaczyc, K., Pirolli, P. L., & Brown, A. L. (1995). Training in self-explanation and self-regulation strategies: Investigating the effects of knowledge acquisition activities on problem solving. Cognition and Instruction, 13, 221–252.
Boyer, K. E., Phillips, R., Wallis, M., Vouk, M., & Lester, J. (2008). Balancing cognitive and motivational scaffolding in tutorial dialogue. Proceedings of the Ninth International Conference on Intelligent Tutoring Systems (pp. 239–249). Canada: Montreal.
Bransford, J., Brown, A., & Cocking, R., (Eds.) (2000). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press. Retrieved form http://www.nap.edu/html/howpeople1/.
Brown, A. L., & Palincsar, A. S. (1982). Inducing strategic learning from texts by means of informed, self-control training. Topics in Learning and Learning Disabilities, 2, 1–17.
Chi, M. T. H., de Leeuw, N., Chiu, M. H., & Lavancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18, 439–477.
Conole, G., Dyke, M., Oliver, M., & Seale, J. (2004). Mapping pedagogy and tools for effective learning design. Computers & Education, 43, 17–33.
Cox, R., McKendree, J., Tobin, R., Lee, J., & Mayes, T. (1999). Vicarious learning from dialogue and discourse. Instructional Science, 27, 431–458.
Craig, S. D., Driscoll, D. M., & Gholson, B. (2004). Constructing knowledge from dialog in an intelligent tutoring system: Interactive learning, vicarious learning and pedagogical agents. Journal of Educational Multimedia and Hypermedia, 13, 163–183.
Csikszentmihaly, M. (1990). Flow, the psychology of optimal experience. New York: Harper Collins.
Dempsey, K. B., Brunelle, J. F., Jackson, G. T., Boonthum, C., Levinstein, I. B., & McNamara, D. S. (2009). MiBoard: Multiplayer interactive board game. In H.C. Lane, A. Ogan, & V. Shute (Eds.), Proceedings of the Workshop on Intelligent Educational Games at the 14th Annual Conference on Artificial Intelligence in Education (pp. 113–116). Brighton, UK: AIED.
Dynarski, M., Agodini, R., Heaviside, S., Novak, T., Carey, N., Campuzano, L., et al. (2007). Effectiveness of reading and mathematics software products: Findings from the first student cohort. Washington, DC: U.S. Department of Education, Institute of Education Sciences.
Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998). The measurement of textual coherence with Latent Semantic Analysis. Discourse Processes, 25, 285–307.
Graesser, A. C., Chipman, P., Leeming, F., & Biedenbach, S. (2009). Deep learning and emotion in serious games. In U. Ritterfield, M. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 81–100). Mahwah, NJ: Routledge, Taylor and Francis.
Graesser, A. C., Hu, X., & McNamara, D. S. (2005). Computerized learning environments that incorporate research in discourse psychology, cognitive science, and computational linguistics. In A. F. Healy (Ed.), Experimental cognitive psychology and its applications: Festschrift in honor of Lyle Bourne, Walter Kintsch, and Thomas Landauer (pp. 183–194). Washington, DC: American Psychological Association.
Graesser, A. C., Hu, X., & Person, N. (2001). Teaching with the help of talking heads. In T. Okamoto, R. Hartley, D. G. S. Kinshuk , & J. P. Klus (Eds.), Proceedings IEEE international conference on advanced learning technology: Issues, achievements and challenges (pp. 460–461). Los Alamitos, CA: IEEE Computer Society.
Graesser, A. C., Wiemer-Hastings, P., Wiemer-Hastings, K., Harter, D., Person, N., & the TRG (2000). Using latent semantic analysis to evaluate the contributions of students in AutoTutor. Interactive Learning Environments, 8, 129–148.
Gredler, M. E. (2004). Games and simulations and their relationships to learning. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology (pp. 571–582). Mahwah, NJ: Lawrence Erlbaum Associates.
Greene, J. A., & Azevedo, R. (2007). Adolescents’ use of self-regulatory processes and their relation to qualitative mental model shifts while using hypermedia. Journal of Educational Computing Research, 36, 125–148.
Hu, X., Graesser, A. C., & the Tutoring Research Group (1998). Using WordNet and latent semantic analysis to evaluate the conversational contributions of learners in tutorial dialog. Proceedings of the international conference on computers in education, Vol. 2 (pp. 337–341). Beijing: Springer.
Jackson, G. T., Boonthum, C., & McNamara, D. M. (2009). iSTART-ME: Situating extended learning within a game-based environment. Proceedings of the 14th international conference on artificial intelligence in education.
Jackson, G. T., & Graesser, A. C. (2007). Content matters: An investigation of feedback categories within an ITS. In R. Luckin, K. R. Koedinger, & J. Greer (Eds.), Proceedings of AIED 2007 Conference (pp. 127–134). Amsterdam: IOS Press.
Kennedy, D. (1998). Software development teams in higher education: An educator’s view. In R. M. Corderoy (Ed.), ASCILITE ‘98. flexibility: The next wave? Proceedings (pp. 373–385). Wollongong: ASCILITE.
Landauer, T., & Dumais, S. T. (1997). A solution to Plato’s Problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104, 211–240.
Landauer, T., Foltz, P. W., & Laham, D. (1998). An introduction to latent semantic analysis. Discourse Processes, 25, 259–284.
Landauer, T., McNamara, D. S., Dennis, S., & Kintsch, W. (Eds.). (2007). Handbook of latent semantic analysis. Mahwah, NJ: Erlbaum.
Levinstein, I. B., Boonthum, C., Pillarisetti, S. P., Bell, C., & McNamara, D. S. (2007). iSTART 2: Improvements for efficiency and effectiveness. Behavior Research Methods, 39, 224–232.
Louwerse, M. M., Graesser, A. C., Olney, A., & the TRG (2002). Good computational manners: Mixed-initiative dialog in conversational agents. In C. Miller (Ed.), Etiquette for human-computer work (pp. 71–76). Falmouth, MA: Sea Crest Conference Center.
Magliano, J. P., Todaro, S., Millis, K., Wiemer-Hastings, K., Kim, H. J., & McNamara, D. S. (2005). Changes in reading strategies as a function of reading training: A comparison of live and computerized training. Journal of Educational Computing Research, 32, 185–208.
McNamara, D. S. (2000a). Background knowledge assessment as a key to improving learning from text (Project JSMF 95-56). Final report submitted to James S. McDonnell Foundation Program in Cognitive Studies for Educational Practice.
McNamara, D. S. (2000b). Promoting active reading strategies to improve undergraduate students’ understanding of science. Final report submitted to the ODU College of Sciences and ODU Office of Academic Affairs.
McNamara, D. S. (2004a). Aprender del texto: efectos de la estructura textual y las estrategias del lector. Revista Signos, 37, 19–30.
McNamara, D. S. (2004b). SERT: Self-explanation reading training. Discourse Processes, 38, 1–30.
McNamara, D. S., Boonthum, C., Levinstein, I. B., & Millis, K. (2007). Evaluating self-explanations in iSTART: Comparing word-based and LSA algorithms. In T. Landauer, D. S. McNamara, S. Dennis, & W. Kintsch (Eds.), Handbook of latent semantic analysis (pp. 227–241). Mahwah, NJ: Erlbaum.
McNamara, D. S., Jackson, G. T., & Graesser, A. C. (2009). Intelligent tutoring and games. Proceedings of the 14th International conference on artificial intelligence in education.
McNamara, D. S., Jackson, G. T., & Graesser, A. C. (in press). Intelligent tutoring and games (ITaG). In Y. Baek (Ed.), Gaming for classroom-based learning: Digital role playing as a motivator of study. Plainsboro, NJ: IGE Global Press.
McNamara, D. S., Levinstein, I. B., & Boonthum, C. (2004). iSTART: Interactive strategy trainer for active reading and thinking. Behavioral Research Methods, Instruments, & Computers, 36, 222–233.
McNamara, D. S., O’Reilly, T., Best, R., & Ozuru, Y. (2006). Improving adolescent students’ reading comprehension with iSTART. Journal of Educational Computing Research, 34, 147–171.
McNamara, D. S., & Scott, J. L. (1999). Training reading strategies. In M. Hahn & S. C. Stoness (Eds.), Proceedings of the twenty first annual conference of the cognitive science society (pp. 387–392). Hillsdale, NJ: Erlbaum.
McNamara, D. S., & Shapiro, A. M. (2005). Multimedia and hypermedia solutions for promoting metacognitive engagement, coherence, and learning. Journal of Educational Computing Research, 33, 1–29.
Millis, K., Kim, H. J., Todaro, S., Magliano, J. P., Wiemer-Hastings, K., & McNamara, D. S. (2004). Identifying reading strategies using latent semantic analysis: Comparing semantic benchmarks. Behavior Research Methods, Instruments, & Computers, 36, 213–221.
Moreno, R., & Mayer, R. E. (2005). Role of guidance, reflection, and interactivity in an agent-based multimedia game. Journal of Educational Psychology, 97, 117–128.
Muñoz, B., Magliano, J. P., Sheridan, R., & McNamara, D. S. (2006). Typing versus thinking aloud when reading: Implications for computer-based assessment and training tools. Behavior Research Methods, Instruments, & Computers, 38, 211–217.
Okan, Z. (2003). Edutainment: is learning at risk? British Journal of Educational Technology, 34, 255–264.
Oliver, R. (2002). Winning the toss and electing to bat: Maximizing the opportunities of online learning. In C. Rust (Ed.), Proceedings of the 9th improving student learning conference (pp. 35–44). Oxford: OCSLD.
O’Reilly, T., Best, R., & McNamara, D. S. (2004). Self-Explanation reading training: Effects for low-knowledge readers. In K. Forbus, D. Gentner, T. Regier (Eds.), Proceedings of the twenty-sixth annual meeting of the cognitive science society (pp. 1053–1058). Mahwah, NJ: Erlbaum.
O’Reilly, T., Sinclair, G. P., & McNamara, D. S. (2004a). iSTART: A web-based reading strategy intervention that improves students’ science comprehension. In Kinshuk, D. G. S. & P. Isaías (Eds.), Proceedings of the IADIS international conference cognition and exploratory learning in digital age: CELDA 2004 (pp. 173–180). Lisbon, Portugal: IADIS Press.
O’Reilly, T., Sinclair, G. P., & McNamara, D. S. (2004b). Reading strategy training: Automated verses live. In K. Forbus, D. Gentner, T. Regier (Eds.), Proceedings of the twenty-sixth annual meeting of the cognitive science society (pp. 1059–1064). Mahwah, NJ: Erlbaum.
O’Reilly, T., Taylor, R. S., & McNamara, D. S. (2006). Classroom based reading strategy training: Self-explanation vs. reading control. In R. Sun & N. Miyake (Eds.), Proceedings of the 28th annual conference of the cognitive science society (pp. 1887). Mahwah, NJ: Erlbaum.
Palincsar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1, 117–175.
Pashler, H., Bain, P., Bottage, B., Graesser, A., Koedinger, K., McDaniel, M., et al. (2007). Organizing instruction and study to improve student learning (NCER 2007–2004). Washington, DC: National Center for Educational Research, Institute of Education Sciences, U.S. Department of Education.
Pressman, R. S. (1997). Software engineering: A practitioner’s approach (4th ed.). New York: McGraw-Hill Companies Inc.
Ricci, K., Salas, E., & Cannon-Bowers, J. A. (1996). Do computer-based games facilitate knowledge acquisition and retention? Military Psychology, 8(4), 295–307.
Roy, M., & Chi, M. T. H. (2005). The self-explanation principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 271–286). New York: Cambridge University Press.
Shapiro, A. M., & McNamara, D. S. (2000). The use of latent semantic analysis as a tool for the quantitative assessment of understanding and knowledge. Journal of Educational Computing Research, 22, 1–36.
Taylor, R., O’Reilly, T., Sinclair, G., & McNamara, D. S. (2006). Enhancing learning of expository science texts in a remedial reading classroom via iSTART. Proceedings of the 7th international conference of learning sciences (pp. 765–770). Bloomington, IN.
Thomas, R., Cahill, J., & Santilli, L. (1997). Using an interactive computer game to increase skill and self-efficacy regarding safer sex negotiation: Field test results. Health Education & Behavior, 24, 71–86.
Vygotsky, L. S. (1978). Mind in society. Cambridge, MA: Harvard University Press.
Wiemer-Hastings, P., Wiemer-Hastings, K., & Graesser, A. (1999). Improving an intelligent tutor’s comprehension of students with Latent Semantic Analysis. In S. P. Lajoie & M. Vivet (Eds.), Artificial intelligence in education (pp. 535–542). Amsterdam: IOS Press.
Witmer, B. G., & Singer, M. J. (1994). Measuring immersion in virtual environments (Technical Rep. 1014). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
Acknowledgments
This research was supported in part by the Institute for Educational Sciences (IES R305G020018-02; R305G040046; R305A080589) and National Science Foundation (NSF REC0241144; IIS-0735682). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the IES or NSF.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Jackson, G.T., Dempsey, K.B., McNamara, D.S. (2010). The Evolution of an Automated Reading Strategy Tutor: From the Classroom to a Game-Enhanced Automated System. In: Khine, M., Saleh, I. (eds) New Science of Learning. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-5716-0_14
Download citation
DOI: https://doi.org/10.1007/978-1-4419-5716-0_14
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-5715-3
Online ISBN: 978-1-4419-5716-0
eBook Packages: Humanities, Social Sciences and LawEducation (R0)