skip to main content
10.1145/2470654.2470668acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Optimizing challenge in an educational game using large-scale design experiments

Published:27 April 2013Publication History

ABSTRACT

Online games can serve as research instruments to explore the effects of game design elements on motivation and learning. In our research, we manipulated the design of an online math game to investigate the effect of challenge on player motivation and learning. To test the \'1cInverted-U Hypothesis\'1d, which predicts that maximum game engagement will occur with moderate challenge, we produced two large-scale (10K and 70K subjects), multi-factor (2x3 and 2x9x8x4x25) online experiments. We found that, in almost all cases, subjects were more engaged and played longer when the game was easier, which seems to contradict the generality of the Inverted-U Hypothesis. Troublingly, we also found that the most engaging design conditions produced the slowest rates of learning. Based on our findings, we describe several design implications that may increase challenge-seeking in games, such as providing feedforward about the anticipated degree of challenge.

References

  1. Abuhamdeh, S. and Csikszentmihalyi, M. The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities. Personality and Social Psychology Bulletin 38, 3 (2012), 317--330.Google ScholarGoogle ScholarCross RefCross Ref
  2. Andersen, E., Liu, Y., Snider, R., Szeto, R., and Popovic, Z. Placing a value on aesthetics in online casual games. CHI 2011, May 7--12, 2011, Vancouver, Canada (2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Atkinson, J. Towards Experimental Analysis of Human Motivation in Terms of Motives, Expectances, and incentives. In J. Atkinson, ed., Motives in fantasy, action and society. Van Nostrand, Princeton, NJ, (1958) 288-- 305.Google ScholarGoogle Scholar
  4. Deci, E. L., & Ryan, R. M. (2000). The \'1cwhat\'1d and \'1cwhy\'1d of goal pursuits: Human needs and the selfdetermination of behavior. Psychological Inquiry, 4, 227--268.Google ScholarGoogle Scholar
  5. Gee, J.P. What video games have to teach us about learning and literacy. Computers in Entertainment, 1 (2003), 20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hays, R. The effectiveness of instructional games: A literature review and discussion. 2005. Technical report 2005-004, Naval Air Warfare Center Training Systems Division, Orlando, FL.Google ScholarGoogle Scholar
  7. Harter, S. Pleasure derived from challenge and the effects of receiving grades on children's difficulty level choices. Child Development 49, 3 (1978), 788--799.Google ScholarGoogle ScholarCross RefCross Ref
  8. Harter, S. Effectance Motivation Reconsidered: Towards a developmental model. Human Development; Human Development, (1978), 34--64.Google ScholarGoogle Scholar
  9. Heckhausen, H. Achievement motivation and its constructs: A cognitive model. Motivation and emotion 1, 4 (1977), 283--329.Google ScholarGoogle Scholar
  10. Heffernan, N. and Koedinger, K.R. A developmental model of algebra symbolization: the results of a difficulty factors assessment. Proc. Twentieth Annual Conference of the cognitive science society, (1998), 484489.Google ScholarGoogle Scholar
  11. Lomas D., Ching D., Stampfer, E., Sandoval, M., Koedinger, K. Battleship Numberline: A Digital Game for Improving Estimation Accuracy on Fraction Number Lines. Conference of the American Education Research Association (2012)Google ScholarGoogle Scholar
  12. Malone, T. Toward a theory of intrinsically motivating instruction. Cognitive Science 5, 4 (1981), 333--369.Google ScholarGoogle ScholarCross RefCross Ref
  13. Malone, T.W. What Makes Things Fun to Learn? Heuristics for Designing Instructional Computer Games. 1980, ACM.Google ScholarGoogle Scholar
  14. Randel, J., Morris, B., Wetzel, C., and Whitehill, B. The effectiveness of games for educational purposes: a review of recent research. Simulation & Gaming 23, 3 (1992), 261--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ritter, F. and Schooler, L. The Learning Curve. International Encyclopedia of the Social and Behavioral Sciences, 2001, 8602--8605.Google ScholarGoogle Scholar
  16. Rittle-Johnson, B., Siegler, R.S., and Alibali, M.W. Developing Conceptual Understanding and Procedural Skill in Mathematics: An Iterative Process. Journal of Educational Psychology 93, 2 (2001), 346--362.Google ScholarGoogle ScholarCross RefCross Ref
  17. Shapira, Z. Task choice and assigned goals as determinants of task motivation and performance. Org. Behavior & Human Dec. Proc. 44, 2 (1989), 141--165.Google ScholarGoogle Scholar
  18. Schell, J. The Art of Game Design. Morgan Kaufmann (2008) Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Stamper, J., Lomas, D., Ching, D., Ritter, S., Koedinger, K., and Steinhart, J. The Rise of the Super Experiment. Educational Data Mining, (2012), 196--200.Google ScholarGoogle Scholar
  20. Sweetser, P. and Wyeth, P. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE) 3, 3 (2005), 1--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Yannakakis, G.N., Denmark, S., and Hallam, J. Towards optimizing entertainment in computer games. (2007), 933--971 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Optimizing challenge in an educational game using large-scale design experiments

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2013
      3550 pages
      ISBN:9781450318990
      DOI:10.1145/2470654

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 April 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '13 Paper Acceptance Rate392of1,963submissions,20%Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI PLAY '24
      The Annual Symposium on Computer-Human Interaction in Play
      October 14 - 17, 2024
      Tampere , Finland

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader