skip to main content
research-article

Analysis of telemetry data from a real-time strategy game: A case study

Published:06 December 2012Publication History
Skip Abstract Section

Abstract

This article describes the analysis of a simple, free-to-play real-time strategy (RTS) game called Pixel Legions. In developing this analysis, we worked with the developer to instrument, collect, and analyze telemetry data. The game design questions examined constitute macro- and micro-level analysis. We used pre-existing statistical and visualization tools to examine the macro-level questions. However, micro-level analysis was more game-specific, which required us to develop a novel visualization system to answer these questions in a way that is easy for the designer to understand. Our contribution constitutes the system we built and the analysis we developed to answer the questions imposed by the designer.

References

  1. Alexander, L. 2010. Gamasutra - News - Call Of Duty: Black Ops Hits $1 Billion In Sales. Gamasutra. http://www.gamasutra.com/view/news/32145/Call_Of_Duty_Black_Ops_Hits_1_Billion_In_Sales.php.Google ScholarGoogle Scholar
  2. Bernhaupt, R., Ijsselsteijn, W., Mueller, F., “Floyd,” Tscheligi, M., and Wixon, D. 2008. Evaluating user experiences in games. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, 3905--3908. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. CCP Recurve. 2011. Dev blog: Price indices. EVE Online Dev Blog. http://www.eveonline.com/devblog.asp?a=blog&nbid=3295.Google ScholarGoogle Scholar
  4. Chittaro, L., Ranon, R., and Ieronutti, L. 2006. VU-Flow: A visualization tool for analyzing navigation in virtual environments. IEEE Trans. Visualization Comput. Graph. 12, 6, 1475--1485. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Coulton, P., Bamford, W., Cheverst, K., and Rashid, O. 2008. 3d Space-time visualization of player behaviour in pervasive location-based games. Int, J. Comput. Games Technol., 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Drachen, A. and Canossa, A. 2009. Analyzing spatial user behavior in computer games using geographic information systems. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era, ACM, New York, 182--189. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Drachen, A. and Canossa, A. 2011. Evaluating motion: Spatial user behaviour in virtual environments. Int. J. Arts Technol. 4, 3, 294--314.Google ScholarGoogle ScholarCross RefCross Ref
  8. Drachen, A., Canossa, A., and Yannakakis, G. N. 2009. Player modeling using self-organization in tomb raider: Underworld. In Proceedings of the 5th International Conference on Computational Intelligence and Games, IEEE, Washigton, D.C., 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Fulton, B. 2002. Beyond psychological theory: Getting data that improves games. In Beyond Psychological Theory: Getting Data that Improves Games. http://www.gamasutra.com/gdc2002/features/fulton/fulton_01.htm.Google ScholarGoogle Scholar
  10. Gagné, A., Seif El-Nasr, M., and Shaw, C. D. 2011. A Deeper Look at the use of Telemetry for Analysis of Player Behavior in RTS Games. Springer, Berlin, 247--257. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hoobler, N., Humphreys, G., and Agrawala, M. 2004. Visualizing competitive behaviors in multi-user virtual environments. In Proceedings of the Conference on Visualization, IEEE, Washington, D.C., 163--170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Isbister, K. and Schaffer, N. 2008. Game Usability: Advancing the Player Experience. Morgan Kaufmann.Google ScholarGoogle ScholarCross RefCross Ref
  13. Kapler, T. and Wright, W. 2004. GeoTime information visualization. In Information Visualization, IEEE, Washington, D.C., 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Kennerly, D. 2003. Better game design through data mining. Gamasutra. http://www.gamasutra.com/features/20030815/kennerly_01.shtml.Google ScholarGoogle Scholar
  15. Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B., Pagulayan, R. J., and Wixon, D. 2008. Tracking real-time user experience (TRUE): A comprehensive instrumentation solution for complex systems. In Proceeding of the 26 Annual SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, 443--452. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Laurel, B., ed. 2003. Design Research: Methods and Perspectives. MIT Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mellon, L. and Kazemi, D. 2008. Wake up and smell the metrics!: Metrics-driven development in online games. http://maggotranch.com/AGC_2008.ppt.Google ScholarGoogle Scholar
  18. Niwinski, T. and Randall, D. J. 2010. Using telemetry to improve zombie killing. http://www.gdcvault.com/play/1013152/Using-Telemetry-to-Improve-Zombie.Google ScholarGoogle Scholar
  19. Rashid, O., Bamford, W., Coulton, P., Edwards, R., and Scheible, J. 2006. PAC-LAN: Mixed-reality gaming with RFID-enabled mobile phones. Comput. Entertain. 4, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Romero, R. 2008. Successful instrumentation: Tracking attitudes and behaviors to improve games. http://download.microsoft.com/download/7/6/a/76ad49f8-cf47-47d3-8894-df30c67e5c1f/GDC_2008_RamonRomero_SuccessfulInstrumentation.pps.Google ScholarGoogle Scholar
  21. Schuh, E., Gunn, D. V., Phillips, B., Pagulayan, R., Kim, J. H., and Wixon, D. 2012. TRUE instrumentation: Tracking real-time user experience in games. In Game Usability Advancing the Player Experience, K. Isbister and N. Schaffer, Eds., Morgan Kaufmann, 237--265.Google ScholarGoogle Scholar
  22. Thawonmas, R. and Iizuka, K. 2008. Visualization of online-game players based on their action behaviors. Int. J. Comput. Games Technol. 2008, 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Thompson, C. 2007. Halo 3: How Microsoft Labs invented a new science of play. Wired Magazine. http://www.wired.com/gaming/virtualworlds/magazine/15-09/ff_halo.Google ScholarGoogle Scholar
  24. Thurau, C. and Bauckhage, C. 2010. Analyzing the evolution of social groups in World of Warcraft. IEEE Symposium on Computational Intelligence and Games (CIG), IEEE, Washington, D.C., 170--177.Google ScholarGoogle Scholar
  25. Thurau, C. and Drachen, A. 2011. Introducing archetypal analysis for player classification in games. 2nd International Workshop on Evaluating Player Experience in Games (epex11): At 6th International Conference on the Foundations of Digital Games.Google ScholarGoogle Scholar
  26. Tychsen, A. and Canossa, A. 2008. Defining personas in games using metrics. In Proceedings of the 2008 Conference on Future Play: Research, Play, Share, ACM, New York, 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Williams, D., Consalvo, M., Caplan, S., and Yee, N. 2009. Looking for gender: Gender roles and behaviors among online gamers. J. Commun. 59, 4, 700--725.Google ScholarGoogle ScholarCross RefCross Ref
  28. Williams, D., Yee, N., and Caplan, S.E. 2008. Who plays, how much, and why? Debunking the stereotypical gamer profile. J. Comput.-Mediated Commun. 13, 4, 993--1018.Google ScholarGoogle ScholarCross RefCross Ref
  29. Zammitto, V. and Seif El-Nasr, M. 2010. User experience research for sports games. GDC Summit on Games User Research, San Francisco, USA, 2010Google ScholarGoogle Scholar
  30. Zammitto, V., Seif El-Nasr, M., and Newton, P. 2010. Exploring quantitative methods for evaluating sports games. CHI 2010 Workshop on Brain, Body and Bytes: Psychophysiological User Interaction.Google ScholarGoogle Scholar

Index Terms

  1. Analysis of telemetry data from a real-time strategy game: A case study

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image Computers in Entertainment
            Computers in Entertainment   Volume 10, Issue 1
            Theoretical and Practical Computer Applications in Entertainment
            October 2012
            103 pages
            EISSN:1544-3574
            DOI:10.1145/2381876
            Issue’s Table of Contents

            Copyright © 2012 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 6 December 2012
            • Accepted: 1 June 2012
            • Revised: 1 January 2012
            • Received: 1 July 2011

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format