Amanda Swearngin
Myra Cohen
ABSTRACT
With the rise of tools for predictive human performance modeling in HCI comes a need to model legacy applications. Models of legacy systems are used to compare products to competitors, or new proposed design ideas to the existing version of an application. We present CogTool-Helper, an exemplar of a tool that results from joining this HCI need to research in automatic GUI testing from the Software Engineering testing community. CogTool-Helper uses automatic UI-model extraction and test case generation to automatically create CogTool storyboards and models and infer methods to accomplish tasks beyond what the UI designer has specified. A design walkthrough with experienced CogTool users reveal that CogTool-Helper resonates with a "pain point" of real-world modeling and provide suggestions for future work.
- Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111, 4, 1036--1060.Google Scholar
Cross Ref
- Bellamy, R., John, B. E., Kogan, S. (2011) Deploying CogTool: Integrating quantitative usability assessment into real-world software development. Proceeding of the 33rd International Conference on Software Engineering (ICSE '11). ACM, New York, NY, USA, 691--700. Google ScholarDigital Library
- Card, S. K., Moran, T. P., and Newell, A. 1983. The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates. Google ScholarDigital Library
- Chang, T., Yeh, T., and Miller, R. C. (2010) GUI testing using computer vision, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1535--1544. Google ScholarDigital Library
- Gray, W. D., John, B. E., & Atwood, M. E. (1993) Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-Computer Interaction, 8, 237--309. Google ScholarDigital Library
- Grechanik, M. Xie, Q. and Fu C. (2009) Creating GUI testing tools using accessibility technologies, Software Testing Verification and Validation Workshop, 243--250. Google ScholarDigital Library
- John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. 2004. Predictive human performance modeling made easy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 455--462. Google ScholarDigital Library
- Kieras, D. E. (1999). A Guide to GOMS Model Usability Evaluation using GOMSL and GLEAN3. University of Michigan. Available at: ftp://www.eecs.umich.edu/people/kieras/GOMS/GOMSL_Guide.pdfGoogle Scholar
- Knight, A., Pyrzak, G., and Green, C. 2007. When two methods are better than one: combining user study with cognitive modeling. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1783--1788. Google ScholarDigital Library
- Memon, A. M. (2002), GUI testing: pitfalls and process, IEEE Computer, 35(8), 87--88. Google ScholarDigital Library
- Memon, A. M. (2011) GUITAR- A GUI testing framework, available at: http://guitar.sourceforge.net.Google Scholar
- Memon, A. M. (2011) TerpOffice, available at: http://www.cs.umd.edu/~atif/TerpOffice/Google Scholar
- Memon, A. M., Banerjee, I and Nagarajan, A. (2003) GUI Ripping: Reverse engineering of graphical user interfaces for testing, In Proceedings of The 10th Working Conference on Reverse Engineering, 260--269. Google ScholarDigital Library
- Memon, A. M., Pollack, M. E. and Soffa, M. L. (2001) Hierarchical GUI test case generation using automated planning, IEEE Transactions on Software Engineering, 27(2), 144--155. Google ScholarDigital Library
- Monkiewicz, J. (1992). CAD's next-generation user interface. Computer-Aided Engineering, November, 1992, 55--56.Google Scholar
- Pirolli, P. and Card, S. K. (1999). Information foraging. Psychological Review, 106, 643--675.Google ScholarCross Ref
- St. Amant, R., and Riedl, M. O. (2001). A perception/action substrate for cognitive modeling in HCI. International Journal of Human-Computer Studies 55(1), 15--39.Google ScholarDigital Library
- Teo, L., John, B. E., and Blackmon, M. H. (2012) CogTool-Explorer: A Model of Goal-Directed User Exploration that Considers Information Layout. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA. Google ScholarDigital Library
- White L. and Almezen, H. (2000). Generating test cases for GUI responsibilities using complete interaction sequences, in International Symposium on Software Reliability Engineering (ISSRE), 110--121. Google ScholarDigital Library
- Yuan, X. and Memon. A. M. (2010). Generating event sequence-based test cases using GUI runtime state feedback. IEEE Transactions on Software Engineering, 36(1), 81--95. Google ScholarDigital Library
Index Terms
- Easing the generation of predictive human performance models from legacy systems
Recommendations
Using predictive human performance models to inspire and support UI design recommendations
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPredictive human performance modeling has traditionally been used to make quantitative comparisons between alternative designs (e.g., task execution time for skilled users) instead of identifying UI problems or making design recommendations. This note ...
Predictive human performance modeling made easy
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsAlthough engineering models of user behavior have enjoyed a rich history in HCI, they have yet to have a widespread impact due to the complexities of the modeling process. In this paper we describe a development system in which designers generate ...
Experiences with collaborative, distributed predictive human performance modeling
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsAlthough predictive human performance modeling has been researched for 30 years in HCI, to our knowledge modeling has been conducted as a solitary task of one modeler or, occasionally, two modelers working in tight face-to-face collaboration. In ...
Comments