Rachel Bellamy
John Richards
ABSTRACT
In this paper, we describe the use of CogTool, a tool that enables non-psychologists to create cognitive models of user tasks from which reliable estimates of skilled user task times can be derived. We show how CogTool was used to compare a new parallel programming toolkit built on Eclipse, with Vim, a programming editor typically used in command line environments. This comparison was conducted to evaluate new parallel/scientific systems as part of the US Defense Advanced Research Projects Agency's High Productivity Computing Systems initiative. Our models indicate that for the four tasks analyzed, the new Eclipse tools are faster than the command line environments. Surprisingly, our models also reveal that despite programmers' preference for keyboard interaction in command line environments, mouse-based interaction is sometimes faster.
- Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111, (4). 1036--1060.Google Scholar
Cross Ref
- Brown, A. B. and Hellerstein, J. L. (2004) An Approach to Benchmarking Configuration Complexity Proceedings of the 11th workshop on ACM SIGOPS European workshop. Google ScholarDigital Library
- Card, S. K., Moran, T. P., & Newell, A. (1983) The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates. Google ScholarDigital Library
- Furnas, G. W. (1986) Generalized fisheye views. SIGCHI Bulletin. 17, 4, 16--23. Google ScholarDigital Library
- John, B. E., (2010) Reducing the Variability between Novice Modelers: Results of a Tool for Human Performance Modeling Produced through Human-Centered Design. Proceedings of the 19th Annual Conference on Behavior Representation in Modeling and Simulation (BRIMS) (Charleston, SC, March 22--25, 2010).Google Scholar
- John, B. E., (submitted) Using Predictive Human Performance Models to Inspire and Support UI Design Recommendations. Manuscript submitted for publication.Google Scholar
- John, B., Prevas, K., Salvucci, D., & Koedinger, K. (2004) Predictive Human Performance Modeling Made Easy. Proceedings of CHI, 2004 (Vienna, Austria, April 24--29, 2004) ACM, New York. Google ScholarDigital Library
- Kirschenbaum, S. S., Gray, W. D., Ehret, B. D., & Miller, S. L. (1996) When using the tool interferes with doing the task. In M. J. Tauber (Ed.), Conference companion of the ACM CHI'96 Conference Human Factors in Computing Systems (pp. 203--204). New York: ACM Press. Google ScholarDigital Library
- Lawrance, J., Bellamy, R., Burnett, M. (2007) Scents in programs: Does information foraging theory apply to program maintenance? In Proceedings of Visual Languages and Human-Centric Computing, IEEE. Google ScholarDigital Library
- Pirolli, P. & Card, S. (1999) "Information foraging," Psychology Review, vol. 106, no. 4, pp. 643--675.Google ScholarCross Ref
- Teo, L. & John, B. E. (2008) Towards predicting user interaction with CogTool-Explorer. Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting (New York, NY, Sept 22--26, 2008).Google Scholar
Index Terms
- Using CogTool to model programming tasks
Recommendations
CogTool+: Modeling Human Performance at Large Scale
Cognitive modeling tools have been widely used by researchers and practitioners to help design, evaluate, and study computer user interfaces (UIs). Despite their usefulness, large-scale modeling tasks can still be very challenging due to the amount of ...
Deploying CogTool: integrating quantitative usability assessment into real-world software development
ICSE '11: Proceedings of the 33rd International Conference on Software EngineeringUsability concerns are often difficult to integrate into real-world software development processes. To remedy this situation, IBM research and development, partnering with Carnegie Mellon University, has begun to employ a repeatable and quantifiable ...
CogTool-Explorer: a model of goal-directed user exploration that considers information layout
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsCogTool-Explorer 1.2 (CTE1.2) predicts novice exploration behavior and how it varies with different user-interface (UI) layouts. CTE1.2 improves upon previous models of information foraging by adding a model of hierarchical visual search to guide ...
Comments