ABSTRACT
Knowledge workers increasingly use multiple devices such as desktop computers, laptops, cell phones, and PDAs for personal information management (PIM) tasks. The use of several of these devices together creates higher task difficulty for users than when used individually (as reported in a recent survey we conducted). Prompted by this, we are conducting an experiment to study mental workload in multi-device scenarios. While mental workload has been shown to decrease at sub-task boundaries, it has not been studied if this still holds for sub-tasks performed on different devices. We hypothesize that the level of support provided by the system for task migration affects mental workload. Mental workload measurements can enable designers to isolate critical sub-tasks and redesign or optimize the user experience selectively. In addition, we believe that mental workload shows promise as a cross-tool, cross-task method of evaluating PIM tools, services and strategies, thus fulfilling a need expressed by several researchers in the area of personal information management. In this paper, we describe our ongoing experiment of measuring mental workload (via physiological as well as subjective measures) and its implications for users, designers and researchers in PIM.
- B. P. Bailey and S. T. Iqbal. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Trans. Comput.-Hum. Interact., 14(4):1--28, 2008. Google ScholarDigital Library
- J. Ballas, C. Heitmeyer, and M. Pérez-Quiñones. Evaluating two aspects of direct manipulation in advanced cockpits. In CHI '92: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 127--134, New York, NY, USA, 1992. ACM. Google ScholarDigital Library
- J. Beatty. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91(2):276--92, 1982.Google ScholarCross Ref
- O. Bergman, R. Beyth-Marom, and R. Nachmias. The project fragmentation problem in personal information management. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 271--274, New York, NY, USA, 2006. ACM Press. Google ScholarDigital Library
- D. A. Bertram, D. A. Opila, J. L. Brown, S. J. Gallagher, R. W. Schifeling, I. S. Snow, and C. O. Hershey. Measuring physician mental workload: Reliability and validity assessment of a brief instrument. Medical Care, 30(2):95--104, 1992.Google ScholarCross Ref
- S. G. Hart and L. E. Staveland. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload, 1:139--183, 1988.Google ScholarCross Ref
- S. T. Iqbal, P. D. Adamczyk, X. S. Zheng, and B. P. Bailey. Towards an index of opportunity: understanding changes in mental workload during task execution. In CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 311--320, New York, NY, USA, 2005. ACM Press. Google ScholarDigital Library
- S. T. Iqbal and B. P. Bailey. Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption. In CHI '05: CHI '05 extended abstracts on Human factors in computing systems, pages 1489--1492, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- D. Kelly. Evaluating personal information management behaviors and tools. Commun. ACM, 49(1):84--86, 2006. Google ScholarDigital Library
- J. Klingner, R. Kumar, and P. Hanrahan. Measuring the task-evoked pupillary response with a remote eye tracker. In Eye Tracking Research and Applications Symposium, Savannah, Georgia, 2008. Google ScholarDigital Library
- D. M. Levy. To grow in wisdom: Vannevar Bush, Information Overload, and the Life of Leisure. In JCDL '05: Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, pages 281--286, New York, NY, USA, 2005. ACM Press. Google ScholarDigital Library
- R. D. O'Donnell and F. T. Eggemeier. Workload assessment methodology, volume 2 of Handbook of perception and human performance: Vol. 2. Cognitive processes and performance, chapter Workload assessment methodology, pages 42/1--42/49. Wiley, New York, 1986.Google Scholar
- P. S. Pyla, M. Tungare, and M. Pérez-Quiñones. Multiple user interfaces: Why consistency is not everything, and seamless task migration is key. In Proceedings of the CHI 2006 Workshop on The Many Faces of Consistency in Cross-Platform Design., 2006.Google Scholar
- J. C. Schryver. Experimental validation of navigation workload metrics. Human Factors and Ergonomics Society Annual Meeting Proceedings, 38:340--344(5), 1994.Google ScholarCross Ref
- M. Tungare and M. Pérez-Quiñones. It's not what you have, but how you use it: Compromises in mobile device use. Technical report, Computing Research Repository (CoRR), 2008.Google Scholar
- M. Tungare and M. Pérez-Quiñones. An exploratory study of personal calendar use. Technical report, Computing Research Repository (CoRR), 2008.Google Scholar
Index Terms
- Mental workload in multi-device personal information management
Recommendations
Towards task-based personal information management evaluations
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrievalPersonal Information Management (PIM) is a rapidly growing area of research concerned with how people store, manage and refind information. A feature of PIM research is that many systems have been designed to assist users manage and refind information, ...
Factors in Personal Information Management Evaluation
Advances in Visual InformaticsAbstractPersonal Information Management (PIM) is the domain that involves methods and procedures to study how people keep, manage, maintain and re-find information. Related studies show that re-finding could be a difficult and time-consuming task due to ...
Mobile personal information management agent: Supporting natural language interface and application integration
Managing personal information such as to-dos and contacts has become our daily routines, consuming more time than needed. Existing PIM tools require extensive involvement of human users. This becomes a problem in using mobile devices due to their ...
Comments