ABSTRACT
An increasing amount of text is being read digitally. In this paper we explore how eye tracking devices can be used to aggregate reading data of many readers in order to provide authors and editors with objective and implicitly gathered quality feedback. We present a robust way to jointly evaluate the gaze data of multiple readers, with respect to various reading-related features. We conducted an experiment in which a group of high school students composed essays subsequently read and rated by a group of seven other students. Analyzing the recorded data, we find that the amount of regression targets, the reading-to-skimming ratio, reading speed and reading count are the most discriminative features to distinguish very comprehensible from barely comprehensible text passages. By employing machine learning techniques, we are able to classify the comprehensibility of text automatically with an overall accuracy of 62%.
- Biedert, R., Buscher, G., Lottermann, T., Schwarz, S., Möller, M., and Dengel, A. 2010. The Text 2.0 Framework. Workshop on Eye Gaze in Intelligent Human Machine Interaction.Google Scholar
- Biedert, R., Buscher, G., Hees, J., and Dengel, A. 2012. A Robust Realtime Reading-Skimming Classifier. In Proceedings of the 2012 Symposium on Eye-Tracking Research & Applications. Google ScholarDigital Library
- Buscher, G. 2010. Attention-Based Information Retrieval. PhD thesis, University Kaiserslautern, Kaiserslautern.Google Scholar
- DuBay, W. H. 2004. The Principles of Readability. Impact Information (Aug.).Google Scholar
- Duchowski, A. T. 2002. A Breadth-First Survey of Eye Tracking Applications. Behavior Research Methods, Instruments, and Computers 34, 4, 455--470.Google ScholarCross Ref
- Hunicke, R. 2004. AI for dynamic difficulty adjustment in games. Proceedings of the Challenges in Game AI Workshop, Nineteenth National Conference on Artificial Intelligence.. Google ScholarDigital Library
- Hyrskykari, A. 2006. Eyes in Attentive Interfaces: Experiences from Creating iDict, a Gaze-Aware Reading Aid. acta.uta.fi.Google Scholar
- Kamalski, J., Sanders, T., and Lentz, L. 2008. Coherence Marking, Prior Knowledge, and Comprehension of Informative and Persuasive Texts: Sorting Things Out. Discourse Processes, 45, 323--345.Google ScholarCross Ref
- Kennerly, D., 2003. Better Game Design Through Data Mining, Aug.Google Scholar
- Lenzner, T., Kaczmirek, L., and Galesic, M. 2011. Seeing Through the Eyes of the Respondent: An Eye-tracking Study on Survey Question Comprehension. International Journal of Public Opinion Research 23, 3 (Aug.), 361--373.Google ScholarCross Ref
- Miller, C. C., and Bosman, J. 2011. E-Books Outsell Print Books at Amazon. New York Times (May), B2.Google Scholar
- Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin.Google Scholar
Index Terms
- Towards robust gaze-based objective quality measures for text
Recommendations
Towards Predicting Reading Comprehension From Gaze Behavior
ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and ApplicationsAs readers of a language, we all agree to move our eyes in roughly the same way. Yet might there be hidden within this self-similar behavior subtle clues as to how a reader is understanding the material being read? Here we attempt to decode a reader’s ...
Detecting readers with dyslexia using machine learning with eye tracking measures
W4A '15: Proceedings of the 12th International Web for All ConferenceWorldwide, around 10% of the population has dyslexia, a specific learning disorder. Most of previous eye tracking experiments with people with and without dyslexia have found differences between populations suggesting that eye movements reflect the ...
E-Gaze Glasses: Simulating Natural Gazes for Blind People
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionGaze and eye contact are frequently in social occasions used among sighted people. Gaze is considered as a predictor of attention and engagement between interlocutors in conversations. However, gaze signals from the sighted are not accessible for the ...
Comments