skip to main content
10.1145/2168556.2168593acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

Towards robust gaze-based objective quality measures for text

Published:28 March 2012Publication History

ABSTRACT

An increasing amount of text is being read digitally. In this paper we explore how eye tracking devices can be used to aggregate reading data of many readers in order to provide authors and editors with objective and implicitly gathered quality feedback. We present a robust way to jointly evaluate the gaze data of multiple readers, with respect to various reading-related features. We conducted an experiment in which a group of high school students composed essays subsequently read and rated by a group of seven other students. Analyzing the recorded data, we find that the amount of regression targets, the reading-to-skimming ratio, reading speed and reading count are the most discriminative features to distinguish very comprehensible from barely comprehensible text passages. By employing machine learning techniques, we are able to classify the comprehensibility of text automatically with an overall accuracy of 62%.

References

  1. Biedert, R., Buscher, G., Lottermann, T., Schwarz, S., Möller, M., and Dengel, A. 2010. The Text 2.0 Framework. Workshop on Eye Gaze in Intelligent Human Machine Interaction.Google ScholarGoogle Scholar
  2. Biedert, R., Buscher, G., Hees, J., and Dengel, A. 2012. A Robust Realtime Reading-Skimming Classifier. In Proceedings of the 2012 Symposium on Eye-Tracking Research & Applications. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Buscher, G. 2010. Attention-Based Information Retrieval. PhD thesis, University Kaiserslautern, Kaiserslautern.Google ScholarGoogle Scholar
  4. DuBay, W. H. 2004. The Principles of Readability. Impact Information (Aug.).Google ScholarGoogle Scholar
  5. Duchowski, A. T. 2002. A Breadth-First Survey of Eye Tracking Applications. Behavior Research Methods, Instruments, and Computers 34, 4, 455--470.Google ScholarGoogle ScholarCross RefCross Ref
  6. Hunicke, R. 2004. AI for dynamic difficulty adjustment in games. Proceedings of the Challenges in Game AI Workshop, Nineteenth National Conference on Artificial Intelligence.. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hyrskykari, A. 2006. Eyes in Attentive Interfaces: Experiences from Creating iDict, a Gaze-Aware Reading Aid. acta.uta.fi.Google ScholarGoogle Scholar
  8. Kamalski, J., Sanders, T., and Lentz, L. 2008. Coherence Marking, Prior Knowledge, and Comprehension of Informative and Persuasive Texts: Sorting Things Out. Discourse Processes, 45, 323--345.Google ScholarGoogle ScholarCross RefCross Ref
  9. Kennerly, D., 2003. Better Game Design Through Data Mining, Aug.Google ScholarGoogle Scholar
  10. Lenzner, T., Kaczmirek, L., and Galesic, M. 2011. Seeing Through the Eyes of the Respondent: An Eye-tracking Study on Survey Question Comprehension. International Journal of Public Opinion Research 23, 3 (Aug.), 361--373.Google ScholarGoogle ScholarCross RefCross Ref
  11. Miller, C. C., and Bosman, J. 2011. E-Books Outsell Print Books at Amazon. New York Times (May), B2.Google ScholarGoogle Scholar
  12. Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin.Google ScholarGoogle Scholar

Index Terms

  1. Towards robust gaze-based objective quality measures for text

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications
        March 2012
        420 pages
        ISBN:9781450312219
        DOI:10.1145/2168556

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 28 March 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate69of137submissions,50%

        Upcoming Conference

        ETRA '24
        The 2024 Symposium on Eye Tracking Research and Applications
        June 4 - 7, 2024
        Glasgow , United Kingdom

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader