Maurice Koch
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Comparing mobile eye tracking data from multiple participants without information about areas of interest (AOIs) is challenging because of individual timing and coordinate systems. We present a technique, the gaze spiral, that visualizes individual recordings based on image content of the stimulus. The spiral layout of the slitscan visualization is used to create a compact representation of scanpaths. The visualization provides an overview of multiple recordings even for long time spans and helps identify and annotate recurring patterns within recordings. The gaze spirals can also serve as glyphs that can be projected to 2D space based on established scanpath metrics in order to interpret the metrics and identify groups of similar viewing behavior. We present examples based on two egocentric datasets to demonstrate the effectiveness of our approach for annotation and comparison tasks. Our examples show that the technique has the potential to let users compare even long-term recordings of pervasive scenarios without manual annotation.
Supplemental Material
Available for Download
zip
koch.zip (36.7 MB)
Supplemental movie, appendix, image and software files for, A Spiral into the Mind: Gaze Spiral Visualization for Mobile Eye Tracking
- Wolfgang Aigner, Silvia Miksch, Heidrun Schumann, and Christian Tominski. 2011. Visualization of Time-Oriented Data. Springer-Verlag, London.Google Scholar
- Nicola C. Anderson, Fraser Anderson, Alan Kingstone, and Walter F. Bischof. 2015. A comparison of scanpath comparison methods. Behavior Research Methods 47, 4(2015), 1377--1392.Google ScholarCross Ref
- Donald J. Berndt and James Clifford. 1994. Using Dynamic Time Warping to find patterns in time series. In Knowledge Discovery in Databases: Papers from the 1994 AAAI Workshop, Seattle, Washington. Technical Report WS-94-03, Usama M. Fayyad and Ramasamy Uthurusamy (Eds.). 359--370.Google Scholar
- F. N. Bezerra and E. Lima. 2006. Low cost soccer video summaries based on visual rhythm. In Proceedings of the ACM International Workshop on Multimedia Information Retrieval. 71--78.Google Scholar
- T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf, and T. Ertl. 2017. Visualization of eye tracking data: A taxonomy and survey. Computer Graphics Forum 36, 8 (2017), 260--284.Google ScholarCross Ref
- Tanja Blascheck, Kuno Kurzhals, Michael Raschke, Stefan Strohmaier, Daniel Weiskopf, and Thomas Ertl. 2016. AOI hierarchies for visual exploration of fixation sequences. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 111--118.Google ScholarDigital Library
- Rita Borgo, Min Chen, Ben Daubney, Edward Grundy, Gunther Heidemann, Benjamin Höferlin, Markus Höferlin, Heike Leitte, Daniel Weiskopf, and Xianghua Xie. 2012. State of the art report on video-based graphics and video visualization. Computer Graphics Forum 31, 8 (2012), 2450--2477.Google ScholarDigital Library
- Andreas Bulling, Andrew T. Duchowski, and Päivi Majaranta. 2011. PETMEI 2011: the 1st international workshop on pervasive eye tracking and mobile eye-based interaction. In Proceedings of the 13th International Conference on Ubiquitous Computing. 627--628.Google ScholarDigital Library
- Michael Burch. 2018. Identifying similar eye movement patterns with t-SNE. In Proceedings of the Conference on Vision, Modeling, and Visualization. 111--118.Google ScholarDigital Library
- Nora Castner, Thomas C. Kuebler, Katharina Scheiter, Juliane Richter, Therese Eder, Fabian Huettig, Constanze Keutel, and Enkelejda Kasneci. 2020. Deep semantic gaze embedding and scanpath comparison for expertise classification during OPT viewing. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 18:1--18:10.Google ScholarDigital Library
- Revital Dafner, Daniel Cohen-Or, and Yossi Matias. 2000. Context-based space filling curves. Computer Graphics Forum 19, 3 (2000), 209--218.Google ScholarCross Ref
- Kenneth Holmqvist, Marcus Nyström, and Fiona Mulvey. 2012. Eye tracker data quality: What it is and how to measure it. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 45--52.Google ScholarDigital Library
- Qiang Ji and Xiaojie Yang. 2002. Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-time Imaging 8, 5 (2002), 357--377.Google ScholarDigital Library
- Peter Kiefer, Ioannis Giannopoulos, Martin Raubal, and Andrew Duchowski. 2017. Eye tracking for spatial research: Cognition, computation, challenges. Spatial Cognition & Computation 17, 1-2 (2017), 1--19.Google ScholarCross Ref
- Maurice Koch, Kuno Kurzhals, and Daniel Weiskopf. 2018. Image-based scanpath comparison with slit-scan visualization. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 55:1--55:5.Google ScholarDigital Library
- Kai Kunze, Yuzuko Utsumi, Yuki Shiga, Koichi Kise, and Andreas Bulling. 2013. I know what you are reading: Recognition of document types using mobile eye tracking. In Proceedings of the 2013 International Symposium on Wearable Computers. 113--116.Google ScholarDigital Library
- Kuno Kurzhals. 2021. Image-based projection labeling for mobile eye tracking. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 1--12.Google ScholarDigital Library
- Kuno Kurzhals, Michael Burch, Tanja Blascheck, Gennady Andrienko, Natalia Andrienko, and Daniel Weiskopf. 2017. A task-based view on the visual analysis of eye-tracking data. In Eye Tracking and Visualization: Foundations, Techniques, and Applications (ETVIS 2015), Michael Burch, Lewis Chuang, Brian Fisher, Albrecht Schmidt, and Daniel Weiskopf (Eds.). Springer International Publishing AG, Cham, Switzerland, 3--22.Google Scholar
- Kuno Kurzhals, Florian Heimerl, and Daniel Weiskopf. 2014. ISeeCube: Visual analysis of gaze data for video. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 43--50.Google ScholarDigital Library
- Kuno Kurzhals, Marcel Hlawatsch, Michael Burch, and Daniel Weiskopf. 2016a. Fixation-image charts. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 11--18.Google ScholarDigital Library
- Kuno Kurzhals, Marcel Hlawatsch, Florian Heimerl, Michael Burch, Thomas Ertl, and Daniel Weiskopf. 2015. Gaze stripes: Image-based visualization of eye tracking data. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2015), 1005--1014.Google ScholarDigital Library
- Kuno Kurzhals, Marcel Hlawatsch, Christof Seeger, and Daniel Weiskopf. 2016b. Visual analytics for mobile eye tracking. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2016), 301--310.Google ScholarDigital Library
- Kuno Kurzhals, Nils Rodrigues, Maurice Koch, Michael Stoll, Andres Bruhn, Andreas Bulling, and Daniel Weiskopf. 2020. Visual analytics and annotation of pervasive eye tracking video. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 1--9.Google ScholarDigital Library
- Kuno Kurzhals and Daniel Weiskopf. 2016. Visualizing eye tracking data with gaze-guided slit-scans. In Proceedings of the IEEE Workshop on Eye Tracking and Visualization (ETVIS). 45--49.Google ScholarCross Ref
- Michael F. Land and Mary Hayhoe. 2001. In what ways do eye movements contribute to everyday activities? Vision Research 41, 25-26 (2001), 3559--3565.Google ScholarCross Ref
- Vladimir I. Levenshtein et al. 1966. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, Vol. 10. 707--710.Google Scholar
- Yin Li, Miao Liu, and James M Rehg. 2018. In the eye of beholder: Joint learning of gaze and actions in first person video. In Proceedings of the European Conference on Computer Vision (ECCV). 619--635.Google ScholarDigital Library
- Leland McInnes, John Healy, and James Melville. 2018. UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018).Google Scholar
- Simona Naspetti, Roberto Pierdicca, Serena Mandolesi, Marina Paolanti, Emanuele Frontoni, and Raffaele Zanoli. 2016. Automatic analysis of eye-tracking data for augmented reality applications: A prospective outlook. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. 217--230.Google ScholarCross Ref
- Rudolf Netzel, Bettina Ohlhausen, Kuno Kurzhals, Robin Woods, Michael Burch, and Daniel Weiskopf. 2017. User performance and reading strategies for metro maps: An eye tracking study. Spatial Cognition & Computation 17, 1-2 (2017), 39--64.Google ScholarCross Ref
- Sohail Rafiqi, Chatchai Wangwiwattana, Jasmine Kim, Ephrem Fernandez, Suku Nair, and Eric C. Larson. 2015. PupilWare: Towards pervasive cognitive load measurement using commodity devices. In Proceedings of the ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA). 42:1--42:8 pages.Google Scholar
- Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 3 (1998), 372--422.Google ScholarCross Ref
- Eyal M. Reingold and Heather Sheridan. 2011. Eye movements and visual expertise in chess and medicine. In The Oxford Handbook of Eye Movements, Simon P. Liversedge, Iain D. Gilchrist, and Stefan Everling (Eds.). Oxford University Press, Oxford, 523--550.Google Scholar
- Daniel C. Richardson and Rick Dale. 2005. Looking to understand: The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cognitive Science 29, 6 (2005), 1045--1060.Google ScholarCross Ref
- Christoph Schulz, Michael Burch, Fabian Beck, and Daniel Weiskopf. 2017. Visual data cleansing of low-level eye-tracking data. In Eye Tracking and Visualization: Foundations, Techniques, and Applications (ETVIS 2015), Michael Burch, Lewis Chuang, Brian Fisher, Albrecht Schmidt, and Daniel Weiskopf (Eds.). Springer International Publishing AG, Cham, Switzerland, 199--216.Google Scholar
- Steven M. Seitz and Jiwon Kim. 2003. Multiperspective imaging. IEEE Computer Graphics and Applications 23, 6 (2003), 16--19.Google ScholarDigital Library
- Temple F. Smith and Michael S. Waterman. 1981. Identification of common molecular subsequences. Journal of Molecular Biology 147, 1 (1981), 195--197.Google ScholarCross Ref
- Julian Steil, Michael Xuelin Huang, and Andreas Bulling. 2018. Fixation detection for head-mounted eye tracking based on visual similarity of gaze targets. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications. 23:1--23:9.Google ScholarDigital Library
- Anthony Tang, Saul Greenberg, and Sidney Fels. 2008. Exploring video streams using slit-tear visualizations. In Proceedings of the Working Conference on Advanced Visual Interfaces. 191--198.Google ScholarDigital Library
- Marc Weber, Marc Alexa, and Wolfgang Müller. 2001. Visualizing time-series on spirals. In Proceedings of the IEEE Symposium on Information Visualization. 7--14.Google ScholarDigital Library
- Julian Wolf, Stephan Hess, David Bachmann, Quentin Lohmeyer, and Mirko Meboldt. 2018. Automating areas of interest analysis in mobile eye tracking experiments based on machine learning. Journal of Eye Movement Research 11, 6 (2018). 1--6.Google ScholarCross Ref
Index Terms
- A Spiral into the Mind: Gaze Spiral Visualization for Mobile Eye Tracking
Recommendations
Image-Based Projection Labeling for Mobile Eye Tracking
ETRA '21 Full Papers: ACM Symposium on Eye Tracking Research and ApplicationsThe annotation of gaze data concerning investigated areas of interest (AOIs) poses a time-consuming step in the analysis procedure of eye tracking experiments. For data from mobile eye tracking glasses, the annotation effort is further increased ...
Fixation detection for head-mounted eye tracking based on visual similarity of gaze targets
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & ApplicationsFixations are widely analysed in human vision, gaze-based interaction, and experimental psychology research. However, robust fixation detection in mobile settings is profoundly challenging given the prevalence of user and gaze target motion. These ...
InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation
Analysis of everyday human gaze behaviour has significant potential for ubiquitous computing, as evidenced by a large body of work in gaze-based human-computer interaction, attentive user interfaces, and eye-based user modelling. However, current mobile ...
Comments