skip to main content
research-article

InvisibleEye: Fully Embedded Mobile Eye Tracking Using Appearance-Based Gaze Estimation

Published:14 November 2019Publication History
Skip Abstract Section

Abstract

Despite their potential for a range of exciting new applications, mobile eye trackers suffer from several fundamental usability problems. InvisibleEye is an innovative approach for mobile eye tracking that uses millimeter-size RGB cameras, which can be fully embedded into normal glasses frames, as well as appearancebased gaze estimation to directly estimate gaze from the eye images. Through evaluation on three large-scale, increasingly realistic datasets, we show that InvisibleEye can achieve a person-specific gaze estimation accuracy of up to 2.04° using three camera pairs with a resolution of only 3x3 pixels.

References

  1. Andreas Bulling and Hans Gellersen. (2010). "Toward mobile eye-based human-computer interaction." IEEE Pervasive Computing 9, 4, 8--12. DOI: http://dx.doi.org/10.1109/MPRV.2010.86Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Andreas Bulling, Jamie A. Ward, Hans Gellersen, and Gerhard Troster. (2011). "Eye movement analysis for activity recognition using electrooculography." IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 4 (2011), 741--753. DOI: http://dx.doi.org/10.1109/ TPAMI.2010.86Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Augusto Esteves, Eduardo Velloso, Andreas Bulling, and Hans Gellersen. (2015). "Orbits: Enabling gaze interaction in smart watches using moving targets." In Proc. ACM Symposium on User Interface Software and Technology (UIST). 457--466. DOI: http://dx.doi. org/10.1145/2807442.2807499Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Sabrina Hoppe, Tobias Loetscher, Stephanie Morey, Andreas Bulling. (2018). "Eye movements during everyday behavior predict personality traits." Frontiers in Human Neuroscience, 12, 105:1--105:8. DOI: http://dx.doi.org/10.3389/ fnhum.2018.00105Google ScholarGoogle Scholar
  5. Moritz Kassner, William Patera, and Andreas Bulling. 2014. "Pupil: An open source platform for pervasive eye tracking and mobile gaze-based interaction." In Adj. Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). 1151--1160. DOI: http://dx.doi.org/10.1145/2638728.2641695Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Päivi Majaranta and Andreas Bulling. (2014). Eye Tracking and Eye-Based Human-Computer Interaction. Springer Publishing London, 39--65. DOI: http://dx.doi.org/10.1007/978--1--4471- 6392--3_3Google ScholarGoogle Scholar
  7. Evan F. Risko and Alan Kingstone. (2011). "Eyes wide shut: Implied social presence, eye tracking and attention." Attention, Perception, & Psychophysics 73, 2 (2011), 291--296. DOI: http://dx.doi.org/10.3758/s13414-010-0042--1Google ScholarGoogle ScholarCross RefCross Ref
  8. Hosnieh Sattar, Sabine Müller, Mario Fritz, and Andreas Bulling. 2015. "Prediction of search targets from fixations in open-world settings." In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR). 981--990. DOI: http://dx.doi.org/10.1109/CVPR.2015.7298700Google ScholarGoogle Scholar
  9. Julian Steil and Andreas Bulling. (2015). "Discovery of everyday human activities from long-term visual behavior using topic models." In Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). 75--85. DOI: http://dx.doi. org/10.1145/2750858.2807520Google ScholarGoogle Scholar
  10. Yusuke Sugano and Andreas Bulling. (2015). "Self-calibrating head-mounted eye trackers using egocentric visual saliency." In Proc. ACM Symposium on User Interface Software and Technology (UIST). 363--372. DOI: http://dx.doi. org/10.1145/2807442.2807445Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Yusuke Sugano, Xucong Zhang, and Andreas Bulling. (2016). "AggreGaze: collective estimation of audience attention on public displays." In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 821--831. DOI: 10.1145/2984511.2984536Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Erroll Wood, Tadas Baltruaitis, Louis-Philippe Morency, Peter Robinson, and Andreas Bulling. (2016). "Learning an appearance-based gaze estimator from one million synthesized images. In Proc. International Symposium on Eye Tracking Research and Applications (ETRA). ACM, 131--138. DOI: http://dx.doi.org/10.1145/2857491.2857492Google ScholarGoogle Scholar
  13. Erroll Wood, Tadas Baltrusaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, and Andreas Bulling. (2015). "Rendering of eyes for eye-shape registration and gaze estimation." In Proc. of the IEEE International Conference on Computer Vision (ICCV). 3756--3764. DOI: http://dx.doi. org/10.1109/ICCV.2015.428Google ScholarGoogle Scholar
  14. Marc Tonsen, Julian Steil, Yusuke Sugano, and Andreas Bulling. (2017). "InvisibleEye: Mobile eye tracking using multiple low-resolution cameras and learning-based gaze estimation." Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 1, 3, 106: 1--106:21. DOI: https://doi.org/10.1145/3130971Google ScholarGoogle Scholar
  15. Yanxia Zhang, Hans Jörg Müller, Ming Ki Chong, Andreas Bulling, and Hans Gellersen. 2014. "GazeHorizon: Enabling passers-by to interact with public displays by Gaze. In Proc. ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). 559--563. DOI: http://dx.doi.org/10.1145/2632048.2636071Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image GetMobile: Mobile Computing and Communications
    GetMobile: Mobile Computing and Communications  Volume 23, Issue 2
    June 2019
    34 pages
    ISSN:2375-0529
    EISSN:2375-0537
    DOI:10.1145/3372300
    Issue’s Table of Contents

    Copyright © 2019 Copyright is held by the owner/author(s)

    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 14 November 2019

    Check for updates

    Qualifiers

    • research-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader