Isabel Kütemeyer
Mathias Lux
ABSTRACT
Performance optimisation continues to be a relevant topic both in hardware and software development, with video games producing fully rendered images every 16 or 34 ms, depending on the desired framerate. Human observers close their eyes for about 300 ms an average of twelve times per minute, which means many frames will never be observed. This paper aimed to examine if it would be possible to reduce rendering time by detecting and skipping these unobserved frames. Blinks were identified during runtime by detecting the eye aspect ratio of the observer in low-quality web camera footage. A prototype using this method was tested on a small group of subjects to determine if footage watched this way was perceived as distracting or of lesser quality than unaltered images. Results from a questionnaire suggest that the altered footage did not impact the subjects’ opinions, with no participant reporting any visual disturbances. Because this test used video footage, skipping frames was substituted by a lower resolution render. Altered frames were rendered an average of five percent faster than their unaltered counterparts.
- Ahmad Aljaafreh, Murad Alaqtash, Naeem Al-Oudat, Jafar Abukhait, and Ma’en Saleh. 2019. saccadic-measurement. github.com/jaafreh/saccadic-measurementGoogle Scholar
- Paul Bakker. 2017. Real-time face and landmark localization for eyeblink-response detection: a heterogenous CPU-GPU approach. Ph. D. Dissertation. Delft University of Technology.Google Scholar
- W. P. Blount. 1927. Studies of the movements of the eyelids of animals: blinking. Quarterly Journal of Experimental Physiology: Translation and Integration 18, 2(1927), 111–125.Google ScholarCross Ref
- Benjamin Bolte and Markus Lappe. 2015. Subliminal Reorientation and Repositioning in Immersive Virtual Environments using Saccadic Suppression. IEEE transactions on visualization and computer graphics 21, 4(2015), 545–552. https://doi.org/10.1109/TVCG.2015.2391851Google ScholarDigital Library
- Navneet Dalal and Bill Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), Vol. 1. Ieee, 886–893.Google Scholar
- Sanjeev Kr Dhull, Krishna Kant Singh, 2020. ECG beat classifiers: a journey from ANN to DNN. Procedia Computer Science 167 (2020), 747–759.Google ScholarCross Ref
- Marshall G. Doane. 1980. Interactions of eyelids and tears in corneal wetting and the dynamics of the normal human eyeblink. American journal of ophthalmology 89, 4 (1980), 507–516.Google Scholar
- Irving Fatt and Barry A. Weissman. 2013. Physiology of the eye: an introduction to the vegetative functions. Butterworth-Heinemann.Google Scholar
- Helinä Häkkänen, Heikki Summala, Markku Partinen, Mikko Tiihonen, and Jouni Silvo. 1999. Blink duration as an indicator of driver sleepiness in professional bus drivers. Sleep 22, 6 (1999), 798–802.Google ScholarCross Ref
- Jonathan Peirce et. PsychoPyAl.2021. PsychoPy. psychopy.orgGoogle Scholar
- Bart Krekelberg. 2010. Saccadic suppression. Current Biology 20, 5 (2010), R228–R229.Google ScholarCross Ref
- Kyung-Ah Kwon, Rebecca J. Shipley, Mohan Edirisinghe, Daniel G. Ezra, Geoff Rose, Serena M. Best, and Ruth E. Cameron. 2013. High-speed camera characterization of voluntary eye blinking kinematics. Journal of the Royal Society Interface 10, 85 (2013), 20130227.Google ScholarCross Ref
- Tomas Möller, Eric Haines, and Naty Hoffman. 2018. Real-time rendering(fourth edition ed.). CRC Press, Boca Raton.Google Scholar
- Keith O’Conor. 2017. GPU Performance for Game Artists. http://fragmentbuffer.comGoogle Scholar
- H. Rambold, A. Sprenger, and C. Helmchen. 2002. Effects of voluntary blinks on saccades, vergence eye movements, and saccade-vergence interactions in humans. Journal of neurophysiology 88, 3 (2002), 1220–1233. https://doi.org/10.1152/jn.2002.88.3.1220Google ScholarCross Ref
- Martin Rolfs Richard Schweitzer. 2018. Online Saccade Detection. github.com/richardschweitzer/OnlineSaccadeDetectionGoogle Scholar
- A. A. Skavenski and R. M. Hansen. 1978. Role of eye position information in visual space perception. Eye Movements and the Higher Psychological Functions (1978), 15–34.Google Scholar
- John A. Stern, Larry C. Walrath, and Robert Goldstein. 1984. The endogenous eyeblink. Psychophysiology 21, 1 (1984), 22–33.Google ScholarCross Ref
- Miika Toivanen, Kati Pettersson, and Kristian Lukander. 2015. A probabilistic real-time algorithm for detecting blinks, saccades, and fixations from EOG data. Journal of Eye Movement Research 8, 2 (2015).Google ScholarCross Ref
- Toivanen, M., Pettersson, K., Lukander, K.2016. EOGERT - EOG Event Recognizer Tool. github.com/bwrc/eogertGoogle Scholar
- Raimondas Zemblys, Diederick C Niehorster, and Kenneth Holmqvist. 2019. gazeNet: End-to-end eye-movement event detection with deep neural networks. Behavior research methods 51, 2 (2019), 840–864.Google Scholar
Index Terms
- The Potential of Webcam Based Real Time Eye-Tracking to Reduce Rendering Cost
Recommendations
Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments
We present a new, real-time method for rendering diffuse and glossy objects in low-frequency lighting environments that captures soft shadows, interreflections, and caustics. As a preprocess, a novel global transport simulator creates functions over the ...
Radiance Transfer Biclustering for Real-Time All-Frequency Biscale Rendering
We present a real-time algorithm to render all-frequency radiance transfer at both macroscale and mesoscale. At a mesoscale, the shading is computed on a per-pixel basis by integrating the product of the local incident radiance and a bidirectional ...
Comments