Abstract
Objective
Exploration of changes in eye movement at different flight conditions can enrich scholarly understanding of situation awareness (SA) and inform new scanning behavior training techniques for efficient and effective pilot education.
Background
The SA requirements for pilots vary from mission to mission. Eye tracking is often used to analyze various attention allocation and SA acquisition processes at work in different missions.
Methods
Pilot eye movements were measured during a climbing task and circling task using a cockpit-based simulator.
Results
Results of situation awareness rating technique (SART) tests show that there are significant differences between attention processes during climbing versus circling flight tasks. Fixation frequency during climbing is lower than in the circling task. Additionally, saccade frequency and average fixation time in the climbing task are markedly higher than those in the circling task. Wilcoxon test results show that the pilot has a higher fixation count and fixation time during the circling phase in out-view (OV) areas of interest (AOI) than during the climbing phase. Notably, the attention probability is higher in climbing task than in circling task when the current area of fixation (AOF) is in the head-up display (HUD) AOI and the next fixation area is in the instrumentation panel left (IPL); when the current AOF is in the out-view right (OVR) and the next AOF is HUD, the attention probability is higher in climbing task than in circling task; when the current fixation is in the IPL and the next fixation probability is to the out-view left (OVL), the attention probability is higher in task climbing task than in circling task. In terms of the Markov stationary distribution, the Wilcoxon test shows that, when IPL AOI is the area of the maximum probability of fixation in both tasks, the attention probability of HUD AOI and instrumentation panel right (IPR) is higher in climbing task than in circling task.
Conclusion
Circling tasks require efficient eye movement patterns accompanied by strict attention distribution, which yields high SA level and flight performance when performed properly.
Application
This paper summarizes the attention characteristics at different flight phases and various requirements of different tasks according to pilot eye movement tracking results. Similar activities, as routine training, can enhance the efficiency of a novice pilot’s attention distribution.
Similar content being viewed by others
References
Adams, M. J., Tenney, Y. J., & Pew, R. W. (1995). Situation awareness and the cognitive management of complex systems. Human Factors, 37(1), 85–104.
Alliger, G. M., Tannenbaum, S. I., Bennett, W., Jr., Traver, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50(2), 341–358.
de Voogt, A., & van Doorn, R. R. A. (2007). The paradox of helicopter emergency training. International Journal of Aviation Psychology, 17, 265–274.
Bellenkes, A. H., Wickens, C. D., & Kramer, A. F. (1997). Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. Aviation, Space, and Environmental Medicine, 68(7), 569–579.
Bell, H. H., & Lyon, D. R. (2000). Using observer ratings to assess situation awareness (No. AFRL-RH-AZ-BC-2000–0001). Air force research lab mesa az warfighter readiness research division.
Casner, S. M., Geven, R. W., & Williams, K. T. (2013). The effectiveness of airline pilot training for abnormal events. Human Factors, 55(3), 477–485.
Dijk, H. V., Merwe, K. V. D., & Zon, R. (2011). A coherent impression of the pilots' situation awareness: studying relevant human factors tools. International Journal of Aviation Psychology, 21(4), 343–356.
Doane, S. M., Woo Sohn, Y., & Jodlowski, M. T. (2004). Pilot ability to anticipate the consequences of flight actions as a function of expertise. Human Factors, 46(1), 92–103.
Emilien, A., Vimont, U., Cani, M., Poulin, P., & Benes, B. (2015). WorldBrush: Interactive example-based synthesis of procedural virtual worlds. ACM Transactions on Graphics, 34(4),11.
Endsley, M. R. (1995a). Measurement of situation awareness in dynamic systems. Human Factors, 37(1), 65–84.
Endsley, M. R. (1995b). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32–64.
Endsley, M. R. (1995c). A taxonomy of situation awareness errors. Human Factors in Aviation Operations, 3(2), 287–292.
Endsley, M. R. (2000). Errors in situation assessment: Implications for system design. International Workshop on Human Error & System Design & Management.
Endsley, M. R., & Garland, D. J. (2000). Pilot situation awareness training in general aviation. Human Factors & Ergonomics Society Annual Meeting Proceedings, 44(11), 357–360.
Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102(2), 211.
Feng, C., Wanyan, X., Liu, S., Zhuang, D., Wu, X. (2018). Dynamic prediction model of situation awareness in flight simulation. In D. Harris (Ed.) International Conference on Engineering Psychology and Cognitive Ergonomics (pp. 115–126). Springer: Cham.
Glaholt, M. G. (2014). Eye tracking in the cockpit: a review of the relationships between eye movements and the aviators cognitive state (No. DRDC-RDDC-2014-R153). Defence Research and Development Toronto (Canada).
Guo, Z., Chen, C. S., Chen, Y. Q., Wang, Y. H., & Tang, Y. H. (2009). Research on shift model of driver's visual attention based on markov process. Journal of Highway and Transportation Research and Development, 23(12), 116–119.
Guznov, S. Y. (2008). Visual search training techniques in a uav simulator environment: pilots' performance, workload, and stress. Dissertations & Theses—Gradworks.
Hauland, G. (2008). Measuring individual and team situation awareness during planning tasks in training of en route air traffic control. The International Journal of Aviation Psychology, 18(3), 290–304.
Hayashi, M. (2003, October). Hidden markov models to identify pilot instrument scanning and attention patterns. In SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance (Cat. No. 03CH37483) (Vol. 3, pp. 2889–2896). IEEE.
Jones, D. G., & Endsley, M. R. (1996). Sources of situation awareness errors in aviation. Aviat. Space Environ. MD., 67(6), 507–512.
Kasarskis, P., Stehwien, J., Hickox, J., Aretz, A., & Wickens, C. (2001). Comparison of expert and novice scan behaviors during VFR flight. In Proceedings of the 11th international symposium on aviation psychology (Vol. 6).
Kilingaru, K., Tweedale, J. W., Thatcher, S., & Jain, L. C. (2013). Monitoring pilot “situation awareness”. Journal of Intelligent & Fuzzy Systems, 24(3), 457–466.
Liu, Z., Yuan, X. G., & Liu, W. (2006). Analysis on eye movement indices based on simulated flight task. J. Safety Sci. China, 16(2), 48–51.
Li, W. C. , Chiu, F. C. , Kuo, Y. S. , & Wu, K. J. (2013). The investigation of visual attention and workload by experts and novices in the cockpit. In Proceedings of the 10th international conference on Engineering Psychology and Cognitive Ergonomics: applications and services—Volume Part II. Springer-Verlag.
Liu, S., Wanyan, X., & Zhuang, D. (2014). Modeling the situation awareness by the analysis of cognitive process. Bio-Medical Materials and Engineering, 24(6), 2311.
Liu, Z. F., & Su, H. (2016). Exploring the individual and task difficulty difference of situation awareness in aviation working environment: the advantages of eye tracking method. Chinese Journal of Applied Psychology., 22(1), 12–25.
Moore, K., & Gugerty, L. (2010, September). Development of a novel measure of situation awareness: The case for eye movement analysis. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 54, No. 19, pp. 1650–1654). Sage CA: Los Angeles, CA: SAGE Publications.
Merk, R. J., & Roessingh, J. J. M. (2013). An Evaluation of cognitive models for surprise and situation awareness in a flight simulator with fighter pilots. Aviation Psychology and Applied Human Factors, 4(4), 2014.
Muehlethaler, C. M., & Knecht, C. P. (2016). Situation awareness training for general aviation pilots using eye tracking. IFAC-PapersOnLine, 49(19), 66–71.
Nataša V. D., & Missoni, E. (2005). Physiological parameters and trace elements before and after aerobatic flight. In E. Donaldson & M. Krzysztof (Eds.), 53 International Congress of Aviation & Space Medicine (pp. 45). Warsaw, Poland: ICASM.
Ottati, W. L., Hickox, J. C., & Richter, J. (1999). Eye scan patterns of experienced and novice pilots during visual flight rules (vfr) navigation. Human Factors & Ergonomics Society Annual Meeting Proceedings, 43(1), 66–70.
Lefrancois, O., Matton, N., Gourinat, Y., Peysakhovich, V., & Causse, M. (2016) The role of Pilots' monitoring strategies in flight performance. In EAAP32, European Association for Aviation Psychology Conference, Sep 2016, Cascais, Portugal. ⟨hal-01405262⟩
Peng, Z. (2012). The safety analysis of flight landing based on Time Petri Net. In Reliability & Maintainability Symposium.
Peysakhovich, V., Lefrançois, O., Dehais, F., & Causse, M. (2018). The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety, 4(1), 8.
Rasmussen, J. (2012). Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Transactions on Systems Man & Cybernetics SMC-13, 3, 257–266.
Ratwani, R., & Trafton, J. G. (2010). An eye movement analysis of the efect of interruption modality on primary task resumption. Human Factors, 52(3), 370–380.
Ratwani, R. M., McCurry, J. M., & Trafton, J. G. (2010). Single operator, multiple robots: An eye movement based theoretic model of operator situation awareness. In Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction (HRI ’10) (pp. 235–242). IEEE Press.
Sadasivan, S., Greenstein, J. S., Gramopadhye, A. K., & Duchowski, A. T. (2005). Use of eye movements as feedforward training for a synthetic aircraft inspection task. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 141–149). ACM.
Salmon, P., Stanton, N., Walker, G., & Green, D. (2006). Situation awareness measurement: a review of applicability for C4i environments. Applied Ergonomics, 37(2), 225–238.
Schnell, T., & Merchant, S. (2001). Assessing pilot performance in flight decks equipped with synthetic vision information systems. Final Report, Rockwell Collins, Cedar Rapids, Iowa: Seine, France.
Schriver, A. T., Morrow, D. G., Wickens, C. D., & Talleur, D. A. (2008). Expertise differences in attentional strategies related to pilot decision making. Human Factors, 50(6), 864–878.
Salmon, P. M. (2008). Distributed situation awareness: Advances in theory, measurement and application to team work (Doctoral dissertation, Brunel University School of Engineering and Design PhD Theses).
Soliman, A. M., & Mathna, E. K. (2009). Metacognitive strategy training improves driving situation awareness. Social Behavior and Personality, 37(9), 1161–1170.
Takahashi, N., & Nakayama, M. (2013). Chronological prediction of certainty in recall tests using markov models of eye movements. In Proceedings of BIOTECHNO 2013: The Fifth International Conference on Biometrics, Biocomputational Systems and Biotechnologies (pp. 55–60).
Taylor, R.M., 1990. Situational Awareness Rating Technique (SART): the development of a tool for aircrew systems design. In: Situational Awareness in Aerospace Operations. Neuilly Sur-seine. France, (3), 1–17.
Van De Merwe, K., Van Dijk, H., & Zon, R. (2012). Eye movements as an indicator of situation awareness in a flight simulator experiment. The International Journal of Aviation Psychology, 22(1), 78–95.
Wickens, C. D. (1999). Cognitive factors in aviation. In F. Durso (Ed.) Handbook of applied cognition (pp. 247–282). New York: Wiley.
Wickens, C. D. (2002). Situation awareness and workload in aviation. Current Directions in Psychological Science, 11(4), 128–133.
Xiong, W., Wang, Y., Zhou, Q., Liu, Z., & Zhang, X. (2016, July). The research of eye movement behavior of expert and novice in flight simulation of landing. In International conference on engineering psychology and cognitive ergonomics (pp. 485–493). Springer, Cham.
Yang, C., Liu, Z., Zhou, Q., Xie, F., & Zhou, S. (2014, June). Analysis on eye movement indexes based on simulated flight task. In International conference on engineering psychology and cognitive ergonomics (pp. 419–427). Springer, Cham.
Yu, C. S., Wang, E. M. Y., Li, W. C., & Braithwaite, G. (2014). Pilots’ visual scan patterns and situation awareness in flight operations. Aviation, Space, and Environmental Medicine, 85(7), 708–714.
Yuan, W., (2008). Experimental study on dynamic visual characteristics of automobile drivers in urban road environment.(Doctoral dissertation, University of Chang’an).
Zhang, Y. A. (2001). Discussion on markov model and its application. Journal of Shenyang University (Natural Science Edition)., 13(2), 44–46.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lu, T., Lou, Z., Shao, F. et al. Attention allocation in pilots based on climbing and circling mission behavior. Psychological Research 85, 1136–1145 (2021). https://doi.org/10.1007/s00426-020-01324-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00426-020-01324-1