skip to main content
10.1145/2669592.2669651acmotherconferencesArticle/Chapter ViewAbstractPublication Pageshci-aeroConference Proceedingsconference-collections
research-article

Augmented reality tower technology flight test

Published:30 July 2014Publication History

ABSTRACT

Augmented reality technology adapted for air traffic control tower applications was used to track an OH-58C helicopter in proximity to an airport. A camera and 'see-through' display system was used to measure the registration error of static airport features and dynamic test aircraft. The observed registration errors of the test aircraft were largely attributable to two terms of error: 1) aircraft surveillance transport latency, and 2) registration error (from all sources) of the static environment. Compensating for registration errors of static objects and modeling aircraft movement reduces registration errors for dynamic (aircraft) objects to ≤2° of error for aircraft-surveillance transport latency ≤ 5 seconds, and to ≤1° of error for transport latency ≤ 2 seconds.

References

  1. Arthur III, J. T. J., Prinzel III, L. J., Shelton, K. J., Kramer, L. J., Williams, S. P., Bailey, R. E., & Norman, R. M., Synthetic Vision Enhanced Surface Operations With Head-Worn Display for Commercial Aircraft. The International Journal Of Aviation Psychology, 19, 2, (2009), 158--181. Available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20090017752.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  2. Azuma, R., and Bishop, G. Improving static and dynamic registration in an optical see-through HMD. Proceedings of the 21st annual conference on Computer graphics and interactive techniques, ACM, (1994), 197--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Azuma, R., Daily, M., and Krozel, J., Advanced Human-Computer Interfaces for Air Traffic Management and Simulation, Proceedings of 1996 AIAA Flight Simulation Technologies Conference, AIAA, Washington, DC, (1996), 656--666.Google ScholarGoogle ScholarCross RefCross Ref
  4. Bajura, M., and Neumann, U. Dynamic registration correction in video-based augmented reality systems. IEEE Computer Graphics and Applications, 15, 5, (1995), 52--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ellis, S.R., and Liston, D.B., "Static and motion-based visual features used by airport tower controllers," NASA TM-2011-216427, Ames Research Center, Moffett Field, CA, (2011).Google ScholarGoogle Scholar
  6. Ellis, S.R., Furstenau, N., and Mittendorf, M., Frame Rate Effects on Visual Discrimination of Landing Aircraft Deceleration: Implications for Virtual Tower Design and Speed Perception, Proceedings of Human Factors and Ergonomics Society Annual Meeting, Las Vegas, Nevada, (September, 2011), 71--75.Google ScholarGoogle ScholarCross RefCross Ref
  7. Ellis, S.R., McGreevy, M.W., and Hitchcock, R.J., Perspective traffic display format and airline pilot traffic avoidance, Human Factors, 29, HFES, Santa Monica, CA, (1987), 371--382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ellis, S.R., Schmidt-Ott, J. R., Krozel, J., Reisman, R.J., and Gips, J., Augmented reality in a simulated tower environment: effect of field of view on aircraft detection, NASA TM 2002-211853, (2002). Available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20030005687.pdfGoogle ScholarGoogle Scholar
  9. Ellis, S.R., Towards determination of visual requirements for augmented reality displays and virtual environments for the airport tower. Proceedings of the NATO workshop on Virtual Media for the Military, West Point, N.Y. HFM-121/RTG 042 HFM-136, (2006), 24-1-24-9. Available at http://www.dtic.mil/dtic/tr/fulltext/u2/a473306.pdfGoogle ScholarGoogle Scholar
  10. Feiner, S. Augmented reality: A new way of seeing. Scientific American, 286, 4, (April 2002), 34--41. Available at http://203.68.243.199/saweb/pdf.file/en/e004/e004p036.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  11. Foyle, D.C., Andre, A.D., McCann, R.S., Wenzel, E., Begault, D., and Battiste, V., Taxiway Navigation and Situation Awareness (T-NASA) System: Problem, design philosophy and description of an integrated display suite for low-visibility airport surface operations, SAE Transactions: Journal of Aerospace, No. 105, SAE, Warrendale, PA, (1996), 1411--1418.Google ScholarGoogle Scholar
  12. Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, C., & Halle, W., Augmented vision videopanorama system for remote airport tower operation., Proc. ICAS. (September, 2008). Available at http://www.icas-proceedings.net/ICAS2008/PAPERS/093.PDFGoogle ScholarGoogle Scholar
  13. Kramer, L. J., Arthur III, J. J., Bailey, R. E., & Prinzel III, L. J., Flight testing an integrated synthetic vision system. In Defense and Security, International Society for Optics and Photonics, (May, 2005), 1--12. Available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20050160185.pdfGoogle ScholarGoogle Scholar
  14. Kramer, L. J., Bailey, R. E., Ellis, K. K., Norman, R. M., Williams, S. P., Arthur III, J. J., Shelton, K.J., Prinzel III, L. J., Enhanced and synthetic vision for terminal maneuvering area nextgen operations. SPIE Defense, Security, and Sensing, International Society for Optics and Photonics, (June, 2011), 80420T-80420T. Available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20110011181.pdfGoogle ScholarGoogle Scholar
  15. Krozel. J., Birtcil, L., Mueller, K.T., and Azuma, R., Augmented reality system for the ATC Tower, NASA TR 98183-01, 1999.Google ScholarGoogle Scholar
  16. Mackay, W. E., Fayard, A. L., Frobert, L., & Médini, L., Reinventing the familiar: exploring an augmented reality design space for air traffic control. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press/Addison-Wesley Publishing Co., (1998), 558--565. Available at http://stl.cs.queensu.ca/~graham/cisc836/lectures/readings/chi98-mackay.pdf Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Redeiss, H.A., "An augmented reality pilot display for airport operations under low and zero visibility conditions," AIAA Guidance, Navigation, and Control Conference, A97-37001 10-63, Vol. 2, AIAA, Washington, DC, (1997), pp. 912--929.Google ScholarGoogle Scholar
  18. Reisman, R J., and Ellis, S.R., Augmented reality for air traffic control, SIGGRAPH 2003 Sketches & Applications: In conjunction with the 30th Annual Conference on Computer Graphics and Interactive Techniques, (2003). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Reisman, R. J., & Brown, D. M., Design of augmented reality tools for air traffic control towers. In 6th AIAA Aviation Technology, Integration and Operations (ATIO) Conference, Wichita, KS, (2006).Available at http://www.aviationsystemsdivision.arc.nasa.gov/publications/more/other/reisman_09_06.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  20. Reisman, R. J., & Ellis, S. R., Air traffic control tower augmented reality field study. In ACM SIGGRAPH 2005 Posters, ACM, (2005), 52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Reisman, R.J., and Brown, D.M., Augmented Reality Tower Technology Assessment, NASA TM--2010-216011, (2010). Available at http://www.aviationsystemsdivision.arc.nasa.gov/publications/2010/Reisman_TM-2010-216011_FINAL.pdfGoogle ScholarGoogle Scholar
  22. Ruffner, J.W., and Fulbrook, J.E., Usability Considerations for a Tower Controller Near-Eye Augmented Reality Display. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 51, 2, (2007), 117--121.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Augmented reality tower technology flight test

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            HCI-Aero '14: Proceedings of the International Conference on Human-Computer Interaction in Aerospace
            July 2014
            253 pages
            ISBN:9781450325608
            DOI:10.1145/2669592

            Copyright © 2014 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 30 July 2014

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader