Rotorcraft virtual sensors via deep regression

https://doi.org/10.1016/j.jpdc.2019.08.008Get rights and content
Under a Creative Commons license
open access

Highlights

  • Deep fully-connected neural networks perform high-dimensional and non-linear mapping.

  • Architecture design and hyper-parameters are critical components to configure.

  • Evolutionary algorithms are effective and systematic methods for neural network optimization.

  • Robust and representative objectives are required to ensure appropriate learning.

  • An automated HPC asynchronous workflow was instrumental for model generation.

Abstract

Raw sensor data containing high-fidelity information is highly desirable for valuable post-processing. We developed a machine learning model that performs deep regression to infer rotorcraft component vibration spectra from a few flight conditional indicators (CI). The model consists of a deep neural network of fully connected layers (DNN) that performs high-dimensional and non-linear multivariate regression to reconstruct raw accelerometer data. The network architecture hyperparameters were optimized using an evolutionary genetic algorithm (GA) that was more effective than random and manual search methods. The best GA design was further tuned to achieve spectrum reconstruction accuracies above 95% on validation datasets. An automated model generator workflow was developed to train and evaluate thousands of DNN designs using parallel asynchronous execution on a Cray XC50, which were monitored and studied. Finally, as a verification step of the DNN inference model operation and performance, a detailed sensitivity analysis was performed using a modified Sobol sampling technique to understand response behavior and limitations. The sensitivity analysis method utilized Dask-distributed across multiple nodes on our HPC to evaluate millions of generated samples in parallel.

Keywords

Virtual Sensors
Deep Learning
High Performance Computing
Deep Neural Networks
Evolutionary Optimization

Cited by (0)

Mr. Daniel Martinez is a research mechanical engineer and data scientist at the Information Technology Laboratory of the US Army Corps of Engineers, Engineering Research and Development Center. Daniel is currently the PI and main developer of the Machine Learning Computational Physics program under the Engineering Resilient Systems in ERDC-ITL. He is currently a graduate student with a degree B.S. in Mechanical Engineering from the University of Puerto Rico Mayaguez in 2016.

Wesley Brewer is currently working as Chief Data Scientist for SAIC. Prior to that he spent 14 years working as an independent computational engineering consultant to industry, government, and academia, including a contract with the DoD High Performance Computing Modernization Program (HPCMP) under which he collaborated on this project. He is a graduate of MIT and has a PhD in Computational Engineering from Mississippi State University.

Dr. Andrew Strelzoff is a computer scientist at the Information Technology Laboratory (ITL) of the US Army Corps of Engineers, Engineering Research and Development Center. Andrew was head of Computer Science and Graduate programs at the University of Southern Mississippi School of Computing before leaving in 2012 to work at ITL. As the lead scientist for the Engineering Resilient Systems program at ITL Dr. Strelzoff helped the program grow to a full ITL business area employing more than 100 full time employees. Currently Dr. Strelzoff is the technical lead for the US Army Corps of Engineers Civil Works Data Science initiative seeking to infuse all areas of the Corp with Data Science insights,

Andrew Wilson has worked in a variety of applied and computational mathematics and engineering fields, including physics, fluid dynamics, and data science. During his 4-year tenure at AMRDEC, he applied machine learning to rotorcraft vibration sensor data for cutting edge applications such as raw-data reconstruction and gearbox health prediction. He is currently employed as a Data Science Principal at SAIC, working on cutting edge aviation training systems. He has a PhD in Aerospace Engineering from UT Knoxville and a BA in Physics and Mathematics from the University of Chicago.

Daniel Wade spent over 13 years with the US Army’s AMRDEC where he was a subject matter expert in aircraft health monitoring. During his last two years with the AMRDEC, he was the team lead for Aviation Data Science, a team that he co-founded with fellow author, Andrew Wilson. Daniel has since moved on to become a Senior Staff Data Scientist for Lockheed Martin’s Analytics PHM and AI Innovations team.