Bryan Matthews

Mr. Bryan Matthews


Research Focus & Metrics

Academic Career Length

17Years (2010-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 August 2020 in Aerospace
Verified
Journal Article
Open access
PDF file
Milad MemarzadehMilad Memarzadeh
Milad Memarzadeh
BMBryan Matthews
Bryan Matthews
IAIlya Avrekh
Ilya Avrekh
The modern National Airspace System (NAS) is an extremely safe system and the aviation industry has experienced a steady decrease in fatalities over the years. This is in part due the airlines, manufacturers, FAA, and research institutions all continually working to improve the safety of the operations. However, the current approach for identifying vulnerabilities in NAS operations leverages domain expertise using knowledge about how the system should behave within the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to assess risk based on pre-defined safety vulnerabilities. Moreover, state-of-the-art machine learning models that are developed for event detection in aerospace data usually rely on supervised learning. However, in many real-world problems, such as flight safety, creating labels for the data requires specialized expertise that is time consuming and therefore largely impractical. To address this challenge, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised deep generative model for anomaly detection in high-dimensional time-series data. Validating on Yahoo’s benchmark data as well as a case study of identifying anomalies in commercial flights’ take-offs, we show that CVAE outperforms both classic and deep learning-based approaches in precision and recall of detecting anomalies.

10 August 2022 in Aerospace
Verified
Journal Article
Open access
PDF file
Milad MemarzadehMilad Memarzadeh
Milad Memarzadeh
AAAta Akbari Asanjan
Ata Akbari Asanjan
BMBryan Matthews
Bryan Matthews
Identifying safety anomalies and vulnerabilities in the aviation domain is a very expensive and time-consuming task. Currently, it is accomplished via manual forensic reviews by subject matter experts (SMEs). However, with the increase in the amount of data produced in airspace operations, relying on such manual reviews is impractical. Automated approaches, such as exceedance detection, have been deployed to flag safety events which surpass a pre-defined safety threshold. These approaches, however, completely rely on domain knowledge and outcome of the SMEs’ reviews and can only identify purely threshold crossings safety vulnerabilities. Unsupervised and supervised machine learning approaches have been developed in the past to automate the process of anomaly detection and vulnerability discovery in the aviation data, with availability of the labeled data being their differentiator. Purely unsupervised approaches can be prone to high false alarm rates, while a completely supervised approach might not reach optimal performance and generalize well when the size of labeled data is small. This is one of the fundamental challenges in the aviation domain, where the process of obtaining safety labels for the data requires significant time and effort from SMEs and cannot be crowd-sourced to citizen scientists. As a result, the size of properly labeled and reviewed data is often very small in aviation safety and supervised approaches fall short of the optimum performance with such data. In this paper, we develop a Robust and Explainable Semi-supervised deep learning model for Anomaly Detection (RESAD) in aviation data. This approach takes advantage of both majority unlabeled and minority labeled data sets. We develop a case study of multi-class anomaly detection in the approach to landing of commercial aircraft in order to benchmark RESAD’s performance to baseline methods. Furthermore, we develop an optimization scheme where the model is optimized to not only reach maximum accuracy, but also a desired interpretability and robustness to adversarial perturbations.

1 April 2023 in Journal of Aerospace Information Systems
Verified
Journal Article
Closed access
Milad MemarzadehMilad Memarzadeh
Milad Memarzadeh
BMBryan Matthews
Bryan Matthews
TTThomas Templin
Thomas Templin
ARAida Sharif Rohani
Aida Sharif Rohani
DWDaniel Weckler
Daniel Weckler
Anomaly detection in commercial aviation is an extremely challenging yet crucial task. Accurately detecting operationally significant anomalies can save civilian lives and/or result in significant savings in maintenance cost. The current practice uses manually tuned rule-based mechanisms to flag exceedances from predefined safety boundaries. However, this system cannot identify unknown risks and emerging vulnerabilities. Recently, innovative approaches based on machine learning have been used to automate anomaly detection. However, there are limits to their applicability in the field of aviation due to several challenges: 1) Properly reviewed data are scarce in aviation and, as a result, supervised learning cannot reach optimal performance. 2) Operationally significant anomalies do not coincide with statistically significant ones and, as a result, unsupervised learning fails to provide reliable and robust performance. In this paper, we propose a semi-supervised active learning framework for anomaly detection (SALAD), which detects operationally significant anomalies in flight operational quality assurance data. The developed framework works with vast amounts of unlabeled data as well as a small quantity of labeled data reviewed by subject matter experts to reliably identify safety anomalies in flight operations. Moreover, the model’s active learning strategy allows it to detect unknown anomalies that might emerge in the system. We validate the performance of the SALAD with a real-world case study of anomaly detection during the approach to landing of commercial aircraft. We specifically show that the proposed framework reaches reliable performance when only 1% of the data is labeled and can identify unknown anomalies effectively.

10 October 2010 in Annual Conference of the PHM Society
Verified
Journal Article
Open access
PDF file
Rodney MartinRodney Martin
Rodney Martin
MSMark A. Schwabacher
Mark A. Schwabacher
BMBryan Matthews
Bryan Matthews
In this paper, we will assess the performance of a data-driven anomaly detection algorithm, the In- ductive Monitoring System (IMS), which can be used to detect simulated Thrust Vector Control (TVC) system failures. However, the ability of IMS to detect these failures in a true operational setting may be related to the realistic nature of how they are simulated. As such, we will investi- gate both a low fidelity and high fidelity approach to simulating such failures, with the latter based upon the underlying physics. Furthermore, the ability of IMS to detect anomalies that were pre- viously unknown and not previously simulated will be studied in earnest, as well as apparent de- ficiencies or misapplications that result from us- ing the data-driven paradigm. Our conclusions indicate that robust detection performance of sim- ulated failures using IMS is not appreciably af- fected by the use of a high fidelity simulation. However, we have found that the inclusion of a data-driven algorithm such as IMS into a suite of deployable health management technologies does add significant value.

29 February 2016 in arXiv
Verified
Preprint
Open access
PDF file
IMIgor Melnyk
Igor Melnyk
ABArindam Banerjee
Arindam Banerjee
BMBryan Matthews
Bryan Matthews
Nikunj OzaNikunj Oza
Nikunj Oza
In this work we consider the problem of anomaly detection in heterogeneous, multivariate, variable-length time series datasets. Our focus is on the aviation safety domain, where data objects are flights and time series are sensor readings and pilot switches. In this context the goal is to detect anomalous flight segments, due to mechanical, environmental, or human factors in order to identifying operationally significant events and provide insights into the flight operations and highlight otherwise unavailable potential safety risks and precursors to accidents. For this purpose, we propose a framework which represents each flight using a semi-Markov switching vector autoregressive (SMS-VAR) model. Detection of anomalies is then based on measuring dissimilarities between the model's prediction and data observation. The framework is scalable, due to the inherent parallel nature of most computations, and can be used to perform online anomaly detection. Extensive experimental results on simulated and real datasets illustrate that the framework can detect various types of anomalies along with the key parameters involved.