Engineering PapersSearch

SEARCH · Engineering Papers

Results for “anomaly identification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Clustering and Recurring Anomaly Identification: Recurring Anomaly Detection System (ReADS)

This viewgraph presentation reviews the Recurring Anomaly Detection System (ReADS). The Recurring Anomaly Detection System is a tool to analyze text reports, such as aviation reports and maintenance records: (1) Text clustering algorithms group large quantities of reports and documents; Reduces human error and fatigue (2) Identifies interconnected reports; Automates the discovery of possible recurring anomalies; (3) Provides a visualization of the clusters and recurring anomalies We have illustrated our techniques on data from Shuttle and ISS discrepancy reports, as well as ASRS data. ReADS has been integrated with a secure online search

McIntosh, Dawn

An Extreme-Value Approach to Anomaly Vulnerability Identification

The objective of this paper is to present a method for importance analysis in parametric probabilistic modeling where the result of interest is the identification of potential engineering vulnerabilities associated with postulated anomalies in system behavior. In the context of Accident Precursor Analysis (APA), under which this method has been developed, these vulnerabilities, designated as anomaly vulnerabilities, are conditions that produce high risk in the presence of anomalous system behavior. The method defines a parameter-specific Parameter Vulnerability Importance measure (PVI), which identifies anomaly risk-model parameter values that indicate the potential presence of anomaly vulnerabilities, and allows them to be prioritized for further investigation. This entails analyzing each uncertain risk-model parameter over its credible range of values to determine where it produces the maximum risk. A parameter that produces high system risk for a particular range of values suggests that the system is vulnerable to the modeled anomalous conditions, if indeed the true parameter value lies in that range. Thus, PVI analysis provides a means of identifying and prioritizing anomaly-related engineering issues that at the very least warrant improved understanding to reduce uncertainty, such that true vulnerabilities may be identified and proper corrective actions taken.

Everett, Chris

Identification Of Anomalies In Welds

Advanced techniques combined with conventional analytical methods. Combination of real-time radiography, scanning electron microscopy, and energy-dispersive spectrometry identify enigmatic features in radiographs of welds where standard tensile, hardness, and electrical-conductivity tests and visible-light microscopic and macroscopic examinations insufficient. New combination of techniques applied successfully to variable-polarity-plasma-arc welds of 2219 aluminum alloy. Joints subjected to penetration, fill, and weld-repair passes with 2319 aluminum weld wire.

Knichen, David G.

Anomaly Detection in Test Equipment via Sliding Mode Observers

Nonlinear observers were originally developed based on the ideas of variable structure control, and for the purpose of detecting disturbances in complex systems. In this anomaly detection application, these observers were designed for estimating the distributed state of fluid flow in a pipe described by a class of advection equations. The observer algorithm uses collected data in a piping system to estimate the distributed system state (pressure and velocity along a pipe containing liquid gas propellant flow) using only boundary measurements. These estimates are then used to further estimate and localize possible anomalies such as leaks or foreign objects, and instrumentation metering problems such as incorrect flow meter orifice plate size. The observer algorithm has the following parts: a mathematical model of the fluid flow, observer control algorithm, and an anomaly identification algorithm. The main functional operation of the algorithm is in creating the sliding mode in the observer system implemented as software. Once the sliding mode starts in the system, the equivalent value of the discontinuous function in sliding mode can be obtained by filtering out the high-frequency chattering component. In control theory, "observers" are dynamic algorithms for the online estimation of the current state of a dynamic system by measurements of an output of the system. Classical linear observers can provide optimal estimates of a system state in case of uncertainty modeled by white noise. For nonlinear cases, the theory of nonlinear observers has been developed and its success is mainly due to the sliding mode approach. Using the mathematical theory of variable structure systems with sliding modes, the observer algorithm is designed in such a way that it steers the output of the model to the output of the system obtained via a variety of sensors, in spite of possible mismatches between the assumed model and actual system. The unique properties of sliding mode control allow not only control of the model internal states to the states of the real-life system, but also identification of the disturbance or anomaly that may occur.

Solano, Wanda M.

Enabling the Discovery of Recurring Anomalies in Aerospace System Problem Reports using High-Dimensional Clustering Techniques

This paper describes the results of a significant research and development effort conducted at NASA Ames Research Center to develop new text mining techniques to discover anomalies in free-text reports regarding system health and safety of two aerospace systems. We discuss two problems of significant importance in the aviation industry. The first problem is that of automatic anomaly discovery about an aerospace system through the analysis of tens of thousands of free-text problem reports that are written about the system. The second problem that we address is that of automatic discovery of recurring anomalies, i.e., anomalies that may be described m different ways by different authors, at varying times and under varying conditions, but that are truly about the same part of the system. The intent of recurring anomaly identification is to determine project or system weakness or high-risk issues. The discovery of recurring anomalies is a key goal in building safe, reliable, and cost-effective aerospace systems. We address the anomaly discovery problem on thousands of free-text reports using two strategies: (1) as an unsupervised learning problem where an algorithm takes free-text reports as input and automatically groups them into different bins, where each bin corresponds to a different unknown anomaly category; and (2) as a supervised learning problem where the algorithm classifies the free-text reports into one of a number of known anomaly categories. We then discuss the application of these methods to the problem of discovering recurring anomalies. In fact the special nature of recurring anomalies (very small cluster sizes) requires incorporating new methods and measures to enhance the original approach for anomaly detection. ?& pant 0-

Srivastava, Ashok, N.

First incremental buy for Increment 2 of the Space Transportation System (STS)

Thiokol manufactured and delivered 9 flight motors to KSC on schedule. All test flights were successful. All spent SRMs were recovered. Design, development, manufacture, and delivery of required transportation, handling, and checkout equipment to MSFC and to KSC were completed on schedule. All items of data required by DPD 400 were prepared and delivered as directed. In the system requirements and analysis area, the point of departure from Buy 1 to the operational phase was developed in significant detail with a complete set of transition documentation available. The documentation prepared during the Buy 1 program was maintained and updated where required. The following flight support activities should be continued through other production programs: as-built materials usage tracking on all flight hardware; mass properties reporting for all flight hardware until sample size is large enough to verify that the weight limit requirements were met; ballistic predictions and postflight performance assessments for all production flights; and recovered SRM hardware inspection and anomaly identification. In the safety, reliability, and quality assurance area, activities accomplished were assurance oriented in nature and specifically formulated to prevent problems and hardware failures. The flight program to date has adequately demonstrated the success of this assurance approach. The attention focused on details of design, analysis, manufacture, and inspection to assure the production of high-quality hardware has resulted in the absence of flight failures. The few anomalies which did occur were evaluated, design or manufacturing changes incorporated, and corrective actions taken to preclude recurrence.

Source record

Development of a Relay Performance Web Tool for the Mars Network

Modern Mars surface missions rely upon orbiting spacecraft to relay communications to and from Earth systems. An important component of this multi-mission relay process is the collection of relay performance statistics supporting strategic trend analysis and tactical anomaly identification and tracking.

data accountability

The Space Debris Sensor Experiment

The Space Debris Sensor (SDS) is a NASA Class 1E technology demonstration external payload aboard the International Space Station (ISS). With approximately one square meter of detection area, the SDS is attached to the European Space Agency Columbus module facing the ISS velocity vector with minimal obstruction from ISS hardware. The SDS is the first flight demonstration of the Debris Resistive/Acoustic Grid Orbital NASA-Navy Sensor (DRAGONS) technology developed and matured over 10 years by the NASA Orbital Debris Program Office (ODPO), in concert with the DRAGONS consortium, to provide information on the sub-millimeter scale orbital debris environment. The SDS demonstrated the capacity to read 4 resistive grids at 1 Hz, 40 acoustic sensors at 500 kHz, and record and downlink impact data to the ground. Observable and derived data from the SDS could provide information to models that are critical to understanding risks the small debris environment poses to spacecraft in low Earth orbit. The technology demonstrated by the SDS is a major step forward in monitoring and characterizing the space debris environment. This paper will address the technical performance of the SDS during its operational lifetime and its realization of technical and scientific goals. The SDS was intended to operate for 3 years; however, the payload incurred multiple anomalies during its operational life. Subsequently termed “Anomaly #1,” the first was the symptomatic loss of low data rate 1553 channel command and telemetry. The second, Anomaly #2, was loss of all low- and medium-data rate (Ethernet) telemetry. Anomaly #2 proved to be unrecoverable, leading to loss of the payload after approximately 26 days on-board the ISS. Therefore, this paper also addresses the anomalies that occurred during operation of the SDS, their attribution, and their resolution. Lessons learned are described when relevant to anomaly identification, attribution, and resolution.

Anz-Meador, P.

Apollo experience report: Flight anomaly resolution

The identification of flight anomalies, the determination of their causes, and the approaches taken for corrective action are described. Interrelationships of the broad range of disciplines involved with the complex systems and the team concept employed to ensure timely and accurate resolution of anomalies are discussed. The documentation techniques and the techniques for management of anomaly resolution are included. Examples of specific anomalies are presented in the original form of their progressive documentation. Flight anomaly resolution functioned as a part of the real-time mission support and postflight testing, and results were included in the postflight documentation.

Lobb, J. D.

Applications of Anomaly Detection and Precursor Identification in Airspace Operations

As we continue to advance the U.S. National Airspace into the next generation of air traffic, we face challenges in both increase in complexity, as well as, a significant growth in traffic volume. Addressing these challenges, while maintaining the same level of safety is an important application of data mining. Because of these significant shifts in airspace design and usage there is a need to identify current and emergent safety risks along with their potential precursors. In recent years NASA has made advancements in developing scalable methods to address this effort in the Big Data paradigm. Multiple kernel anomaly detection approaches have been employed on both surveillance radar data and flight operational quality assurance data to identify operationally significant safety risks. Additionally, events have been explored with a recently developed precursor identification tool to discover states that reveal an increased probability of a safety event. These tools can be used to discover emerging safety risks that may not be currently monitored, which allows for mitigation tactics to be employed and ultimately make the overall airspace safer. This talk will discuss an overview of these methods and a discussion of the findings.

anomaly detection

Anomaly Detection, Active Learning, Precursor Identification,and Human Knowledge for Autonomous System Safety

The project Autonomy Teaming and TRajectories for ComplexTrusted Operational Reliability (ATTRACTOR) researched and developed Artificial Intelligence with application to multi-Unmanned Aerial Systems (UAS) missions. Such missions, like other complex systems-of-systems, are likely to have previously-unknown, safety relevant anomalies occur due to many possible factors including system failures or degradations, emergent behavior, changes in the environment in which the systems operate, changes in the way the systems are operated. We discuss the application of anomaly detection, active learning, and precursor identification to identify such anomalies and the conditions under which they are more likely to appear. We demonstrate results on simulated multi-UAS missions that show promise to be applied to real missions.

machine learning

Identification and detection of anomalies through SSME data analysis

The goal of the ongoing research described in this paper is to analyze real-time ground test data in order to identify patterns associated with the anomalous engine behavior, and on the basis of this analysis to develop an expert system which detects anomalous engine behavior in the early stages of fault development. A prototype of the expert system has been developed and tested on the high frequency data of two SSME tests, namely Test #901-0516 and Test #904-044. The comparison of our results with the post-test analyses indicates that the expert system detected the presence of the anomalies in a significantly early stage of fault development.

Pereira, Lisa

Discovering System Health Anomalies Using Data Mining Techniques

We present a data mining framework for the analysis and discovery of anomalies in high-dimensional time series of sensor measurements that would be found in an Integrated System Health Monitoring system. We specifically treat the problem of discovering anomalous features in the time series that may be indicative of a system anomaly, or in the case of a manned system, an anomaly due to the human. Identification of these anomalies is crucial to building stable, reusable, and cost-efficient systems. The framework consists of an analysis platform and new algorithms that can scale to thousands of sensor streams to discovers temporal anomalies. We discuss the mathematical framework that underlies the system and also describe in detail how this framework is general enough to encompass both discrete and continuous sensor measurements. We also describe a new set of data mining algorithms based on kernel methods and hidden Markov models that allow for the rapid assimilation, analysis, and discovery of system anomalies. We then describe the performance of the system on a real-world problem in the aircraft domain where we analyze the cockpit data from aircraft as well as data from the aircraft propulsion, control, and guidance systems. These data are discrete and continuous sensor measurements and are dealt with seamlessly in order to discover anomalous flights. We conclude with recommendations that describe the tradeoffs in building an integrated scalable platform for robust anomaly detection in ISHM applications.

Sriastava, Ashok, N.

Thermal and Chemical Characterization of Composite Materials. MSFC Center Director's Discretionary Fund Final Report, Project No. ED36-18

The purpose of this research effort was to: (1) provide a concise and well-defined property profile of current and developing composite materials using thermal and chemical characterization techniques and (2) optimize analytical testing requirements of materials. This effort applied a diverse array of methodologies to ascertain composite material properties. Often, a single method of technique will provide useful, but nonetheless incomplete, information on material composition and/or behavior. To more completely understand and predict material properties, a broad-based analytical approach is required. By developing a database of information comprised of both thermal and chemical properties, material behavior under varying conditions may be better understood. THis is even more important in the aerospace community, where new composite materials and those in the development stage have little reference data. For example, Fourier transform infrared (FTIR) spectroscopy spectral databases available for identification of vapor phase spectra, such as those generated during experiments, generally refer to well-defined chemical compounds. Because this method renders a unique thermal decomposition spectral pattern, even larger, more diverse databases, such as those found in solid and liquid phase FTIR spectroscopy libraries, cannot be used. By combining this and other available methodologies, a database specifically for new materials and materials being developed at Marshall Space Flight Center can be generated . In addition, characterizing materials using this approach will be extremely useful in the verification of materials and identification of anomalies in NASA-wide investigations.

Stanley, D. C.

Monthly Representations of Mid-Tropospheric Carbon Dioxide from the Atmospheric Infrared Sounder

The Atmospheric Infrared Sounder (AIRS) on NASA's Earth Observing System Aqua spacecraft was launched in May of 2002 and acquires hyperspectral infrared spectra used to generate a wide range of atmospheric products including temperature, water vapor, and trace gas species including carbon dioxide. Here we present monthly representations of global concentrations of mid-tropospheric carbon dioxide produced from 8 years of data obtained by AIRS between the years of 2003 and 2010. We define them as "representations" rather than "climatologies" to reflect that the files are produced over a relatively short time period and represent summaries of the Level 3 data. Finally, they have not yet been independently validated. The representations have a horizontal resolution of 2.0 deg x 2.5 deg (Latitude x Longitude) and faithfully reproduce the original 8 years of monthly L3 CO2 concentrations with a standard deviation of 1.48 ppm and less than 2% outliers. The representations are intended for use in studies of the global general circulation of CO2 and identification of anomalies in CO2 typically associated with atmospheric transport. The seasonal variability and trend found in the AIRS CO2 data are discussed.

Carbon Dioxide

Autonomous Assessment and Predictive Capabilities for Low-Altitude Urban Flight Operations

The integration of unmanned aerial vehicles in the national airspace will introduce new vehicle types, technologies, and operational paradigms for which safety must be maintained and hazards mitigated. One approach is to attempt to design for possible hazards and unsafe incidents that can occur at different phases of flight (pre-flight, in-flight, and post-flight) and during ground operations. Another is to mitigate safety incidents by implementing changes to policies, procedures, regulations, and design to cover personnel, equipment, and aircraft during operations. These and other techniques, not described herein, are typically conservative or adhoc in that they reduce the likelihood of risk after safety incidents have occurred. In this work, the goal is to develop a more predictive capability to monitor and mitigate risk and hazards to safety “in-time” enough for decisions to be made. In line with NASA’s Aeronautics Mission Directorate Strategic Thrust 5 [1] (In-Time System-Wide Safety Assurance), the System-Wide Safety (SWS) project under which this work falls, is developing and demonstrating innovative and safety-oriented solutions that enable modernization and aviation transformation. To that effect, this work will detail data-driven efforts on the SWS project to develop a number of safety-critical services for in-time monitoring and mitigation of hazards to low-altitude flight operations. First, hazards to these operations are identified based on previous work by NASA [2,3] and others in the aerospace industry. These hazards include (i) unsafe proximity to other vehicles, property, and people on the ground, (ii) critical system failures such as communication signal/GPS loss, unexpected propulsion system degradation, engine/power failure, and (iii) operational/environmental issues such as severe weather and gusty winds. For these hazards, safety metrics, which can be quantified and assessed are defined, models to monitor and predict them are developed, and flight test data is generated to develop, validate, and test these models, considering the complex interplay of the different hazards that define them [4-6]. In addition, the uncertainty in the non-deterministic effects that cannot be modeled nor predicted and unknown unknowns that arise after design/testing and during operations must be handled in rigorous manner. As a result, for each of the developed safety metrics, their dependencies on one another are characterized and a framework for handling the uncertainties inherent in the modeling, algorithms, and measurements required for prediction is also developed [7]. To that effect, this presentation will describe the safety metrics and services already developed and underway under the System-Wide Safety project that utilize data-driven techniques for the identification of anomalies, precursors, and trends (APTs) to monitor and mitigate hazards to safety, in-time, for urban flight operations in low-altitude airspace.

Okolo, Wendy A.

The identification of meteorite inclusions with isotope anomalies

Ca-Al refractory inclusions with characteristic chemical and mineralogical compositions show an enhanced occurrence of 20 pct of isotope anomalies reflecting unknown nucleosynthetic effects for O and Mg. The anomalies are characterized by large isotope fractionation in Mg, apparent deficits in Mg-26/Mg-24, and large correlated effects for isotopes of Ca, Ti, and Cr. These isotope patterns define exotic components depleted in the most neutron-rich isotopes of Ca, Ti, and Cr, or components depleted in isotopes produced in explosive O and Si burning. An opaque assemblage within one of the inclusions yields isotope anomalies in Cr similar to the bulk inclusion and must be intrinsically part of the inclusion and not a trapped, foreign grain aggregate.

Papanastassiou, D. A.

An Investigation of State-Space Model Fidelity for SSME Data

In previous studies, a variety of unsupervised anomaly detection techniques for anomaly detection were applied to SSME (Space Shuttle Main Engine) data. The observed results indicated that the identification of certain anomalies were specific to the algorithmic method under consideration. This is the reason why one of the follow-on goals of these previous investigations was to build an architecture to support the best capabilities of all algorithms. We appeal to that goal here by investigating a cascade, serial architecture for the best performing and most suitable candidates from previous studies. As a precursor to a formal ROC (Receiver Operating Characteristic) curve analysis for validation of resulting anomaly detection algorithms, our primary focus here is to investigate the model fidelity as measured by variants of the AIC (Akaike Information Criterion) for state-space based models. We show that placing constraints on a state-space model during or after the training of the model introduces a modest level of suboptimality. Furthermore, we compare the fidelity of all candidate models including those embodying the cascade, serial architecture. We make recommendations on the most suitable candidates for application to subsequent anomaly detection studies as measured by AIC-based criteria.

Martin, Rodney Alexander