Results for “unknowns” — Page 42

NASA NTRSDate not supplied

Safety Expertise and the Perils of Novelty

Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.

safety expertise↗

NASA NTRS2020

Preliminary Design, Testing, and Performance of the LOFTID Navigation System

The Low Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) involves the first orbital test of an inflatable decelerator. This test involves the LOFTID re-entry vehicle using an inflatable decelerator to re-enter the atmosphere after flying to orbit as a secondary payload. Due to system constraints, including spin stabilization, unknown time of day, a limited space available for antennas, and a heat shield which blocks magnetic fields, the navigation system includes only an inertial measurement unit and a single GPS receiver. As the vehicle is turned off for the first part of the mission and will not receive commands or data from the ground, the navigation system will not have accurate initialization, and will in-stead rely on pre-flight estimates or first measurement estimation. This could result in significant unknown error in the initial state, resulting in needing to initialize the state on-orbit and requires using the single GPS antenna for attitude updates. These design considerations led to using an Extended Kalman filter, modified to perform with these design constraints. A streamlined testing approach, including tests with flight-like rotations, is being used to limit the time and resources needed to test the navigation system while still fully testing the performance and robustness of the navigation system. This testing approach follows the NASA test-as-you-fly principle and allows for early detection of errors and changes that are needed in the software. This results in a navigation system that, even within the design constraints of the mission architecture, will provide the performance and robustness needed of the mission.

Joel Amert↗

NASA NTRS2023

Software Error Incident Categorizations in Aerospace

Since the first use of computers in space and aircraft, software errors have occurred. These errors can manifest as loss-of-life or less catastrophically. As the demand for automation increases, software in safety-critical systems should be designed to be tolerant to the most likely software faults. This paper categorizes historic aerospace software errors to determine trends of how and where automation is most likely to fail. A distinction between software producing wrong (erroneous) output versus no output (fail-silent) is introduced. Of the historical incidents analyzed, 87% were from software acting unexpectedly rather than simply stopping. Rebooting was found to be ineffective to clear erroneous behavior, and only partially effective for silent software. Errors were traced back to the software logic itself in 62% of cases, 13% within configurable data, and 25% introduced through input. Thirty percent (30%) of unexpected software behavior was caused by the absence of software and 20% was due to “unknown-unknowns”. These findings indicate that to achieve fault tolerance in safety-critical systems, backup strategies must be employed to detect and respond to erroneous software behavior beyond only fail-silent cases, and robust off-nominal testing should be performed to uncover unanticipated situations.

Software↗

NASA NTRS2024

Historical Aerospace Software Errors Categorized to Influence Fault Tolerance

Since the first use of computers in space and aircraft, software errors have occurred. These errors can manifest as loss-of-life or less catastrophically. As the demand for automation increases, software in mission or safety-critical systems should be designed to be tolerant to the most likely software faults. This paper categorizes a set of 55 historic aerospace software error incidents from 1962 to 2023 to determine trends of how and where automation is most likely to fail, behaving unexpectedly. A distinction between software producing unexpected (erroneous) output versus no output (failsilent) is introduced. Of the historical incidents analyzed, 85% were from software producing wrong output rather than simply stopping. Rebooting was found to be ineffective to clear erroneous behavior, and not reliable to recover from silent failures. Error origin was within the code/logic itself in 58% of cases, 16% from configurable data, 15% from unexpected sensor input, and 11% from command/operator input. A substantial forty percent (40%) of unexpected software behavior was indicated by the absence of code, arising from unanticipated situations and missing requirements, and 16% of incidents were subjectively deemed “unknown-unknowns”. No incidents were found to be the result of programming language, compiler, tool, or operating system; and only sixteen percent (16%) of all incidents were considered errors traditional computer science/programming in nature. These findings indicate that for fault tolerance, erroneous automation behavior must be a primary consideration especially at critical moments, and reboot recoverability may not be viable. Special care should be taken to validate configurable data and commands prior to use. “Test-like-you-fly”, including hardware-in-the-loop combined with robust off-nominal testing should be used to uncover missing logic arising from unanticipated situations not covered by requirements alone. This study uniquely focuses on manifestations of unexpected flight software behavior, independent of ultimate root cause. We characterize software error behavior and origin to improve software design, test, and operations for resilience to the most common manifestations, and provide a rich dataset for further study.

Aerospace↗

NASA NTRSDate not supplied

Safety Expertise and the Perils of Novelty

Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.

safety expertise↗

NASA NTRS2021

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering

Estimation of unknown noise covariances in a Kalman filter is a problem of significant practical interest in a wide array of applications. Although this problem has a long history, reliable algorithms for their estimation were scant, and necessary and sufficient conditions for identifiability of the covariances were in dispute until recently. Necessary and sufficient conditions for covariance estimation and a batch estimation algorithm were presented in our previous study. This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better root mean square error. More significantly, these algorithms are applicable to non-stationary systems where the noise covariances can occasionally jump up or down by an unknown magnitude. The computational efficiency of the new algorithms stems from adaptive thresholds for convergence, recursive fading memory estimation of the sample cross-correlations of the innovations, and accelerated stochastic gradient descent algorithms. The comparative evaluation of the proposed methods on a number of test cases demonstrates their computational efficiency and accuracy.

Adaptive Kalman filtering↗

NASA NTRS2024

Aircraft Parameter Estimation Considering Process and Measurement Noise

A practical formulation is proposed for parameter estimation using the filter-error method, which is a maximum-likelihood estimator for dynamic systems having both process and measurement noise inputs. The novelty of the proposed formulation is that by accurately estimating the measurement noise covariance matrix using a time series analysis method, the remaining unknowns (which include the unknown parameters in the state-space matrices and the process noise covariance matrix) become decorrelated and can be estimated simultaneously in a straightforward manner. The approach is demonstrated using simulation data and flight test data from a subscale airplane. Results indicate that proposed algorithm can obtain accurate modeling results when both measurement noise and process noise are present in the data.

Kalman filter↗

NASA NTRSDate not supplied

Implementation of a Compact Self-Aligned Focusing Schlieren System for Measurements with the SBLT-II Flight Test Article

Previous flight testing of a supersonic natural laminar flow airfoil on the NASA F-15Baircraft showed evidence of multiple impinging shocks (shock train) of unknown origin, which generated sufficient crossflow on the airfoil to affect the primary measurement goal of transition location. A compact self-aligned focusing schlieren (SAFS) system is being developed to visualize this shock train on the forward surface of the Supersonic Boundary Layer Transition - PhaseII (SBLT-II) flight test article. Details of the design of the SAFS flight system, the constraints imposed by the imaging pod that will be mounted to the F-15B aircraft, preliminary laboratory results obtained with the system, and challenges associated with integrating the imaging system into the aircraft are presented. The resulting schlieren images obtained from this flight test will allow for a three-dimensional reconstruction of the unknown shock structure, validating the use of SAFS for flight testing.

Joshua M. Weisberger↗

NASA NTRSDate not supplied

Evaluating Lunar Water Processing System Model Configurations for Small Scale Oxygen and Hydrogen Production Within JAXA'S ISRU Technology

Introduction: In-Situ Resource Utilization (ISRU) refers to novel methods of extracting and processing local resources for use in life support and propulsion systems, reducing or eliminating the required consumables to be transferred from Earth. Current estimates of water-ice availability embedded in regolith within the Moon’s permanently shadowed regions (PSR’s) range between 1-5% by weight. However, the composition and characteristics of the “wet” regolith is unknown. Alternate ISRU excavation techniques and Concept of Operations (ConOps) must be explored to optimize surface system operations based on these factors. To assess the feasibility of different ISRU subsystem technologies and compare system architecture configurations, an interchangeable system model was generated to incorporate technologies spanning excavation of raw materials to storage of products and determine optimal arrangement of total system processing needs. Total Mass, Volume, and Power (M/V/P) requirements were computed for 168 design iterations of this water processing plant. System Model: In FY24, the System Engineering and Integration (SE&I) ISRU Modeling and Analysis (SIMA) team developed a lunar water processing system model using the Mission Analysis and Integration Tool (MAIT) to estimate the M/V/P for ISRU subsystems operating under a wide range of Hydrogen (H2) and Oxygen (O2) production targets for the Space Technology Mission Directorate (STMD) [1]. Based on Japan Aerospace Exploration Agency’s (JAXA) surface operational requirements, this system architecture was modified to include the ability to excavate consolidated icy regolith (versus granular ice excavation using Kennedy Space Center’s (KSC) ISRU Pilot Excavator, IPEx) and explore the feasibility of processing the lunar water both inside and outside of the PSR. For the consolidated icy regolith case study, excavation was performed via a mobility transport chassis outfitted with The Regolith Ice Drill for Exploring New Terrain (TRIDENT) for drilling [2] and the Cold Operable Lunar Deployable Arm (COLDArm) [3] for regolith transfer. The system model determines the required rover and payload. M/V/P to handle the required regolith processing rates. The regolith is then sorted and heated to sublimate the ice (via an auger dryer). The exiting high temperature, low pressure vapor is cleaned of volatiles (via cold trap) and electrolyzed to produce H2 and O2. These products are then dried, liquified with 20 K and 90 K cryocoolers (for H2 and O2, respectively), and stored in cylindrical tanks. Study Goals: Due to the different ConOps options of regolith transport to the ridge for processing versus processing it directly inside the PSR, as well as the unknown regolith/water-ice composition, new excavation techniques and their power configurations are being evaluated within a ISRU system architecture for production targets less than NASA’s pilot plant (1 mT). This analysis investigates the feasibility of numerous excavation techniques, power architectures, and logistical operations and determines an optimal system configuration with regards to M/V/P. It aims to investigate which parameters, both locally and globally, have the greatest effect on each subsystem within the plant. This can be used to identify the most critical components of the plant, and guide future decisions on allocating funding for research and development. The results from this study may provide subsystem developers with appropriate interfaces with excavation subsystems and downstream processes, and assessing the overall feasibility of each excavation technique, power architecture, and logistical timeframe. References: [1] Carlson, A. et. al. (2024) ICES. [2] Zacny, K., et. al. (2024) “ASCE Earth and Space”. [3] McCormick, R., et. Al. (2024) IEEE Xplore.

ISRU↗

DOE OSTI2019

High-pressure, high-temperature hollow sphere acoustic pressure sensor

A pressure sensor and a method of measuring pressure with the pressure sensor, based on measuring the effect of pressure loads on the acoustic resonance mode frequencies of a spherical core (e.g., a hollow sphere). The pressure sensor includes a transmitter configured to transmit vibrational signals to a sphere, and a receiver on the opposite side of the spherical core that is configured to receive vibrational signals from the spherical core. According to the method of measuring pressure with this sensor, the spherical core exhibits a pressure-dependent resonance response that can be monitored utilizing a frequency response technique. Peak shifts observed under an unknown pressure load can be compared to a calibration of the spherical core under a series of known pressure loads to thereby determine the unknown pressure. The pressure sensor and method may be operated in real-time at very high temperatures and pressure, and may be used in borehole applications and in aggressive media.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

Online Data-Enabled Predictive Control

We develop an online data-enabled predictive (ODeePC) control method for trajectory tracking of unknown systems, building upon the recently proposed DeePC. Our proposed ODeePC method leverages a primal-dual algorithm with real-time measurement feedback to iteratively compute the corresponding real-time optimal control policy as system conditions change. Specifically, our developed ODeePC: a) records data from the unknown system and updates the underlying primal-dual algorithm dynamically, b) can track changes in the system's operating point and adjust the control inputs, and c) is computationally efficient as it deploys a Fast Fourier Transform-based algorithm enabling the fast computation of the product of a non-square Hankel matrix with a vector. We provide theoretical guarantees regarding the asymptotic behavior of ODeePC and demonstrate its performance through a power system application.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2022

LWR Aging Management for Life Beyond 80

While several decades of materials degradation research enabled the current US fleet of Light Water Reactors (LWR) to plan to produce electrical power through extended operations up to 80 years of plant life, it now seems appropriate to evaluate what issues, methods, and timelines need to be considered to meet the expected electric power demands for life beyond eighty (LBE) years. To address these questions, it will be necessary to review the electrical capacity and the projected LWR fleet capacity including new builds and advanced reactors. This effort should begin with a materials degradation assessment focused on known and possible unknown issues using a reduced Expanded Materials Degradation Assessment [1], which was employed to identify knowledge gaps for a second license renewal (60-80 yrs.). The focus of the LBE assessment should include: Establishing a timeline to initiate assessments of possible materials aging issues and to ensure sufficient time to evaluate materials degradation research gaps; assessing components and materials to be evaluated, e.g., metals (reactor pressure vessels and alloys within and outside the pressure boundary), concrete, cables, as well as mitigation methods, advanced monitoring, and validation with ex-service materials; initiating a LBE research plan focused on developing an expanded mechanistic understanding of materials degradation and refined models through Codes and Standards evaluation for use by the nuclear industry; and maintaining and strengthening the nuclear materials human knowledge base to address new and as yet unknown degradation modes.

Chen, Xiang↗

DOE OSTI2023

Unbalanced Nested Random Effects Estimation of Variance Components

To investigate the contributing factors of variance in the measurement of an iodine 127 (127I) sample, we implement a nested random effects analysis of variance (ANOVA). Historically, the reported uncertainty on a measurement of 127I has been obtained by methods of forward uncertainty propagation because there is typically only one replicate of a given sample for which to estimate the uncertainty. When samples are processed there are several types of quality control (QC) standards analyzed along-side the unknown samples with two to five replicates for each. Assuming the variance observed in these replicate QC standards is representative of that of the unknown samples, we use these data in a nested random effects ANOVA to estimate the total uncertainty of a measurement. We demonstrate this approach with two sets of measurements from Idaho National Laboratory and compare the results with the forward uncertainty propagation approach. Variance component estimates for the coarsest level of the nesting structure were most imprecise because replicates were most limited at these levels. We find that the results largely agree between forward propagation and ANOVA, and the greatest contributors of variance are due to instrument variation and chemical processing, with human processing being among the smallest contributors. This analysis provides reassurance that the reported uncertainties using forward propagation are reasonable and the process is well controlled. We propose a future designed experiment to increase replicates at the coarsest level of the hierarchy to improve estimates of these variance components.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

System state estimation with asynchronous measurements

The present disclosure provides techniques for estimating network states using asynchronous measurements by leveraging network inertia. For example, a device configured in accordance with the techniques of the present disclosure may receive electrical parameter values corresponding to at least one first location within a power network and determine, based on the electrical parameter values and a previous estimated state of the power network, an estimated value of unknown electrical parameters that correspond to a second location within the power network. The device may further cause at least one device within the power network to modify operation based on the estimated value of the unknown electrical parameters. The leveraging of network inertia may obviate the need for probabilistic models or pseudo-measurements.

Cavraro, Guido↗

DOE OSTI2023

Physics-constrained fault diagnosis framework for monitoring a multi-component thermal hydraulic system

A method for diagnosing faults includes receiving a system description of a thermal hydraulic system, the system description indicating a plurality of components and sensors. The method also includes constructing, based on physical conservations laws and using the system description, a plurality of physics-based models for the plurality of components, each of the plurality of physics-based models including unknown parameters. The method further includes receiving historical measurements and calibrating the physics-based models by calculating the unknown parameters of each of the physics-based models using the historical measurements to produce calibrated models. The method also includes receiving sensor measurements of the sensors, and calculating residuals corresponding to differences between measurements predicted by the plurality of calibrated models and the sensor measurements. The method also includes determining, based on the calculated residuals, a fault of a component or a sensor, and generating an alert indicating the fault.

Nguyen, Tat Nghia↗

DOE OSTI2020

Development of a Convolutional Neural Network Classifier for Data Starved Spectra - 20199

The Institute for Clean Energy Technology (ICET) at Mississippi State University is exploring the utility of machine learning in augmenting its mobile radiation surveying platforms, which are currently being developed as means to survey depleted uranium contaminated areas in support of remediation and decommissioning efforts. Mobile survey platforms provide a means to efficiently scan large areas of interest while reducing human exposure to radiation and other hazards. The survey platforms can also be used for scanning for any gamma emitting isotope in addition to depleted uranium. The spectral data that the platforms collect may be data starved with relatively low counts and poorly defined spectral features depending on the speed of the platforms and scintillation detector selection. Such data-starved spectra are difficult to use for isotope identification, requiring advanced knowledge of the possible radionuclides that could be present and environmental factors that could attenuate signals or introduce background noise. These factors in combination with the volume of survey data increases the time it takes to perform analysis of survey data when the source type is unknown. There are a number of algorithms in the field of machine learning that can be used to classify data that would be challenging and time-consuming for a human to identify. Supervised machine learning algorithms train models based on extensive amounts of human-labeled training data. Once sufficiently trained, these models can be used to quickly make high-fidelity predictions on new data. Convolutional neural networks are machine learning algorithms that excel in learning representations of 'shapes'. They do this by taking numerical input data and convolving them with spatial feature detectors referred to as filters. These filters are incrementally adjusted to reduce the prediction error on the data during the backpropagation step of training. Discussed in this paper is the development of a convolutional neural network classifier (CNNC) that can utilize spectral survey data for source discrimination and isotope identification. Bench-top laboratory experiments data using LaBr{sub 3}(Ce) scintillation detectors were used to train and evaluate the performance of the developed CNNC. The CNNC is capable of discriminating a variety of gamma emitting source types, differentiating different forms of uranium (depleted vs. natural), and estimating the amount of uranium for a known geometry. The discussed CNNC may be useful in scenarios where survey systems are deployed in situations where hazardous radioactive material maybe present, but the type is unknown. When used in remediation applications the CNNC can be used to screen-out false positives, helping reduce remediation costs. (authors)

07 ISOTOPE AND RADIATION SOURCES↗

DOE OSTI2024

Physics-constrained fault diagnosis framework for monitoring a standalone component of a thermal hydraulic system

A method for diagnosing faults includes receiving a description of a component of a thermal hydraulic system, where the description also indicates one or more sensors of the component. The method also includes constructing, based on a physical conservation law and using the description, a physics-based model describing operation of the component, the physics-based model including one or more unknown parameters. The method further includes calibrating the physics-based model by calculating the one or more unknown parameters using historical measurements to produce a calibrated model. Further, the method includes receiving sensor measurements captured by the one or more sensors, and calculating residuals corresponding to differences between measurements predicted by the calibrated model and the sensor measurements. The method also includes determining, based on the calculated residuals, a fault of the component or of a sensor of the one or more sensors, and generating an alert indicating the fault.

Nguyen, Tat Nghia↗

DOE OSTI2024

Carbon fiber classification using raman spectroscopy

Carbon fiber characterization processes are described that include multi-condition Raman spectroscopy-based examination combined with multivariate data analyses. Methods are a nondestructive material characterization approach that can provide predictions as to carbon fiber bulk physical properties, as well as identification of unknown carbon fiber materials for quality control purposes. The framework of the multivariate analysis methods includes a principal component-based identification protocol including comparison of Raman spectral data from an unknown carbon fiber with a data library of multiple principal component spaces.

Houk, Amanda L.↗