Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “unknown unknowns”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Preliminary Design, Testing, and Performance of the LOFTID Navigation System

The Low Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) involves the first orbital test of an inflatable decelerator. This test involves the LOFTID re-entry vehicle using an inflatable decelerator to re-enter the atmosphere after flying to orbit as a secondary payload. Due to system constraints, including spin stabilization, unknown time of day, a limited space available for antennas, and a heat shield which blocks magnetic fields, the navigation system includes only an inertial measurement unit and a single GPS receiver. As the vehicle is turned off for the first part of the mission and will not receive commands or data from the ground, the navigation system will not have accurate initialization, and will in-stead rely on pre-flight estimates or first measurement estimation. This could result in significant unknown error in the initial state, resulting in needing to initialize the state on-orbit and requires using the single GPS antenna for attitude updates. These design considerations led to using an Extended Kalman filter, modified to perform with these design constraints. A streamlined testing approach, including tests with flight-like rotations, is being used to limit the time and resources needed to test the navigation system while still fully testing the performance and robustness of the navigation system. This testing approach follows the NASA test-as-you-fly principle and allows for early detection of errors and changes that are needed in the software. This results in a navigation system that, even within the design constraints of the mission architecture, will provide the performance and robustness needed of the mission.

Joel Amert↗

Software Error Incident Categorizations in Aerospace

Since the first use of computers in space and aircraft, software errors have occurred. These errors can manifest as loss-of-life or less catastrophically. As the demand for automation increases, software in safety-critical systems should be designed to be tolerant to the most likely software faults. This paper categorizes historic aerospace software errors to determine trends of how and where automation is most likely to fail. A distinction between software producing wrong (erroneous) output versus no output (fail-silent) is introduced. Of the historical incidents analyzed, 87% were from software acting unexpectedly rather than simply stopping. Rebooting was found to be ineffective to clear erroneous behavior, and only partially effective for silent software. Errors were traced back to the software logic itself in 62% of cases, 13% within configurable data, and 25% introduced through input. Thirty percent (30%) of unexpected software behavior was caused by the absence of software and 20% was due to “unknown-unknowns”. These findings indicate that to achieve fault tolerance in safety-critical systems, backup strategies must be employed to detect and respond to erroneous software behavior beyond only fail-silent cases, and robust off-nominal testing should be performed to uncover unanticipated situations.

Software↗

Historical Aerospace Software Errors Categorized to Influence Fault Tolerance

Since the first use of computers in space and aircraft, software errors have occurred. These errors can manifest as loss-of-life or less catastrophically. As the demand for automation increases, software in mission or safety-critical systems should be designed to be tolerant to the most likely software faults. This paper categorizes a set of 55 historic aerospace software error incidents from 1962 to 2023 to determine trends of how and where automation is most likely to fail, behaving unexpectedly. A distinction between software producing unexpected (erroneous) output versus no output (failsilent) is introduced. Of the historical incidents analyzed, 85% were from software producing wrong output rather than simply stopping. Rebooting was found to be ineffective to clear erroneous behavior, and not reliable to recover from silent failures. Error origin was within the code/logic itself in 58% of cases, 16% from configurable data, 15% from unexpected sensor input, and 11% from command/operator input. A substantial forty percent (40%) of unexpected software behavior was indicated by the absence of code, arising from unanticipated situations and missing requirements, and 16% of incidents were subjectively deemed “unknown-unknowns”. No incidents were found to be the result of programming language, compiler, tool, or operating system; and only sixteen percent (16%) of all incidents were considered errors traditional computer science/programming in nature. These findings indicate that for fault tolerance, erroneous automation behavior must be a primary consideration especially at critical moments, and reboot recoverability may not be viable. Special care should be taken to validate configurable data and commands prior to use. “Test-like-you-fly”, including hardware-in-the-loop combined with robust off-nominal testing should be used to uncover missing logic arising from unanticipated situations not covered by requirements alone. This study uniquely focuses on manifestations of unexpected flight software behavior, independent of ultimate root cause. We characterize software error behavior and origin to improve software design, test, and operations for resilience to the most common manifestations, and provide a rich dataset for further study.

Aerospace↗

Safety Expertise and the Perils of Novelty

Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.

safety expertise↗

Multi-Pass Sequential Mini-Batch Stochastic Gradient Descent Algorithms for Noise Covariance Estimation in Adaptive Kalman Filtering

Estimation of unknown noise covariances in a Kalman filter is a problem of significant practical interest in a wide array of applications. Although this problem has a long history, reliable algorithms for their estimation were scant, and necessary and sufficient conditions for identifiability of the covariances were in dispute until recently. Necessary and sufficient conditions for covariance estimation and a batch estimation algorithm were presented in our previous study. This paper presents stochastic gradient descent algorithms for noise covariance estimation in adaptive Kalman filters that are an order of magnitude faster than the batch method for similar or better root mean square error. More significantly, these algorithms are applicable to non-stationary systems where the noise covariances can occasionally jump up or down by an unknown magnitude. The computational efficiency of the new algorithms stems from adaptive thresholds for convergence, recursive fading memory estimation of the sample cross-correlations of the innovations, and accelerated stochastic gradient descent algorithms. The comparative evaluation of the proposed methods on a number of test cases demonstrates their computational efficiency and accuracy.

Adaptive Kalman filtering↗

Aircraft Parameter Estimation Considering Process and Measurement Noise

A practical formulation is proposed for parameter estimation using the filter-error method, which is a maximum-likelihood estimator for dynamic systems having both process and measurement noise inputs. The novelty of the proposed formulation is that by accurately estimating the measurement noise covariance matrix using a time series analysis method, the remaining unknowns (which include the unknown parameters in the state-space matrices and the process noise covariance matrix) become decorrelated and can be estimated simultaneously in a straightforward manner. The approach is demonstrated using simulation data and flight test data from a subscale airplane. Results indicate that proposed algorithm can obtain accurate modeling results when both measurement noise and process noise are present in the data.

Kalman filter↗

Implementation of a Compact Self-Aligned Focusing Schlieren System for Measurements with the SBLT-II Flight Test Article

Previous flight testing of a supersonic natural laminar flow airfoil on the NASA F-15Baircraft showed evidence of multiple impinging shocks (shock train) of unknown origin, which generated sufficient crossflow on the airfoil to affect the primary measurement goal of transition location. A compact self-aligned focusing schlieren (SAFS) system is being developed to visualize this shock train on the forward surface of the Supersonic Boundary Layer Transition - PhaseII (SBLT-II) flight test article. Details of the design of the SAFS flight system, the constraints imposed by the imaging pod that will be mounted to the F-15B aircraft, preliminary laboratory results obtained with the system, and challenges associated with integrating the imaging system into the aircraft are presented. The resulting schlieren images obtained from this flight test will allow for a three-dimensional reconstruction of the unknown shock structure, validating the use of SAFS for flight testing.

Joshua M. Weisberger↗

Evaluating Lunar Water Processing System Model Configurations for Small Scale Oxygen and Hydrogen Production Within JAXA'S ISRU Technology

Introduction: In-Situ Resource Utilization (ISRU) refers to novel methods of extracting and processing local resources for use in life support and propulsion systems, reducing or eliminating the required consumables to be transferred from Earth. Current estimates of water-ice availability embedded in regolith within the Moon’s permanently shadowed regions (PSR’s) range between 1-5% by weight. However, the composition and characteristics of the “wet” regolith is unknown. Alternate ISRU excavation techniques and Concept of Operations (ConOps) must be explored to optimize surface system operations based on these factors. To assess the feasibility of different ISRU subsystem technologies and compare system architecture configurations, an interchangeable system model was generated to incorporate technologies spanning excavation of raw materials to storage of products and determine optimal arrangement of total system processing needs. Total Mass, Volume, and Power (M/V/P) requirements were computed for 168 design iterations of this water processing plant. System Model: In FY24, the System Engineering and Integration (SE&I) ISRU Modeling and Analysis (SIMA) team developed a lunar water processing system model using the Mission Analysis and Integration Tool (MAIT) to estimate the M/V/P for ISRU subsystems operating under a wide range of Hydrogen (H2) and Oxygen (O2) production targets for the Space Technology Mission Directorate (STMD) [1]. Based on Japan Aerospace Exploration Agency’s (JAXA) surface operational requirements, this system architecture was modified to include the ability to excavate consolidated icy regolith (versus granular ice excavation using Kennedy Space Center’s (KSC) ISRU Pilot Excavator, IPEx) and explore the feasibility of processing the lunar water both inside and outside of the PSR. For the consolidated icy regolith case study, excavation was performed via a mobility transport chassis outfitted with The Regolith Ice Drill for Exploring New Terrain (TRIDENT) for drilling [2] and the Cold Operable Lunar Deployable Arm (COLDArm) [3] for regolith transfer. The system model determines the required rover and payload. M/V/P to handle the required regolith processing rates. The regolith is then sorted and heated to sublimate the ice (via an auger dryer). The exiting high temperature, low pressure vapor is cleaned of volatiles (via cold trap) and electrolyzed to produce H2 and O2. These products are then dried, liquified with 20 K and 90 K cryocoolers (for H2 and O2, respectively), and stored in cylindrical tanks. Study Goals: Due to the different ConOps options of regolith transport to the ridge for processing versus processing it directly inside the PSR, as well as the unknown regolith/water-ice composition, new excavation techniques and their power configurations are being evaluated within a ISRU system architecture for production targets less than NASA’s pilot plant (1 mT). This analysis investigates the feasibility of numerous excavation techniques, power architectures, and logistical operations and determines an optimal system configuration with regards to M/V/P. It aims to investigate which parameters, both locally and globally, have the greatest effect on each subsystem within the plant. This can be used to identify the most critical components of the plant, and guide future decisions on allocating funding for research and development. The results from this study may provide subsystem developers with appropriate interfaces with excavation subsystems and downstream processes, and assessing the overall feasibility of each excavation technique, power architecture, and logistical timeframe. References: [1] Carlson, A. et. al. (2024) ICES. [2] Zacny, K., et. al. (2024) “ASCE Earth and Space”. [3] McCormick, R., et. Al. (2024) IEEE Xplore.

ISRU↗

Statistical abstraction of high-fidelity CO2 pressure histories in 2-D, uniform, cylindrical domains

Long-term, deep, geologic sequestration of carbon dioxide (CO{sub 2}) is being evaluated as a world-wide strategy for limiting anthropogenic carbon emissions to the atmosphere. A key element of this evaluation is quantification of the ancillary risks associated with this fundamentally new linkage between the global energy economy and the subsurface ecosphere. Quantitative risk assessment methods traditionally enumerate operational scenarios and describe the multiple physical responses that may ensue from each scenario depending on the quality of information that is available to describe identified system dependencies. For example, multiplepoint injection of compressed CO{sub 2} into a geologic reservoir having a nominal stratigraphy will create a pressurized zone of liquid that migrates through the rock. Scenarios that postulate CO{sub 2} encountering previously undetected wells or natural fractures in the caprock that represent leakage paths to the surface must be treated in a probabilistic format that accommodates unknown details in the subsurface geology. Fluid pressure in the reservoir at the location of the potential transport path drives any potential leakage that might occur, so the spatial and temporal distribution of CO{sub 2} overpressure represents an important metric for numeric simulation. State-of-the-art geologic transport models like FEHM, TUFF, and ECLIPSE (Refs. 1, 2, 3) can accurately simulate multi phase gas migration in a fully characterized geologic domain. However, each simulation can require time periods ranging between minutes and hours to achieve acceptable numerical performance, so it is often impractical to link predictive physics models directly in a quantitative risk assessment that will require transport estimates for thousands of scenarios. When direct computation is not possible, a library of high-fidelity calculations can sometimes be distilled to a simplified statistical correlation that spans the variability in all relevant input parameters while retaining acceptable accuracy in the key predicted qu antities. Essentially, numerical calculations can be used as data for an exploratory trend analysis just as one might regress predictive equations against laboratory measurements to determine unknown parameter values. Statistical correlations are derived here to reproduce radial overpressure as a function of time and position for CO{sub 2} injected along the centerline of cylindrical geologic domains. FEHM was used to compute two-phase pressure histories in a suite of simulations that varied (1) initial pressure, (2) vertical reservoir thickness, (3) domain radius, (4) uniform permeability, and (5) mass injection rate. The simulations include both a 50-yr injection phase and a 50-yr relaxation phase. The correlations are based on a two-step fitting paradigm that first captures the shape of an entire radial pressure profile for a given time and input condition, and then correlates the shape parameters as generalized power products of 6 dimensionless parameters. Estimated overpressures are accurate within a factor of 1.25 compared to the suite of simulated values. The correlations can be used to evaluate rapidly local temporal overpressure for any continuous values within the defined space of input parameters. Inversion of the pressure correlation is also demonstrated to determine the maximum injection rate corresponding to an assumed limiting fracture pressure.

54 ENVIRONMENTAL SCIENCES↗

Simultaneous beta and gamma spectroscopy

A phoswich radiation detector for simultaneous spectroscopy of beta rays and gamma rays includes three scintillators with different decay time characteristics. Two of the three scintillators are used for beta detection and the third scintillator is used for gamma detection. A pulse induced by an interaction of radiation with the detector is digitally analyzed to classify the type of event as beta, gamma, or unknown. A pulse is classified as a beta event if the pulse originated from just the first scintillator alone or from just the first and the second scintillator. A pulse from just the third scintillator is recorded as gamma event. Other pulses are rejected as unknown events.

Farsoni, Abdollah T↗

Tune-stabilized, non-scaling, fixed-field, alternating gradient accelerator

A FFAG is a particle accelerator having turning magnets with a linear field gradient for confinement and a large edge angle to compensate for acceleration. FODO cells contain focus magnets and defocus magnets that are specified by a number of parameters. A set of seven equations, called the FFAG equations relate the parameters to one another. A set of constraints, call the FFAG constraints, constrain the FFAG equations. Selecting a few parameters, such as injection momentum, extraction momentum, and drift distance reduces the number of unknown parameters to seven. Seven equations with seven unknowns can be solved to yield the values for all the parameters and to thereby fully specify a FFAG.

43 PARTICLE ACCELERATORS↗

Using the Schur Complement to Reduce Runtime in KULL's Magnetic Diffusion Package

Recently a Resistive Magnetohydrodynamics (MHD) package has been added to the KULL code. In order to be compatible with the underlying hydrodynamics algorithm, a new sub-zonal magnetics discretization was developed that supports arbitrary polygonal and polyhedral zones. This flexibility comes at the cost of many more unknowns per zone - approximately ten times more for a hexahedral mesh. We can eliminate some (or all, depending on the dimensionality) of the extra unknowns from the global matrix during assembly by using a Schur complement approach. This trades expensive global work for cache-friendly local work, while still allowing solution for the full system. Significant improvements in the solution time are observed for several test problems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Using a two-step matrix solution to reduce the run time in KULL's magnetic diffusion package

Recently a Resistive Magnetohydrodynamics (MHD) package has been added to the KULL code. In order to be compatible with the underlying hydrodynamics algorithm, a new sub-zonal magnetics discretization was developed that supports arbitrary polygonal and polyhedral zones. This flexibility comes at the cost of many more unknowns per zone - approximately ten times more for a hexahedral mesh. We can eliminate some (or all, depending on the dimensionality) of the extra unknowns from the global matrix during assembly by using a Schur complement approach. This trades expensive global work for cache-friendly local work, while still allowing solution for the full system. Significant improvements in the solution time are observed for several test problems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Structural Basis for the Assembly and Gate Closure Mechanisms of the Mycobacterium tuberculosis 20S Proteasome

Mycobacterium tuberculosis (Mtb) possesses a proteasome system analogous to the eukaryotic ubiquitin-proteasome pathway. Mtb requires the proteasome to resist killing by the host immune system. The detailed assembly process and the gating mechanism of Mtb proteasome have remained unknown. Using cryo-electron microscopy and X-ray crystallography, we have obtained structures of three Mtb proteasome assembly intermediates, showing conformational changes during assembly, and explaining why the {beta}-subunit propeptide inhibits rather than promotes assembly. Although the eukaryotic proteasome core particles close their protein substrate entrance gates with different amino terminal peptides of the seven {alpha}-subunits, it has been unknown how a prokaryotic proteasome might close the gate at the symmetry axis with seven identical peptides. We found in the new Mtb proteasome crystal structure that the gate is tightly sealed by the seven identical peptides taking on three distinct conformations. Our work provides the structural bases for assembly and gating mechanisms of the Mtb proteasome.

59 BASIC BIOLOGICAL SCIENCES↗

Poker Face of Inelastic Dark Matter: Prospects at Upcoming Direct Detection Experiments

The XENON100 and CRESST experiments will directly test the inelastic dark matter explanation for DAMA's 8.9{sigma} anomaly. This article discusses how predictions for direct detection experiments depend on uncertainties in quenching factor measurements, the dark matter interaction with the Standard Model and the halo velocity distribution. When these uncertainties are accounted for, an order of magnitude variation is found in the number of expected events at CRESST and XENON100. The process of testing the DAMA anomaly highlights many of the challenges inherent to direct detection experiments. In addition to determining the properties of the unknown dark matter particle, direct detection experiments must also consider the unknown flux of the incident dark matter, as well as uncertainties in converting a signal from one target nucleus to another. The predictions for both the CRESST 2009 run and XENON100 2010 run show an order of magnitude uncertainty. The nuclear form factor for {sup 184}W, when combined with additional theoretical and experimental uncertainties, will likely prevent CRESST from refuting the iDM hypothesis with an exposure of {Omicron}(100 kg-d) in a model-independent manner. XENON100, on the other hand, will be able to make a definitive statement about a spin-independent, inelastically scattering dark matter candidate. Still, the CRESST 2009 data can potentially confirm iDM for a large range of parameter space. In case of a positive signal, the combined data from CRESST and XENON100 will start probing the properties of the Milky Way DM profile and the interaction of the SM with the dark matter.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

GLAST And Dark Matter Substructure in the Milky Way

We discuss the possibility of GLAST detecting gamma-rays from the annihilation of neutralino dark matter in the Galactic halo. We have used 'Via Lactea', currently the highest resolution simulation of cold dark matter substructure, to quantify the contribution of subhalos to the annihilation signal. We present a simulated allsky map of the expected gamma-ray counts from dark matter annihilation, assuming standard values of particle mass and cross section. In this case GLAST should be able to detect the Galactic center and several individual subhalos. One of the most exciting discoveries that the Gamma-ray Large Area Space Telescope (GLAST) could make, is the detection of gamma-rays from the annihilation of dark matter (DM). Such a measurement would directly address one of the major physics problems of our time: the nature of the DM particle. Whether or not GLAST will actually detect a DM annihilation signal depends on both unknown particle physics and unknown astrophysics theory. Particle physics uncertainties include the type of particle (axion, neutralino, Kaluza-Klein particle, etc.), its mass, and its interaction cross section. From the astrophysical side it appears that DM is not smoothly distributed throughout the Galaxy halo, but instead exhibits abundant clumpy substructure, in the form of thousands of so-called subhalos. The observability of DM annihilation radiation originating in Galactic DM subhalos depends on their abundance, distribution, and internal properties. Numerical simulations have been used in the past to estimate the annihilation flux from DM substructure, but since the subhalo properties, especially their central density profile, which determines their annihilation luminosity, are very sensitive to numerical resolution, it makes sense to re-examine their contribution with higher resolution simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Comprehensive Study of Nanometer Resolution of the IPBPM at ATF2

High-resolution beam position monitors (IPBPMs) have been developed in order to measure the electron beam position at the focus point of ATF2 to a few nanometers in the vertical plane. To date, the IPBPM system has operated in test mode with a highest demonstrated resolution of 8.7 nm in the ATF extraction line during 2008. After expected noise source calculations there still remains 7.9 nm of noise of unexplained origin. We summarize the experimental work on the IPBPM system since this measurement and outline the possible origins of these sources. We then present a study plan to be performed at the ATF2 facility designed to identify and to improve the resolution performance and comment on the expected ultimate resolution of this system. The Accelerator Test Facility 2 (ATF2) is a test beamline for ILC final focus system in the framework of the ATF international collaboration which was constructed to extend the extraction line at ATF, located at KEK, Japan. There are two goals of the ATF2: firstly to demonstrate focusing to 37 nm vertical beam size, secondly to achieve a few nanometer level beam orbit stability at the focus point in the vertical plane. High-resolution beam position monitors (IPBPMs) for the interaction point (IP) have been developed in order to measure the electron beam position at the focus point of the ATF2 to a few nanometers in the vertical plane. The previous measured position resolution of IPBPMs was 8.7 nm for a 0.68 x 10{sup 10} e/bunch beam with a dynamic range of 5 {mu}m. The intrinsic noise of the system was estimated to be 2.6 nm at 10{sup 10} e/bunch. It is scaled to 3.8 nm at 0.68 x 10{sup 10} e/bunch which means that 7.9 nm of unknown noise remains. The origin of the unknown noise must be studied in order to improve the resolution. This paper describes the ongoing work to improve the resolution of IPBPMs.

43 PARTICLE ACCELERATORS↗

Multiple target detection in video using quadratic multi-frame correlation filtering

Most integrated target detection and tracking systems employ state-space models to keep track of an explicit number o findividual targets. Recently, a non-state-space framework was developed for enhancing target detection in video by applying probabilistic motion models to the soft information in correlation outputs before thresholding. This framework has been referred to as multi-frame correlation ltering (MFCF), and because it avoids the use of state-space models and the formation of explicit tracks, the framework is well-suited for handling scenes with unknown numbers of targets at unknown positions. In this paper, we propose to use quadratic correlation lters(QCFs)in the MFCF framework for robust target detection. We test our detection algorithm on real and synthe sized single-target and multi-target video sequences. Simulation results show that MFCF can signi cantly reduce (to zero in the best case) the false alarm rates of QCFs at detection rates above 95%in the presence of large amounts of uncorrelated noise. We also show that MFCF is more adept at rejecting those false peaks due to uncorrelated noise rather than those due to clutter and compression noise; consequently, we show that lters used in the framework should be made to favor clutter rejection over noise tolerance.

Kerekes, Ryan A↗