Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “process uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗

XANES spectroscopy of sulfides stable under reducing conditions

X-ray absorption near-edge structure (XANES) spectroscopy is a powerful technique to quantitatively investigate sulfur speciation in geologically complex materials such as minerals, glasses, soils, organic compounds, industrial slags, and extraterrestrial materials. This technique allows non-destructive investigation of the coordination chemistry and oxidation state of sulfur species ranging from sulfide (2–oxidation state) to sulfate (6+ oxidation state). Each sulfur species has a unique spectral shape with a characteristic K-edge representing the s → p and d hybridization photoelectron transitions. As such, sulfur speciation is used to measure the oxidation state of samples by comparing the overall XANES spectra to that of reference compounds. Although many S XANES spectral standards exist for terrestrial applications under oxidized conditions, new sulfide standards are needed to investigate reduced (oxygen fugacity, f O 2 , below IW) silicate systems relevant for studies of extraterrestrial materials and systems. Sulfides found in certain meteorites (e.g., enstatite chondrites and aubrites) and predicted to exist on Mercury, such as CaS (oldhamite), MgS (niningerite), and FeCr 2 S 4 (daubréelite), are stable at f O 2 below IW-3 but rapidly oxidize to sulfate and/or produce sulfurous gases under terrestrial surface conditions. XANES spectra of these compounds collected to date have been of variable quality, possibly due to the unstable nature of certain sulfides under typical (e.g., oxidizing) laboratory conditions. A new set of compounds was prepared for this study and their XANES spectra are analyzed for comparison with potential extraterrestrial analogs. S K -edge XANES spectra were collected at Argonne National Lab for FeS (troilite), MnS (alabandite), CaS (oldhamite), MgS (niningerite), Ni 1–x S, NiS 2 , CaSO 4 (anhydrite), MgSO 4 , FeSO 4 , Fe 2 (SO 4 ) 3 , FeCr 2 S 4 (daubréelite), Na 2 S, Al 2 S 3 , Ni 7 S 6 , and Ni 3 S 2 ; the latter five were analyzed for the first time using XANES. These standards expand upon the existing S XANES end-member libraries at a higher spectral resolution (0.25 eV steps) near the S K -edge. Processed spectra, those that have been normalized and “flattened,” are compared to quantify uncertainties due to data processing methods. Future investigations that require well-characterized sulfide standards, such as the ones presented here, may have important implications for understanding sulfur speciation in reduced silicate glasses and minerals with applications for the early Earth, Moon, Mercury, and enstatite chondrites.

Anzures, Brendan A.↗

The heliopause

A Pioneer or Voyager spacecraft will soon pass through one of the last major frontiers in the solar system - the heliospheric terminal shock. Some unknown, but perhaps small, distance beyond the terminal shock is the heliopause, marking the final boundary between solar-wind and Galactic plasmas and the final goal of these spacecraft. This occasion offers an opportunity to obtain a wealth of information on the properties of the Galaxy, the interstellar medium, and the large-scale interactions of that medium with stellar winds. Several tentative remote detections of the shock place it just beyond the present spacecraft locations. However, uncertainties in the physical processes and parameters that determine the location of the boundary lead to equal uncertainties in predicting which of the spacecraft will reach it first.

Suess, Steven T.↗

Numerical simulation of asteroid geometry variance on airburst threat

For an atmospheric airburst the primary source of concern when assessing uncertainty is the size and velocity. Determining these properties provides the basis for threat assessment, as the total energy of the asteroid may then be estimated, and the threat investigated thoroughly. Even with clarity as to how much energy an asteroid may deposit, a great deal of uncertainty still exists for the actual energy deposition process. One such source of uncertainty is the geometry of the incoming asteroid. The geometry of an asteroid will alter the stress distribution during entry, which adds uncertainty to when fracture will occur. Here, in this study, we use Smoothed Particle Hydrodynamics to model the atmospheric airburst of Tunguska-scale asteroids with varying geometric profiles, including a sphere, ellipsoid, binary and superellipsoid. Each asteroid is modeled as a homogenous structure with strength. We assess uncertainty through a series of planar 2D simulation cases for each geometry, comparing the source of stochasticity across geometries. A single 3D airburst simulation for each geometry is also analyzed. Additionally, the 3D cases are compared to the highly uncertain Tunguska event, predicting variance in burst height across geometries, but all bounded by theoretical burst heights proposed for Tunguska.

Airburst↗

Micro-Pulse Lidar Signals: Uncertainty Analysis

Micro-pulse lidar (MPL) systems are small, autonomous, eye-safe lidars used for continuous observations of the vertical distribution of cloud and aerosol layers. Since the construction of the first MPL in 1993, procedures have been developed to correct for various instrument effects present in MPL signals. The primary instrument effects include afterpulse, laser-detector cross-talk, and overlap, poor near-range (less than 6 km) focusing. The accurate correction of both afterpulse and overlap effects are required to study both clouds and aerosols. Furthermore, the outgoing energy of the laser pulses and the statistical uncertainty of the MPL detector must also be correctly determined in order to assess the accuracy of MPL observations. The uncertainties associated with the afterpulse, overlap, pulse energy, detector noise, and all remaining quantities affecting measured MPL signals, are determined in this study. The uncertainties are propagated through the entire MPL correction process to give a net uncertainty on the final corrected MPL signal. The results show that in the near range, the overlap uncertainty dominates. At altitudes above the overlap region, the dominant source of uncertainty is caused by uncertainty in the pulse energy. However, if the laser energy is low, then during mid-day, high solar background levels can significantly reduce the signal-to-noise of the detector. In such a case, the statistical uncertainty of the detector count rate becomes dominant at altitudes above the overlap region.

Welton, Ellsworth J.↗

Physics-Informed Gaussian Process Inference of Liquid Structure from Scattering Data

We present a nonparametric Bayesian framework to infer radial distribution functions from experimental scattering measurements with uncertainty quantification using nonstationary Gaussian processes. The Gaussian process prior mean and kernel functions are designed to mitigate well-known numerical challenges with the Fourier transform, including discrete measurement binning and detector windowing, while encoding fundamental yet minimal physical knowledge of the liquid structure. We demonstrate uncertainty propagation of the Gaussian process posterior to unmeasured quantities of interest. Experimental radial distribution functions of liquid argon and water with uncertainty quantification are provided as both a proof of principle for the method and a benchmark for molecular models.

Chemical structure↗

Satellite stratospheric aerosol measurement validation

The validity of the stratospheric aerosol measurements made by the satellite sensors SAM II and SAGE was tested by comparing their results with each other and with results obtained by other techniques (lider, dustsonde, filter, and impactor). The latter type of comparison required the development of special techniques that convert the quantity measured by the correlative sensor (e.g. particle backscatter, number, or mass) to that measured by the satellite sensor (extinction) and quantitatively estimate the uncertainty in the conversion process. The results of both types of comparisons show agreement within the measurement and conversion uncertainties. Moreover, the satellite uncertainty is small compared to aerosol natural variability (caused by seasonal changes, volcanoes, sudden warmings, and vortex structure). It was concluded that the satellite measurements are valid.

Russell, P. B.↗

Satellite stratospheric aerosol measurement validation

The validity of the stratospheric aerosol measurements made by the satellite sensors SAM II and SAGE was tested by comparing their results with each other and with results obtained by other techniques (lider, dustsonde, filter, and impactor). The latter type of comparison required the development of special techniques that convert the quantity measured by the correlative sensor (e.g., particle backscatter, number, or mass) to that measured by the satellite sensor (extinction) and quantitatively estimate the uncertainty in the conversion process. The results of both types of comparisons show agreement within the measurement and conversion uncertainties. Moreover, the satellite uncertainty is small compared to aerosol natural variability (caused by seasonal changes, volcanoes, sudden warmings, and vortex structure). It was concluded that the satellite measurements are valid.

Russell, P. B.↗

Space Shuttle ET Friction Stir Weld Machines

NASA and Lockheed-Martin approached the FSW machine vendor community with a specification for longitudinal barrel production FSW weld machines and a shorter travel process development machine in June of 2000. This specification was based on three years of FSW process development on the Space Shuttle External Tank alloys, AL2 195-T8M4 and AL22 19-T87. The primary motivations for changing the ET longitudinal welds from the existing variable polarity Plasma Arc plasma weld process included: (1) Significantly reduced weld defect rates and related reduction in cycle time and uncertainty; (2) Many fewer process variables to control (5 vs. 17); (3) Fewer manufacturing steps; (4) Lower residual stresses and distortion; (5) Improved weld strengths, particularly at cryogenic temperatures; (6) Fewer hazards to production personnel. General Tool was the successful bidder. The equipment is at this writing installed and welding flight hardware. This paper is a means of sharing with the rest of the FSW community the unique features developed to assure NASA/L-M of successful production welds.

Thompson, Jack M.↗

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗

Soil thickness map at two hillslopes near the pumphouse in the east river watershed, Colorado

The soil thickness maps were created by using a hybrid model-data approach. Field sampling and remote sensing data of the spatial distribution of two hillslopes in the Pump House area in the East River Watershed in the CO., the U.S. The data package includes the geospatial data of the soil thickness maps at two hillslopes near the pumphouse, and the associated remote sensing data, including lidar DEM and a shape file of the boundary of the study area. The data can be viewed in GIS software such as QGIS or ArcGIS desktop. The geospatial data can also be viewed in Python or Matlab. The data were generated for the purpose of modeling surface hydrology and near-surface chemistry. This work shows how to combine sampling data and a process-based model to predict one of the highest uncertainty in the land surface process, the soil thickness.

2D Geospatial Maps↗

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗

Tidal Turbine Benchmarking Project: Stage I - Steady Flow Blind Predictions: Preprint

This paper presents the first blind prediction stage of the Tidal Turbine Benchmarking Project being conducted and funded by the UK's EPSRC and Supergen ORE Hub. In this first stage, only steady flow conditions, at low and elevated turbulence (3.1%) levels, were considered. Prior to the blind prediction stage, a large laboratory scale experiment was conducted in which a highly instrumented 1.6m diameter tidal rotor was towed through a large towing tank in well-defined flow conditions with and without an upstream turbulence grid. Details of the test campaign and rotor design were released as part of this community blind prediction exercise. Participants were invited to use a range of engineering modelling approaches to simulate the performance and loads of the turbine. 26 submissions were received from 12 groups from across academia and industry using solution techniques ranging from blade resolved computational fluid dynamics through actuator line, boundary integral element methods, vortex methods to engineering Blade Element Momentum methods. The comparisons between experiments and blind predictions were extremely positive helping to provide validation and uncertainty estimates for the models, but also validating the experimental tests themselves. The exercise demonstrated that the experimental turbine data provides a robust data set against which researchers and design engineers can test their models and implementations to ensure robustness in their processes, helping to reduce uncertainty and provide increased confidence in engineering processes. Furthermore, the data set provides the basis by which modellers can evaluate and refine approaches.

benchmarking↗

Adapting Covariance Propagation to Account for the Presence of Modeled and Unmodeled Maneuvers

This paper explores techniques that can be used to adapt the standard linearized propagation of an orbital covariance matrix to the case where there is a maneuver and an associated execution uncertainty. A Monte Carlo technique is used to construct a final orbital covariance matrix for a 'prop-burn-prop' process that takes into account initial state uncertainty and execution uncertainties in the maneuver magnitude. This final orbital covariance matrix is regarded as 'truth' and comparisons are made with three methods using modified linearized covariance propagation. The first method accounts for the maneuver by modeling its nominal effect within the state transition matrix but excludes the execution uncertainty by omitting a process noise matrix from the computation. The second method does not model the maneuver but includes a process noise matrix to account for the uncertainty in its magnitude. The third method, which is essentially a hybrid of the first two, includes the nominal portion of the maneuver via the state transition matrix and uses a process noise matrix to account for the magnitude uncertainty. The first method is unable to produce the final orbit covariance except in the case of zero maneuver uncertainty. The second method yields good accuracy for the final covariance matrix but fails to model the final orbital state accurately. Agreement between the simulated covariance data produced by this method and the Monte Carlo truth data fell within 0.5-2.5 percent over a range of maneuver sizes that span two orders of magnitude (0.1-20 m/s). The third method, which yields a combination of good accuracy in the computation of the final covariance matrix and correct accounting for the presence of the maneuver in the nominal orbit, is the best method for applications involving the computation of times of closest approach and the corresponding probability of collision, PC. However, applications for the two other methods exist and are briefly discussed. Although the process model ("prop-burn-prop") that was studied is very simple - point-mass gravitational effects due to the Earth combined with an impulsive delta-V in the velocity direction for the maneuver - generalizations to more complex scenarios, including high fidelity force models, finite duration maneuvers, and maneuver pointing errors, are straightforward and are discussed in the conclusion.

Schiff, Conrad↗

An Uncertainty Quantification Framework for Autonomous Flight System Tracking and Health Monitoring

This work proposes a perspective towards establishing a framework for uncertainty quantification of autonomous system tracking and health monitoring. The approach leverages the use of a predictive process structure, which maps uncertainty sources and their interaction according to the quantity of interest and the goal of the predictive estimation. It is systematic and uses basic elements that are system agnostic, and therefore needs to be tailored according to the specificity of the application. This work is motivated by the interest in low-altitude unmanned aerial vehicle operations, where awareness of vehicle and airspace state becomes more relevant as the density of autonomous operations grows rapidly. Predicted scenarios in the area of small vehicle operations and urban air mobility have no precedent, and holistic frameworks to perform prognostics and health management (PHM) at the system- and airspace-level are missing formal approaches to account for uncertainty. At the end of the paper, two case studies demonstrate implementation framework of trajectory tracking and health diagnosis for a small unmanned aerial vehicle. This work has been accepted for publication at the International Journal of Prognostics and Health Management Jan 2021. Minor edits have been incorporated to this original submission to incorporate complete overview and software integration.

Uncertainty Quantification↗