Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “process uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Recommended Practices in Thrust Measurements

Accurate, direct measurement of thrust or impulse is one of the most critical elements of electric thruster characterization, and one of the most difficult measurements to make. The American Institute of Aeronautics and Astronautics has started an initiative to develop standards for many important measurement processes in electric propulsion, including thrust measurements. This paper summarizes recommended practices for the design, calibration, and operation of pendulum thrust stands, which are widely recognized as the best approach for measuring micro N- to mN-level thrust and micro Ns-level impulse bits. The fundamentals of pendulum thrust stand operation are reviewed, along with its implementation in hanging pendulum, inverted pendulum, and torsional balance configurations. Methods of calibration and recommendations for calibration processes are presented. Sources of error are identified and methods for data processing and uncertainty analysis are discussed. This review is intended to be the first step toward a recommended practices document to help the community produce high quality thrust measurements.

microthrusters↗
NASA NTRS2016

Quantification of the Uncertainties for the Space Launch System Liftoff/Transition and Ascent Databases

A detailed description of the uncertainty quantification process for the Space Launch System Block 1 vehicle configuration liftoff/transition and ascent 6-Degree-of-Freedom (DOF) aerodynamic databases is presented. These databases were constructed from wind tunnel test data acquired in the NASA Langley Research Center 14- by 22-Foot Subsonic Wind Tunnel and the Boeing Polysonic Wind Tunnel in St. Louis, MO, respectively. The major sources of error for these databases were experimental error and database modeling errors.

Favaregh, Amber L.↗
NASA NTRS2019

Seasonal Dependence of SMAP Radiometer-Based Soil Moisture Performance as Observed over Core Validation Sites

The NASA SMAP (Soil Moisture Active Passive) mission provides a global coverage of soil moisture measurements based on its L-band microwave radiometer every 2-3 days at about 40 km resolution. The soil moisture retrieval algorithms model the brightness temperature as a function of soil moisture, surface conditions and vegetation. External data sources inform the algorithms about the surface conditions and vegetation, which enable the retrieval of soil moisture. The inversion process contains uncertainties related to radiometer measurements, forward model assumptions and ancillary data sources. This study focuses on the uncertainties that depend on the seasonal evolution of the surface conditions and vegetation. This study compares the SMAP and core validation site (CVS) soil moisture values over a period of three years to extract the evolution of performance metrics over time. The analysis showed that most CVS that include managed agriculture exhibit significant time-dependent seasonal bias. This bias was linked to seasonal temperature cycle, which is a proxy to several features that can cause seasonally dependent errors in the SMAP product.

core validation site↗
NASA NTRS2020

Demonstration of Deployment Accuracy of the Starshade Inner Disk Subsystem

We present experimental results that demonstrate the required in-plane deployment accuracy of the starshade Inner Disk Subsystem (IDS). This effort was to address Milestone 7C of the Starshade Technology Activity S5, which requires that the in-plane deployment accuracy of the petal interfaces on the IDS be within +/-300um. A full-scale 10m-diameter IDS prototype was constructed. This prototype comprised a medium-fidelity perimeter truss, medium-fidelity spokes, and a low-fidelity optical shield (OS). The testbed also included gravity compensation systems and a laser tracker metrology system. The post-processed measurement uncertainties of the laser tracker were less than 30um at the 3 sigma level. Design, engineering and fabrication of these components was done by JPL, Tendeg, and Roccor. Testing was performed at the Tendeg facility in Louisville, Colorado. The IDS prototype was deployed 22 times and the locations of petal interfaces on the IDS were measured after each deployment. Based on this data, tolerance intervals were calculated that would contain 99.73% of future deployment accuracy errors with 90% confidence. These tolerance intervals are conservative estimates for 3 sigma bounds. The tolerance intervals for the three pertinent error components were found to be within the required allocations, with at least 19% margin.

Turse, Dana↗
NASA NTRS2025

Gaussian Process for Flight Delay Prediction: Learning a Stochastic Process

This paper presents a machine-learning approach to predict flight delays. Whereas neural networks are extensively studied for predictive capabilities, they involve non-intuitive design and extensive analysis, particularly in training and optimization processes. Instead, the proposed framework employs Gaussian Processes as a supervised learning technique for flight delay prediction. This data-driven approach trains the model using prior information, specifically the mean and covariance tied to existing data. The proposed Gaussian Process Regression (GPR) model employs the day of flight as a pivotal feature for delay forecasting. We analyze flights from various routes and gauge the accuracy of the presented learning technique by comparing the predicted delays with the actual ones. Given the inherent challenges in precisely forecasting delays, we predict the delays with a 95 % confidence interval. Also, an error propagation analysis in the prediction horizon is carried out to determine the optimal time frame for prediction. The proposed method for flight delay prediction is important as airlines can strategize flight operations and issue timely advisories.

stochastic↗
NASA NTRS2019

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗
NASA NTRSDate not supplied

High Temperature Material Property Data and Challenges to Thermal Process Model Predictions and In-Situ/Ex-Situ Measurements for Metallic Additive Manufacturing

Understanding and predicting performance properties of parts produced by metallic additive manufacturing has improved significantly over the past decade; however, difficult to measure material properties and process outcomes continue to be challenges. The qualification or certification of aerospace parts require extensive measures to quantify variable part properties in order to buy down the risk of component failure. The variability, inherent to the additive manufacturing, process adds unwanted uncertainty in the production of load critical structural components. Process modeling has proven valuable in providing predictions and context for understanding outcomes of the additive manufacturing process; however, these physically informed process models require material properties at temperatures that are difficult to measure and rarely available. Further, calibrating or validating such models is difficult because the process itself is challenging to measure. This talk will explore some of the challenges resulting from difficult to acquire input data by relating thermal process model predictions to in-situ and ex-situ optical microscopy measurements.

Process Model↗
NASA NTRS1989

Evaluating Statistical Process Control (SPC) techniques and computing the uncertainty of force calibrations

In recent years there has been a push within NASA to use statistical techniques to improve the quality of production. Two areas where statistics are used are in establishing product and process quality control of flight hardware and in evaluating the uncertainty of calibration of instruments. The Flight Systems Quality Engineering branch is responsible for developing and assuring the quality of all flight hardware; the statistical process control methods employed are reviewed and evaluated. The Measurement Standards and Calibration Laboratory performs the calibration of all instruments used on-site at JSC as well as those used by all off-site contractors. These calibrations must be performed in such a way as to be traceable to national standards maintained by the National Institute of Standards and Technology, and they must meet a four-to-one ratio of the instrument specifications to calibrating standard uncertainty. In some instances this ratio is not met, and in these cases it is desirable to compute the exact uncertainty of the calibration and determine ways of reducing it. A particular example where this problem is encountered is with a machine which does automatic calibrations of force. The process of force calibration using the United Force Machine is described in detail. The sources of error are identified and quantified when possible. Suggestions for improvement are made.

Navard, Sharon E.↗
NASA NTRSDate not supplied

A Practical Approach to Uncertainty Quantification Using Probability Boxes

To date, while the use of CFD for aerospace vehicle design and development is prevalent, the documentation of uncertainties associated with the simulations are rare. Instead, the current state-of-the-art relies heavily on the experience of the CFD practitioner to estimate the uncertainty associated with their simulations through simple sensitivity studies or subject matter expertise. This practice will have to be replaced with a formal uncertainty quantification (UQ) process if CFD is to play an expanded role in the research and engineering design community, test and evaluation community, and ultimately certification for flight. Accounting for uncertainties in a formal manner is a tedious process. Moreover, the typical CFD practitioner is not likely to be familiar with formal UQ methods. These factors have prevented the adoption of UQ methods in the engineering design and development cycle. This presentation will outline a credible approach to UQ using Probability Boxes that is straightforward to apply, and can readily be automated using existing UQ tool sets such as the DAKOTA packaged developed at Sandia. The added expense incurred when moving away from a deterministic CFD process to a stochastic one that captures uncertainties to enable risk-informed decision making will be discussed, as well as effective ways to reduce the computational costs.

Uncertainty Quantification↗
NASA NTRS1997

Uncertain responses by humans and rhesus monkeys (Macaca mulatta) in a psychophysical same-different task

The authors asked whether animals, like humans, use an uncertain response adaptively to escape indeterminate stimulus relations. Humans and monkeys were placed in a same-different task, known to be challenging for animals. Its difficulty was increased further by reducing the size of the stimulus differences, thereby making many same and different trials difficult to tell apart. Monkeys do escape selectively from these threshold trials, even while coping with 7 absolute stimulus levels concurrently. Monkeys even adjust their response strategies on short time scales according to the local task conditions. Signal-detection and optimality analyses confirm the similarity of humans' and animals' performances. Whereas associative interpretations account poorly for these results, an intuitive uncertainty construct does so easily. The authors discuss the cognitive processes that allow uncertainty's adaptive use and recommend further comparative studies of metacognition.

NASA Discipline Space Human Factors↗
NASA NTRS2022

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗
NASA NTRSDate not supplied

Integrated Process-Structure-Property Simulations for Additive Manufacturing Using the Open-Source Materialite Package

The microstructure and properties of additively manufactured (AM) metals are strongly dependent on process conditions. Therefore, process-structure-property (PSP) simulations are a useful tool for exploring process parameter space, studying process variations, and quantifying uncertainty in material properties. However, integrating process-structure and structure-property simulations often involves connecting multiple software packages. Each package may use unique data structures and require substantial domain knowledge. This presentation demonstrates PSP simulation capabilities of Materialite, an open-source package developed at NASA Langley Research Center. Materialite simplifies model linkages by using a common data structure and model interface, enabling straightforward simulation across a PSP model chain. Physics-based models, including kinetic Monte Carlo and crystal plasticity, are implemented within the package. The model interface is also intended to simplify implementation of new models and enable integration with external simulation tools. Example use cases include uncertainty quantification with PSP models and GPU-accelerated powder bed fusion AM process models.

additive manufacturing↗
NASA NTRS2003

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗
NASA NTRSDate not supplied

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis↗
NASA NTRSDate not supplied

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis↗
NASA NTRS2016

Model-Based Fatigue Prognosis of Fiber-Reinforced Laminates Exhibiting Concurrent Damage Mechanisms

Prognostics of large composite structures is a topic of increasing interest in the field of structural health monitoring for aerospace, civil, and mechanical systems. Along with recent advancements in real-time structural health data acquisition and processing for damage detection and characterization, model-based stochastic methods for life prediction are showing promising results in the literature. Among various model-based approaches, particle-filtering algorithms are particularly capable in coping with uncertainties associated with the process. These include uncertainties about information on the damage extent and the inherent uncertainties of the damage propagation process. Some efforts have shown successful applications of particle filtering-based frameworks for predicting the matrix crack evolution and structural stiffness degradation caused by repetitive fatigue loads. Effects of other damage modes such as delamination, however, are not incorporated in these works. It is well established that delamination and matrix cracks not only co-exist in most laminate structures during the fatigue degradation process but also affect each other's progression. Furthermore, delamination significantly alters the stress-state in the laminates and accelerates the material degradation leading to catastrophic failure. Therefore, the work presented herein proposes a particle filtering-based framework for predicting a structure's remaining useful life with consideration of multiple co-existing damage-mechanisms. The framework uses an energy-based model from the composite modeling literature. The multiple damage-mode model has been shown to suitably estimate the energy release rate of cross-ply laminates as affected by matrix cracks and delamination modes. The model is also able to estimate the reduction in stiffness of the damaged laminate. This information is then used in the algorithms for life prediction capabilities. First, a brief summary of the energy-based damage model is provided. Then, the paper describes how the model is embedded within the prognostic framework and how the prognostics performance is assessed using observations from run-to-failure experiments

Prognostics↗
NASA NTRS2012

An Efficient Deterministic Approach to Model-based Prediction Uncertainty Estimation

Prognostics deals with the prediction of the end of life (EOL) of a system. EOL is a random variable, due to the presence of process noise and uncertainty in the future inputs to the system. Prognostics algorithm must account for this inherent uncertainty. In addition, these algorithms never know exactly the state of the system at the desired time of prediction, or the exact model describing the future evolution of the system, accumulating additional uncertainty into the predicted EOL. Prediction algorithms that do not account for these sources of uncertainty are misrepresenting the EOL and can lead to poor decisions based on their results. In this paper, we explore the impact of uncertainty in the prediction problem. We develop a general model-based prediction algorithm that incorporates these sources of uncertainty, and propose a novel approach to efficiently handle uncertainty in the future input trajectories of a system by using the unscented transformation. Using this approach, we are not only able to reduce the computational load but also estimate the bounds of uncertainty in a deterministic manner, which can be useful to consider during decision-making. Using a lithium-ion battery as a case study, we perform several simulation-based experiments to explore these issues, and validate the overall approach using experimental data from a battery testbed.

Daigle, Matthew J.↗