Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Network Uncertainty Quantification for Analysis of Multi-Component Systems

To impact physical mechanical system design decisions and realize the full promise of high-fidelity computational tools, simulation results must be integrated at the earliest stages of the design process. This is particularly challenging when dealing with uncertainty and optimizing for system-level performance metrics, as full-system models (often notoriously expensive and time-consuming to develop) are generally required to propagate uncertainties to system-level quantities of interest. Methods for propagating parameter and boundary condition uncertainty in networks of interconnected components hold promise for enabling design under uncertainty in real-world applications. These methods avoid the need for time consuming mesh generation of full-system geometries when changes are made to components or subassemblies. Additionally, they explicitly tie full-system model predictions to component/subassembly validation data which is valuable for qualification. These methods work by leveraging the fact that many engineered systems are inherently modular, being comprised of a hierarchy of components and subassemblies that are individually modified or replaced to define new system designs. By doing so, these methods enable rapid model development and the incorporation of uncertainty quantification earlier in the design process. The resulting formulation of the uncertainty propagation problem is iterative. We express the system model as a network of interconnected component models, which exchange solution information at component boundaries. We present a pair of approaches for propagating uncertainty in this type of decomposed system and provide implementations in the form of an open-source software library. We demonstrate these tools on a variety of applications and demonstrate the impact of problem-specific details on the performance and accuracy of the resulting UQ analysis. This work represents the most comprehensive investigation of these network uncertainty propagation methods to date.

42 ENGINEERING↗
DOE OSTI2023

Uncertainty quantification of bank vegetation impacts on the flood flow field in the American River, California, using large‐eddy simulations

Bank vegetation plays a key role in both hydrodynamics and morphodynamics of natural rivers; however, these effects are often unaccounted for in the computational flow dynamics of natural waterways. Recent studies using the large‐eddy simulation (LES), however, have attempted to gain insights into the impacts of bank vegetation on the mean flow field of the natural rivers using a vegetation model, which applies a sink term to the momentum equations of motion. This approach accounts for the effects of the vegetation and provides a practical approach to account for the complex patches of bank vegetation in large‐scale rivers. To implement the vegetation model, a drag coefficient reflecting the overall resistance of vegetal structures to the flow is needed, but due to the lack of calibrated data and range of size, density and type of vegetation, this parameter can be a significant source of uncertainty in the model results. Here, in this study, we use uncertainty quantification (UQ) to investigate the hydrodynamics and bed shear results when a bank vegetation is incorporated in an LES model. To this end, we used the polynomial chaos expansion and Monte Carlo sampling techniques to determine the uncertainties associated with the drag coefficient in the vegetation model and from uncertainties in the bed roughness and inflow discharge. The UQ analysis provided spatially varying confidence levels for the spanwise and vertical distribution of velocity magnitude and for the bed shear stress distributions. In addition, Sobol indices were computed to indicate the relative influence that each parameter had on the overall uncertainty. In general, it was found that uncertainty in flow discharge was the dominant source of uncertainty; however, the drag coefficient in the vegetation model and the bed roughness parameter also made significant contribution to the uncertainty near the banks and bed, respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Updates to the Regional Seismic Travel Time (RSTT) Model: 2. Path-dependent Travel-time Uncertainty

Abstract The regional seismic travel time (RSTT) model and software were developed to improve travel-time prediction accuracy by accounting for three-dimensional crust and upper mantle structure. Travel-time uncertainty estimates are used in the process of associating seismic phases to events and to accurately calculate location uncertainty bounds (i.e. event location error ellipses). We improve on the current distance-dependent uncertainty parameterization for RSTT using a random effects model to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The random effects model separates the error between observed slowness and model predicted slowness into bias and random components. The path-specific travel-time uncertainty is calculated by integrating these mean squared errors along a seismic-phase ray path. We demonstrate that event location error ellipses computed for a 90% coverage ellipse metric (used by the Comprehensive Nuclear-Test-Ban Treaty Organization International Data Centre (IDC)), and using the path-specific travel-time uncertainty approach, are more representative (median 82.5% ellipse percentage) of true location error than error ellipses computed using distance-dependent travel-time uncertainties (median 70.1%). We also demonstrate measurable improvement in location uncertainties using the RSTT method compared to the current station correction approach used at the IDC (median 74.3% coverage ellipse).

58 GEOSCIENCES↗
DOE OSTI2021

Sensitive parameter identification and uncertainty quantification for the stability of pipeline conveying fluid

In this study, several uncertainty quantification and sensitivity analysis methods are used to determine the most sensitive geometric and material input parameters of a cantilevered pipeline conveying fluid when uncertainty is introduced to the system at the onset of instability. The full nonlinear equations of motion are modeled using the extended Hamilton’s principle and then discretized using Galerkin’s method. A parametric study is first performed, and the Morris elementary effects are calculated to obtain a preliminary understanding of how the onset speed changes when each parameter is introduced to a ± 5% uncertainty. Then, four different input uncertainty distributions, mainly, uniform and Gaussian distribution, are chosen to investigate how input distributions affect uncertainty in the output. A convergence analysis is used to determine the number of samples needed to maintain simulation accuracy while saving the most computational time. Then, Monte Carlo simulations are run, and the output distributions for each input distribution at ± 1%, ± 3% and ± 5% input uncertainty range are found and discussed. Additionally, the Pearson correlation coefficients are evaluated for different uncertainty ranges. A final Monte Carlo study is performed in which single parameters are held constant while all others still have uncertainty. Overall, the flow speed at the onset of instability is the most sensitive to changes in the outer diameter of the pipe.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Propagation of Noise Uncertainty Through Virtual Strain Gauge Formulations for 2D Digital Image Correlation

The effect of displacement uncertainty is examined on 2-dimensional strain, calculated using linear surfaces fitted to the displacement field. A classical engineering error propagation method is used to calculate uncertainty in Green-Lagrangian strain calculations. The derived uncertainty is compared to a Monte Carlo simulation and discrepancies under 2% are seen between these two methods. The effect of virtual strain gauge size, displacement uncertainty, and boundaries on the region of interest on the strain uncertainty are considered. Here, an exponential decay relationship is observed between strain uncertainty and virtual strain gauge size, while a linear relationship is seen between strain and displacement uncertainty. For boundaries in the region of interest, strain uncertainty is affected by the reduced number of points available to perform the regression.

42 ENGINEERING↗
DOE OSTI2025

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗
DOE OSTI2023

Visualization and Decision Making Design Under Uncertainty

Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.

data models↗
DOE OSTI2026

MAGIC: M arching Cubes Isosurface Uncertainty Visualization for G auss i an Uncertain Data With Spatial C orrelation

Here, in this paper, we study the propagation of data uncertainty through the marching cubes algorithm for isosurface visualization for correlated uncertain data. Consideration of correlation has been shown paramount for avoiding errors in uncertainty quantification and visualization in multiple prior studies. Although the problem of isosurface uncertainty with spatial data correlation has been previously addressed, there are two major limitations to prior treatments. First, there are no analytical formulations for uncertainty quantification of isosurfaces when the data uncertainty is characterized by a Gaussian distribution with spatial correlation. Second, as a consequence of the lack of analytical formulations,existing techniques resort to a Monte Carlo sampling approach, which is expensive and difficult to integrate into visualization tools. To address these limitations, we present a closed-form framework to efficiently derive uncertainty in marching cubes level-sets for Gaussian uncertain data with spatial correlation (MAGIC). To derive closed-form solutions, we leverage the Hinkley's derivation on the ratio of Gaussian distributions. With our analytical framework, we achieve a significant speed-up and enhanced accuracy of uncertainty quantification over classical Monte Carlo methods. We further accelerate our analytical solutions using many-core processors to achieve speed-ups up to 585× and integrability with production visualization tools for broader impact. We demonstrate the effectiveness of our correlation-aware uncertainty framework through experiments on meteorology, urban flow, and astrophysics simulation datasets.

Gaussian↗
DOE OSTI2022

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2016

Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A detailed description of the Monte Carlo method as applied for this analysis is provided. Detailed uncertainty results for the uncertainty in average free stream Mach number as well as other variables of interest are provided. All results are presented as random (variation in observed values about a true value), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty. The largest sources contributing to uncertainty are determined and potential improvement opportunities for the facility are investigated.

Error↗
NASA NTRS2021

Measurement Uncertainty Analysis of 6x9 Icing Research Tunnel (IRT)

This paper presents the results of the measurement uncertainty analysis that was performed on the aero-thermal characteristics of the 6- by 9-Foot Icing Research Tunnel (IRT) at the NASA Glenn Research Center. The engineering judgments and statistical methods used to determine the elemental uncertainties are described. Instrumentation uncertainty was quanti ed using MANTUS (Measurement Analysis Tool for Uncertainty in Systems) and instrument speci cation sheets. The Monte Carlo method was used to propagate systematic components of uncertainty in order to quantify the uncertainty of the Variables of Interest (VOI). A detailed description of the Monte Carlo method and the MANTUS tool can be found in the Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel report [1]. Detailed uncertainty results for test section airspeed and temperature as well as other variables of interest are described within this document.

6x9 Icing Research Tunnel↗
NASA NTRS2021

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗
NASA NTRS2023

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗
NASA NTRSDate not supplied

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗
DOE OSTI2023

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗
DOE OSTI2022

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗
DOE OSTI2025

Identifying high-impact and high-uncertainty parameters in MiniFuel model predictions

The MiniFuel irradiation platform at Oak Ridge National Laboratory's High Flux Isotope Reactor (HFIR) is a flexible, high-throughput separate effects test capability. Finite element thermal models are relied upon to design MiniFuel experiments and to achieve experimental objectives. Recent reports show good agreement in the model prediction of target fuel temperatures, but as the capability of the experiments is extended to higher temperatures, the uncertainty in the model predictions must be quantified. To that end, high-impact, high-uncertainty parameters that contribute the most uncertainty to the model are identified. The uncertainty quantification was accomplished through a series of screening and sensitivity analyses. The first analysis utilizes the method of Morris to perform a computationally efficient preliminary screening that considers uncertainty in a large number of the model inputs. The most important parameters identified in the Morris screening study were then considered in a Sobol sensitivity analysis that more robustly ranks and quantifies the uncertainty associated with each parameter. From these analyses, it was determined that thermal contact conductance between components is the parameter that contributes the highest uncertainty. The estimated uncertainty of the MiniFuel model fuel temperature predictions is ±80 °C in the removable beryllium and ±40 °C in the vertical experiment facilities. In conclusion, the framework established by the series of sensitivity analyses presented herein could easily be adapted to fit the needs of accelerated fuel qualification processes.

Fuel, Irradiation↗
DOE OSTI2021

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗