Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An Assessment of the Influence of Uncertainty in Temporally Evolving Streamflow Forecasts on Riverine Inundation Modeling

Continental-scale river forecasting platforms forecast streamflow at reaches that can be used as boundary conditions to drive a local-scale flood inundation model. Uncertainty accumulated during this process stems not only from any part of the forecasting chain but can also be caused by the daily variations in weather forcing that keeps evolving as the event advances. This work aims to examine the influence of the evolving forecast streamflow on predicting the maximum inundation for extreme floods. A diagnostic case study was made on the basis of a hindcast of Hurricane Matthew striking the eastern U.S. in 2016. The U.S. National Water Model was one-way coupled to a hydrodynamic inundation model through a developed automated workflow. Although the river forcing has significantly mismatched hydrographs versus observations, the simulated peak water surface elevations and maximum extents were validated to be comparable with the observations, which indicates that the inundation model may not be sensitive to the inherited uncertainty from the weather forcing. Moreover, the uncertainty of the forecast streamflow time series caused only one order of magnitude fewer variations in inundation prediction; this dampening effect may become clearer for extreme events with large areas inundated. In addition, the forecast total volume of stream discharge appears to be an important metric for assessing the performance of river forcing for inundation mapping, as a linear correlation between the total volume and the accuracy of the predicted peak water surface elevation and maximum extent was found, with the coefficients of determination all above 0.8. Extra best-practice experience of running similar operational tasks demonstrated the tradeoff between the cost and accuracy gain.

flood, national water model, RIFT↗
DOE OSTI2022

Model Coupling Through Learned Representations

Reliable climate predictions are important for making robust decisions in response to the changing climate. This project aims to reduce mis-modeling uncertainties arising from the representation of the land-atmosphere coupling in the Energy Exascale Earth System Model (E3SM) by using a machine learning approach. This approach will use an encoder-decoder architecture to represent the information that is developed in the land model and given to the atmosphere model. The simulated data will be taken from the E3SM simulation. However, the incorporation of observed data into the simulated dataset reduces mis-modeling uncertainties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Stochastic Framework for Optimal Control of Planetary Reentry Trajectories Under Multilevel Uncertainties

We present a novel stochastic optimal control framework that accounts for various types of uncertainties, with application to reentry trajectory planning. The formulation of the optimal trajectory control problem is presented in the context of an indirect method where a functional objective associated with the terminal vehicle speed is to be minimized. Uncertain input parameters in the optimal trajectory control model, including aerodynamic parameters and initial and terminal conditions, are modeled as aleatory random variables, while the statistical parameters of these aleatory distributions are themselves random variables. The parametric and model uncertainties are simultaneously propagated through an extended polynomial chaos expansion (EPCE) formalism. Several metrics are described to evaluate response statistics and presented as insightful tools for robust decision making. Specifically, the response probability density function (PDF) reflecting influence of both epistemic and aleatory uncertainties is obtained. By sampling over the random variables representing model error, an ensemble of response PDFs is generated and the associated failure probability is estimated as a random variable with its own polynomial chaos expansion. Besides, the sensitivity index functions of response PDF with respect to the statistical parameters are evaluated. Coupling parametric and model uncertainties within the EPCE framework leads to a robust and efficient paradigm for multilevel uncertainty propagation and PDF characterization in general optimal control problems.

Engineering↗
DOE OSTI2025

Optimization problems governed by systems of PDEs with uncertainties

This paper reviews current theoretical and numerical approaches to optimization problems governed by partial differential equations (PDEs) that depend on random variables or random fields. Such problems arise in many engineering, science, economics and societal decision-making tasks. This paper focuses on problems in which the governing PDEs are parametrized by the random variables/fields, and the decisions are made at the beginning and are not revised once uncertainty is revealed. Examples of such problems are presented to motivate the topic of this paper, and to illustrate the impact of different ways to model uncertainty in the formulations of the optimization problem and their impact on the solution. A linear–quadratic elliptic optimal control problem is used to provide a detailed discussion of the set-up for the risk-neutral optimization problem formulation, study the existence and characterization of its solution, and survey numerical methods for computing it. Different ways to model uncertainty in the PDE-constrained optimization problem are surveyed in an abstract setting, including risk measures, distributionally robust optimization formulations, probabilistic functions and chance constraints, and stochastic orders. Furthermore, approximation-based optimization approaches and stochastic methods for the solution of the large-scale PDE-constrained optimization problems under uncertainty are described. Some possible future research directions are outlined.

Heinkenschloss, Matthias [Rice Univ., Houston, TX ↗
DOE OSTI2020

A Bayesian framework for adsorption energy prediction on bimetallic alloy catalysts

Abstract For high-throughput screening of materials for heterogeneous catalysis, scaling relations provides an efficient scheme to estimate the chemisorption energies of hydrogenated species. However, conditioning on a single descriptor ignores the model uncertainty and leads to suboptimal prediction of the chemisorption energy. In this article, we extend the single descriptor linear scaling relation to a multi-descriptor linear regression models to leverage the correlation between adsorption energy of any two pair of adsorbates. With a large dataset, we use Bayesian Information Criteria (BIC) as the model evidence to select the best linear regression model. Furthermore, Gaussian Process Regression (GPR) based on the meaningful convolution of physical properties of the metal-adsorbate complex can be used to predict the baseline residual of the selected model. This integrated Bayesian model selection and Gaussian process regression, dubbed as residual learning, can achieve performance comparable to standard DFT error (0.1 eV) for most adsorbate system. For sparse and small datasets, we propose an ad hoc Bayesian Model Averaging (BMA) approach to make a robust prediction. With this Bayesian framework, we significantly reduce the model uncertainty and improve the prediction accuracy. The possibilities of the framework for high-throughput catalytic materials exploration in a realistic setting is illustrated using large and small sets of both dense and sparse simulated dataset generated from a public database of bimetallic alloys available in Catalysis-Hub.org.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Increasing Functional Diversity in a Global Land Surface Model Illustrates Uncertainties Related to Parameter Simplification

Abstract Simulations of the land surface carbon cycle typically compress functional diversity into a small set of plant functional types (PFT), with parameters defined by the average value of measurements of functional traits. In most earth system models, all wild plant life is represented by between five and 14 PFTs and a typical grid cell (≈100 × 100 km) may contain a single PFT. Model logic applied to this coarse representation of ecological functional diversity provides a reasonable proxy for the carbon cycle, but does not capture the non‐linear influence of functional traits on productivity. Here we show through simulations using the Energy Exascale Land Surface Model in 15 diverse terrestrial landscapes, that better accounting for functional diversity markedly alters predicted total carbon uptake. The shift in carbon uptake is as great as 30% and 10% in boreal and tropical regions, respectively, when compared to a single PFT parameterized with the trait means. The traits that best predict gross primary production vary based on vegetation phenology, which broadly determines where traits fall within the global distribution. Carbon uptake is more closely associated with specific leaf area for evergreen PFTs and the leaf carbon to nitrogen ratio in deciduous PFTs.

58 GEOSCIENCES↗
DOE OSTI2022

Creep anisotropy modeling and uncertainty quantification of an additively manufactured Ni-based superalloy

The advantages offered by additive manufacturing over traditional processes has driven a great deal of industrial and academic interest in recent years. However, the process is relatively new and requires additional investigation to become sufficiently mature for wide scale industrial adoption. Electron beam melting powder bed fusion is one technology that has shown promise for fabricating high temperature resistant materials such as nickel based superalloys. The resulting microstructures typically exhibit a strong fiber texture in the build direction giving rise to anisotropic time-dependent deformation behavior. In order to accelerate the qualification of these materials for industrial adoption accurate numerical models are needed for simulating their behavior. In this work a crystal plasticity model including non-Schmid effects is presented for capturing creep anisotropy observed in additively manufactured IN738LC. The model is calibrated via a probabilistic framework where model parameters are treated as random variables. An iterative sequential design strategy is utilized to efficiently identify the probability density of the unknown model parameters. As a case study the model is utilized to investigate the behavior of randomly oriented equiaxed grain clusters sometimes observed embedded in the additively manufactured columnar structure. A synthetic realization is simulated and uncertainty is propagated through to the full-field response. Results indicate that these features are the source of significant creep relaxation and strain accumulation which partially explains observed grain boundary decohesion at these locations.

36 MATERIALS SCIENCE↗
DOE OSTI2024

When do different scenarios of projected electricity demand start to meaningfully diverge?

Resource adequacy studies look at balancing electricity supply and demand on 10- to 15-year time horizons while asset investment planning typically evaluates returns on 20- to 40-year time horizons. Projections of electricity demand are factored into the decision-making in both cases. Climate, energy policy, and socioeconomic changes are key uncertainties known to influence electricity demands, but their relative importance for demands over the next 10-40 years is unclear. The power sector would benefit from a better understanding of the need to characterize these uncertainties for resource adequacy and investment planning. In this study, we quantify when projected United States (U.S.) electricity demands start to meaningfully diverge in response to a range of climate, energy policy, and socioeconomic drivers. Here we use a wide yet plausible range of 21st century scenarios for the U.S. The projections span two population/economic growth scenarios (Shared Socioeconomic Pathways 3 and 5) and two climate/energy policy scenarios, one including climate mitigation policies and one without (Representative Concentration Pathways 4.5 and 8.5). Each climate/energy policy scenario has two warming levels to reflect a range of climate model uncertainty. We show that the socioeconomic scenario matters almost immediately – within the next 10 years, the climate/policy scenario matters within 25-30 years, and the climate model uncertainty matters only after 50+ years. This work can inform the power sector working to integrate climate change uncertainties into their decision-making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Modeling with uncertainty quantification reveals the essentials of a non-canonical algal carbon-concentrating mechanism

The thermoacidophilic red alga Cyanidioschyzon merolae survives its challenging environment likely in part by operating a carbon-concentrating mechanism (CCM). Here, we demonstrated that C. merolae 's cellular affinity for CO 2 is stronger than the affinity of its rubisco for CO 2 . This finding provided additional evidence that C. merolae operates a CCM while lacking the structures and functions characteristic of CCMs in other organisms. To test how such a CCM could function, we created a mathematical compartmental model of a simple CCM, distinct from those we have seen previously described in detail. The results of our modeling supported the feasibility of this proposed minimal and non-canonical CCM in C. merolae . To facilitate the robust modeling of this process, we measured and incorporated physiological and enzymatic parameters into the model. Additionally, we trained a surrogate machine-learning model to emulate the mechanistic model and characterized the effects of model parameters on key outputs. This parameter exploration enabled us to identify model features that influenced whether the model met the experimentally derived criteria for functional carbon concentration and efficient energy usage. Such parameters included cytosolic pH, bicarbonate pumping cost and kinetics, cell radius, carboxylation velocity, number of thylakoid membranes, and CO 2 membrane permeability. Our exploration thus suggested that a non-canonical CCM could exist in C. merolae and illuminated the essential features generally necessary for CCMs to function.

Steensma, Anne K. [Michigan State Univ., East Lans↗
DOE OSTI2024

DEEPEN: Final 3D PFA Favorability Models and 2D Favorability Maps at Newberry Volcano

Part of the DEEPEN (DE-risking Exploration of geothermal Plays in magmatic ENvironments) project involved developing and testing a methodology for a 3D play fairway analysis (PFA) for multiple play types (conventional hydrothermal, superhot EGS, and supercritical). This was tested using new and existing geoscientific exploration datasets at Newberry Volcano. This GDR submission includes images, data, and models related to the 3D favorability and uncertainty models and the 2D favorability and uncertainty maps. The DEEPEN PFA Methodology, detailed in the journal article below, is based on the method proposed by Poux & O'brien (2020), which uses the Leapfrog Geothermal software with the Edge extension to conduct PFA in 3D. This method uses all available data to build a 3D geodata model which can be broken down into smaller blocks and analyzed with advanced geostatistical methods. Each data set is imported into a 3D model in Leapfrog and divided into smaller blocks. Conditional queries can then be used to assign each block an index value which conditionally ranks each block's favorability, from 0-5 with 5 being most favorable, for each model (e.g., lithologic, seismic, magnetic, structural). The values between 0-5 assigned to each block are referred to as index values. The final step of the process is to combine all the index models to create a favorability index. This involves multiplying each index model by a given weight and then summing the resulting values. The DEEPEN PFA Methodology follows this approach, but split up by the specific geologic components of each play type. These components are defined as follows for each magmatic play type: 1. Conventional hydrothermal plays in magmatic environments: Heat, fluid, and permeability 2. Superhot EGS plays: Heat, thermal insulation, and producibility (the ability to create and sustain fractures suitable for and EGS reservoir) 3. Supercritical plays: Heat, supercritical fluid, pressure seal, and producibility (the proper permeability and pressure conditions to allow production of supercritical fluid) More information on these components and their development can be found in Kolker et al., (2022). For the purposes of subsurface imaging, it is easier to detect a permeable fluid-filled reservoir than it is to detect separate fluid and permeability components. Therefore, in this analysis, we combine fluid and permeability for conventional hydrothermal plays, and supercritical fluid and producibility for supercritical plays. We also project the 3D favorability volumes onto 2D surfaces for simplified joint interpretation, and we incorporate an uncertainty component. Uncertainty was modeled using the best approach for the dataset in question, for the datasets where we had enough information to do so. Identifying which subsurface parameters are the least resolved can help qualify current PFA results and focus future efforts in data collection. Where possible, the resulting uncertainty models/indices were weighted using the same weights applied to the respective datasets, and summed, following the PFA methodology above, but for uncertainty.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

An improved framework for the dynamic likelihood filtering approach to data assimilation

Here, we propose improvements to the Dynamic Likelihood Filter (DLF), a Bayesian data assimilation filtering approach, specifically tailored to wave problems. The DLF approach was developed to address the common challenge in the application of data assimilation to hyperbolic problems in the geosciences and in engineering, where observation systems are sparse in space and time. When these observations have low uncertainties, as compared to model uncertainties, the DLF exploits the inherent nature of information and uncertainties to propagate along characteristics to produce estimates that are phase aware as well as amplitude aware, as would be the case in the traditional data assimilation approach. Along characteristics, the stochastic partial differential equations underlying the linear or nonlinear stochastic dynamics are differential equations. This study focuses on developing the explicit challenges of relating dynamics and uncertainties in the Eulerian and Lagrangian frames via dynamic Gaussian processes. It also implements the approach using the ensemble Kalman filter (EnKF) and compares the DLF approach to the conventional one with respect to wave amplitude and phase estimates in linear and nonlinear wave problems. Numerical comparisons show that the DLF/EnKF outperforms the EnKF estimates, when applied to linear and nonlinear wave problems. This advantage is particularly noticeable when sparse, low uncertainty observations are used.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Density modification of cryo-EM maps

Density modification uses expectations about features of a map such as a flat solvent and expected distributions of density in the region of the macromolecule to improve individual Fourier terms representing the map. This process transfers information from one part of a map to another and can improve the accuracy of a map. Here, the assumptions behind density modification for maps from electron cryomicroscopy are examined and a procedure is presented that allows the incorporation of model-based information. Density modification works best in cases where unfiltered, unmasked maps with clear boundaries between the macromolecule and solvent are visible, and where there is substantial noise in the map, both in the region of the macromolecule and the solvent. It also is most effective if the characteristics of the map are relatively constant within regions of the macromolecule and the solvent. Model-based information can be used to improve density modification, but model bias can in principle occur. Here, model bias is reduced by using ensemble models that allow an estimation of model uncertainty. A test of model bias is presented that suggests that even if the expected density in a region of a map is specified incorrectly by using an incorrect model, the incorrect expectations do not strongly affect the final map.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Status of the KRUSTY Benchmark Modeling and Uncertainty Analysis

The U.S. National Aeronautics and Space Administration’s (NASA) desire for a small nuclear reactor for space applications led to a prototype assembly, Kilopower Reactor Using Stirling Technology (KRUSTY). The KRUSTY experiments included four phases: component critical, cold critical, warm critical, and high temperature. The KRUSTY benchmark described in this paper includes five configurations from the component critical experiments that were performed at the National Criticality Experiments Research Center (NCERC) beginning in November 2017. Preliminary results have been reported. The benchmark is now nearing completion (although it is still preliminary until formally accepted by the International Criticality Safety Benchmark Evaluation Project [ICSBEP] working group). In this paper, we present the updated benchmark and its uncertainties. These results were computed using MCNP6.2 ® with ENDF/B-VIII.0 cross sections.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗