Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Real-Time Prediction of Safety Margins in the National Airspace

Underlying all operations in the National Airspace System (NAS) is the concept of safety. Safety, as defined by acceptable levels of risk, is to be maintained at all times. The real-time safety monitoring (RTSM) framework is under development to provide an automated system to quantify safety in the NAS, estimate the current level of safety, and predict the future evolution of safety and the occurrence of events that pose an increased risk to flights so that these occurrences can be managed strategically rather than mitigated reactively. This paper presents the mathematical framework, the models, and the monitoring and prediction algorithms used to achieve this. RTSM computes safety as expressed through a set of safety margins based on user-defined safety metrics, thresolds, and events. Sources of uncertainty are modeled and propagated through the predictions in order to compute the probabilistic evolution of safety and the probability of events that introduce increased risk to operations. A prototype implementation is discussed and results demonstrating feasibility are presented. The results highlight the kinds of predictions that can be computed and the fidelity that is currently achieved.

national airspace system↗
DOE OSTI2024

Multistage Stochastic optimization for mid-term integrated generation and maintenance scheduling of cascaded hydroelectric system with renewable energy uncertainty

The uncertainties resulting from the escalating penetration of renewable energy resources pose severe challenges to the efficient operation of modern power systems. Hydroelectricity is characterized by its flexibility, controllability, and reliability, and thus becomes one of the most ideal energy resources to hedge against such uncertainties. This paper studies the mid-term integrated generation and maintenance scheduling of a cascaded hydroelectric system (CHS) consisting of multiple cascaded reservoirs and hydroelectric units. To precisely describe the mid-term water regulation policies, the hydraulic coupling relationship and water-energy nexus of CHS are incorporated into the proposed optimization model. The uncertainties of natural water inflow and the power outputs of wind/solar energy generation are taken into consideration and captured via a stochastic process modeled by a scenario tree. A multistage stochastic optimization (MSO) approach is developed to coordinate the complementary operations of multiple energy resources, by optimizing the mid-term water resource management, generation scheduling, and maintenance scheduling of CHS. The proposed MSO model is formulated as a large-scale mixed-integer linear program that presents significant computational intractability. To address this issue, a tailored Benders decomposition algorithm is developed. Two real-world case studies are conducted to demonstrate the capability and characteristics of the proposed model and algorithm. The computational results show that the proposed MSO model can exploit the flexibility of hydroelectricity to efficiently respond to variable wind and solar power, and reserve water resources for the generation in peak months to reduce the consumption of fossil fuel. Furthermore, the proposed solution approach also exhibits promising computational efficiency when handling large-scale models.

13 HYDRO ENERGY↗
NASA NTRSDate not supplied

A Gaussian Process Enhancement to Linear Parameter Varying Models

Simulation and analysis for modern engineering systems now routinely requires the merging of multiple disciplines, physical-domains, time-scales, and data sets — all at ever increasing levels. These capabilities are especially needed in the domain of Advanced Air Mobility, where rapidly emerging vehicle designs are significantly more complex, while having to be both cost-effective and safe. To meet these engineering challenges, machine learning methods are an attractive option for merging models and data across multiple areas while providing uncertainty quantification and maintaining computational efficiency. This paper examines the use of Gaussian process machine learning to generalize and enhance the commonly used class of quasi-Linear Parameter Varying models for fast full-envelope simulation while also supporting control system design and analysis with model uncertainty. Gaussian process machine learning is selected because it: can fuse multiple data sets, enables an easy trade-off between data fitting and smoothing, provides model uncertainty quantification, scales well with increasing complexity, and does not generally require starting from a large training data set. To demonstrate the benefits of the approach, a robust stability analysis with Gaussian process uncertainty is shown for a NASA reference design of an electric quad-rotor air-taxi concept vehicle with motor parameter uncertainty.

Gaussian Process↗
DOE OSTI2024

Modeling Plutonium Decorporation in a Female Nuclear Worker Treated with Ca-DTPA after Inhalation Intake

The present work models plutonium (Pu) biokinetics in a female former nuclear worker. Her bioassay measurements are available at the US Transuranium and Uranium Registries. The worker was internally exposed to a plutonium-americium mixture via acute inhalation at a nuclear weapons facility. She was medically treated with injections of 1 g Ca-DTPA on days 0, 5, and 14 after the intake. Between days 0 and 20, fecal and urine samples were collected and analyzed for 239 Pu and 241 Am. Subsequently, she was followed up for bioassay monitoring over 14 y, with additional post-treatment urine samples collected and analyzed for 239 Pu. The uniqueness of this dataset is due to the availability of: (1) both early and long-term bioassay data from a female with plutonium intake; (2) data on chelation therapy for a female; and (3) fecal measurement results. Chelation therapy with Ca- and/or Zn-salts of DTPA is known to aid in reducing the internal radiation dose by enhancing the excretion of plutonium and americium from the body. Such enhancement affects plutonium biokinetics in the human body, posing a challenge to the internal dose assessment. The current radiation dose assessment practice is to exclude the data affected by Ca-DTPA from the analysis. The present analysis is the first to explicitly model the chelation-affected bioassay data in a female by using a newly developed chelation model. Thus, the bioassay data collected during and after the Ca-DTPA administrations were used for biokinetic modeling and dose assessment. The Markov Chain Monte Carlo method was used to investigate model parameter uncertainty, based on the bioassay data and assumed prior probability distributions. A χ 2 /nData (number of data points) ≈ 1 was observed in this study, which indicates self-consistency of the data with the model. Results of this study show that the worker’s 239 Pu intake was 12 Bq, with a committed effective dose to the whole-body of 1.2 mSv and a committed equivalent dose to the bone surfaces, liver, and lungs of 37.8, 9.1, and 0.8 mSv, respectively. This study also discusses the worker’s dose reduction due to chelation treatment.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2023

Exploring the impacts of unprecedented climate extremes on forest ecosystems: hypotheses to guide modeling and experimental studies

Abstract. Climatic extreme events are expected to occur more frequently in the future, increasing the likelihood of unprecedented climate extremes (UCEs) or record-breaking events. UCEs, such as extreme heatwaves and droughts, substantially affect ecosystem stability and carbon cycling by increasing plant mortality and delaying ecosystem recovery. Quantitative knowledge of such effects is limited due to the paucity of experiments focusing on extreme climatic events beyond the range of historical experience. Here, we present a road map of how dynamic vegetation demographic models (VDMs) can be used to investigate hypotheses surrounding ecosystem responses to one type of UCE: unprecedented droughts. As a result of nonlinear ecosystem responses to UCEs that are qualitatively different from responses to milder extremes, we consider both biomass loss and recovery rates over time by reporting a time-integrated carbon loss as a result of UCE, relative to the absence of drought. Additionally, we explore how unprecedented droughts in combination with increasing atmospheric CO2 and/or temperature may affect ecosystem stability and carbon cycling. We explored these questions using simulations of pre-drought and post-drought conditions at well-studied forest sites using well-tested models (ED2 and LPJ-GUESS). The severity and patterns of biomass losses differed substantially between models. For example, biomass loss could be sensitive to either drought duration or drought intensity depending on the model approach. This is due to the models having different, but also plausible, representations of processes and interactions, highlighting the complicated variability of UCE impacts that still need to be narrowed down in models. Elevated atmospheric CO2 concentrations (eCO2) alone did not completely buffer the ecosystems from carbon losses during UCEs in the majority of our simulations. Our findings highlight the consequences of differences in process formulations and uncertainties in models, most notably related to availability in plant carbohydrate storage and the diversity of plant hydraulic schemes, in projecting potential ecosystem responses to UCEs. We provide a summary of the current state and role of many model processes that give way to different underlying hypotheses of plant responses to UCEs, reflecting knowledge gaps which in future studies could be tested with targeted field experiments and an iterative modeling–experimental conceptual framework.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Mitigating baryonic effects with a theoretical error covariance

ABSTRACT One of the primary sources of uncertainties in modelling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for stage-IV surveys requires knowledge of the matter power spectrum deep in the non-linear regime at the per cent level. Therefore, it is important to develop reliable mitigation techniques to take into account baryonic uncertainties if information from small scales is to be considered in the cosmological analysis. In this work, we develop a new mitigation method for dealing with baryonic physics for the case of the shear angular power spectrum. The method is based on an augmented covariance matrix that incorporates baryonic uncertainties informed by hydrodynamical simulations. We use the results from 13 hydrodynamical simulations and the residual errors arising from a fit to a ΛCDM model using the extended halo model code HMCode to account for baryonic physics. These residual errors are used to model a so-called theoretical error covariance matrix that is added to the original covariance matrix. In order to assess the performance of the method, we use the 2D tomographic shear from four hydrodynamical simulations that have different extremes of baryonic parameters as mock data and run a likelihood analysis comparing the residual bias on Ωm and σ8 of our method and the HMCode for an LSST-like survey. We use different modelling of the theoretical error covariance matrix to test the robustness of the method. We show that it is possible to reduce the bias in the determination of the tested cosmological parameters at the price of a modest decrease in the precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Long-Term Evaluation of Remedial Technology Performance in the Laboratory: Multi-year Experimental Test Plan

An understanding of the long-term effectiveness of remediation technologies is central to sustainable environmental cleanup. Long-term experiments are valuable for reducing uncertainty and predicting remediation outcomes at scales required for regulatory compliance. However, these types of tests can be costly and challenging to interpret. Therefore, contaminated sites often rely on short-term laboratory experiments that may not account for the potentially significant effects of gradual, time- dependent processes governing contaminant retention, release, and species transformation. For example, short-term lab experiments (from months to a year) conducted with sediments from the unsaturated and saturated zones at the Hanford Site play an important role in initial evaluations of remediation technologies but cannot capture the full extent of time-dependent reactions, leaving uncertainties in field-scale deployment. Here, long-term testing will be conducted on select technologies based on their performance in short-term testing. The overall objective is to directly address the challenges described above by generating and analyzing data on long-term (2–10 years) efficacy of selected remediation technologies, integrating this understanding into models, and providing critical input for remediation planning, monitoring, and 5-year review cycles for field-implemented remedies. Specific objectives include: 1. Evaluating long-term efficiency of promising remedies under site-specific conditions. 2. Generating robust parameters for modeling, reducing uncertainty in predictive simulations. 3. Advancing integrated monitoring by combining geochemical and geophysical observations. 4. Informing field-scale implementation by incrementally advancing technologies, identifying failure mechanisms early, and prioritizing robust, cost-effective remedies. Through systematic evaluation of technologies in laboratory-scale column experiments, integrated monitoring, and modeling support, this project is designed to bolster confidence in the long-term robustness of selected technologies. The ultimate outcome is the identification and deployment of more reliable, cost-effective remedies that safeguard human health and the environment while reducing the uncertainties that have historically hindered cleanup progress at Hanford Site. An experimental approach was developed and initiated for long-term testing potentially up to 10 years. The table below summarizes the experimental approach developed for testing select technologies and presented in this multi-year experimental test plan.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Interpretable Data-Driven Probabilistic Power System Load Margin Assessment with Uncertain Renewable Energy and Loads

The increasing uncertainties caused by the high-penetration of stochastic renewable generation resources poses a significant threat to the power system voltage stability. To address this issue, this paper proposes a probabilistic deep kernel learning enabled surrogate model to extract the hidden relationship between uncertain sources, i.e., wind power and loads, and load margin for probabilistic load margin assessment (PLMA). Unlike other deep learning approaches, a kernel SHAP provides the sensitivity analysis as well as interpretability of the inputs to outputs influences. This allows identifying the critical factors that affect load margin so that corrective control can be initiated for stability enhancement. Numerical results carried out on the IEEE 118-bus power system demonstrate the accuracy and efficiency of the proposed data-driven PLMA scheme.

deep kernel learning↗
DOE OSTI2024

Active learning of ternary alloy structures and energies

Abstract Machine learning models with uncertainty quantification have recently emerged as attractive tools to accelerate the navigation of catalyst design spaces in a data-efficient manner. Here, we combine active learning with a dropout graph convolutional network (dGCN) as a surrogate model to explore the complex materials space of high-entropy alloys (HEAs). We train the dGCN on the formation energies of disordered binary alloy structures in the Pd-Pt-Sn ternary alloy system and improve predictions on ternary structures by performing reduced optimization of the formation free energy, the target property that determines HEA stability, over ensembles of ternary structures constructed based on two coordinate systems: (a) a physics-informed ternary composition space, and (b) data-driven coordinates discovered by the Diffusion Maps manifold learning scheme. Both reduced optimization techniques improve predictions of the formation free energy in the ternary alloy space with a significantly reduced number of DFT calculations compared to a high-fidelity model. The physics-based scheme converges to the target property in a manner akin to a depth-first strategy, whereas the data-driven scheme appears more akin to a breadth-first approach. Both sampling schemes, coupled with our acquisition function, successfully exploit a database of DFT-calculated binary alloy structures and energies, augmented with a relatively small number of ternary alloy calculations, to identify stable ternary HEA compositions and structures. This generalized framework can be extended to incorporate more complex bulk and surface structural motifs, and the results demonstrate that significant dimensionality reduction is possible in thermodynamic sampling problems when suitable active learning schemes are employed.

Chemistry↗
DOE OSTI2023

BUQEYE guide to projection-based emulators in nuclear physics

The BUQEYE collaboration (Bayesian Uncertainty Quantification: Errors in Your effective field theory) presents a pedagogical introduction to projection-based, reduced-order emulators for applications in low-energy nuclear physics. The term emulator refers here to a fast surrogate model capable of reliably approximating high-fidelity models. As the general tools employed by these emulators are not yet well-known in the nuclear physics community, we discuss variational and Galerkin projection methods, emphasize the benefits of offline-online decompositions, and explore how these concepts lead to emulators for bound and scattering systems that enable fast and accurate calculations using many different model parameter sets. We also point to future extensions and applications of these emulators for nuclear physics, guided by the mature field of model (order) reduction. All examples discussed here and more are available as interactive, open-source Python code so that practitioners can readily adapt projection-based emulators for their own work.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2020

Calibration Probe Uncertainty and Validation for the Hypersonic Material Environmental Test System

This paper presents an uncertainty analysis of the stagnation-point calibration probe surface predictions for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System facility located at NASA Langley Research Center. A second-order stochastic expansion was constructed over 47 uncertain parameters to evaluate the sensitivities, identify the most significant uncertain variables, and quantify the uncertainty in the stagnation-point heat flux and pressure predictions of the calibration probe for a low- and high-enthalpy test condition. A sensitivity analysis showed that measurement bias uncertainty is the most significant contributor to the stagnation-point pressure and heat flux variance for the low-enthalpy condition. For the high-enthalpy condition, a paradigm shift in sensitivities revealed the computational fluid dynamics model input uncertainty as the main contributor. A comparison between the prediction and measurement of the stagnation-point conditions under uncertainty showed that there was evidence of statistical disagreement. A validation metric was proposed and applied to the prediction uncertainty to account for the statistical disagreement when compared to the possible stagnation-point heat flux and pressure measurements.

Brune, Andrew J.↗
DOE OSTI2020

The potential role of organics in new particle formation and initial growth in the remote tropical upper troposphere

Abstract. Global observations and model studies indicate that new particle formation (NPF) in the upper troposphere (UT) and subsequent particles supply 40 %–60 % of cloud condensation nuclei (CCN) in the lower troposphere, thus affecting the Earth's radiative budget. There are several plausible nucleation mechanisms and precursor species in this atmospheric region, which, in the absence of observational constraints, lead to uncertainties in modeled aerosols. In particular, the type of nucleation mechanism and concentrations of nucleation precursors, in part, determine the spatial distribution of new particles and resulting spatial distribution of CCN from this source. Although substantial advances in understanding NPF have been made in recent years, NPF processes in the UT in pristine marine regions are still poorly understood and are inadequately represented in global models. Here, we evaluate commonly used and state-of-the-art NPF schemes in a Lagrangian box model to assess which schemes and precursor concentrations best reproduce detailed in situ observations. Using measurements of aerosol size distributions (0.003 < Dp < 4.8 µm) in the remote marine troposphere between ∼0.18 and 13 km altitude obtained during the NASA Atmospheric Tomography (ATom) mission, we show that high concentrations of newly formed particles in the tropical UT over both the Atlantic and Pacific oceans are associated with outflow regions of deep convective clouds. We focus analysis on observations over the remote Pacific Ocean, which is a region less perturbed by continental emissions than the Atlantic. Comparing aerosol size distribution measurements over the remote Pacific with box model simulations for 32 cases shows that none of the NPF schemes most commonly used in global models, including binary nucleation of sulfuric acid and water (neutral and ion-assisted) and ternary involving sulfuric acid, water, and ammonia, are consistent with observations, regardless of precursor concentrations. Through sensitivity studies, we find that the nucleation scheme among those tested that is able to explain most consistently (21 of 32 cases) the observed size distributions is that of Riccobono et al. (2014), which involves both organic species and sulfuric acid. The method of Dunne et al. (2016), involving charged sulfuric acid–water–ammonia nucleation, when coupled with organic growth of the nucleated particles, was most consistent with the observations for 5 of 32 cases. Similarly, the neutral sulfuric acid–water–ammonia method of Napari (2002), when scaled with a tuning factor and with organic growth added, was most consistent for 6 of 32 cases. We find that to best reproduce both nucleation and growth rates, the mixing ratios of gas-phase organic precursors generally need to be at least twice that of SO2, a proxy for dimethyl sulfide (DMS). Unfortunately, we have no information on the nature of oxidized organic species that participated in NPF in this region. Global models rarely include organic-driven nucleation and growth pathways in UT conditions where globally significant NPF takes place, which may result in poor estimates of NPF and CCN abundance and contribute to uncertainties in aerosol–cloud–radiation effects. Furthermore, our results indicate that the organic aerosol precursor vapors may be important in the tropical UT above marine regions, a finding that should guide future observational efforts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Robust Control Design for Uncertain Nonlinear Dynamic Systems

Robustness to parametric uncertainty is fundamental to successful control system design and as such it has been at the core of many design methods developed over the decades. Despite its prominence, most of the work on robust control design has focused on linear models and uncertainties that are non-probabilistic in nature. Recently, researchers have acknowledged this disparity and have been developing theory to address a broader class of uncertainties. This paper presents an experimental application of robust control design for a hybrid class of probabilistic and non-probabilistic parametric uncertainties. The experimental apparatus is based upon the classic inverted pendulum on a cart. The physical uncertainty is realized by a known additional lumped mass at an unknown location on the pendulum. This unknown location has the effect of substantially altering the nominal frequency and controllability of the nonlinear system, and in the limit has the capability to make the system neutrally stable and uncontrollable. Another uncertainty to be considered is a direct current motor parameter. The control design objective is to design a controller that satisfies stability, tracking error, control power, and transient behavior requirements for the largest range of parametric uncertainties. This paper presents an overview of the theory behind the robust control design methodology and the experimental results.

Kenny, Sean P.↗
DOE OSTI2023

Quantifying uncertainties due to optical potentials in one-neutron knockout reactions

One-neutron knockout reactions have been widely used to extract information about the single-particle structure of nuclei from the valley of stability to the drip lines. The interpretation of knockout data relies on reaction models, where the uncertainties are typically not accounted for. In this work, we quantify uncertainties of optical potentials used in these reaction models and propagate them, for the first time, to knockout observables using a Bayesian analysis. We study two reactions in the present paper, the first of which involves a loosely bound halo projectile, 11 Be, and the second a tightly bound projectile, 12 C. We first quantify the parametric uncertainties associated with phenomenological optical potentials. Complementing this approach, we also quantify the model uncertainties associated with the chiral forces that can be used to construct microscopic optical potentials. For the phenomenological study, we investigate the impact of the imaginary terms of the optical potential on the breakup and stripping components of the knockout cross sections as well as the impact of the angular range. For the 11 Be case, the theoretical uncertainty from the phenomenological method is on the order of the experimental uncertainty of the knockout observables; however, for the 12 C case, the theoretical uncertainty is significantly larger. Additionally, the widths of the uncertainty bands for the knockout observables obtained for the microscopic study and the phenomenological approach are of similar orders of magnitude. Based on this work we conclude that structure information inferred from the ratio of the knockout cross sections will carry a theoretical uncertainty of at least 20% for halo nuclei and at least 40% for tightly bound nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Sensitivity study of parameters important to Molten Salt Reactor Safety

This paper presents a molten salt reactor (MSR) design parameter sensitivity study using a nodal dynamic modelling methodology with explicitly modified point kinetics equation and Mann’s model for heat transfer. Six parameters that can impact MSR safety are evaluated. A MATLAB-Simulink model inspired by Thorcon’s 550MW th MSR is used for parameter evaluations. A safety envelope was formed to encapsulate power, maximum and minimum temperature, and temperature-induced reactivity feedback. The parameters are perturbed by ±30%. The parameters were then ranked by their subsequent impact on the considered safety envelope, which ranks acceptable parameter uncertainty. The model is openly available on GitHub.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗