SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Impact of model predictive control-enabled home energy management on large-scale distribution systems with photovoltaics

Residential customers use more than one-quarter of the electricity in the world. Optimally managing home energy consumption is an effective way of easing the operational challenges facing the electric grid with increasing solar photovoltaics (PV). This paper studies the impact of the future proliferation of home energy management systems (HEMS) in the presence of PV on large-scale distribution systems. First, we present a stochastic HEMS model that minimizes residential customers' thermal discomfort and energy costs under uncertainty. The HEMS model schedules the optimal operations of residential appliances in the presence of PV within a mixed-integer linear programming-based model predictive control framework that links the proposed HEMS to a quasi-steady-state time-series simulation tool. Additionally, extensive simulations are conducted for a stand-alone residential home using two tariff structures and for 1977 homes on an 8,500-node distribution feeder. Simulation results quantify the impact of the future proliferation of HEMS on the large-scale distribution system with PV.

14 SOLAR ENERGY↗

DOE OSTI2025

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗

DOE OSTI2023

Autonomous MultiScale Library

AMSLib provides infrastructure to tightly couple multi-scale physics simulation code with ML surrogate model inference. It provides a wholistic runtime execution paradigm to supports uncertainty quantification, surrogate model inference, persistent data storing throughout the execution of a simulation.

Bhatia, Harsh↗

DOE OSTI2024

Platform Of Optimal Experiment Management

The platform of optimal experiment management, POEM, powered with automated machine learning to accelerate the discovery of optimal solutions, and automatically guide the design of experiments to be evaluated. POEM currently supports 1) random model explorations for experiment design, 2) sparse grid model explorations with Gaussian Polynomial Chaos surrogate model to accelerate experiment design ,3) time-dependent model sensitivity and uncertainty analysis to identify the importance features for experiment design, 4) model calibrations via Bayesian inference to integrate experiments to improve model performance, and 5) Bayesian optimization for optimal experimental design. In addition, POEM aims to simplify the process of experimental design for users, enabling them to analyze the data with minimal human intervention, and improving the technological output from research activities.

Wang, Congjian [Idaho National Laboratory (INL), I↗

DOE OSTI2021

Flattop Benchmark CED-2 (IER-423)

The final design for the Flattop HEU Core Benchmark is presented in this report. Physical measurements will be performed on Flattop components using modern instruments and techniques to define uncertainties necessary to meet contemporary ICSBEP standards. A preliminary re-evaluation of ICSBEP HMF-0028 (Flattop HEU Core) led to the development of IER-423 CED-1, wherein total relative uncertainties in $k_{eff}$ were provided based on a new detailed model. The estimated uncertainty on the total uncertainty is +100%/-0%, given a lack of documented uncertainties on mass, dimensions, and densities of predominantly the natural uranium (NU) and highly enriched uranium (HEU) components.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS2012

Comprehensive Approach to Verification and Validation of CFD Simulations Applied to Backward Facing Step-Application of CFD Uncertainty Analysis

There are inherent uncertainties and errors associated with using Computational Fluid Dynamics (CFD) to predict the flow field and there is no standard method for evaluating uncertainty in the CFD community. This paper describes an approach to -validate the . uncertainty in using CFD. The method will use the state of the art uncertainty analysis applying different turbulence niodels and draw conclusions on which models provide the least uncertainty and which models most accurately predict the flow of a backward facing step.

Groves, Curtis E.↗

DOE OSTI2021

Biomass burning aerosols in most climate models are too absorbing

Uncertainty in the representation of biomass burning (BB) aerosol composition and optical properties in climate models contributes to a range in modeled aerosol effects on incoming solar radiation. Depending on the model, the top-of-the-atmosphere BB aerosol effect can range from cooling to warming. By relating aerosol absorption relative to extinction and carbonaceous aerosol composition from 12 observational datasets to nine state-of-the-art Earth system models/chemical transport models, we identify varying degrees of overestimation in BB aerosol absorptivity by these models. Modifications to BB aerosol refractive index, size, and mixing state improve the Community Atmosphere Model version 5 (CAM5) agreement with observations, leading to a global change in BB direct radiative effect of -0.07 W m -2 , and regional changes of -2 W m -2 (Africa) and -0.5 W m -2 (South America/Temperate). Our findings suggest that current modeled BB contributes less to warming than previously thought, largely due to treatments of aerosol mixing state.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Imprecise global sensitivity analysis using bayesian multimodel inference and importance sampling

Global Sensitivity Analysis (GSA) aims to understand the relative importance of uncertain input variables to model response. Conventional GSA involves calculating sensitivity (Sobol’) indices for a model with known model parameter distributions. However, model parameters are affected by aleatory and epistemic uncertainty, with the latter often caused by lack of data. In this paper, we propose a new framework to quantify uncertainty in probability model-form and model parameters resulting from small datasets and integrate these uncertainties into Sobol’ index estimates. First, the process establishes, through Bayesian multimodel inference, a set of candidate probability models and their associated probabilities. Imprecise Sobol’ indices are calculated from these probability models using an importance sampling reweighting approach. This results in probabilistic Sobol’ indices, whose distribution characterizes uncertainty in the sensitivity resulting from small dataset size. The imprecise Sobol’ indices thus provide a measure of confidence in the sensitivity estimate and, moreover, can be used to inform data collection efforts targeted to minimize the impact of uncertainties. Through an example studying the parameters of a Timoshenko beam, we show that these probabilistic Sobol’ indices converge to the true/deterministic Sobol’ indices as the dataset size increases and hence, distribution-form uncertainty reduces. The approach is then applied to assess the sensitivity of the out-of-plane properties of an E-glass fiber composite material to its constituent properties. This second example illustrates the approach for an important class of materials with wide-ranging applications when data may be lacking for some input parameters.

42 ENGINEERING↗

DOE OSTI2020

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results

Accurate representation of the turbulent exchange of carbon, water, and heat between the land surface and the atmosphere is critical for modelling global energy, water, and carbon cycles in both future climate projections and weather forecasts. Evaluation of models' ability to do this is performed in a wide range of simulation environments, often without explicit consideration of the degree of observational constraint or uncertainty and typically without quantification of benchmark performance expectations. We describe a Model Intercomparison Project (MIP) that attempts to resolve these shortcomings, comparing the surface turbulent heat flux predictions of around 20 different land models provided with in situ meteorological forcing evaluated with measured surface fluxes using quality-controlled data from 170 eddy-covariance-based flux tower sites. Predictions from seven out-of-sample empirical models are used to quantify the information available to land models in their forcing data and so the potential for land model performance improvement. Sites with unusual behaviour, complicated processes, poor data quality, or uncommon flux magnitude are more difficult to predict for both mechanistic and empirical models, providing a means of fairer assessment of land model performance. When examining observational uncertainty, model performance does not appear to improve in low-turbulence periods or with energy-balance-corrected flux tower data, and indeed some results raise questions about whether the energy balance correction process itself is appropriate. In all cases the results are broadly consistent, with simple out-of-sample empirical models, including linear regression, comfortably outperforming mechanistic land models. In all but two cases, latent heat flux and net ecosystem exchange of CO 2 are better predicted by land models than sensible heat flux, despite it seeming to have fewer physical controlling processes. Land models that are implemented in Earth system models also appear to perform notably better than stand-alone ecosystem (including demographic) models, at least in terms of the fluxes examined here. The approach we outline enables isolation of the locations and conditions under which model developers can know that a land model can improve, allowing information pathways and discrete parameterisations in models to be identified and targeted for future model development.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1991

Assessing damping uncertainty in space structures with fuzzy sets

NASA has been interested in the development of methods for evaluating the predictive accuracy of structural dynamic models. This interest stems from the use of mathematical models in evaluating the structural integrity of all spacecraft prior to flight. Space structures are often too large and too weak to be tested fully assembled in a ground test lab. The predictive accuracy of a model depends on the nature and extent of its experimental verification. The further the test conditions depart from in-service conditions, the less accurate the model will be. Structural damping is known to be one source of uncertainty in models. The uncertainty in damping is explored in order to evaluate the accuracy of dynamic models. A simple mass-spring-dashpot system is used to illustrate a comparison among three methods for propagating uncertainty in structural dynamics models: the First Order Method, the Numerical Simulation Method, and the Fuzzy Set Method. The Fuzzy Set Method is shown to bound the range of possible responses and thus to provide a valuable limiting check on the First Order Method near resonant conditions. Fuzzy Methods are a relative inexpensive alternative to numerical simulation.

Ross, Timothy J.↗

DOE OSTI2020

Understanding Material Strength Variabilities and Uncertainties for Component Qualification (2020 LDRD Final Report)

At its core, material specification and materials qualification require an understanding of the uncertainties in relation to a given performance metric. When simulations are used to inform the design and evaluation of these metrics, it is essential to understand the uncertainties in the underlying models and parameters that feed into those simulations. In this work, we have created a statistical framework to address uncertainties in the materials strength modeling used in integrated simulations. The framework is based on the Bayesian methodology, which allows for uncertainties to be updated as new data become available. The results of this work show how model parameters and their uncertainties can be updated as new and different types of strength data are added, as well as methods for determining which future experiment has the greatest potential to reduce the uncertainty. The statistical framework developed in this project will be utilized to assess and propagate the uncertainties in the strength models used in the programmatic simulations and to create a way to formally update those uncertainties as new data become available.

36 MATERIALS SCIENCE↗

NASA NTRS2022

Constraining Clouds and Convective Parameterizations in A Climate Model Using Paleoclimate Data

Cloud and convective parameterizations strongly influence uncertainties in equilibrium climate sensitivity. We provide a proof-of-concept study to constrain these parameterizations in a perturbed parameter ensemble of the atmosphere-only version of the Goddard Institute for Space Studies Model E2.1 simulations by evaluating model biases in the present-day runs using multiple satellite climatologies and by comparing simulated δ 18 O of precipitation (δ 18 O p ), known to be sensitive to parameterization schemes, with a global database of speleothem δ 18 O records covering the Last Glacial Maximum (LGM), mid-Holocene (MH) and pre-industrial (PI) periods. Relative to modern interannual variability, paleoclimate simulations show greater sensitivity to parameter changes, allowing for an evaluation of model uncertainties over a broader range of climate forcing and the identification of parts of the world that are parameter sensitive. Certain simulations reproduced absolute δ 18 O p values across all time periods, along with LGM and MH δ 18 O p anomalies relative to the PI, better than the default parameterization. No single set of parameterizations worked well in all climate states, likely due to the non-stationarity of cloud feedbacks under varying boundary conditions. Future work that involves varying multiple parameter sets simultaneously with coupled ocean feedbacks will likely provide improved constraints on cloud and convective parameterizations.

cloud and convective parameterization↗

DOE OSTI2024

Identifying Hydropower Operational Flexibilities in Presence of Streamflow and Net-load Uncertainty (Final Technical report)

In the existing operations, hydropower contributions to future system flexibility are generally modeled while maintaining traditional operating rules and constraints in supporting grid operation, such as the balancing of variable renewable energy production. Moreover, operation of large scale hydropower systems on major rivers has been investigated for decades, utilizing various systems engineering approaches, with the evolving electric grid, as the result of renewable resources integration, compounded by the changing climate (variability of river flows, intensification of hydrologic cycle resulting in more frequent extreme events) affecting water availability, the need for more advanced stochastic modeling and effective uncertainty analysis approaches have become necessary. The research results supported by this funding and presented in this report provide a new look at hydropower operational flexibility enforced by the changes identified above. Understanding how hydropower operates in response to the underlying uncertainties with respect to the system constraints is crucial in identifying its operational flexibility potentials. In this project, the flexibility of the operating hydropower facility is described by capturing uncertainties in both water and power system and formulating the operations as a multistage stochastic optimization problem. The proposed approach supports short- to seasonal-term operations and planning decision horizons.

13 HYDRO ENERGY↗

NASA NTRS2021

Stochastic Guidance of Buoyancy Controlled Vehicles under Ice Shelves using Ocean Currents

We propose a novel technique for guidance ofbuoyancy-controlled vehicles in uncertain under-ice ocean flows.In-situ melt rate measurements collected at the grounding zoneof Antarctic ice shelves, where the ice shelf meets the underlyingbedrock, are essential to constrain models of future sea levelrise. Buoyancy-controlled vehicles, which control their verticalposition in the water column but have no means of horizontalpropulsion, offer an affordable and reliable platform for suchin-situ data collection. However, reaching the grounding zonerequires vehicles to traverse tens of kilometers under the iceshelf, with approximate position knowledge and no meansof communication, in highly variable and uncertain oceancurrents. To address this challenge, we propose a partiallyobservable MDP approach that exploits model-based knowledgeof the under-ice currents and, critically, of their uncertainty,to synthesize effective guidance policies. The approach usesapproximate dynamic programming to model uncertainty inthe currents, and QMDP to address localization uncertainty.Numerical experiments show that the policy can deliver upto 88.8% of underwater vehicles to the grounding zone – a33% improvement compared to state-of-the-art guidance techniques, and a 262% improvement over uncontrolled drifters.Collectively, these results show that model-based under-iceguidance is a highly promising technique for exploration ofunder-ice cavities, and has the potential to enable cost-effectiveand scalable access to these challenging and rarely observed environments.

Clark, Evan B.↗

NASA NTRS2013

Uncertainty of Passive Imager Cloud Optical Property Retrievals to Instrument Radiometry and Model Assumptions: Examples from MODIS

The optical and microphysical structure of clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS on the NASA EOS Terra and Aqua platforms, simultaneous global-daily 1 km retrievals of cloud optical thickness (COT) and effective particle radius (CER) are provided, as well as the derived water path (WP). The cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate retrieval datasets for various two-channel retrievals, typically a VISNIR channel paired with a 1.6, 2.1, and 3.7 m spectral channel. The MOD06 forward model is derived from on a homogeneous plane-parallel cloud. In Collection 5 processing (completed in 2007 with a modified Collection 5.1 completed in 2010), pixel-level retrieval uncertainties were calculated for the following non-3-D error sources: radiometry, surface spectral albedo, and atmospheric corrections associated with model analysis uncertainties (water vapor only). The latter error source includes error correlation across the retrieval spectral channels. Estimates of uncertainty in 1 aggregated (Level-3) means were also provided assuming unity correlation between error sources for all pixels in a grid for a single day, and zero correlation of error sources from one day to the next. I n Collection 6 (expected to begin in late summer 2013) we expanded the uncertainty analysis to include: (a) scene-dependent calibration uncertainty that depends on new band and detector-specific Level 1B uncertainties, (b) new model error sources derived from the look-up tables which includes sensitivities associated with wind direction over the ocean and uncertainties in liquid water and ice effective variance, (c) thermal emission uncertainties in the 3.7 m band associated with cloud and surface temperatures that are needed to extract reflected solar radiation from the total radiance signal, (d) uncertainty in the solar spectral irradiance at 3.7 m, and (e) addition of stratospheric ozone uncertainty in visible atmospheric corrections. A summary of the approach and example Collection 6 results will be shown.

Cloud Properties Observations↗

DOE OSTI2026

Statistical Uncertainty of Inhalation Dose Coefficients in Consequence Management: Propagated Dose Uncertainty in ICRP 66 Human Respiratory Tract Model

Reference inhalation dose models rely on deterministic biokinetics and reference computational phantoms, limiting their applicability to the variability present in population-specific exposures encountered in emergency response scenarios. Here, this study introduces REDCAL, a Python-based computational framework developed to propagate uncertainty in inhalation dose coefficients using the International Commission on Radiological Protection (ICRP) Publication 66 Human Respiratory Tract Model. REDCAL integrates ICRP deposition and clearance models, systemic biokinetics, and governing physics principles, and leverages Sandia National Laboratories’ Dakota toolkit for uncertainty quantification via Latin Hypercube Sampling. REDCAL was validated against DCAL, with biokinetic retention results differing by less than 1% and effective dose coefficients by less than 2% across all tested radionuclides. Stochastic sampling introduced variability in dose coefficients, with geometric standard deviations (GSD) in committed effective dose coefficients (CEDC) ranging from 1.0 to 1.5, based on lognormal distribution fits. Analysis demonstrated that variations in the activity median aerodynamic diameter (AMAD) notably influenced the computed CEDC values. Smaller particles (<1 µm) increased doses by 20–30% due to deeper lung deposition and prolonged retention for alpha emitting radionuclides, such as 241 Am and 239 Pu. Radionuclides with fast clearance, such as 133 I, demonstrated a dose reduction exceeding 50%, as AMAD increased beyond 5 µm due to upper airway deposition and rapid mucociliary clearance. The greatest GSD among the radionuclides reported in this study was for 241 Am. In most cases, the largest GSDs in the CEDC were associated with larger particle sizes, an expected outcome, as ICRP Publication 66 defines GSD in particle size as a function of AMAD, resulting in an extended tail of the lognormal distribution. The findings support improved inhalation dose assessments and enhance consequence management strategies for the U.S. Federal Radiological Monitoring and Assessment Center by quantifying uncertainty in dose coefficients and strengthening decision-making for emergency response scenarios.

Biokinetic Modeling↗

NASA NTRS1988

Current models of the intensely ionizing particle environment in space

The Cosmic Ray Effects on MicroElectronics (CREME) model that is currently in use to estimate single event effect rates in spacecraft is described. The CREME model provides a description of the radiation environment in interplanetary space near the orbit of the earth that contains no major deficiencies. The accuracy of the galactic cosmic ray model is limited by the uncertainties in solar modulation. The model for solar energetic particles could be improved by making use of all the data that has been collected on solar energetic particle events. There remain major uncertainties about the environment within the earth's magnetosphere, because of the uncertainties over the charge states of the heavy ions in the anomalous component and solar flares, and because of trapped heavy ions. The present CREME model is valid only at 1 AU, but it could be extended to other parts of the heliosphere. There is considerable data on the radiation environment from 0.2 to 35 AU in the ecliptic plane. This data could be used to extend the CREME model.

Adams, James H., Jr.↗