Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Subpolar North Atlantic Mean State Affects the Response of the Atlantic Meridional Overturning Circulation to the North Atlantic Oscillation in CMIP6 Models

Abstract The Atlantic meridional overturning circulation (AMOC) plays an important role in climate, transporting heat and salt to the subpolar North Atlantic. The AMOC’s variability is sensitive to atmospheric forcing, especially the North Atlantic Oscillation (NAO). Because AMOC observations are short, climate models are a valuable tool to study the AMOC’s variability. Yet, there are known issues with climate models, like uncertainties and systematic biases. To investigate this, preindustrial control experiments from models participating in the phase 6 of Coupled Model Intercomparison Project (CMIP6) are evaluated. There is a large, but correlated, spread in the models’ subpolar gyre mean surface temperature and salinity. By splitting models into groups of either a warm–salty or cold–fresh subpolar gyre, it is shown that warm–salty models have a lower sea ice cover in the Labrador Sea and, hence, enable a larger heat loss during a positive NAO. Stratification in the Labrador Sea is also weaker in warm–salty models, such that the larger NAO-related heat loss can also affect greater depths. As a result, subsurface density anomalies are much stronger in the warm–salty models than in those that tend to be cold and fresh. As these anomalies propagate southward along the western boundary, they establish a zonal density gradient anomaly that promotes a stronger delayed AMOC response to the NAO in the warm–salty models. These findings demonstrate how model mean state errors are linked across variables and affect variability, emphasizing the need for improvement of the subpolar North Atlantic mean states in models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2024

Structural Uncertainty in the Sensitivity of Urban Temperatures to Anthropogenic Heat Flux

One key source of uncertainty for weather and climate models is structural uncertainty arising from the fact that these models must simplify or approximate complex physical, chemical, and biological processes that occur in the real world. However, structural uncertainty is rarely examined in the context of simulated effects of anthropogenic heat flux in cities. Using the Weather Research and Forecasting (WRF) model coupled with a single-layer urban canopy model, it is found that the sensitivity of urban canopy air temperature to anthropogenic heat flux can differ by an order of magnitude depending on how anthropogenic heat flux is released to the urban environment. Moreover, varying model structures through changing the treatment of roof-air interaction and the parameterization of convective heat transfer between the canopy air and the atmosphere can affect the sensitivity of urban canopy air temperature by a factor of 4. Urban surface temperature and 2-m air temperature are less sensitive to the methods of anthropogenic heat flux release and the examined model structural variants than urban canopy air temperature, but their sensitivities to anthropogenic heat flux can still vary by as much as a factor of 4 for surface temperature and 2 for 2-m air temperature. Our study recommends using temperature sensitivity instead of temperature response to understand how various physical processes (and their representations in numerical models) modulate the simulated effects of anthropogenic heat flux.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Uncertainty in inventories for life cycle assessment: State‐of‐the‐art, challenges, and new technologies

Uncertainty is a critical factor that can hinder the quality and potential applications of life cycle assessment (LCA) results. A prominent source of uncertainty stems from the life cycle inventory (LCI) data. Various methodologies exist to estimate the uncertainty associated with LCI data, primarily based on the widely used structured pedigree matrix approach or the computationally intensive Monte Carlo simulation. This perspective review explores how new technologies (e.g., computational algorithms and data collection methods) from data science and related fields can contribute to identifying, quantifying, and reducing uncertainty in LCI modeling. A brief overview of the sources of uncertainty in LCI modeling and how they are addressed in current LCA practice is provided. Additionally, several new technologies are identified, and the potential benefits of their implementation in reducing uncertainties in LCI modeling are discussed. This perspective review concludes by identifying potential areas that require further development for these technologies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Holocene paleoclimate change in the western US: The importance of chronology in discerning patterns and drivers

We report sediment in lakes and meadows forms a powerful archive that can be used to reconstruct environmental change through time. Reconstructions of lake level, of chemical, biological, and hydrological conditions, and of surrounding vegetation provide detailed information about past climate conditions, both locally and regionally. Indeed, most of our current knowledge of centennial- to millennial-scale climate variability in the arid western United States, where information about past hydroclimate is particularly important, comes from such sediment-based reconstructions. The pressing need for robust, precise predictions of future conditions is a significant motivation for paleoclimate science, and current research questions frequently require Holocene reconstructions to be resolved at sub-centennial timescales. Increasingly, regional syntheses seek to identify synoptic-scale patterns similar to those defined from modern observations (seasonal, interannual, multi-decadal, etc.) or to compare with the output of climate model simulations. However, the age control on existing records, especially those more than about 20 years old, is often sufficient only for millennial-scale interpretation. Here we assess the age control for 84 published and unpublished records from lakes and meadows in the Great Basin, California, and desert southwest, and use Bayesian modeling to evaluate the 95% uncertainty ranges for the 42 best-dated records. In the Late Holocene, about half of the 42 records have <400-year mean uncertainty ranges; however, high-precision age control is especially critical for young records, used to develop an accurate understanding of a proxy’s response to known climate variations. In the Middle Holocene, records vary from 400 to >800-year mean uncertainty and records of the Early Holocene have 600- to >1400-year mean uncertainty ranges. We find that the largest control on modeled uncertainties is dating density, with at least 2 dates/kyr being optimal and suggest obtaining “range-finder” dates at the onset of a study to better predict the total number of dates needed for an adequate age model. Such a density avoids a commonly observed phenomenon of significant peaks in uncertainty arising in gaps between age control points. Analysis of the uncertainties associated with proxy shifts reveal that more than half are >400 years. Although such large uncertainties currently prevent sub-centennial interpretations in most cases, increased dating density, strategic use of limited funds (including budgeting for a 2 date/kyr minimum at the proposal stage), construction of age-depth models with Bayesian methods, and critical evaluation of chronological uncertainty will shed light on past climate variability at finer timescales, enhancing our understanding of global and regional drivers of western U.S. climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Axion pulsarscope

Electromagnetic fields surrounding pulsars may source coherent ultralight axion signals at the known rotational frequencies of the neutron stars, which can be detected by laboratory experiments (e.g., pulsarscopes). As a promising case study, we model axion emission from the well-studied Crab pulsar, which would yield a prominent signal at 𝑓 ≈ 29.6 Hz regardless of whether the axion contributes to the dark matter abundance. We estimate the relevant sensitivity of future axion dark matter detection experiments such as DMRadio-GUT, Dark SRF, and CASPEr, assuming different magnetosphere models to bracket the uncertainty in astrophysical modeling. For example, depending on final experimental parameters, the Dark SRF experiment could probe axions with any mass 𝑚 𝑎 ≪ 10 −13 eV down to 𝑔 𝑎⁢𝛾⁢𝛾 ∼3 × 10 −13 GeV −1 with one year of data and assuming the vacuum magnetosphere model. These projected sensitivities may be degraded depending on the extent to which the magnetosphere is screened by charge-filled plasma. The promise of pulsar-sourced axions as a clean target for direct detection experiments motivates dedicated simulations of axion production in pulsar magnetospheres.

axions↗
DOE OSTI2021

Sparse Control Synthesis for Uncertain Responsive Loads With Stochastic Stability Guarantees

In this report, recent studies have demonstrated the potential of flexible loads in providing frequency response services, predominantly due to their availability and cost-effectiveness. However, uncertainty and variability in various weather-related and end-use behavioral factors often impact the reliability of demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive in the power system dynamics. Recently developed mean square exponential stability (MSES) results for continuous-time linear stochastic systems are applied to pose the control synthesis problem which results in an LMI-based optimization problem. Additional costs and constraints are added to the LMI-based controller synthesis to ensure MSES, improve closed-loop transient performance, maximize tolerable uncertainties, and promote sparsity in the controller. Additionally, the fundamental limitations between the tolerable uncertainties and control efforts while ensuring MSES are discussed. Further, the control synthesis problem for the case of the full-state measurement is generalized to the case of partial-state measurements. The proposed control synthesis is illustrated on an IEEE 39 bus system with rigorous studies to demonstrate the role of sparsity, closed-loop transient performance, tolerable uncertainties, and control efforts while ensuring MSES and achieving frequency response.

42 ENGINEERING↗
DOE OSTI2021

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

In-Situ Inference: Bringing Advanced Data Science Into Exascale Simulations

As simulations generate ever-increasing amounts of data, there are correspondingly richer opportunities for analysis and scientific discovery - discoveries that will be missed if most of the data must be discarded before it is analyzed. Because future exascale architectures will be increasingly storage-limited, it will not be possible to save the vast majority of simulation data for later analysis, requiring analysis to occur “in-situ” within the simulation. However, existing in-situ data analysis frameworks provide little or no support for one of the most sophisticated forms of data science: probabilistic statistical modeling or uncertainty quantification (UQ), and the accompanying challenge of inference - fitting those statistical models to massive simulation output. Our goal is to develop the fundamental statistical algorithms and computer science needed to perform statistical inference in-situ (in HPC simulations) to the full stream of data those simulations generate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Nuclear Material Control & Accounting for Pebble Bed Reactors (FY 2023 Summary Report)

This report discusses the work done under the US Department of Energy NE-5 Advanced Reactor Safeguards and Security Program during FY 2023. It provides a summary of material control and accounting (MC&A) for pebble bed reactors (PBRs) and addresses some of the main challenges with current PBR MC&A approaches that will inform safeguards and security by design efforts. The efforts to date have focused on tristructural isotropic (TRISO) pebble fuel material accounting and control including working with partners in industry, loss and production of nuclear material as part of reactor operations, burnup modeling and measurements, uncertainty quantifications for such modeling and measurements, statistical approaches needed, and measurement methods. The unique fuel management and utilization in a PBR, where the fuel in spherical form is introduced and circulates through the reactor, poses special challenges for MC&A. This contrasts with traditional water-cooled reactors in which the fuel is contained in large assemblies and can be easily identified and counted. Even online fueled reactors, such as the CANDU reactors (none of which operate in the United States), are significantly different because the fuel is still contained in relatively large assemblies, is uniquely identified, and the number of assemblies that pass through the core on an annual basis is much fewer than the hundreds of thousands that circulate in a PBR, none of which are uniquely identified. Additionally, the nature of the TRISO fuel results in very low heavy metal loading with each pebble containing less than 10 g of uranium and on the order of less than 1 g of fissile material. This low fuel density and the robustness of the TRISO particles are major features of the TRISO fuel from a safety basis as each TRISO particle and pebble acts as a containment for the nuclear material and fission products during normal and accident conditions. This also results in very low plutonium loading per pebble during normal operations, which is on the order of 0.1 g at full burnup. A major feature of PBRs is that they will allow for significantly higher burnup, on the order of 160 GWd/THM compared to the burnup of traditional LWRs, which is on the order of 45 GWd/THM. This is achieved by monitoring the pebbles as they circulate through the reactor and allowing them to be reintroduced into the core until the desired burnup is achieved and they are removed from the reactor and enter the spent fuel storage areas.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Quantifying physical parameterization uncertainties associated with land-atmosphere interactions in the WRF model over Amazon

The Weather Research and Forecasting (WRF) model can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations but subjected to uncertainties associated with model physical parameterizations. In this study, we propose a framework to quantify and reduce model physical parameterization uncertainties associated with surface fluxes and L-A coupling. An ensemble of WRF simulations with different physical schemes is used to simulate surface fluxes and land-atmosphere coupling strength over the Amazon region. The physical parameterizations investigated include cloud microphysics (MP), land surface processes (LSM), planetary boundary layer (PBL), surface layer (SL), and cumulus (CU). We perform 120 ensemble simulations using the WRF model and different combinations of six MPs, three LSMs, six PBLs and SLs and three CUs. The measurements from the GoAMAZON field campaign and satellite data are used to evaluate model performance. A Multi-way analysis of variance (ANOVA) approach is applied to quantify the relative importance of different physics processes on L-A coupling. The Tukey’s test is used to sort schemes that have no significant differences into one group. The suite of physics that result in the best simulations of the corresponding variables are selected based on the Taylor skill score. Results show that the relative importance of processes and their interaction vary with the variables of interest. For example, CU was the most important process in modulating soil moisture, 2 m-humidity, latent heat, and net radiation. LSM showed dominant effects on 2 m-temperature and also has the largest impact on sensible heat and the lifting condensation level. The best physical parameterization ensembles show much narrower ranges of the variables of interest than the priori ensemble. Results of this study show the roles of different physical processes in modulating L-A interactions, quantify model uncertainties from physical processes, and provide insights for improving the model physics parameterizations.

Wang, Chen↗
DOE OSTI2021

High-resolution hourly surrogate modeling framework for physics-based large-scale building stock modeling

Surrogate modeling can play a key role in reducing high computational burdens for large-scale physics-based modeling and uncertainty quantification. With the rapid development of large-scale building stock energy modeling, surrogate modeling has also begun to be widely applied in this field; however, most existing surrogate models lack hourly time resolution for regional-scale modeling, which is essential for understanding building demand profiles and grid impacts. Further, there is generally a lack of necessary data and feature engineering frameworks specific to building modeling for efficiently managing large datasets and complex computations. Furthermore, this paper proposes a modeling framework for large-scale (city-/region-scale), high-resolution, high-fidelity surrogate building stock energy models. Our developed framework consists of six modules: (1) building stock energy modeling (ComStock TM and ResStock TM ), (2) data engineering for large simulation data, (3) high performance computing workflow, (4) feature engineering, (5) machine learning model development, and (6) model performance evaluation. Two case studies apply the developed framework in both residential and commercial building stock analysis to demonstrate its computational efficiency and surrogate modeling accuracies. Results show that surrogate models, when efficiently trained using the HPC workflow module, reach a high level of modeling accuracy for two case studies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Analysis of Uncertainty Impacts on Emissions and Fuel Economy Evaluation for Chassis Dynamometer Testing

This study illustrates a methodology for quantifying the uncertainties encountered in the measurement of tailpipe emissions and in the fuel consumption measurements for light-duty conventional vehicles tested on a four-wheel drive chassis dynamometer. The study leverages high-fidelity experimental data collected over three standard drive cycles, UDDS, HWY and US06, intended to simulate a wide range of operating conditions. Here, a method is developed to estimate the measurement uncertainties in fuel consumption for a test cycle, which occur due to the accumulation of measurement uncertainties propagated through the system. The uncertainty determination model uses statistical analysis and standard propagation techniques to evaluate and combine the uncertainties introduced from various sources (including the vehicle, chassis dynamometer, driver, and instrumentation). The analysis also examines three different experimental methods for determining the fuel consumption: 1) carbon mass balance, 2) volumetric fuel scale and 3) gravimetric fuel scale, and takes into consideration the properties of the instrumentation used. The results show that the most significant influence on the determination of the emissions comes from the concentration measurement, and similarly the biggest impact on the total fuel consumption uncertainty comes from the uncertainty in the determination of the carbon dioxide mass, due to the large presence of this pollutant in the overall emissions. It was found that the fuel consumption uncertainties are in the range of ±1-2% for all three methods analyzed, with the lowest values being obtained for measurements performed using the gravimetric method for all three drive cycles considered.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Long-term impact of light- and elevated temperature-induced degradation on photovoltaic arrays

Low levelized cost of electricity (LCOE) has been identified as critical for widespread adoption of photovoltaics (PV) without subsidies. Maintaining decades-long high-energy production is often an under-recognized opportunity in meeting cost goals because component lifetimes are not fully quantified at the time of manufacture. Whereas certain standardized tests minimize risk of early failure, there is little guidance to quantitatively predict degradation (or lack thereof) over decades, based on accelerated tests. In this article, we move toward bridging the understanding between indoor accelerated tests and outdoor performance data, with the goal of predicting energy yield with enough accuracy to inform financial decisions. Light- and elevated temperature-induced degradation (LETID) in p-type Si modules is analyzed in terms of impact on long-term module performance and thus LCOE. A method to predict the progression of LETID, using fixed kinetic constants and a numerical solution to the basic reaction rate equations, is detailed. Predictions are compared against both published data and that new to this study. These data include both indoor accelerated tests and fielded modules. We use the results in financial models to derive LCOE of modules in different climates with varying amounts of LETID, including uncertainty. Cost models based on the predictions indicate that LETID has a significant and climate-dependent impact on LCOE. Finally, we show that - even given the uncertainties identified in the study - these financial calculations can provide useful guidance to quantify risk based on accelerated test results. The analysis serves as an example of developing a predictive approach to PV reliability using physics of failure.

14 SOLAR ENERGY↗
DOE OSTI2023

Fuel performance uncertainty quantification and sensitivity analysis in the presence of epistemic and aleatoric sources of uncertainties

Fuel performance modeling and simulation includes many uncertain parameters from models to boundary conditions, manufacturing parameters and material properties. These parameters exhibit large uncertainties and can have an epistemic or aleatoric nature, something that renders fuel performance code-to-code and code-to-measurements comparisons for complex phenomena such as the pellet cladding mechanical interaction (PCMI) very challenging. Additionally, PCMI and other complex phenomena found in fuel performance modeling and simulation induce strong discontinuities and non-linearities that can render difficult to extract meaningful conclusions form uncertainty quantification (UQ) and sensitivity analysis (SA) studies. In this work, we develop and apply a consistent treatment of epistemic and aleatoric uncertainties for both UQ and SA in fuel performance calculations and use historical benchmark-quality measurement data to demonstrate it. More specifically, the developed methodology is applied to the OECD/NEA Multi-physics Pellet Cladding Mechanical Interaction Validation benchmark. A cold ramp test leading to PCMI is modeled. Two measured quantities of interest are considered: the cladding axial elongation during the irradiations and the cladding outer diameter after the cold ramp. The fuel performance code used to perform the simulation is FAST. The developed methodology involves various steps including a Morris screening to decrease the number of uncertain inputs, a nested loop approach for propagating the epistemic and aleatoric sources of uncertainties, and a global SA using Sobol indices. The obtained results indicate that the fuel and cladding thermal conductivities as well as the cladding outer diameter uncertainties are the three inputs having the largest impact on the measured quantities. More importantly, it was found that the epistemic uncertainties can have a significant impact on the measured quantities and can affect the outcome of the global sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗