SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Sensitivity of fatigue reliability in wind turbines: effects of design turbulence and the Wöhler exponent

Fatigue assessment of wind turbines involves three main sources of uncertainty: material resistance, load, and the damage accumulation model. Many studies focus on increasing the accuracy of fatigue load assessment to improve the fatigue reliability. Probabilistic modeling of the wind's turbulence standard deviation is an example of an approach used for this purpose. Editions 3 and 4 of the IEC standard for the design of wind energy generation systems (IEC 61400-1) suggest different probability distributions as alternatives for the representative turbulence in the normal turbulence model (NTM) of edition 1. There are debates on whether the suggested distributions provide conservative reliability levels, as the established design safety factors are calibrated based on the representative turbulence approach. The current study addresses the debate by comparing annual reliability based on different scenarios of NTM using a probabilistic approach. More importantly, it elaborates on the relative importance of load assessment accuracy in defining the fatigue reliability. Using the DTU 10 MW reference wind turbine and the first-order reliability method (FORM), we study the changes in the annual reliability level and its sensitivity to the three main random inputs. We perform the study considering the blade root flapwise and the tower base fore–aft moments, assuming different fatigue exponents in each load channel. The results show that integration over distributions of turbulence in each mean wind speed results in less conservative annual reliability levels than representative turbulence. The difference in the reliability levels varies according to turbulence distribution and the fatigue exponent. In the case of the tower base, the difference in the annual reliability index after 20 years can be up to 50 %. However, the model and material uncertainty have much higher effects on the reliability levels compared to load uncertainty. Knowledge about such differences in the reliability levels due to the choice of turbulence distribution is especially important, as it impacts the extent of lifetime extension through reliability reassessments.

17 WIND ENERGY↗

DOE OSTI2024

Uncertainty Propagation from Experiment Measurements to Modeling Approaches: A Case for SMR Steam Entrainment Testing

To license new and advanced reactor designs, regulators must be convinced that their unique safety cases—relative to existing large scale reactors—have been adequately addressed by the designed reactor protection systems. In water cooled small modular reactors (SMRs), droplet entrainment in steam flow has significant implications on the progression of accident scenarios due to its compact design features, which requires representative test data applicable to SMR designs. Computer code, modeling and simulation (M&S) tools and models require adequate verification, assessment, and qualification. This includes M&S results validation against scaled empirical data within allowable uncertainty bands to gain regulatory approvals during the various stages of reactor system design, demonstration, and commercialization. However, measurement uncertainty within the empirical datasets and test data applicability ranges requires careful consideration of M&S inputs (i.e., boundary conditions, and initial conditions), and verification and validation efforts. This study focuses on uncertainty quantification in designing scaled test facilities for SMR applications with appropriate measurements and a standard data-reduction method to estimate thermal hydraulics characteristics parameters that incorporate physics phenomena of interest. In addition, this study supports the evaluation model development and assessment process using M&S that interfaces with advanced computing tools and digital twin capabilities. This will allow synchronization between experiment and modeling approaches for droplet entrainment testing and analysis, improving diagnostics, prognostics, and decision-making to accelerate regulatory approval.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2023

Sequential Bayesian Methods for Analyzing Computer Models

Efficient analysis of computer models is essential for the validation and uncertainty quantification of those models. Surrogate models, and Gaussian processes in particular, are a common and powerful approach to analyzing computer models that treat computer models as a black-box function. Gaussian processes form a Bayesian model over a space of functions that gives a measure of uncertainty about the computer model output at unobserved locations and a framework for sequential sampling. This tutorial will show how to fit Gaussian processes on a series of test functions and apply sequential design techniques to estimate extrema, level sets, and reliabilities of those test functions.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗

DOE OSTI2023

Revisiting Interior Water Mass Responses to Surface Forcing Changes and the Subsequent Effects on Overturning in the Southern Ocean

Abstract Two coupled climate models, differing primarily in horizontal resolution and treatment of mesoscale eddies, were used to assess the impact of perturbations in wind stress and Antarctic ice sheet (AIS) melting on the Southern Ocean meridional overturning circulation (SO MOC), which plays an important role in global climate regulation. The largest impact is found in the SO MOC lower limb, associated with the formation of Antarctic Bottom Water (AABW), which in both models is enhanced by wind and weakened by AIS meltwater perturbations. Even though both models under the AIS melting perturbation show similar AABW transport reductions of 4–5 Sv (50%–60%), the volume deflation of AABW south of 30°S is four times greater in the higher resolution simulation (−20 vs. −5 Sv). Water mass transformation (WMT) analysis reveals that surface‐forced dense water formation on the Antarctic shelf is absent in the higher resolution and reduced by half in the lower resolution model in response to the increased AIS melting. However, the decline of the AABW volume (and its inter‐model difference) far exceeds the surface‐forced WMT changes alone, which indicates that the divergent model responses arise from interactions between changes in surface forcing and interior mixing processes. This model divergence demonstrates an important source of uncertainty in climate modeling, and indicates that accurate shelf processes together with scenarios accounting for AIS melting are necessary for robust projections of the deep ocean's response to anthropogenic forcing.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Beam availability has increased at the SNS, however, the targeted availability is greater than 95 %, while the SNS has failed to meet lower targets in the past. The HVCM used to power the linac klystrons have been one source of lost beam time and was chosen to explore using AI/ML techniques to improve reliability. Among the possibilities being explored are automating the tuning of HVCMs and predicting component failures such as capacitor aging, rectifier assemblies containing hundreds of diodes, and insulating oil degradation. The methodology pursued includes data cleaning, de-noising, post-analysis data labeling, and machine learning model development. We explore using Long Short-Term Memory and autoencoders for anomaly detection and prognostication used to schedule maintenance. We evaluate the use of model regularizers and constraints to improve the performance of the model and investigate methods to estimate the uncertainty of the models to provide a robust prediction with statistical interoperability. This paper describes the operational experience and known failures of the HVCMs and the proposed ML methodology and the preliminary results of training the AI/ML algorithms.

Pappas, G. C.↗

DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Pappas, Chris↗

DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Pappas, Chris↗

DOE OSTI2020

Null Space Monte Carlo Evaluation of the Plateau to River Model

The Plateau to River Groundwater Model (P2R Model) is a groundwater flow and contaminant fate and transport (F&T) simulation model used to support remedial activities conducted by CH2M HILL Plateau Remediation Company at the Hanford Site in Washington State. Figure 1-1 illustrates the P2R Model extents, discretization, and boundary conditions. The P2R Model provides a computational framework to simulate the F&T of contaminants in groundwater associated with the 200-PO-1, 200-UP-1, 200-BP-5, and 200-ZP-1 Groundwater Operable Units (OUs) in the Hanford Site Central Plateau. In addition, the model includes adjacent areas and facilities (e.g., the State Approved Land Disposal Site). Intended and anticipated uses of the model include calculating water levels, hydraulic gradients, and groundwater flows throughout the model domain (encompassing the 200 West and 200 East Areas) for use in subsequent F&T calculations for contaminants of concern and developing scale-appropriate, telescopic-mesh refinement models for detailed evaluation of areas within the model domain where required. The overall objective of the modeling effort is to provide a basis for making informed remedial action decisions based on descriptions of current and expected future contaminant concentrations in groundwater at decision points within the OU boundaries. The objective for the model development phase is to create a common modeling platform that can be used for investigations of the Central Plateau groundwater OUs and areas downgradient toward the Columbia River. The P2R Model calibration to historical data observed at the Hanford Site is documented in CP-57037, Model Package Report for the Plateau to River Model Version 8.3. The purpose of this environmental calculation is to describe a null space Monte Carlo (NSMC) evaluation was conducted with the historic calibration of the P2R model. Use of numerical groundwater models is always accompanied with uncertainty in the results produced by a model because models are approximations of reality. Thus, by definition, lack the detail to fully represent observed behavior. Use of numerical techniques, such as a NSMC analysis, can help in identifying and quantifying the potential uncertainties associated with a numerical model such as the P2R Model. Use of the NSMC approach results in 100 groundwater flow models that are variants of the calibrated P2R Model. These variant models can be used to evaluate uncertainty in model predictions made by the calibrated P2R Model for other analyses. A secondary purpose of the environmental calculation is to establish these variant models for use with other applications.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2021

Evaluation and Uncertainty of Radioxenon Transport with a Mesoscale Model after the February 2013 Underground Test in North Korea

Abstract The transport of radioxenon released from the February 2013 underground nuclear weapons test in North Korea was analyzed at two receptors—one at the Comprehensive Nuclear Test Ban Treaty site Rn58 in Russia (400 km downwind) and a second at Rn38 in Japan (1000 km downwind). Transport was modeled with two ensembles of mesoscale simulations, one generated with varying initial and lateral boundary conditions taken from the Global Forecasting System uncertainty ensemble, and a second created from different parameterizations and surface conditions. The wind variability was similar for the two ensembles and consistent with observations at 925 mb (1 mb = 1 hPa) but not at the surface. Biases in calculated surface winds and the radioxenon concentration in the ensembles were attributed mainly to poor simulation of the sea breeze at both locations and mountain lee affects at Rn38 in Japan. These wind regimes affected the timing of the surface radioxenon plume at Rn58 and its duration at Rn38. Surface wind variability induced by terrain and land–sea contrast (the sea breeze) also had a significant effect on the surface winds and plume dynamics, including blocking of flow approaching elevated terrain near Vladivostok and the west side of Japan. Increased plume uncertainty was seen at night because of surface wind variability. Measured surface chemical variability was larger than found in the first European Tracer Experiment in central Europe. The study found that horizontal model resolution contributes to uncertainty but not as much as vertical resolution, boundary layer parameterizations, and assimilation of surface meteorological data near the receptor.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Motion Planning Algorithms for Safety and Quantum Computing Efficiency

Motion planning remains a fundamental problem in robotics. Sampling-based algorithms use randomization to allow efficient solutions to this complex problem. As mobile robots and autonomous vehicles become more prevalent in everyday life, motion planning must be applied to increasingly challenging scenarios. Safety has become a paramount concern in motion planning for ensuring robotic applications enrich human lives. To date, many motion planning techniques to increase safety in the face of uncertain and dynamic environments have been developed. This dissertation first addresses distributional safety of Rapidly-Exploring Random Trees (RRT) through our algorithm W-Safe RRT. To acknowledge distributional uncertainty and poor modeling, W-Safe RRT uses the Wasserstein metric to provide a probabilistic bound on the distributional distance between a robot and obstacles. Human-interpretable environmental agent classification allows online safety margin adaptation. We propose and analyze an integrating region method for online classification that increases actor labeling accuracy based on behavioral feature values when compared to state of the art methods. The method performs class assignments based on local maximum likelihood in a created behavioral feature-space, allowing a notion of classification uncertainty. Model-based methods with safety guarantees can quickly become computationally in tractable, especially with multiple agents, higher dimensions, and plentiful unknowns. Sampling based algorithms have been parallelized for computation with multi-core computers and GPUs. We consider the use of quantum algorithms and computers for sampling-based motion planning for the first time. Quantum computing performs operations on superpositions of states and can solve certain problems much more efficiently than classical computers, but introduces previously unseen challenges. With Quantum-RRT, we recast the motion planning problem into a database-search structure and use Quantum Amplitude Amplification to find reachable states in the database with a quadratic performance increase over classical methods. We address two error sources with this method: quantum measurement and quantum oracle errors. We then extend this method to Parallel Quantum-RRT, which uses a manager-worker architecture with multiple parallel quantum workers to increase database search efficiency. We compare algorithm architectures and characterize probabilities of multiple workers finding solutions. Lastly, we test in simulation the quantum algorithms against classical versions in a wide variety of scenarios, concluding that a similar parallelization improvement is to be found in the quantum case as was found in the parallelization of classical RRT.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗

DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Improving the representation of shallow cumulus convection with the simplified-higher-order-closure–mass-flux (SHOC+MF v1.0) approach

Abstract. Parameterized boundary layer turbulence and moist convection remain some of the largest sources of uncertainty in general circulation models. High-resolution climate modeling aims to reduce that uncertainty by explicitly attempting to resolve deep moist convective motions. An example of such a model is the Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) with a target global resolution of 3.25 km, allowing for a more accurate representation of complex mesoscale deep convective dynamics. Yet, small-scale planetary boundary layer turbulence and shallow convection still need to be parameterized, which in SCREAM is accomplished through the turbulent-kinetic-energy-based (TKE-based) simplified higher-order closure (SHOC) – a simplified version of the assumed-double-Gaussian-PDF (probability density function) higher-order-closure method. In this paper, we implement a stochastic-multiplume mass-flux (MF) parameterization of dry and shallow convection in SCREAM to go beyond the limitations of double-Gaussian-PDF closures and couple it to SHOC (SHOC+MF). The new parameterization implemented in a single-column model type version of SCREAM produces results for two shallow cumulus convection cases (marine and continental shallow convection) that agree well with the reference data from large-eddy simulations, thus improving the general representation of the thermodynamic quantities and their turbulent fluxes as well as cloud macrophysics in the model. Furthermore, SHOC+MF parameterization shows weak sensitivity to the vertical grid resolution and model time step.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Uncertainty of SW Cloud Radiative Effect in Atmospheric Models Due to the Parameterization of Liquid Cloud Optical Properties

Clouds are largely responsible for the spread of climate models predictions. Here we focus on the uncertainties in cloud shortwave radiative effect due to the parameterization of liquid cloud single scattering properties (SSPs) from liquid water content (LWC) and droplet number concentration (N), named parameterization of cloud optical properties. Uncertainties arise from not accounting for the droplet size distribution (DSD)—which affects the estimation of the effective radius (r eff ) and modulates the r eff -dependency of the SSPs—and from averaging SSPs over wide spectral bands. To assess these uncertainties a series of r eff -dependent SSPs parameterizations corresponding to various DSDs and spectral averaging methods are derived and implemented in a radiative code. Combined with the DSD-dependent estimation of r eff they are used to compute the bulk radiative properties (reflectance, transmittance, absorptance) of various clouds (defined in terms of LWC and N), including a homogeneous cloud, more realistic case studies, and outputs of a climate model. The results show that the cloud radiative forcing can vary up to 20% depending on the assumed DSD. Likewise, differences up to 20% are obtained for heating rates. The estimation of r eff is the main source of uncertainty, while the SSPs parameterization contributes to around 20% of the total uncertainty. Spectral averaging is less an issue, except for atmospheric absorption. Overall, global shortwave cloud radiative effect can vary by 6 W m –2 depending on the assumed DSD shape, which is about 13% of the best observational estimate.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Understanding uncertainties in projections of western North Pacific tropical cyclogenesis

Reliable projections of tropical cyclone (TC) activities in the western North Pacific (WNP) are crucial for climate policy-making in densely-populated coastal Asia. Existing projections, however, exhibit considerable uncertainties with unclear sources. Here, based on future projections by the latest Coupled Model Intercomparison Project Phase 6 climate models, we identify a new and prevailing source of uncertainty arising from different TC identification schemes. Notable differences in projections of detected TCs and empirical genesis potential indices are found to be caused by inconsistent changes in dynamic and thermodynamic environmental factors affecting TC formations. While model uncertainty holds the secondary importance, we show large potential in reducing it through improved model simulations of present-day TC characteristics. Internal variability noticeably impacts near-term projections of the WNP tropical cyclogenesis, while the relative contribution of scenario uncertainty remains small. Our findings provide valuable insights into model development and TC projections, thereby aiding in adaptation decisions.

54 ENVIRONMENTAL SCIENCES↗