Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗

Important role of stratospheric injection height for the distribution and radiative forcing of smoke aerosol from the 2019–2020 Australian wildfires

More than 1 Tg smoke aerosol was emitted into the atmosphere by the exceptional 2019–2020 southeastern Australian wildfires. Triggered by the extreme fire heat, several deep pyroconvective events carried the smoke directly into the stratosphere. Once there, smoke aerosol remained airborne considerably longer than in lower atmospheric layers. The thick plumes traveled eastward, thereby being distributed across the high and mid-latitudes in the Southern Hemisphere, enhancing the atmospheric opacity. Due to the increased atmospheric lifetime of the smoke plume, its radiative effect increased compared to smoke that remains in lower altitudes. Global models describing aerosol-climate impacts lack adequate descriptions of the emission height of aerosols from intense wildfires. Here, we demonstrate, by a combination of aerosol-climate modeling and lidar observations, the importance of the representation of those high-altitude fire smoke layers for estimating the atmospheric energy budget. Through observation-based input into the simulations, the Australian wildfire emissions by pyroconvection are explicitly prescribed to the lower stratosphere in different scenarios. Based on our simulations, the 2019–2020 Australian fires caused a significant top-of-atmosphere (TOA) hemispheric instantaneous direct radiative forcing signal that reached a magnitude comparable to the radiative forcing induced by anthropogenic absorbing aerosol. Up to +0.50 W m -2 instantaneous direct radiative forcing was modeled at TOA, averaged for the Southern Hemisphere (+0.25 W m -2 globally) from January to March 2020 under all-sky conditions. At the surface, on the other hand, an instantaneous solar radiative forcing of up to -0.81 W m -2 was found for clear-sky conditions, with the respective estimates depending on the model configuration and subject to the model uncertainties in the smoke optical properties. Since extreme wildfires are expected to occur more frequently in the rapidly changing climate, our findings suggest that high-altitude wildfire plumes must be adequately considered in climate projections in order to obtain reasonable estimates of atmospheric energy budget changes.

54 ENVIRONMENTAL SCIENCES↗

Indirect climate impacts of the Hunga eruption

Injection of sulfur and water vapour by the Hunga volcanic eruption significantly altered chemical composition and radiative budget of the stratosphere. Yet, whether the eruption could also affect surface climate, especially via indirect pathways, remains poorly understood. Here we investigate these effects using large ensembles of simulations with the CESM2(WACCM6) Earth system model, incorporating interactive chemistry and aerosols in both coupled ocean and atmosphere-only configurations. We find some statistically significant extratropical regional climate responses to the eruption driven by circulation changes; these are partially linked to the modulation of El Niño–Southern Oscillation, and its associated teleconnections, and to perturbations of the stratospheric polar vortex in both hemispheres. The stratospheric anomalies affect surface climate through modulating the North Atlantic Oscillation in the Northern Hemisphere (up to three boreal winters following the eruption) and the Southern Annular Mode in the Southern Hemisphere in late 2023. The latter is partly related to a concurrent reduction in Antarctic ozone, as increased stratospheric aerosols and water vapor reach the polar vortex. Our study suggests that the eruption could have had a non-negligible influence on regional surface climate, and discusses the mechanisms via which such an influence could occur. However, the results also highlight that this forcing is relatively weak compared to interannual variability, and is subject to model uncertainties in the representation of key processes. More research is thus needed before definitive statements on the role of the eruption in contributing to surface climate and weather events in the following years are made.

Geosciences↗

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗

Lidar measurements of yawed-wind-turbine wakes: characterization and validation of analytical models

Abstract. Wake measurements of a scanning Doppler lidar mounted on the nacelle of a full-scale wind turbine during a wake-steering experiment were used for the characterization of the wake flow, the evaluation of the wake-steering set-up, and the validation of analytical wake models. Inflow-scanning Doppler lidars, a meteorological mast, and the supervisory control and data acquisition (SCADA) system of the wind turbine complemented the set-up. Results from the wake-scanning Doppler lidar showed an increase in the wake deflection with the yaw angle and that the wake deflection was not in all cases beneficial for the power output of a downstream turbine due to a bias of the inflow wind direction perceived by the yawed wind turbine and the wake-steering design implemented. Both observations could be reproduced with an analytical model that was initialized with the inflow measurements. Error propagation from the inflow measurements that were used as model input and the power coefficient of a waked wind turbine contributed significantly to the model uncertainty. Lastly, the span-wise cross section of the wake was strongly affected by wind veer, masking the effects of the yawed wind turbine on the wake cross sections.

17 WIND ENERGY↗

MSD CoP Webinar: Applied Science for Decision-Making at the Water-Energy Nexus

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: The energy transition is a game-changer across multiple sectors, requiring researchers and practitioners to re-evaluate the evolving connections between climate, water, and power systems, as well as the associated co-management of resources and decision-making. In anticipation of new technologies, policies, business models, and other solutions, applied science for decision-making at the climate-water-energy nexus is needed to support transitions with the expected climate resilience, maintained and enhanced energy security, thriving economies, and equity considerations. Through panelists' applied research and operational experience, the webinar will provide lesson-learnt in how to increase the readiness of water-energy research and become actionable in the context of energy transitions. A number of themes will be discussed, including the connection between growing computational resources and complexity of models, and the implications on the intended users, the actual actionable products, the availability of data for validation of the models, uncertainty characterization and decision-making under uncertainty, and the communication of the novelty to decision-makers and the public. Presenters : David McCollum (Oak Ridge National Laboratory; Co-Chair), and Gokul Iyer (Pacific Northwest National Laboratory; Co-Chair), Curt Jawdy (Tennessee Valley Authority), Nathalie Voisin (Pacific Northwest National Laboratory), and Andrew D. Jones (Lawrence Berkeley National Laboratory) Moderator: Pat M. Reed (MSD CoP Facilitation Team) This webinar was held on: April 30, 2024 from 1-2 PM ET

Energy↗

Data-Driven Computation of Probabilistic Marching Cubes for Efficient Visualization of Level-Set Uncertainty

Uncertainty visualization is an important emerging research area. Being able to visualize data uncertainty can help scientists improve trust in analysis and decision-making. However, visualizing uncertainty can add computational overhead, which can hinder the efficiency of analysis. In this paper, we propose novel data-driven techniques to reduce the computational requirements of the probabilistic marching cubes (PMC) algorithm. PMC is an uncertainty visualization technique that studies how uncertainty in data affects level-set positions. However, the algorithm relies on expensive Monte Carlo (MC) sampling for the multivariate Gaussian uncertainty model because no closed-form solution exists for the integration of multivariate Gaussian. In this work, we propose the eigenvalue decomposition and adaptive probability model techniques that reduce the amount of MC sampling in the original PMC algorithm and hence speed up the computations. Our proposed methods produce results that show negligible differences compared with the original PMC algorithm demonstrated through metrics, including root mean squared error, maximum error, and difference images. We demonstrate the performance and accuracy evaluations of our data-driven methods through experiments on synthetic and real datasets.

Athawale, Tushar↗

A317_Fast and Thermal Neutron Spectrum Dosimetry Measurements in the Advanced Test Reactor large-B and small-I Positions Following the Sixth Core Internals Change-out

The Advanced Test Reactor (ATR) has a wide variety of irradiation positions that have had experiments that were developed by users from around the world. Most experiment irradiations rely on thoroughly benchmarked numerical models. However, some irradiation positions in ATR are not as well- characterized and are complicated by spectral perturbations from control cylinder orientation. The “small I” and “large-B” irradiation positions are located nearby control cylinders and suffer from these flux perturbations from control cylinder orientations that change during an irradiation cycle to maintain the desired core power distribution. Models predicted that these types of position would exhibit both spectral shifts and amplitude changes in neutron flux, but few measurements have been conducted to benchmark these predictions. Recently, requalification testing was performed to confirm the operational readiness of the ATR following the completion of the Core Internals Change-out (CIC). These tests provided a unique opportunity to validate the analytical methods used to simulate the ATR because nearly all components in the reactor were in a clean as-built state, significantly reducing modelling uncertainties. One subset of the testing included characterization of the fast and thermal neutron flux in the “small-I” and “large-B” positions using silver, cobalt, and nickel neutron dosimetry. In contrast to typical irradiation cycles, the control cylinders were held in position during the post-CIC nuclear testing. The specific activity of these dosimeter wires was measured following two low-power tests with different control cylinder positions.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Dark Matter Constraints from Small-Scale Cosmic Structure

Small-scale cosmic structure provides a powerful test of the fundamental nature of dark matter (DM). A wide range of DM models impact matter clustering on small scales, including warm, fuzzy, and (self-)interacting DM. In these scenarios, DM physics such as free-streaming, wave interference, and self/Standard Model interactions alter the abundance and internal structure of DM halos. Cosmological and astrophysical probes of nonlinear structure---including dwarf galaxies, strong lensing, the Lyman-$α$ forest, stellar streams, and high-redshift galaxies---are therefore sensitive to these effects. Here, we review DM constraints provided by small-scale structure, focusing on observables that probe scales smaller than $\sim 1~\mathrm{Mpc}$, which define the frontier of current measurements. We summarize how these constraints have been translated to limits on microphysical DM models, and we discuss key modeling uncertainties and observational systematics. Finally, we highlight the growing importance of probe combination and simulation-based inference for this field, and we overview upcoming observational facilities that will sharpen small-scale structure tests of DM physics.

Nadler, Ethan O. [UC, San Diego] (ORCID:0000000211↗

Characterizing the Electromagnetic Response of the NOvA Detectors

The NOvA Test Beam Program was commissioned to complement the full-scale NOvA experiment in its goal of measuring neutrino oscillations. The NOvA Experiment consists of a 300-ton Near Detector and a 14-kton Far Detector, both exposed to the same beam, which can be operated in neutrino or antineutrino mode from Fermilab at an off-axis angle of 14.6~mrad. These detectors can discriminate between $\nu_\mu$-CC and $\nu_e$-CC neutrino (or corresponding antineutrino) events, enabling appearance and disappearance measurements of these flavors across the \SI{810}{\kilo\meter} near-to-far detector baseline. From these measurements, the underlying parameters of the three-flavor PMNS oscillations framework are measured. The NOvA Test Beam uses identical technology to the full-scale detectors, but scaled down to 30~tons. It is exposed to a beam of charged particles closely matched to the daughter products of NOvA (anti)neutrino interactions in both energy and species. An instrumented beamline determines both particle momentum and species upstream of the NOvA detector, allowing for a crisp measurement of the NOvA detector response to these known inputs. This dissertation presents an analysis of the electromagnetic response of the NOvA hardware and establishes a framework for incorporating these results to enhance the physics reach of the experiment. Prior to this work, the electromagnetic energy response of the NOvA detector relied primarily on simulation-driven calibration together with a globally applied energy scale uncertainty. The measurements presented here provide direct test beam constraints on the detector response, enabling particle-dependent and potentially energy-dependent uncertainty models derived from controlled electromagnetic inputs.

Myers, Dalton Grant [U. Texas, Austin (main)] (ORC↗

Uncertainty Propagation within Chained Models for Machine Learning Reconstruction of Neutrino-LAr Interactions

Sequential or chained models are increasingly prevalent in machine learning for scientific applications, due to their flexibility and ease of development. Chained models are particularly useful when a task is separable into distinct steps with a hierarchy of meaningful intermediate representations. In reliability-critical tasks, it is important to quantify the confidence of model inferences. However, chained models pose an additional challenge for uncertainty quantification, especially when input uncertainties need to be propagated. In such cases, a fully uncertainty-aware chain of models is required, where each step accepts a probability distribution over the input space, and produces a probability distribution over the output space. In this work, we present a case study for adapting a single model within an existing chain, designed for reconstruction within neutrino-Argon interactions, developed for neutrino oscillation experiments such as MicroBooNE, ICARUS, and the future DUNE experiment. We test the performance of an input uncertainty-enabled model against an uncertainty-blinded model using a method for generating synthetic noise. By comparing these two, we assess the increase in inference quality achieved by exposing models to upstream uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

energy modeling↗

Toward shell model interactions with credible uncertainties

Background: The nuclear shell model is a powerful framework for predicting nuclear structure observables, but relies on interaction matrix elements fit to experimental data as its inputs. Extending the shell model's applicability, particularly toward dripline nuclei, requires efficient fitting methods and credible uncertainty quantification. Traditional approaches face computational challenges and may underestimate uncertainties. Purpose: We develop and test a framework combining eigenvector continuation and Markov chain Monte Carlo to efficiently fit shell model interaction matrix elements and quantify their uncertainties. Methods: Eigenvector continuation is used to emulate shell model calculations, reducing computational costs. The emulator enables Markov chain Monte Carlo sampling to optimize interaction matrix elements and rigorously assess parametric uncertainties. Here, the framework is benchmarked using the USDB interaction in the 𝑠⁢𝑑 shell. Results: The emulator reproduces the USDB interaction with negligible error, validating its use in shell model fitting applications. However, we find that to obtain credible predictive intervals, the model defect of the shell model itself, rather than experimental or emulator error, must be taken into account in order to obtain credible uncertainties. Conclusions: The proposed framework provides an efficient and rigorous approach for fitting shell model interactions and quantifying uncertainties. Further, the normality assumption used in the past appears sufficient to describe the distribution of interaction matrix elements. However, it is crucial to account for model correlations to avoid underestimating uncertainties.

Nuclear forces↗

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗

Surrogate multi-fidelity data and model fusion for scientific discovery and uncertainty quantification in Earth System Models

This whitepaper addresses the Earth and Environmental Systems Sciences Division (EESSD)’s predictability challenges in modeling the integrated water cycle and data-model integration. Specifically, it focuses on reducing and characterizing the uncertainty in the representation of process models for unresolved physics, either due to model resolution or limited by the physical under standing or computational efficiency, and the use of observational data for in-situ process parameter optimization within ESM. The described methods may also be used to determine the nature of responses (e.g. strength and direction), and hence to identify critical processes that drive the overall ESM responses to perturbation in the forcing

54 ENVIRONMENTAL SCIENCES↗

Evolution of the Antarctic Ice Sheet from 2000–2300 and beyond: model sensitivity and uncertainty analysis using MPAS-Albany Land Ice

We present a description of the Antarctic Ice Sheet model configuration submitted to the ISMIP6-Antarctica-2300 experiment using the MPAS-Albany Land Ice model, along with three new sets of simulations: (1) a set of extended simulations to 2500 for three forced experiments and to 2775 for the control experiment; (2) a sensitivity analysis of our model configuration to parameters controlling basal sliding and sub-shelf melt, and to model structural choices including the choice of the energy and stress balances; and (3) a 72-member ensemble run on graphics processing units (GPUs) and analysis of variance to determine the primary sources of uncertainty in our ice-sheet model projections. Our extended simulations predict rapid retreat beginning after 2300 for SSP1-2.6 forcing and after 2500 for present-day (control) forcing, primarily in the Amundsen Sea Embayment. We find that varying the sub-shelf melt parameter between the 5th to 95th percentile values for a mean-Antarctic calibration target results in an up to ∼ ± 40 % change in sea-level contribution relative to our baseline simulations that used the median value. Using a linear basal sliding law reduces sea-level contribution by 51 %–73 % relative to our baseline nonlinear sliding law with an exponent of 1/5. When using basal sliding law exponents of 1/3 and 1/10, the overall difference from our baseline simulations at 2300 is on the order of 10 %. The Amundsen Sea Embayment region displays a strongly non-linear dependence of mass loss on the sliding law exponent, with no discernible relationship between the sliding law exponent and the mass loss by 2300, while the sectors feeding the Ross and Filchner-Ronne ice shelves exhibit more mass loss with a more-plastic sliding law. Our model fidelity sensitivity experiments reveal a 9 %–31 % increase in sea-level contribution when using a depth-integrated stress balance approximation relative to our three-dimensional solver, while using a fixed-in-time temperature field increases sea-level contribution by 14 %–88 % relative to two thermomechanically coupled configurations. Our 72-member ensemble and analysis of variance show that the uncertainty in long-term projections is dominated by the choice of Earth system model forcing and the presence or absence of hydrofracture forcing, rather than uncertainty in sliding and sub-shelf melt parameters.

58 GEOSCIENCES↗

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

bifacial↗

Conditional Karhunen–Loève regression model with Basis Adaptation for high-dimensional problems: Uncertainty quantification and inverse modeling

Here, we propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems’ spatially heterogeneous parameter fields, with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen–Loève expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the KLE coefficients. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loève expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements of the parameter field via Gaussian process regression, and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1000-dimensional representation of the model’s log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models.

97 MATHEMATICS AND COMPUTING↗