Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Aircraft-derived particle fluxes distinguish entrainment zone and decoupled layer nucleation in marine boundary layers

The vertical distribution of freshly nucleated aerosol particles in the marine boundary layer remains poorly constrained, limiting our ability to represent new particle formation in climate models. Here we characterize 3–10 nm particle events, termed small particle events (SPEs), by deriving their vertical turbulent fluxes from aircraft measurements during the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) campaign. To overcome stationarity limitations of traditional eddy covariance methods, we applied continuous wavelet transform analysis to data collected during June–July 2017 and January–February 2018 flights over the Azores. Our flux-based analysis revealed two distinct SPE scenarios with different vertical structures and spatial extents. The first featured nucleation in the entrainment zone, where free tropospheric air entrains into the boundary layer. The second showed nucleation in the decoupled layer, a stratified region between the well-mixed surface layer and cloud-topped upper boundary layer. In both cases, convergence of air masses from different layers diluted preexisting aerosol surface area to very low levels, creating conditions favorable for nucleation and generating strong downward particle fluxes. SPEs occurred in 15 % of flights, challenging prevailing theoretical expectations that new particle formation should rarely occur in marine boundary layers due to high condensation and coagulation sink capacity of sea spray aerosols. Aircraft-derived particle fluxes provide first observational constraints on the vertical location and source strength of likely nucleation regions in the remote marine boundary layer, improving aerosol source representations in climate models and reducing uncertainties in aerosol-cloud interactions.

Rasheeda Satheesh, Ajmal [North Carolina State Uni↗

The sensitivity of the Fitch wind farm parameterization to a three-dimensional planetary boundary layer scheme

Abstract. Wind plant wake impacts can be estimated with a number of simulation methodologies, each with its own fidelity and sensitivity to model inputs. In turbine-free mesoscale simulations, hub-height wind speeds often significantly vary with the choice of a planetary boundary layer (PBL) scheme. However, the sensitivity of wind plant wakes to a PBL scheme has not been explored because, as of the Weather Research and Forecasting model v4.3.3, wake parameterizations were only compatible with one PBL scheme. We couple the Fitch wind farm parameterization with the new NCAR 3DPBL scheme and compare the resulting wakes to those simulated with a widely used PBL scheme. We simulate a wind plant in pseudo-steady states under idealized stable, neutral, and unstable conditions with matching hub-height wind speeds using two PBL schemes: MYNN and the NCAR 3DPBL. For these idealized scenarios, average hub-height wind speed losses within the plant differ between PBL schemes by between −0.20 and 0.22 m s−1, and correspondingly, capacity factors range between 39.5 %–53.8 %. These simulations suggest that PBL schemes represent a meaningful source of modeled wind resource uncertainty; therefore, we recommend incorporating PBL variability into future wind plant planning sensitivity studies as well as wind forecasting studies.

17 WIND ENERGY↗

Measurement of the Higgs boson production via vector boson fusion and its decay into bottom quarks in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A measurement of the Higgs boson (H) production via vector boson fusion (VBF) and its decay into a bottom quark-antiquark pair ($\mathrm{b\bar{b}}$) is presented using proton-proton collision data recorded by the CMS experiment at $\sqrt{s}$ = 13 TeV and corresponding to an integrated luminosity of 90.8 fb$^{-1}$. Treating the gluon-gluon fusion process as a background and constraining its rate to the value expected in the standard model (SM) within uncertainties, the signal strength of the VBF process, defined as the ratio of the observed signal rate to that predicted by the SM, is measured to be $\mu^\text{qqH}_\mathrm{Hb\bar{b}}$ = 1.01$^{+0.55}_{-0.46}$. The VBF signal is observed with a significance of 2.4 standard deviations relative to the background prediction, while the expected significance is 2.7 standard deviations. Considering inclusive Higgs boson production and decay into bottom quarks, the signal strength is measured to be $\mu^\text{incl.}_\mathrm{Hb\bar{b}}$ = 0.99$^{+0.48}_{-0.41}$, corresponding to an observed (expected) significance of 2.6 (2.9) standard deviations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗

End-to-end differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using controllable-fidelity simulations that have fast execution time or can yield additional insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate an end-to-end digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes for linac and ring simulation, the development of generic interfaces between surrogate and physics-based sections, and presenting the control interface as either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to implement larger proton accelerators like PIPII and Booster.

Kuklev, N. [Fermilab]↗

Code and Data for "Quantifying Uncertainties in Greenhouse Gas Savings and Mitigation Costs with Cellulosic Biofuels"

Use of cellulosic biofuels from non-feedstocks are modeled using the BEPAM (Biofuel and Environmental Policy Analysis Model) model to quantifying the uncertainties about induced land use change effects, net greenhouse gas saving potential, and economic costs. The code is in GAMS, general algebraic modeling language. NOTE: Column 3 is titled "BAU" in "merged_BAU.gdx", "merged_RFS.gdx", and "merged_CEM.gdx", but contains "RFS" data in "merged_RFS.gdx" and "CEM" data in "merged_CEM.gdx".

BEPAM↗

Unveiling the Essential Parameters Driving Mineral Reactions during CO2 Storage in Carbonate Aquifers through Proxy Models

Numerical simulation is a commonly employed technique for studying carbon dioxide (CO2) storage processes in porous media, particularly saline aquifers. It enables the representation of diverse trapping mechanisms and the assessment of CO2 retention capacity within the subsurface. The intricate physicochemical phenomena involved necessitate the incorporation of multiphase flow, accurate depiction of fluid and rock properties, and their interactions. Among these factors, geochemical reaction rates and mechanisms are pivotal for successful CO2 trapping in carbonate reactive rocks. However, research on kinetic parameters and the influence of lithology on CO2 storage remains limited. This limitation is partly due to the challenges faced in laboratory experiments, where the time scale of the reactions and the lack of in situ conditions hinder accurate measurement of mineral reaction rates. This study employs proxy models constructed using response surfaces calibrated with simulation results to address uncertainties associated with geochemical reactions. Monte Carlo simulation is utilized to explore a broader range of parameters and identify influential factors affecting CO2 mineralization. The findings indicate that an open database containing kinetic parameters can support uncertainty assessment. Additionally, the proxy models effectively represent objective functions related to CO2 injectivity and mineralization, with calcite dissolution playing a predominant role. pH, calcite concentration, and CO2 injection rate significantly impact dolomite precipitation, while quartz content remains unaffected.

58 GEOSCIENCES↗

Theoretical and calculable dependent variables and their covariance in nuclear data libraries [Slides]

This presentation begins by defining observables, including theoretical observable, calculable observable, and measured observable. It also provides definitions and examples of experimental effects. Additionally, uncertainty in evaluated libraries and a metric to probe evaluated uncertainty is presented. In conclusion, being related to theoretical quantities such as resonance parameters, the uncertainty in ENDF libraries (e.g., ENDF/B-VIII.0) can be overestimated because it is usually evaluated under the guidance of experimental uncertainty: lim Δσexp.corr.→0 Δσ = Δσ theoretical model . The presentation states that a clear distinction of the uncertainty between nuclear theoretical models and experimental corrections should be revisited and this is important since (e.g., transport) simulations need theoretical quantities convoluted with specific operational parameters and material configurations. It also states that strong coupling between uncertainty quantification methodologies and optimization procedures exists, and it is necessary to develop methodologies to obtain uncertainty on theoretical models from physical and mathematical constraints.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Inverse Modeling of Hydrologic Parameters in CLM4 via Generalized Polynomial Chaos in the Bayesian Framework

In this work, generalized polynomial chaos (gPC) expansion for land surface model parameter estimation is evaluated. We perform inverse modeling and compute the posterior distribution of the critical hydrological parameters that are subject to great uncertainty in the Community Land Model (CLM) for a given value of the output LH. The unknown parameters include those that have been identified as the most influential factors on the simulations of surface and subsurface runoff, latent and sensible heat fluxes, and soil moisture in CLM4.0. We set up the inversion problem in the Bayesian framework in two steps: (i) building a surrogate model expressing the input–output mapping, and (ii) performing inverse modeling and computing the posterior distributions of the input parameters using observation data for a given value of the output LH. The development of the surrogate model is carried out with a Bayesian procedure based on the variable selection methods that use gPC expansions. Our approach accounts for bases selection uncertainty and quantifies the importance of the gPC terms, and, hence, all of the input parameters, via the associated posterior probabilities.

97 MATHEMATICS AND COMPUTING↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

National Opacity Program: Analysis of Opacity-relevant X-ray Emission Spectra (Milestone Report ID 7121)

We have produced high energy density iron plasmas at temperatures above 1 keV and electron densities exceeding 1023 cm -3 (~ 1 g/cm 3 ) using the Orion laser at the Atomic Weapons Establishment. These plasmas were created by irradiating 50 µm diameter layered targets with frequency doubled (λ = 527 nm), 1 ps laser pulses focused to a 100 µm diameter producing an irradiance of ~ 2 x 10 18 W/cm 2 . The buried layer targets consist of 160 nm iron sulfide (FeS), 60 nm potassium chloride (KCl), and 15 nm carbon. The combined layers are tamped on both sides with 3 µm of parylene-N. The x-ray emission from the plasma was measured using two time-resolved, and four time-integrated Bragg crystal spectrometers, as well as one time-integrated imaging system. One time-resolved x-ray spectrometer measured emission from L-shell transitions in highly charged iron, the other from K-shell transitions in helium-like S 14+ and hydrogen-like S 15+ . The time-integrated spectrometers are intensity-calibrated and measured emission from K-shell transitions in sulfur, potassium, chlorine, and both K-shell and L-shell transitions in iron. The density and temperature of the plasma were determined by modeling the x-ray spectra using different spectral and hydrodynamic modeling packages. A brief overview of the uncertainties associated with the measurements and models are presented. We also give an overview of our 1-D HYDRA-DCA radiation-hydrodynamics model and improvements for future work. Our results aid in assessing experimental uncertainties associated with plasma uniformity and with x-ray emission employed as diagnostics in opacity experiments at temperatures and densities not achievable elsewhere and represent a significant step in creating and diagnosing plasmas near LTE. These results are summarized as part of the completion requirements for milestone 7121

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Surrogate-driven Variance-based Sensitivity Analysis of Thermal Storage Tanks in Integrated Energy Systems

Sensitivity analysis and uncertainty quantification are essential steps for enhancing the accuracy of computational models by identifying and mitigating uncertainties. This study focuses on these steps for the Thermal Energy Delivery System at Idaho National Laboratory, specifically targeting the thermocline tank. Using a Modelica/Dymola simulation model, the study perturbed various design parameters and boundary conditions, including shape factor, porosity, outlet temperature, inlet mass flow rate, and system pressure, to predict and quantify uncertainty in the tank’s ax- ial temperature. A dataset of over 1,000 simulations was generated, and surrogate models were developed using the pyMAISE (Michigan Artificial Intelligence Standard Environment) library, which is an Automatic Machine Learning library for nuclear engineering applications. The optimal model, a feedforward neural network with two hidden layers, achieved an R2 score above 0.99 and a mean absolute error below 1 Kelvin. Sensitivity analyses using Sobol indices and Fourier amplitude sensitivity testing methods on this surrogate model revealed that the inlet mass flow rate at initial timestamps and porosity significantly impacts predicted temperatures across all sensors and time steps.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

PV Performance Modeling and Stakeholder Engagement (Q3 FY2020 Project Report)

The objectives of this project are as follows: 1. Reduce uncertainty in PV performance models by developing and validating new and improved models and submodes. 2. Create and manage an open source repository of modeling functions and data. 3. Build and grow the PV Performance Modeling Collaborative; and, 4. Represent the US in the IEA PVPS Task 13 Working group.

14 SOLAR ENERGY↗

PV Performance Modeling and Stakeholder Engagement (Q1 FY2021 Project Report))

The objectives of this project are as follows: 1) Reduce uncertainty in PV performance models by developing and validating new and improved models and submodes. 2) Create and manage an open source repository of modeling functions and data. 3) Build and grow the PV Performance Modeling Collaborative 4) Represent the US in the IEA PVPS Task 13 Working group.

14 SOLAR ENERGY↗

Bayesian Inference for the Seismic Moment Tensor Using Regional Waveforms and Teleseismic- P Polarities with a Data-Derived Distribution of Velocity Models and Source Locations

The largest source of uncertainty in any source inversion is the velocity model used in the transfer function that relates observed ground motion to the seismic moment tensor. However, standard inverse procedure often does not quantify uncertainty in the seismic moment tensor due to error in the Green’s functions from uncertain event location and Earth structure. Here, we incorporate this uncertainty into an estimation of the seismic moment tensor using a data-derived distribution of velocity models based on complementary geophysical data sets, including thickness constraints, velocity profiles, gravity data, surface-wave group velocities, and regional body-wave travel times. The data-derived distribution of velocity models is then used as a prior distribution of Green’s functions for use in Bayesian inference of an unknown seismic moment tensor using regional and teleseismic-P waveforms. The use of multiple data sets is important for gaining resolution to different components of the moment tensor. The combined likelihood is estimated using data-specific error models and the posterior of the seismic moment tensor is estimated and interpreted in terms of the most probable source type.

58 GEOSCIENCES↗

The ongoing need for high-resolution regional climate models: Process understanding and stakeholder information

Regional climate modeling addresses our need to understand and simulate climatic processes and phenomena unresolved in global models. High resolution models are generally more skillful in simulating extremes, such as heavy precipitation, strong winds, and severe storms. In addition, research has shown that fine-scale features such as mountains, coastlines, lakes, irrigation, land use, and urban heat islands can substantially influence a region’s climate and its response to changing forcings. Regional climate simulations explicitly simulating convection are now being performed, providing an opportunity to illuminate new physical behavior that previously was represented by parameterizations with large uncertainties. Regional and global models are both advancing toward higher resolution, as computational capacity increases. However, the resolution and ensemble size necessary to produce a sufficient statistical sample of these processes in global models has proven too costly for contemporary supercomputing systems. Regional climate models are thus indispensable tools that complement global models for understanding regional climate variability and change, and are critical for supporting societal responses to changing climate.

Gutowski, William↗

Uncertainty Quantification Enabled by Automatic Differentiation for Hydrodynamic Simulation of Shock‐to‐Detonation Transition in High Explosives

Quantifying the effects of uncertainty in a reactive burn model on the run-to-detonation time in high explosives (HEs) provides a robust methodology for assessing the probability of an HE failing the IHE qualification standard. Moreover, uncertainty quantification helps evaluate whether the model calibration accurately represents data outside the calibration set. This study uses a specialized hydrodynamic simulation code for modeling detonation to determine the run-to-detonation time of the HE PBX 9502 for various impact velocities. To quickly approximate uncertainties in the model, a surrogate was constructed using a Taylor series expansion centered at the mean of the input parameters. To obtain the sensitivities required for constructing the Taylor series, HYP-percomplex Automatic Differentiation (HYPAD) was implemented. HYPAD is a methodology for infusing existing codes with automatic differentiation capabilities by augmenting variables with one or more imaginary units to compute step-size independent partial derivatives. These derivatives are accurate to machine precision with respect to the implemented numerical algorithm, meaning their accuracy reflects that of the underlying method (e.g., integration or discretization schemes). Using reduced order modeling techniques, the mean and standard deviation of the run-to-detonation time of a shock within PBX 9502 were computed for a number of initial impact velocities. A weighted least squares regression was then performed to obtain a best fit curve and prediction interval for the computed statistics. Historical data points from explosively driven wedge tests were utilized to validate the prediction interval, ensuring its reliability in predicting future outcomes. With this prediction interval and a known safety constraint curve, the most probable point of failure and the probability of failure for the HE PBX 9502 were determined.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification in CO2 Trapping Mechanisms: A Case Study of PUNQ-S3 Reservoir Model Using Representative Geological Realizations and Unsupervised Machine Learning

Evaluating uncertainty in CO2 injection projections often requires numerous high-resolution geological realizations (GRs) which, although effective, are computationally demanding. This study proposes the use of representative geological realizations (RGRs) as an efficient approach to capture the uncertainty range of the full set while reducing computational costs. A predetermined number of RGRs is selected using an integrated unsupervised machine learning (UML) framework, which includes Euclidean distance measurement, multidimensional scaling (MDS), and a deterministic K-means (DK-means) clustering algorithm. In the context of the intricate 3D aquifer CO2 storage model, PUNQ-S3, these algorithms are utilized. The UML methodology selects five RGRs from a pool of 25 possibilities (20% of the total), taking into account the reservoir quality index (RQI) as a static parameter of the reservoir. To determine the credibility of these RGRs, their simulation results are scrutinized through the application of the Kolmogorov–Smirnov (KS) test, which analyzes the distribution of the output. In this assessment, 40 CO2 injection wells cover the entire reservoir alongside the full set. The end-point simulation results indicate that the CO2 structural, residual, and solubility trapping within the RGRs and full set follow the same distribution. Simulating five RGRs alongside the full set of 25 GRs over 200 years, involving 10 years of CO2 injection, reveals consistently similar trapping distribution patterns, with an average value of Dmax of 0.21 remaining lower than Dcritical (0.66). Using this methodology, computational expenses related to scenario testing and development planning for CO2 storage reservoirs in the presence of geological uncertainties can be substantially reduced.

Mahjour, Seyed Kourosh↗