Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Automated calculation and convergence of defect transport tensors

Defect diffusion is a key process in materials science and catalysis, but as migration mechanisms are often too complex to enumerate a priori, calculation of transport tensors typically have no measure of convergence and require significant end-user intervention. These two bottlenecks prevent high-throughput implementations essential to propagate model-form uncertainty from interatomic interactions to predictive simulations. In order to address these issues, we extend a massively parallel accelerated sampling scheme, autonomously controlled by Bayesian estimators of statewide sampling completeness, to build atomistic kinetic Monte Carlo models on a state-space irreducible under exchange and space group symmetries. Focusing on isolated defects, we derive analytic expressions for drift and diffusion coefficients, providing a convergence metric by calculating the Kullback–Leibler divergence across the ensemble of diffusion processes consistent with the sampling uncertainty. The autonomy and efficacy of the method is demonstrated on surface trimers in tungsten and Hexa-interstitials in magnesium oxide, both of which exhibit complex, correlated migration mechanisms.

36 MATERIALS SCIENCE↗

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sensitivity analysis of numerical modeling input parameters on floating offshore wind turbine loads

Abstract. Floating wind turbines must withstand a unique and challenging set of loads from the wind and ocean environment. To de-risk development, accurate predictions of these loads are necessary. Uncertainty in modeling predictions leads to larger required safety factors, increasing project costs and the levelized cost of energy. Complex aero-hydro-elastic modeling tools use many input parameters to represent the wind, waves, current, aerodynamic loads, hydrodynamic loads, and structural properties. It is helpful to understand which of these parameters ultimately drives a design. In this work, an ultimate and fatigue-proxy load sensitivity analysis was performed with 35 different input parameters, using an elementary effects approach to identify the most influential parameters for a case study involving the National Renewable Energy Laboratory (NREL) 5 MW baseline wind turbine atop the OC4-DeepCwind semisubmersible during normal operation. The importance of each parameter was evaluated using 14 response quantities of interest across three operational wind speed conditions. The study concludes that turbulent wind velocity standard deviation is the parameter with the strongest sensitivity; this value is important not just for turbine loads, but also for the global system response. The system center of mass in the wind direction is found to have the highest impact on the system rotation and tower loads. The current velocity is found to be the most dominating parameter for the system global motion and consequently the mooring loads. All tested wind turbulence parameters in addition to the standard deviation are also found to be influential. Wave characteristics are influential for some fatigue-proxy loading but do not significantly impact the extreme ultimate loads in these operational load cases. The required number of random seeds for stochastic environmental conditions is considered to ensure that the sensitivities are due to the input parameters and not due to the seed. The required number of analysis points in the parameter space is identified so that the conclusions represent a global sensitivity. The results are specific to the platform, turbine, and choice of parameter ranges, but the demonstrated approach can be applied widely to guide focus in parameter uncertainty.

17 WIND ENERGY↗

N 2 Onet: a global collaborative network facilitating advances in measurement, modeling, and mitigation of agricultural soil nitrous oxide emissions

Nitrogen (N) fertilizer supports global food production, but its use and overuse drive emissions of nitrous oxide (N 2 O), a potent and long-lived greenhouse gas. Understanding the drivers of N 2 O fluxes remains elusive, making it difficult to predict emissions in time and space and to develop and evaluate ways to lower emissions through management. Major scientific uncertainties underlying the understanding of the drivers of N 2 O fluxes identified in a workshop of N 2 O emissions experts include poor process-based understanding of controls on soil N 2 O emissions in the field; insufficient data to reduce uncertainty in N 2 O budgets from the field to regional scales, including N 2 O emission measurements and importantly, field-scale N balances; and high uncertainty in model predictions of soil N 2 O emissions across environmental and management conditions. To reduce these uncertainties, we present the concept of N 2 Onet, a global collaborative initiative to accelerate advances in N 2 O measurement, analyses, and mitigation. N 2 Onet will serve as an observational network of supersites with multi-scale measurements; a database hub for N 2 O flux and ancillary data; and a catalyst for community building, information sharing, and training. By coalescing and coordinating the global community of researchers, N 2 Onet will provide a roadmap for reducing N 2 O emissions from agriculture worldwide.

54 ENVIRONMENTAL SCIENCES↗

Prompt and non-prompt J/$ψ$ production at midrapidity in Pb–Pb collisions at $\sqrt{s_{\textrm{NN}}}$ = 5.02 TeV

The transverse momentum (p T ) and centrality dependence of the nuclear modif cation factor R AA of prompt and non-prompt J/ψ, the latter originating from the weak decays of beauty hadrons, have been measured by the ALICE collaboration in Pb–Pb collisions at $\sqrt{s_{\textrm{NN}}}$ = 5.02 TeV. The measurements are carried out through the e + e - decay channel at midrapidity (|y| < 0.9) in the transverse momentum region 1.5 < p T < 10 GeV/c. Both prompt and non-prompt J/ψ measurements indicate a significant suppression for p T > 5 GeV/c, which becomes stronger with increasing collision centrality. The results are consistent with similar LHC measurements in the overlapping p T intervals, and cover the kinematic region down to p T = 1.5 GeV/c at midrapidity, not accessible by other LHC experiments. The suppression of prompt J/ψ in central and semicentral collisions exhibits a decreasing trend towards lower transverse momentum, described within uncertainties by models implementing J/ψ production from recombination of $c$ and $\overline{c}$ quarks produced independently in different partonic scatterings. At high transverse momentum, transport models including quarkonium dissociation are able to describe the suppression for prompt J/ψ. For non-prompt J/ψ, the suppression predicted by models including both collisional and radiative processes for the computation of the beauty-quark energy loss inside the quark-gluon plasma is consistent with measurements within uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Geometric Measures of Trustworthiness for Machine Learning Predictions

his report details the findings from the research and investigation of Geometric Measures of Trustworthiness for Machine Learning Predictions. We explored the trustworthiness of machine learning (ML) models’ predictions using geometric measures to quantify the similarity of a query point with the training data. Predictive uncertainty in ML can originate from at least three sources: (1) Model uncertainty, which represents the uncertainty in model form (e.g. decision tree, vs neural network) and estimating the model parameters from the training data, (2) Data uncertainty, which represents the natural complexities of the data such as class overlap and inherent noise, and (3) Distributional uncertainty, which represents the mismatch between the training and operational distributions. The proposed measures focus on measuring and explaining the data and distributional uncertainties by measuring the relationships of operational data with the training data.

97 MATHEMATICS AND COMPUTING↗

The impact of mineral reactive surface area variation on simulated mineral reactions and reaction rates

Reactive transport modeling is an essential tool to simulate complex geochemical reactions in porous media that can impact formation properties including porosity and permeability. However, simulating these reactions is challenging due to uncertainties in model parameters, particularly mineral surface areas. Imaging has emerged as a powerful means of estimating model parameters including porosity and mineral abundance, accessibility and accessible surface area. However, these parameters, particularly mineral accessible surface area, vary with image resolution. This work aims to enhance understanding of the impact of image resolution and other means of estimating mineral reactive surface area on simulated mineral reactions and reaction rates. Mineral surface areas calculated from images with resolutions of 0.34 μm and 5.71 μm were used to simulate mineral reactions in the context of geologic CO 2 sequestration in the Paluxy formation at the continuum scale. Additional simulations were carried out using BET surface areas collected from the literature and geometric surface areas. Simulations were run for 7300 days and mineral volume fractions and effluent ion concentrations tracked and compared. Variations in mineral surface areas measured from images are within 1 order of magnitude and yield similar simulation results, indicating the impact of image resolution on simulated reactions and reaction rates is minimum for the resolutions and sample considered. In comparison, surface areas obtained from BET and geometric approaches are 1–4 orders of magnitude higher than image-obtained surface areas and result in greater simulated reaction rates and extents. Minerals with high reaction rates (calcite and siderite) are most impacted by surface area values at short times where simulated mineral volume fractions at longer times agree relatively well, even for simulations with several orders of magnitude variation in surface area. Phases with lower reaction rates, such as K-feldspar and muscovite, are predominantly impacted over longer times where variations in surface areas impact reaction extents and porosity evolution. Overall, variations in surface areas due to image resolution are small and result in little variation in simulated reactions and reaction rates while there are significant variations in simulation results when other surface area estimates are used. These variations, however, depend on the reactivity of the mineral phase where surface areas of fast-reacting phases largely impact simulations at short (hours to days) timescales and surface areas of slower-reactive phases impact longer term simulations (years).

58 GEOSCIENCES↗

Strong detection of the CMB lensing and galaxy weak lensing cross-correlation from ACT-DR4, Planck Legacy, and KiDS-1000

Here we measured the cross-correlation between galaxy weak lensing data from the Kilo Degree Survey (KiDS-1000, DR4) and cosmic microwave background (CMB) lensing data from the Atacama Cosmology Telescope (ACT, DR4) and the Planck Legacy survey. We used two samples of source galaxies, selected with photometric redshifts, (0.1 < z B < 1.2) and (1.2 < z B < 2), which produce a combined detection significance of the CMB lensing and weak galaxy lensing cross-spectrum of 7.7σ. With the lower redshift galaxy sample, for which the cross-correlation was detected at a significance of 5.3σ, we present joint cosmological constraints on the matter density parameter, Ω m , and the matter fluctuation amplitude parameter, σ 8 , marginalising over three nuisance parameters that model our uncertainty in the redshift and shear calibration as well as the intrinsic alignment of galaxies. We find our measurement to be consistent with the best-fitting flat ΛCDM cosmological models from both Planck and KiDS-1000. We demonstrate the capacity of CMB weak lensing cross-correlations to set constraints on either the redshift or shear calibration by analysing a previously unused high-redshift KiDS galaxy sample (1.2 < z B < 2), with the cross-correlation detected at a significance of 7σ. This analysis provides an independent assessment for the accuracy of redshift measurements in a regime that is challenging to calibrate directly owing to known incompleteness in spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimization and stabilization of Fermilab Booster using hybrid Bayesian/RL framework

PIPII project will raise Fermilab Booster intensity and ramp rate. Beam losses will limit average power and are hard to simulate. Presently, Booster uses operator-guided empirical tuning. This task is challenging due to high dimensionality, multiple objectives, critical safety constraints, and drifts. We developed a synergistic suite of Bayesian optimization (BO) and reinforcement learning (RL) tools to optimize and stabilize beam losses. First, active learning was used to build a rough model. Data was collected parasitically using two novel safety constraint types – nonlinear input space restrictions (based on optics model), and uncertainty constraints (to stop bad steps/beam aborts). We then applied online multi-objective BO with scalarized objectives and fitting to improve/rebalance losses, increasing safety margins by 25%. Using BO model as a safety veto, we tried several on/off-policy RL agents for long term stabilization; SAC had best performance. We found that adding contextual (state) information further improved performance, eventually integrating key knobs like linac phase and temperature into the parameter space. Long term testing is ongoing to enable operational use.

Kuklev, Nikita [Fermilab]↗

Using automated machine learning for the upscaling of gross primary productivity

Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗

Spatial biases of information influence global estimates of soil respiration: how can we improve global predictions?

Soil respiration (Rs), the efflux of CO2 from soils to the atmosphere, is a major component of the terrestrial carbon cycle, but is poorly constrained from regional to global scales. The global soil respiration database (SRDB) is a compilation of in-situ Rs observations from around the globe that has been consistently updated with new measurements over the past decade. It is unclear whether the addition of data to new versions of the SRDB has produced better-constrained global Rs estimates. We compared two versions of the SRDB (v3.0 n=5173 and v5.0 n=10366) to determine how additional data influenced the global sum and uncertainty of Rs as predicted by a quantile regression forest model. A model parameterized using SRDBv3 yielded a global Rs sum of 88.6 Pg C yr-1, and associated uncertainty of 29.9 (mean absolute error) and 57.9 (standard deviation) Pg C yr-1, whereas parameterization using SRDBv5 yielded 96.5 Pg C yr-1 and associated uncertainty of 30.2 (mean average error) and 73.4 (standard deviation) Pg C yr-1. Empirically estimated global heterotrophic respiration (Rh) from v3 and v5 were 49.9-50.2 (mean 50.1) and 53.3-53.5 (mean 53.4) Pg C yr-1, respectively. Interestingly, SRDBv5’s inclusion of new data from underrepresented regions (e.g., Asia, Africa, South America) thus resulted in overall higher model uncertainty. The SRDBv5 is still biased towards northern latitudes and temperate zones, so we tested that an optimized global distribution of Rs measurements resulted in a global sum of 96.4 ± 21.4 Pg C yr-1 and lower model uncertainty. These results support current global estimates of Rs but highlight spatial inconsistencies that influence model parameterization and interpretation that should be addressed to improve regional- to global-scale predictions.

Stell, Emma↗

Integrated Tiger Series (ITS) Code Validation and Uncertainty Quantification for Electron Number Albedo in Various Materials

In the 1970’s and 1980’s, researchers at Sandia National Laboratories produced electron albedo data for a range of materials. Since that time, the electron albedo data has been used for a wide variety of purposes including the validation of Monte Carlo electron transport codes. This report was compiled to examine the electron albedo experiment results in the context of Integrated Tiger Series (ITS) validation. The report presents tables and figures that could provide insight into the underlying model form uncertainty present in the ITS code. Additionally, the report provides data on potential means to reduce these model form errors by highlighting potential refinements in the cross-section generation process.

97 MATHEMATICS AND COMPUTING↗

Evaluation of Leading Modes of Climate Variability in the CMIP Archives

The adequate simulation of internal climate variability is key for our understanding of climate as it underpins efforts to attribute historical events, predict on seasonal and decadal time scales, and isolate the effects of climate change. Here the skill of models in reproducing observed modes of climate variability is assessed, both across and within the CMIP3, CMIP5, and CMIP6 archives, in order to document model capabilities, progress across ensembles, and persisting biases. A focus is given to the well-observed tropical and extratropical modes that exhibit small intrinsic variability relative to model structural uncertainty. These include El Niño–Southern Oscillation (ENSO), the Pacific decadal oscillation (PDO), the North Atlantic Oscillation (NAO), and the northern and southern annular modes (NAM and SAM). Significant improvements are identified in models’ representation of many modes. Canonical biases, which involve both amplitudes and patterns, are generally reduced across model generations. For example, biases in ENSO-related equatorial Pacific sea surface temperature, which extend too far westward, and associated atmospheric teleconnections, which are too weak, are reduced. Stronger tropical expression of the PDO in successive CMIP generations has characterized their improvement, with some CMIP6 models generating patterns that lie within the range of observed estimates. For the NAO, NAM, and SAM, pattern correlations with observations are generally higher than for other modes and slight improvements are identified across successive model generations. Finally, for ENSO and PDO spectra and extratropical modes, changes are small compared to internal variability, precluding definitive statements regarding improvement.

54 ENVIRONMENTAL SCIENCES↗

Multistage Stochastic optimization for mid-term integrated generation and maintenance scheduling of cascaded hydroelectric system with renewable energy uncertainty

The uncertainties resulting from the escalating penetration of renewable energy resources pose severe challenges to the efficient operation of modern power systems. Hydroelectricity is characterized by its flexibility, controllability, and reliability, and thus becomes one of the most ideal energy resources to hedge against such uncertainties. This paper studies the mid-term integrated generation and maintenance scheduling of a cascaded hydroelectric system (CHS) consisting of multiple cascaded reservoirs and hydroelectric units. To precisely describe the mid-term water regulation policies, the hydraulic coupling relationship and water-energy nexus of CHS are incorporated into the proposed optimization model. The uncertainties of natural water inflow and the power outputs of wind/solar energy generation are taken into consideration and captured via a stochastic process modeled by a scenario tree. A multistage stochastic optimization (MSO) approach is developed to coordinate the complementary operations of multiple energy resources, by optimizing the mid-term water resource management, generation scheduling, and maintenance scheduling of CHS. The proposed MSO model is formulated as a large-scale mixed-integer linear program that presents significant computational intractability. To address this issue, a tailored Benders decomposition algorithm is developed. Two real-world case studies are conducted to demonstrate the capability and characteristics of the proposed model and algorithm. The computational results show that the proposed MSO model can exploit the flexibility of hydroelectricity to efficiently respond to variable wind and solar power, and reserve water resources for the generation in peak months to reduce the consumption of fossil fuel. Furthermore, the proposed solution approach also exhibits promising computational efficiency when handling large-scale models.

13 HYDRO ENERGY↗

Modeling Plutonium Decorporation in a Female Nuclear Worker Treated with Ca-DTPA after Inhalation Intake

The present work models plutonium (Pu) biokinetics in a female former nuclear worker. Her bioassay measurements are available at the US Transuranium and Uranium Registries. The worker was internally exposed to a plutonium-americium mixture via acute inhalation at a nuclear weapons facility. She was medically treated with injections of 1 g Ca-DTPA on days 0, 5, and 14 after the intake. Between days 0 and 20, fecal and urine samples were collected and analyzed for 239 Pu and 241 Am. Subsequently, she was followed up for bioassay monitoring over 14 y, with additional post-treatment urine samples collected and analyzed for 239 Pu. The uniqueness of this dataset is due to the availability of: (1) both early and long-term bioassay data from a female with plutonium intake; (2) data on chelation therapy for a female; and (3) fecal measurement results. Chelation therapy with Ca- and/or Zn-salts of DTPA is known to aid in reducing the internal radiation dose by enhancing the excretion of plutonium and americium from the body. Such enhancement affects plutonium biokinetics in the human body, posing a challenge to the internal dose assessment. The current radiation dose assessment practice is to exclude the data affected by Ca-DTPA from the analysis. The present analysis is the first to explicitly model the chelation-affected bioassay data in a female by using a newly developed chelation model. Thus, the bioassay data collected during and after the Ca-DTPA administrations were used for biokinetic modeling and dose assessment. The Markov Chain Monte Carlo method was used to investigate model parameter uncertainty, based on the bioassay data and assumed prior probability distributions. A χ 2 /nData (number of data points) ≈ 1 was observed in this study, which indicates self-consistency of the data with the model. Results of this study show that the worker’s 239 Pu intake was 12 Bq, with a committed effective dose to the whole-body of 1.2 mSv and a committed equivalent dose to the bone surfaces, liver, and lungs of 37.8, 9.1, and 0.8 mSv, respectively. This study also discusses the worker’s dose reduction due to chelation treatment.

61 RADIATION PROTECTION AND DOSIMETRY↗

Exploring the impacts of unprecedented climate extremes on forest ecosystems: hypotheses to guide modeling and experimental studies

Abstract. Climatic extreme events are expected to occur more frequently in the future, increasing the likelihood of unprecedented climate extremes (UCEs) or record-breaking events. UCEs, such as extreme heatwaves and droughts, substantially affect ecosystem stability and carbon cycling by increasing plant mortality and delaying ecosystem recovery. Quantitative knowledge of such effects is limited due to the paucity of experiments focusing on extreme climatic events beyond the range of historical experience. Here, we present a road map of how dynamic vegetation demographic models (VDMs) can be used to investigate hypotheses surrounding ecosystem responses to one type of UCE: unprecedented droughts. As a result of nonlinear ecosystem responses to UCEs that are qualitatively different from responses to milder extremes, we consider both biomass loss and recovery rates over time by reporting a time-integrated carbon loss as a result of UCE, relative to the absence of drought. Additionally, we explore how unprecedented droughts in combination with increasing atmospheric CO2 and/or temperature may affect ecosystem stability and carbon cycling. We explored these questions using simulations of pre-drought and post-drought conditions at well-studied forest sites using well-tested models (ED2 and LPJ-GUESS). The severity and patterns of biomass losses differed substantially between models. For example, biomass loss could be sensitive to either drought duration or drought intensity depending on the model approach. This is due to the models having different, but also plausible, representations of processes and interactions, highlighting the complicated variability of UCE impacts that still need to be narrowed down in models. Elevated atmospheric CO2 concentrations (eCO2) alone did not completely buffer the ecosystems from carbon losses during UCEs in the majority of our simulations. Our findings highlight the consequences of differences in process formulations and uncertainties in models, most notably related to availability in plant carbohydrate storage and the diversity of plant hydraulic schemes, in projecting potential ecosystem responses to UCEs. We provide a summary of the current state and role of many model processes that give way to different underlying hypotheses of plant responses to UCEs, reflecting knowledge gaps which in future studies could be tested with targeted field experiments and an iterative modeling–experimental conceptual framework.

54 ENVIRONMENTAL SCIENCES↗

Mitigating baryonic effects with a theoretical error covariance

ABSTRACT One of the primary sources of uncertainties in modelling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for stage-IV surveys requires knowledge of the matter power spectrum deep in the non-linear regime at the per cent level. Therefore, it is important to develop reliable mitigation techniques to take into account baryonic uncertainties if information from small scales is to be considered in the cosmological analysis. In this work, we develop a new mitigation method for dealing with baryonic physics for the case of the shear angular power spectrum. The method is based on an augmented covariance matrix that incorporates baryonic uncertainties informed by hydrodynamical simulations. We use the results from 13 hydrodynamical simulations and the residual errors arising from a fit to a ΛCDM model using the extended halo model code HMCode to account for baryonic physics. These residual errors are used to model a so-called theoretical error covariance matrix that is added to the original covariance matrix. In order to assess the performance of the method, we use the 2D tomographic shear from four hydrodynamical simulations that have different extremes of baryonic parameters as mock data and run a likelihood analysis comparing the residual bias on Ωm and σ8 of our method and the HMCode for an LSST-like survey. We use different modelling of the theoretical error covariance matrix to test the robustness of the method. We show that it is possible to reduce the bias in the determination of the tested cosmological parameters at the price of a modest decrease in the precision.

79 ASTRONOMY AND ASTROPHYSICS↗