Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Correlation function distributions for O ( N ) lattice field theories in the disordered phase

Numerical computations in strongly interacting quantum field theories are often performed using Monte Carlo sampling methods. A key task in these calculations is to estimate the value of a given physical quantity from the distribution of stochastic samples that are generated using the Monte Carlo method. Typically, the sample mean and sample variance are used to define the expectation values and uncertainties of computed quantities. However, the Monte Carlo sample distribution contains more information than these basic properties, and it is useful to investigate it more generally. In this work, the exact form of the probability distributions of two-point correlation functions at zero momentum in O ( N ) lattice field theories in the disordered phase and in infinite volume are determined. These distributions allow for a robust investigation of the efficacy of the Monte Carlo sampling procedure and are shown also to allow for improved estimators of the target physical quantity to be constructed. The theoretical expectations are shown to agree with numerical calculations in the O ( 2 ) model. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Statistical Uncertainty of Inhalation Dose Coefficients in Consequence Management: Propagated Dose Uncertainty in ICRP 66 Human Respiratory Tract Model

Reference inhalation dose models rely on deterministic biokinetics and reference computational phantoms, limiting their applicability to the variability present in population-specific exposures encountered in emergency response scenarios. Here, this study introduces REDCAL, a Python-based computational framework developed to propagate uncertainty in inhalation dose coefficients using the International Commission on Radiological Protection (ICRP) Publication 66 Human Respiratory Tract Model. REDCAL integrates ICRP deposition and clearance models, systemic biokinetics, and governing physics principles, and leverages Sandia National Laboratories’ Dakota toolkit for uncertainty quantification via Latin Hypercube Sampling. REDCAL was validated against DCAL, with biokinetic retention results differing by less than 1% and effective dose coefficients by less than 2% across all tested radionuclides. Stochastic sampling introduced variability in dose coefficients, with geometric standard deviations (GSD) in committed effective dose coefficients (CEDC) ranging from 1.0 to 1.5, based on lognormal distribution fits. Analysis demonstrated that variations in the activity median aerodynamic diameter (AMAD) notably influenced the computed CEDC values. Smaller particles (<1 µm) increased doses by 20–30% due to deeper lung deposition and prolonged retention for alpha emitting radionuclides, such as 241 Am and 239 Pu. Radionuclides with fast clearance, such as 133 I, demonstrated a dose reduction exceeding 50%, as AMAD increased beyond 5 µm due to upper airway deposition and rapid mucociliary clearance. The greatest GSD among the radionuclides reported in this study was for 241 Am. In most cases, the largest GSDs in the CEDC were associated with larger particle sizes, an expected outcome, as ICRP Publication 66 defines GSD in particle size as a function of AMAD, resulting in an extended tail of the lognormal distribution. The findings support improved inhalation dose assessments and enhance consequence management strategies for the U.S. Federal Radiological Monitoring and Assessment Center by quantifying uncertainty in dose coefficients and strengthening decision-making for emergency response scenarios.

Biokinetic Modeling↗

GW with hybrid functionals for large molecular systems

A low-cost approach for stochastically sampling static exchange during time-dependent Hartree–Fock-type propagation is presented. This enables the use of an excellent hybrid density functional theory (DFT) starting point for stochastic GW quasiparticle energy calculations. Generalized Kohn–Sham molecular orbitals and energies, rather than those of a local-DFT calculation, are used for building the Green function and effective Coulomb interaction. The use of an optimally tuned hybrid diminishes the starting point dependency in one-shot stochastic GW, effectively avoiding the need for self-consistent GW iterations.

Chemistry↗

Active sampling for neural network potentials: Accelerated simulations of shear-induced deformation in Cu–Ni multilayers

Neural network potentials (NNPs) can greatly accelerate atomistic simulations relative to ab initio methods, allowing one to sample a broader range of structural outcomes and transformation pathways. In this work, we demonstrate an active sampling algorithm that trains an NNP that is able to produce microstructural evolutions with accuracy comparable to those obtained by density functional theory, exemplified during structure optimizations for a model Cu–Ni multilayer system. We then use the NNP, in conjunction with a perturbation scheme, to stochastically sample structural and energetic changes caused by shear-induced deformation, demonstrating the range of possible intermixing and vacancy migration pathways that can be obtained as a result of the speedups provided by the NNP. The code to implement our active learning strategy and NNP-driven stochastic shear simulations is openly available at https://github.com/pnnl/Active-Sampling-for-Atomistic-Potentials .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Nuclear data uncertainty quantification for the nuclide inventory of a Calvert Cliffs spent fuel sample

The impact of nuclear data cross section uncertainties and covariance matrices on the nuclide vector of spent nuclear fuel was investigated; This exercise was carried out for the Calvert Cliffs fuel assembly D047 benchmark available in the SFCOMPO database. Sample P irradiated in rod MKP109 for 4 cycles up to a burnup of approximately 44 GWd/MTU was selected for the analysis. Nuclear data uncertainties were taken from the most recent libraries released by evaluation projects JEFF, ENDF/B and JENDL, and were propagated using the SANDY code via a stochastic sampling approach. This paper provides a quantification of the uncertainty on the concentration of several actinides and fission products relevant for spent fuel management. Uncertainties generally below 5 % were predicted for the concentrations of most of the uranium, neptunium and plutonium isotopes relevant for SNF applications. Curium isotopes carry larger uncertainties that might exceed 10 %. The contribution of cross section uncertainties on the concentrations of fission products was found to be marginal with the exception of a few nuclides. These results can be significantly affected by the lack of evaluated covariance matrices for the capture cross section of several fission products. Burnup tracers such as {sup 148}Nd and {sup 137}Cs have negligible uncertainties because of the power normalisation imposed in every stochastic calculation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ATHENA: A unique radiation environment platform at the National Ignition Facility

This paper describes the ATHENA platform, an energy tuning assembly, which was developed to spectrally shape the National Ignition Facility (NIF) deuterium–tritium fusion neutron source to a thermonuclear (fusion) plus prompt fission neutron spectrum with a capability to act as a short-pulse neutron source. This unique, otherwise inaccessible radiation environment complements existing experimental facilities and capabilities. Here, the flexible ATHENA irradiation positions were modeled using an ensemble of Monte Carlo simulations with stochastic sampling of the nuclear cross-sections to characterize the radiation environments and uncertainty for the platform. Validation of the internal neutron spectrum produced from fielding ATHENA at NIF occurred through neutron flux unfolding with 20 measured activation products.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Parameterizing Subgrid Variations of Land Surface Heat Fluxes to the Atmosphere Improves Boreal Summer Land Precipitation Simulation With the NCAR CESM1.2

Subgrid horizontal variations of land surface heat fluxes to the atmosphere resulting from subgrid land cover heterogeneity are important in land-atmosphere interaction in global climate models (GCMs). To incorporate it, a parameterization using stochastic sampling based on truncated normal distributions diagnosed from the land model and internal ensemble mean of multiple calls to the planetary boundary layer and deep convection schemes is developed. After its implementation in the National Center for Atmospheric Research (NCAR) Community Earth System Model version 1.2 (CESM1.2), large changes of simulated land precipitation are found to occur in regions where large subgrid variations of surface heat fluxes exist. The simulated precipitation is improved in boreal summer, especially over eastern China and the coastal areas of the Bay of Bengal. The improved precipitation is mainly a result of improved large-scale moisture convergence and advection by altered vertical diffusion and convection.

58 GEOSCIENCES↗

Hierarchical Multi-agent Large Language Model Reasoning for Autonomous Heterogeneous Catalyst Discovery

Artificial intelligence is reshaping scientific exploration, but most methods automate procedural tasks without engaging in scientific reasoning, limiting autonomy in discovery. We demonstrate that hierarchical agentic large language model reasoning can efficiently drive simulation and scientific exploration. Across two chemical applications, CO adsorption on Cu surface transition metal adatoms and on M–N–C catalysts, reasoning-guided exploration reduces required atomistic simulations by up to 90% relative to heuristic or random selection. Comparisons across single-agent, multi-agent, and stochastic baselines show that hierarchical strategies yield more coherent and information-efficient search trajectories. Reasoning traces reveal chemically grounded decisions that cannot be explained by semantic bias or stochastic sampling. We realize these agentic reasoning strategies in Materials Agents for Simulation and Theory in Electronic-structure Reasoning (MASTER), a multimodal system that translates natural language into density functional theory workflows. Altogether, multi-agent collaboration accelerates heterogeneous catalyst discovery and marks a step toward more autonomous, reasoning-guided scientific exploration.

30 DIRECT ENERGY CONVERSION↗

Piecewise interaction picture density matrix quantum Monte Carlo

The density matrix quantum Monte Carlo (DMQMC) set of methods stochastically samples the exact N-body density matrix for interacting electrons at finite temperature. We introduce a simple modification to the interaction picture DMQMC (IP-DMQMC) method that overcomes the limitation of only sampling one inverse temperature point at a time, instead allowing for the sampling of a temperature range within a single calculation, thereby reducing the computational cost. At the target inverse temperature, instead of ending the simulation, we incorporate a change of picture away from the interaction picture. The resulting equations of motion have piecewise functions and use the interaction picture in the first phase of a simulation, followed by the application of the Bloch equation once the target inverse temperature is reached. We find that the performance of this method is similar to or better than the DMQMC and IP-DMQMC algorithms in a variety of molecular test systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic quantum Krylov protocol with double-factorized Hamiltonians

Here we propose a class of randomized quantum Krylov diagonalization (rQKD) algorithms capable of solving the eigenstate estimation problem with modest quantum resource requirements. Compared to previous real-time evolution quantum Krylov subspace methods, our approach expresses the time evolution operator e –i$\widehat{H}$$\tau$ as a linear combination of unitaries and subsequently uses a stochastic sampling procedure to reduce circuit depth requirements. While our methodology applies to any Hamiltonian with fast-forwardable subcomponents, we focus on its application to the explicitly double-factorized electronic-structure Hamiltonian. To demonstrate the potential of the proposed rQKD algorithm on near-term quantum devices, we provide numerical benchmarks for a variety of molecular systems with circuit-based state-vector simulators including the effects of sampling noise, achieving ground-state energy errors of less than 1 kcal mol -1 with circuit depths orders of magnitude shallower than those required for low-rank deterministic Trotter-Suzuki decompositions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker--Planck Equation and Physics-Informed Neural Networks

The Fokker--Planck (FP) equation governing the evolution of the probability density function (PDF) is applicable to many disciplines, but it requires specification of the coefficients for each case, which can be functions of space-time and not just constants and hence require the development of a data-driven modeling approach. When the data available is directly on the PDF, there exist methods for inverse problems that can be employed to infer the coefficients and thus determine the FP equation and subsequently obtain its solution. Herein, we address a more realistic scenario, where only sparse data are given on the particles' positions at a few time instants, which are not sufficient to accurately construct directly the PDF even at those times from existing methods, e.g., kernel estimation algorithms. To this end, we develop a general framework based on physics-informed neural networks (PINNs) that introduces a new loss function using the Kullback--Leibler divergence to connect the stochastic samples with the FP equation to simultaneously learn the equation and infer the multidimensional PDF at all times. In particular, we consider two types of inverse problems, type I, where the FP equation is known but the initial PDF is unknown, and type II, in which, in addition to the unknown initial PDF, the drift and diffusion terms are also unknown. In both cases, we investigate problems with either Brownian or Lévy noise or a combination of both. Here, we demonstrate the new PINN framework in detail in the one-dimensional (1D) case, but we also provide results for up to five dimensions demonstrating that we can infer both the FP equation and dynamics simultaneously at all times with high accuracy using only very few discrete observations of the particles.

97 MATHEMATICS AND COMPUTING↗

Impact of nuclear data covariance libraries on uncertainty quantification of sodium cooled fast reactor simulation

Uncertainty quantification in core modelling to assess reactor performance is a regular practice to identify design safety limits. Best-estimate plus uncertainty (BEPU) methods are commonly used to propagate uncertainties to core responses from input parameters, characterized by variance-covariance libraries. This study evaluates the impact of different covariance libraries on the uncertainty associated with core safety parameters and their propagation through reactor transient modelling for a metallic core (ABR-1000). The COMAC-1.0, COMMARA-2.0, and COMMARA-2.1 covariance libraries are used to propagate nuclear data uncertainties to neutron feedback coefficients using the Generalized Perturbation Theory, then through transient safety analyses to establish the confidence interval for safety performance of the reactor using stochastic sampling. The considered transients include Unprotected Transient Over Power and Unprotected Loss Of Flow. Most influential nuclide and reaction pairs in different variance-covariance libraries are identified and their impact on the uncertainty of safety parameters are evaluated. Significant differences were observed between uncertainties from COMAC compared to COMMARA libraries. Uncertainties from COMMARA libraries were consistently larger than COMAC for all cases. For structure, coolant density feedback coefficients and control rod worth, total nuclear data uncertainties were approximately 50% larger for COMMARA than COMAC. Differences were also observed in identification of top contributors of uncertainty in terms of reaction-cross sections. For instance, largest contribution to total uncertainty of radial expansion coefficient from COMMARA-2.0 and 2.1 originates from Na{sup 23} P1 Elastic cross section (0.81%) but from Pu{sup 239} Fission (0.53%) with COM C-1.0. Such differences are evaluated in this research for all quantities of interest. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On the Verification of Deep Reinforcement Learning Solution for Intelligent Operation of Distribution Grids

Capabilities of deep reinforcement learning (DRL) in obtaining fast decision policies in high dimensional and stochastic environments have led to its extensive use in operational research, including the operation of distribution grids with high penetration of distributed energy resources (DER). However, the feasibility and robustness of DRL solutions are not guaranteed for the system operator, and hence, those solutions may be of limited practical value. This paper proposes an analytical method to find feasibility ellipsoids that represent the range of multi-dimensional system states in which the DRL solution is guaranteed to be feasible. Empirical studies and stochastic sampling determine the ratio of the discovered to the actual feasible space as a function of the sample size. In addition, the performance of logarithmic, linear, and exponential penalization of infeasibility during the DRL training are studied and compared in order to reduce the number of infeasible solutions

Hosseini, Mohammad Mehdi↗

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗

A Data-Driven Multi-Period Importance Sampling Strategy for Stochastic Economic Dispatch

Power systems with high penetrations of renewable energy (e.g., wind power) require sophisticated approaches to optimize system performance due to uncertainty in short-term system generation capacity. In this paper, we combine a data-driven analog scenario selection method with importance sampling to create a novel scenario construction approach for two-stage stochastic economic dispatch problems with a large number of wind farms on a network. The proposed method produces scenarios with realistic physics by finding high-fidelity analogs that can describe future states of the system. We show how to extend this method to multi-period operations and demonstrate the effectiveness of this technique by simulating economic dispatch operations on a synthetic test system over the course of a week.

data-driven forecasting↗

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗

Variance-Reduced Accelerated First-Order Methods: Central Limit Theorems and Confidence Statements

In this paper, we consider a strongly convex stochastic optimization problem and propose three classes of variable sample-size stochastic first-order methods: (i) the standard stochastic gradient descent method, (ii) its accelerated variant, and (iii) the stochastic heavy-ball method. In each scheme, the exact gradients are approximated by averaging across an increasing batch size of sampled gradients. We prove that when the sample size increases at a geometric rate, the generated estimates converge in mean to the optimal solution at an analogous geometric rate for schemes (i)–(iii). Based on this result, we provide central limit statements, whereby it is shown that the rescaled estimation errors converge in distribution to a normal distribution with the associated covariance matrix dependent on the Hessian matrix, the covariance of the gradient noise, and the step length. If the sample size increases at a polynomial rate, we show that the estimation errors decay at a corresponding polynomial rate and establish the associated central limit theorems (CLTs). Under certain conditions, we discuss how both the algorithms and the associated limit theorems may be extended to constrained and nonsmooth regimes. As a result, we provide an avenue to construct confidence regions for the optimal solution based on the established CLTs and test the theoretical findings on a stochastic parameter estimation problem.

Lei, Jinlong↗

Priors on red galaxy stochasticity from hybrid effective field theory

ABSTRACT We investigate the stochastic properties of typical red galaxy samples in a controlled numerical environment. We use halo occupation distribution (HOD) modelling to create mock realizations of three separate bright red galaxy samples consistent with data sets used for clustering and lensing analyses in modern galaxy surveys. Second-order Hybrid Effective Field Theory (HEFT) is used as a field-level forward model to describe the full statistical distribution of these tracer samples, and their stochastic power spectra are directly measured and compared to the Poisson shot-noise prediction. While all of the galaxy samples we consider are hosted within haloes with sub-Poisson stochasticity, we observe that the galaxy samples themselves possess stochasticities that range from sub-Poisson to super-Poisson, in agreement with predictions from the halo model. As an application of our methodology, we place priors on the expected degree of non-Poisson stochasticity in cosmological analyses using such samples. We expect these priors will be useful in reducing the complexity of the full parameter space for future analyses using second-order Lagrangian bias models. More generally, the techniques outlined here present the first application of HEFT methods to characterize models of the galaxy–halo connection at the field level, revealing new connections between once-disparate modelling frameworks.

79 ASTRONOMY AND ASTROPHYSICS↗