Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic ensemble generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

30 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Laser Wakefield Accelerator modelling with Variational Neural Networks

A machine learning model was created to predict the electron spectrum generated by a GeV-class laser wakefield accelerator. The model was constructed from variational convolutional neural networks, which mapped the results of secondary laser and plasma diagnostics to the generated electron spectrum. An ensemble of trained networks was used to predict the electron spectrum and to provide an estimation of the uncertainty of that prediction. It is anticipated that this approach will be useful for inferring the electron spectrum prior to undergoing any process that can alter or destroy the beam. In addition, the model provides insight into the scaling of electron beam properties due to stochastic fluctuations in the laser energy and plasma electron density.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Resolving turbulent magnetohydrodynamics: a hybrid operator-diffusion framework

We present a hybrid machine learning framework that combines physics-informed neural operators (PINOs) with score-based generative diffusion models to simulate the full spatio-temporal evolution of two-dimensional, incompressible, resistive magnetohydrodynamic turbulence across a broad range of Reynolds numbers (Re). The framework leverages the equation-constrained generalization capabilities of PINOs to predict coherent, low-frequency dynamics, while a conditional diffusion model stochastically corrects high-frequency residuals, enabling accurate modeling of fully developed turbulence. Trained on a comprehensive ensemble of high-fidelity simulations with Re ϵ {100, 250, 500, 750, 1000, 3000, 10000}, the approach achieves state-of-the-art accuracy in regimes previously inaccessible to deterministic surrogates. At Re = 1000 and 3000, the model faithfully reconstructs the full spectral energy distributions of both velocity and magnetic fields late into the simulation, capturing non-Gaussian statistics, intermittent structures, and cross-field correlations with high fidelity. At extreme turbulence levels (Re = 10 000), it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field, preserving large-scale morphology and enabling statistically meaningful predictions.

Diffusion-Integrated Neural Operators↗
DOE OSTI2021

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Physics-Informed Gaussian Process Regression for States Estimation and Forecasting in Power Grids

Real-time state estimation and forecasting are critical for the efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data. In the PhI-GPR method, we propose to compute the prior statistics offline by solving stochastic differential equations (SDEs) governing the power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertainty in wind mechanical power. Here, we assume that the power grid dynamics are governed by swing equations, with the wind mechanical power fluctuating randomly in time. We solve these equations for the mean and covariances of the power grid states using the Monte Carlo simulation method. We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate observed and unobserved states. For the considered problem, PhI-GPR has computational advantages over the ensemble Kalman filter (EnKF) method: In PhI-GPR, ensembles are computed offline and independently of the data acquisition process, whereas for EnFK, ensembles are computed online with data acquisition, rendering real-time forecast more challenging. We also demonstrate that the PhI-GPR forecast is more accurate than the EnKF forecast when the random mechanical wind power is non-Markovian. In contrast, the two methods produce similar forecasts for the Markovian mechanical wind power. For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR; both forecasts are significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is more sensitive to observation frequency and measurement errors than the PhI-GPR forecast.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Diffusional growth of cloud droplets in homogeneous isotropic turbulence: DNS, scaled-up DNS, and stochastic model

This paper presents a novel methodology to use direct numerical simulation (DNS) to study the impact of isotropic homogeneous turbulence on the condensational growth of cloud droplets. As shown by previous DNS studies, the impact of turbulence increases with the computational domain size, that is, with the Reynolds number, because larger eddies generate higher and longer-lasting supersaturation fluctuations that affect growth of individual cloud droplets. The traditional DNS can only simulate a limited range of scales because of the excessive computational cost that comes from resolving all scales involved, that is, from large scales at which the turbulent kinetic energy (TKE) is introduced down to the Kolmogorov microscale, and from following every single droplet. The novel approach is referred to as the “scaled-up DNS”. The scaling up is done in two parts, first by increasing both the computational domain and the Kolmogorov microscale and second by using super-droplets instead of real droplets. To ensure proper dissipation of TKE and scalar variance at small scales, molecular transport coefficients are appropriately scaled up with the grid length. For the scaled-up domains, say, meters and tens of meters, one needs to follow billions of real droplets. This is not computationally feasible, and so-called super-droplets are applied in scaled-up DNS simulations. Each super-droplet represents an ensemble of identical real droplets, and the number of real droplets represented by a super-droplet is referred to as the multiplicity attribute. After simple tests showing the validity of the methodology, scaled-up DNS simulations are conducted for five domains, the largest of 64 3 m 3 volume using a DNS of 256 3 grid points and various multiplicities. All simulations are carried out with vanishing mean vertical velocity and with no mean supersaturation, similarly to past DNS studies. As expected, the supersaturation fluctuations as well as the spread in droplet size distribution increase with the domain size, with the droplet radius variance increasing in time t as t 1∕2 as identified in previous DNS studies. Scaled-up simulations with different multiplicities document numerical convergence of the scaled-up solutions. Finally, we compare the scaled-up DNS results with a simple stochastic model that calculates supersaturation fluctuations based on the vertical velocity fluctuations updated using the Langevin equation. Overall, the results document similar scaling to previous small-domain DNS simulations and support the notion that the stochastic subgrid-scale model is a valuable tool for the multi-scale simulation of droplet spectral evolution applying a large-eddy simulation model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Decadal Spiciness Variability in the Subtropical-Tropical Pacific in the CESM2 Large Ensemble

Tropical Pacific decadal variations impact weather and climate around the world and are also connected to variations in the global warming trend. The mechanisms driving these long-term modulations, particularly the role of subsurface ocean dynamics, are still debated. Here, we investigate the dynamics of spiciness (density-compensated temperature and salinity) anomalies in the tropical and subtropical Pacific, which are hypothesized as a possible driving mechanism of decadal climate variability. Based on the analysis of 100 realizations from the Community Earth System Model Version 2 Large Ensemble (CESM2-LE), we demonstrate a coupling between the subtropics and the equatorial Pacific by propagating spiciness anomalies at decadal time scales. The CESM2-LE simulates spiciness variability along a subduction path from the subtropics to the equator with frequency spectra that show the highest power at low frequencies and a power decay proportional to a −4 slope for frequencies greater than 0.01 cycles per months, corresponding to periods smaller than ∼8.5 years. Signals that originate in the Southern Hemisphere (SH) dominate and arrive with a larger magnitude at the equator compared to spiciness anomalies from the Northern Hemisphere (NH). Spiciness anomalies from the SH have shorter propagation times and are strengthened along their pathway as stochastic wind stress curl forcing generates anomalous baroclinic ocean pressure gradients. These pressure gradients generate spiciness anomalies via anomalous advection across climatological spiciness gradients in the SH. We conclude that the observed spiciness variance at decadal time scales is consistent with a forcing by stochastic wind variations that are low-pass filtered by ocean dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

STOCHASTIC OPTIMAL POWER FLOW FOR REAL-TIME MANAGEMENT OF DISTRIBUTED RENEWABLE GENERATION AND DEMAND RESPONSE (Final Report)

To meet the grand challenge of a sustainable energy future, there has been a surge of interest in renewable energy. Today, the uncertainty associated with renewable resources is handled by using operating reserves. The high penetration of renewable resources, however, introduces difficult-to-control dynamics and challenges for power system operation. Decision support tools are necessary at the bulk system operational level to recognize and efficiently utilize renewable resources and distributed demand response products in concert with traditional grid resources. It is envisaged that responsive load can potentially have very significant cost advantages over either spinning or non-spinning ramping reserve. Critical decisions are made during hour(s)-ahead and real-time power system operation regarding the commitment and dispatch of generators to ensure power delivery is both reliable and economic. These decisions are typically made by a security constrained optimal flow, which determines future generator commitments, dispatches, and ensures adequate reserves are available in the event of a contingency (unexpected outage) or if future system conditions deviate from forecasts. However, security has been always based on a pre-specified subset of contingency constraints whose enforcement does not guarantee security under all possible future possibilities while also giving little or no weight to the likelihood of each contingent event or the severity of its consequences. Existing tools, which are based exclusively on deterministic optimization models, do not yield optimal operational decisions to address these new challenges, in terms of both reliability and cost-effectiveness. This project has focused on developing a stochastic optimal power flow (SOPF) framework, which integrates renewable resource uncertainty, load uncertainty, distributed storage (DS), demand response (DR) products, in a holistic manner to address the uncertainty associated with ever-increasing renewable resources, along with the inclusion of distributed demand response products in future power systems. A proof-of-concept problem was created using the Pennsylvania-Jersey-Maryland (PJM) power system network. Synthetic wind generation was added to the system to simulate 50% wind penetration. A 1-hour test of SOPF operation indicated more than 6% operational cost savings. The project continued by adding the Midwestern Independent System Operator (MISO) as a partner, with focus shifting from SOPF to Stochastic Look-Ahead Unit Commitment (SLAC). Unlike PJM, MISO is faced with significant renewable energy resources within its footprint and is challenged with substantial uncertainty in its operations. The SLAC distinguishes itself from existing tools that operators use. At best, today’s tools solve two to three cases independently, where one or two system parameters, such as forecasted load level (e.g., a low, base, and high forecast), are varied and the resulting scenarios are analyzed independently. The stochastic-based optimization of SLAC leverages statistical information from an ensemble of potential operational scenarios and their respective likelihood. The SLAC output can be translated into valuable information to the operator such as suggested commitments, optimal scheduling and dispatch of resources, reserve requirements at both locational and zonal resolutions, ramping availability and requirements, availability of demand response including operational guidance concerning the near-term and real-time coordination between distributed energy resources, and utilization of distributed storage resources. The developed SOPF/SLAC tool, a stand-alone tool compatible with existing EMSs, will provide system operators with unprecedented visibility, flexibility and predictability to these resources and operational guidance concerning the real-time coordination between DERs and DR/DS products. The game changing and practical impact of this disruptive technology will be dramatic and will usher in a new era in the electric power industry, wherein green energy concepts are fully embraced, and electric power costs are lowered throughout the nation.

42 ENGINEERING↗
DOE OSTI2023

Stochastic Framework for Optimal Control of Planetary Reentry Trajectories Under Multilevel Uncertainties

We present a novel stochastic optimal control framework that accounts for various types of uncertainties, with application to reentry trajectory planning. The formulation of the optimal trajectory control problem is presented in the context of an indirect method where a functional objective associated with the terminal vehicle speed is to be minimized. Uncertain input parameters in the optimal trajectory control model, including aerodynamic parameters and initial and terminal conditions, are modeled as aleatory random variables, while the statistical parameters of these aleatory distributions are themselves random variables. The parametric and model uncertainties are simultaneously propagated through an extended polynomial chaos expansion (EPCE) formalism. Several metrics are described to evaluate response statistics and presented as insightful tools for robust decision making. Specifically, the response probability density function (PDF) reflecting influence of both epistemic and aleatory uncertainties is obtained. By sampling over the random variables representing model error, an ensemble of response PDFs is generated and the associated failure probability is estimated as a random variable with its own polynomial chaos expansion. Besides, the sensitivity index functions of response PDF with respect to the statistical parameters are evaluated. Coupling parametric and model uncertainties within the EPCE framework leads to a robust and efficient paradigm for multilevel uncertainty propagation and PDF characterization in general optimal control problems.

Engineering↗
DOE OSTI2021

Scale setting the Möbius domain wall fermion on gradient-flowed HISQ action using the omega baryon mass and the gradient-flow scales 𝑡 0 and 𝑤 0

We report on a subpercent scale determination using the omega baryon mass and gradient-flow methods. The calculations are performed on 22 ensembles of 𝑁 𝑓 =2 +1 +1 highly improved, rooted staggered sea-quark configurations generated by the MILC and CalLat Collaborations. The valence quark action used is Möbius domain wall fermions solved on these configurations after a gradient-flow smearing is applied with a flowtime of 𝑡 gf = 1 in lattice units. The ensembles span four lattice spacings in the range 0.06 ≲ 𝑎 ≲0.15 fm, six pion masses in the range 130 ≲ 𝑚 𝜋 ≲ 400 MeV and multiple lattice volumes. On each ensemble, the gradient-flow scales 𝑡 0 /𝑎 2 and 𝑤 0 /𝑎 and the omega baryon mass 𝑎⁢𝑚 Ω are computed. The dimensionless product of these quantities is then extrapolated to the continuum and infinite volume limits and interpolated to the physical light, strange and charm quark mass point in the isospin limit, resulting in the determination of $\sqrt{t}_0$ = 0.1422⁢(14) fm and 𝑤 0 = 0.1709⁢(11) fm with all sources of statistical and systematic uncertainty accounted for. The dominant uncertainty in both results is the stochastic uncertainty, though for $\sqrt{t}_0$ there are comparable continuum extrapolation uncertainties. For 𝑤 0 , there is a clear path for a few-per-mille uncertainty just through improved stochastic precision, as recently obtained by the Budapest-Marseille-Wuppertal Collaboration.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Bootstrap-determined p values in lattice QCD

We present a general method to determine the probability that stochastic Monte Carlo data, in particular those generated in a lattice QCD calculation, would have been obtained were that data drawn from the distribution predicted by a given theoretical hypothesis. Such a probability, or p -value, is often used as an important heuristic measure of the validity of that hypothesis. The proposed method offers the benefit that it remains usable in cases where the standard Hotelling T 2 methods based on the conventional χ 2 statistic do not apply, such as for uncorrelated fits. Specifically, we analyze q 2 , defined as the correlated χ 2 statistic obtained using an arbitrary covariance matrix estimator, and show how to use the bootstrap as a data-driven method to determine the expected distribution of q 2 for a given hypothesis with minimal assumptions. This distribution can then be used to determine the p -value for a fit to the data. We also describe a bootstrap approach for quantifying the impact upon this p -value of estimating population parameters from a single ensemble of N samples. The overall method is accurate up to a 1 / N bias which we do not attempt to quantify. Published by the American Physical Society 2025

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Imaging of a van der Waals spin-orbit torque system using spin ensembles in hBN

Recently, optically active spin defects embedded in two-dimensional (2D) van der Waals (vdW) crystals have emerged as a transformative quantum sensing platform to explore cutting-edge materials science. Taking advantage of excellent solid-state integrability, this new class of spin defects can be readily arranged in nanoscale proximity to target materials, showing great promise for realizing in-situ quantum sensing of microscopic spin and charge behaviors in vdW heterostructures. Here we report hexagonal boron nitride-based quantum imaging of field-free deterministic magnetic switching and electric current distributions in an all-vdW spin-orbit torque (SOT) system. By visualizing variations of nanoscale magnetic stray field profile of room-temperature 2D magnet Fe 3 GaTe 2 under different SOT conditions, we show how the magnetic switching evolves from deterministic to stochastic behavior due to the interplay between spin orientations, anisotropy and Joule heating. Micromagnetic simulations rationalize our results well, revealing the role of field-like SOT in inhibiting thermal fluctuation driven stochastic switching and chaotic multi-domain competition. This understanding, which is otherwise difficult to access by conventional transport measurements, offers valuable insights into material design, testing, and performance evaluation of next-generation vdW spintronic devices.

Imaging techniques↗
DOE OSTI2021

NO PLIF flow visualization and time-resolved temperature distributions in laser induced breakdown plumes

NO planar laser induced fluorescence (PLIF) is used to obtain images of laser-induced breakdown plasma plumes in NO-seeded nitrogen and dry air at near atmospheric pressure. Single-shot PLIF-images show that the plume development 5–50 μs after the breakdown pulse is fairly reproducible shot-to-shot, although the plume becomes increasingly stochastic on longer timescales, 100–500 μs. The stochastic behavior of the plume is quantified using probability distributions of the loci of the plume boundary. Analysis of the single-shot images indicates that the mixing of the plume with ambient gas on sub-ms time scale is insignificant. The induced flow velocity in the plume is fairly low, up to 30 m s –1 , suggesting that laser breakdowns are ineffective for mixing enhancement in high speed flows. The ensemble-averaged PLIF images indicate the evolution of the plume from an initially elongated shape to near-spherical to toroidal shape, with a subsequent radial expansion and formation of an axial jet in the center. Temperature distributions in the plume in air are obtained from the NO PLIF images, using two rotational transitions in the NO(X, v' = 0 → A, v'' = 0) band, J'' = 6.5 and 12.5 of the Q R 12 + Q 2 branch. The results indicate that the temperature in the plume remains high, above 1000 K, for approximately 100 μs, after which it decays gradually, to below 500 K at 500 μs. The residual NO fraction in the plume is ~0.1%, indicating that repetitive laser-assisted ignition may result in significant NO-generation. Furthermore, these measured temperature and velocity distributions can be used for detailed validation of kinetic models of laser-induced breakdown and assessment of their predictive capability.

42 ENGINEERING↗