Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Impacts of floating-point non-associativity on reproducibility for HPC and deep learning applications

Run to run variability in parallel programs caused by floating-point non-associativity has been known to significantly affect reproducibility in iterative algorithms, due to accumulating errors. Non-reproducibility can critically affect the efficiency and effectiveness of correctness testing for stochastic programs. Recently, the sensitivity of deep learning training and inference pipelines to floating-point non-associativity has been found to sometimes be extreme. It can prevent certification for commercial applications, accurate assessment of robustness and sensitivity, and bug detection. New approaches in scientific computing applications have coupled deep learning models with high-performance computing, leading to an aggravation of debugging and testing challenges. Here we perform an investigation of the statistical properties of floating-point non-associativity within modern parallel programming models, and analyze performance and productivity impacts of replacing atomic operations with deterministic alternatives on GPUs. We examine the recently-added deterministic options in PyTorch within the context of GPU deployment for deep learning, uncovering and quantifying the impacts of input parameters triggering run to run variability and reporting on the reliability and completeness of the documentation. Finally, we evaluate the strategy of exploiting automatic determinism that could be provided by deterministic hardware, using the Groq LPUTM accelerator for inference portions of the deep learning pipeline. We demonstrate the benefits that a hardware-based strategy can provide within reproducibility and correctness efforts.

Shanmugavelu, Sanjif↗
DOE OSTI2021

Scalable/Secure Cooperative Algorithms and Framework for Extremely-high Penetration Solar Integration (SolarExPert) (Final Technical Report)

This SolarExPert project has developed a Sustainable Grid Platform (SGP) with scalable architecture of distributed control and optimization. The SGP consists of the following major functions: 1) an advanced grid architecture with hierarchical and distributed communication and control, combined with the OpenFMB standard and implemented on the Multi-Agent OpenDSS (MA-OpenDSS) platform; 2) an online distributed stochastic optimal power flow; 3) an online distributed system state estimation algorithm; 4) the distributed Volt/VAR optimization and frequency control algorithms; 5) the distributed distribution system restoration strategy. The developed SGP together with advanced functions are tested in 1 million (1M)-node distribution system on the MA-OpenDSS platform. Furthermore, the models and algorithms are tested in 100,000-node system HiL simulation, and also in P-HiL implementation with 100 physical devices. The developed functions haven been validated and tested on the selected actual distribution feeder with the data collected from the field of Maui Meadows in Hawaii. The distributed PV hosting capacities with cooperative Volt/VAR and Volt/VAR/Watt control are estimated and compared to provide recommendations for customers and the utility company.

14 SOLAR ENERGY↗
DOE OSTI2023

Residuals-based distributionally robust optimization with covariate information

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in the sense that it can accommodate a variety of regression setups and DRO ambiguity sets. We investigate asymptotic and finite sample properties of solutions obtained using Wasserstein, sample robust optimization, and phi-divergence-based ambiguity sets within our DRO formulations, and explore cross-validation approaches for sizing these ambiguity sets. Through numerical experiments, we validate our theoretical results, study the effectiveness of our approaches for sizing ambiguity sets, and illustrate the benefits of our DRO formulations in the limited data regime even when the prediction model is misspecified.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

State-of-the-art short-term electricity market operation with solar generation: A review

With the accelerating penetration of solar energy in energy systems, market operations concerning the solar-associated intermittency are widely discussed. How to correctly model the solar generation in the market and solve the uncertainty-based operation problems call for solutions. Unlike other renewable resources, solar power can be more easily applied to the demand side through behind-the-meter installations in a distributed manner with significant future extensibility. The corresponding operational rules in the markets are largely being revised. Over the past two decades, with the development of deregulated power markets, numerous studies related to uncertainty-based market operations tend to transform the market from a deterministic and centralized framework to a stochastic and decentralized one. As the relevant literature is most recent, this paper reviews their contributions to electricity market operations with solar integration and underlines the research directions of this topic and ongoing industry practices. A thorough review of the electricity markets worldwide with solar energy is provided. A variety of proposed mathematical solutions to the problem are also addressed.

14 SOLAR ENERGY↗
DOE OSTI2021

Diverse Super-Resolution (diversity_SR) [SWR-21-60]

Deep learning tools for enhancing the spatial resolution of wind data. The software is developed in Python using the TensorFlow deep learning package. Models for diversity super-resolution is provided. Included in the package are pretrained models with example code/data to perform the super-resolution as well as tools of training models for different enhancement- or data-types. The super-resolution is an inherently ill-conditioned problem, with multiple high-resolution fields plausibly mapping to the same coarse field. Considitional GANs provide a framework for generating a distribution of high-resolution realizations from a given low-resolution input. Stochastic estimation is used to inform the network of the expected degree and location of sub-grid diversity. The package includes a pretrained network to generate distributions of 10x-enhanced fields of wind data.

Glaws, Andrew↗
DOE OSTI2021

Uncertainty Quantification of Geophysical Inversion Using Stochastic Partial Differential Equations (LDRD #218329)

This report summarizes work completed under the Laboratory Directed Research and Development (LDRD) project "Uncertainty Quantification of Geophysical Inversion Using Stochastic Differential Equations." Geophysical inversions often require computationally expensive algorithms to find even one solution, let alone propagating uncertainties through to the solution domain. The primary purpose of this project was to find more computationally efficient means to approximate solution uncertainty in geophysical inversions. We found multiple computationally efficient methods of propagating Earth model uncertainty into uncertainties in solutions of full waveform seismic moment tensor inversions. However, the optimum method of approximating the uncertainty in these seismic source solutions was to use the Karhunen-Love theorem with data misfit residuals. This method was orders of magnitude more computationally efficient than traditional Monte Carlo methods and yielded estimates of uncertainty that closely approximated those of Monte Carlo. We will summarize the various methods we evaluated for estimating uncertainty in seismic source inversions as well as work toward this goal in the realm of 3-D seismic tomographic inversion uncertainty.

58 GEOSCIENCES↗
DOE OSTI2026

Modeling frequency instability in high-quality resonant experiments

Modern resonant sensing tools can achieve increasingly high quality factors, which correspond to extremely narrow linewidths. In such systems, time variation of the resonator’s natural frequency can potentially impact its ability to accumulate power and its resulting sensitivity. One such example is the Dark SRF experiment, which utilizes superconducting radio frequency (SRF) cavities with quality factors of Q ∼ 10 10 . Microscopic deformations of the cavity lead to stochastic jittering of its resonant frequency with amplitude 20 times its linewidth. Naively, one may expect this to lead to a large suppression in accumulated power. In this work, we study in detail the effects of frequency instability on high-quality resonant systems, utilizing the Dark SRF experiment as a case study. We show that the timescale of jittering is crucial to determining its effect on power accumulation. Namely, when the resonant frequency varies sufficiently quickly, the system accumulates power as if there were no jittering at all. This implies that the sensitivity of a jittering resonator is comparable to that of a stable resonator. In the case of Dark SRF, we find that jittering only induces a ∼ 10 % loss in power. Our results allow the dark-photon exclusion bound from Dark SRF’s pathfinder run to be refined, leading to a constraint that is an order of magnitude stronger than previously reported (corresponding to a signal-to-noise ratio that is four orders of magnitude larger). This result represents the world-leading constraint on dark photons over a wide range of masses below 6 μ eV and translates to the best laboratory-based limits on the photon mass m γ < 2.9 × 10 - 48 g .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Predictive Complexity of Quantum Subsystems

We define predictive states and predictive complexity for quantum systems composed of distinct subsystems. This complexity is a generalization of entanglement entropy. It is inspired by the statistical or forecasting complexity of predictive state analysis of stochastic and complex systems theory but is intrinsically quantum. Predictive states of a subsystem are formed by equivalence classes of state vectors in the exterior Hilbert space that effectively predict the same future behavior of that subsystem for some time. As an illustrative example, we present calculations in the dynamics of an isotropic Heisenberg model spin chain and show that, in comparison to the entanglement entropy, the predictive complexity better signifies dynamically important events, such as magnon collisions. It can also serve as a local order parameter that can distinguish long and short range entanglement.

Asplund, Curtis T. (ORCID:0000000305575850)↗
DOE OSTI2024

A ‘Nuclear Bomb’ or Just ‘a Joke’? Groundwater Models May Help Communicate Nuanced Risks to the Great Salt Lake

The Great Salt Lake entered the zeitgeist of environmental concern in 2022 when a coalition of scientists and activists warned in a highly publicized report that the lake might be just five years away from complete desiccation, a possibility one state official warned was tantamount to an “environmental nuclear bomb”. Shortly thereafter, an unpredicted and unprecedented pluvial winter resulted in an increase in inflow, temporarily halting the lake’s decline and prompting Utah’s governor to mock the dire prediction as “a joke”, an outcome that speaks to the tension between agenda-setting and trust-building that researchers face when sharing worst-case warnings, particularly those based on short-term variability. Here, we describe a robust relationship between the lake and groundwater in the surrounding region and demonstrate how coupled models can thus be used to improve lake elevation predictions, suggesting that while the situation may not be as dire as some have warned, the lake remains at long-term risk as a result of climate warming. We further suggest that efforts to communicate the risk of future desiccation should be informed by stochastic variability and guided by long-term fluctuations in the total water storage of the endorheic lake’s watershed.

Environmental Sciences & Ecology↗
DOE OSTI2026

Preparing Fermions via Classical Sampling and Linear Combinations of Unitaries

We present an extension of the Evolving density matrices on Qubits (E$ρ$OQ) framework that enables efficient fault-tolerant preparation of fermionic quantum states. The original method circumvents state preparation by stochastic sampling, but faces a sign problem in fermionic systems leading to a large number of circuits necessary. We resolve this by combining classical stochastic sampling with a linear combination of unitaries method that avoids the exponential circuit scaling that plagued naïve implementations. The resulting algorithm requires $\mathcal{O}(M^2)$$R_Z$ rotations for circuit preparation, where $M$ is the number of retained basis states. We validate the method for ground and excited states in the Thirring model, including by computing two-point correlation functions relevant to scattering. In this model for fixed accuracy $\varepsilon$, $M$ is found to scale empirically as $M \propto \frac{1}{mg}\log(1/g)\log(1/m)$.

Gustafson, Erik J. [RIACS, Mtn. View] (ORCID:00000↗
DOE OSTI2022

Probing physics beyond the standard model: limits from BBN and the CMB independently and combined

We present new Big Bang Nucleosynthesis (BBN) limits on the cosmic expansion rate or relativistic energy density, quantified via the number N ν of equivalent neutrino species. We use the latest light element observations, neutron mean lifetime, and update our evaluation for the nuclear rates d + d → 3 He + n and d + d → 3 H+p. Combining this result with the independent constraints from the cosmic microwave background (CMB) yields tight limits on new physics that perturbs N ν and η prior to cosmic nucleosynthesis: a joint BBN+CMB analysis gives N ν = 2.898 ± 0.141, resulting in N ν < 3.180 at 2σ. We apply these limits to a wide variety of new physics scenarios including right-handed neutrinos, dark radiation, and a stochastic gravitational wave background. The strength of the independent BBN and CMB constraints now opens a new window: we can search for limits on potential changes in N ν and/or the baryon-to-photon ratio η between the two epochs. The present data place strong constraints on the allowed changes in N ν between BBN and CMB decoupling; for example, we find -0.708 < N ν CMB - N ν BBN < 0.328 in the case where η and the primordial helium mass fraction Yp are unchanged between the two epochs; we also give limits on the allowed variations in η or in (η, N ν ) jointly. We discuss scenarios in which such changes could occur, and show that BBN+CMB results combine to place important constraints on some early dark energy models to explain the H 0 tension. Looking to the future, we forecast the tightened precision for N ν arising from both CMB Stage 4 measurements as well as improvements in astronomical 4 He measurements. Here, we find that CMB-S4 combined with present BBN and light element observation precision can give σ(N ν ) ≃ 0.03. Such future precision would reveal the expected effect of neutrino heating (N eff -3 = 0.044) of the CMB during BBN, and would be near the level to reveal any particle species ever in thermal equilibrium with the standard model. Improved Y p measurements can push this precision even further.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Variational design principles for nonequilibrium colloidal assembly

Using large deviation theory and principles of stochastic optimal control, we show that rare molecular dynamics trajectories conditioned on assembling a specific target structure encode a set of interactions and external forces that lead to enhanced stability of that structure. Such a relationship can be formulated into a variational principle, for which we have developed an associated optimization algorithm and have used it to determine optimal forces for targeted self-assembly within nonequilibrium steady-states. We illustrate this perspective on inverse design in a model of colloidal cluster assembly within linear shear flow. We find that colloidal clusters can be assembled with high yield using specific short-range interactions of tunable complexity. Shear decreases the yields of rigid clusters, while small values of shear increase the yields of nonrigid clusters. The enhancement or suppression of the yield due to shear is rationalized with a generalized linear response theory. Furthermore, by studying 21 unique clusters made of six, seven, or eight particles, we uncover basic design principles for targeted assembly out of equilibrium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Soil microbiome predictability increases with spatial and taxonomic scale

Soil microorganisms shape ecosystem function, yet it remains an open question whether we can predict the composition of the soil microbiome in places before observing it. Furthermore, it is unclear whether the predictability of microbial life exhibits taxonomic- and spatial-scale dependence, as it does for macrobiological communities. Here, we leverage multiple large-scale soil microbiome surveys to develop predictive models of bacterial and fungal community composition in soil, then test these models against independent soil microbial community surveys from across the continental United States. We find remark- able scale dependence in community predictability. The predictability of bacterial and fungal communities increases with the spatial scale of observation, and fungal predictability increases with taxonomic scale. These patterns suggest that there is an increasing importance of deterministic versus stochastic processes with scale, consistent with findings in plant and animal communities, suggesting a general scaling relationship across biology. Biogeochemical functional groups and high-level taxonomic groups of microorganisms were equally predictable, indicating that traits and taxonomy are both powerful lenses for understanding soil communities. Here, by focusing on out-of-sample prediction, these findings suggest an emerging generality in our understanding of the soil microbiome, and that this understanding is fundamentally scale dependent

Biogeography↗
DOE OSTI2025

Evolution of intermittent filaments in the scrape-off layer of NSTX

Filamentary structures naturally arise from background turbulence in the scrape-off layer (SOL) of plasmas, leading to significant particle and heat transport that can degrade overall plasma confinement. This enhanced transport can contribute to unacceptably high heat loads on plasma-facing components. As such, understanding the physics of SOL plasma filaments is critical for predicting and mitigating their effects in future fusion devices. On the National Spherical Torus Experiment (NSTX), plasma filaments—commonly referred to as “blobs”—were investigated using the gas-puff imaging (GPI) diagnostic in the edge and SOL regions. The analysis involved identifying, segmenting, and tracking the characteristic contours of the blobs in each frame of the GPI video sequences. Their evolution was characterized through shape descriptors, velocity, and angular velocity derived from their contour coordinates. The results indicate that as the blob area increases, their shapes become more concave and less circular, suggesting reduced structural stability in larger blobs. This result aligns with previous theoretical results where it was shown that larger blobs are more susceptible to instabilities [Krasheninnikov et al., J. Plasma Phys. 74, 679–717 (2008) and D'Ippolito et al., Phys. Plasmas 18, 060501 (2011)]. A positive correlation was observed between radial velocity and radial position, suggesting radially outward acceleration of the filaments, potentially driven by decreasing viscous drag toward the far SOL. Interestingly, blobs in background SOL turbulence exhibited minimal spinning in contrast to filaments originating from edge localized modes, which show substantial rotation during their paths [Lampert et al., Phys. Plasmas 29, 102502 (2022)]. Statistical analysis of the solidity and total curvature shape descriptors, along with their temporal evolution, revealed relatively broad, near-Gaussian distributions. This suggests that blob morphology is strongly influenced by stochastic turbulent processes in the surrounding plasma environment. Blob parameters were also compared with bulk plasma and radial profile measurements. Notable trends were found between blob rotation and poloidal velocity with collisionality and line-integrated density. These findings contribute to a deeper understanding of blob dynamics and provide valuable insights for refining SOL turbulence models.

Covariance and correlation↗
DOE OSTI2024

Gravitational waves from stochastic scalar fluctuations

Here, we present a novel mechanism for gravitational wave generation in the early Universe. Light spectator scalar fields during inflation can acquire a blue-tilted power spectrum due to stochastic effects. We show that this effect can lead to large curvature perturbations at small scales (induced by the spectator field fluctuations) while maintaining the observed, slightly red-tilted curvature perturbations at large cosmological scales (induced by the inflaton fluctuations). Along with other observational signatures, such as enhanced dark matter substructure, large curvature perturbations can induce a stochastic gravitational wave background (SGWB). The predicted strength of SGWB in our scenario, Ω GW ⁢ℎ 2 ≃10 -20 -10 -15 , can be observed with future detectors, operating between 10 -5 Hz and 10 Hz. We note that, in order to accommodate the newly reported NANOGrav observation, one could consider the same class of spectator models. At the same time, one would need to go beyond the simple benchmark considered here and consider a regime in which a misalignment contribution is also important.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Delivery-Risk-Aware Flexibility Scheduling and Dispatch for Aggregated Flexible Loads

Flexible loads like smart thermostats and water heaters can shift energy consumption and provide flexibility to the grid. However, this flexibility is dependent on occupant behavior and can lead to delivery risk, which causes utilities and grid operations to consider them as unreliable for purposes of grid operation. To date, they have not been well integrated into wholesale electricity markets or ancillary service offerings. With proper consideration of uncertainty and risk, these resources can be one of the most cost-effective sources of flexibility. This work uses stochastic optimization to quantify and bid flexibility from a fleet of flexible resources while considering their delivery risk.

DER↗
DOE OSTI2021

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗
DOE OSTI2023

Stochastic optimization of a uranium oxide reaction mechanism using plasma flow reactor measurements

Abstract In this work, a coupled Monte Carlo Genetic Algorithm (MCGA) approach is used to optimize a gas phase uranium oxide reaction mechanism based on plasma flow reactor (PFR) measurements. The PFR produces a steady Ar plasma containing U, O, H, and N species with high temperature regions (3000–5000 K) relevant to observing UO formation via optical emission spectroscopy. A global kinetic treatment is used to model the chemical evolution in the PFR and to produce synthetic emission signals for direct comparison with experiments. The parameter space of a uranium oxide reaction mechanism is then explored via Monte Carlo sampling using objective functions to quantify the model-experiment agreement. The Monte Carlo results are subsequently refined using a genetic algorithm to obtain an experimentally corroborated set of reaction pathways and rate coefficients. Out of 12 reaction channels targeted for optimization, four channels are found to be well constrained across all optimization runs while another three channels are constrained in select cases. The optimized channels highlight the importance of the OH radical in oxidizing uranium in the PFR. This study comprises a first step toward producing a comprehensive experimentally validated reaction mechanism for gas phase uranium molecular species formation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗