Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic gradient”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Stochastic hydrodynamics and hydro-kinetics: Similarities and differences

The hydro-kinetic formalism has been used as a complementary approach to solving the Stochastic Differential Equations (SDE) corresponding to noisy hydrodynamics. The hydro-kinetic formalism consists of a deterministic set of relaxation type equations that tracks the evolution of 2-point correlation functions of stochastic hydrodynamic quantities. Hence they are comparatively easier to solve than the SDEs, which are computationally intensive and need to deal with arbitrarily large gradients. This work compares the two approaches for the propagation and diffusion of conserved charge fluctuations in the Bjorken hydrodynamic model. For white noise, the two approaches agree. For colored Catteneo noise, which is causal, the two approaches diverge. This is because white noise only induces two-point correlations, while Catteneo noise also induces higher-order correlations. Furthermore, this difference is quantified from the effects of causal evolution and influence from higher-order correlations induced by the Catteneo noise.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Revisiting the ODE Method for Recursive Algorithms: Fast Convergence Using Quasi Stochastic Approximation

Several decades ago, Profs. Sean Meyn and Lei Guo were postdoctoral fellows at ANU, where they shared interest in recursive algorithms. It seems fitting to celebrate Lei Guo's 60th birthday with a review of the ODE Method and its recent evolution. The method has been regarded as a technique for algorithm analysis. It is argued that this viewpoint is backwards: The original stochastic approximation method was surely motivated by an ODE, and tools for analysis came much later (based on establishing robustness of Euler approximations). The paper presents a brief survey of recent research in machine learning that shows the power of algorithm design in continuous time, following by careful approximation to obtain a practical recursive algorithm. While these methods are usually presented in a stochastic setting, this is not a prerequisite. In fact, recent theory shows that rates of convergence can be dramatically accelerated by applying techniques inspired by quasi Monte-Carlo. Subject to conditions, the optimal rate of convergence can be obtained by applying the averaging technique of Polyak and Ruppert. The conditions are not universal, but theory suggests alternatives to achieve acceleration. The theory is illustrated with applications to gradient-free optimization, and policy gradient algorithms for reinforcement learning.

learning and adaptive systems in artificial intell↗
DOE OSTI2022

Learning Stochastic Parametric Differentiable Predictive Control Policies

We present a scalable unsupervised learning-based method for obtaining explicit control policies for model predictive control problems for stochastic linear systems with additive uncertainties subject to nonlinear chance constraints. We call the proposed method stochastic parametric differentiable predictive control (SP-DPC), which extends the recently proposed deterministic DPC policy optimization algorithm. We formulate the SP-DPC as a deterministic approximation to the stochastic parametric constrained optimal control problem via independent sampling of the problem's parameters and uncertainties. This formulation allows us to directly compute the policy gradients via automatic differentiation of the problem's value function, evaluated over sampled parameters and uncertainties. In particular, the computed expectation of the problem's value function is backpropagated through the finite-time closed-loop system rollouts parametrized by a known nominal system dynamics model and neural control policy. We also provide theoretical probabilistic guarantees on closed-loop stability and chance constraints satisfaction for systems controlled by learned neural policies. We demonstrate the computational efficiency and scalability of the proposed policy optimization algorithm in three numerical examples, including systems with a large number of states or subject to nonlinear constraints.

Drgona, Jan↗
DOE OSTI2025

A fluctuating hydrodynamics model for nanoscale surfactant-laden interfaces

A multispecies diffuse interface model is formulated in a fluctuating hydrodynamics framework for the purpose of simulating surfactant interfaces at the nanoscale. The model generalizes previous work to ternary mixtures, employing a Cahn-Hilliard free energy density combined with incompressible, isothermal fluctuating hydrodynamics where dissipative fluxes include both deterministic and stochastic terms. The intermolecular parameters in the free energy are chosen such that one species acts as a partially miscible surfactant. From Laplace pressure measurements, we show that in this model the surface tension decreases linearly with surfactant concentration, leading to Marangoni convection for interfaces with concentration gradients. In the capillary wave spectrum for interfaces with and without surfactant, we find that for the former, the spectrum deviates significantly from classical capillary wave theory, presumably due to Gibbs elasticity. In non-equilibrium simulations of the Rayleigh-Plateau instability, deterministic simulations showed that the surfactant delays pinching of a fluid cylinder into droplets. However, stochastic simulations indicate that thermal fluctuations disrupt the surfactant's stabilizing effect. Similarly, the spreading of a patch of surfactant, driven by Marangoni convection, was found to be partially suppressed by thermal fluctuations.

Capillary waves↗
DOE OSTI2023

MrHyDE v.1.0

SAND2024-01324O MrHyDE, which stands for Multi-resolution Hybridized Differential Equations, is a general-purpose C++ package for the solution of coupled multiphysics and multiscale systems on massively parallel computing systems. MrHyDE is designed to enable moving beyond forward simulation for multiscale applications which includes optimization, control, uncertainty quantification, and stochastic inversion. The framework provides interfaces to several packages within the Trilinos framework and leverages automatic differentiation to enable adjoint capabilities for large-scale, gradient-based optimization. MrHyDE provides automated multiscale capabilities through a subgrid model interface and multiscale Dirichlet-to-Neumann maps. For extreme-scale applications, MrHyDE provides in situ data-compression algorithms to reduce memory requirements while maintaining performance. MrHyDE is a general-purpose, computational framework for the solution of multiscale and multiphysics applications. It uses a combination of structure-preserving, physics-compatible discretizations, fully implicit methods, multi-resolution schemes, or fully explicit methods. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗
NASA NTRS1989

Energy dissipation of Alfven wave packets deformed by irregular magnetic fields in solar-coronal arches

The importance of field line geometry for shear Alfven wave dissipation in coronal arches is demonstrated. An eikonal formulation makes it possible to account for the complicated magnetic geometry typical in coronal loops. An interpretation of Alfven wave resonance is given in terms of gradient steepening, and dissipation efficiencies are studied for two configurations: the well-known slab model with a straight magnetic field, and a new model with stochastic field lines. It is shown that a large fraction of the Alfven wave energy flux can be effectively dissipated in the corona.

Similon, Philippe L.↗
DOE OSTI2023

Insights into ENSO Diversity from an Intermediate Coupled Model. Part II: Role of Nonlinear Dynamics and Stochastic Forcing

Abstract In this study, we investigate how a single leading linear El Niño–Southern Oscillation (ENSO) mode, as studied in Part I, leads to the irregular coexistence of central Pacific (CP) and eastern Pacific (EP) ENSO, a phenomenon known as ENSO spatiotemporal diversity. This diversity is fundamentally generated by deterministic nonlinear pathways to chaos via the period-doubling route and, more prevailingly, the subharmonic resonance route with the presence of a seasonally varying basic state. When residing in the weakly nonlinear regime, the coupled system sustains a weak periodic oscillation with a mixed CP/EP pattern as captured by the linear ENSO mode. With a stronger nonlinearity effect, the ENSO behavior experiences a period-doubling bifurcation. The single ENSO orbit splits into coexisting CP-like and EP-like ENSO orbits. A sequence of period-doubling bifurcation results in an aperiodic oscillation featuring irregular CP and EP ENSO occurrences. The overlapping of subharmonic resonances between ENSO and the seasonal cycle allows this ENSO irregularity and diversity to be more readily excited. In the strongly nonlinear regime, the coupled system is dominated by regular EP ENSO. The deterministic ENSO spatiotemporal diversity is thus confined to a relatively narrow range corresponding to a moderately unstable ENSO mode. Stochastic forcing broadens this range and allows ENSO diversity to occur when the ENSO mode is weakly subcritical. A close relationship among a weakened mean zonal temperature gradient, stronger ENSO activity, and more (fewer) occurrences of EP (CP) ENSO is noted, indicating that ENSO–mean state interaction may yield ENSO regime modulations on the multidecadal time scale.

Geng, Licheng↗
NASA NTRS1991

Stochastic inflation lattice simulations - Ultra-large scale structure of the universe

Non-Gaussian fluctuations for structure formation may arise in inflation from the nonlinear interaction of long wavelength gravitational and scalar fields. Long wavelength fields have spatial gradients, a (exp -1), small compared to the Hubble radius, and they are described in terms of classical random fields that are fed by short wavelength quantum noise. Lattice Langevin calculations are given for a toy model with a scalar field interacting with an exponential potential where one can obtain exact analytic solutions of the Fokker-Planck equation. For single scalar field models that are consistent with current microwave background fluctuations, the fluctuations are Gaussian. However, for scales much larger than our observable Universe, one expects large metric fluctuations that are non-Gaussian. This example illuminates non-Gaussian models involving multiple scalar fields which are consistent with current microwave background limits.

Salopek, D. S.↗
NASA NTRS1987

Stochastic and hybrid-stress plate/shell finite elements for hot-section components

The research effort in the Center for the Advancement of Computational Mechanics at Georgia Tech has two main thrusts. The first of these is the development of special approaches for the numerical stress analysis of solids and structures whose material and geometric properties are uncertain. The second seeks to develop and implement high-efficiency plate and shell elements. The stochastic element method, currently being implemented, will be able to more accurately portray the probabilistic nature of stress, strain, and displacement in actual structures. Current research has provided a hybrid-stress shell element whose behavior is acceptable for aspect ratios as high as 30 to 1. Thus, substantially more complex analyses will be practicable as soon as this element is fully implemented. An additional advantage of the hybrid approach is that it permits more accurate stress-recovery at the upper and lower surfaces of the shell, an important consideration in high thickness-gradient applications. The software associated with the above research is being implemented in the form of extensions to the Nessus code. The hybrid shell element has been successfully tested in several small-deformation elastic analyses. The theoretical formulation of the stochastic elements is essentially complete; its implementation is just beginning.

Atluri, S. N.↗
DOE OSTI2023

Electronic specific heat capacities and entropies from density matrix quantum Monte Carlo using Gaussian process regression to find gradients of noisy data

In this work, we present a machine learning approach to calculating electronic specific heat capacities for a variety of benchmark molecular systems. Our models are based on data from density matrix quantum Monte Carlo, which is a stochastic method that can calculate the electronic energy at finite temperature. As these energies typically have noise, numerical derivatives of the energy can be challenging to find reliably. In order to circumvent this problem, we use Gaussian process regression to model the energy and use analytical derivatives to produce the specific heat capacity. From there, we also calculate the entropy by numerical integration. We compare our results to cubic splines and finite differences in a variety of molecules in which Hamiltonians can be diagonalized exactly with full configuration interaction. We finally apply this method to look at larger molecules where exact diagonalization is not possible and make comparisons with more approximate ways to calculate the specific heat capacity and entropy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Stochastic and deterministic processes shape bioenergy crop microbiomes along a vertical soil niche

Abstract Sustainable biofuel cropping systems aim to address climate change while meeting energy needs. Understanding how soil and plant‐associated microbes respond to these different cropping systems is key to promoting agriculture sustainability and evaluating changes in ecosystem functions. Here, we leverage a long‐term biofuel cropping system field experiment to dissect soil and root microbiome changes across a soil‐depth gradient in poplar, restored prairie and switchgrass to understand their effects on the microbial communities. High throughput amplicon sequencing of the fungal internal transcribed spacer (ITS) and prokaryotic 16S DNA regions showed a common trend of root and soil microbial community richness decreasing and evenness increasing with depth. Ecological niche (root vs. soil) had the strongest effect on community structure, followed by depth, then crop. Stochastic processes dominated the structuring of fungal communities in deeper soil layers while operational taxonomic units (OTUs) in surface soil layers were more likely to co‐occur and to be enriched by plant hosts. Prokaryotic communities were dispersal limited at deeper depths. Microbial networks showed a higher density, connectedness, average degree and module size in deeper soils. We observed a decrease in fungal‐fungal links and an increase of bacteria–bacteria links with increasing depth in all crops, particularly in the root microbiome.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Score-based deterministic density sampling

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density π given only its score ∇ log π. Our method approximates the Wasserstein gradient flow on KL($f_t$∥π) by learning the time-varying score ∇ log $f_t$ on the fly using score matching. While having the same marginal distribution as Langevin dynamics, our method produces smooth deterministic trajectories, resulting in monotone noise-free convergence. We prove that our method dissipates relative entropy at the same rate as the exact gradient flow, provided sufficient training. Numerical experiments validate our theoretical findings: our method converges at the optimal rate, has smooth trajectories, and is often more sample efficient than its stochastic counterpart. Experiments on high-dimensional image data show that our method produces high-quality generations in as few as 15 steps and exhibits natural exploratory behavior. The memory and runtime scale linearly in the sample size.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2019

A Communication Channel Density Estimating Generative Adversarial Network

Autoencoder-based communication systems use neural network channel models to backwardly propagate message reconstruction error gradients across an approximation of the physical communication channel. In this work, we develop and test a new generative adversarial network (GAN) architecture for the purpose of training a stochastic channel approximating neural network. In previous research, investigators have focused on additive white Gaussian noise (AWGN) channels and/or simplified Rayleigh fading channels, both of which are linear and have well defined analytic solutions. Given that training a neural network is computationally expensive, channel approximation networks— and more generally the autoencoder systems—should be evaluated in communication environments that are traditionally difficult. To that end, our investigation focuses on channels that contain a combination of non-linear amplifier distortion, pulse shape filtering, intersymbol interference, frequency-dependent group delay, multipath, and non-Gaussian statistics. Each of our models are trained without any prior knowledge of the channel. We show that the trained models have learned to generalize over an arbitrary amplifier drive level and constellation alphabet. We demonstrate the versatility of our GAN architecture by comparing the marginal probability density function of several channel simulations with that of their corresponding neural network approximations

Smith, Aaron↗
DOE OSTI2026

Optimality of Gradient-MUSIC for Spectral Estimation

We introduce the Gradient-MUSIC algorithm for estimating the unknown frequencies and amplitudes of a nonharmonic signal from noisy time samples. While the classical MUSIC algorithm performs a computationally expensive search over a fine grid, Gradient-MUSIC is significantly more efficient and eliminates the need for discretization over a fine grid by using optimization techniques. It coarsely scans the 1D landscape to find initialization simultaneously for all frequencies followed by parallelizable local refinement via gradient descent. We also analyze its performance when the noise level is sufficiently small and the signal frequencies are separated by at least 8π/m, where π/m is the standard resolution of this problem. Even though the 1D landscape is nonconvex, we prove a global convergence result for Gradient-MUSIC: coarse scanning provably finds suitable initialization and gradient descent converges at a linear rate. In addition to convergence results, we also upper bound the error between the true signal frequencies and amplitudes with those found by Gradient-MUSIC. For example, if the noise has $\ell^\infty$ norm at most ϵ, then the frequencies and amplitudes are recovered up to error at most Cϵ/m and Cϵ respectively, which are minimax optimal in m and ϵ. Our theory can also handle stochastic noise with performance guarantees under nonstationary independent Gaussian noise. Our main approach is a comprehensive geometric analysis of the landscape, a perspective that has not been explored before.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The role of edge resonant magnetic perturbations in edge-localized-mode suppression and density pump-out in low-collisionality DIII-D plasmas

Two-fluid nonlinear MHD simulations using the TM1 code demonstrate that the formation of magnetic islands at the top and bottom of the H-mode pedestal, together with the strong screening of resonant fields in the gradient region of the pedestal, can account for ELM suppression and density pump-out by n = 2 resonant magnetic perturbations (RMPs) in low-collisionality DIII-D ITER similar shape (ISS) plasmas. Using experimentally relevant transport coefficients, neoclassical resistivity, electron collisionality, and RMP amplitudes, nonlinear MHD simulations reproduce the observed level of density reduction (density pump-out) in DIII-D due to the formation of narrow magnetic islands in the resistive foot of pedestal. For large amplitude RMPs ( B r / B t > 1 × 10 -4 ) simulations predict resonant field penetration and resulting in pressure reduction at the top of the pedestal, consistent with experimental observations at the onset of ELM suppression. The predicted reduction in the height and width of the pedestal by magnetic island enhanced collisional transport provides a quantitative mechanism for the stabilization of the peeling-ballooning mode (PBM). Importantly, these simulations predict strong screening of resonant fields in the steep gradient region of the pedestal due to strong E × B rotation and diamagnetic flows. Yet, if the plasma resistivity is made artificially larger (~ 10X) than neoclassical, the simulations predict magnetic stochasticity throughout the plasma edge and the collapse of the pedestal due to the reduction in the penetration threshold with increasing resistivity. A scaling relation for resonant field penetration at the pedestal top, using several hundred nonlinear simulations, reproduces the density and E × B rotation dependence of the ELM suppression threshold observed in DIII-D. Simulations using ITER model equilibria indicate that the penetration threshold at the top of the ITER pedestal will be lower than in DIII-D due to the anticipated lower perpendicular flow velocities in ITER, resulting in the weaker screening of resonant fields.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

The maintenance of coherent vortex topology by Lagrangian chaos in drift-Rossby wave turbulence

Here, this work introduces the “potential vorticity bucket brigade,” a mechanism for explaining the resilience of vortex structures in magnetically confined fusion plasmas and geophysical flows. Drawing parallels with zonal jet formation, we show how inhomogeneous patterns of mixing can reinforce, rather than destroy non-zonal flow structure. We accomplish this through an exact stochastic Lagrangian representation of vorticity transport, together with a near-integrability property, which relates coherent flow topology to fluid relabeling symmetries. We demonstrate these ideas in the context of gradient-driven magnetized plasma turbulence, though the tools we develop here are model-agnostic and applicable beyond the system studied here.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Enhanced mechanical property evaluation using innovative data analytics capability

This report focuses on efforts to improve Multiphysics Object-Oriented Simulation Environ-ment (MOOSE) for mechanical property evaluation using data analytics. These efforts involveimprovements to the stochastic tools module (STM) for stochastic simulations of MOOSE mul-tiphysics model and the development of inverse optimization capabilities. The report gives anoverview of the STM and describes recent updates to its core capabilities and theory on itsreduced-order model (ROM) schemes. Examples are also provided showing the impact of theseupdates and exhibits the usefulness of ROMs. An overview of the gradient based inverse opti-mziation algorithms are given along with examples of their application to source identification.Inverse optimization will provide a new methodology in STM for fitting model parameters toexperimental data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1974

Parameter estimation for terrain modeling from gradient data

This paper developes a method for mathematically modeling terrain surfaces for use on an unmanned Martian vehicle. The data collected by the vehicle consists of terrain height and two directional slopes at each data point. The parameters for the mathematical terrain model are stochastically determined by using least square approximations.-

Shen, C. N.↗