Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic gradient”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

An adjoint method for determining the sensitivity of island size to magnetic field variations

An adjoint method to calculate the gradient of island width in stellarators is presented and applied to a set of magnetic field configurations. The underlying method for calculation of the island width is that of Cary & Hanson ( Phys. Fluids B, vol. 3, issue 4, 1991, pp. 1006–1014) (with a minor modification), and requires that the residue of the island centre be small. Therefore, the gradient of the residue is calculated in addition. Both the island width and the gradient calculations are verified using an analytical magnetic field configuration introduced by Reiman & Greenside ( Comput. Phys. Commun. , vol. 43, issue 1, 1986, pp. 157–167). The method is also applied to the calculation of the shape gradient of the width of a magnetic island in a National Compact Stellarator Experiment (NCSX) vacuum configuration with respect to positions on a coil. A gradient-based optimization is applied to a magnetic field configuration studied by Hanson & Cary ( Phys. Fluids , vol. 27, issue 4, 1984, pp. 767–769) to minimize stochasticity by adding perturbations to a pair of helical coils. Although only vacuum magnetic fields and an analytical magnetic field model are considered in this work, the adjoint calculation of the island width gradient could also be applied to a magnetohydrodynamic (MHD) equilibrium if the derivative of the magnetic field, with respect to the equilibrium parameters, is known. Using the island width gradient calculation presented here, more general gradient-based optimization methods can be applied to design stellarators with small magnetic islands. Moreover, the sensitivity of the island size may itself be optimized to ensure that coil tolerances, with respect to island size, are kept as high as possible.

Physics↗
DOE OSTI2023

Assignment of Freight Traffic in a Large-scale Intermodal Network under Uncertainty

This paper presents a methodology for freight traffic assignment in a large-scale road-rail intermodal network under uncertainty. Network uncertainties caused by natural disasters have dramatically increased in recent years. Several of these disasters (e.g., Hurricane Sandy, Mississippi River Flooding, and Hurricane Harvey) severely disrupted the U.S. freight transportation network, and consequently, the supply chain. To account for these network uncertainties, a stochastic freight traffic assignment model is formulated. An algorithmic framework, involving the sample average approximation and gradient projection algorithm, is proposed to solve this challenging problem. The developed methodology is tested on the U.S. intermodal network with freight flow data from the Freight Analysis Framework. The experiments consider three types of natural disasters that have different risks and impacts on transportation networks: earthquakes, hurricanes, and floods. It is found that for all disaster scenarios, freight ton-miles are higher compared to the base case without uncertainty. The increase in freight ton-miles is the highest under the flooding scenario; this is because there are more states in the flood-risk areas, and they are scattered throughout the U.S.

42 ENGINEERING↗
DOE OSTI2022

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure --- this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗
DOE OSTI2022

SPATIAL GRAPH ATTENTION AND CURIOSITY-DRIVEN POLICY FOR ANTIVIRAL DRUG DISCOVERY

We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure - this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.

Wu, Y↗
DOE OSTI2024

Stochastic Optimization to Find Optimum Beginning-of-Life Core Configuration of Stable Salt Reactor with Online Refueling

A stochastic optimization method has been developed to find an optimum equilibrium cycle core configuration of the waste-burning stable salt reactor, which is a fast-spectrum molten salt reactor with frequent online refueling. An optimum core configuration was determined with the goal of minimizing radial power peaking. Because of the vast number of potential candidate core configurations, stochastic optimization was applied based on simulated annealing and an additional acceleration method, which screened out unpromising core configurations. It has been demonstrated that the developed stochastic optimization method successfully finds the optimal core configuration regardless of the initial guess and outperforms the gradient descent approach. In addition, it has been observed that the use of a so-called out-in core configuration as the initial guess speeds up convergence of the iterative solution more than five times. Based on the searched optimum equilibrium cycle core configuration, new beginning-of-life (BOL) core configurations have been developed. In conclusion, the new BOL core configurations will be used in developing optimum refueling strategies.

Moltex static salt reactor↗
DOE OSTI2022

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optical Diagnostics of Discharges in and in Contact With Liquids

Discharges in liquids have been the subject of intensive investigations for a broad range of applications and involve highly coupled and complex phenomena with timescales ranging from picoseconds to seconds and length scales from micrometers to centimeters. This review focuses on some of the challenges in optical diagnostics of discharges in and in contact with liquids; this includes the interpretation of optical emission spectra, the inherently stochastic nature of many discharge phenomena including the initial stages of plasma ignition, and the large gradients in species and plasma properties interfacing with a dynamic liquid interface. We report recent notable advances, controversies in interpretations of diagnostics, and remaining opportunities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Binary Quantum Control Optimization with Uncertain Hamiltonians

Optimizing the controls of quantum systems plays a crucial role in advancing quantum technologies. The time-varying noises in quantum systems and the widespread use of inhomogeneous quantum ensembles raise the need for high-quality quantum controls under uncertainties. In this paper, we consider a stochastic discrete optimization formulation of a discretized binary optimal quantum control problem involving Hamiltonians with predictable uncertainties. We propose a sample-based reformulation that optimizes both risk-neutral and risk-averse measurements of control policies, and solve these with two gradient-based algorithms using sum-up-rounding approaches. Furthermore, we discuss the differentiability of the objective function and prove upper bounds of the gaps between the optimal solutions to binary control problems and their continuous relaxations. We conduct numerical simulations on various sized problem instances based on two applications of quantum pulse optimization; we evaluate different strategies to mitigate the impact of uncertainties in quantum systems. In conclusion, we demonstrate that the controls of our stochastic optimization model achieve significantly higher quality and robustness compared with the controls of a deterministic model.

conditional value-at-risk (CVaR)↗
DOE OSTI2024

Optimization of nonlinear turbulence in stellarators

We present new stellarator equilibria that have been optimized for reduced turbulent transport using nonlinear gyrokinetic simulations within the optimization loop. The optimization routine involves coupling the pseudo-spectral GPU-native gyrokinetic code GX with the stellarator equilibrium and optimization code DESC . Since using GX allows for fast nonlinear simulations, we directly optimize for reduced nonlinear heat fluxes. To handle the noisy heat flux traces returned by these simulations, we employ the simultaneous perturbation stochastic approximation (SPSA) method that only uses two objective function evaluations for a simple estimate of the gradient. We show several examples that optimize for both reduced heat fluxes and good quasi-symmetry as a proxy for low neoclassical transport. Finally, we run full transport simulations using the T3D stellarator transport code to evaluate the changes in the macroscopic profiles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Efficient particle control in systems with large density gradients

Simulations of large density gradients present a number of challenges for direct Monte Carlo methods, since they lead to too few particles in dilute regions and prohibitively many in the dense regions. Here, we propose a particle control methodology that gives the user more control of the number of particles per cell by introducing a variable weight for each particle. The proposed scheme is based on the stochastic weighted particle method, requires only small modifications to DSMC, and exactly conserves mass, momentum, and energy. In validation tests of systems with density ratios of order 102-104, we observe 101-102 times less variance in the dilute region compared to a DSMC solution with the same number of system particles, while introducing a moderate additional computational cost.

DSMC↗
DOE OSTI2024

A Kaczmarz-inspired approach to accelerate the optimization of neural network wavefunctions

Neural network wavefunctions optimized using the variational Monte Carlo method have been shown to produce highly accurate results for the electronic structure of atoms and small molecules, but the high cost of optimizing such wavefunctions prevents their application to larger systems. We propose the Subsampled Projected-Increment Natural Gradient Descent (SPRING) optimizer to reduce this bottleneck. SPRING combines ideas from the recently introduced minimum-step stochastic reconfiguration optimizer (MinSR) and the classical randomized Kaczmarz method for solving linear least-squares problems. We demonstrate that SPRING outperforms both MinSR and the popular Kronecker-Factored Approximate Curvature method (KFAC) across a number of small atoms and molecules, given that the learning rates of all methods are optimally tuned. For example, on the oxygen atom, SPRING attains chemical accuracy after forty thousand training iterations, whereas both MinSR and KFAC fail to do so even after one hundred thousand iterations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Mortality correlates with tree functional traits across a wood density gradient in the Central Amazon

Introduction: Understanding the mechanisms of tree mortality in tropical ecosystems remains challenging, in part due to the high diversity of tree species and the inherently stochastic nature of mortality. Plant functional traits offer a mechanistic link between plant physiology and performance, yet their ability to predict growth and mortality remains poorly understood. Given recent increases in tree mortality rates in the Amazon forest following extreme drought and wind events, we tested if lower wood density and acquisitive plant functional traits were associated with increased growth and mortality for common co-occurring trees in the Central Amazon. Methods: Seventeen trees of different species with similar sizes but a range in wood density (WD) and wood traits were felled, then assessed for 27 different individual functional parameters, including whole tree architecture, stem xylem anatomical and hydraulic traits and leaf traits. Traits of the individual trees were related to stand-level growth and mortality rates collected periodically over 30 years from nearby permanent inventory plots. Results: Higher wood density was associated with smaller leaf size, lower foliar base cations, lower stem water content and sapwood fraction, in agreement with the fast-slow plant economics spectrum. Lower wood density was associated with more acquisitive characteristics with greater hydraulic capacity and foliar nutrient concentrations, correlating with greater growth and mortality rates. Discussion: Our results show that lower wood density is part of a coordinated suite of traits linked to high resource acquisition, fast growth, and increased mortality risk, providing a functional framework for predicting species performance and forest vulnerability under future climate stress.

demographics↗
DOE OSTI2024

Improved filters for angular filter refractometry

Angular filter refractometry is an optical diagnostic that measures the absolute contours of a line-integrated density gradient by placing a filter with alternating opaque and transparent zones in the focal plane of a probe beam, which produce corresponding alternating light and dark regions in the image plane. Identifying transitions between these regions with specific zones on the angular filter (AF) allows the line-integrated density to be determined, but the sign of the density gradient at each transition is degenerate and must be broken using other information about the object plasma. Additional features from diffraction in the filter plane often complicate data analysis. Here, in this paper, we present an improved AF design that uses a stochastic pixel pattern with a sinusoidal radial profile to minimize unwanted diffraction effects in the image caused by the sharp edges of the filter bands. We also present a technique in which a pair of AFs with different patterns on two branches of the same probe beam can be used to break the density gradient degeneracy. Both techniques are demonstrated using a synthetic diagnostic and data collected on the OMEGA EP (extended performance) laser.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

L-H transition trigger physics in ITER-similar plasmas with applied n = 3 magnetic perturbations

The L–H transition power threshold PLH is observed to increase with applied n = 3 resonant magnetic perturbations (RMP) in ITER-similar-shape plasmas with balanced neutral beam torque injection in DIII-D. The increase is most pronounced with added electron–cyclotron heating: PLH increases with decreasing edge plasma collisionality as PLH/PLH-08 ~ (ν*)−0.5, where PLH-08 is the 2008 ITPA multi-machine power threshold scaling. This result raises concerns for H-mode access at low edge collisionality in ITER, where RMP may have to be applied before the L–H transition to safely suppress the first edge-localized mode. Non-axisymmetric modifications with RMP include a simultaneous reduction of the radial electric field (Er) well depth and E × B shear. This can be attributed to increasing edge toroidal co-current rotation, and is consistent with substantially increased local long-wavelength turbulence (measured via beam emission spectroscopy). At high RMP perturbation strength the edge electric field Er reverses sign locally (becomes positive), with changes in dominant turbulence modes. Edge magnetic stochasticity provides an attractive explanation of the observed modifications, and the observed changes in toroidal rotation and Er are consistent with a simple fluid model describing radial electron current flow along stochastic fieldlines. The observed collisionality dependence of the L-mode edge electric field with applied RMP is also qualitatively consistent with this model. Reflectometry data indicate a significant reduction of the normalized L-mode radial density gradient a/Ln at high RMP field with simultaneous increase in radial particle flux and electron thermal flux from power balance analysis. We conjecture that the increase of PLH with RMP results from the combined effects of reduced E × B flow shear (increasing turbulent transport levels) and toroidal/poloidal flow modulation due to edge stochasticity. Initial experiments indicate that non-resonant n = 3 magnetic perturbations lead only to relatively small changes in Er, E × B shear and fluctuation characteristics, and have less impact on the L–H transition power threshold. This motivates further exploration of the RMP spectrum dependence of PLH for possible mitigation of the observed threshold increase.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Structure–Function Relationships in Sequence-Controlled Copolymers for Rare Earth Element Chelation

The ability to tune material function through primary sequence is a defining feature of biological macromolecules, allowing precise control over structure and target interactions in complex aqueous environments. However, translating sequence–structure–function relationships to synthetic macromolecules is challenging due to their dispersity in sequence, conformation, and composition. Here, we report systematic studies of amphiphilic polymer chelators designed to probe how composition and patterning influence binding affinity and selectivity for rare earth elements (REEs), a series of technologically relevant metals with challenging separation profiles. A library of copolymers varying hydrophobic monomer composition and patterning was synthesized via reversible addition–fragmentation chain transfer (RAFT) polymerization, spanning statistical, gradient, and block architectures. REE binding was quantified using a high-throughput colorimetric assay, and reconstruction of polymer ensembles using kinetic stochastic simulations enabled quantitative comparisons of sequence heterogeneity, linking local monomer colocalization to emergent REE binding. Further, we investigated the role of different hydrophobic comonomers in tuning metal coordination, with binding trends linked to structural features that influence binding site desolvation. Complementary dynamic light scattering (DLS) and small-angle X-ray scattering (SAXS) measurements showed that both polymer and monomer architecture modulate metal-induced conformational changes, and that multichain assembly behavior emerges beyond critical hydrophobic thresholds. Sequence control also altered REE selectivity, with nonmonotonic differences observed across compositionally identical polymers with different sequence architectures. Together, these findings establish design principles that connect polymer sequence and structure to binding performance, guiding the design of macromolecular chelators with enhanced affinity and selectivity for applications in separations, sensing, and catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Summary of Methodology for Mitigating Risks Associated with Licensing and Qualifying AM Nuclear Materials

The US Department of Energy’s Advanced Materials and Manufacturing Technologies (AMMT) program focuses on accelerating the development, qualification, demonstration, and deployment of advanced materials and manufacturing technologies to enable reliable and economical nuclear energy. Laser powder bed fusion (LPBF) is one of the most popular additive manufacturing (AM) processes for fabricating components with intrinsically complex geometries. LPBF was extensively explored for nuclear applications under the previous Transformational Challenge Reactor program. Additionally, Oak Ridge National Laboratory developed and licensed the Peregrine software and larger digital platform that couples machine learning and in situ data collection during AM to detect anomalies and any evolved defects. The digital platform will be critical to (1) the qualification of AM components for nuclear applications that link location-specific data to macroscopic properties and (2) predict final component performance. Current in situ process monitoring tools are valuable for observing the formation of stochastic flaws, but additional data are needed to predict the resulting microstructures and associated material performance. Rapid cooling rates and large thermal gradients have caused large heterogeneities in the microstructure, which cause anisotropy in mechanical performance. The AMMT program is evaluating the best approaches for addressing these heterogeneities and their effect on component performance using a combination of multiscale modeling, enhanced in situ process monitoring, and high throughput experimental testing. This report summarizes strategies for mitigating the risks associated with qualifying AM components, including developing new sensing capabilities for in situ process monitoring and characterizing melt pool solidification and residual stresses to inform multiscale modeling efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Bottom-Up Simulation, Reconstruction, and Quantification of Macromolecule Sequences from Experimental Polymerizations

Motivated by the canonical sequence–structure–function paradigm, tools to characterize chemical patterning in natural biomacromolecules, from proteins to nucleic acids, have grown exponentially in recent years. However, analogous strategies for synthetic macromolecules remain in nascent stages, complicated by sequence polydispersity and analytical limitations. To address this, we have developed a comprehensive and open-source Python package, PRISM (polymer rate insights and sequence modeling), an end-to-end workflow that provides a path from experimental kinetics measurements to quantitative and qualitative metrics for describing chemical patterning in stochastic polymers. First, a numerical integration strategy was constructed to simulate and fit experimental data from reversible addition–fragmentation chain transfer (RAFT) polymerization kinetics, enabling the facile estimation of relevant reactivity ratios. These ratios were then used in a mechanism-specific stochastic kinetic simulation strategy to simulate sequence ensembles corresponding to model systems spanning experimental copolymers, classes of statistical polymers (e.g., alternating, block, and gradient), and multiblock copolymers. Lastly, inspired by sequence homology metrics from bioinformatics, we introduce visualization strategies and quantitative metrics to facilitate comparisons of different sequence ensembles. As the sequence–structure–function paradigm becomes increasingly central in de novo design of synthetic macromolecules, this toolkit provides a first step toward accurate and representative sequence description and featurization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Neuromorphic heat transport effects in a molecular junction

Understanding energy transport at the nanoscale is an open and fundamental challenge in the molecular sciences with direct implications for the design of new electronics, computing devices, and materials. While nanoscale energy transport under steady-state conditions has been studied extensively, there is much less known about energy transport under time-dependent driving forces, particularly in the far-from-equilibrium regime. In this work, we use nonequilibrium molecular dynamics simulations and stochastic thermodynamics to investigate energy transport in a well-studied nanoscale system—a molecular junction—subjected to a time-periodic temperature gradient. The primary observation is that molecular junctions can exhibit heat transport hysteresis, a phenomenon in which the heat flux through a system depends not only on the instantaneous value of a time-dependent temperature bias but also on the temporal history of that bias. The presented findings illustrate that molecular junctions can exhibit the specific memory effect—heat transport hysteresis—that is essential for the design of thermal neuromorphic computers. This work elucidates a potential pathway toward the realization of such devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗