Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Modeling Streamflow and Sediment Transport Under Current and Future Climates at the West Valley Site - 20231

Performance Assessment models often require inputs representing specific hydrologic processes such as streamflow and sediment flux. This paper details the development of a process-level hydrologic model and its use in a Probabilistic Performance Assessment (PPA) system-level model for the West Valley Site in western New York. For this PPA model, a watershed model was developed using SWAT (Soil and Water Assessment Tool) and used to evaluate water and sediment fluxes in nearby streams draining the Site. A particular challenge of probabilistic modeling over long periods of time is scaling parameters appropriately so that outcomes are not grossly over- or underestimated. This challenge is especially important when the spatial and temporal scales of process and system level models differ. In this instance, the SWAT watershed model and GoldSim PPA model have similar spatial scales of stream reaches and sub-catchments within a single watershed (approximately hundreds to tens of thousands of square meters, but the temporal scales differ considerably. The SWAT model calculates streamflow and sediment transport rates at the daily scale, while the PPA model requires long-term average values that are applied over hundreds to thousands of year-long periods. As such, distributions of daily climatic parameters such as average precipitation rate, temperature, wind speed, and relative humidity were developed to force a transient SWAT model that captures the dynamic behavior of the watershed in response to daily changes in the weather. Output from the model, which includes stream flow (m{sup 3}/y) and sediment transport rate (Mg/y) is then averaged over a 100-year period as an approximation for the long-term average values which can be applied in GoldSim. A single SWAT model was run 5000 times with varying climatic inputs and deterministic soil, land use, and elevation data, and the range of outputs were compiled into a distribution which can be implemented stochastically into the PPA Model. Additionally, this paper includes a high-level discussion of how changes in future climate affect weather input distributions, and a summary of how those changes in weather affect the outcomes from the SWAT model and the inputs into the PPA model. In this analysis, future climate distributions were developed based on climate research documenting the expected changes to precipitation and temperature in western New York. The 5,000 SWAT simulations were then repeated with these future climate distributions, and the resulting output was implemented into the PPA Model as hydrologic conditions under a future climate. In the current version of the PPA Model, hydrologic parameters change linearly from the 'current climate' conditions to the 'future climate' conditions over a period of 100 years, after which they remain constant. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Learning the temporal evolution of multivariate densities via normalizing flows

In this work, we propose a method to learn multivariate probability distributions using sample path data from stochastic differential equations. Specifically, we consider temporally evolving probability distributions (e.g., those produced by integrating local or nonlocal Fokker–Planck equations). Here, we analyze this evolution through machine learning assisted construction of a time-dependent mapping that takes a reference distribution (say, a Gaussian) to each and every instance of our evolving distribution. If the reference distribution is the initial condition of a Fokker–Planck equation, what we learn is the time-T map of the corresponding solution. Specifically, the learned map is a multivariate normalizing flow that deforms the support of the reference density to the support of each and every density snapshot in time. We demonstrate that this approach can approximate probability density function evolutions in time from observed sampled data for systems driven by both Brownian and Lévy noise. We present examples with two- and three-dimensional, uni- and multimodal distributions to validate the method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Photoinduced correlations in stochastic dynamics of a solid-state ionic conductor

Photoexcitation by ultrashort laser pulses plays a crucial role in controlling reaction pathways, creating nonequilibrium material properties, and probing complex molecular dynamics. The photoresponse following a laser pulse is generally nonidentical between exposures due to spatiotemporal fluctuations or the stochastic nature of dynamical pathways. However, most ultrafast pump-probe experiments struggle to distinguish intrinsic sample fluctuations from extrinsic apparatus noise, often missing deviations from the averaged response. Leveraging the stability and high photon flux of time-resolved X-ray micro-diffraction at a synchrotron, we characterized stochastic photoinduced dynamics in a solid-state ionic conductor. By analyzing temporal evolutions of the lattice parameter of a single grain, we found that shot-to-shot fluctuations are not independent. Instead, correlations exist between nonequilibrium lattice trajectories following adjacent shots, with a characteristic correlation length of approximately 1500 shots, corresponding to an energy barrier of 0.4 ± 0.1 eV, close to the activation energy of lithium-ion diffusion.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A General Framework for Bounding Approximate Dynamic Programming Schemes

For years, there has been interest in approximation methods for solving dynamic programming problems, because of the inherent complexity in computing optimal solutions characterized by Bellman’s principle of optimality. A wide range of approximate dynamic programming (ADP) methods now exists. It is of great interest to guarantee that the performance of an ADP scheme be at least some known fraction, say ß , of optimal. This letter introduces a general approach to bounding the performance of ADP methods, in this sense, in the stochastic setting. The approach is based on new results for bounding greedy solutions in string optimization problems, where one has to choose a string (ordered set) of actions to maximize an objective function. This bounding technique is inspired by submodularity theory, but submodularity is not required for establishing bounds. Instead, the bounding is based on quantifying certain notions of curvature of string functions; the smaller the curvatures the better the bound. The key insight is that any ADP scheme is a greedy scheme for some surrogate string objective function that coincides in its optimal solution and value with those of the original optimal control problem. The ADP scheme then yields to the bounding technique mentioned above, and the curvatures of the surrogate objective determine the value ß of the bound. The surrogate objective and its curvatures depend on the specific ADP.

discrete event systems↗
DOE OSTI2023

Social network structure and the spread of complex contagions from a population genetics perspective

Ideas, behaviors, and opinions spread through social networks. If the probability of spreading to a new individual is a non-linear function of the fraction of the individuals’ affected neighbors, such a spreading process becomes a “complex contagion”. This non-linearity does not typically appear with physically spreading infections, but instead can emerge when the concept that is spreading is subject to game theoretical considerations (e.g. for choices of strategy or behavior) or psychological effects such as social reinforcement and other forms of peer influence (e.g. for ideas, preferences, or opinions). Here we study how the stochastic dynamics of such complex contagions are affected by the underlying network structure. Motivated by simulations of complex contagions on real social networks, we present a framework for analyzing the statistics of contagions with arbitrary non-linear adoption probabilities based on the mathematical tools of population genetics. The central idea is to use an effective lower-dimensional diffusion process to approximate the statistics of the contagion. This leads to a tradeoff between the effects of ”selection” (microscopic tendencies for an idea to spread or die out), random drift, and network structure. Our framework illustrates intuitively several key properties of complex contagions: stronger community structure and network sparsity can significantly enhance the spread, while broad degree distributions dampen the effect of selection compared to random drift. Finally, we show that some structural features can exhibit critical values that demarcate regimes where global contagions become possible for networks of arbitrary size. Our results draw parallels between the competition of genes in a population and memes in a world of minds and ideas. Our tools provide insight into the spread of information, behaviors, and ideas via social influence, and highlight the role of macroscopic network structure in determining their fate.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Sequential Learning of Active Subspaces

This study shows that in recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target function. In the event of noisy, expensive, or stochastic simulators, evaluating gradients via finite differencing may be infeasible. In such cases, often a surrogate model is employed, on which finite differencing is performed. When the surrogate model is a Gaussian process (GP), we show that the ASM estimator is available in closed form, rendering the finite-difference approximation unnecessary. We use our closed-form solution to develop acquisition functions focused on sequential learning tailored to sensitivity analysis on top of ASMs. We also show that the traditional ASM estimator may be viewed as a method of moments estimator for a certain class of GPs. We demonstrate how uncertainty on GP hyperparameters may be propagated to uncertainty on the sensitivity analysis, allowing model-based confidence intervals on the active subspace. Our methodological developments are illustrated on several examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

EELS Studies of Cerium Electrolyte Reveal Substantial Solute Concentration Effects in Graphene Liquid Cells

Graphene liquid cell transmission electron microscopy is a powerful technique to visualize nanoscale dynamics and transformations at atomic resolution. However, the solution in liquid cells is known to be affected by radiolysis, and the stochastic formation of graphene liquid cells raises questions about the solution chemistry in individual pockets. In this study, electron energy loss spectroscopy (EELS) was used to evaluate a model encapsulated solution, aqueous CeCl 3 . First, the ratio between the O K-edge and Ce M-edge was used to approximate the concentration of cerium salt in the graphene liquid cell. It was determined that the ratio between oxygen and cerium was orders of magnitude lower than what is expected for a dilute solution, indicating that the encapsulated solution is highly concentrated. To probe how this affects the chemistry within graphene liquid cells, the oxidation of Ce 3+ was measured using time-resolved parallel EELS. Here, it was determined that Ce 3+ oxidizes faster under high electron fluxes, but reaches the same steady-state Ce 4+ concentration regardless of flux. The time-resolved concentration profiles enabled direct comparison to radiolysis models, which indicate rate constants and g-values of certain molecular species are substantially different in the highly concentrated environment. Finally, electron flux-dependent gold nanocrystal etching trajectories showed that gold nanocrystals etch faster at higher electron fluxes, correlating well with the Ce 3+ oxidation kinetics. Understanding the effects of the highly concentrated solution in graphene liquid cells will provide new insight on previous studies and may open up opportunities to systematically study systems in highly concentrated solutions at high resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Data-driven predictive probability density function control of fiber length stochastic distribution shaping in refining process

Pulp is the most important raw material in paper in paper industries, whose Fiber Length Stochastic Distribution (FLSD) shaping directly determines the energy consumption and paper quality of the subsequent papermaking processes. However, the mean and variance are insufficient to describe the output FLSD shaping, which display non-Gaussian distribution properties. Therefore, the traditional control, method based on the mean and variance of fiber length is difficult to control the FLSD shaping effectively. In this paper, a novel data-driven predictive probability density function (PDF) control method is proposed for output FLSD shaping in refining process. Primarily, in order to improve the approximation accuracy of the PDF employing RBF neural network, the parameters (center value and width) of each RBF basis functions are tuned via utilizing iterative learning control (ILC) law, and the corresponding estimations of weights law can be obtained. Secondly, considering that the conventional linear model of weights vector has drawbacks of low accuracy and weak generalization ability, random vector functional link networks (RVFLNs) based data driven nonlinear modelling method is employed to characterize the prediction model between the input variables and weights vector. Finally, in order to reduce the randomness of the output FLSD, a minimum entropy control method under mean constraint is employed to design the predictive PDF controller for the output FLSD shaping with the help of the established nonlinear stochastic distribution model. Both simulations and experiments are given to illustrate the effectiveness and practicability of the proposed method.

Probability debsity function, Fiber length distrib↗
DOE OSTI2021

Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗
DOE OSTI2024

Characterizing and improving the performance of molten-salt-steam heat exchangers in concentrating solar power plants

Shell-and-tube heat exchangers (HXs) for steam generation from molten salts in concentrating solar power (CSP) plants experience thermal fatigue due to significant temperature gradients and inherent transient operation. Molten salt-steam HX design lifespans exceed actual lifespans, and, as a consequence, designers overpredict plant profitability and operators neglect appropriate prescriptions to optimize these lifetimes. Here, this study refines HX lifespan estimates with data benchmarked against thermal-fluid mechanical modeling of stress and accumulated fatigue. Reduced-order thermal models of the molten salt-steam, shell-and-tube evaporator and superheater predict transient temperature profiles along the two HXs salt-steam flow paths. The modeled evaporator and superheater temperature profiles enable assessment of cyclic stresses within the HX tubesheets, where molten-salt HX failures are most common. Evaporator and superheater performance data from a current 110 MW elec commercial CSP plant provide a basis for validating the reduced-order HX models. HX life predictions derived from stochastic failure distributions serve as inputs for simulating and optimizing existing plant operations. The impact of the updated lifespans on overall plant revenue depends on operating scenarios. This study suggests that typical ramping rates for a CSP plant with a high-temperature Rankine cycle result in an evaporator and superheater life of approximately 10 and 25 years, respectively, compared to the design target of 30 years. Reduced HX lifespans decrease operational plant revenue on average by 4.6-5.1%. Furthermore, there may be as many as four HX replacements over the 30-year lifetime of the plant; and, purchase agreement loss due to failure to meet contractual production requirements can have ramifications that include the risk of bankruptcy.

14 SOLAR ENERGY↗
DOE OSTI2022

Realistic simulations of spin squeezing and cooperative coupling effects in large ensembles of interacting two-level systems

We describe an efficient numerical method for simulating the dynamics of interacting spin ensembles in the presence of dephasing and decay. The method builds on the discrete truncated Wigner approximation for isolated systems, which combines the mean-field dynamics of a spin ensemble with a Monte Carlo sampling of discrete initial spin values to account for quantum correlations. Here we show how this approach can be generalized for dissipative spin systems by replacing the deterministic mean-field evolution by a stochastic process, which describes the decay of coherences and populations while preserving the length of each spin. We demonstrate the application of this technique for simulating nonclassical spin-squeezing effects or the dynamics and steady states of cavity QED models with 10 5 interacting two-level systems. This opens up the possibility to perform accurate real-scale simulations of a diverse range of experiments in quantum optics or with solid-state spin ensembles under realistic laboratory conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Stochastic scheduling of generating units with weekly energy storage: A hybrid decomposition approach

We propose a solution method for the large-scale stochastic unit commitment (SUC) problem with weekly-dispatched energy storage and significant weather-dependent stochastic generating capacity. Weekly storage facilities that mostly charge during weekends and discharge during weekdays require a weekly scheduling of generating units, which result in a large-scale optimization problem. This SUC problem is formulated as a two-stage stochastic model and we use the conditional value-at-risk as a risk measure. Using a Benders framework, the proposed solution method decomposes the problem into a mixed-integer linear master problem and linear and continuous subproblems. The master problem corresponds to the first-stage decisions throughout the week and includes all the commitment (binary) variables and their corresponding constraints. The subproblems correspond to the actual dispatch of the generating units on a weekly basis. Based on the success of column-and-constraint generation algorithms to solve robust optimization problems, we improve the low communication between the master problem and the subproblems in the standard Benders decomposition by adding primal variables and constraints from the subproblems to the master problem, which provides a better approximation of the recourse function. Furthermore, our computational experiments demonstrate the effectiveness of the proposed decomposition method using an instance of the South Carolina synthetic system with 90 generating units under 40 scenarios.

25 ENERGY STORAGE↗
DOE OSTI2023

Binary operations on neuromorphic hardware with application to linear algebraic operations and stochastic equations

Abstract Non-von Neumann computational hardware, based on neuron-inspired, non-linear elements connected via linear, weighted synapses—so-called neuromorphic systems—is a viable computational substrate. Since neuromorphic systems have been shown to use less power than CPUs for many applications, they are of potential use in autonomous systems such as robots, drones, and satellites, for which power resources are at a premium. The power used by neuromorphic systems is approximately proportional to the number of spiking events produced by neurons on-chip. However, typical information encoding on these chips is in the form of firing rates that unarily encode information. That is, the number of spikes generated by a neuron is meant to be proportional to an encoded value used in a computation or algorithm. Unary encoding is less efficient (produces more spikes) than binary encoding. For this reason, here we present neuromorphic computational mechanisms for implementing binary two’s complement operations. We use the mechanisms to construct a neuromorphic, binary matrix multiplication algorithm that may be used as a primitive for linear differential equation integration, deep networks, and other standard calculations. We also construct a random walk circuit and apply it in Brownian motion simulations. We study how both algorithms scale in circuit size and iteration time.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fundamentals of Au(111) Surface Dynamics: Coarsening of Two-Dimensional Au Islands

Au(111) surfaces play a central role in many applications, yet studies of fundamental aspects of their dynamics are limited. Thus, using scanning tunneling microscopy (STM) at 300 K, we analyze the coarsening of first-layer 2D Au islands directly on the Au(111) substrate and also of second-layer 2D Au islands. Specifically, we monitor the decay of Au first-layer islands with areas of about 100–500 nm 2 in the vicinity of larger islands or extended step edges over a period of approximately 40 h, the relevant time scale for this process. Experimentally observed behavior is captured by analytical theory for terrace-diffusion-limited decay incorporating DFT results for the Au terrace diffusion barrier and the adatom formation energy.Lastly, experimental observations of second-layer island decay are also compared with appropriate analytical theory and stochastic simulations, thereby determining the effective Ehrlich–Schwoebel barrier for Au on Au(111).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Reproducibility of fixed-node diffusion Monte Carlo across diverse community codes: The case of water–methane dimer

Fixed-node diffusion quantum Monte Carlo (FN-DMC) is a widely trusted many-body method for solving the Schrödinger equation, known for its reliable predictions of material and molecular properties. Furthermore, its excellent scalability with system complexity and near-perfect utilization of computational power make FN-DMC ideally positioned to leverage new advances in computing to address increasingly complex scientific problems. Even though the method is widely used as a computational gold standard, reproducibility across the numerous FN-DMC code implementations has yet to be demonstrated. This difficulty stems from the diverse array of DMC algorithms and trial wave functions, compounded by the method’s inherent stochastic nature. Here, this study represents a community-wide effort to assess the reproducibility of the method, affirming that yes, FN-DMC is reproducible (when handled with care). Using the water–methane dimer as the canonical test case, we compare results from eleven different FN-DMC codes and show that the approximations to treat the non-locality of pseudopotentials are the primary source of the discrepancies between them. In particular, we demonstrate that, for the same choice of determinantal component in the trial wave function, reliable and reproducible predictions can be achieved by employing the T-move, the determinant locality approximation, or the determinant T-move schemes, while the older locality approximation leads to considerable variability in results. These findings demonstrate that, with appropriate choices of algorithmic details, fixed-node DMC is reproducible across diverse community codes—highlighting the maturity and robustness of the method as a tool for open and reliable computational science.

Della Pia, Flaviano [Univ. of Cambridge (United Ki↗
DOE OSTI2026

Structural Aspects of Neutron Survival Probabilities

The neutron survival probability (and related quantities including probabilities of extinction and initiation) is a central element of the broader stochastic theory of neutron populations and finds application in fields including reactor start-up, analysis of reactor power bursts and criticality accidents, and safeguards. In a full neutron transport formulation, the equation governing the single-neutron survival probability is a backward or adjoint-like integro-partial differential equation with the added complexity of being highly nonlinear. Analogous formulations of this equation exist in the context of many approximate theories of neutron transport, with the point kinetics formulation having received significant theoretical attention since the 1940s. This work continues this tradition by providing a novel analysis of the single-neutron survival probability equation using the tools of boundary layer theory. The analysis reveals that the “fully dynamic” solution of the single-neutron survival probability equation—and some key probability distributions derived from it—may be cast as a singular perturbation around the underlying quasi-static single-neutron probability of initiation. In this perturbation solution, the expansion parameter is the ratio of the neutron generation time to a macroscopic time scale characterizing the overall system evolution; this interpretation illuminates some of the fundamental structural aspects of neutron survival phenomena.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

In situ Visible Light and Thermal Imaging Data from a Laser Powder Bed Fusion Additive Manufacturing Process Co-Registered to X-ray Computed Tomography and Fatigue Data

This dataset is comprised of in situ sensing data collected during a laser-based powder bed fusion additive manufacturing process, as well as rasterized scan path information, post-build X-ray computed tomography (XCT), and fatigue test results. A total of 64 cylinders, approximately 15 mm in diameter and 102 mm tall, were printed out of stainless steel 316H on a Colibrium Additive Concept Laser M2 Series 5 machine. Parameters known to produce dense material were used to construct 56 of these cylinders, while the remaining 8 cylinders were printed with relatively high energy density parameters prone to producing keyhole pores. In addition, two spatter generation blocks were constructed upstream of the 64 cylinders such that ejecta produced during the melting of the spatter generators were stochastically seeded onto the 64 cylinders. Based on previous experiments, these spatter particles were theorized to produce stochastic lack-of-fusion pores. During the construction of the build, high-resolution images of reflected light in the visible spectrum were captured both before and after recoating for each print layer. Additionally, temporally integrated thermal imaging in the near infrared spectrum produced integrated sum and max images on a layerwise basis. The multimodal in situ data has been co-registered to the build plate coordinate system, allowing for identification of process anomalies (e.g., spatter particles) apparent in the two sensors. Following construction of the build, the cylinders were subjected to XCT to identify internal flaws, and the resulting data have also been registered to the build plate coordinate system. Finally, 60 of the 64 cylinders were machined into fatigue coupons conforming to ASTM E466 and subsequently subjected to either high- or -low-cycle fatigue testing. The results of the fatigue tests have also been included in the dataset, and the XCT data corresponded to the approximate location of the gauge sections of the machine fatigue specimen geometry.

42 ENGINEERING↗