Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Production of neutron-rich heavy nuclei in deep-inelastic 208 Pb + 208 Pb collisions within the stochastic mean-field theory

In deep-inelastic collisions of heavy nuclei, reaction products with a wide range of mass and charge are produced. Such collisions been considered as a possible way to produce superheavy nuclei, as an alternative to fusion reactions. To provide reliable theoretical predictions, it is desired to develop microscopic approaches that correctly and accurately describe nucleon transfer processes in dissipative collisions of heavy nuclei. The purpose of the present work is (1) to investigate the mechanism of nucleon transfers in dissipative collisions of two heavy nuclei, and (2) to explore possible pathways to produce neutron-rich heavy nuclei, through detailed theoretical analyses of fluctuations and correlations in nucleon transfers in 208 Pb + 208 Pb reactions. Three-dimensional time-dependent Hartree-Fock (TDHF) calculations are performed for the collisions of 208 Pb + 208 Pb at 𝐸 c.m. = 832, 936, and 1040 MeV, using the Skyrme SLy4d energy density functional. To calculate fluctuations and correlations in nucleon transfers, we employ the stochastic mean-field (SMF) theory, and the results are compared with another theoretical framework currently available, the time-dependent random phase approximation (TDRPA). Primary and secondary production cross sections are calculated with the SMF theory combined with a statistical model, GEMINI ++ . Using information of nucleon flow across a neck of colliding nuclei in TDHF calculations, we solve quantal diffusion equations for fluctuations and correlations in nucleon transfers based on the SMF theory. From the SMF calculations, we obtain the time evolution of diffusion coefficients as well as fluctuations and correlations in nucleon transfers for a range of initial orbital angular momenta. We compare the results of the SMF calculations with those of TDRPA, showing that TDRPA tends to predict substantially larger fluctuations and correlations in strongly damped collisions of heavy nuclei, which exhibit complex initial angular momentum dependence, while the SMF results provide almost constant (stable) values. Using the obtained fluctuations and correlations, we calculate primary and secondary production cross sections for the 208 Pb + 208 Pb collisions. From the results, we find that both lighter and heavier reaction products as compared to 208 Pb are produced for a wide region in the 𝑁−𝑍 plane as primary products, thanks to the quantal diffusion mechanism in the dissipative collisions. However, we show that cross sections for production of heavy nuclei with 𝑍 ≳ 90 or 𝑁 ≳ 135 are washed out due to secondary particle evaporation and/or fission processes. On the other hand, we find that there remain sizable cross sections for production of neutron-rich nuclei along 𝑁 = 126 with 𝑍< 82, even after secondary disintegration processes. We demonstrate that the secondary production cross sections depend weakly on incident energies, but lower (higher) energy is slightly preferred for production of nuclei with smaller (larger) atomic numbers as compared to 𝑍 = 82. Here, based on the microscopic SMF calculations, it has been shown that deep-inelastic collisions of heavy nuclei, such as 208 Pb + 208 Pb examined in this study, can be a promising means to produce neutron-rich heavy nuclei along 𝑁=126. Discrepancies between the SMF and TDRPA approaches are left unsolved for future investigations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stochastic tensor contraction for quantum chemistry

Many computational methods in ab initio quantum chemistry are formulated in terms of high-order tensor contractions, whose cost determines the size of system that can be studied. We introduce stochastic tensor contraction to perform such operations with greatly reduced cost, and present its application to the gold-standard quantum chemistry method, coupled cluster theory with up to perturbative triples. For total energy errors more stringent than chemical accuracy, we reduce the computational scaling to that of mean-field theory, while starting to approach the mean-field absolute cost, thereby challenging the existing cost-to-accuracy landscape. Benchmarks against state-of-the-art local correlation approximations further show that we achieve an order-of-magnitude improvement in both total computation time and error, with significantly reduced sensitivity to system dimensionality and electron delocalization. We conclude that stochastic tensor contraction is a powerful computational primitive to accelerate a wide range of quantum chemistry.

Chemical Physics (physics.chem-ph)↗

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗

The dust in the hydrogen-poor ejecta of Abell 30

We present new optical and near-infrared images of the hydrogen-poor planetary nebula Abell 30 and produce detailed models that account for the major observed morphological and IR properties. By imaging the nebula in the K band, we confirm the presence of hot dust in an expanding equatorial ring of H-poor gas. No emission was detected from the H-poor polar knots, suggesting a dust deficiency htere relative to the equatorial ring. The near-IR emission is attributed to small carbonaceous dust grains which are stochastically heated by stellar ultraviolet photons. Using an adaptive version of a matrix method devised by Guhathakurta & Draine (1989) to model stochastic heating, we find that the near-IR spectrum observed by Dinerstein & Lester (1984) requires the presence of dust grains down to approximately 0.0007 microns in radius. This minimum grain radius is in excellent agreement with our calculations of the grain destruction by energetic stellar UV photons: we find that carbon clusters with less than approximately 140 atoms (0.0007 microns in radius) are destroyed by stellar UV photons in approximately 1000 yr, the kinematic age of H-poor ejecta. Modeling of the far-IR dust emission implies that the bulk of the dust mass in A30 must reside at distances several times greater than the distance of the equatorial ring from the central star. This spatial dust distribution is attributed to the interaction of the stellar wind with the inhomogeneous H-poor ejecta. Most of the H-poor gas and dust has been apparently carried outward by the stellar wind, leaving behing dense, H-poor knots with prominent wind-blown tails in the equatorial ring and in the polar knots. This picture is supported by the presence of a stellar wind-blown bubble within the H-rich envelope in our optical images.

Borkowski, Kazimierz J.↗

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Toward data assimilation of ship-induced aerosol–cloud interactions

Satellite imagery can detect temporary cloud trails or ship tracks formed from aerosols emitted from large ships traversing our oceans, a phenomenon that global climate models cannot directly reproduce. Ship tracks are observable examples of marine cloud brightening, a potential solar climate intervention that shows promise in helping combat climate change. In this paper, we demonstrate a simulation-based approach in learning the behavior of ship tracks based upon a novel stochastic emulation mechanism. Our method uses wind fields to determine the movement of aerosol–cloud tracks and uses a stochastic partial differential equation (SPDE) to model their persistence behavior. This SPDE incorporates both a drift and diffusion term which describes the movement of aerosol particles via wind and their diffusivity through the atmosphere, respectively. We first present our proposed approach with examples using simulated wind fields and ship paths. We then successfully demonstrate our tool by applying the approximate Bayesian computation method-sequential Monte Carlo for data assimilation.

54 ENVIRONMENTAL SCIENCES↗

Quantum Vibronic Effects on the Electronic Properties of Molecular Crystals

We present a study of molecular crystals, focused on the effect of nuclear quantum motion and anharmonicity on their electronic properties. We consider a system composed of relatively rigid molecules, a diamondoid crystal, and one composed of floppier molecules, NAI-DMAC, a thermally activated delayed fluorescence compound. We compute fundamental electronic gaps at the density functional theory (DFT) level of theory, with the Perdew–Burke–Erzenhof (PBE) and strongly constrained and approximately normed (SCAN) functionals, by coupling first-principles molecular dynamics with a nuclear quantum thermostat. We find a sizable zero-point renormalization (ZPR) of the band gaps, which is much larger in the case of diamondoids (0.6 eV) than for NAI-DMAC (0.22 eV). We show that the frozen phonon (FP) approximation, which neglects intermolecular anharmonic effects, leads to a large error (~50%) in the calculation of the band gap ZPR. Instead, when using a stochastic method, we obtain results in good agreement with those of our quantum simulations for the diamondoid crystal. However, the agreement is worse for NAI-DMAC where intramolecular anharmonicities contribute to the ZPR. Our results highlight the importance of accurately including nuclear and anharmonic quantum effects to predict the electronic properties of molecular crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic estimation of conditional eddies in turbulent channel flow

Several long-standing issues regarding linear estimation and coherent structures are addressed, and some questions that were addressed partially, but never with the benefit of full, three-dimensional information are answered. The objectives were to: determine how well linear estimates approximate the field obtained by true conditional averaging, using events such as those in quadrant analysis; determine the extent to which the three-dimensional linearly estimated fields correspond to coherent structures, and the degree and manner in which they differ; evaluate the type and nature of the structural information gained by employing several different types of events; and learn more about the 3-D structure of important coherent motions that occur in wall turbulence. The results indicate that linear stochastic estimation can be used effectively in the study of numerical data bases consisting of three-dimensional vector fields, both velocity and vorticity. Two-point stochastic estimation yields more structural information and more detail than single-point estimation. The structures observed occurred repeatedly within the flow, but much can not be said about their dominance or the probability of their occurrence without further systematic studies of their frequency.

Adrian, R. J.↗

GFINNs: GENERIC formalism informed neural networks for deterministic and stochastic dynamical systems

Here we propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism. GFINNs comprise two modules, each of which contains two components. We model each component using a neural network whose architecture is designed to satisfy the required conditions. The component-wise architecture design provides flexible ways of leveraging available physics information into neural networks. We prove theoretically that GFINNs are sufficiently expressive to learn the underlying equations, hence establishing the universal approximation theorem. We demonstrate the performance of GFINNs in three simulation problems: gas containers exchanging heat and volume, thermoelastic double pendulum and the Langevin dynamics. In all the examples, GFINNs outperform existing methods, hence demonstrating good accuracy in predictions for both deterministic and stochastic systems.

97 MATHEMATICS AND COMPUTING↗

Finite Element Aircraft Simulation of Turbulence

A turbulence model has been developed for realtime aircraft simulation that accommodates stochastic turbulence and distributed discrete gusts as a function of the terrain. This model is applicable to conventional aircraft, V/STOL aircraft, and disc rotor model helicopter simulations. Vehicle angular activity in response to turbulence is computed from geometrical and temporal relationships rather than by using the conventional continuum approximations that assume uniform gust immersion and low frequency responses. By using techniques similar to those recently developed for blade-element rotor models, the angular-rate filters of conventional turbulence models are not required. The model produces rotational rates as well as air mass translational velocities in response to both stochastic and deterministic disturbances, where the discrete gusts and turbulence magnitudes may be correlated with significant terrain features or ship models. Assuming isotropy, a two-dimensional vertical turbulence field is created. A novel Gaussian interpolation technique is used to distribute vertical turbulence on the wing span or lateral rotor disc, and this distribution is used to compute roll responses. Air mass velocities are applied at significant centers of pressure in the computation of the aircraft's pitch and roll responses.

McFarland, R. E.↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

An empirical polytrope law for solar wind thermal electrons between 0.45 and 4.76 AU: Voyager 2 and Mariner 10

Empirical evidence is presented that solar wind thermal electrons obey a polytrope law with polytrope index gamma = 1.175 plus or minus 0.03. The Voyager 2 and Mariner 10 data used as evidence are compared and discussed. The theoretical predictions that solar wind thermal electrons in the asymptotic solar wind should obey a polytrope law with polytrope index gamma = 1.16 plus or minus. The widespread impressions in the literature that solar wind electrons behave more like an isothermal than adiabatic gas, and the arguments that Coulomb collisions are the dominant stochastic process shaping observed electron distribution functions in the solar wind are reexamined, reviewed and evaluated. The assignment of the interplanetary potential as equal to approximately seven times the temperature of the thermal electrons is discussed.

Sittler, E. C., Jr.↗

Oscillator response to nonstationary excitation

Analytical solutions are presented regarding probability density distributions of various response parameters of a lightly damped oscillator. The oscillator is subjected to a broad-band stochastic excitation which possesses a time-variant power spectrum. The analytical solutions are derived by utilizing appropriate Fokker-Planck equations which govern Markovian approximations of the response parameters considered. The reliability of the approximate analytical solution is tested by using pertinent data generated by a digital Monte Carlo study.

Spanos, P.-T. D.↗

A Discrete Probability Function Method for the Equation of Radiative Transfer

A discrete probability function (DPF) method for the equation of radiative transfer is derived. The DPF is defined as the integral of the probability density function (PDF) over a discrete interval. The derivation allows the evaluation of the PDF of intensities leaving desired radiation paths including turbulence-radiation interactions without the use of computer intensive stochastic methods. The DPF method has a distinct advantage over conventional PDF methods since the creation of a partial differential equation from the equation of transfer is avoided. Further, convergence of all moments of intensity is guaranteed at the basic level of simulation unlike the stochastic method where the number of realizations for convergence of higher order moments increases rapidly. The DPF method is described for a representative path with approximately integral-length scale-sized spatial discretization. The results show good agreement with measurements in a propylene/air flame except for the effects of intermittency resulting from highly correlated realizations. The method can be extended to the treatment of spatial correlations as described in the Appendix. However, information regarding spatial correlations in turbulent flames is needed prior to the execution of this extension.

Sivathanu, Y. R.↗

Radiative transfer theory for inhomogeneous media with random extinction and scattering coefficients

The small-angle scattering approximation of the scalar radiative transfer equation (RTE) is examined for the case where the extinction and scattering coefficients have a component that is a deterministic function of position along the propagation path and a component that is a random function of position transverse to the propagation direction. It is found that the resulting stochastic RTE can be reduced to a system of two stochastic integrodifferential equations for the average and fluctuating components of the radiant intensity. Two transfer equations are obtained describing the average radiant intensity and the spatial correlation function of the intensity fluctuations. The average intensity equation is then solved and applied to a simple propagation scenario. An approximate solution is also derived for the equation giving the correlation function. The developed equations can be applied to problems involving short wavelength electromagnetic wave propagation through media possessing the variable characteristics of turbulence and turbidity, such as plasmas, the atmosphere, and the ocean.

Manning, Robert M.↗

Microgrid design and multi-year dispatch optimization under climate-informed load and renewable resource uncertainty

Microgrids are an increasingly popular solution to provide energy resilience in response to increasing grid dependency and the growing impacts of climate change on grid operations. However, existing microgrid models do not currently consider the uncertain and long-term impacts of climate change when determining a set of design and operational decisions to minimize long-term costs or meet a resilience threshold. In this paper, we develop a novel scenario generation method that accounts for the uncertain effects of (i) climate change on variable renewable energy availability, (ii) extreme heat events on site load, and (iii) population and electrification trends on load growth. Additionally, we develop a two-stage stochastic programming extension of an existing microgrid design and dispatch optimization model to obtain uncertainty-informed and climate-resilient energy system decisions that minimizes long-term costs. Use of sample average approximation to validate our two case studies illustrates that the proposed methodology produces high-quality solutions that add resilience to systems with existing backup generation while reducing expected long-term costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A statistical mechanics framework for polymer chain scission, based on the concepts of distorted bond potential and asymptotic matching

To design increasingly tough, resilient, and fatigue-resistant elastomers and hydrogels, the relationship between controllable network parameters at the molecular level (bond type, non-uniform chain length, entanglement density, etc.) to macroscopic quantities that govern damage and failure must be established. Many of the most successful constitutive models for elastomers have been rooted in statistical mechanical treatments of polymer chains. Typically, such constitutive models have used variants of the freely jointed chain model with rigid links. However, since the free energy state of a polymer chain is dominated by enthalpic bond distortion effects as the chain approaches its rupture point, bond extensibility ought to be accounted for if the model is intended to capture chain rupture. To that end, a new bond potential is supplemented to the freely jointed chain model (as derived in the u FJC framework of Buche and Silberstein (2021) and Buche et al. (2022)), which we have extended to yield a tractable, closed-form model of single chain behavior that should be amenable to continuum-level constitutive model development. Inspired by the asymptotically matched u FJC model response in both the low/intermediate chain force and high chain force regimes, a simple, quasi-polynomial bond potential energy function is derived. This bond potential exhibits harmonic behavior near the equilibrium state and anharmonic behavior for large bond stretches tending to a characteristic energy plateau (akin to the Lennard-Jones and Morse bond potentials). Using this bond potential, approximate yet highly-accurate analytical functions for bond stretch and chain force dependent upon chain stretch are established. Then, using this polymer chain model, a stochastic thermal fluctuation-driven chain rupture framework is developed. This framework is based upon a force-modified tilted bond potential that accounts for distortional bond potential energy, allowing for the derivation and subsequent calculation of the dissipated chain scission energy. Here, the cases of rate-dependent and rate-independent scission are accounted for throughout the rupture framework. The impact of Kuhn segment number on chain rupture behavior is also investigated. The model is fit to single chain mechanical response data collected from atomic force microscopy tensile tests for validation and to glean deeper insight into the molecular physics taking place. Due to their analytical nature, this polymer chain model and the associated rupture framework can in the future be implemented in finite element models accounting for fracture and fatigue in polydisperse elastomer networks.

36 MATERIALS SCIENCE↗