Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Optimization of nonlinear turbulence in stellarators

We present new stellarator equilibria that have been optimized for reduced turbulent transport using nonlinear gyrokinetic simulations within the optimization loop. The optimization routine involves coupling the pseudo-spectral GPU-native gyrokinetic code GX with the stellarator equilibrium and optimization code DESC . Since using GX allows for fast nonlinear simulations, we directly optimize for reduced nonlinear heat fluxes. To handle the noisy heat flux traces returned by these simulations, we employ the simultaneous perturbation stochastic approximation (SPSA) method that only uses two objective function evaluations for a simple estimate of the gradient. We show several examples that optimize for both reduced heat fluxes and good quasi-symmetry as a proxy for low neoclassical transport. Finally, we run full transport simulations using the T3D stellarator transport code to evaluate the changes in the macroscopic profiles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Elucidation of Local Ordering and Atomic-Scale Structure in Polymer-Derived SiOC

Silicon oxycarbide (SiOC) is a versatile ceramic material with tunable microstructure and compositions that can be modulated through precursor chemistry and processing conditions. Though there are several noteworthy uses of SiOC across a range of application spaces, the difficulties in elucidating the short- to medium-range order within these materials have limited the maturation of strategies to precisely control SiC x O 4–x compositions for user-tailored applications. In this contribution, we implement a range of synchrotron scattering and spectroscopy methods coupled with stochastic modeling techniques to elucidate changes in local chemistry and structure associated with the pyrolysis of a commercially available SiOC polymer precursor. Stochastic modeling approaches provide valuable insights into decoupling local Si–O and Si–C environments while confirming predominate heterogeneous phases in materials. Using pyrolysis temperatures between 250 to 800 °C results in a heterogeneous material predominately composed of SiOC and amorphous SiO 2 domains. At 1100 °C, redistribution of Si–C pairs in the SiOC network and Si–O from the SiO 2 domains create a more ordered SiOC phase with local cubic SiC-like ordering. In addition, residual carbon leads to a detectable carbon phases at 1100 °C that persist at higher temperatures. These efforts address the difficulties of obtaining atomic-scale insights into the local structure and nanoscale heterogeneities in SiOC, providing pathways toward establishing structure–property relationships for future materials development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Impact of Momentum Perturbation on Convective Boundary Layer Turbulence

Mesoscale-to-microscale coupling is an important tool for conducting turbulence-resolving multiscale simulations of realistic atmospheric flows, which are crucial for applications ranging from wind energy to wildfire spread studies. Different techniques are used to facilitate the development of realistic turbulence in the large-eddy simulation (LES) domain while minimizing computational cost. Here, we explore the impact of a simple and computationally efficient Stochastic Cell Perturbation method using momentum perturbation (SCPM-M) to accelerate turbulence generation in boundary-coupled LES simulations using the Weather Research and Forecasting model. We simulate a convective boundary layer (CBL) to characterize the production and dissipation of turbulent kinetic energy (TKE) and the variation of TKE budget terms. Furthermore, we evaluate the impact of applying momentum perturbations of three magnitudes below, up to, and above the CBL on the TKE budget terms. Momentum perturbations greatly reduce the fetch associated with turbulence generation. When applied to half the vertical extent of the boundary layer, momentum perturbations produce an adequate amount of turbulence. However, when applied above the CBL, additional structures are generated at the top of the CBL, near the inversion layer. The magnitudes of the TKE budgets produced by SCPM-M when applied at varying heights and with different perturbation amplitudes are always higher near the surface and inversion layer than those produced by No-SCPM, as are their contributions to the TKE. This study provides a better understanding of how SCPM-M reduces computational costs and how different budget terms contribute to TKE in a boundary-coupled LES simulation.

17 WIND ENERGY↗
DOE OSTI2020

Quantifying the impacts of climate change and extreme climate events on energy systems

Climate induced extreme weather events and weather variations will affect both the demand of energy and the resilience of energy supply systems. The specific potential impact of extreme events on energy systems has been difficult to quantify due to the unpredictability of future weather events. In this work, we develop a stochastic-robust optimization method to consider both low impact variations and extreme events. Applications of the method to 30 cities in Sweden, by considering 13 climate change scenarios, reveal that uncertainties in renewable energy potential and demand can lead to a significant performance gap (up to 34% for grid integration) brought by future climate variations and a drop in power supply reliability (up to 16%) due to extreme weather events. Finally, appropriate quantification of the climate change impacts will ensure robust operation of the energy systems and enable renewable energy penetration above 30% for a majority of the cities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Gaussian process based optimization of molecular geometries using statistically sampled energy surfaces from quantum Monte Carlo

Optimization of atomic coordinates and lattice parameters remains a significant challenge to the wide use of stochastic electronic structure methods such as quantum Monte Carlo (QMC). Measurements of the forces and stress tensor by these methods contain statistical errors, challenging conventional gradient-based numerical optimization methods that assume deterministic results. Additionally, forces are not yet available for some methods, wavefunctions, and basis sets and when available may be expensive to compute to sufficiently high statistical accuracy near energy minima, where the energy surfaces are flat. Here, we explore the use of Gaussian process based techniques to sample the energy surfaces and reduce sensitivity to the statistical nature of the problem. We utilize Latin hypercube sampling, with the number of sampled energy points scaling quadratically with the number of optimized parameters. Furthermore, we show these techniques may be successfully applied to systems consisting of tens of parameters, demonstrating QMC optimization of a benzene molecule starting from a randomly perturbed, broken symmetry geometry.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2019

Explicit time integration of the stiff chemical Langevin equations using computational singular perturbation

A stable explicit time-scale splitting algorithm for stiff chemical Langevin equations (CLEs) is developed, based on the concept of computational singular perturbation. The drift term of the CLE is projected onto basis vectors that span the fast and slow subdomains. The corresponding fast modes exhaust quickly, in the mean sense, and the system state then evolves, with a mean drift controlled by slow modes, on a random manifold. The drift-driven time evolution of the state due to fast exhausted modes is modeled algebraically as an exponential decay process, while that due to slow drift modes and diffusional processes is integrated explicitly. This enables time integration step sizes much larger than those required by typical explicit numerical methods for stiff stochastic differential equations. The algorithm is motivated and reported on, and extensive numerical experiments are conducted to illustrate its accuracy and stability with a number of model systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A light weight regularization for wave function parameter gradients in quantum Monte Carlo

The parameter derivative of the expectation value of the energy, ∂E/∂p, is a key ingredient in variational Monte Carlo (VMC) wave function optimization methods. In some cases, a naïve estimate of this derivative suffers from an infinite variance, which inhibits the efficiency of optimization methods that rely on a stable estimate of the derivative. In this work, we derive a simple regularization of the naïve estimator, which is trivial to implement in existing VMC codes, has finite variance, and a negligible bias, which can be extrapolated to zero bias with no extra cost. We use this estimator to construct an unbiased, finite variance estimation of ∂E/∂p for a multi-Slater–Jastrow trial wave function on the LiH molecule and in the optimization of a multi-Slater–Jastrow trial wave function on the CuO molecule. This regularized estimator is a simple and efficient estimator of ∂E/∂p for VMC optimization techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Population-based 3D genome structure analysis reveals driving forces in spatial genome organization

Significance We provide a method for population-based structure modeling of whole diploid genomes using Hi-C data. The method considers the stochastic nature of chromosome structures, which allows a detailed analysis of the dynamic landscape of genome organizations. We predict and experimentally validate the presence of chromosome-specific higher-order centromere clusters, which can play a key role in the spatial organization of the human genome, specifically influencing the overall chromosome positioning, as well as the preference of specific chromosome conformations. Our approach generate predictive structural models of diploid genomes from Hi-C data, which can provide insights into the guiding principles of 3D genome organizations.

3D genome organization↗
DOE OSTI2016

Rejoinder

We are grateful for the many insightful comments provided by the discussants. One team politely pointed out oversights in our literature review and the subsequent omission of a formidable comparator. Another made an important clarification about when a more aggressive variation (the so-called NoMax) would perform poorly. A third team offered enhancements to the framework, including a derivation of closed-form expressions and a more aggressive updating scheme; these enhancements were supported by an empirical study comparing new alternatives with old. The last team suggested hybridizing the statistical augmented Lagrangian (AL) method with modern stochastic search. Here we present our responses to these contributions and detail some improvements made to our own implementations in light of them. We conclude with some thoughts on statistical optimization using surrogate modeling and open-source software.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

A UNIFIED MICROSCOPIC-MACROSCOPIC MONTE CARLO SIMULATION OF GAS-GRAIN CHEMISTRY IN COLD DENSE INTERSTELLAR CLOUDS

For the first time, we report a unified microscopic-macroscopic Monte Carlo simulation of gas-grain chemistry in cold interstellar clouds in which both the gas-phase and the grain-surface chemistry are simulated by a stochastic technique. The surface chemistry is simulated with a microscopic Monte Carlo method in which the chemistry occurs on an initially flat surface. The surface chemical network consists of 29 reactions initiated by the accreting species H, O, C, and CO. Four different models are run with diverse but homogeneous physical conditions including temperature, gas density, and diffusion-barrier-to-desorption energy ratio. As time increases, icy interstellar mantles begin to grow. Our approach allows us to determine the morphology of the ice, layer by layer, as a function of time, and to ascertain the environment or environments for individual molecules. Our calculated abundances can be compared with observations of ices and gas-phase species, as well as the results of other models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

STAR CLUSTERS IN M33: UPDATED UBVRI PHOTOMETRY, AGES, METALLICITIES, AND MASSES

The photometric characterization of M33 star clusters is far from complete. In this paper, we present homogeneous UBVRI photometry of 708 star clusters and cluster candidates in M33 based on archival images from the Local Group Galaxies Survey, which covers 0.8 deg{sup 2} along the galaxy's major axis. Our photometry includes 387, 563, 616, 580, and 478 objects in the UBVRI bands, respectively, of which 276, 405, 430, 457, and 363 do not have previously published UBVRI photometry. Our photometry is consistent with previous measurements (where available) in all filters. We adopted Sloan Digital Sky Survey ugriz photometry for complementary purposes, as well as Two Micron All Sky Survey near-infrared JHK photometry where available. We fitted the spectral-energy distributions of 671 star clusters and candidates to derive their ages, metallicities, and masses based on the updated PARSEC simple stellar populations synthesis models. The results of our χ{sup 2} minimization routines show that only 205 of the 671 clusters (31%) are older than 2 Gyr, which represents a much smaller fraction of the cluster population than that in M31 (56%), suggesting that M33 is dominated by young star clusters (<1 Gyr). We investigate the mass distributions of the star clusters—both open and globular clusters—in M33, M31, the Milky Way, and the Large Magellanic Cloud. Their mean values are log (M {sub cl}/M {sub ☉}) = 4.25, 5.43, 2.72, and 4.18, respectively. The fraction of open to globular clusters is highest in the Milky Way and lowest in M31. Our comparisons of the cluster ages, masses, and metallicities show that our results are basically in agreement with previous studies (where objects in common are available); differences can be traced back to differences in the models adopted, the fitting methods used, and stochastic sampling effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Validation of the stochastic inversion algorithm for acoustic travel-time tomography: a large eddy simulation study

Acoustic tomography (AT) is explored as a remote sensing technique to obtain instantaneous snapshots of temperature and velocity fluctuations for wind energy applications. This study integrates Large Eddy Simulation (LES) with the Stochastic Inversion (SI) method to validate the algorithm’s capacity for accurate reconstruction of atmospheric fluctuations. The initial findings demonstrate the efficacy of the method in accurately capturing the predominant flow structures. Normalized L2 error evaluations further inform the algorithm’s precision, with errors accentuated in less sampled peripheral regions. The results underscore the method’s promise as a non-intrusive observational tool, with ongoing development poised to improve its precision and reliability.

17 WIND ENERGY↗
DOE OSTI2019

Cosmological Evidence Modelling: a new simulation-based approach to constrain cosmology on non-linear scales

Extracting accurate cosmological information from galaxy–galaxy and galaxy–matter correlation functions on non-linear scales (${\lesssim } 10 \, h^{-1}{\rm {Mpc}}$) requires cosmological simulations. Additionally, one has to marginalize over several nuisance parameters of the galaxy–halo connection. However, the computational cost of such simulations prohibits naive implementations of stochastic posterior sampling methods like Markov chain Monte Carlo (MCMC) that would require of order $\mathcal {O}(10^6)$ samples in cosmological parameter space. Several groups have proposed surrogate models as a solution: a so-called emulator is trained to reproduce observables for a limited number of realizations in parameter space. Afterwards, this emulator is used as a surrogate model in an MCMC analysis. In this work, we demonstrate a different method called Cosmological Evidence Modelling (CEM). First, for each simulation, we calculate the Bayesian evidence marginalized over the galaxy–halo connection by repeatedly populating the simulation with galaxies. We show that this Bayesian evidence is directly related to the posterior probability of cosmological parameters. Finally, we build a physically motivated model for how the evidence depends on cosmological parameters as sampled by the simulations. We demonstrate the feasibility of CEM by using simulations from the Aemulus simulation suite and forecasting cosmological constraints from BOSS CMASS measurements of redshift-space distortions. Our analysis includes exploration of how galaxy assembly bias affects cosmological inference. Overall, CEM has several potential advantages over the more common approach of emulating summary statistics, including the ability to easily marginalize over highly complex models of the galaxy–halo connection and greater accuracy, thereby reducing the number of simulations required.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Critical fluid dynamics in two and three dimensions

We describe a numerical method for simulating stochastic fluid dynamics near a critical point in the Ising universality class. This theory is known as model H, and is expected to govern the nonequilibrium dynamics of quantum chromodynamics (QCD) near a possible critical endpoint of the phase transition between a hadron liquid and the quark-gluon plasma. The numerical algorithm is based on a Metropolis scheme, and automatically ensures that the distribution function of the hydrodynamic variables in equilibrium is independent of the transport coefficients and only governed by the microscopic free energy. We verify dynamic scaling near the critical point of a two and three-dimensional fluid and extract the associated critical exponent z. Here, we find z≃3 in three dimensions, and z≃2 for a two-dimensional fluid. In a finite system, we observe a crossover between the mean field value z=4 and the true critical exponent z≃3 (z≃2 in d=2). This crossover is governed by the values of the correlation length and the renormalized shear viscosity.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗
DOE OSTI2018

Quasiparticle spectra from molecules to bulk

We present a stochastic cumulant GW method, allowing us to map the evolution of photoemission spectra, quasiparticle energies, lifetimes, and emergence of collective excitations from molecules to bulklike systems with up to thousands of valence electrons, including Si nanocrystals and nanoplatelets. The quasiparticle energies rise due to their coupling with collective shake-up (plasmon) excitations, and this coupling leads to significant spectral weight loss (up to 50% for the low-energy states), shortening the lifetimes and shifting the spectral features to lower energies by as much as 0.6 eV. Such features are common to all the systems studied irrespective of their sizes and shapes. For small and low-dimensional systems the surface plasmon resonances affect the frequency of the collective excitation and position of the satellites.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2022

Machine learning and atomic layer deposition: Predicting saturation times from reactor growth profiles using artificial neural networks

In this work, we explore the application of deep neural networks to the optimization of atomic layer deposition (ALD) processes. In particular, we focus on a one-shot optimization problem, where we try to predict the optimal dose time that leads to saturation everywhere in the reactor based on thickness values measured at different points of an ALD reactor after a single trial growth. In order to tackle this problem, we introduce a dataset designed to train neural networks to predict saturation times based on these inputs for a cross-flow ALD reactor. Here, we then explore the predictive ability of artificial neural networks of different depths and sizes using a separate testing dataset to evaluate their accuracies. The results obtained show that networks trained using stochastic gradient descent methods can accurately predict saturation times without requiring any additional information on the surface kinetics. This provides a viable approach to minimize the number of experiments required to optimize new ALD processes in a known reactor, and it highlights the way machine learning can be leveraged for thin film growth and manufacturing. While the datasets and training procedure depend on the reactor geometry, the trained neural networks provide a general surrogate model connecting thickness values and trial dose times with optimal saturation times that can be reused for different ALD processes within the same reactor.

36 MATERIALS SCIENCE↗