Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Multiscale simulation of spatially correlated microstructure via a latent space representation

When deformation gradients act on the scale of the microstructure of a part due to geometry and loading, spatial correlations and finite-size effects in simulation cells cannot be neglected. We propose a multiscale method that accounts for these effects using a variational autoencoder to encode the structure–property map of the stochastic volume elements making up the statistical description of the part. In this paradigm the autoencoder can be used to directly encode the microstructure or, alternatively, its latent space can be sampled to provide likely realizations. Furthermore, we demonstrate the method on three examples using the common additively manufactured material AlSi10Mg in: (a) a comparison with direct numerical simulation of the part microstructure, (b) a push forward of microstructural uncertainty to performance quantities of interest, and (c) a simulation of functional gradation of a part with stochastic microstructure.

Elastoplasticity↗

Global stochastic optimization of stellarator coil configurations

In the construction of a stellarator, the manufacturing and assembling of the coil system is a dominant cost. These coils need to satisfy strict engineering tolerances, and if those are not met the project could be cancelled as in the case of the National Compact Stellarator Experiment (NCSX) project. Therefore, our goal is to find coil configurations that increase construction tolerances without compromising the performance of the magnetic field. In this paper, we develop a gradient-based stochastic optimization model which seeks robust stellarator coil configurations in high dimensions. In particular, we design a two-step method: first, we perform an approximate global search by a sample efficient trust-region Bayesian optimization; second, we refine the minima found in step one with a stochastic local optimizer. To this end, we introduce two stochastic local optimizers: BFGS applied to the sample average approximation; and Adam, equipped with a control variate for variance reduction. Numerical simulations performed on a W7-X-like coil configuration demonstrate that our global optimization approach finds a variety of promising local solutions at less than 0.1% of the cost of previous work, which considered solely local stochastic optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

On the minimax feedback control of uncertain dynamic systems.

In this paper the problem of optimal feedback control of uncertain discrete-time dynamic systems is considered where the uncertain quantities do not have a stochastic description but instead are known to belong to given sets. The problem is converted to a sequential minimax problem and dynamic programming is suggested as a general method for its solution. The notion of a sufficiently informative function, which parallels the notion of a sufficient statistic of stochastic optimal control, is introduced, and conditions under which the optimal controller decomposes into an estimator and an actuator are identified.

Bertsekas, D. P.↗

Sufficiently informative functions and the minimax feedback control of uncertain dynamic systems.

The problem of optimal feedback control of uncertain discrete-time dynamic systems is considered where the uncertain quantities do not have a stochastic description but instead are known to belong to given sets. The problem is converted to a sequential minimax problem and dynamic programming is suggested as a general method for its solution. The notion of a sufficiently informative function, which parallels the notion of a sufficient statistic of stochastic optimal control, is introduced, and conditions under which the optimal controller decomposes into an estimator and an actuator are identified.

Bertsekas, D. P.↗

Stochastic density functional theory combined with Langevin dynamics for warm dense matter

Here, this study overviews and extends a recently developed stochastic finite-temperature Kohn-Sham density functional theory to study warm dense matter using Langevin dynamics, specifically under periodic boundary conditions. The method's algorithmic complexity exhibits nearly linear scaling with system size and is inversely proportional to the temperature. Additionally, a linear-scaling stochastic approach is introduced to assess the Kubo-Greenwood conductivity, demonstrating exceptional stability for dc conductivity. Utilizing the developed tools, we investigate the equation of state, radial distribution, and electronic conductivity of hydrogen at a temperature of 30 000 K. As for the radial distribution functions, we reveal a transition of hydrogen from gaslike to liquidlike behavior as its density exceeds 4 g/cm 3 . As for the electronic conductivity as a function of the density, we identified a remarkable isosbestic point at frequencies around 7 eV, which may be an additional signature of a gas-liquid transition in hydrogen at 30 000 K.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Complex Langevin and other approaches to the sign problem in quantum many-body physics

In this work, we review the theory and applications of complex stochastic quantization to the quantum many-body problem. Along the way, we present a brief overview of a number of ideas that either ameliorate or in some cases altogether solve the sign problem, including the classic reweighting method, alternative Hubbard–Stratonovich transformations, dual variables (for bosons and fermions), Majorana fermions, density-of-states methods, imaginary asymmetry approaches, and Lefschetz thimbles. We discuss some aspects of the mathematical underpinnings of conventional stochastic quantization, provide a few pedagogical examples, and summarize open challenges and practical solutions for the complex case. Finally, we review the recent applications of complex Langevin to quantum field theory in relativistic and nonrelativistic quantum matter, with an emphasis on the nonrelativistic case.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Information system of rice planting calendar based on ten-day (Dasarian) rainfall prediction

This paper describes information system of rice planting calendar to help farmers in determining the time for rice planting. The information includes rainfall prediction in ten days (dasarian) scale overlaid to map of rice field to produce map of rice planting in village level. The rainfall prediction was produced by stochastic modeling using Fast Fourier Transform (FFT) and Non-Linier Least Squares methods to fit the curve of function to the rainfall data. In this research, the Fourier series has been modified become non-linear function to follow the recent characteristics of rainfall that is non stationary. The results have been also validated in 4 steps, including R-Square, RMSE, R-Skill, and comparison with field data. The development of information system (cyber extension) provides information such as rainfall prediction, prediction of the planting time, and interactive space for farmers to respond to the information submitted. Interfaces for interactive response will be critical to the improvement of prediction accuracy of information, both rainfall and planting time. The method used to get this information system includes mapping on rice planting prediction, converting the format file, developing database system, developing website, and posting website. Because of this map was overlaid with the Google map, the map files must be converted to the .kml file format.

60 APPLIED LIFE SCIENCES↗

Using full configuration interaction quantum Monte Carlo in a seniority zero space to investigate the correlation energy equivalence of pair coupled cluster doubles and doubly occupied configuration interaction

Over the past few years, pair coupled cluster doubles (pCCD) has shown promise for the description of strong correlation. This promise is related to its apparent ability to match results from doubly occupied configuration interaction (DOCI), even though the latter method has exponential computational cost. Here, by modifying the full configuration interaction quantum Monte Carlo algorithm to sample only the seniority zero sector of Hilbert space, we show that the DOCI and pCCD energies are in agreement for a variety of 2D Hubbard models, including for systems well out of reach for conventional configuration interaction algorithms. Our calculations are aided by the sign problem being much reduced in the seniority zero space compared with the full space. We present evidence for this and then discuss the sign problem in terms of the wave function of the system which appears to have a simplified sign structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Process-oriented stochastic perturbations applied to the parametrization of turbulence and shallow convection for ensemble prediction

Weather forecasting nowadays often requires some estimation of uncertainties associated with the output of meteorological models, in order to better inform decision making, especially in the context of intense weather events. Ensemble prediction systems provide such information through sets of possible scenarios which are designed to represent various uncertainty sources, including model uncertainties. A wide variety of methods have been proposed to estimate model uncertainties, among which perturbation methods targeting uncertain processes are a promising research field. Here, we focus on the representation of small-scale variability by process-oriented perturbation schemes applied to two key physical processes, namely turbulence and shallow convection. The perturbations are applied to a single-column version of the convection-permitting AROME model, in three idealized boundary-layer cases. Large-eddy simulations (LESs) of the same cases serve as a reference for the subgrid variability that has to be represented, and the results are also compared to those given by the Stochastically Perturbed Parametrization Tendencies (SPPT) method, which is a method commonly used by weather forecast centres to represent model uncertainty. The spread produced by our process-oriented perturbations of turbulence and shallow convection does not represent all the small-scale variability implied by the LESs for temperature and humidity. However, it is of a similar order of magnitude for the wind, thanks to perturbations generated by the stochastic turbulence scheme. The dispersion is structurally different from what is obtained with SPPT. It is non-negligible in the lower levels, where SPPT perturbations are usually suppressed because of numerical instabilities, indicating a possible complementarity between the schemes.

54 ENVIRONMENTAL SCIENCES↗

A three-point velocity estimation method for two-dimensional coarse-grained imaging data

Time delay and velocity estimation methods have been widely studied subjects in the context of signal processing, with applications in many different fields of physics. The velocity of waves or coherent fluctuation structures is commonly estimated as the distance between two measurement points divided by the time lag that maximizes the cross correlation function between the measured signals, but this is demonstrated to result in erroneous estimates for two spatial dimensions. We present an improved method to accurately estimate both components of the velocity vector, relying on three non-aligned measurement points. We introduce a stochastic process describing the fluctuations as a superposition of uncorrelated pulses moving in two dimensions. Using this model, we show that the three-point velocity estimation method, using time delays calculated through cross correlations, yields the exact velocity components when all pulses have the same velocity. The two- and three-point methods are tested on synthetic data generated from realizations of such processes for which the underlying velocity components are known. The results reveal the superiority of the three-point technique. Finally, we demonstrate the applicability of the velocity estimation on gas puff imaging data of strongly intermittent plasma fluctuations due to the radial motion of coherent, blob-like structures at the boundary of the Alcator C-Mod tokamak.

Materials Science↗

Scalable Techniques for Stochastic Power Flow Problems (Final Report)

The proposed research focuses on developing scalable algorithms for two-stage security-constrained OPF problems with AC power flow constraints, a class of problems complicated by (i) scale arising from a scenario representation; and (ii) the presence of nonlinearity, nonconvexity, and possibly second-stage discreteness or complementarity. Unfortunately, most existing solvers cannot contend with both challenges simultaneously; accordingly, the proposed research focuses on developing solution techniques that can both scale with the number of scenarios and contend with nonconvexity and second-stage complementarity. We consider three avenues for addressing such problems: (i) Variable sample-size SQP (VS-SQP) methods that combine sparse Quasi-Newton updates with a scalable variance-reduced stochastic gradient scheme for stochastic QP subproblems, allowing for contending with second-stage complementarity via regularization; (ii) Variable sample-size stochastic Interior-point (VS-sIP) schemes that propose a sampling-based regularized (to allow for contending with complementarity) interior-point schemes in which a Schur-complement technique is employed for decomposing the Newton direction computation step; (iii) Variable sample-size tractable ADMM (VS-tADMM) schemes combine variable sample-sizes with carefully designed techniques for resolving each of the nonconvex updates (by leveraging the QCQP structures). We intend to compare the three schemes using performance profiles in terms of solution quality, scalability, etc. and then select one scheme which will then be developed and further refined in Python for purposes of the GO competition.

42 ENGINEERING↗

Stochastic Models of Tropical Rain-Rate Fields

Because of the extreme variability of rain rate in space and time and the difficulties with remote sensing methods of measuring rain rates, accurate determination of rainfall over large areas and time periods has long been a problem for hydrologists, meteorogists, and climatologists. A number of statistical models of rain have been developed in order to investigate the impact of rain variability on satellite remote sensing methods, validation of satellite rain products, and generation of rain maps with accompanying error estimates. These models may be useful in examining 'sub-grid scale' issues in representing precipitation in numerical mdoels. A stochastic model will first be described which can generate time-dependent high-resolution spatial rain fields with space and time correlations similar to those seen in rain data, as well as representing the presence of areas with zero rain rate and log-normally distributed rain rates where there is rain. A simpler model derived from this, formulated in the spectral domain, seems to imply fractal-like rain statistics at small scales when fit to rain data.

Bell, Thomas L.↗

Volt-Var Curve Reactive Power Control Requirements and Risks for Feeders with Distributed Roof-Top Photovoltaic Systems

The benefits and risks associated with Volt-Var Curve (VVC) control for management of voltages in electric feeders with distributed, roof-top photovoltaic (PV) can be defined using a stochastic hosting capacity analysis methodology. Although past work showed that a PV inverter’s reactive power can improve grid voltages for large PV installations, this study adds to the past research by evaluating the control method’s impact (both good and bad) when deployed throughout the feeder within small, distributed PV systems. The stochastic hosting capacity simulation effort iterated through hundreds of load and PV generation scenarios and various control types. The simulations also tested the impact of VVCs with tampered settings to understand the potential risks associated with a cyber-attack on all of the PV inverters scattered throughout a feeder. The simulation effort found that the VVC can have an insignificant role in managing the voltage when deployed in distributed roof-top PV inverters. This type of integration strategy will result in little to no harm when subjected to a successful cyber-attack that alters the VVC settings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Variational Bayesian strategies for high-dimensional, stochastic design problems

This paper is concerned with a lesser-studied problem in the context of model-based, uncertainty quantification (UQ), that of optimization/design/control under uncertainty. The solution of such problems is hindered not only by the usual difficulties encountered in UQ tasks (e.g. the high computational cost of each forward simulation, the large number of random variables) but also by the need to solve a nonlinear optimization problem involving large numbers of design variables and potentially constraints. We propose a framework that is suitable for a class of such problems and is based on the idea of recasting them as probabilistic inference tasks. To that end, we propose a Variational Bayesian (VB) formulation and an iterative VB–Expectation-Maximization scheme that is capable of identifying a local maximum as well as a low-dimensional set of directions in the design space, along which, the objective exhibits the largest sensitivity. We demonstrate the validity of the proposed approach in the context of two numerical examples involving thousands of random and design variables. In all cases considered the cost of the computations in terms of calls to the forward model was of the order of 100 or less. The accuracy of the approximations provided is assessed by information-theoretic metrics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Scalable and Energy-Efficient Methods for Interactive Exploration of Scientific Data

The main scientific contributions of this project are the following novel concepts for multidimensional arrays: shape-based similarity join (SIGMOD 2016), incremental view maintenance (SIGMOD 2017), user-defined stencil functions (HPDC 2017), and distributed caching for in-situ processing (SSDBM 2018). Building on our collaboration with the astrophysics group at LBNL, we applied these techniques to the data generated in the Palomar Transient Factory (PTF) astronomical survey. They played a pivotal role in the first-ever observation of a neutron star merger, which produces gravitational waves and turns out to be the origin of heavy elements, including gold. This has lead to a Science magazine article that has received extensive media coverage on ACM TechNews, Slashdot, FiveThirtyEight, and Quanta Magazine, among others. Additionally, two other articles detailing related aspects of the same discovery have been published in the Astrophysical Journal Letters journal. These publications have more than 3,000 citations according to Google Scholar (as of February 2022). This cross-disciplinary collaboration provided very good opportunities to apply database techniques to real-life scientific problems. The fact that they facilitated major discoveries in astrophysics proves the importance of our research. In addition to the work on multidimensional array databases, this project has also developed stochastic gradient descent (SGD) optimization algorithms for training large scale machine learning models, methods for querying in-situ data, and a database query optimizer based on sketch synopses.

79 ASTRONOMY AND ASTROPHYSICS↗

Transported PDF Modeling of Compressible Turbulent Reactive Flows by using the Eulerian Monte Carlo Fields Method

Although the transported probability density function (PDF) method has been developed for decades, its application has been mainly focused on the low-Mach number flow problems. This work extends the transported PDF method to compressible flow problems. The Eulerian Monte Carlo fields (EMCF) solution method is employed to solve the transported PDF equation for compressible flow problems. A pseudo stagnation enthalpy is introduced and its stochastic partial differential equation is derived to ensure total energy conservation numerically. A new mixing model called interaction by partial exchange with mean (IPEM) is introduced to expand the available choices of mixing models for the EMCF method. The consistency of the EMCF method is examined for solving the transported PDF equation. Numerical implementation details are discussed, such as the density coupling between the compressible flow solver and the EMCF solver, discretization schemes for the mixing terms and the stochastic terms. The implemented compressible flow solver coupled with the EMCF solver is verified and validated in a series of test cases with increasing level of complexity, ranging from a statistically one-dimensional turbulent mixing layer to a self-excited resonance model rocket combustor. It is observed that in general with the increase of compressibility, there is an increase in the sensitivity of the modeling results to the different models and algorithms. This makes it necessary to develop a thorough understanding of the model sensitivity in order to develop a robust and accurate simulation solver for highly compressible turbulent reactive flows. The thermo-acoustic instability inside the model rocket combustor case is captured reasonably, which demonstrates the overall capability of the developed compressible turbulent combustion solver based on the transported PDF method.

42 ENGINEERING↗

An adaptive local reduced basis method for solving PDEs with uncertain inputs and evaluating risk

Many physical systems are modeled using partial differential equations (PDEs) with uncertain or random inputs. For such systems, naively propagating a fixed number of samples of the input probability law (or an approximation thereof) through the PDE is often inadequate to accurately quantify the "risk" associated with critical system responses. In this paper, we develop a goal-oriented, adaptive sampling and local reduced basis approximation for PDEs with random inputs. Our method determines a set of samples and an associated (implicit) Voronoi partition of the parameter domain on which we build local reduced basis approximations of the PDE solution. The samples are selected in an adaptive manner using an a posteriori error indicator. A notable advantage of the proposed approach is that the computational cost of the approximation during the adaptive process remains constant. We provide theoretical error bounds for our approximation and numerically demonstrate the performance of our method when compared to widely used adaptive sparse grid techniques. In addition, we tailor our approach to accurately quantify the risk of quantities of interest that depend on the PDE solution. We demonstrate our method on an advection-diffusion example and a Helmholtz example. Keywords: stochastic partial differential equation, adaptive sampling, reduced basis, a posteriori error estimation, coherent risk measure, conditional value-at-risk.

42 ENGINEERING↗

Gapped-filtering for efficient Chebyshev expansion of the density projection operator

In this paper, we develop the gapped-filtering method, whereby a short Chebyshev expansion accurately represents the density-matrix operator. The method optimizes the Chebyshev coefficients to give the correct density matrix at all energies except within the gapped region where there are no eigenstates. Gapped filtering reduces the number of required terms in the Chebyshev expansion compared to traditional expansion methods, as long as one knows or can determine efficiently the HOMO and LUMO positions. The reduction is especially noticeable (factors of 2-3) when high accuracy is sought. To exemplify the method, we use gapped-filtering to increase the efficiency of stochastic-GW calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗