Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Resonant X-ray emission spectroscopy from broadband stochastic pulses at an X-ray free electron laser

Abstract Hard X-ray spectroscopy is an element specific probe of electronic state, but signals are weak and require intense light to study low concentration samples. Free electron laser facilities offer the highest intensity X-rays of any available light source. The light produced at such facilities is stochastic, with spikey, broadband spectra that change drastically from shot to shot. Here, using aqueous ferrocyanide, we show that the resonant X-ray emission (RXES) spectrum can be inferred by correlating for each shot the fluorescence intensity from the sample with spectra of the fluctuating, self-amplified spontaneous emission (SASE) source. We obtain resolved narrow and chemically rich information in core-to-valence transitions of the pre-edge region at the Fe K-edge. Our approach avoids monochromatization, provides higher photon flux to the sample, and allows non-resonant signals like elastic scattering to be simultaneously recorded. The spectra obtained match well with spectra measured using a monochromator. We also show that inaccurate measurements of the stochastic light spectra reduce the measurement efficiency of our approach.

Fuller, Franklin D. (ORCID:0000000237737087)↗

Evaluation of a stochastic model of particle dispersion in a turbulent round jet

A stochastic model of particle dispersion by turbulence, proposed by Gosman and Ioannides (1981), is evaluated. The method employs a k-epsilon model to estimate turbulence properties. Dispersion is determined by computing particle motion, with random sampling to obtain instantaneous flow properties for a statistically significant number of particle trajectories. The stochastic model yields good results particularly when eddy lifetimes are evaluated. The method allows the effects of large relative velocities between the particles and the flow, drag properties at Reynolds numbers greater than the Stokes flow regime, and the variations of local turbulence properties to be readily handled, at least for boundary layer flows.

Shuen, J.-S.↗

Adaptive, Active Learning, and Multifidelity Monte Carlo Methods in the MOOSE Stochastic Tools Module

MOOSE is an open-source computational platform for constructing multi-physics models and executing them in a massively parallel fashion. It has a stochastic tools module (STM) for forward/inverse uncertainty quantification (UQ) and surrogate modeling. This presentation details some recent developments to the STM with respect to the implementation of adaptive, active learning, and multifidelity Monte Carlo methods for forward UQ of computational models. Specifically, the adaptive Monte Carlo methods include Markov Chain Monte Carlo (MCMC)-driven algorithms like adaptive importance sampling and parallelized subset simulation for statistical QoI estimation, rare events analysis, and stochastic gradient-free optimization. The active learning methods include Gaussian Process (GP) surrogates and their training via Adam optimization, design of acquisition functions, and integration with samplers like Monte Carlo, adaptive importance, and parallelized subset simulation. These active learning methods are also designed to work in a batch mode, wherein, the required calls to the full computational model are executed in parallel whenever a user-specified batch size is met. The multifidelity methods in STM are broadly divided into two categories: hierarchical, where a defined hierarchy exists among the low-fidelity models, and peer, where all the low-fidelity models are treated equally. A GP surrogate is used to learn the differences between the low- and high-fidelity models in both multifidelity categories, and acquisition functions from the active learning classes are used to decide whether to rely on a low-fidelity model or call the expensive high-fidelity model. Alongside the software description and usage, applications are also presented to nuclear engineering computational models including a TRISO nuclear fuel particle, a reactor pressure vessel, and a heat-pipe microreactor.

97 MATHEMATICS AND COMPUTING↗

Exploring the Connection Between Sampling Problems in Bayesian Inference and Statistical Mechanics

The Bayesian and statistical mechanical communities often share the same objective in their work - estimating and integrating probability distribution functions (pdfs) describing stochastic systems, models or processes. Frequently, these pdfs are complex functions of random variables exhibiting multiple, well separated local minima. Conventional strategies for sampling such pdfs are inefficient, sometimes leading to an apparent non-ergodic behavior. Several recently developed techniques for handling this problem have been successfully applied in statistical mechanics. In the multicanonical and Wang-Landau Monte Carlo (MC) methods, the correct pdfs are recovered from uniform sampling of the parameter space by iteratively establishing proper weighting factors connecting these distributions. Trivial generalizations allow for sampling from any chosen pdf. The closely related transition matrix method relies on estimating transition probabilities between different states. All these methods proved to generate estimates of pdfs with high statistical accuracy. In another MC technique, parallel tempering, several random walks, each corresponding to a different value of a parameter (e.g. "temperature"), are generated and occasionally exchanged using the Metropolis criterion. This method can be considered as a statistically correct version of simulated annealing. An alternative approach is to represent the set of independent variables as a Hamiltonian system. Considerab!e progress has been made in understanding how to ensure that the system obeys the equipartition theorem or, equivalently, that coupling between the variables is correctly described. Then a host of techniques developed for dynamical systems can be used. Among them, probably the most powerful is the Adaptive Biasing Force method, in which thermodynamic integration and biased sampling are combined to yield very efficient estimates of pdfs. The third class of methods deals with transitions between states described by rate constants. These problems are isomorphic with chemical kinetics problems. Recently, several efficient techniques for this purpose have been developed based on the approach originally proposed by Gillespie. Although the utility of the techniques mentioned above for Bayesian problems has not been determined, further research along these lines is warranted

Pohorille, Andrew↗

Photoinduced correlations in stochastic dynamics of a solid-state ionic conductor

Photoexcitation by ultrashort laser pulses plays a crucial role in controlling reaction pathways, creating nonequilibrium material properties, and probing complex molecular dynamics. The photoresponse following a laser pulse is generally nonidentical between exposures due to spatiotemporal fluctuations or the stochastic nature of dynamical pathways. However, most ultrafast pump-probe experiments struggle to distinguish intrinsic sample fluctuations from extrinsic apparatus noise, often missing deviations from the averaged response. Leveraging the stability and high photon flux of time-resolved X-ray micro-diffraction at a synchrotron, we characterized stochastic photoinduced dynamics in a solid-state ionic conductor. By analyzing temporal evolutions of the lattice parameter of a single grain, we found that shot-to-shot fluctuations are not independent. Instead, correlations exist between nonequilibrium lattice trajectories following adjacent shots, with a characteristic correlation length of approximately 1500 shots, corresponding to an energy barrier of 0.4 ± 0.1 eV, close to the activation energy of lithium-ion diffusion.

36 MATERIALS SCIENCE↗

Concurrent multi-peak Bragg coherent x-ray diffraction imaging of 3D nanocrystal lattice displacement via global optimization

Abstract In this paper we demonstrated a method to reconstruct vector-valued lattice distortion fields within nanoscale crystals by optimization of a forward model of multi-reflection Bragg coherent diffraction imaging (MR-BCDI) data. The method flexibly accounts for geometric factors that arise when making BCDI measurements, is amenable to efficient inversion with modern optimization toolkits, and allows for globally constraining a single image reconstruction to multiple Bragg peak measurements. This is enabled by a forward model that emulates the multiple Bragg peaks of a MR-BCDI experiment from a single estimate of the 3D crystal sample. We present this forward model, we implement it within the stochastic gradient descent optimization framework, and we demonstrate it with simulated and experimental data of nanocrystals with inhomogeneous internal lattice displacement. We find that utilizing a global optimization approach to MR-BCDI affords a reliable path to convergence of data which is otherwise challenging to reconstruct.

36 MATERIALS SCIENCE↗

Prediction of the structure of fuel sprays in gas turbine combustors

The structure of fuel sprays in a combustion chamber is theoretically investigated using computer models of current interest. Three representative spray models are considered: (1) a locally homogeneous flow (LHF) model, which assumes infinitely fast interphase transport rates; (2) a deterministic separated flow (DSF) model, which considers finite rates of interphase transport but ignores effects of droplet/turbulence interactions; and (3) a stochastic separated flow (SSF) model, which considers droplet/turbulence interactions using random sampling for turbulence properties in conjunction with random-walk computations for droplet motion and transport. Two flow conditions are studied to investigate the influence of swirl on droplet life histories and the effects of droplet/turbulence interactions on flow properties. Comparison of computed results with the experimental data show that general features of the flow structure can be predicted with reasonable accuracy using the two separated flow models. In contrast, the LHF model overpredicts the rate of development of the flow. While the SSF model provides better agreement with measurements than the DSF model, definitive evaluation of the significance of droplet/turbulence interaction is not achieved due to uncertainties in the spray initial conditions.

Shuen, J. S.↗

Prediction of the structure of fuel sprays in gas turbine combustors

The structure of fuel sprays in a combustion chamber is theoretically investigated using computer models of current interest. Three representative spray models are considered: (1) a locally homogeneous flow (LHF) model, which assumes infinitely fast interphase transport rates; (2) a deterministic separated flow (DSF) model, which considers finite rates of interphase transport but ignores effects of droplet/turbulence interactions; and (3) a stochastic separated flow (SSF) model, which considers droplet/turbulence interactions using random sampling for turbulence properties in conjunction with random-walk computations for droplet motion and transport. Two flow conditions are studied to investigate the influence of swirl on droplet life histories and the effects of droplet/turbulence interactions on flow properties. Comparison of computed results with the experimental data show that general features of the flow structure can be predicted with reasonable accuracy using the two separated flow models. In contrast, the LHF model overpredicts the rate of development of the flow. While the SSF model provides better agreement with measurements than the DSF model, definitive evaluation of the significance of droplet/turbulence interaction is not achieved due to uncertainties in the spray initial conditions.

Shuen, J.-S.↗

Frequency stability of GPS NAVSTAR block 1 and block 2 on-orbit clocks

Analysis of the frequency stability of the on-orbit NAVSTAR clocks os performed by the Naval Research Laboratory. The frequency stability is presented for sample times of one day to 30 days. Composite frequency stability profiles are presented for Block 1 and Block 2 NAVSTAR clocks. Several NAVSTAR cesium clocks show frequency stabilities of a few parts in 10^(14) for long sample times. Time-domain noise-process analysis shows the dominant noise type to be white frequency noise for sample times of one to ten days. The non-stationary stochastic behavior of one of the cesium clocks, illustrated by its frequency stability history, shows that the frequency stability is not always time-invariant.

Thomas B. Mccaskill↗

Structure optimization with stochastic density functional theory

Linear-scaling techniques for Kohn–Sham density functional theory are essential to describe the ground state properties of extended systems. Still, these techniques often rely on the localization of the density matrix or accurate embedding approaches, limiting their applicability. In contrast, stochastic density functional theory (sDFT) achieves linear- and sub-linear scaling by statistically sampling the ground state density without relying on embedding or imposing localization. In return, ground state observables, such as the forces on the nuclei, fluctuate in sDFT, making optimizing the nuclear structure a highly non-trivial problem. In this work, we combine the most recent noise-reduction schemes for sDFT with stochastic optimization algorithms to perform structure optimization within sDFT. We compare the performance of the stochastic gradient descent approach and its variations (stochastic gradient descent with momentum) with stochastic optimization techniques that rely on the Hessian, such as the stochastic Broyden–Fletcher–Goldfarb–Shanno algorithm. In conclusion, we further provide a detailed assessment of the computational efficiency and its dependence on the optimization parameters of each method for determining the ground state structure of bulk silicon with varying supercell dimensions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic control and the second law of thermodynamics

The second law of thermodynamics is studied from the point of view of stochastic control theory. We find that the feedback control laws which are of interest are those which depend only on average values, and not on sample path behavior. We are lead to a criterion which, when satisfied, permits one to assign a temperature to a stochastic system in such a way as to have Carnot cycles be the optimal trajectories of optimal control problems. Entropy is also defined and we are able to prove an equipartition of energy theorem using this definition of temperature. Our formulation allows one to treat irreversibility in a quite natural and completely precise way.

Brockett, R. W.↗

Data-Consistent Inversion for Stochastic Input-to-Output Maps

Data-consistent inversion is a recently developed measure-theoretic framework for solving a stochastic inverse problem involving models of physical systems. The goal is to construct a probability measure on model inputs (i.e., parameters of interest) whose associated push-forward measure matches (i.e., is consistent with) a probability measure on the observable outputs of the model (i.e., quantities of interest). Previous implementations required the map from parameters of interest to quantities of interest to be deterministic. This work generalizes this framework for maps that are stochastic, i.e., contain uncertainties and variation not explainable by variations in uncertain parameters of interest. Generalizations of previous theorems of existence, uniqueness, and stability of the data-consistent solution are provided while new theoretical results address the stability of marginals on parameters of interest. A notable aspect of the algorithmic generalization is the ability to query the solution to generate independent identically distributed samples of the parameters of interest without requiring knowledge of the so-called stochastic parameters. This work therefore extends the applicability of the data-consistent inversion framework to a much wider class of problems. This includes those based on purely experimental and field data where only a subset of conditions are either controllable or can be documented between experiments while the underlying physics, measurement errors, and any additional covariates are either uncertain or not accounted for by the researcher. Finally, numerical examples demonstrate application of this approach to systems with stochastic sources of uncertainties embedded within the modeling of a system and a numerical diagnostic is summarized that is useful for determining if a key assumption is verified among competing choices of stochastic maps.

97 MATHEMATICS AND COMPUTING↗

The second-moment climatology of the GATE rain rate data

The first part of this paper presents the description of the GARP (Global Atmospheric Research Program) Atlantic Tropical Experiment (GATE) 1 rain-rate data and its two-dimensional spectral and correlation characteristics, which has made it possible to accomplish the following: to show the concentration of a significant power along the frequency axis in the spatiotemporal spectra; to detect a diurnal cycle (which has a range of variation of about 3.4-5.4 mm/n) as one of the sources of bias in the rain statistics of satellite data; to study the distinction between the north-south and east-west transport of spatial rain-rate field and character of its anisotropy; to evaluate the scales of the distinction between second-moment estimates associated with ground and satellite samples; and to determine the appropriate spatial and temporal scales of simple linear stochastic models fitted to averaged rain-rate fields. The second part of this paper is devoted to an analysis of the diffusion of the rain rate by establishing a relationship between the parameters of the multivariate autoregressive model and the coefficients of a diffusion equation. This analysis led to the use of rain data to estimate the rain advection velocity as well as other coefficients of the diffusion equation of the corresponding field. The results obtained can be used for comparison with corresponding estimates of other sources of data (satellite, Tropical Oceans Global Atmosphere Coupled Ocean - Atmosphere Response Experiment (TOGA, COARE) or simulated by physical models), for generating multiple samples of any size, for solving the inverse problems of some of the hydrodynamic equations, and in some other areas of rain data analysis and modeling.

Polyak, Ilya↗

Predictions of the structure of turbulent, particle-laden, round jets

Models of gas and particle motion in turbulent, particle-laden, round jets were evaluated using existing measurements of flow structure. Three models were considered: (1) a locally homogeneous flow model, where velocities and turbulent mixing properties of both phases were assumed to be equal; (2) a deterministic separated flow model, where interphase slip was considered but effects of turbulent dispersion were ignored; and (3) a stochastic separated flow model where effects of interphase slip and turbulent dispersion were considered using random sampling techniques. In all three cases, mean and turbulent properties of the continuous phase were found with a well-calibrated k-epsilon model. The locally homogeneous flow and deterministic separated flow models over- and underestimated particle spread and flow development rates, respectively. The stochastic separated flow model, however, yielded satisfactory predictions of flow structure - except at high particle loadings. Uncertainties in initial conditions for the measurements and possible effects of turbulence modulation by the particles are proposed as the reason for these errors.

Shuen, J.-S.↗

Leveraging neural control variates for enhanced precision in lattice field theory

Results obtained with stochastic methods have an inherent uncertainty due to the finite number of samples that can be achieved in practice. In lattice QCD this problem is particularly salient in some observables like, for instance, observables involving one or more baryons and it is the main problem preventing the calculation of nuclear forces from first principles. The method of control variables has been used extensively in statistics and it amounts to computing the expectation value of the difference between the observable of interest and another observable whose average is known to be zero but is correlated with the observable of interest. Recently, control variates methods emerged as a promising solution in the context of lattice field theories. In our current study, instead of relying on an educated guess to determine the control variate, we utilize a neural network to parametrize this function. Using 1 + 1 dimensional scalar field theory as a testbed, we demonstrate that this neural network approach yields substantial improvements. Notably, our findings indicate that the neural network ansatz is particularly effective in the strong coupling regime. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Hybrid Simulation Framework

HYBRID is a modeling toolset to assess the economic viability of Nuclear-Renewable Integrated Energy Systems (N-R IES). The frameworks enabling this toolset are INL’s RAVEN, its CashFlow plugin and the Modelica language. The toolset includes sample RAVEN workflows performing economic assessments. These workflows consist of: generation of stochastic time series and application of probabilistic analysis and optimization algorithms (RAVEN); a library of Modelica models representing the physical behavior of N-R IES; and the CashFlow plugin mapping physical performance to economic performance. The toolset allows assembling existing and new models such as nuclear reactors, renewable energy sources, energy storage, gas turbines, industrial processes, etc. into an N-R IES. The toolset workflows evaluate the dynamics of the N-R IES responding to stochastic conditions (electricity demand, price, etc.) and optimize the dispatch economics as well as N-R IES capacity planning.

Epiney, Aaron↗