Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Effect of Stochastic Perturbation of Fuel Distribution on the Criticality of a One Speed Reactor and the Development of Multi-Material Multinomial Line Statistics

The effect of random fuel redistribution on the eigenvalue of a one-speed reactor is investigated. An ensemble of such reactors that are identical to a homogeneous reference critical reactor except for the fissile isotope density distribution is constructed such that it meets a set of well-posed redistribution requirements. The average eigenvalue, , is evaluated when the total fissile loading per ensemble element, or realization, is conserved. The perturbation is proven to increase the reactor criticality on average when it is uniformly distributed. The various causes of the change in reactivity, and their relative effects are identified and ranked. From this, a path towards identifying the causes. and relative effects of reactivity fluctuations for the energy dependent problem is pointed to. The perturbation method of using multinomial distributions for representing the perturbed reactor is developed. This method has some advantages that can be of use in other stochastic problems. Finally, some of the features of this perturbation problem are related to other techniques that have been used for addressing similar problems.

Jahshan, S. N.↗

A discrete element method representation of an anisotropic elastic continuum

A method for modeling cubically anisotropic elasticity within the discrete element method is presented. The discrete element method (DEM) is an approach originally intended for modeling granular materials (sand, soil, and powders); however, recent developments have usefully extended it to model stochastic mechanical processes in monolithic solids which, to date, have been assumed to be elastically isotropic. The method presented here for efficiently capturing cubic elasticity in DEM is an important prerequisite for further extending DEM to capture the influence of elastic anisotropy on the mechanical response of polycrystals, composites, etc. The system demonstrated here uses a directionally assigned stiffness in the bonds between adjacent elements and includes separate schemes for achieving anisotropy with Zener ratios greater and smaller than one. Finally, the model framework is presented along with an analysis of the accessible space of elastic properties that can be modeled and an artificial neural network interpolation scheme for mapping input parameters to model elastic behavior.

42 ENGINEERING↗

Stochastic inverse problems: Models and metrics

In past work, we introduced model-based inverse methods, and applied them to problems in which the anomaly could be reasonably modeled by simple canonical shapes, such as rectangular solids. In these cases the parameters to be inverted would be length, width and height, as well as the occasional probe lift-off or rotation. We are now developing a formulation that allows more flexibility in modeling complex flaws. The idea consists of expanding the flaw in a sequence of basis functions, and then solving for the expansion coefficients of this sequence, which are modeled as independent random variables, uniformly distributed over their range of values. There are a number of applications of such modeling: 1. Connected cracks and multiple half-moons, which we have noted in a POD set. Ideally we would like to distinguish connected cracks from one long shallow crack. 2. Cracks of irregular profile and shape which have appeared in cold work holes during bolt-hole eddy-current inspection. One side of such cracks is much deeper than other. 3. L or C shaped crack profiles at the surface, examples of which have been seen in bolt-hole cracks. By formulating problems in a stochastic sense, we are able to leverage the stochastic global optimization algorithms in NLSE, which is resident in VIC-3D®, to answer questions of global minimization and to compute confidence bounds using the sensitivity coefficient that we get from NLSE. We will also address the issue of surrogate functions which are used during the inversion process, and how they contribute to the quality of the estimation of the bounds.

36 MATERIALS SCIENCE↗

Generative AI models for learning flow maps of stochastic dynamical systems in bounded domains

Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary interactions. Despite the success of machine learning-based methods in learning SDEs, existing learning methods are not applicable to SDEs in bounded domains because they cannot accurately capture the particle exit dynamics. We present a unified hybrid data-driven approach that combines a conditional diffusion model with an exit prediction neural network to capture both interior stochastic dynamics and boundary exit phenomena. Our ML model consists of two major components: a neural network that learns exit probabilities using binary cross-entropy loss with rigorous convergence guarantees, and a training-free diffusion model that generates state transitions for non-exiting particles using closed-form score functions. The two components are integrated through a probabilistic sampling algorithm that determines particle exit at each time step and generates appropriate state transitions. Here, the performance of the proposed approach is demonstrated via three test cases: a one-dimensional simplified problem for theoretical verification, a two-dimensional advection-diffusion problem in a bounded domain, and a three-dimensional problem of interest to magnetically confined fusion plasmas.

Bounded domains↗

Quantum-assisted associative adversarial network: applying quantum annealing in deep learning

Abstract Generative models have the capacity to model and generate new examples from a dataset and have an increasingly diverse set of applications driven by commercial and academic interest. In this work, we present an algorithm for learning a latent variable generative model via generative adversarial learning where the canonical uniform noise input is replaced by samples from a graphical model. This graphical model is learned by a Boltzmann machine which learns low-dimensional feature representation of data extracted by the discriminator. A quantum processor can be used to sample from the model to train the Boltzmann machine. This novel hybrid quantum-classical algorithm joins a growing family of algorithms that use a quantum processor sampling subroutine in deep learning, and provides a scalable framework to test the advantages of quantum-assisted learning. For the latent space model, fully connected, symmetric bipartite and Chimera graph topologies are compared on a reduced stochastically binarized MNIST dataset, for both classical and quantum sampling methods. The quantum-assisted associative adversarial network successfully learns a generative model of the MNIST dataset for all topologies. Evaluated using the Fréchet inception distance and inception score, the quantum and classical versions of the algorithm are found to have equivalent performance for learning an implicit generative model of the MNIST dataset. Classical sampling is used to demonstrate the algorithm on the LSUN bedrooms dataset, indicating scalability to larger and color datasets. Though the quantum processor used here is a quantum annealer, the algorithm is general enough such that any quantum processor, such as gate model quantum computers, may be substituted as a sampler.

Wilson, Max (ORCID:0000000207983391)↗

Data-Driven Simulation-Based Planning for Electric Airport Shuttle Systems: A Real-World Case Study

Many airports are adopting battery electric buses in their shuttle fleets due to concerns over air quality and regulations. This study proposes a simulation-based optimization modeling framework to help airport shuttle operators effectively deploy electric buses. We evaluated a planned airport electric shuttle system with an event-driven simulator. Empirical data collected from existing systems were used to drive the simulations. We then proposed a simulation-based optimization model to determine the battery capacity, charging power, and number of chargers so that predefined objective(s) (e.g., minimizing total capital cost, minimizing emissions) are optimized. Compared to existing studies, the primary contribution of the proposed method is that it can model the real-world stochastic nature of operations in an electric bus system with much higher fidelity. To demonstrate the proposed modeling framework, we study a real-world shuttle system at the Dallas-Fort Worth International Airport, and present extensive numerical studies. When considering partial fleet electrification, the model can provide a set of Pareto optimal solutions. When considering full fleet electrification, the optimal solution requires a 50-kWh battery capacity and four 210-kW chargers, resulting in a total capital cost of $26,744,000. The results demonstrate that the proposed modeling framework can effectively optimize the planning of electric airport shuttle systems with partial or full fleet electrification.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

Ten questions concerning occupant behavior in buildings: The big picture

Occupant behavior has significant impacts on building energy performance and occupant comfort. However, occupant behavior is not well understood and is often oversimplified in the building life cycle, due to its stochastic, diverse, complex, and interdisciplinary nature. The use of simplified methods or tools to quantify the impacts of occupant behavior in building performance simulations significantly contributes to performance gaps between simulated models and actual building energy consumption. Therefore, it is crucial to understand occupant behavior in a comprehensive way, integrating qualitative approaches and data- and model-driven quantitative approaches, and employing appropriate tools to guide the design and operation of low-energy residential and commercial buildings that integrate technological and human dimensions. This paper presents ten questions, highlighting some of the most important issues regarding concepts, applications, and methodologies in occupant behavior research. The proposed questions and answers aim to provide insights into occupant behavior for current and future researchers, designers, and policy makers, and most importantly, to inspire innovative research and applications to increase energy efficiency and reduce energy use in buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Accelerated basis adaptation in homogeneous chaos spaces

Polynomial chaos expansions (PCE) provide an efficient approach to uncertainty quantification (UQ) and have been adapted to diverse applications across the spectrum of science and engineering. For situations involving large stochastic parameterizations, the curse of dimensionality renders PCE-based methods computationally prohibitive. A basis adaptation approach for PCE was proposed by Tipireddy and Ghanem (2014) which transforms the input random variables through an isometry such that sufficient probabilistic characterization of specific quantities of interest (QoI) is concentrated in an algebraic manifold embedded in the linear span of the dominant transformed variables. While quite versatile, that original version of the PCE basis adaptation exhibited slow convergence for a number of problems of practical significance. In the present paper, we propose two novel methods to accelerate the convergence of the original basis adaptation approach, thus expanding its reach while also providing insight into its performance. In the first method, information gained from a pilot PCE representation is used to correct the mean and Gaussian coefficients in the adapted space. By taking advantages of probabilistic information in higher dimensional adaptation gleaned from an initial adaptation, the second method updates the rotation matrix used to identify the dominant transformed variables. In this manner, the new rotation matrix concentrates even more probabilistic information in its first few dimensions. These two method can be combined to achieve even better performance, the combined method is referred to as sequentially optimized adaptation method. Here, the methods are demonstrated on an analytical test function and a model of a space structure with several sub-components and a non-smooth quantity of interest representing the maximum acceleration over time. Both methods achieve accelerated convergence of the basis adaptation approach with negligible additional costs.

Accelerated convergence↗

Exact PDF equations and closure approximations for advective-reactive transport

Mathematical models of advection–reaction phenomena rely on advective flow velocity and (bio) chemical reaction rates that are notoriously random. By using functional integral methods, we derive exact evolution equations for the probability density function (PDF) of the state variables of the advection–reaction system in the presence of random transport velocity and random reaction rates with rather arbitrary distributions. These PDF equations are solved analytically for transport with deterministic flow velocity and a linear reaction rate represented mathematically by a heterog eneous and strongly-correlated random field. Our analytical solution is then used to investigate the accuracy and robustness of the recently proposed large-eddy diffusivity (LED) closure approximation [1]. We find that the solution to the LED-based PDF equation, which is exact for uncorrelated reaction rates, is accurate even in the presence of strong correlations and it provides an upper bound of predictive uncertainty.

PDF methods, Uncertainty quantification, Heterogen↗

Accurate Atomic Correlation and Total Energies for Correlation Consistent Effective Core Potentials

Very recently, we introduced a set of correlation consistent effective core potentials (ccECPs) constructed within full many-body approaches. By employing significantly more accurate correlated approaches, we were able to reach a new level of accuracy for the resulting effective core Hamiltonians. We also strived for simplicity of use and easy transferability into a variety of electronic structure methods in quantum chemistry and condensed matter physics. Here, as a reference for future use, we present exact or nearly exact total energy calculations for these ccECPs. The calculations cover H–Kr elements and are based on the state-of-the-art configuration interaction (CI), coupled-cluster (CC), and quantum Monte Carlo (QMC) calculations with systematically eliminated/improved errors. In particular, we carry out full CI/CCSD(T)/CCSDT(Q) calculations with cc-pVnZ with up to n = 6 basis sets and we estimate the complete basis set limits. Using combinations of these approaches, we achieved an accuracy of ≈1–10 mHa for K–Zn atoms and ≈0.1–0.3 mHa for all other elements—within about 1% or better of the ccECP total correlation energies. We also estimate the corresponding kinetic energies within the feasible limit of full CI calculations. In order to provide data for QMC calculations, we include fixed-node diffusion Monte Carlo energies for each element that give quantitative insights into the fixed-node biases for single-reference trial wave functions. The results offer a clear benchmark for future high-accuracy calculations in a broad variety of correlated wave function methods such as CI and CC as well is in stochastic approaches such as real space sampling QMC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning for characterizing the self-assembly of three-dimensional colloidal systems

Creating a systematic framework to characterize the structural states of colloidal self-assembly systems is crucial for unraveling the fundamental understanding of these systems’ stochastic and non-linear behavior. The most accurate characterization methods create high-dimensional neighborhood graphs that may not provide useful information about structures unless these are well-defined reference crystalline structures. Dimensionality reduction methods are thus required to translate the neighborhood graphs into a low-dimensional space that can be easily interpreted and used to characterize non-reference structures. We investigate a framework for colloidal system state characterization that employs deep learning methods to reduce the dimensionality of neighborhood graphs. The framework next uses agglomerative hierarchical clustering techniques to partition the low-dimensional space and assign physically meaningful classifications to the resulting partitions. In this work, we first demonstrate the proposed colloidal self-assembly state characterization framework on a three-dimensional in silico system of 500 multi-flavored colloids that self-assemble under isothermal conditions. We next investigate the generalizability of the characterization framework by applying the framework to several independent self-assembly trajectories, including a three-dimensional in silico system of 2052 colloidal particles that undergo evaporation-induced self-assembly.

36 MATERIALS SCIENCE↗

Analysis of Real Ship Rolling Dynamics under Wave Excitement Force Composed of Sums of Cosine Functions

The ship motion equation with a cosine wave excitement force describes the slip moments in regular waves. A new kind of wave excitement force model, with the form as sums of cosine functions was proposed to describe ship rolling in irregular waves. Ship rolling time series were obtained by solving the ship motion equation with the fourth-order-Runger-Kutta method. These rolling time series were synthetically analyzed with methods of phase-space track, power spectrum, primary component analysis, and the largest Lyapunove exponent. Simulation results show that ship rolling presents some chaotic characteristic when the wave excitement force was applied by sums of cosine functions. The result well explains the course of ship rolling's chaotic mechanism and is useful for ship hydrodynamic study.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Preserving correlations between trajectories for efficient path sampling

Importance sampling of trajectories has proved a uniquely successful strategy for exploring rare dynamical behaviors of complex systems in an unbiased way. Carrying out this sampling, however, requires an ability to propose changes to dynamical pathways that are substantial, yet sufficiently modest to obtain reasonable acceptance rates. Satisfying this requirement becomes very challenging in the case of long trajectories, due to the characteristic divergences of chaotic dynamics. Here, we examine schemes for addressing this problem, which engineer correlation between a trial trajectory and its reference path, for instance using artificial forces. Our analysis is facilitated by a modern perspective on Markov chain Monte Carlo sampling, inspired by non-equilibrium statistical mechanics, which clarifies the types of sampling strategies that can scale to long trajectories. Viewed in this light, the most promising such strategy guides a trial trajectory by manipulating the sequence of random numbers that advance its stochastic time evolution, as done in a handful of existing methods. In cases where this “noise guidance” synchronizes trajectories effectively, as the Glauber dynamics of a two-dimensional Ising model, we show that efficient path sampling can be achieved for even very long trajectories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Similarity of capacitive radio-frequency discharges in nonlocal regimes

Similarity transformations are essential for correlating discharges at different scales, which are mostly utilized with local field or local energy approximations. In this work, we report the fully kinetic results from particle-in-cell/Monte Carlo collision simulations that unambiguously demonstrate the similarity of radio frequency (rf) discharges in nonlocal regimes where the electron energy relaxation length is much larger than the gap dimension. It is found that at a constant rf voltage amplitude, discharges will be similar if the gas pressure, inverse of gap distance, and rf driving frequency are all changed by the same scaling factor. The scaling relations of fundamental parameters are illustrated for rf discharges in the alpha-mode with secondary electron emission ignored, and the temporal electron kinetics are shown to have invariance in similar discharges. The results explicitly validate the scaling laws in nonlocal kinetic regimes, indicating promising application potentials of the similarity transformations across a wide range of kinetic regimes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Constructing Surrogate Models of Complex Systems with Enhanced Sparsity: Quantifying the influence of conformational uncertainty in biomolecular solvation

Biomolecules exhibit conformational fluctuations near equilibrium states, inducing uncertainty in various biological properties in a dynamic way. We have developed a general method to quantify the uncertainty of target properties induced by conformational fluctuations. Using a generalized polynomial chaos (gPC) expansion, we construct a surrogate model of the target property with respect to varying conformational states. We also propose a method to increase the sparsity of the gPC expansion by defining a set of conformational “active space” random variables. With the increased sparsity, we employ the compressive sensing method to accurately construct the surrogate model. We demonstrate the performance of the surrogate model by evaluating fluctuation-induced uncertainty in solvent-accessible surface area for the bovine trypsin inhibitor protein system and show that the new approach offers more accurate statistical information than standard Monte Carlo approaches. Further more, the constructed surrogate model also enables us to directly evaluate the target property under various conformational states, yielding a more accurate response surface than standard sparse grid collocation methods. In particular, the new method provides higher accuracy in high-dimensional systems, such as biomolecules, where sparse grid performance is limited by the accuracy of the computed quantity of interest. Our new framework is generalizable and can be used to investigate the uncertainty of a wide variety of target properties in biomolecular systems.

coarse graining↗

Disconnected Hadronic Vacuum Polarization Contribution to the Muon g-2 with HISQ

We describe a computation of the contribution to the anomalous magnetic moment of the muon from the disconnected part of the hadronic vacuum polarization. We use the highly-improved staggered quark (HISQ) formulation for the current density with gauge configurations generated with four flavors of HISQ sea quarks. The computation is performed by stochastic estimation of the current density using the truncated solver method combined with deflation of low-modes. The parameters are tuned to minimize the computational cost for a given target uncertainty in the current-current correlation function. The calculation presented here is carried out on a single gauge-field ensemble of size $32^3\times48$ with an approximate lattice spacing of $\sim0.15$ fm and with physical sea-quark masses. We describe the methodology and the analysis procedure

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗