Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems

Here, we present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a statistical inference framework that enables the end-to-end training of surrogate models on paired input–output observations that may be stochastic in nature, originate from different information sources of variable fidelity, or be corrupted by complex noise processes. The resulting surrogates can accommodate high-dimensional inputs and outputs and are able to return predictions with quantified uncertainty. Furthermore, the effectiveness our approach is demonstrated through a series of canonical studies, including the regression of noisy data, multi-fidelity modeling of stochastic processes, and uncertainty propagation in high-dimensional dynamical systems.

97 MATHEMATICS AND COMPUTING↗

A preconditioning technique for Schur complement systems arising in stochastic optimization

Deterministic sample average approximations of stochastic programming problems with recourse are suitable for a scenario-based parallelization. In this paper the parallelization is obtained by using an interior-point method and a Schur complement mechanism for the interior-point linear systems. However, the direct linear solves involving the dense Schur complement matrix are expensive, and adversely affect the scalability of this approach. We address this issue by proposing a stochastic preconditioner for the Schur complement matrix and by using Krylov iterative methods for the solution of the dense linear systems. The stochastic preconditioner is built based on a subset of existing scenarios and can be assembled and factorized on a separate process before the computation of the Schur complement matrix finishes on the remaining processes. The expensive factorization of the Schur complement is removed from the parallel execution flow and the scaling of the optimization solver is considerably improved with this approach. The spectral analysis indicates an exponentially fast convergence in probability to 1 of the eigenvalues of the preconditioned matrix with the number of scenarios incorporated in the preconditioner. Numerical experiments performed on the relaxation of a unit commitment problem show good performance, in terms of both the accuracy of the solution and the execution time.

99 GENERAL AND MISCELLANEOUS↗

Stochastic average model methods

We consider the solution of finite-sum minimization problems, such as those appearing in nonlinear least-squares or general empirical risk minimization problems. We are motivated by problems in which the summand functions are computationally expensive and evaluating all summands on every iteration of an optimization method may be undesirable. Here we present the idea of stochastic average model (SAM) methods, inspired by stochastic average gradient methods. SAM methods sample component functions on each iteration of a trust-region method according to a discrete probability distribution on component functions; the distribution is designed to minimize an upper bound on the variance of the resulting stochastic model. We present promising numerical results concerning an implemented variant extending the derivative-free model-based trust-region solver POUNDERS, which we name SAM-POUNDERS.

97 MATHEMATICS AND COMPUTING↗

Observation of spatter-induced stochastic lack-of-fusion in laser powder bed fusion using in situ process monitoring

Material produced via additive manufacturing (AM) continues to exhibit variable mechanical properties despite apparent optimization of processing parameters, inhibiting qualification efforts and limiting use in critical applications. Stochastic lack-of-fusion flaws may help explain this variability, but the origin of these seemingly random defects has to this point remained unclear. In this work, we show that spatter particles, material ejected from the laser melt pool, are directly responsible for generating stochastic lack-of-fusion in laser-based powder bed fusion components through the application of spatial statistics. Herein a statistically significant, causal relationship between spatter particles and stochastic lack-of-fusion is established, and the spatial and morphological relationships between spatter and internal flaws are investigated. The occurrence of spatter-induced lack-of-fusion in relation to the inert gas flow and laser trajectory direction is also investigated, and recommendations for mitigating the occurrence of spatter are evaluated.

36 MATERIALS SCIENCE↗

An air quality index-based multistage type-2-fuzzy interval-stochastic programming model for energy and environmental systems management under multiple uncertainties

Highlights: • A multistage type-2-fuzzy interval-stochastic programming (MTIP) method is developed. • Air quality index (AQI) is introduced to manage energy and environmental systems. • AQI-MTIP model is formulated and results for Tianjin's EES are generated. • Impacts of environmental requirements on energy systems is analyzed. • Results can provide support for making effective pollutant mitigation policy. In this study, a multistage type-2-fuzzy interval-stochastic programming (MTIP) method is developed, which extends upon the existing multistage stochastic programming (MSP) by allowing uncertainties expressed as probabilistic distributions, interval values and type-2 fuzzy sets to be effectively incorporated within the optimization framework. Through coupling air quality index (AQI) with MTIP, an AQI-MTIP model is formulated for energy and environmental systems (EES) management of Tianjin. A number of scenarios based on changed AQIs are examined to analyze the impacts of environmental requirements on the city's energy system. Results indicate that (i) with the improvement of environmental requirement, utilization of clean energies (especially natural gas) is provoked markedly; (ii) PM{sub 2.5} is the primary pollutant, 64.50% of which should be reduced each period to maintain the city's air quality at a health-safe level. These findings can help decision makers adjust energy structure, make effective mitigation strategy, and gain deep insight into the relationship between energy consumption and environmental requirement.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Risk-Averse Bi-Level Stochastic Network Interdiction Model for Cyber-Security Risk Management

Security of cyber networks is crucial; recent severe cyber-attacks have had a devastating effect on many large organizations. The attack graph, which maps the potential attack paths of a cyber network, is a popular tool for analyzing cyber system vulnerability. In this study, we propose a bi-level stochastic network interdiction model on an attack graph to enable a risk-averse, resource constrained cyber network defender to optimally deploy security countermeasures that protect against attackers with an uncertain budget. This risk- averse conditional-value-at-risk (CVaR) model minimizes a weighted sum of the expected maximum loss over all scenarios and the expected maximum loss from the most damaging attack scenarios. We develop a customized constraint and column generation algorithm to solve our model as well as several acceleration techniques to improve the computational efficiency. Numerical experiments demonstrate that the acceleration techniques enable the solution of relatively large problems within a reasonable amount of time: applying all the acceleration techniques also reduces the average computation time of the basic algorithm by 71% for 100-node graphs. Using metrics called mean-risk value of stochastic solution and value of risk-aversion, computational results suggest that our stochastic risk-averse model significantly outperforms deterministic and risk-neutral models when 1) the distribution of attacker budget is heavy-right-tailed and 2) the defender is highly risk-averse.

Bhuiyan, Tanveer H.↗

A retrodictive stochastic simulation algorithm

In this paper we describe a simple method for inferring the initial states of systems evolving stochastically according to master equations, given knowledge of the final states. This is achieved through the use of a retrodictive stochastic simulation algorithm which complements the usual predictive stochastic simulation approach. We demonstrate the utility of this new algorithm by applying it to example problems, including the derivation of likely ancestral states of a gene sequence given a Markovian model of genetic mutation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Hybrid framework for the simulation of stochastic chemical kinetics

Stochasticity plays a fundamental role in various biochemical processes, such as cell regulatory networks and enzyme cascades. Isothermal, well-mixed systems can be modelled as Markov processes, typically simulated using the Gillespie Stochastic Simulation Algorithm (SSA) [25]. While easy to implement and exact, the computational cost of using the Gillespie SSA to simulate such systems can become prohibitive as the frequency of reaction events increases. This has motivated numerous coarse-grained schemes, where the “fast” reactions are approximated either using Langevin dynamics or deterministically. While such approaches provide a good approximation when all reactants are abundant, the approximation breaks down when one or more species exist only in small concentrations and the fluctuations arising from the discrete nature of the reactions become significant. This is particularly problematic when using such methods to compute statistics of extinction times for chemical species, as well as simulating non-equilibrium systems such as cell-cycle models in which a single species can cycle between abundance and scarcity. In this paper, a hybrid jump-diffusion model for simulating well-mixed stochastic kinetics is derived. It acts as a bridge between the Gillespie SSA and the chemical Langevin equation. For low reactant reactions the underlying behaviour is purely discrete, while purely diffusive when the concentrations of all species are large, with the two different behaviours coexisting in the intermediate region. A bound on the weak error in the classical large volume scaling limit is obtained, and three different numerical discretisations of the jump-diffusion model are described. The benefits of such a formalism are illustrated using computational examples.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Itô-SDE MCMC method for Bayesian characterization of errors associated with data limitations in stochastic expansion methods for uncertainty quantification

This paper is concerned with the characterization and the propagation of errors associated with data limitations in polynomial-chaos-based stochastic methods for uncertainty quantification. Such an issue can arise in uncertainty quantification when only a limited amount of data is available. When the available information does not suffice to accurately determine the probability distributions that must be assigned to the uncertain variables, the Bayesian method for assigning these probability distributions becomes attractive because it allows the stochastic model to account explicitly for insufficiency of the available information. In previous work, such applications of the Bayesian method had already been implemented by using the Metropolis–Hastings and Gibbs Markov Chain Monte Carlo (MCMC) methods. In this paper, we present an alternative implementation, which uses an alternative MCMC method built around an Itô stochastic differential equation (SDE) that is ergodic for the Bayesian posterior. We draw together from the mathematics literature a number of formal properties of this Itô SDE that lend support to its use in the implementation of the Bayesian method, and we describe its discretization, including the choice of the free parameters, by using the implicit Euler method. We demonstrate the proposed methodology on a problem of uncertainty quantification in a complex nonlinear engineering application relevant to metal forming.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SDYN-GANs: Adversarial learning methods for multistep generative models for general order stochastic dynamics

We introduce adversarial learning methods for data-driven generative modeling of dynamics of nth-order stochastic systems. Our approach builds on Generative Adversarial Networks (GANs) with generative model classes based on stable m-step stochastic numerical integrators. From observations of trajectory samples, we introduce methods for learning long-time predictors and stable representations of the dynamics. Our approaches use discriminators based on Maximum Mean Discrepancy (MMD), training protocols using both conditional and marginal distributions, and methods for learning dynamic responses over different time-scales. We show how our approaches can be used for modeling physical systems to learn force-laws, damping coefficients, and noise-related parameters. Our adversarial learning approaches provide methods for obtaining stable generative models for dynamic tasks including long-time prediction and developing simulations for stochastic systems.

• Artificial intelligence (AI) / machine learning ↗

Wave-optics modeling of the optical-transport line for passive optical stochastic cooling

Optical stochastic cooling (OSC) is expected to enable fast cooling of dense particle beams. Transition from microwave to optical frequencies enables an achievement of stochastic cooling rates which are orders of magnitude higher than ones achievable with the classical microwave based stochastic cooling systems. A subsystemcritical to the OSC scheme is the focusing optics used to image radiation from the upstream “pickup” undulator to the downstream “kicker” undulator. In this paper, we present simulation results using wave-optics calculation carried out with the Synchrotron Radiation Workshop (SRW). Our simulations are performed in support to a proof-of-principle experiment planned at the Integrable Optics Test Accelerator (IOTA) at Fermilab. The calculations provide an estimate of the energy kick received by a 100-MeV electron as it propagates in the kicker undulator and interacts with the electromagnetic pulse it radiated at an earlier time while traveling through the pickup undulator.

42 ENGINEERING↗

Probabilistic evolution of stochastic dynamical systems: A meso-scale perspective

Stochastic dynamical systems arise naturally across nearly all areas of science and engineering. Typically, a dynamical system model is based on some prior knowledge about the underlying dynamics of interest in which probabilistic features are used to quantify and propagate uncertainties associated with the initial conditions, external excitations, etc. From a probabilistic modeling standing point, two broad classes of methods exist, i.e. macro-scale methods and micro-scale methods. Classically, macro-scale methods such as statistical moments-based strategies are usually too coarse to capture the multi-mode shape or tails of a non-Gaussian distribution. Micro-scale methods such as random samples-based approaches, on the other hand, become computationally very challenging in dealing with high-dimensional stochastic systems. In view of these potential limitations, a meso-scale scheme is proposed here that utilizes a meso-scale statistical structure to describe the dynamical evolution from a probabilistic perspective. The significance of this statistical structure is twofold. First, it can be tailored to any arbitrary random space. Second, it not only maintains the probability evolution around sample trajectories but also requires fewer meso-scale components than the micro-scale samples. To demonstrate the efficacy of the proposed meso-scale scheme, a set of examples of increasing complexity are provided. Connections to the benchmark stochastic models as conservative and Markov models along with practical implementation guidelines are presented.

97 MATHEMATICS AND COMPUTING↗

Forces from Stochastic Density Functional Theory under Nonorthogonal Atom-Centered Basis Sets

We develop a formalism for calculating forces on the nuclei within the linear-scaling stochastic density functional theory (sDFT) in a nonorthogonal atom-centered basis set representation (Fabian et al. Wiley Interdiscip. Rev.: Comput. Mol. Sci. 2019, 9, e1412, 10.1002/wcms.1412) and apply it to the Tryptophan Zipper 2 (Trp-zip2) peptide solvated in water. We use an embedded-fragment approach to reduce the statistical errors (fluctuation and systematic bias), where the entire peptide is the main fragment and the remaining 425 water molecules are grouped into small fragments. We analyze the magnitude of the statistical errors in the forces and find that the systematic bias is of the order of 0.065 eV/Å (~1.2 × 10 -3 E h / a 0 ) when 120 stochastic orbitals are used, independently of system size. This magnitude of bias is sufficiently small to ensure that the bond lengths estimated by stochastic DFT (within a Langevin molecular dynamics simulation) will deviate by less than 1% from those predicted by a deterministic calculation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Determining the N -Representability of a Reduced Density Matrix via Unitary Evolution and Stochastic Sampling

The N-representability problem consists in determining whether, for a given p-body matrix, there exists at least one N-body density matrix from which the p-body matrix can be obtained by contraction, that is, if the given matrix is a p-body reduced density matrix (p-RDM). The knowledge of all necessary and sufficient conditions for a p-body matrix to be N-representable allows the constrained minimization of a many-body Hamiltonian expectation value with respect to the p-body density matrix and, thus, the determination of its exact ground state. However, the number of constraints that complete the N-representability conditions grows exponentially with system size, and hence, the procedure quickly becomes intractable for practical applications. This work introduces a hybrid quantum-stochastic algorithm to effectively replace the N-representability conditions. The algorithm consists of applying to an initial N-body density matrix a sequence of unitary evolution operators constructed from a stochastic process that successively approaches the reduced state of the density matrix on a p-body subsystem, represented by a p-RDM, to a target p-body matrix, potentially a p-RDM. The generators of the evolution operators follow the well-known adaptive derivative-assembled pseudo-Trotter method (ADAPT), while the stochastic component is implemented by using a simulated annealing process. The resulting algorithm is independent of any underlying Hamiltonian, and it can be used to decide whether a given p-body matrix is N-representable, establishing a criterion to determine its quality and correcting it. We apply the proposed hybrid ADAPT algorithm to alleged reduced density matrices from a quantum chemistry electronic Hamiltonian, from the reduced Bardeen–Cooper–Schrieffer model with constant pairing, and from the Heisenberg XXZ spin model. In all cases, the proposed method behaves as expected for 1-RDMs and 2-RDMs, evolving the initial matrices toward different targets.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Substrate-Mediated Evaporation and Stochastic Evolution of Supported Au Nanoparticles

Here, we use in situ transmission electron microscopy with automated tracking to study supported gold nanoparticles (NPs) during high-temperature vacuum annealing. The average mass loss per NP is governed by a flat, nearly size-independent substrate-mediated evaporation profile. On top of this mean shrinkage, individual NPs show significant fluctuations in apparent growth or shrinkage, and NP volume follows a random-walk-like trajectory. To rationalize both the ensemble-mean behavior and the particle-resolved variability, we develop a self-consistent theory that couples substrate-mediated evaporation to collective 2D Ostwald-type mass exchange through a shared adatom field, described in terms of a renormalized screening length and background concentration. In the experimentally relevant regime, the theory predicts an approximately size-independent mean shrinkage rate and clarifies how net mass loss suppresses classical coarsening. Superimposed on this deterministic drift, we quantify stochastic volume trajectories and capture their fluctuation spectrum with a minimal Langevin description consistent with intermittent adatom attachment and detachment events. In addition, we characterize the lateral diffusive motion of NPs, which is responsible for their coalescence. Altogether, our results highlight that stochasticity is intrinsic at the nanoscale and that predicting the evolution of supported NPs at early and intermediate times requires a unified framework combining substrate-mediated evaporation, collective mass exchange, and stochastic fluctuations.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Generation of Tunable Stochastic Sequences Using the Insulator–Metal Transition

Probabilistic computing is a paradigm in which data are not represented by stable bits, but rather by the probability of a metastable bit to be in a particular state. The development of this technology has been hindered by the availability of hardware capable of generating stochastic and tunable sequences of “1s” and “0s”. The options are currently limited to complex CMOS circuitry and, recently, magnetic tunnel junctions. Here, we demonstrate that metal–insulator transitions can also be used for this purpose. We use an electrical pump/probe protocol and take advantage of the stochastic relaxation dynamics in VO 2 to induce random metallization events. A simple latch circuit converts the metallization sequence into a random stream of 1s and 0s. The resetting pulse in between probes decorrelates successive events, providing a true stochastic digital sequence.

97 MATHEMATICS AND COMPUTING↗

Stochastic simulation of pulverized coal (PC) processes

An increasing population and electricity demand in the U.S. require capacity expansion of power systems. The National Energy Technology Laboratory (NETL), U.S. Department of Energy (DOE), has invested considerable efforts on research and development to improve the design and simulation of these power plants. Incorporation of novel process synthesis techniques and realistic simulation methodologies yield optimal flowsheet configurations and accurate estimation of their performance parameters. To provide a better estimation of such performance indicators, simulation models should predict the process behavior based on not only deterministic values of well-known input parameters but also uncertain variables associated with simulation assumptions. In this work, the stochastic simulation of a load-following pulverized coal (PC) power plant takes into account the variation of three input variables, namely, atmospheric air temperature, atmospheric air humidity, and generation load. These uncertain variables are characterized with probability density functions (pdfs) obtained from available atmospheric and electrical energy generation data. The stochastic simulation is carried out by obtaining a sample of values from the pdfs that generates a set of scenarios under which the model is run. An efficient sampling technique [Hammersley sequence sampling (HSS)] guarantees a set of scenarios uniformly distributed throughout the uncertain variable range. Then, each model run generates results on performance parameters as cycle efficiency, carbon emissions, sulfur emissions, and water consumption that are statistically analyzed after all runs are completed. Among these parameters, water consumption is of importance because an increasing demand has been observed mostly in arid regions of the country and, therefore, constrains the operability of the processes. This water consumption is significantly affected by atmospheric uncertainties. The original deterministic process model simulation was designed in Aspen Plus, and a CAPE-OPEN compliant stochastic simulation capability is employed to run the uncertainty analysis. Initially, the influences of atmospheric conditions and load change on the performance parameters are analyzed separately to understand their individual influences on the process, and then their simultaneous variation is analyzed to generate more realistic estimations of the process performance.

97 MATHEMATICS AND COMPUTING↗

Fluorescence Correlation Spectroscopy and Nonlinear Stochastic Reaction-Diffusion

The currently existing theory of fluorescence correlation spectroscopy (FCS) is based on the linear fluctuation theory originally developed by Einstein, Onsager, Lax, and others as a phenomenological approach to equilibrium fluctuations in bulk solutions. For mesoscopic reaction-diffusion systems with nonlinear chemical reactions among a small number of molecules, a situation often encountered in single-cell biochemistry, it is expected that FCS time correlation functions of a reaction-diffusion system can deviate from the classic results of Elson and Magde [Biopolymers (1974) 13:1-27]. We first discuss this nonlinear effect for reaction systems without diffusion. For nonlinear stochastic reaction-diffusion systems there are no closed solutions; therefore, stochastic Monte-Carlo simulations are carried out. We show that the deviation is small for a simple bimolecular reaction; the most significant deviations occur when the number of molecules is small and of the same order. Extending Delbrück-Gillespie’s theory for stochastic nonlinear reactions with rapidly stirring to reaction-diffusion systems provides a mesoscopic model for chemical and biochemical reactions at nanometric and mesoscopic level such as a single biological cell.

Del Razo, Mauricio↗