Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Time-dependent behavior of active galactic nuclei with pair production

We study the properties of coupled partial differential equations describing the time-dependent behavior of the photon and electron occupation numbers for conditions likely to be found near active galactic nuclei (AGN). The processes governing electron acceleration are modeled by a stochastic accelerator, and we include acceleration by Alfvenic and whistler turbulence. The acceleration of electrons is limited by Compton and synchrotron losses, and the number density of electrons depends on pair production and annihilation processes. We also treat particle escape from the system. We examine the steady, (possibly) oscillatory, and unstable solutions that arise for various choices of parameters. We examine instabilities related to pair production and trapping and consider the formation of pair jets.

Li, H.↗

Stochastic Simulation of Mudcrack Damage Formation in an Environmental Barrier Coating

The FEAMAC/CARES program, which integrates finite element analysis (FEA) with the MAC/GMC (Micromechanics Analysis Code with Generalized Method of Cells) and the CARES/Life (Ceramics Analysis and Reliability Evaluation of Structures / Life Prediction) programs, was used to simulate the formation of mudcracks during the cooling of a multilayered environmental barrier coating (EBC) deposited on a silicon carbide substrate. FEAMAC/CARES combines the MAC/GMC multiscale micromechanics analysis capability (primarily developed for composite materials) with the CARES/Life probabilistic multiaxial failure criteria (developed for brittle ceramic materials) and Abaqus (Dassault Systèmes) FEA. In this report, elastic modulus reduction of randomly damaged finite elements was used to represent discrete cracking events. The use of many small-sized low-aspect-ratio elements enabled the formation of crack boundaries, leading to development of mudcrack-patterned damage. Finite element models of a disk-shaped three-dimensional specimen and a twodimensional model of a through-the-thickness cross section subjected to progressive cooling from 1,300 °C to an ambient temperature of 23 °C were made. Mudcrack damage in the coating resulted from the buildup of residual tensile stresses between the individual material constituents because of thermal expansion mismatches between coating layers and the substrate. A two-parameter Weibull distribution characterized the coating layer stochastic strength response and allowed the effect of the Weibull modulus on the formation of damage and crack segmentation lengths to be studied. The spontaneous initiation of cracking and crack coalescence resulted in progressively smaller mudcrack cells as cooling progressed, consistent with a fractal-behaved fracture pattern. Other failure modes such as delamination, and possibly spallation, could also be reproduced. The physical basis assumed and the heuristic approach employed, which involves a simple stochastic cellular automaton methodology to approximate the crack growth process, are described. The results ultimately show that a selforganizing mudcrack formation can derive from a Weibull distribution that is used to describe the stochastic strength response of the bulk brittle ceramic material layers of an EBC.

Nemeth, Noel N.↗

On Transfer Learning Of Neural Networks Using Bi-Fidelity Data For Uncertainty Propagation

Due to their high degree of expressiveness, neural networks have recently been used as surrogate models for mapping inputs of an engineering system to outputs of interest. Once trained, neural networks are computationally inexpensive to evaluate and remove the need for repeated evaluations of computationally expensive models in uncertainty quantification applications. However, given the highly parameterized construction of neural networks, especially deep neural networks, accurate training often requires large amounts of simulation data that may not be available in the case of computationally expensive systems. In this paper, to alleviate this issue for uncertainty propagation, we explore the application of transfer learning techniques using training data generated from both high- and low-fidelity models. We explore two strategies for coupling these two datasets during the training procedure, namely, the standard transfer learning and the bi-fidelity-weighted learning. In the former approach, a neural network model mapping the inputs to the outputs of interest is trained based on the low-fidelity data. The high-fidelity data are then used to adapt the parameters of the upper layer(s) of the low-fidelity network, or train a simpler neural network to map the output of the low-fidelity network to that of the high-fidelity model. In the latter approach, the entire low-fidelity network parameters are updated using data generated via a Gaussian process model trained with a small high-fidelity dataset. The parameter updates are performed via a variant of stochastic gradient descent with learning rates given by the Gaussian process model. Using three numerical examples, we illustrate the utility of these bi-fidelity transfer learning methods where we focus on accuracy improvement achieved by transfer learning over standard training approaches.

97 MATHEMATICS AND COMPUTING↗

Nucleation-mediated reshaping of facetted metallic nanocrystals: Breakdown of the classical free energy picture

Shape stability is key to avoiding degradation of performance for metallic nanocrystals synthesized with facetted non-equilibrium shapes to optimize properties for catalysis, plasmonics, and so on. Reshaping of facetted nanocrystals is controlled by the surface diffusion-mediated nucleation and growth of new outer layers of atoms. Here, Kinetic Monte Carlo (KMC) simulation of a realistic stochastic atomistic-level model is applied to precisely track the reshaping of Pd octahedra and nanocubes. Unexpectedly, separate constrained equilibrium Monte Carlo analysis of the free energy profile during reshaping reveals a fundamental failure of the classical nucleation theory (CNT) prediction for the reshaping barrier and rate. Why? Nucleation barriers can be relatively low for these processes, so the system is not locally equilibrated before crossing the barrier, as assumed in CNT. This claim is supported by an analysis of a first-passage problem for reshaping within a master equation framework for the model that reasonably captures the behavior in KMC simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Requirements for theoretical models of outflows

Recent observational and theoretical investigations of astrophysical mass outflows are reviewed, with a focus on the basic physical principles. Specific limitations on the observational data and their interpretation are listed and discussed. Modeling problems considered include the role of the critical point in determining the mass-loss rate and terminal velocity, the physical processes controlling density at the critical point, the possible coexistence of multiple mass-loss mechanisms, time scales, instabilities and phase changes, multiphase atmospheres and winds, the definition of geometries, the role of the environment, explosive transient events, stochastic phenomena, mode-mode coupling and damping processes, departures from ionization equilibrium, and nonthermal phenomena.

Linsky, Jeffrey L.↗

Fast and Universal Kohn-Sham Density Functional Theory Algorithm for Warm Dense Matter to Hot Dense Plasma

Understanding many processes, e.g., fusion experiments, planetary interiors, and dwarf stars, depends strongly on microscopic physics modeling of warm dense matter and hot dense plasma. This complex state of matter consists of a transient mixture of degenerate and nearly free electrons, molecules, and ions. This regime challenges both experiment and analytical modeling, necessitating predictive ab initio atomistic computation, typically based on quantum mechanical Kohn-Sham density functional theory (KS-DFT). However, cubic computational scaling with temperature and system size prohibits the use of DFT through much of the warm dense matter regime. A recently developed stochastic approach to KS-DFT can be used at high temperatures, with the exact same accuracy as the deterministic approach, but the stochastic error can converge slowly and it remains expensive for intermediate temperatures (< 50 eV). Here we have developed a universal mixed stochastic-deterministic algorithm for DFT at any temperature. This approach leverages the physics of KS-DFT to seamlessly integrate the best aspects of these different approaches. We demonstrate that this method significantly accelerated self-consistent field calculations for temperatures from 3 to 50 eV, while producing stable molecular dynamics and accurate diffusion coefficients.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quasi-Stochastic Approximation and Off-Policy Reinforcement Learning: Preprint

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning and often an efficient approach to solving (or approximating the solution to) complex optimal control problems. In many cases, however, practitioners are unable to apply these techniques because of an inherent high variance. This paper aims to provide a general foundation for 'quasi-stochastic approximation,' in which all of the processes under consideration are deterministic, much like quasi-Monte Carlo for variance reduction in simulation. The variance reduction can be substantial, subject to tuning of pertinent parameters in the algorithm. This paper introduces a new coupling argument to establish the optimal rate of convergence provided the gain is sufficiently large. These results are established for linear models and tested also in nonideal settings. A major application of these general results is a new class of reinforcement learning algorithms for deterministic state space models. In this setting, the main contribution is a class of algorithms for approximating the value function for a given policy, using a different policy designed to introduce exploration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

TOF-SIMS analysis of decoherence sources in superconducting qubits

Superconducting qubits have emerged as a potentially foundational platform technology for addressing complex computational problems deemed intractable with classical computing. Despite recent advances enabling multiqubit designs that exhibit coherence lifetimes on the order of hundreds of μs, material quality and interfacial structures continue to curb device performance. Two-level system defects in the thin superconducting film and adjacent dielectric regions introduce stochastic noise and dissipate electromagnetic energy at the cryogenic operating temperatures. In this study, we utilize time-of-flight secondary ion mass spectrometry to understand the role specific fabrication procedures play in introducing such dissipation mechanisms in these complex systems. We interrogated Nb thin films and transmon qubit structures fabricated through slight modifications in the processing and vacuum conditions. We find that when the Nb film is sputtered onto the Si substrate, oxide and silicide regions are generated at various interfaces. We also observe that impurity species, such as niobium hydrides and carbides, are incorporated within the niobium layer during the subsequent lithographic patterning steps. The formation of these resistive compounds likely impacts the superconducting properties of the Nb thin film. Additionally, we observe the presence of halogen species distributed throughout the patterned thin films. We conclude by hypothesizing the source of such impurities in these structures in an effort to intelligently fabricate superconducting qubits and extend coherence times moving forward.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Probability Density Function Control of Frequency Fluctuations in Renewable-Rich Power Systems

The stochastic nature of renewable energy sources (RESs) necessitates treating power system frequency response as a random process with a nonstationary probability density function (PDF). Here, based upon the stochastic distribution control theory originated by the second author, this paper proposes a novel stochastic controller to improve the frequency PDF in power grids when integrating a large amount of RESs, thereby minimizing the effects of uncertainties and enhancing overall system stability. The key idea is to manipulate the controllable power generation resources so that the frequency PDF is make to follow a target PDF by using the stochastic distribution control theory originated by the second author. The proposed method can easily be plugged into existing automatic generation controls for multi-area transmission grids. The proposed method is validated via a modified Kundar's two area system and 240-bus Western Electricity Coordinating Council systems. The simulation results show that the proposed control shapes the frequency PDF narrower and sharper, leading to a notable improvement toward minimizing the effects of randomness and uncertainty during grid operation.

frequency↗

Utilizing remote sensing of thematic mapper data to improve our understanding of estuarine processes and their influence on the productivity of estuarine-dependent fisheries

A stochastic spatial computer model addressing coastal resource problems in Lousiana is being refined and validated using thematic mapper (TM) imagery. The TM images of brackish marsh sites were processed and data were tabulated on spatial parameters from TM images of the salt marsh sites. The Fisheries Image Processing Systems (FIPS) was used to analyze the TM scene. Activities were concentrated on improving the structure of the model and developing a structure and methodology for calibrating the model with spatial-pattern data from the TM imagery.

Browder, Joan A.↗

Automated Flight Routing Using Stochastic Dynamic Programming

Airspace capacity reduction due to convective weather impedes air traffic flows and causes traffic congestion. This study presents an algorithm that reroutes flights in the presence of winds, enroute convective weather, and congested airspace based on stochastic dynamic programming. A stochastic disturbance model incorporates into the reroute design process the capacity uncertainty. A trajectory-based airspace demand model is employed for calculating current and future airspace demand. The optimal routes minimize the total expected traveling time, weather incursion, and induced congestion costs. They are compared to weather-avoidance routes calculated using deterministic dynamic programming. The stochastic reroutes have smaller deviation probability than the deterministic counterpart when both reroutes have similar total flight distance. The stochastic rerouting algorithm takes into account all convective weather fields with all severity levels while the deterministic algorithm only accounts for convective weather systems exceeding a specified level of severity. When the stochastic reroutes are compared to the actual flight routes, they have similar total flight time, and both have about 1% of travel time crossing congested enroute sectors on average. The actual flight routes induce slightly less traffic congestion than the stochastic reroutes but intercept more severe convective weather.

Ng, Hok K.↗

Strong Evidence for Stochastic Growth of Langmuir-Like Waves in Earth's Foreshock

Bursty Langmuir-like waves driven by electron beams in Earth's foreshock have properties which are inconsistent with the standard plasma physics paradigm of uniform exponential growth saturated by nonlinear processes. Here it is demonstrated for a specific period that stochastic growth theory (SGT) quantitatively describes these waves throughout a large fraction of the foreshock. The statistical wave properties are inconsistent with nonlinear processes or self-organized criticality being important. SGT's success in explaining the foreshock waves and type III solar bursts suggests that SGT is widely applicable to wave growth in space, astrophysical, and laboratory plasmas.

Cairns, Iver H.↗

Stochastically estimated covariance matrices for independent and cumulative fission yields in the ENDF/B-VIII.0 and JEFF-3.3 evaluations

A Monte-Carlo method for the generation of correlation and covariance matrices for independent and cumulative fission yields has been developed. The method uses a constrained Monte-Carlo resampling structure in order to vary evaluated fission yield libraries in a way that meets basic conservation principles. This results in the generation of correlation/covariance matrices with limited model bias and uncertainty; the matrices are primarily reflective of the evaluated fission yield uncertainties and correlations that arise from the evaluation process. This method has been applied to generate correlation and covariance matrices for all of the fissioning systems of the ENDF/B-VIII.0 and JEFF-3.3 evaluations, marking the first time such matrices have been generated for all of these systems. These covariance matrices have been published online for immediate public use. These correlation and covariance matrices can be used to improve uncertainty estimation in calculations of reactor antineutrino emission rates, decay heat problems, and nuclear forensics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Estimation of correlation functions by stochastic approximation.

Consideration of the autocorrelation function of a zero-mean stationary random process. The techniques are applicable to processes with nonzero mean provided the mean is estimated first and subtracted. Two recursive techniques are proposed, both of which are based on the method of stochastic approximation and assume a functional form for the correlation function that depends on a number of parameters that are recursively estimated from successive records. One technique uses a standard point estimator of the correlation function to provide estimates of the parameters that minimize the mean-square error between the point estimates and the parametric function. The other technique provides estimates of the parameters that maximize a likelihood function relating the parameters of the function to the random process. Examples are presented.

Habibi, A.↗

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗

Revealing melt flow instabilities in laser powder bed fusion additive manufacturing of aluminum alloy via in-situ high-speed X-ray imaging

Laser metal additive manufacturing technologies enable the fabrication of geometrically and compositionally complex parts unachievable by conventional manufacturing methods. However, the certification and qualification of additively manufactured parts are greatly hindered by the stochastic melt flow instabilities intrinsic to the process, which has not been explicitly revealed by direct observation. Here, we report the mechanisms of the melt flow instabilities in laser powder bed fusion additive manufacturing process revealed by in-situ high-speed high-resolution synchrotron X-ray imaging. Here we identified powder/droplet impact, significant keyhole oscillation, and melting-mode switching as three major mechanisms for causing melt flow instabilities. We demonstrated the detrimental consequences of these instabilities brought to the process, and presented new understanding on the melt flow evolution and keyhole oscillation. This work provides critical insights into process instabilities during laser metal additive manufacturing, which may guide the development of instability mitigation approaches. The results reported here are also important for the development and validation of high-fidelity computational models.

36 MATERIALS SCIENCE↗

Diffusion Probabilistic Modeling for Video Generation

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual and probabilistic forecasting metrics. We propose an autoregressive, end-to-end optimized video diffusion model inspired by recent advances in neural video compression. The model successively generates future frames by correcting a deterministic next-frame prediction using a stochastic residual generated by an inverse diffusion process. We compare this approach against six baselines on four datasets involving natural and simulation-based videos. We find significant improvements in terms of perceptual quality and probabilistic frame forecasting ability for all datasets.

97 MATHEMATICS AND COMPUTING↗