Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Latent Stochastic Differential Equations for Modeling Quasar Variability and Inferring Black Hole Properties

Quasars are bright and unobscured active galactic nuclei (AGN) thought to be powered by the accretion of matter around supermassive black holes at the centers of galaxies. The temporal variability of a quasar’s brightness contains valuable information about its physical properties. The UV/optical variability is thought to be a stochastic process, often represented as a damped random walk described by a stochastic differential equation (SDE). Upcoming wide-field telescopes such as the Rubin Observatory Legacy Survey of Space and Time (LSST) are expected to observe tens of millions of AGN in multiple filters over a ten year period, so there is a need for efficient and automated modeling techniques that can handle the large volume of data. Latent SDEs are machine learning models well suited for modeling quasar variability, as they can explicitly capture the underlying stochastic dynamics. In this work, we adapt latent SDEs to jointly reconstruct multivariate quasar light curves and infer their physical properties such as the black hole mass, inclination angle, and temperature slope. Our model is trained on realistic simulations of LSST ten year quasar light curves, and we demonstrate its ability to reconstruct quasar light curves even in the presence of long seasonal gaps and irregular sampling across different bands, outperforming a multioutput Gaussian process regression baseline. Our method has the potential to provide a deeper understanding of the physical properties of quasars and is applicable to a wide range of other multivariate time series with missing data and irregular sampling.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Stochastic and deterministic processes shape bioenergy crop microbiomes along a vertical soil niche

Abstract Sustainable biofuel cropping systems aim to address climate change while meeting energy needs. Understanding how soil and plant‐associated microbes respond to these different cropping systems is key to promoting agriculture sustainability and evaluating changes in ecosystem functions. Here, we leverage a long‐term biofuel cropping system field experiment to dissect soil and root microbiome changes across a soil‐depth gradient in poplar, restored prairie and switchgrass to understand their effects on the microbial communities. High throughput amplicon sequencing of the fungal internal transcribed spacer (ITS) and prokaryotic 16S DNA regions showed a common trend of root and soil microbial community richness decreasing and evenness increasing with depth. Ecological niche (root vs. soil) had the strongest effect on community structure, followed by depth, then crop. Stochastic processes dominated the structuring of fungal communities in deeper soil layers while operational taxonomic units (OTUs) in surface soil layers were more likely to co‐occur and to be enriched by plant hosts. Prokaryotic communities were dispersal limited at deeper depths. Microbial networks showed a higher density, connectedness, average degree and module size in deeper soils. We observed a decrease in fungal‐fungal links and an increase of bacteria–bacteria links with increasing depth in all crops, particularly in the root microbiome.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Voltage Probability Density Function Shaping Control Strategy Considering Grid Operational Uncertainties

It is well-known that power systems operation always affected by various uncertainties which make the bus voltage a random process that can be characterized by its probability density function (PDF) at any time instant. In this context, this paper presents a novel PDF-based voltage control framework for power systems. By modeling voltage as a stochastic process, we formulate a stochastic differential equationthat captures grid uncertainties. The associated Fokker-Planck-Kolmogorov equation is derived to describe the evolution of the voltage PDF, which enables the formulation of a PDF-shaping control strategy. To simplify the PDF control formulation, a B-spline neural network is introduced for real-time estimation and regulation of the voltage distribution. The proposed PDF control law updates voltage references for energy storage systems and synchronous generators using real-time PDF measurements and feedback signals. The proposed method is validated on a modified Kundur’s two-area system. Simulation results demonstrate that the controller can significantly improve the voltage stability under stochastic conditions, highlighting its effectiveness in modern inverter-rich grids.

Gui, Yonghao [ORNL] (ORCID:0000000250435534)↗
NASA NTRS2010

Analyzing Non Stationary Processes in Radiometers

The lack of well-developed techniques for modeling changing statistical moments in our observations has stymied the application of stochastic process theory for many scientific and engineering applications. Non linear effects of the observation methodology is one of the most perplexing aspects to modeling non stationary processes. This perplexing problem was encountered when modeling the effect of non stationary receiver fluctuations on the performance of radiometer calibration architectures. Existing modeling approaches were found not applicable; particularly problematic is modeling processes across scales over which they begin to exhibit non stationary behavior within the time interval of the calibration algorithm. Alternatively, the radiometer output is modeled as samples from a sequence random variables; the random variables are treated using a conditional probability distribution function conditioned on the use of the variable in the calibration algorithm. This approach of treating a process as a sequence of random variables with non stationary stochastic moments produce sensible predictions of temporal effects of calibration algorithms. To test these model predictions, an experiment using the Millimeter wave Imaging Radiometer (MIR) was conducted. The MIR with its two black body calibration references was configured in a laboratory setting to observe a third ultra-stable reference (CryoTarget). The MIR was programmed to sequentially sample each of the three references in approximately a 1 second cycle. Data were collected over a six-hour interval. The sequence of reference measurements form an ensemble sample set comprised of a series of three reference measurements. Two references are required to estimate the receiver response. A third reference is used to estimate the uncertainty in the estimate. Typically, calibration algorithms are designed to suppress the non stationary effects of receiver fluctuations. By treating the data sequence as an ensemble collection, it is possible to apply temporal algorithms which exacerbate the non stationary effects. By varying the algorithm, information about the properties of the non stationary receiver fluctuations is obtained. Comparisons of analytical calculations and statistical analysis of data demonstrate impressive agreement.

Racette, Paul↗
NASA NTRS2019

Electron Scattering by Low-frequency Whistler Waves at Earth’s Bow Shock

Electrons are accelerated to nonthermal energies at shocks in space and astrophysical environments. While shock drift acceleration (SDA) has been considered a key process of electron acceleration at Earth’s bow shock, it has also been recognized that SDA needs to be combined with an additional stochastic process to explain the observed power-law energy spectra. Here, we show mildly energetic (∼0.5 keV) electrons are locally scattered (and accelerated while being confined) by magnetosonic-whistler waves within the shock transition layer, especially when the shock angle is large (θ(sub Bn) approximately equal or greater than 70°). When measured by the Magnetospheric Multiscale mission at a high cadence, ∼0.5 keV electron flux increased exponentially in the shock transition layer. However, the flux profile was not entirely smooth and the fluctuation showed temporal/spectral association with large-amplitude (δB/B ~ 0.3), low-frequency (approximately equal or less than 0.1 Ω(sub ce) where Ω(sub ce) is the cyclotron frequency), obliquely propagating (θ(sub kB) ~ 30°–60°, where θ(sub kB) is the angle between the wave vector and background magnetic field) whistler waves, indicating that the particles were interacting with the waves. Particle simulations demonstrate that, although linear cyclotron resonances with ∼0.5 keV electrons are unlikely due to the obliquity and low frequencies of the waves, the electrons are still scattered beyond 90° pitch angle by (1) resonant mirroring (transit-time damping), (2) non-resonant mirroring, and (3) subharmonic cyclotron resonances. Such coupled nonlinear scattering processes are likely to provide the stochasticity needed to explain the power-law formation.

Oka, M.↗
DOE OSTI2017

Stochastic Dynamic Analysis for Power Systems Under Uncertain Variability

This paper proposes a novel method to analyze impacts of uncertain variability on power system dynamics. There is considerable interest in integrating intermittent renewable energy and plug-in electric vehicles into power systems. Therefore, power systems are in an environment with increasing uncertain variability. In this paper, the uncertain variability is described as a continuous-time stochastic process, and thus, the power system under uncertain variability is modeled by stochastic differential equations. To quantify impacts of uncertain variability on power system dynamics, an intra-region probability index is presented. Based on the stochastic averaging method, an analytical method is proposed to calculate the intra-region probability. Compared to Monte Carlo simulation, the proposed method is many orders of magnitude faster without sacrificing the result accuracy. As a result, several insights are given to improve the power system dynamics under uncertain variability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2015

THE BIMODAL STRUCTURE OF THE SOLAR CYCLE

Some properties of the 11 yr solar cycle can be explained by the current solar dynamo models. However, some other features remain not well understood such as the asymmetry of the cycle, the double-peaked structure, and the “Waldmeier effect” that a stronger cycle tends to have less rise time and a shorter cycle length. We speculate that the solar cycle is governed by a bi-dynamo model forming two stochastic processes depicted by a bimodal Gaussian function with a time gap of about 2 yr, from which the above features can be reasonably explained. The first one describes the main properties of the cycle dominated by the current solar dynamo models, and the second one occurs either in the rising phase as a short weak explosive perturbation or in the declining phase as a long stochastic perturbation. The above function is the best one selected from several in terms of the Akaike information criterion. Through analyzing different distributions, one might speculate about the dominant physical process inside the convection zone. The secondary (main) process is found to be closely associated with complicated (simple) active ranges. In effect, the bi-dynamo model is a reduced form of a multi-dynamo model, which could occur from the base of the convection zone through its envelope and from low to high heliographic latitude, reflecting the active belts in the convection zone. These results are insensitive to the hemispheric asymmetry, smoothing filters, and distribution functions selected and are expected to be helpful in understanding the formation of solar and stellar cycles.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Random field optimization

Herein we present a new modeling paradigm for optimization that we call random field optimization. Random fields are a powerful modeling abstraction that aims to capture the behavior of random variables that live on infinite-dimensional spaces (e.g., space and time) such as stochastic processes (e.g., time series, Gaussian processes, and Markov processes), random matrices, and random spatial fields. This paradigm involves sophisticated mathematical objects (e.g., stochastic differential equations and space-time kernel functions) and has been widely used in neuroscience, geoscience, physics, civil engineering, and computer graphics. Despite of this, however, random fields have seen limited use in optimization; specifically, existing optimization paradigms that involve uncertainty (e.g., stochastic programming and robust optimization) mostly focus on the use of finite random variables. This trend is rapidly changing with the advent of statistical optimization (e.g., Bayesian optimization) and multi-scale optimization (e.g., integration of molecular sciences and process engineering). Our work extends a recently-proposed abstraction for infinite-dimensional optimization problems by capturing more general uncertainty representations. Moreover, we discuss solution paradigms for this new class of problems based on finite transformations and sampling, and identify open questions and challenges.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1973

A guidance and navigation system for continuous low thrust vehicles

A midcourse guidance and navigation system for continuous low thrust vehicles is described. A set of orbit elements, known as the equinoctial elements, are selected as the state variables. The uncertainties are modelled statistically by random vector and stochastic processes. The motion of the vehicle and the measurements are described by nonlinear stochastic differential and difference equations respectively. A minimum time nominal trajectory is defined and the equation of motion and the measurement equation are linearized about this nominal trajectory. An exponential cost criterion is constructed and a linear feedback guidance law is derived to control the thrusting direction of the engine. Using this guidance law, the vehicle will fly in a trajectory neighboring the nominal trajectory. The extended Kalman filter is used for state estimation. Finally a short mission using this system is simulated. The results indicate that this system is very efficient for short missions.

Tse, C. J. C.↗
NASA NTRS1973

A guidance and navigation system for continuous low-thrust vehicles

A midcourse guidance and navigation system for continuous low thrust vehicles was developed. The equinoctial elements are the state variables. Uncertainties are modelled statistically by random vector and stochastic processes. The motion of the vehicle and the measurements are described by nonlinear stochastic differential and difference equations respectively. A minimum time trajectory is defined; equations of motion and measurements are linearized about this trajectory. An exponential cost criterion is constructed and a linear feedback quidance law is derived. An extended Kalman filter is used for state estimation. A short mission using this system is simulated. It is indicated that this system is efficient for short missions, but longer missions require accurate trajectory and ground based measurements.

Jack-Chingtse, C.↗
DOE OSTI2025

Microbial community dynamics in the soil-root continuum are linked with plant species turnover during secondary succession

Grazing exclusion and land abandonment are commonly adopted to restore degraded ecosystems in semiarid and arid regions worldwide. However, the temporal variation in the soil- versus root-associated microbiome over plant species turnover during secondary succession has rarely been quantified. Using the chronosequence restored from fenced grassland and abandoned farmlands on the Loess Plateau of China, we characterized the dynamics of the soil- and root-associated microbiome of host plant with different dominance statuses during secondary succession from 0 to 40 years. Our results revealed that the root microhabitat, the host plant and their interactions were the main contributors to the bacterial community shift (R 2 = 15.5%, 8.1%, and 22.3%, respectively), and plant interspecies replacement had a greater effect on the shift in the root-associated microbial community than intraspecies replacement did during succession. The root-associated bacterial community of pioneer plants was particularly responsive to succession, especially the endosphere community. Endosphere microbial diversity was positively correlated with host plant coverage change, and the diversity and abundance of taxon recruitment into the endosphere of pioneer plants from the surrounding environment decreased as succession progressed. The community assembly processes also indicated that the endosphere microbiota are strongly selected in younger host plants, whereas stochastic processes dominate in aged host plants. Our study provides evidence of the unique response of the root-associated microbiome to the replacement of plant species during secondary succession, and the function of endosphere microbes should be considered when studying plant–microbe feedback.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Force-Free Identification of Minimum-Energy Pathways and Transition States for Stochastic Electronic Structure Theories

Here, the accurate mapping of potential energy surfaces (PESs) is crucial to our understanding of the numerous physical and chemical processes mediated by atomic rearrangements, such as conformational changes and chemical reactions, and the thermodynamic and kinetic feasibility of these processes. Stochastic electronic structure theories, e.g., Quantum Monte Carlo (QMC) methods, enable highly accurate total energy calculations that in principle can be used to construct the PES. However, their stochastic nature poses a challenge to the computation and use of forces and Hessians, which are typically required in algorithms for minimum-energy pathway (MEP) and transition state (TS) identification, such as the nudged elastic band (NEB) algorithm and its climbing image formulation. Here, we present strategies that utilize the surrogate Hessian line-search method, previously developed for QMC structural optimization, to efficiently identify MEP and TS structures without requiring force calculations at the level of the stochastic electronic structure theory. By modifying the surrogate Hessian algorithm to operate in path-orthogonal subspaces and at saddle points, we show that it is possible to identify MEPs and TSs by using a force-free QMC approach. We demonstrate these strategies via two examples, the inversion of the ammonia (NH 3 ) molecule and the nucleophilic substitution (S N 2) reaction F – + CH 3 F → FCH 3 + F – . We validate our results using Density Functional Theory (DFT)- and Coupled Cluster (CCSD, CCSD(T))-based NEB calculations. We then introduce a hybrid DFT-QMC approach to compute thermodynamic and kinetic quantities, free energy differences, rate constants, and equilibrium constants that incorporates stochastically optimized structures and their energies, and show that this scheme improves upon DFT accuracy. Our methods generalize straightforwardly to other systems and other high-accuracy theories that similarly face challenges computing energy gradients, paving the way for highly accurate PES mapping, transition state determination, and thermodynamic and kinetic calculations at significantly reduced computational expense.

Iyer, Gopal R.↗
DOE OSTI2019

Forfeiting the priority effect: turnover defines biofilm community succession

Microbial community succession is a fundamental process that affects underlying functions of almost all ecosystems; yet the roles and fates of the most abundant colonizers are often poorly understood. Does early abundance spur long term persistence? How do deterministic and stochastic processes influence the ecological contribution of colonizers? We performed a succession experiment within a hypersaline ecosystem to investigate how different processes contributed to the turnover of founder species. Bacterial and eukaryotic colonizers were identified during primary succession and tracked through a defined, 79-day biofilm maturation period using 16S and 18S rRNA gene sequencing in combination with high resolution imaging that utilized stable isotope tracers to evaluate successional patterns of primary producers and nitrogen fixers. The majority of the founder species did not maintain high abundance throughout succession. Species replacement (versus loss) was the dominant process shaping community succession. We also asked if different ecological processes acted on bacteria versus Eukaryotes during succession and found deterministic and stochastic forces corresponded more with microeukaryote and bacterial colonization, respectively. Our results show that taxa and functions belonging to different kingdoms, which share habitat in the tight spatial confines of a biofilm, were influenced by different ecological processes and time scales of succession.

Brislawn, Colin J.↗
DOE OSTI2018

ISAP-MATLAB Package for Sensitivity Analysis of High-Dimensional Stochastic Chemical Networks

Stochastic simulation and modeling play an important role to elucidate the fundamental mechanisms in complex biochemical networks. The parametric sensitivity analysis of reaction networks becomes a powerful mathematical and computational tool, yielding information regarding the robustness and the identifiability of model parameters. However, due to overwhelming computational cost, parametric sensitivity analysis is a extremely challenging problem for stochastic models with a high-dimensional parameter space and for which existing approaches are very slow. Here we present an information-theoretic sensitivity analysis in path-space (ISAP) MATLAB package that simulates stochastic processes with various algorithms and most importantly implements a gradient-free approach to quantify the parameter sensitivities of stochastic chemical reaction network dynamics using the pathwise Fisher information matrix (PFIM; Pantazis, Katsoulakis, and Vlachos 2013). The sparse, block-diagonal structure of the PFIM makes its computational complexity scale linearly with the number of model parameters. As a result of the gradientfree and the sparse nature of the PFIM, it is highly suitable for the sensitivity analysis of stochastic reaction networks with a very large number of model parameters, which are typical in the modeling and simulation of complex biochemical phenomena. Finally, the PFIM provides a fast sensitivity screening method (Arampatzis, Katsoulakis, and Pantazis 2015) which allows it to be combined with any existing sensitivity analysis software.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Learning stochastic dynamics with statistics-informed neural network

We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by a universal approximation theorem for stochastic systems, which we introduce in this paper, and the projection-operator formalism for stochastic modeling. Here, we devise mechanisms for training the neural network model to reproduce the correct statistical behavior of a target stochastic process. Numerical simulation results demonstrate that a well-trained SINN can reliably approximate both Markovian and non-Markovian stochastic dynamics. We demonstrate the applicability of SINN to coarse-graining problems and the modeling of transition dynamics. Furthermore, we show that the obtained reduced-order model can be trained on temporally coarse-grained data and hence is well suited for rare-event simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. Furthermore, we demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗
NASA NTRS2007

A Black-Scholes Approach to Satisfying the Demand in a Failure-Prone Manufacturing System

The goal of this paper is to use a financial model and a hedging strategy in a systems application. In particular, the classical Black-Scholes model, which was developed in 1973 to find the fair price of a financial contract, is adapted to satisfy an uncertain demand in a manufacturing system when one of two production machines is unreliable. This financial model together with a hedging strategy are used to develop a closed formula for the production strategies of each machine. The strategy guarantees that the uncertain demand will be met in probability at the final time of the production process. It is assumed that the production efficiency of the unreliable machine can be modeled as a continuous-time stochastic process. Two simple examples illustrate the result.

Chavez-Fuentes, Jorge R.↗