Modeling fast diffusion processes in time integration of stiff stochastic differential equations.
Abstract not provided.
Han, Xiaoying↗
SEARCH · Engineering Papers
Results for “Stochastic differential equations”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Numerically modeling stochastic inflation in slow-roll and beyond
In this work, we present a complete numerical treatment of inflationary dynamics under the influence of stochastic corrections from sub-Hubble modes. We discuss how to exactly model the stochastic noise terms arising from the sub-Hubble quantum modes that give rise to the coarse-grained inflaton dynamics in the form of stochastic differential equations. The stochastic differential equations are solved event by event on a discrete time grid. We then compute the power spectrum of curvature perturbations that can be compared with the power spectrum computed in the traditional fashion using the Mukhanov-Sasaki equation by canonically quantizing the inflaton fluctuations. Our numerical procedure helps us to easily extend the formalism to ultra slow-roll inflation and study the possibility of primordial black hole formation.
79 ASTRONOMY AND ASTROPHYSICS↗
Catalyst: Fast and flexible modeling of reaction networks
We introduce Catalyst.jl, a flexible and feature-filled Julia library for modeling and high-performance simulation of chemical reaction networks (CRNs). Catalyst supports simulating stochastic chemical kinetics (jump process), chemical Langevin equation (stochastic differential equation), and reaction rate equation (ordinary differential equation) representations for CRNs. Through comprehensive benchmarks, we demonstrate that Catalyst simulation runtimes are often one to two orders of magnitude faster than other popular tools. More broadly, Catalyst acts as both a domain-specific language and an intermediate representation for symbolically encoding CRN models as Julia-native objects. This enables a pipeline of symbolically specifying, analyzing, and modifying CRNs; converting Catalyst models to symbolic representations of concrete mathematical models; and generating compiled code for numerical solvers. Leveraging ModelingToolkit.jl and Symbolics.jl, Catalyst models can be analyzed, simplified, and compiled into optimized representations for use in numerical solvers. Finally, we demonstrate Catalyst’s broad extensibility and composability by highlighting how it can compose with a variety of Julia libraries, and how existing open-source biological modeling projects have extended its intermediate representation.
59 BASIC BIOLOGICAL SCIENCES↗
Stochastic partial differential equations in turbulence related problems
The theory of stochastic partial differential equations (PDEs) and problems relating to turbulence are discussed by employing the theories of Brownian motion and diffusion in infinite dimensions, functional differential equations, and functional integration. Relevant results in probablistic analysis, especially Gaussian measures in function spaces and the theory of stochastic PDEs of Ito type, are taken into account. Linear stochastic PDEs are analyzed through linearized Navier-Stokes equations with a random forcing. Stochastic equations for waves in random media as well as model equations in turbulent transport theory are considered. Markovian models in fully developed turbulence are discussed from a stochastic equation viewpoint.
Chow, P.-L.↗
A Probabilistic Scheme for Semilinear Nonlocal Diffusion Equations with Volume Constraints
This work presents a probabilistic scheme for solving semilinear nonlocal diffusion equations with volume constraints and integrable kernels. The nonlocal model of interest is defined by a time-dependent semilinear partial integro-differential equation (PIDE), in which the integro-differential operator consists of both local convection-diffusion and nonlocal diffusion operators. Here, our numerical scheme is based on the direct approximation of the nonlinear Feynman–Kac formula that establishes a link between nonlinear PIDEs and stochastic differential equations. The exploitation of the Feynman–Kac representation avoids solving dense linear systems arising from nonlocal operators. Compared with existing stochastic approaches, our method can achieve first-order convergence after balancing the temporal and spatial discretization errors, which is a significant improvement of existing probabilistic/stochastic methods for nonlocal diffusion problems. Error analysis of our numerical scheme is established. The effectiveness of our approach is shown in two numerical examples. The first example considers a three-dimensional nonlocal diffusion equation to numerically verify the error analysis results. The second example presents a physics problem motivated by the study of heat transport in magnetically confined fusion plasmas.
97 MATHEMATICS AND COMPUTING↗
A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions
In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.
97 MATHEMATICS AND COMPUTING↗
Uncertainty Quantification of Geophysical Inversion Using Stochastic Partial Differential Equations (LDRD #218329)
This report summarizes work completed under the Laboratory Directed Research and Development (LDRD) project "Uncertainty Quantification of Geophysical Inversion Using Stochastic Differential Equations." Geophysical inversions often require computationally expensive algorithms to find even one solution, let alone propagating uncertainties through to the solution domain. The primary purpose of this project was to find more computationally efficient means to approximate solution uncertainty in geophysical inversions. We found multiple computationally efficient methods of propagating Earth model uncertainty into uncertainties in solutions of full waveform seismic moment tensor inversions. However, the optimum method of approximating the uncertainty in these seismic source solutions was to use the Karhunen-Love theorem with data misfit residuals. This method was orders of magnitude more computationally efficient than traditional Monte Carlo methods and yielded estimates of uncertainty that closely approximated those of Monte Carlo. We will summarize the various methods we evaluated for estimating uncertainty in seismic source inversions as well as work toward this goal in the realm of 3-D seismic tomographic inversion uncertainty.
58 GEOSCIENCES↗
On the stability of processes defined by stochastic difference-differential equations.
Stability of stochastic processes defined by difference differential equations, noting properties of solution, weak infinitesimal operator, etc
Kushner, H. J.↗
On the stability of processes defined by stochastic difference-differential equations
Stability of processes defined by stochastic difference and differential equations
DIFFERENCE EQUATION↗
Hierarchical Gaussian Random Field Sampling for Multilevel Markov Chain Monte Carlo: Coupling Stochastic Partial Differential Equation and the Karhunen–Loève Decomposition
This work introduces structure preserving hierarchical decompositions for sampling Gaussian random fields (GRFs) within the context of multilevel Bayesian inference in high-dimensional space. Existing scalable hierarchical sampling methods, such as those based on stochastic partial differential equations (SPDEs), often reduce the dimensionality of the sample space at the cost of accuracy of inference. Other approaches, such that those based on Karhunen-Loève (KL) expansions, offer sample space dimensionality reduction but sacrifice GRF representation accuracy and ergodicity of the Markov chain Monte Carlo (MCMC) sampler and are computationally expensive for high-dimensional problems. The proposed method integrates the dimensionality reduction capabilities of KL expansions with the scalability of SPDE-based sampling, thereby providing a robust, unified framework for high-dimensional uncertainty quantification (UQ) that is scalable and accurate, preserves ergodicity, and offers dimensionality reduction of the sample space. The hierarchy in our multilevel algorithm is derived from the geometric multigrid hierarchy. By constructing a hierarchical decomposition that maintains the covariance structure across the levels in the hierarchy, the approach enables efficient coarse-to-fine sampling while ensuring that all samples are drawn from the desired distribution. The effectiveness of the proposed method is demonstrated on a benchmark subsurface flow problem, demonstrating its effectiveness in improving computational efficiency and statistical accuracy. Furthermore, our proposed technique is more efficient and accurate and displays better convergence properties than existing methods for high-dimensional Bayesian inference problems.
Gaussian random fields↗
A backward SDE method for uncertainty quantification in deep learning
Here, we develop a backward stochastic differential equation based probabilistic machine learning method, which formulates a class of stochastic neural networks as a stochastic optimal control problem. An efficient stochastic gradient descent algorithm is introduced with the gradient computed through a backward stochastic differential equation. Convergence analysis for stochastic gradient descent optimization and numerical experiments for applications of stochastic neural networks are carried out to validate our methodology in both theory and performance.
97 MATHEMATICS AND COMPUTING↗
A new approach to the formulation of scalar flux closure
This report shows that if a stochastic differential equation (Langevin equation) for velocity fluctuation vector is known, it is possible to derive the equations for scalar flux transport. Durbin and Speziale (1994) showed that the second moment of this stochastic differential equation gives an equation for the evolution of Reynolds stress tensor. Similarly, the stochastic equation will give an equation for scalar flux. Therefore, a coupling between these two is present. The basis for the present work is that there should be Langevin equations that can produce acceptable models for both the Reynolds stress tensor and the scalar flux vector. Having found this basic Langevin equation, the amount of work needed to model the second order closure problems is reduced; using the well developed models for Reynolds stress equations, it will be possible to derive corresponding models for scalar flux equation.
Shabany, Y.↗
Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker–Planck Equations
The Fokker-Planck (FP) equation is a foundational partial differential equation (PDE) in stochastic processes involving Brownian motions. However, the curse of dimensionality (CoD) poses a formidable challenge when dealing with high-dimensional FP equations. Although Monte Carlo simulation and (vanilla) Physics-Informed Neural Networks (PINNs) have shown the potential to tackle CoD, both methods exhibit significant numerical errors in high dimensions when dealing with the probability density function (PDF) associated with Brownian motion. The point-wise PDF values tend to decrease exponentially as dimensionality increases, surpassing the precision of numerical simulations and resulting in substantial errors. In addition, due to its massive sampling, Monte Carlo fails to offer fast sampling. Modeling the logarithm likelihood (LL) via vanilla PINNs transforms the FP equation into a notoriously difficult Hamilton-Jacobi-Bellman (HJB) equation, which is impractical for PINN learning, whose error grows rapidly with dimension. To this end, we propose a novel approach utilizing a score-based solver to fit the score function in stochastic differential equations (SDEs). The score function, defined as the gradient of the LL, plays a fundamental role in inferring LL and PDF and enables fast SDE sampling, offering an effective means to overcome the CoD. Three fitting methods, Score Matching (SM), Sliced Score Matching (SSM), and Score-PINN, are introduced, each contributing unique advantages in computational complexity, accuracy, and generality. The proposed score-based SDE solver operates in two stages: first, employing score matching or Score-PINN to acquire the score function; and second, solving the LL via an ordinary differential equation (ODE) using the obtained score function. Comparative evaluations across these methods showcase varying trade-offs. The proposed methodology is evaluated across diverse SDEs, including anisotropic Ornstein-Uhlenbeck processes, geometric Brownian motion, and Brownian motion with varying eigenspace. We also test various distributions, including Gaussian, Log-normal, Laplace, and Cauchy distributions. The numerical results demonstrate the score-based SDE solver’s stability, speed, and performance across different experimental settings, solidifying its potential as a solution to CoD for high-dimensional FP equations.
97 MATHEMATICS AND COMPUTING↗
Preserving nonlinear constraints in variational flow filtering data assimilation
Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.
97 MATHEMATICS AND COMPUTING↗
Stochastic Perturbations of Stable Dynamical Systems: Trajectory-Wise Approach
We study stochastic perturbations of a dynamical system with a locally stable fixed point. The perturbed system has the form of Ito stochastic differential equations. We assume that perturbations do not vanish at the equilibrium of the deterministic system. Using the approach based on consideration of trajectories to the analysis of stochastic differential equations, we find restrictions for perturbations under which the stability of the equilibrium is preserved with probability 1.
97 MATHEMATICS AND COMPUTING↗
Numerical analysis of a time discretized method for nonlinear filtering problem with Lévy process observations
Abstract In this paper, we consider a nonlinear filtering model with observations driven by correlated Wiener processes and point processes. We first derive a Zakai equation whose solution is an unnormalized probability density function of the filter solution. Then, we apply a splitting-up technique to decompose the Zakai equation into three stochastic differential equations, based on which we construct a splitting-up approximate solution and prove its half-order convergence. Furthermore, we apply a finite difference method to construct a time semi-discrete approximate solution to the splitting-up system and prove its half-order convergence to the exact solution of the Zakai equation. Finally, we present some numerical experiments to demonstrate the theoretical analysis.
Mathematics↗
Proton Acceleration in Low- β Magnetic Reconnection with Energetic Particle Feedback
Magnetic reconnection regions in space and astrophysics are known as active particle acceleration sites. There is ample evidence showing that energetic particles can take a substantial amount of converted energy during magnetic reconnection. However, there has been a lack of studies understanding the backreaction of energetic particles at magnetohydrodynamical scales in magnetic reconnection. To address this, we have developed a new computational method to explore the feedback by nonthermal energetic particles. This approach considers the backreaction from these energetic particles by incorporating their pressure into magnetohydrodynamics (MHD) equations. The pressure of the energetic particles is evaluated from their distribution evolved through Parker's transport equation, solved using stochastic differential equations (SDEs), so we coin the name MHD-SDE. Applying this method to low-β magnetic reconnection simulations, we find that reconnection is capable of accelerating a large fraction of energetic particles that contain a substantial amount of energy. When the feedback from these particles is included, their pressure suppresses the compression structures generated by magnetic reconnection, thereby mediating particle energization. Consequently, the feedback from energetic particles results in a steeper power-law energy spectrum. These findings suggest that feedback from nonthermal energetic particles plays a crucial role in magnetic reconnection and particle acceleration.
79 ASTRONOMY AND ASTROPHYSICS↗
Random operator equations in mathematical physics. I
Stochastic differential equations objectives, limitations and restrictive assumptions in physical problems, discussing electromagnetic wave propagation in random continuum or random dAlembertian operator
Adomian, G.↗