SEARCH · Engineering Papers

Results for “Differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2025

SPIKANs: separable physics-informed Kolmogorov–Arnold networks

Physics-Informed Neural Networks (PINNs) have emerged as a promising method for solving partial differential equations (PDEs) in scientific computing. While PINNs typically use multilayer perceptrons (MLPs) as their underlying architecture, recent advancements have explored alternative neural network structures. One such innovation is the Kolmogorov–Arnold Network (KAN), which has demonstrated benefits over traditional MLPs, including faster neural scaling and better interpretability. The application of KANs to physics-informed learning has led to the development of Physics-Informed KANs (PIKANs), enabling the use of KANs to solve PDEs. However, despite their advantages, KANs often suffer from slower training speeds, particularly in higher-dimensional problems where the number of collocation points grows exponentially with the dimensionality of the system. To address this challenge, we introduce Separable Physics-Informed Kolmogorov–Arnold Networks (SPIKANs). This novel architecture applies the principle of separation of variables to PIKANs, decomposing the problem such that each dimension is handled by an individual KAN. This approach drastically reduces the computational complexity of training without sacrificing accuracy, facilitating their application to higher-dimensional PDEs. Through a series of benchmark problems, we demonstrate the effectiveness of SPIKANs, showcasing their superior scalability and performance compared to PIKANs and highlighting their potential for solving complex, high-dimensional PDEs in scientific computing.

Kolmogorov-Arnold networks↗

DOE OSTI2022

Implementation of a practical Markov chain Monte Carlo sampling algorithm in PyBioNetFit

Abstract Summary Bayesian inference in biological modeling commonly relies on Markov chain Monte Carlo (MCMC) sampling of a multidimensional and non-Gaussian posterior distribution that is not analytically tractable. Here, we present the implementation of a practical MCMC method in the open-source software package PyBioNetFit (PyBNF), which is designed to support parameterization of mathematical models for biological systems. The new MCMC method, am, incorporates an adaptive move proposal distribution. For warm starts, sampling can be initiated at a specified location in parameter space and with a multivariate Gaussian proposal distribution defined initially by a specified covariance matrix. Multiple chains can be generated in parallel using a computer cluster. We demonstrate that am can be used to successfully solve real-world Bayesian inference problems, including forecasting of new Coronavirus Disease 2019 case detection with Bayesian quantification of forecast uncertainty. Availability and implementation PyBNF version 1.1.9, the first stable release with am, is available at PyPI and can be installed using the pip package-management system on platforms that have a working installation of Python 3. PyBNF relies on libRoadRunner and BioNetGen for simulations (e.g. numerical integration of ordinary differential equations defined in SBML or BNGL files) and Dask.Distributed for task scheduling on Linux computer clusters. The Python source code can be freely downloaded/cloned from GitHub and used and modified under terms of the BSD-3 license (https://github.com/lanl/pybnf). Online documentation covering installation/usage is available (https://pybnf.readthedocs.io/en/latest/). A tutorial video is available on YouTube (https://www.youtube.com/watch?v=2aRqpqFOiS4&t=63s). Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models that includes the Navier–Stokes, Kuramoto–Sivashinsky and Sine–Gordon equations. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that, in general, the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level exceeds a critical threshold σ c . We provide explicit bounds on σ c in the case of Gaussian white noise and we explicitly characterize the spurious terms that arise in the case of trigonometric and/or polynomial libraries. Furthermore, we show that, if the data is suitably denoised (a simple moving average filter is sufficient), then asymptotic consistency is recovered for models with locally-Lipschitz, polynomial-growth nonlinearities. Our results reveal important aspects of weak-form equation learning, which may be used to improve future algorithms. We demonstrate our findings numerically using the Lorenz system, the cubic oscillator, a viscous Burgers-growth model and a Kuramoto–Sivashinsky-type high-order PDE.

asymptotic consistency↗

DOE OSTI2022

Cavitation in a soft porous material

Abstract We study the collapse and expansion of a cavitation bubble in a deformable porous medium. We develop a continuum-scale model that couples compressible fluid flow in the pore network with the elastic response of a solid skeleton. Under the assumption of spherical symmetry, our model can be reduced to an ordinary differential equation that extends the Rayleigh–Plesset equation to bubbles in soft porous media. The extended Rayleigh–Plesset equation reveals that finite-size effects lead to the breakdown of the universal scaling relation between bubble radius and time that holds in the infinite-size limit. Our data indicate that the deformability of the porous medium slows down the collapse and expansion processes, a result with important consequences for wide-ranging phenomena, from drug delivery to spore dispersion.

Leng, Yu↗

DOE OSTI2022

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Bayesian differential programming for robust systems identification under uncertainty

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling. This allows an efficient inference of the posterior distributions over plausible models with quantified uncertainty, while the use of sparsity-promoting priors enables the discovery of interpretable and parsimonious representations for the underlying latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed methods, including nonlinear oscillators, predator–prey systems and examples from systems biology. Taken together, our findings put forth a flexible and robust workflow for data-driven model discovery under uncertainty. All codes and data accompanying this article are available at https://bit.ly/34FOJMj .

Science & Technology - Other Topics↗

DOE OSTI2025

Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble

In this work we explore the capability of physics-informed neural networks (PINNs) to discover multiple solutions. Many real-world phenomena governed by nonlinear differential equations (DEs), such as fluid flow, exhibit multiple solutions under the same conditions, yet capturing this solution multiplicity remains a significant challenge. A key difficulty lies in providing appropriate initial conditions or guesses, as widely used time-marching schemes and Newton’s method are highly sensitive to these choices when solving complex computational problems. While machine learning models, particularly PINNs, have shown promise in solving DEs, their ability to capture multiple solutions remains underexplored. In this work, we propose a simple and practical approach using PINNs to learn and discover multiple solutions. We first demonstrate that PINNs, when combined with random initialization and deep ensemble method—originally developed for uncertainty quantification—can effectively uncover multiple solutions to nonlinear ordinary and partial DEs. Although training large ensembles of PINNs may appear computationally demanding, this can be done efficiently using vectorization techniques supported by modern deep learning frameworks, allowing many networks to be trained simultaneously. Our approach highlights the critical role of initialization in shaping solution diversity, addressing an often-overlooked aspect of machine learning for scientific computing. Furthermore, we propose utilizing PINN-generated solutions as initial conditions or initial guesses for conventional numerical solvers to enhance accuracy and efficiency in capturing multiple solutions. Extensive numerical experiments, including the Allen–Cahn equation and cavity flow, where our approach successfully identifies both stable and unstable solutions, validate the effectiveness of our method. These findings establish a general and efficient framework for addressing solution multiplicity in nonlinear DEs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator–prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue ‘Data-driven prediction in dynamical systems’.

Science & Technology - Other Topics↗

DOE OSTI2026

Comprehensive analytical model of the dynamic 𝑍 pinch

In this work we present an analytical 1D axisymmetric model describing the evolution of the dynamic 𝑍 pinch. This model is capable of predicting the trajectories of the imploding sheath's magnetic piston and preceding shock front, along with the velocity, pressure, density, and magnetic field profiles, for any time-dependent current, spatially varying initial density profile, and weak initial axial field. The implosion is divided into stages, with each stage described by a set of coupled ordinary differential equations derived from the ideal MHD equations. Comparisons with experimental data from the COBRA pulsed-power facility are quite promising and imply this model could prove useful in designing and analyzing future pulsed-power experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Numerical simulation of RHIC polarized proton run 17 spin flipper experiments

RHIC nine-magnet spin flipper has been operated successfully during RHIC polarized proton Run 17, with 97% spin flip efficiency achieved. The results show the importance of mirror resonance removal, small spin tune spread, and proper spin flipper driving tune sweep speed. Detailed spin tracking simulations, based on a Lorentz force and Thomas-BMT differential equation numerical solver code for accuracy, have been carried out to understand the experimental results. Agreement within measurement accuracy is obtained at injection energy, 23.8 GeV. It is not as tight at 255 GeV, reasons for that are exposed. These measurements and numerical studies allow to determine the sensitivity of spin-flip efficiency to the dispersion slopes at the two Siberian snakes and to the ac dipole frequency sweep speed. They also provide guidance for future developments at BNL’s electron-ion collider. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

DOE OSTI2023

Effective dissipation rate in a Liouvillian-graph picture of high-temperature quantum hydrodynamics

At high temperature, generic strongly interacting spin systems are expected to display hydrodynamics: local transport of conserved quantities, governed by classical partial differential equations like the diffusion equation. I argue that the emergence of this dissipative long-wavelength dynamics from the system's unitary microscopic dynamics is controlled by the structure of the Liouvillian graph of the system's Hamiltonian, that is, the graph induced on Pauli strings by commutation with that Hamiltonian. The Liouvillian graph decomposes naturally into subgraphs of Pauli strings of constant diameter, and the coherent dynamics of these subgraphs determines the rate at which operator weight spreads to long operators. In conclusion, this argument provides a quantitative theory of the emergence of a dissipative effective dynamics from unitary microscopic dynamics; it also leads to an effective model with Hilbert space dimension linear in system size and exponential in the UV cutoff for diffusion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2020

Calculating fluctuations and self-correlations numerically for causal charge diffusion in relativistic heavy-ion collisions

Here, we study the propagation and diffusion of electric charge fluctuations in the Bjorken hydrodynamic model with both white and Catteneo noise using purely numerical methods. We show that a lattice of noise fluctuations is required to fully calculate the two-point correlators of charge. We introduce a numerical procedure to solve the stochastic differential equations that arise from the charge conservation equation on the lattice event by event. We explicitly identify the self-correlation term in the case of Catteneo noise and provide a physical interpretation. We provide a numerical recipe to remove this contribution from the full two-point correlators. Finally, we calculate the balance functions for charged hadrons. By limiting the speed of signal propagation, we observe the expected narrowing of the balance functions after removing the self-correlations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Sensitivity of time-dependent density functional theory to initial conditions

Time-dependent density-functional theory is mathematically formulated through nonlinear coupled time-dependent three-dimensional partial differential equations, and it is natural to expect a strong sensitivity of its solutions to variations of the initial conditions, akin to the butterfly effect ubiquitous in classical dynamics. Since the Schrödinger equation for an interacting many-body system is, however, linear and mathematically the exact equations of the density-functional theory reproduce the corresponding one-body properties, it would follow that the Lyapunov exponents are also vanishing within a density-functional theory framework. Whether for realistic implementations of the time-dependent density-functional theory the question of the absence of the butterfly effect and whether the dynamics provided is indeed a predictable theory was never discussed. At the same time, since the time-dependent density-functional theory is a unique tool allowing us to study the nonequilibrium dynamics of strongly interacting many-fermion systems, the question of predictability of this theoretical framework is of paramount importance. Here our analysis, for a number of quantum superfluid many-body systems (unitary Fermi gas, nuclear fission, and heavy-ion collisions) with a classical equivalent number of degrees of freedom O(10 10 ) and larger, suggests that its maximum Lyapunov exponents are negligible for all practical purposes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Stochastic hydrodynamics and hydro-kinetics: Similarities and differences

The hydro-kinetic formalism has been used as a complementary approach to solving the Stochastic Differential Equations (SDE) corresponding to noisy hydrodynamics. The hydro-kinetic formalism consists of a deterministic set of relaxation type equations that tracks the evolution of 2-point correlation functions of stochastic hydrodynamic quantities. Hence they are comparatively easier to solve than the SDEs, which are computationally intensive and need to deal with arbitrarily large gradients. This work compares the two approaches for the propagation and diffusion of conserved charge fluctuations in the Bjorken hydrodynamic model. For white noise, the two approaches agree. For colored Catteneo noise, which is causal, the two approaches diverge. This is because white noise only induces two-point correlations, while Catteneo noise also induces higher-order correlations. Furthermore, this difference is quantified from the effects of causal evolution and influence from higher-order correlations induced by the Catteneo noise.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Ameliorating the Courant-Friedrichs-Lewy condition in spherical coordinates: A double FFT filter method for general relativistic MHD in dynamical spacetimes

Numerical simulations of merging compact objects and their remnants form the theoretical foundation for gravitational wave and multimessenger astronomy. While Cartesian-coordinate-based adaptive mesh refinement is commonly used for simulations, spherical-like coordinates are more suitable for nearly spherical remnants and azimuthal flows due to lower numerical dissipation in the evolution of fluid angular momentum, as well as requiring fewer numbers of computational cells. However, the use of spherical coordinates to numerically solve hyperbolic partial differential equations can result in severe Courant-Friedrichs-Lewy (CFL) stability condition time step limitations, which can make simulations prohibitively expensive. This paper addresses this issue for the numerical solution of coupled spacetime and general relativistic magnetohydrodynamics evolutions by introducing a double fast Fourier transform (FFT) filter and implementing it within the fully message passing interface (mpi)-parallelized sphericalnr framework in the einstein toolkit. In conclusion, we demonstrate the effectiveness and robustness of the filtering algorithm by applying it to a number of challenging code tests, and show that it passes these tests effectively, demonstrating convergence while also increasing the time step significantly compared to unfiltered simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Nonperturbative random matrix model of N = 2 JT supergravity

It is shown how to nonperturbatively define a random matrix model that captures key physics of N = 2 Jackiw-Teitelboim supergravity, going well beyond the perturbative topological expansion defined recently by Turiaci and Witten. A decomposition into an infinite family of certain multicritical models is derived, leading to the definition of a nonlinear ordinary differential equation from which the physics may be computed. Bogomol’nyi-Prasad-Sommerfield (BPS) states are naturally described by the model. The nonperturbative completions of the spectral densities for non-BPS multiplets are readily extracted. Published by the American Physical Society 2024

Johnson, Clifford V. (ORCID:0000000189645830)↗

DOE OSTI2025

Topological contribution to the Bogoliubov coefficient for cosmological particle production

Particle production in cosmology is often efficiently computed in terms of Bogoliubov transforms. Restricting to a particular class of dispersion relationships, we identify a map between the number of particles produced in a special kinematic limit and a Stokes phenomena related topology of analytic continuation of the Bogoliubov coefficient functions. Intuitively, this kinematic limit corresponds to the long wavelength limit although a more precise description depends on the nature of the curved spacetime. To identify the topology, we reformulate the usual Bogoliubov computations as a type of SU(1, 1) gauged differential equation and utilize a special gauge together with a discrete symmetry that naturally characterizes the dispersion relationship. Using a dark matter model and a nonzero constant spatial curvature model, we estimate how such topological contributions will arise in physical applications. Published by the American Physical Society 2025

Chung, Daniel J. H. (ORCID:0000000343998504)↗

DOE OSTI2021

Uncovering turbulent plasma dynamics via deep learning from partial observations

One of the most intensely studied aspects of magnetic confinement fusion is edge plasma turbulence which is critical to reactor performance and operation. Drift-reduced Braginskii two-fluid theory has for decades been widely applied to model boundary plasmas with varying success. Towards better understanding edge turbulence in both theory and experiment, we demonstrate that a novel multi-network physics-informed deep learning framework constrained by partial differential equations can accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure which is not otherwise possible using conventional equilibrium models. Furthermore, this technique presents a novel paradigm for the advanced design of plasma diagnostics and validation of magnetized plasma turbulence theories in challenging thermonuclear environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗