Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “integral equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Probabilistic Scheme for Semilinear Nonlocal Diffusion Equations with Volume Constraints

This work presents a probabilistic scheme for solving semilinear nonlocal diffusion equations with volume constraints and integrable kernels. The nonlocal model of interest is defined by a time-dependent semilinear partial integro-differential equation (PIDE), in which the integro-differential operator consists of both local convection-diffusion and nonlocal diffusion operators. Here, our numerical scheme is based on the direct approximation of the nonlinear Feynman–Kac formula that establishes a link between nonlinear PIDEs and stochastic differential equations. The exploitation of the Feynman–Kac representation avoids solving dense linear systems arising from nonlocal operators. Compared with existing stochastic approaches, our method can achieve first-order convergence after balancing the temporal and spatial discretization errors, which is a significant improvement of existing probabilistic/stochastic methods for nonlocal diffusion problems. Error analysis of our numerical scheme is established. The effectiveness of our approach is shown in two numerical examples. The first example considers a three-dimensional nonlocal diffusion equation to numerically verify the error analysis results. The second example presents a physics problem motivated by the study of heat transport in magnetically confined fusion plasmas.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. Furthermore, we demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Stage-local partitioned two-step runge-kutta methods for large systems of ordinary differential equations

We introduce stage-local partitioned two-step Runge-Kutta methods are an extension of standard two-step Runge-Kutta methods, which are an alternative to the standard additive two-step Runge-Kutta methods currently existing in the literature. Furthermore, these new schemes are designed with an eye towards truly N-partitioned systems and leverage local stage approximations to make several computationally interesting approximations viable. Specifically, the focus on local stage approximations makes possible the construction of truly asynchronous schemes, in the parallel sense, possible. In addition, we show that an implicit-explicit approach to these schemes can lead to methods that require the inversion of only local nonlinear systems.

Applied Dynamical Systems↗
DOE OSTI2025

AutoTandemML: Active Learning Enhanced Tandem Neural Networks for Inverse Design Problems

Inverse design in science and engineering involves determining optimal design parameters that achieve desired performance outcomes, a process often hindered by the complexity and high dimensionality of design spaces, leading to significant computational costs. To tackle this challenge, we propose a novel hybrid approach that combines active learning with Tandem Neural Networks to enhance the efficiency and effectiveness of solving inverse design problems. Active learning allows to selectively sample the most informative data points, reducing the required dataset size without compromising accuracy. We investigate this approach using three benchmark problems: airfoil inverse design, photonic surface inverse design, and scalar boundary condition reconstruction in diffusion partial differential equations. We demonstrate that integrating active learning with Tandem Neural Networks outperforms standard approaches across the benchmark suite, achieving better accuracy with fewer training samples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A novel implicit hybrid machine learning model and its application for reinforcement learning

A novel methodology to develop implicit hybrid models is presented. PyTorch is used to integrate physics-based equations with machine learning models. Automatic differentiation of the hybrid model is leveraged to solve the implicit equations. Iterative solving enables gradient based updates to the machine learning model. The novel methodology is compared to an explicit hybrid approach on a continuously stirred tank reactor (CSTR). The novel method results in a lower modelling error. Both hybrid models effectively train with noisy data. To test the implicit hybrid model, it is employed as a reinforcement learning (RL) training model. The RL algorithm trained on the hybrid model outperforms real time optimization of the CSTR and performs nearly as well as RL trained directly on the CSTR and a traditional gradient based approach. Training RL directly on the CSTR requires over 60,000 system interactions compared to 6000 historical data points for hybrid model development.

42 ENGINEERING↗
DOE OSTI2021

A learning-augmented approach for AC optimal power flow

Because of the high nonlinearity of AC optimal power flow (OPF), numerous efforts have been made in recent decades to find efficient methods. Machine learning (ML) has proven to significantly reduce the computational costs in many real-world problems. Thus, this paper develops a learning-augmented method for solving AC OPF, which integrates both power network equations and ML to yield near-optimal solutions. More specifically, ML models are developed to first predict bus voltage magnitudes and angles. Then, physics-based network equations are employed to calculate the power injection at different buses. Three ML algorithms, i.e., random forest, multi-target decision tree, and extreme learning machine, are explored and compared. To evaluate the efficiency of the proposed learning-augmented AC OPF solver, the MATPOWER Interior Point Solver is adopted as a baseline. Case studies on both 500-bus and 4918-bus test networks show that the proposed learning-augmented method has reduced the computational time by 15–100 times depending on the network size with a minimal loss in optimality.

42 ENGINEERING↗
DOE OSTI2024

Assessment of simulated and observed cavitation-induced erosion damage in Spallation Neutron Source target vessels

Cavitation-induced erosion damage in different Spallation Neutron Source (SNS) target designs are simulated using explicit finite element–based techniques and compared with observations of erosion in targets after operation. The efficacy of the previously developed method, called saturation time, was evaluated using erosion-damaged samples from new target designs. A new metric called maximum bubble size was implemented under the rationale that larger cavitation bubbles will collapse more intensely. The maximum cavitation bubble size over 1 ms of simulated time was calculated based on the Rayleigh–Plesset equation for each element integration point and presented as a contour map at the vessel surface for assessing with erosion observations. SNS targets are now operated with helium gas injection to reduce cavitation damage. A simulation method using a material model for the mixture of mercury and gas bubbles was recently developed and used to account for the effect of small gas bubbles on the structural response of the target vessel. Furthermore, this work compares the new method's results with observed cavitation damage. Maps of the calculated maximum bubble size for targets operated with and without gas injection were compared with photographs of erosion damage observed in SNS targets. The patterns in maximum bubble size maps correlated well with observations of erosion patterns in target vessels after service. Advantages and challenges of the maximum bubble size simulation technique are provided, and differences between results from the previous and the newly proposed metric are discussed.

Jiang, Hao↗
DOE OSTI2024

On the stability of a pair of vortex rings

The growth of perturbations subject to the Crow instability along two vortex rings of equal and opposite circulation undergoing a head-on collision is examined. Unlike the planar case for semi-infinite line vortices, the zero-order geometry of the flow (i.e. the ring radius, core thickness and separation distance) and by extension the growth rates of perturbations vary in time. The governing equations are therefore temporally integrated to characterize the perturbation spectrum. The analysis, which considers the effects of ring curvature and the distribution of vorticity within the vortex cores, explains several key flow features observed in experiments. First, the zero-order motion of the rings is accurately reproduced. Next, the predicted emergent wavenumber, which sets the number of secondary vortex structures emerging after the cores come into contact, agrees with experiments, including the observed increase in the number of secondary structures with increasing Reynolds number. Finally, the analysis predicts an abrupt transition at a critical Reynolds number to a regime dominated by a higher-frequency, faster-growing instability mode that may be consistent with the experimentally observed rapid generation of a turbulent puff following the collision of rings at high Reynolds numbers.

42 ENGINEERING↗
DOE OSTI2024

A streamline coordinate analysis of a turbulent boundary layer subject to pressure gradients and curvature on the windward side of a bump

Direct numerical simulation (DNS) of a turbulent boundary layer over the Gaussian (Boeing) bump is performed. This boundary layer exhibits a series of adverse and favourable pressure gradients and convex and concave curvature effects before separating. These effects on turbulent boundary layers are characterised and compared with a lower-Reynolds-number flow over the same geometry. The momentum budgets are analysed in the streamline-aligned coordinate system upstream of the separation region. These momentum budgets allow the simplification of equations to facilitate an integral analysis. Integral-analysis-based approximations for Reynolds stresses in the inner and outer regions of the boundary layer are also formulated. The shear and wall-normal Reynolds stress profiles normalised by these approximations exhibit a better collapse compared with friction velocity and Zagarola–Smits normalisations in the strong favourable pressure gradient region and in the mild adverse pressure region that precedes it in this flow. Simplification of these Reynolds stress approximations along with results from the DNS are used to obtain semi-empirical approximations that are able to provide stress closure in terms of wall solution fields for the turbulent boundary layer under consideration.

42 ENGINEERING↗
DOE OSTI2025

Numerical simulations of three-dimensional ion crystal dynamics in a Penning trap using the fast multipole method

We simulate the dynamics, including laser cooling, of three-dimensional (3-D) ion crystals confined in a Penning trap using a newly developed molecular dynamics-like code. The numerical integration of the ions’ equations of motion is accelerated using the fast multipole method to calculate the Coulomb interaction between ions, which allows us to efficiently study large ion crystals with thousands of ions. In particular, we show that the simulation time scales linearly with ion number, rather than with the square of the ion number. By treating the ions’ absorption of photons as a Poisson process, we simulate individual photon scattering events to study laser cooling of 3-D ellipsoidal ion crystals. Initial simulations suggest that these crystals can be efficiently cooled to ultracold temperatures, aided by the mixing of the easily cooled axial motional modes with the low frequency planar modes. In our simulations of a spherical crystal of 1000 ions, the planar kinetic energy is cooled to several millikelvin in a few milliseconds while the axial kinetic energy and total potential energy are cooled even further. This suggests that 3-D ion crystals could be well suited as platforms for future quantum science experiments.

Zaris, John (ORCID:0009000196476323)↗
DOE OSTI2022

Methods to Calculate Electronic Excited-State Dynamics for Molecules on Large Metal Clusters with Many States: Ensuring Fast Overlap Calculations and a Robust Choice of Phase

Here, we present an efficient set of methods for propagating excited-state dynamics involving a large number of configuration interaction singles (CIS) or Tamm-Dancoff approximation (TDA) single-reference excited states. Specifically, (i) following Head-Gordon et al., we implement an exact evaluation of the overlap of singly-excited CIS/TDA electronic states at different nuclear geometries using a biorthogonal basis and (ii) we employ a unified protocol for choosing the correct phase for each adiabat at each geometry. For many-electron systems, the combination of these techniques significantly reduces the computational cost of integrating the electronic Schrodinger equation and imposes minimal overhead on top of the underlying electronic structure calculation. As a demonstration, we calculate the electronic excited-state dynamics for a hydrogen molecule scattering off a silver metal cluster, focusing on high-lying excited states, where many electrons can be excited collectively and crossings are plentiful. Interestingly, we find that the high-lying, plasmon-like collective excitation spectrum changes with nuclear dynamics, highlighting the need to simulate non-adiabatic nuclear dynamics and plasmonic excitations simultaneously. In the future, the combination of methods presented here should help theorists build a mechanistic understanding of plasmon-assisted charge transfer and excitation energy relaxation processes near a nanoparticle or metal surface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Collective mode Brownian dynamics: A method for fast relaxation of statistical ensembles

Sampling equilibrium configurations of correlated systems of particles with long relaxation times (e.g., polymeric solutions) using conventional molecular dynamics and Monte Carlo methods can be challenging. This is especially true for systems with complicated, extended bond network topologies and other interactions that make the use and design of specialized relaxation protocols infeasible. We introduce a method based on Brownian dynamics simulations that can reduce the computational time it takes to reach equilibrium and draw decorrelated samples. Importantly, the method is completely agnostic to the particle configuration and the specifics of interparticle forces. In particular, we develop a mobility matrix that excites non-local, collective motion of N particles and can be computed efficiently in $\mathcal{O}(N)$ time. Particle motion in this scheme is computed by integrating the overdamped Langevin equation with an Euler–Maruyama scheme, in which Brownian displacements are drawn efficiently using a low-rank representation of the mobility matrix in position and wave space. We demonstrate the efficacy of the method with various examples from the realm of soft condensed matter and release a massively parallel implementation of the code as a plugin for the open-source package HOOMD-blue [J. A. Anderson et al., J. Comput. Phys. 227, 5342 (2008) and J. Glaser et al., Comput. Phys. Commun. 192, 97 (2015)] which runs on graphics processing units

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Quantum Monte Carlo benchmarking of large noncovalent complexes in the L7 benchmark set

We have used diffusion Monte Carlo (DMC) to perform calculations on the L7 benchmark set. DMC is a stochastic numerical integration scheme in real-space and part of a larger set of quantum Monte Carlo methods. The L7 set was designed to test the ability of electronic structure methods to include dispersive interactions. While the agreement between DMC and quantum-chemical state-of-the-art methods is excellent for some of the structures, there are significant differences in others. In contrast to wavefunction-based quantum chemical methods, DMC is a first-principle many-body method with the many-body wavefunction evolving in real space. It includes explicitly all electron–electron interactions and is relatively insensitive to the size of the basis set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Learning the temporal evolution of multivariate densities via normalizing flows

In this work, we propose a method to learn multivariate probability distributions using sample path data from stochastic differential equations. Specifically, we consider temporally evolving probability distributions (e.g., those produced by integrating local or nonlocal Fokker–Planck equations). Here, we analyze this evolution through machine learning assisted construction of a time-dependent mapping that takes a reference distribution (say, a Gaussian) to each and every instance of our evolving distribution. If the reference distribution is the initial condition of a Fokker–Planck equation, what we learn is the time-T map of the corresponding solution. Specifically, the learned map is a multivariate normalizing flow that deforms the support of the reference density to the support of each and every density snapshot in time. We demonstrate that this approach can approximate probability density function evolutions in time from observed sampled data for systems driven by both Brownian and Lévy noise. We present examples with two- and three-dimensional, uni- and multimodal distributions to validate the method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Implementation of a practical Markov chain Monte Carlo sampling algorithm in PyBioNetFit

Abstract Summary Bayesian inference in biological modeling commonly relies on Markov chain Monte Carlo (MCMC) sampling of a multidimensional and non-Gaussian posterior distribution that is not analytically tractable. Here, we present the implementation of a practical MCMC method in the open-source software package PyBioNetFit (PyBNF), which is designed to support parameterization of mathematical models for biological systems. The new MCMC method, am, incorporates an adaptive move proposal distribution. For warm starts, sampling can be initiated at a specified location in parameter space and with a multivariate Gaussian proposal distribution defined initially by a specified covariance matrix. Multiple chains can be generated in parallel using a computer cluster. We demonstrate that am can be used to successfully solve real-world Bayesian inference problems, including forecasting of new Coronavirus Disease 2019 case detection with Bayesian quantification of forecast uncertainty. Availability and implementation PyBNF version 1.1.9, the first stable release with am, is available at PyPI and can be installed using the pip package-management system on platforms that have a working installation of Python 3. PyBNF relies on libRoadRunner and BioNetGen for simulations (e.g. numerical integration of ordinary differential equations defined in SBML or BNGL files) and Dask.Distributed for task scheduling on Linux computer clusters. The Python source code can be freely downloaded/cloned from GitHub and used and modified under terms of the BSD-3 license (https://github.com/lanl/pybnf). Online documentation covering installation/usage is available (https://pybnf.readthedocs.io/en/latest/). A tutorial video is available on YouTube (https://www.youtube.com/watch?v=2aRqpqFOiS4&t=63s). Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Mesoscopic critical fluctuations

Here, we investigate the magnetic fluctuations in a mesoscopic critical region formed at the interface due to smooth time-independent spatial variations of a control parameter around its critical value. In the proximity of the spatial critical point, the order parameter fluctuations exhibit a mesoscopic nature, characterized by their significant size compared to the lattice constant, while gradually decaying away from the critical region. To explain this phenomenon, we present a minimal model that effectively captures this behavior and demonstrates its connection to the integrable Painlevé-II equation governing the local order parameter. By leveraging the well-established mathematical properties of this equation, we gain valuable insights into the nonlinear susceptibilities exhibited within this region.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Adiabatic quantum imaginary time evolution

We introduce an adiabatic state preparation protocol which implements quantum imaginary time evolution under the Hamiltonian of the system. Unlike the original quantum imaginary time evolution algorithm, adiabatic quantum imaginary time evolution does not require quantum state tomography during its runtime and, unlike standard adiabatic state preparation, the final Hamiltonian is not the system Hamiltonian. Instead, the algorithm obtains the adiabatic Hamiltonian by integrating a classical differential equation that ensures that one follows the imaginary time evolution state trajectory. We introduce some heuristics that allow this protocol to be implemented on quantum architectures with limited resources. We explore the performance of this algorithm via classical simulations in a one-dimensional spin model and highlight essential features that determine its cost, performance, and implementability for longer times, and compare to the original quantum imaginary time evolution for ground-state preparation. More generally, our algorithm expands the range of states accessible to adiabatic state preparation methods beyond those that are expressed as ground states of simple explicit Hamiltonians. Published by the American Physical Society 2024

Hejazi, Kasra (ORCID:000000032349478X)↗