SEARCH · Engineering Papers

Results for “Differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Quantifying local and global mass balance errors in physics-informed neural networks

Physics-informed neural networks (PINN) have recently become attractive for solving partial differential equations (PDEs) that describe physics laws. By including PDE-based loss functions, physics laws such as mass balance are enforced softly in PINN. This paper investigates how mass balance constraints are satisfied when PINN is used to solve the resulting PDEs. We investigate PINN’s ability to solve the 1D saturated groundwater flow equations (diffusion equations) for homogeneous and heterogeneous media and evaluate the local and global mass balance errors. We compare the obtained PINN’s solution and associated mass balance errors against a two-point finite volume numerical method and the corresponding analytical solution. We also evaluate the accuracy of PINN in solving the 1D saturated groundwater flow equation with and without incorporating hydraulic heads as training data. We demonstrate that PINN’s local and global mass balance errors are significant compared to the finite volume approach. Tuning the PINN’s hyperparameters, such as the number of collocation points, training data, hidden layers, nodes, epochs, and learning rate, did not improve the solution accuracy or the mass balance errors compared to the finite volume solution. Mass balance errors could considerably challenge the utility of PINN in applications where ensuring compliance with physical and mathematical properties is crucial.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

An ODE-Enabled Distributed Transient Stability Analysis for Networked Microgrids

Networked microgrid (NMG) exhibits noteworthy resiliency and flexibility benefits for the mutual support from neighboring microgrids. With high penetration of distributed energy resources (DERs) and the associated controls, the transient stability analysis of NMGs is of critical significance. To address the issues of computation burdens and privacy in the centralized transient analysis, this paper devises an ordinary differential equation (ODE)-enabled distributed transient stability (DTS) methodology for NMGs. First, an ODE-based microgrid model is established to capture the dynamics in the droop control of DERs as well as network and load. Further, a distributed DTS is devised for the ODE representation of an NMG, allowing a privacy-preserving transient analysis of each microgrid while accurately reconstructing the frequency dynamics under droop controls in all DERs. In conclusion, extensive tests are performed to verify the validity of the ODE-based microgrid model through both dynamic response and eigenvalue analysis, and the efficacy of the DTS algorithm in simulating the large signal responses and the frequent fluctuations in NMG.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS1983

Numerical computation of transonic flow governed by the full-potential equation

Basic concepts associated with the numerical solution of elliptic partial differential equations are introduced, and procedures used to solve the full potential equation for transonic flow fields are discussed. Governing equations, classical relaxation schemes and concepts regarding transonic, full potential equation algorithms are covered. The equation transformation and grid generation procedures; full potential spatial differencing schemes; full potential iteration schemes, emphasizing convergence acceleration; and three dimensional applications are presented.

Holst, T. L.↗

NASA NTRS1984

Aeroelastic effects in multi-rotor vehicles with application to a hybrid heavy lift system. Part 1: Formulation of equations of motion

This report presents a set of governing coupled differential equations for a model of a hybrid aircraft. The model consists of multiple rotor systems connected by an elastic interconnecting structure, with options to add any combination of or all of the following components; i.e., thrusters, a buoyant hull, and an underslung weight. The dynamic equations are written for the individual blade with hub motions, for the rigid body motions of the whole model, and also for the flexible modes of the interconnecting structure. One of the purposes of this study is to serve as the basis of a numerical study aimed at determining the aeroelastic stability and structural response characteristics of a Hybrid Heavy Lift Airship (HHLA). It is also expected that the formulation may be applicable to analyzing stability and responses of dual rotor helicopters such as a Heavy Lift Helicopter (HLH). Futhermore, the model is capable of representing coupled rotor/body aeromechanical problems of single rotor helicopters.

Venkatesan, C.↗

NASA NTRS1985

The general Lie group and similarity solutions for the one-dimensional Vlasov-Maxwell equations

The general Lie point transformation group and the associated reduced differential equations and similarity forms for the solutions are derived here for the coupled (nonlinear) Vlasov-Maxwell equations in one spatial dimension. The case of one species in a background is shown to admit a larger group than the multispecies case. Previous exact solutions are shown to be special cases of the above solutions, and many of the new solutions are found to constrain the form of the distribution function much more than, for example, the BGK solutions do. The individual generators of the Lie group are used to find the possible subgroups. Finally, a simple physical argument is given to show that the asymptotic solution for a one-species, one-dimensional plasma is one of the general similarity solutions.

Roberts, D.↗

DOE OSTI2026

Magnus method for electronic structure calculations at extreme conditions

We present the application of Magnus based methods to the solution of first order coupled ordinary differential equations in High Energy Density (HED) physics applications. Our focus is on the application to quantum mechanical methods, specifically on the solution of the radial Dirac equation for real and complex energies. HED applications require accurate solutions across a wide range of spatial and energy domains, including regimes where the solutions exhibit pronounced oscillatory behavior. Such cases pose significant computational challenges. We demonstrate that Magnus-based integrators can efficiently and accurately address these challenges. We discuss the implementation of the Magnus method for the solution of the radial Dirac equation, including practical considerations such as the evaluation of matrix exponentials, numerical integration, error estimation, and adaptive step size control. We also discuss the application of these methods to complex energy Green’s function techniques and the efficient approximation of integrals of the solutions relevant to HED electronic structure calculations. Here, we demonstrate the accuracy and robustness of the resulting method in applications to the free-particle case, for which analytic solutions are available for comparison, as well as the challenging case of gold at HED conditions.

general physics↗

DOE OSTI2024

Stochastic modeling of x-ray superfluorescence

An approach to modeling the dynamics of x-ray amplified spontaneous emission and superfluorescence, the phenomenon of collective x-ray emission initiated by intense pulses of x-ray free-electron lasers, is developed based on stochastic partial differential equations. The equations are derived from first principles, and the relevant approximations, derivation steps, and extensions specific to stimulated x-ray emission are presented. The resulting equations take the form of three-dimensional generalized Maxwell-Bloch equations augmented with noise terms for both field and atomic variables. The derived noise terms possess specific correlation properties that enable the correct reconstruction of spontaneous emission. Consequently, the developed theoretical formalism is universally suitable for describing all stages of stimulated x-ray emission: spontaneous emission, amplified spontaneous emission, and superfluorescence. Here, we present numerical examples that illustrate various properties of the emitted field, including spatiotemporal coherence and spectral-angular and polarization characteristics. We anticipate that the proposed theoretical framework will establish a robust foundation for interpreting measurements in stimulated x-ray emission spectroscopy, modeling x-ray laser oscillators, and describing other experiments leveraging x-ray superfluorescence.

74 ATOMIC AND MOLECULAR PHYSICS↗

NASA NTRS1980

Numerical solutions of transonic flows by parametric differentiation and integral equation techniques

The paper discusses results of an exploratory study of the advantages obtained by combining integral equation methods with the method of parametric differentiation in the treatment of transonic flow problems. In the proposed method, the nonlinear unsteady transonic flow equation for small perturbations is transformed into a linear equation by the use of the method of parametric differentiation. The linear equation is split into a pair of weakly coupled partial differential equations by writing the transformed perturbation potential as the sum of a steady component and an unsteady component. The solution of the steady equation as an integral equation is based on Ogana's treatment (1978). As a test case, the formulation is applied to predict the steady transonic flow over a nonlifting parabolic-arc airfoil.

Sivaneri, N. T.↗

DOE OSTI2021

Symmetry-breaking-induced rare fluctuations in a time-delay dynamic system

Inspired by the experimental and numerical findings, we study the dynamic instabilities of two coupled nonlinear delay differential equations that are used to describe the coherent oscillations between the top and bottom boundary layers in turbulent Rayleigh–Bénard convection. By introducing two sensitivity parameters for the instabilities of the top and bottom boundary layers, we find three different types of solutions, namely in-phase single-period oscillations, multi-period oscillations and chaos. The chaos solution contains rare but large amplitude fluctuations. The statistical properties of these fluctuations are consistent with those observed in the experiment for the massive eruption of thermal plumes, which causes random reversals of the large-scale circulation in turbulent Rayleigh–Bénard convection. Finally, our study thus provides new insights into the origin of rare massive eruptions and sudden changes of large-scale flow pattern that are often observed in convection systems of geophysical and astrophysical scales.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2019

Self-focusing of cosh-Gaussian laser beam and its effect on the excitation of ion-acoustic wave and stimulated Brillouin backscattering in collisionless plasma

An analytical and numerical study has been carried out for self-focusing of an intense cosh-Gaussian laser beam in collisionless plasma and its impact on the excitation of ion-acoustic wave and stimulated Brillouin backscattering process. The analytical model has been developed under Wentzel–Kramers–Brillouin and paraxial ray approximations. The nonlinearities of ponderomotive force on electron and the relativistic oscillation of the electron mass have been used in this study. The nonlinear differential equations have been set up for the beam width parameters of the main beam, ion-acoustic wave, backscattered wave and back reflectivity of stimulated Brillouin scattering (SBS). These equations have been solved numerically for different values of decentred parameter (b), relative plasma density (ω{sub p0}/ω{sub 0}) and incident laser intensity (a). The results have been compared with only relativistic nonlinearity and Gaussian profile of laser beam. The focusing of laser beam, ion-acoustic wave and scattered wave are found to be strong under relativistic-ponderomotive regime compared to only relativistic regime. Further, it is observed that focusing/intensity of main laser beam, ion acoustic wave and SBS back reflectivity increases with increasing the values of b and ω{sub p0}/ω{sub 0}. Itis also found that back reflectivity of SBS process gets suppressed with the increase in the value of a. This study may be useful in laser induced fusion scheme where back scattering of SBS plays very important role.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA NTRS1990

Plasma density enhancements created by the ionization of the Earth's upper atmosphere by artificial electron beams

Analytical calculations and experimental observations relating to the interaction with the Earth's upper atmosphere of electron beams emitted from low altitude spacecraft are presented. The problem is described by two coupled nonlinear differential equations in the up-going (along a magnetic field line) and down-going differential energy flux. The equations are solved numerically, using the MSIS atmospheric model and the IRI ionospheric model. The results form the model compare well with recent observations from the CHARGE 2 sounding rocket experiment. Two aspects of the beam-neutral atmosphere interaction are discussed. First, the limits on the electron beam current that can be emitted from a spacecraft without substantial spacecraft charging are investigated. This is important because the charging of the spacecraft to positive potentials limits the current and the escape energy of the beam electrons and thereby limits the ionization of the neutral atmosphere. As an example, we find from CHARGE 2 observations and from the model calculations that below about 180 km, secondary electrons generated through the ionization of the neutral atmosphere by 1 to 10 keV electron beams from sounding rockets, completely balance the beam current, thereby allowing the emission of very high beam currents. Second, the amount of plasma production in the beam-streak is discussed. Results are shown for selected values of the beam energy, spacecraft velocity, and spacecraft altitude.

Neubert, Torsten↗

DOE OSTI2026

A stiff order condition theory for Runge–Kutta methods applied to semilinear ODEs

Classical convergence theory of Runge–Kutta methods assumes that the time step is small relative to the Lipschitz constant of the ordinary differential equation (ODE). For stiff problems, that assumption is often violated, and a problematic degradation in accuracy, known as order reduction, can arise. Methods with high stage order, e.g., Gauss–Legendre and Radau, are known to avoid order reduction, but they must be fully implicit. For the broad class of semilinear ODEs, which consist of a stiff linear term and non-stiff nonlinear term, we show that weaker conditions suffice. Here, our new semilinear order conditions are formulated in terms of orthogonality relations and can be enumerated by rooted trees. Finally, we prove global error bounds that hold uniformly with respect to stiffness of the linear term.

Mathematics and Computing↗

DOE OSTI2022

Improved Architectures and Training Algorithms for Deep Operator Networks

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of partial differential equations (PDEs) in an entirely self-supervised manner. In this work we analyze the training dynamics of deep operator networks (DeepONets) through the lens of Neural Tangent Kernel theory, and reveal a bias that favors the approximation of functions with larger magnitudes. To correct this bias we propose to adaptively re-weight the importance of each training example, and demonstrate how this procedure can effectively balance the magnitude of back-propagated gradients during training via gradient descent. We also propose a novel network architecture that is more resilient to vanishing gradient pathologies. Taken together, our developments provide new insights into the training of DeepONets and consistently improve their predictive accuracy by a factor of 10-50x, demonstrated in the challenging setting of learning PDE solution operators in the absence of paired input-output observations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗

DOE OSTI2021

An explicitly solvable energy-conserving algorithm for pitch-angle scattering in magnetized plasmas

In this work, we develop an Explicitly Solvable Energy-Conserving (ESEC) algorithm for the Stochastic Differential Equation (SDE) describing the pitch-angle scattering process in magnetized plasmas. The Cayley transform is used to calculate both the deterministic gyromotion and stochastic scattering, affording the algorithm to be explicitly solvable and exactly energy conserving. An unusual property of the SDE for pitch-angle scattering is that its coefficients diverge at the zero velocity and do not satisfy the global Lipschitz condition. Consequently, when standard numerical methods, such as the Euler-Maruyama (EM), are applied, numerical convergence is difficult to establish. For the proposed ESEC algorithm, its energy-preserving property enables us to overcome this obstacle. We rigorously prove that the ESEC algorithm is order 1/2 strongly convergent. This result is confirmed by detailed numerical studies. For the case of pitch-angle scattering in a magnetized plasma with a constant magnetic field, the numerical solution is benchmarked against the analytical solution, and excellent agreements are found.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Lax-Oleinik-Type Formulas and Efficient Algorithms for Certain High-Dimensional Optimal Control Problems

Two of the main challenges in optimal control are solving problems with state-dependent running costs and developing efficient numerical solvers that are computationally tractable in high dimension. In this paper, we provide analytical solutions to certain optimal control problems whose running cost depends on the state variable and with constraints on the control. We also provide Lax-Oleinik-type representation formulas for the corresponding Hamilton-Jacobi partial differential equations with state-dependent Hamiltonians. Additionally, we present an efficient, grid-free numerical solver based on our representation formulas, which is shown to scale linearly with the state dimension, and thus, to overcome the curse of dimensionality. Using existing optimization methods and the min-plus technique, we extend our numerical solvers to address more general classes of convex and nonconvex initial costs. We demonstrate the capabilities of our numerical solvers using implementations on a central processing unit (CPU) and a field-programmable gate array (FPGA). In several cases, our FPGA implementation obtains over a 10 times speedup compared to the CPU, which demonstrates the promising performance boosts FPGAs can achieve. Furthermore, our numerical results show that our solvers have the potential to serve as a building block for solving broader classes of high-dimensional optimal control problems in real-time.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Speeding up and reducing memory usage for scientific machine learning via mixed precision

Scientific machine learning (SciML) has emerged as a versatile approach to address complex computational science and engineering problems. Within this field, physics-informed neural networks (PINNs) and deep operator networks (DeepONets) stand out as the leading techniques for solving partial differential equations by incorporating both physical equations and experimental data. However, training PINNs and DeepONets require significant computational resources, including long computational times and large amounts of memory. In search of computational efficiency, training neural networks using half precision (float16) rather than the conventional single (float32) or double (float64) precision has gained substantial interest, given the inherent benefits of reduced computational time and memory consumed. However, we find that float16 cannot be applied to SciML methods, because of gradient divergence at the start of training, weight updates going to zero, and the inability to converge to a local minima. To overcome these limitations, we explore mixed precision, which is an approach that combines the float16 and float32 numerical formats to reduce memory usage and increase computational speed. Our experiments showcase that mixed precision training not only substantially decreases training times and memory demands but also maintains model accuracy. Here, we also reinforce our empirical observations with a theoretical analysis. The research has broad implications for SciML in various computational applications.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems

Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been successfully employed to solve diverse forward and inverse PDE problems. However, one disadvantage of the first generation of PINNs is that they usually have limited accuracy even with many training points. Here, we propose a new method, gradient-enhanced physics-informed neural networks (gPINNs), for improving the accuracy of PINNs. gPINNs leverage gradient information of the PDE residual and embed the gradient into the loss function. We tested gPINNs extensively and demonstrated the effectiveness of gPINNs in both forward and inverse PDE problems. Our numerical results show that gPINN performs better than PINN with fewer training points. Additionally, we combined gPINN with the method of residual-based adaptive refinement (RAR), a method for improving the distribution of training points adaptively during training, to further improve the performance of gPINN, especially in PDEs with solutions that have steep gradients.

42 ENGINEERING↗