Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Influence of initial conditions on data-driven model identification and information entropy for ideal mhd problems

Data-driven methods of model identification are able to discern governing dynamics of a system from data. Such methods are well suited to help us learn about systems with unpredictable evolution or systems with ambiguous governing dynamics given our current understanding. Many plasma problems of interest fall into these categories as there are a wide range of models that exist, however each model is only useful in a certain regime and often limited by computational complexity. To ensure data-driven methods align with theory, they must be consistent and predictable when acting on data whose governing dynamics are known. Weak Sparse Identification of Nonlinear Dynamics (WSINDy) is a recently developed data-driven method that has shown promise in learning governing dynamics from data with high noise levels [1]. This work examines how WSINDy acts on ideal MHD test problems as the initial conditions are varied and specifies limiting requirements for successful equation identification. Furthermore, it is hard to recover the governing dynamics from data that emphasize a single dominant behavior. In these low information cases, Shannon information entropy is able to pick up on the redundancies in the data that affect recoverability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Multi-mode quasi-static excitation for systems with nonlinear joints

Finite element models can be used to model and predict the hysteresis and energy dissipation exhibited by nonlinear joints in structures. As a result of the nonlinearity, the frequency and damping of a mode is dependent on excitation amplitude, and when the modes remain uncoupled, quasi-static modal analysis has been shown to efficiently predict this behavior. However, in some cases the modes have been observed to couple such that the frequency and damping of one mode is dependent on the amplitude of other modes. To model the interactions between modes, one must integrate the dynamic equations in time, which is several orders of magnitude more expensive than quasi-static analysis. This work explores an alternative where quasi-static forces are applied in the shapes of two or more modes of vibration simultaneously, and the resulting load–displacement curves are used to deduce the effect of other modes on the effective frequency and damping of the mode in question. This methodology is demonstrated on a simple 2D cantilever beam structure with a single bolted joint which exhibits micro-slip nonlinearity over a range of vibration amplitudes. The predicted frequency and damping are compared with those extracted from a few expensive dynamic simulations of the structure, showing that the quasi-static approach produces reasonable albeit highly conservative bounds on the observed dynamics. This framework is also demonstrated on a 3D structure where dynamic simulations are infeasible.

42 ENGINEERING↗
DOE OSTI2022

Droplet formation simulation using mixed finite elements

Droplet formation happens in finite time due to the surface tension force. The linear stability analysis is useful to estimate the size of a droplet but fails to approximate the shape of the droplet. This is due to a highly nonlinear flow description near the point where the first pinch-off happens. A one-dimensional axisymmetric mathematical model was first developed by Eggers and Dupont [“Drop formation in a one-dimensional approximation of the Navier–Stokes equation,” J. Fluid Mech. 262, 205–221 (1994)] using asymptotic analysis. This asymptotic approach to the Navier–Stokes equations leads to a universal scaling explaining the self-similar nature of the solution. Numerical models for the one-dimensional model were developed using the finite difference [Eggers and Dupont, “Drop formation in a one-dimensional approximation of the Navier–Stokes equation,” J. Fluid Mech. 262, 205–221 (1994)] and finite element method [Ambravaneswaran et al., “Drop formation from a capillary tube: Comparison of one-dimensional and two-dimensional analyses and occurrence of satellite drops,” Phys. Fluids 14, 2606–2621 (2002)]. The focus of this study is to provide a robust computational model for one-dimensional axisymmetric droplet formation using the Portable, Extensible Toolkit for Scientific Computation. The code is verified using the Method of Manufactured Solutions and validated using previous experimental studies done by Zhang and Basaran [“An experimental study of dynamics of drop formation,” Phys. Fluids 7, 1184–1203 (1995)]. The present model is used for simulating pendant drops of water, glycerol, and paraffin wax, with an aspiration of extending the application to simulate more complex pinch-off phenomena.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Metriplectic foundations of gyrokinetic Vlasov–Maxwell–Landau theory

Here, this Letter reports on a metriplectic formulation of a collisional, nonlinear full-f electromagnetic gyrokinetic theory compliant with energy conservation and monotonic entropy production. In an axisymmetric background magnetic field, the toroidal angular momentum is also conserved. Notably, a new collisional current, contributing to the gyrokinetic Maxwell–Ampère equation and the gyrokinetic charge conservation law, is discovered.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Partially Ionized Plasma Physics and Technological Applications

Partially ionized plasma physics has attracted increased attention recently due to numerous technological applications made possible by the increased sophistication of computer modelling, the depth of the theoretical analysis, and the technological applications to a vast field of manufacturing for computer components. Partially ionized plasma is characterized by a significant presence of neutral particles in contrast to the fully ionized plasma. The theoretical analysis is based upon solutions of the kinetic Boltzmann equation, yielding the non-Maxwellian electron energy distribution function (EEDF), thereby emphasizing the difference with a fully ionized plasma. The impact of the effect on discharges in inert and molecular gases is described in detail, yielding the complex nonlinear phenomena resulting in plasma selforganization. A few examples of such phenomena are given, including the non-monotonic EEDFs in the discharge afterglow in a mixture of argon with the molecular gas NF3; the explosive generation of cold electron populations in capacitive discharges, hysteresis of EEDF in inductively coupled plasmas. Recently, highly advanced computer codes were developed in order to address the outstanding challenges in plasma technology. These developments are briefly described in general terms.

non-Maxwellian electron energy distribution functi↗
DOE OSTI2023

FES 2023 Theory & Simulation Performance Target

The Report for the 2023 Theory & Simulation Performance Target (TSPT) is presented herein. The 1st, 2nd and 3rd Quarter Reports are given in Sec. I, Sec. II and Sec. III. These are unchanged from those previously submitted, except that in this final document the equations, figures and citations have been automatically renumbered. The 4th Quarter Report is given in Sec. IV. The following material presents verification calculations of several widely used three-dimensional (3D) magnetohydrodynamic (MHD) equilibrium codes in strongly shaped configurations; for both fixed and free-boundary equilibria; for the so-called vacuum case and for the case of high plasma pressure; and, for magnetic fields that have nested magnetic surfaces and for fields that have a magnetic island. The configurations studied includes the recently discovered “precise-QA” case [Phys. Rev. Lett., 128, 035001 (2002)] and other highly optimized configurations. Because of the strong (extreme) shaping, the latter of these pose challenges to the 3D MHD codes. A new method is introduced for constructing coordinates in arbitrarily shaped toroidal domains, and this can improve the robustness of 3D equilibrium calculations. Beyond the equilibrium calculation, this report demonstrates the capability of performing non-linear extended-MHD modelling of optimized stellarator equilibria. This capability allows the assessment not only of linear stability thresholds but also of the nonlinear evolution of unstable equilibria to new configurations that might be far from the original configuration, with significantly different transport properties and magnetic topology. They also enable the self-consistent determination of pressure profiles in non-integrable magnetic topology through the use of highly anisotropic thermal-transport equations. The calculations presented here represent the first demonstration of extended-MHD calculations in strongly-shaped, optimized quasi-symmetric configurations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Time-dependent SOLPS-ITER simulations of the tokamak plasma boundary for model predictive control using SINDy *

Abstract Time-dependent SOLPS-ITER simulations have been used to identify reduced models with the sparse identification of nonlinear dynamics (SINDy) method and develop model-predictive control of the boundary plasma state using main ion gas puff actuation. A series of gas actuation sequences are input into SOLPS-ITER to produce a dynamic response in upstream and divertor plasma quantities. The SINDy method is applied to identify reduced linear and nonlinear models for the electron density at the outboard midplane n e , s e p O M P and the electron temperature at the outer divertor T e , s e p d i v . Note that T e , s e p d i v is not necessarily the peak value of T e along the divertor. The identified reduced models are interpretable by construction (i.e. not black box), and have the form of coupled ordinary differential equations. Despite significant noise in T e , s e p d i v , the reduced models can be used to predict the response over a range of actuation levels to a maximum deviation of 0.5% in n e , s e p O M P and 5%–10% in T e , s e p d i v for the cases considered. Model retraining using time history data triggered by a preset error threshold is also demonstrated. A model predictive control strategy for nonlinear models is developed and used to perform feedback control of a SOLPS-ITER simulation to produce a setpoint trajectory in n e , s e p O M P using the integrated plasma simulator framework. The developed techniques are general and can be applied to time-dependent data from other boundary simulations or experimental data. Ongoing work is extending the approach to model identification and control for divertor detachment, which will present transient nonlinear behavior from impurity seeding, including realistic latency and synthetic diagnostic signals derived from the full SOLPS-ITER output.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Semi-Implicit Computation of Fast Modes in a Scheme Integrating Slow Modes by a Leapfrog Method Based on a Selective Implicit Time Filter

Abstract A scheme for integration of atmospheric equations containing terms with differing time scales is developed. The method employs a filtered leapfrog scheme utilizing a fourth-order implicit time filter with one function evaluation per time step to compute slow-propagating phenomena such as advection and rotation. The terms involving fast-propagating modes are handled implicitly with an unconditionally stable method that permits application of larger time steps and faster computations compared to fully explicit treatment. Implementation using explicit and recurrent formulation is provided. Stability analysis demonstrates that the method is conditionally stable for any combination of frequencies involved in the slow and fast terms as they approach the origin. The implicit filter used in the method damps the computational modes without noticeably sacrificing the accuracy of the physical mode. TheO[(Δt 4 )] accuracy for amplitude errors achieved by the implicitly filtered leapfrog is preserved in applications where terms responsible for fast propagation are integrated with a semi-implicit method. Detailed formulation of the method for soundproof nonhydrostatic anelastic equations is provided. Procedures for implementation in global spectral shallow-water models are also given. Examples comparing numerical and analytical solutions for linear gravity waves demonstrate the accuracy of the scheme. The performance is also shown in more practical nonlinear applications, where numerical solutions accomplished by the method are evaluated against those computed from a scheme where the slow terms are handled by the third-order Runge–Kutta scheme. It demonstrates that the method is able to accurately resolve fine-scale dynamics of Kelvin–Helmholtz shear instabilities, the evolution of density current, and nonlinear drifts of twin tropical cyclones.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Higher-Order Corrections to Optimisers based on Newton's Method

The Newton, Gauss–Newton and Levenberg–Marquardt methods all use the first derivative of a vector function (the Jacobian) to minimise its sum of squares. When the Jacobian matrix is ill-conditioned, the function varies much faster in some directions than others and the space of possible improvement in sum of squares becomes a long narrow ellipsoid in the linear model. This means that even a small amount of nonlinearity in the problem parameters can cause a proposed point far down the long axis of the ellipsoid to fall outside of the actual curved valley of improved values, even though it is quite nearby. This paper presents a differential equation that ‘follows’ these valleys, based on the technique of geodesic acceleration, which itself provides a 2 nd order improvement to the Levenberg–Marquardt iteration step. Higher derivatives of this equation are computed that allow n th order improvements to the optimisation methods to be derived. These higher-order accelerated methods up to 4 th order are tested numerically and shown to provide substantial reduction of both number of steps and computation time.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

EIC Physics from Lattice QCD: investigations beyond leading twist

This project proposes theoretical studies of Quantum Chromodynamics (QCD), the theory describing the strong nuclear force among the building blocks (quarks and gluons) of the visible matter. These appear only confined within hadrons, that make up more than 99% of the mass of the matter. Understanding QCD will significantly advance many aspects of science, from the sub-nuclear interactions to astrophysics, and a quantitative theoretical description is imperative. However, this is a challenging task because QCD is a highly nonlinear theory. We propose hadron structure calculations within lattice QCD (LQCD), an ideal ab initio approach based on space-time discretization, which allows the study of the properties of fundamental particles numerically. This is done by defining the continuous equations on a discrete four-dimensional lattice, which results in equations with hundreds of billions of degrees of freedom, and must be simulated in powerful computers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Unitary Qubit Lattice Algorithms for Plasma Physics

This final technical report summarizes research conducted under DOE Award DE-SC0021653 to develop unitary Quantum Lattice Algorithms for modeling electromagnetic wave propagation and scattering in complex media, including plasmas. The project developed and validated quantum-inspired formulations of Maxwell's equations that preserve unitary evolution and can be evaluated on classical high-performance computing systems while providing a foundation for future quantum-computing implementations. Major accomplishments include the development of two- and three-dimensional algorithms for electromagnetic scattering; scalable, distributed-memory implementations demonstrated on the Perlmutter supercomputer; formulations for nonlinear lossless fluid dynamics and cold, lossless, inhomogeneous magnetized plasmas; and an explicit quantum algorithm for a time-discretized Lorenz model. Simulations reproduced a range of characteristic wave phenomena, including transient effects that are not readily apparent in conventional frequency-domain studies, demonstrating the effectiveness of the proposed approach for modeling complex electromagnetic and plasma systems. The work establishes a unified theoretical and computational framework for quantum and quantum-inspired simulation and provides a foundation for future implementation on fault-tolerant quantum systems.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Multiscale modeling and nonlinear model predictive control for flue gas desulfurization

The primary source of sulfur dioxide (SO 2 ) emissions is flue gas from fossil fuels-based power plants. SO 2 emissions are known to not only cause health issues, but also have an adverse effect on the environment in various ways. Several Flue Gas Desulfurization (FGD) technologies have been incorporated in power plants. The most popular technology is Wet FGD, where a limestone slurry is used to absorb SO 2 from the flue gas. A detailed droplet scale model describing the instantaneous and finite rate chemistry is developed. The ill-posed Differential-Algebraic Equation (DAE) droplet model is reformulated to a well-posed index-1 DAE through index reduction. The droplet model is integrated with the bulk phase by incorporating gas-liquid mass transfer, and an oxidation reactor model to simulate the dynamic operation of the counter-current spray scrubber. As a result, the model has a well-conditioned Jacobian and overcomes the modeling challenges of previous works and enables numerical solution without requiring carefully selected initialization or specialized solution procedures. The model is successfully validated using power plant measurements, and nonlinear model predictive control (NMPC) studies are demonstrated to optimize recycle stream flowrates to minimize pumping costs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Learning Forecasts of Rare Stratospheric Transitions from Short Simulations

Abstract Rare events arising in nonlinear atmospheric dynamics remain hard to predict and attribute. We address the problem of forecasting rare events in a prototypical example, sudden stratospheric warmings (SSWs). Approximately once every other winter, the boreal stratospheric polar vortex rapidly breaks down, shifting midlatitude surface weather patterns for months. We focus on two key quantities of interest: the probability of an SSW occurring, and the expected lead time if it does occur, as functions of initial condition. These optimal forecasts concretely measure the event’s progress. Direct numerical simulation can estimate them in principle but is prohibitively expensive in practice: each rare event requires a long integration to observe, and the cost of each integration grows with model complexity. We describe an alternative approach using integrations that are short compared to the time scale of the warming event. We compute the probability and lead time efficiently by solving equations involving the transition operator, which encodes all information about the dynamics. We relate these optimal forecasts to a small number of interpretable physical variables, suggesting optimal measurements for forecasting. We illustrate the methodology on a prototype SSW model developed by Holton and Mass and modified by stochastic forcing. While highly idealized, this model captures the essential nonlinear dynamics of SSWs and exhibits the key forecasting challenge: the dramatic separation in time scales between a single event and the return time between successive events. Our methodology is designed to fully exploit high-dimensional data from models and observations, and has the potential to identify detailed predictors of many complex rare events in meteorology.

Finkel, Justin↗
DOE OSTI2024

High Field Transport in (Ultra) Wide Bandgap Semiconductors: Diamond Versus Cubic GaN

We provide an analysis of nonlinear transport in diamond and cubic GaN (c-GaN) with emphasis on the different types of optical phonon scattering [i.e., optical deformation potential (ODP) scattering versus polar optic phonon (POP) scattering] limiting the carrier velocity. Both types of carrier mobilities and carrier saturation (peak) velocities in diamond and c-GaN as functions of different doping types and concentrations are obtained by directly solving the Boltzmann equation. Our model indicates that the nonrandomizing nature of POP scattering causes carrier temperature cooling, resulting in higher carrier drift velocity than with ODP scattering. This effect, in addition to the small carrier effective masses and large optical phonon energies, is responsible for the higher peak velocities in c-GaN, compared to carrier drift velocity in diamond.

42 ENGINEERING↗
DOE OSTI2022

Accurate relativistic observables from postprocessing light cone catalogs

We introduce and study a new scheme to construct relativistic observables from postprocessing light cone data. This construction is based on a novel approach, LC-metric, which takes general light cone or snapshot output generated by arbitrary N-body simulations or emulations and solves the linearized Einstein equations to determine the spacetime metric on the light cone. We find that this scheme is able to determine the metric to high precision, and subsequently generate accurate mock cosmological observations sensitive to effects such as post-Born lensing and nonlinear integrated Sachs-Wolfe contributions. By comparing to conventional methods in quantifying those general relativistic effects, we show that this scheme is able to accurately construct the lensing convergence signal. We also find that the accuracy of this method in quantifying the integrated Sachs-Wolfe effects in the highly nonlinear regime outperforms conventional methods by an order of magnitude. Furthermore, this scheme opens a new path for exploring and modeling higher-order and nonlinear general relativistic contributions to cosmological observables, including mock observations of gravitational lensing and the moving lens and Rees-Sciama effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

ssys

`ssys` is a Python toolkit for exact algebraic transformation of ordinary differential equation (ODE) models into canonical S-system or Generalized Mass Action (GMA) form. Given a model in Antimony or SBML format, `ssys` produces a mathematically equivalent representation. The transformation introduces auxiliary variables as needed to decompose a broad class of nonlinearities into products of power-law terms. The recast is exact: the original and transformed systems have identical dynamics on the invariant constraint manifold defined by auxiliary variable definitions, given consistent initial conditions.

Hlavacek, William [Los Alamos National Laboratory]↗