Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders

A common strategy for the dimensionality reduction of nonlinear partial differential equations (PDEs) relies on the use of the proper orthogonal decomposition (POD) to identify a reduced subspace and the Galerkin projection for evolving dynamics in this reduced space. However, advection-dominated PDEs are represented poorly by this methodology since the process of truncation discards important interactions between higher-order modes during time evolution. In this study, we demonstrate that encoding using convolutional autoencoders (CAEs) followed by a reduced-space time evolution by recurrent neural networks overcomes this limitation effectively. We demonstrate that a truncated system of only two latent space dimensions can reproduce a sharp advecting shock profile for the viscous Burgers equation with very low viscosities, and a six-dimensional latent space can recreate the evolution of the inviscid shallow water equations. Additionally, the proposed framework is extended to a parametric reduced-order model by directly embedding parametric information into the latent space to detect trends in system evolution. Furthermore, our results show that these advection-dominated systems are more amenable to low-dimensional encoding and time evolution by a CAE and recurrent neural network combination than the POD-Galerkin technique.

97 MATHEMATICS AND COMPUTING↗

Applications of physics informed neural operators

Abstract We present a critical analysis of physics-informed neural operators (PINOs) to solve partial differential equations (PDEs) that are ubiquitous in the study and modeling of physics phenomena using carefully curated datasets. Further, we provide a benchmarking suite which can be used to evaluate PINOs in solving such problems. We first demonstrate that our methods reproduce the accuracy and performance of other neural operators published elsewhere in the literature to learn the 1D wave equation and the 1D Burgers equation. Thereafter, we apply our PINOs to learn new types of equations, including the 2D Burgers equation in the scalar, inviscid and vector types. Finally, we show that our approach is also applicable to learn the physics of the 2D linear and nonlinear shallow water equations, which involve three coupled PDEs. We release our artificial intelligence surrogates and scientific software to produce initial data and boundary conditions to study a broad range of physically motivated scenarios. We provide the source code , an interactive website to visualize the predictions of our PINOs, and a tutorial for their use at the Data and Learning Hub for Science .

97 MATHEMATICS AND COMPUTING↗

Nonlinear quantum behavior of ultrashort-pulse optical parametric oscillators

The quantum features of ultrashort-pulse optical parametric oscillators (OPOs) are investigated theoretically in the nonlinear regime near and above threshold. Viewing the pulsed OPO as a multimode open quantum system, we rigorously derive a general input-output model that features nonlinear coupling among many cavity (i.e., system) signal modes and a broadband single-pass (i.e., reservoir) pump field. Under appropriate assumptions, our model produces a Lindblad master equation with multimode nonlinear Lindblad operators describing two-photon dissipation and a multimode four-wave-mixing Hamiltonian describing a broadband, dispersive optical cascade, which we show is required to preserve causality. To simplify the multimode complexity of the model, we employ a supermode decomposition to perform numerical simulations in the regime where the pulsed supermodes experience strong single-photon nonlinearity. We find that the quantum nonlinear dynamics induces pump depletion as well as corrections to the below-threshold squeezing spectrum predicted by linearized models. We also observe the formation of non-Gaussian states with Wigner-function negativity and show that the multimode interactions with the pump, both dissipative and dispersive, can act as effective decoherence channels. Finally, we briefly discuss some experimental considerations for potentially observing such quantum nonlinear phenomena with ultrashort-pulse OPOs on nonlinear nanophotonic platforms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A scalable matrix-free spectral element approach for unsteady PDE constrained optimization using PETSc/TAO

In this work, we provide a new approach for the efficient matrix-free application of the transpose of the Jacobian for the spectral element method for the adjoint-based solution of partial differential equation (PDE) constrained optimization. This results in optimizations of nonlinear PDEs using explicit integrators where the integration of the adjoint problem is not more expensive than the forward simulation. Solving PDE constrained optimization problems entails combining expertise from multiple areas, including simulation, computation of derivatives, and optimization. The Portable, Extensible Toolkit for Scientific computation (PETSc) together with its companion package, the Toolkit for Advanced Optimization (TAO), is an integrated numerical software library that contains an algorithmic/software stack for solving linear systems, nonlinear systems, ordinary differential equations, differential algebraic equations, and large-scale optimization problems and, as such, is an ideal tool for performing PDE-constrained optimization. This paper describes an efficient approach in which the software stack provided by PETSc/TAO can be used for large-scale nonlinear time-dependent problems. Time integration can involve a range of high-order methods, both implicit and explicit. The PDE-constrained optimization algorithm used is gradient-based and seamlessly integrated with the simulation of the physical problem.

97 MATHEMATICS AND COMPUTING↗

Approximation rates of DeepONets for learning operators arising from advection–diffusion equations

Here we present the analysis of approximation rates of operator learning in Chen and Chen (1995) and Lu et al. (2021), where continuous operators are approximated by a sum of products of branch and trunk networks. In this work, we consider the rates of learning solution operators from both linear and nonlinear advection–diffusion equations with or without reaction. We find that the approximation rates depend on the architecture of branch networks as well as the smoothness of inputs and outputs of solution operators.

97 MATHEMATICS AND COMPUTING↗

Equations of Motion for the Vertical Rigid-Body Rotor: Linear and Nonlinear Cases

Centuries ago, the prolific mathematician Leonhard Euler (1707–1783) wrote down the equations of motion (EOM) for the heavy symmetrical top with one point fixed. The resulting set of equations turned out to be nonlinear and had a limited number of closed-form solutions. Today, tools such as transfer matrix and finite elements enable the calculation of the rotor dynamic properties for rotor-bearing systems. Some of these tools rely on the “linearized” version of the EOM to calculate the eigenvalues, unbalance response, or transients in these systems. In fact, industry standards mandate that rotors be precisely balanced to have safe operational characteristics. However, in some cases, the nonlinear aspect of the EOM should be considered. The purpose of this paper is to show examples of how the linear vs. nonlinear formulations differ. This paper will also show how excessive unbalance is capable of dramatically altering the behavior of the system and can produce chaotic motions associated with the “jump” phenomenon.

42 ENGINEERING↗

Equations of Motion for the Vertical Rigid-Body Rotor: Linear and Nonlinear Cases

Centuries ago, the prolific mathematician Leonhard Euler (1707–1783) wrote down the equations of motion (EOM) for the heavy symmetrical top with one point fixed. The resulting set of equations turned out to be nonlinear and had a limited number of closed-form solutions.Today, tools such as transfer matrix and finite elements enable the calculation of the rotordynamic properties for rotor-bearing systems. Some of these tools rely on the “linearized” version of the EOM to calculate the eigenvalues, unbalance response, or transients in these systems.In fact, industry standards mandate that rotors be precisely balanced to have safe operational characteristics. However, in some cases, the nonlinear aspect of the EOM should be considered.The purpose of this chapter is to show examples of how the linear vs. nonlinear formulations differ. This chapter also shows how excessive unbalance is capable of dramatically altering the behavior of the system and can produce chaotic motions associated with the “jump” phenomenon.

Laos, Hector↗

Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs), especially with arbitrary initial data. We address this problem by taking advantage of recent advances in scientific machine learning and the spectral dynamically orthogonal (DO) and borthogonal (BO) methods for representing stochastic processes. The recently introduced DO/BO methods reduce the SPDE to solving a system of deterministic PDEs and a system of stochastic ordinary differential equations. Specifically, we propose two new physics-informed neural networks (PINNs) for solving time-dependent SPDEs, namely the neural network (NN)-DO/BO methods. The proposed methods incorporate the DO/BO constraints into the loss function (along with the modal decomposition of the SPDE) with an implicit form instead of generating explicit expressions for the temporal derivatives of the DO/BO modes. Hence, the NN-DO/BO methods can overcome some of the drawbacks of the original DO/BO methods. For example, we do not need the assumption that the covariance matrix of the random coefficients is invertible as in the original DO method, and we can remove the assumption of no eigenvalue crossing as in the original BO method. Moreover, the NN-DO/BO methods can be used to solve time-dependent stochastic inverse problems with the same formulation and same computational complexity as for forward problems. Furthermore, we demonstrate the capability of the proposed methods via several numerical examples, namely: (1) A linear stochastic advection equation with deterministic initial condition: we obtain good results with the proposed methods, while the original DO/BO methods cannot be applied directly in this case. (2) Long-time integration of the stochastic Burgers' equation: we show the good performance of NN-DO/BO methods, especially the effectiveness of the NN-BO approach for such problems with many eigenvalue crossings during the whole time evolution, while the original BO method fails. (3) Nonlinear reaction diffusion equation: we consider both the forward problem and the inverse problems, including very noisy initial point values, to investigate the flexibility of the NN-DO/BO methods in handling inverse and mixed type problems. Taken together, these simulation results demonstrate that the NN-DO/BO methods can be employed to effectively quantify uncertainty propagation in a wide range of physical problems, but future work should address the efficiency issue of PINNs for forward problems.

97 MATHEMATICS AND COMPUTING↗

Automatically adaptive stabilized finite elements and continuation analysis for compaction banding in geomaterials

Under compressive creep, viscoplastic solids experiencing internal mass transfer processes can accommodate singular cnoidal wave solutions as material instabilities at the stationary wave limit. These instabilities appear when the loading rate is significantly faster than the material's capacity to diffusive internal perturbations, leading to localized failure features (e.g., cracks and compaction bands). These cnoidal waves, generally found in fluids, have strong nonlinearities that produce periodic patterns. Due to the singular nature of the solutions, the applicability of the theory is currently limited. Additionally, practical simulation tools require proper regularization to overcome the challenges that singularity induces. We focus on the numerical treatment of the governing equation using a nonlinear approach building on a recent adaptive stabilized finite element method. This automatic refinement method provides an error estimate that drives mesh adaptivity, a crucial feature for the problem at hand. We compare the performance of this adaptive strategy against analytical and standard finite element solutions. We then investigate the sensitivity of the diffusivity ratio, the parameter controlling the process, and identify multiple possible solutions with several stress peaks. We also show the evolution of the spacing between peaks for all solutions as a function of that parameter.

42 ENGINEERING↗

Nonlinear spectral analysis of ion acoustic solitons arising from a streaming charged object using the numerical inverse scattering transform

Observations of nonlinear coherent plasma phenomena in spacecraft and terrestrial experiments often rely on visual identification of solitary modes because nonlinear coherent modes are broadband in a Fourier transform based analysis. We implement an alternative spectral decomposition known as the inverse scattering transform and demonstrate its ability to successfully isolate nonlinear modes on the homogeneous and forced Korteweg–De Vries equation which models these nonlinear modes. We also demonstrate for the first time that this decomposition is useful when forcing is applied. This is because the stable modes generated by localized forcing are similar to the homogeneous solutions where the inverse scattering transform is a rigorous decomposition. This spectral technique is then applied to simulations of ion acoustic waves generated by a 10 mm spherical debris object interacting with the ionospheric plasma orbiting at 2000 km altitude. The algorithm is found to successfully detect the resultant solitons. This demonstrates the feasibility of using this spectral technique as a real time analysis tool for screening spacecraft data for nonlinear solitary modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fully Implicit Monte Carlo (FIMC) (September 2019-September 2020 Progress Report)

This research is focused on applying the NLem method to the full thermal radiative transfer (TRT) equations in the context of a Monte Carlo solution strategy. A framework has been developed for obtaining a solution to the TRT equations using the nonlinear elimination method (NLem) method. Current efforts are focused of the development and verification of the required Monte Carlo algorithm, diffusion algorithm, and material energy solver. Once all three pieces have been verified, the algorithms will then be coupled into a fully functioning method for applying NLem to the TRT equations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

One-sweep moment-based semi-implicit-explicit integration for gray thermal radiation transport

Thermal radiation transport (TRT) is a time dependent, high dimensional partial integro-differential equation. In practical applications such as inertial confinement fusion, TRT is coupled to other physics such as hydrodynamics, plasmas, etc., and the timescales one is interested in capturing are often much slower than the radiation timescale. As a result, TRT is treated implicitly, and due to its stiffness and high dimensionality, is often a dominant computational cost in multiphysics simulations. Here we develop a new approach for implicit-explicit (IMEX) integration of gray TRT in the deterministic SN setting, which requires only one sweep per stage, with the simplest first-order method requiring only one sweep per time step. The partitioning of equations is done via a moment-based high-order low-order formulation of TRT, where the streaming operator and first two moments are used to capture the asymptotic stiff regimes of the streaming limit and diffusion limit. Absorption-reemission is treated explicitly, and although stiff, is sufficiently damped by the implicit solve that we achieve stable accurate time integration without incorporating the coupling of the high order and low order equations implicitly. Due to nonlinear coupling of the high-order and low-order equations through temperature-dependent opacities, to facilitate IMEX partitioning and higher-order methods, we use a semi-implicit integration approach amenable to nonlinear partitions. In conclusion, results are demonstrated on thick Marshak and crooked pipe benchmark problems, demonstrating orders of magnitude improvement in accuracy and wallclock compared with the standard first-order implicit integration typically used.

97 MATHEMATICS AND COMPUTING↗

Classical-quantum simulation of non-equilibrium Marshak waves

In the radiation hydrodynamic simulations used to design inertial confinement fusion (ICF) and pulsed power experiments, nonlinear radiation diffusion tends to dominate CPU time. This raises the interesting question of whether a quantum algorithm can be found for nonlinear radiation diffusion which provides a quantum speedup. Recently, such a quantum algorithm was introduced based on a quantum algorithm for solving systems of nonlinear partial differential equations (PDEs) which provides a quadratic quantum speedup. Here, we apply this quantum PDE (QPDE) algorithm to the problem of a non-equilibrium Marshak wave propagating through a cold, semi-infinite, optically thick target, where the radiation and matter fields are not assumed to be in local thermodynamic equilibrium. The dynamics is governed by a coupled pair of nonlinear PDEs which are solved using the QPDE algorithm, as well as two standard PDE solvers: (i) Python's py-pde solver; and (ii) the KULL ICF simulation code developed at Lawrence-Livermore National Laboratory. We compare the simulation results obtained using the QPDE algorithm and the standard PDE solvers and find excellent agreement.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Understanding plasma turbulence through exact coherent structures

Plasma turbulence is a key challenge in understanding transport phenomena in magnetically confined plasmas. This work presents a generalized framework to analyze plasma turbulence that utilizes periodic orbit theory. In periodic orbit theory, doubly periodic solutions (coherent structures) of the governing equation(s) serve as building blocks of the considered turbulent dynamics. To illustrate the concept and method, the particularly simple Kuramoto–Sivashinsky (referred to here as LMRT for the original authors: LaQuey, Mahajan, Rutherford, and Tang) trapped-ion mode toy model is used. By applying numerical optimization techniques to the LMRT equation, we extract coherent spacetime patterns that represent the library of allowable fundamental structures of the equation. These structures provide a framework to systematically describe turbulence as a composition of recurrent solutions, revealing an underlying order within chaotic plasma motion. Although illustrated here using the simplified LMRT model for clarity, this framework provides a general strategy that can be extended to more complex and realistic models of plasma turbulence, including gyrokinetic systems. This offers a new method for predicting and potentially controlling transport processes in fusion plasmas by providing a bridge between nonlinear dynamical systems theory and plasma physics in the form of a generalized framework with which to analyze and understand spatially extended nonlinear partial differential equations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A long short-term memory embedding for hybrid uplifted reduced order models

In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov n -width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Finally, our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency.

42 ENGINEERING↗

Complex Dependence of Calcite Crack Kinetics on Salinity: The Role of DLVO and Hydration Forces

Abstract Subcritical crack growth (SCG) plays an important role in many geological processes such as delayed earth rupture and rock weathering. The complex dependency of SCG on the in‐crack fluid chemistry, however, is still poorly understood. In this study, we utilize the newly developed surface force‐based fracture theory (SFFT) to elucidate the relative contributions of surface forces and solute transport to the crack growth kinetics of calcite in NaCl solutions. Expanding on Barenblatt's cohesive crack model, SFFT introduces an effective stress intensity at the crack tip that encompasses all the relevant intermolecular forces across the crack in addition to the external far‐field stresses. The nonlinear system of equations portraying the crack opening profile, the solute distribution in a propagating crack, and the crack growth velocity are numerically solved via an implicit scheme. After carefully calibrating the model for calcite‐water systems, the SFFT is used to predict the SCG response of calcite at different NaCl concentrations, based on various hypotheses. These predictions are then compared to existing SCG data from the literature. We demonstrate that the experimentally observed variation of SCG rate with NaCl concentration cannot be explained solely by DLVO forces (electrostatic and Van der Waals interactions). This can be remediated by introducing an exponentially decaying hydration force with a nonlinear, nonmonotonic dependence on NaCl concentration. Furthermore, we demonstrate that accounting for both diffusive and advective transport of ions is important in explaining the absence of a stage‐II SCG response for calcite in electrolyte solutions. Plain Language Summary Subcritical crack growth (SCG) refers to the slow propagation of cracks in materials under a stress below the threshold for catastrophic failure. SCG is a key process in many geological events, for example, delayed earth ruptures and rock weathering. New initiatives such as underground CO 2 and H 2 storage in carbonate reservoirs further call for better understanding of SCG in carbonate minerals subjected to varying fluid chemistry. This study examines the SCG of calcite, a key mineral found in carbonate rocks, intergranular cement in sandstones, and filling material in mineral veins and faults, determining their deformation and strength. A mathematical model is developed to describe how the crack opens and propagates, how solutes (like salts) distribute within the crack, and how the crack surfaces interact with each other. We used the model to predict calcite SCG in water at different salt concentrations and compared it with experimental data. Our results revealed that the hydration force is the dominating factor in determining the complex, non‐linear dependency of SCG on salinity. We also found that both the movement of ions by diffusion and by bulk water flow are crucial for explaining the SCG rates, especially when the cracks grow quickly. Key Points Surface Force‐Based Fracture Theory predicts the complex subcritical crack growth patterns of calcite crystals immersed in NaCl solutions Results highlight the dominant role of hydration forces in altering the fracture behavior of calcite compared to VdW and electric double‐layer forces Advective solute transport explains the absence of stages‐II and ‐III subcritical crack growth responses in solid‐liquid systems

DLVO↗

Deep transfer operator learning for partial differential equations under conditional shift

Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.

42 ENGINEERING↗

New static solutions of symmetric $\phi^4$ equation

In this paper, we provide new exact solutions of nonlinear Klein–Gordon ( $\phi^4$) equation in 1 + 1-dimension. For simplicity, we focus on the static equation and ignore the time-dependence. The symmetric $\phi^4$ equation has played an important role in several areas of physics. We obtain several novel non-singular solutions of the symmetric $\phi^4$ model in terms of the Jacobi elliptic functions and compare them with the well-known solutions. Finally, we categorize these solutions in terms of the potential parameters.

36 MATERIALS SCIENCE↗