Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nonlinear equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Multilevel-in-width training for deep neural network regression

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible solutions so as to discourage overfitting while still enabling good solutions, and different regularization strategies impose different types of restrictions. In this paper, we present a multilevel regularization strategy that constructs and trains a hierarchy of neural networks, each of which has layers that are wider versions of the previous network's layers. Here, we draw intuition and techniques from the field of Algebraic Multigrid (AMG), traditionally used for solving linear and nonlinear systems of equations, and specifically adapt the Full Approximation Scheme (FAS) for nonlinear systems of equations to the problem of deep learning. Training through V-cycles then encourage the neural networks to build a hierarchical understanding of the problem. We refer to this approach as multilevel-in-width to distinguish from prior multilevel works which hierarchically alter the depth of neural networks. The resulting approach is a highly flexible framework that can be applied to a variety of layer types, which we demonstrate with both fully connected and convolutional layers. We experimentally show with PDE regression problems that our multilevel training approach is an effective regularizer, improving the generalize performance of the neural networks studied.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Scaling Analysis of Two–Phase Flow in Fractal Permeability Fields

Fluid mixing in permeable media is essential in many practical applications. The mixing process is a consequence of velocity fluctuations owing to geological heterogeneities and mobility contrast of fluids. Heterogeneities in natural rocks are often spatially correlated, and their properties, such as permeability, may be described using fractal distributions. This work models the fractal characteristics of such permeability fields in which the covariance function is expressed as a power-law function. A generalized scaling relation is derived relating various fractal permeability fields using the magnitude of their fluctuations. Here, this relation reveals the self-similar behavior of two-phase flow in such permeable media. To that end, a recently developed, high-resolution numerical simulator is employed to validate the analytically derived scaling relations. Two flow problems are considered in which flow is governed by 1) a linear, and 2) a nonlinear transport equation. Due to the probabilistic representation of the fractal permeability fields, a sensitivity study is conducted for each flow scenario to determine the number of realizations required for statistical convergence. Scaling analysis is performed using ensemble averages of simulated saturation profiles and their mixing lengths. Results support the validity of the developed scaling relation across the range of investigated flow conditions at intermediate times. The dynamics of linear flow in the asymptotic regime is affected by the correlation structure of heterogeneity. In nonlinear flow, scaling behavior appears to be dominated by the degree of nonlinearity.

58 GEOSCIENCES↗
DOE OSTI2026

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗
DOE OSTI2022

Molecular dynamics on quantum annealers

Abstract In this work we demonstrate a practical prospect of using quantum annealers for simulation of molecular dynamics. A methodology developed for this goal, dubbed Quantum Differential Equations (QDE), is applied to propagate classical trajectories for the vibration of the hydrogen molecule in several regimes: nearly harmonic, highly anharmonic, and dissociative motion. The results obtained using the D-Wave 2000Q quantum annealer are all consistent and quickly converge to the analytical reference solution. Several alternative strategies for such calculations are explored and it was found that the most accurate results and the best efficiency are obtained by combining the quantum annealer with classical post-processing (greedy algorithm). Importantly, the QDE framework developed here is entirely general and can be applied to solve any system of first-order ordinary nonlinear differential equations using a quantum annealer.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2025

Benchmark of numerical modeling approaches on the systematic performance evaluation of wave energy converters

Different numerical modeling methods have been developed and applied to evaluate a variety of performance indicators of wave energy converters (WECs), including the power performance, structural loads, levelized cost of energy, etc. Based on the modeling fidelity, the commonly used numerical modeling approaches can be classified as linear modeling, weakly nonlinear modeling and fully nonlinear modeling approaches. Each method differs in accuracy and computational efficiency, making them suitable for different stages of WEC design. However, the selection of modeling approach could significantly impact evaluation outcomes. For instance, simplified linear models may underestimate structural loads or overestimate energy production in some operational conditions, potentially leading to less cost-effective designs. Given the widespread utilization of these models, it is essential to understand the uncertainties brought by them in performance evaluations. This work is dedicated to benchmarking different linear-potential-flow-based numerical models for evaluating the systematic performance of WECs. Three representative numerical modeling approaches are considered in this work, including linear frequency-domain modeling, statistically linearized spectral-domain modeling and Cummins equation-based nonlinear time-domain modeling. A generic point absorber WEC is considered as the research reference in this work, and different sea sites are taken into account. The numerical models are utilized to predict critical performance indicators, including power performance, the annual energy production, the capacity factor, the levelized cost of energy and the PTO fatigue loads. By comparing the results, this work identifies the uncertainties associated with different modeling approaches in evaluating WEC performance.

Fatigue↗
DOE OSTI2024

Classifying photonic topology using the spectral localizer and numerical K -theory

Recently, the spectral localizer framework has emerged as an efficient approach for classifying topology in photonic systems featuring local nonlinearities and radiative environments. In nonlinear systems, this framework provides rigorous definitions for concepts such as topological solitons and topological dynamics, where a system’s occupation induces a local change in its topology due to nonlinearity. For systems embedded in radiative environments that do not possess a shared bulk spectral gap, this framework enables the identification of local topology and shows that local topological protection is preserved despite the lack of a common gap. However, as the spectral localizer framework is rooted in the mathematics of C*-algebras, and not vector bundles, understanding and using this framework requires developing intuition for a somewhat different set of underlying concepts than those that appear in traditional approaches for classifying material topology. In this tutorial, we introduce the spectral localizer framework from a ground-up perspective and provide physically motivated arguments for understanding its local topological markers and associated local measure of topological protection. In doing so, we provide numerous examples of the framework’s application to a variety of topological classes, including crystalline and higher-order topology. We then show how Maxwell’s equations can be reformulated to be compatible with the spectral localizer framework, including the possibility of radiative boundary conditions. To aid in this introduction, we also provide a physics-oriented introduction to multi-operator pseudospectral methods and numerical K-theory, two mathematical concepts that form the foundation for the spectral localizer framework. Finally, we provide some mathematically oriented comments on the C*-algebraic origins of this framework, including a discussion of real C*-algebras and graded C*-algebras that are necessary for incorporating physical symmetries. Looking forward, we hope that this tutorial will serve as an approachable starting point for learning the foundations of the spectral localizer framework.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The role of collective elasticity on activated structural relaxation, yielding, and steady state flow in hard sphere fluids and colloidal suspensions under strong deformation

In this work, we theoretically study the effect of external deformation on activated structural relaxation and aspects of the nonlinear mechanical response of glassy hard sphere fluids in the context of elastically collective nonlinear Langevin equation theory. This microscopic force-based approach describes activated relaxation as a coupled local–nonlocal event involving caging and longer range collective elasticity, with the latter becoming more important and ultimately dominant with increasing packing fraction under equilibrium conditions. The central new question we address is how this physical picture of activated relaxation, and the relative importance of local caging vs collective elasticity physics, depends on external deformation. Theoretical predictions are presented for deformation-induced enhancement of mobility, the onset of relaxation speed up at remarkably low values of stress, strain, or shear rate, apparent power law thinning of the steady state structural relaxation time and viscosity, a non-vanishing activation barrier in the shear thinning regime, an apparent Herschel–Bulkley form of the rate dependence of the steady state shear stress, exponential growth of different measures of a dynamic yield or flow stress with the packing fraction, and reduced fragility and dynamic heterogeneity under deformation. The results are contrasted with experiments and simulations, and qualitative or better agreement is found. An overarching conclusion is that deformation strongly reduces the importance of longer range collective elastic effects relative to the local caging aspect for most, but not all, physical questions, with deformation-dependent fragility and dynamic heterogeneity phenomena being qualitatively sensitive to collective elasticity. Overall, nonlinear rheology is predicted to be a more local problem than quiescent structural relaxation, albeit with deformation-modified activated processes still important.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Parallel-in-Time Solution of Hyperbolic PDE Systems via Characteristic-Variable Block Preconditioning

We consider the parallel-in-time solution of both linear and nonlinear hyperbolic partial differential equation (PDE) systems in one spatial dimension. In the nonlinear setting, the discretized equations are solved with a preconditioned residual iteration based on a global linearization. The linear(ized) equation systems are approximately solved parallel-in-time using a block preconditioner applied in the characteristic variables of the underlying linear(ized) hyperbolic PDE. This change of variables is motivated by the observation that intervariable coupling between characteristic variables is weak, at least locally where spatio-temporal variations in the eigenvectors of the associated flux Jacobian are sufficiently small, while that between the original variables is not. For an ℓ-dimensional system of PDEs, applying the preconditioner consists of solving a sequence of ℓ scalar linear(ized)-advection-like problems, each associated with a different characteristic wave-speed in the underlying linear(ized) PDE. Furthermore, we approximately solve these linear advection problems using multigrid reduction-in-time (MGRIT); however, any other suitable parallel-in-time method could be used. Numerical examples are shown for the (linear) acoustics equations in heterogeneous media and for the (nonlinear) shallow water equations and Euler equations of gas dynamics with shocks and rarefactions. For many test problems, the solver converges in just a handful of iterations and with mesh-independent convergence rates.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

High‐order symmetric cubature rules for tetrahedra and pyramids

Abstract In this article, we present an algorithm to construct high‐order fully symmetric cubature rules for tetrahedral and pyramidal elements, with positive weights and integration points that are in the interior of the domain. Cubature rules are fully symmetric if they are invariant to affine transformations of the domain. We divide the integration points into symmetry orbits where each orbit contains all the points generated by the permutation stars. These relations are represented by equality constraints. The construction of symmetric cubature rules require the solution of nonlinear polynomial equations with both inequality and equality constraints. For higher orders, we use an algorithm that consists of five sequential phases to produce the cubature rules. In the literature, symmetric numerical integration rules are available for the tetrahedron for orders p = 1 – 10, 14 , and for the pyramid up to p = 10 . We have obtained fully symmetric cubature rules for both of these elements up to order p = 20 . Numerical tests are presented that verify the polynomial‐precision of the cubature rules. Convergence studies are performed for the integration of exponential, weakly singular, and trigonometric test functions over both elements with flat and curved faces. With increase in p , improvements in accuracy is realized, though nonmonotonic convergence is observed.

Jaśkowiec, Jan↗
DOE OSTI2022

Landau discriminants

Scattering amplitudes in quantum field theories have intricate analytic properties as functions of the energies and momenta of the scattered particles. In perturbation theory, their singularities are governed by a set of nonlinear polynomial equations, known as Landau equations, for each individual Feynman diagram. The singularity locus of the associated Feynman integral is made precise with the notion of the Landau discriminant, which characterizes when the Landau equations admit a solution. In order to compute this discriminant, we present approaches from classical elimination theory, as well as a numerical algorithm based on homotopy continuation. These methods allow us to compute Landau discriminants of various Feynman diagrams up to 3 loops, which were previously out of reach. For instance, the Landau discriminant of the envelope diagram is a reducible surface of degree 45 in the three-dimensional space of kinematic invariants. We investigate geometric properties of the Landau discriminant, such as irreducibility, dimension and degree. In particular, we find simple examples in which the Landau discriminant has codimension greater than one. Furthermore, we describe a numerical procedure for determining which parts of the Landau discriminant lie in the physical regions. In order to study degenerate limits of Landau equations and bounds on the degree of the Landau discriminant, we introduce Landau polytopes and study their facet structure. Finally, we provide an efficient numerical algorithm for the computation of the number of master integrals based on the connection to algebraic statistics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Alluvial fan morphology: A self-similar free boundary problem description

In this work, we examine approximate geometrically self-similar solutions to a parabolic free boundary value problem applied to alluvial fan surface morphology and growth. Alluvial fans are fan- or cone-shaped sedimentary deposits caused by the rapid deposition of sediment from a canyon discharging onto a flatter plain. Longitudinal, topographic profiles of fans can be readily described by a seemingly time independent dimensionless profile (DeChant et al., 1999). However, because an alluvial fan can be expected to grow over time, it is clear that this “steady” profile is certainly time dependent and can be described using a space-time self-similar solution. In an experimental and theory-based study, Guerit et al. (2014) developed a self-similar (or as they describe it a self-affine) linear solution based upon an approximate first order small parameter expansion solution for a 1-d homogeneous nonlinear diffusion equation. Direct substitution of this result into a linear diffusion equation suggests that this first order expression may not fully satisfy the associated governing equation. In contrast, we develop a more complete solution based upon a modeled approximation for the axi-symmetric formulation such that the associated temporal behavior is consistent with a 1/3 time power-law as described by Reitz and Jerolmack (2014). The resulting expression is an exact solution to a linear heat equation. Furthermore, we emphasize that a small parameter is not inherent to the resulting profile result and is not included in our model development. Though developed using rather different approaches, the formal solution developed here is in good agreement with the simple polynomial described by DeChant et al. (1999) suggesting that this self-similar solution is a suitable time dependent representation of alluvial fan longitudinal profile form and improves on earlier work.

58 GEOSCIENCES↗
DOE OSTI2023

Adjoint DSMC for nonlinear spatially-homogeneous Boltzmann equation with a general collision model

We derive an adjoint method for the Direct Simulation Monte Carlo (DSMC) method for the spatially homogeneous Boltzmann equation with a general collision law. This generalizes our previous results in Caflisch et al., which was restricted to the case of Maxwell molecules, for which the collision rate is constant. The main difficulty in generalizing the previous results is that a rejection sampling step is required in the DSMC algorithm in order to handle the variable collision rate. We find a new term corresponding to the so-called score function in the adjoint equation and a new adjoint Jacobian matrix capturing the dependence of the collision parameter on the velocities. The new formula works for a much more general class of collision models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Thermodynamics–Structure–Dynamics Correlations and Nonuniversal Effects in the Elastically Collective Activated Hopping Theory of Glass-Forming Liquids

We employ the microscopic Elastically Collective Nonlinear Langevin Equation (ECNLE) theory of activated dynamics in combination with crystal-avoiding simulations to study four inter-related questions for metastable monodisperse hard sphere fluids. The first is how significantly improved integral equation theory structural input (Modified-Verlet (MV) closure) changes the dynamical predictions of ECNLE theory. The main consequence is a modest enhancement of the importance of the collective elastic barrier relative to its local cage contribution, which increases the alpha relaxation time and fragility relative to prior results based on the Percus–Yevick closure. Second, ECNLE-MV theory predictions for the alpha time and self-diffusion constant in the metastable regime are quantitatively compared to our new simulations. The small adjustment of a numerical prefactor that enters the collective elastic barrier leads to quantitative agreement over three decades. Third, using the more accurate MV structural input, ECNLE theory is shown to predict thermodynamics–structure–dynamics “correlations” based on various long and short wavelength scalar properties all related to static two-point collective density fluctuations. The logarithm of the alpha relaxation time scales as a power law with these scalar metrics with an exponent that is significantly lower in the less dense noncooperative activated regime compared to the very dense highly cooperative regime. However, the discovered correlation of activated relaxation with a thermodynamic property (dimensionless compressibility) is not causal in ECNLE theory, but rather reflects a strong connection between the local structural quantities that quantify kinetic constraints in the theory with the amplitude of long wavelength density fluctuations. Fourth, the consequences of chemically specific nonuniversalities associated with the onset condition and relative importance of collective elasticity are studied. In conclusion, the predicted thermodynamics–structure–dynamics correlations are found to be robust, albeit with nontrivial shifts of the onset condition.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Medium-Range Structural Order as the Driver of Activated Dynamics and Complexity Reduction in Glass-Forming Liquids

Here, we analyze in depth the Elastically Collective Nonlinear Langevin Equation theory of activated dynamics in metastable liquids to establish that the predicted inter-relationships between the alpha relaxation time, local cage and collective elastic barriers, dynamic localization length, and shear modulus are causally related within the theory to the medium range order (MRO) static correlation length. The latter grows exponentially with density for metastable hard sphere fluids and as a nonuniversal inverse power law with temperature for supercooled liquids under isobaric conditions. The physical origin of predicted connections between the alpha time and other metrics of cage order and the thermodynamic inverse dimensionless compressibility is fully established. It is discovered that although kinetic constraints from the real space first coordination shell are important for the alpha time, they are of secondary importance compared to the consequences of the more universal MRO correlations in both the modestly and deeply metastable regimes. This understanding sheds new light on the theoretical basis for, and prior successes of, the predictive mapping of chemically complex thermal liquids to effective hard sphere fluids based on matching their dimensionless compressibilities, a scheme we call “complexity reduction”. In essence, the latter is equivalent to the physical requirement that the thermal liquid MRO correlation equals that of its effective hard sphere analog. The mapping alone is shown to provide a remarkable level of quantitative predictive power for the glass transition temperature T g of 21 molecular and polymer liquids. Predictions for the chemically specific absolute magnitude and growth with cooling of the MRO correlation length are obtained and lie in the window of 2–6 nm at T g . Dynamic heterogeneity, elastic facilitation, and beyond pair structure issues are briefly discussed. Future opportunities to theoretically analyze the equilibrated deep glass regime are outlined.

cancer↗
DOE OSTI2020

Hot electrons between cold walls

We consider electron cooling in a collisionless plasma slab between two cold and freely emitting walls. Numerical calculations suggest a counterintuitive behavior of this system: the cooling rate slows down and eventually stops, leaving the system with a significant fraction of its initial thermal energy. Analytical treatment within the Vlasov–Poisson model reveals a set of steady-states with a two-component distribution of electrons: the primary electrons trapped within the potential wells and the secondary electrons forming the counterstreaming beams. We show that such steady-states are linearly stable with respect to one-dimensional perturbations. Establishment of a particular steady-state depends on initial conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Activated relaxation in supercooled monodisperse atomic and polymeric WCA fluids: Simulation and ECNLE theory

Here, we combine simulation and Elastically Collective Nonlinear Langevin Equation (ECNLE) theory to study the activated relaxation in monodisperse atomic and polymeric Weeks–Chandler–Andersen (WCA) liquids over a wide range of temperatures and densities in the supercooled regime under isochoric conditions. By employing novel crystal-avoiding simulations, metastable equilibrium dynamics is probed in the absence of complications associated with size polydispersity. Based on a highly accurate structural input from integral equation theory, ECNLE theory is found to describe well the simulated density and temperature dependences of the alpha relaxation time of atomic fluids using a single system-specific parameter, a c , that reflects the nonuniversal relative importance of local cage and collective elastic barriers. For polymer fluids, the explicit dynamical effect of local chain connectivity is modeled at the fundamental dynamic free energy trajectory level based on a different parameter, N c , that quantifies the degree of intramolecular correlation of bonded segment activated barrier hopping. For the flexible chain model studied, a physically intuitive value of N c ≈ 2 results in good agreement between simulation and theory. A direct comparison between atomic and polymeric systems reveals that chain connectivity can speed up activated segmental relaxation due to weakening of equilibrium packing correlations but can slow down relaxation due to local bonding constraints. The empirical thermodynamic scaling idea for the alpha time is found to work well at high densities or temperatures but fails when both density and temperature are low. The rich and subtle behaviors revealed from simulation for atomic and polymeric WCA fluids are all well captured by ECNLE theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Gravitational memory and compact extra dimensions

Here we develop a general formalism for treating radiative degrees of freedom near $\mathscr{I}^+$ in theories with an arbitrary Ricci-flat internal space. These radiative modes are encoded in a generalized news tensor which decomposes into gravitational, electromagnetic, and scalar components. We find a preferred gauge which simplifies the asymptotic analysis of the full nonlinear Einstein equations and makes the asymptotic symmetry group transparent. This asymptotic symmetry group extends the Bondi–Metzner–Sachs (BMS) group to include angle-dependent isometries of the internal space. We apply this formalism to study memory effects, which are expected to be observed in future experiments, that arise from bursts of higher-dimensional gravitational radiation. We outline how measurements made by gravitational wave observatories might probe properties of the compact extra dimensions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Uniform-density Bose-Einstein condensates of the Gross-Pitaevskii equation found by solving the inverse problem for the confining potential

Here, in this work, we consider a “reverse-engineering” approach to construct confining potentials that support exact, constant density kovaton solutions to the classical Gross-Pitaevskii equation (GPE) also known as the nonlinear Schr¨odinger equation (NLSE). In the one-dimensional case, the exact solution is the sum of stationary kink and anti-kink solutions, i.e. a kovaton, and in the overlapping region, the density is constant. In higher dimensions, the exact solutions are generalizations of this wave function. In the absence of self-interactions, the confining potential is similar to a smoothed out finite square well with minima also at the edges. When self-interactions are added, a term proportional to ±gψ*ψ gets added to the confining potential and ±gM, where M is the norm, gets added to the total energy. In the realm of stability analysis, we find (linearly) stable solutions in the case with repulsive self-interactions which also are stable to self-similar deformations. For attractive interactions, however, the minima at the edges of the potential get deeper and a barrier in the center forms as we increase the norm. This leads to instabilities at a critical value of M (related to the number of particles in the BEC). Comparing the stability criteria from Derrick’s theorem and Bogoliubov-de Gennes analysis stability results, we find that both predict stability for repulsive self-interactions and instability at a critical mass M for attractive interactions. However, the numerical analysis gives a much lower critical mass. The numerical analysis shows further that the initial instabilities violate the symmetry x → -x assumed by Derrick’s theorem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗