Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “nonlinear manifolds”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

DRIPS: A framework for dimension reduction and interpolation in parameter space

Reduced-order models are often used to describe the behavior of complex systems, whose simulation with a full model is too expensive, or to extract salient features from the full model’s output. We introduce a new model-reduction framework DRIPS (dimension reduction and interpolation in parameter space) that combines the offline local model reduction with the online parameter interpolation of reduced-order bases (ROBs). The offline step of this framework relies on dynamic mode decomposition (DMD) to build a low-rank linear surrogate model, equipped with a local ROB, for quantities of interest derived from the training data generated by repeatedly solving the (nonlinear) high-fidelity model for multiple parameter points. The online step consists of the construction of a parametric reduced-order model for each target/test point in the parameter space, with the interpolation of ROBs done on a Grassman manifold and the interpolation of reduced-order operators done on a matrix manifold. The DMD component enables DRIPS to model (typically low-dimensional) quantities of interest directly, without having to access the (typically high-dimensional and possibly nonlinear) operators in a high-fidelity model that governs the dynamics of the underlying high-dimensional state variables, as required in projection-based reduced-order modeling. A series of numerical experiments suggests that DRIPS yields a model reduction, which is computationally more efficient than the commonly used projection-based proper orthogonal decomposition; it does so without requiring a prior knowledge of the governing equation for quantities of interest. Furthermore, for the nonlinear systems considered, DRIPS is more accurate than Gaussian-process interpolation (Kriging).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A long short-term memory embedding for hybrid uplifted reduced order models

In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov n -width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Finally, our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency.

42 ENGINEERING↗
DOE OSTI2026

Local reduced-order modeling for electrostatic plasmas by physics-informed solution manifold decomposition

Despite advancements in high-performance computing and modern numerical algorithms, computational cost remains prohibitive for multi-query kinetic plasma simulations. Here, in this work, we develop data-driven reduced-order models (ROMs) for collisionless electrostatic plasma dynamics, based on the kinetic Vlasov-Poisson equation. Our ROM approach projects the equation onto a linear subspace defined by the proper orthogonal decomposition (POD) modes. We introduce an efficient tensorial method to update the nonlinear term using a precomputed third-order tensor. We capture multiscale behavior with a minimal number of POD modes by decomposing the solution manifold into multiple time windows and creating temporally local ROMs. We consider two strategies for decomposition: one based on the physical time and the other based on the electric field energy. Applied to the 1D1V Vlasov–Poisson simulations, that is, prescribed E-field, Landau damping, and two-stream instability, we demonstrate that our ROMs accurately capture the total energy of the system both for parametric and time extrapolation cases. The temporally local ROMs are more efficient and accurate than the single ROM. In addition, in the two-stream instability case, we show that the energy-windowing reduced-order model (EW-ROM) is more efficient and accurate than the time-windowing reduced-order model (TW-ROM). With the tensorial approach, EW-ROM solves the equation approximately 90 times faster than Eulerian simulations while maintaining a maximum relative error of 7.5% for the training data and 11% for the testing data.

Electrostatic plasmas↗
DOE OSTI2024

Exploiting Power Flow Manifold to Solve AC Optimal Power Flow

AC optimal power flow has proven difficult to solve with interior point methods on GPUs. This is largely due to challenging linear algebra problems that current state of the art massively parallel linear solvers struggle with. However, the advent of Riemannian optimization techniques and the fact that the power flow equations form a smooth manifold present an alternative approach. In this talk, we present the basics of Riemannian optimization techniques in which optimization is done directly on a manifold. Then we present computational results showing that Riemannian techniques are capable of producing solutions of comparable quality as interior point methods.

AC optimal power flow↗
DOE OSTI2026

ssys

`ssys` is a Python toolkit for exact algebraic transformation of ordinary differential equation (ODE) models into canonical S-system or Generalized Mass Action (GMA) form. Given a model in Antimony or SBML format, `ssys` produces a mathematically equivalent representation. The transformation introduces auxiliary variables as needed to decompose a broad class of nonlinearities into products of power-law terms. The recast is exact: the original and transformed systems have identical dynamics on the invariant constraint manifold defined by auxiliary variable definitions, given consistent initial conditions.

Hlavacek, William [Los Alamos National Laboratory]↗
DOE OSTI2022

On-shell correlators and color-kinematics duality in curved symmetric spacetimes

We define a perturbatively calculable quantity — the on-shell correlator — which furnishes a unified description of particle dynamics in curved spacetime. Specializing to the case of flat and anti-de Sitter space, on-shell correlators coincide precisely with on-shell scattering amplitudes and boundary correlators, respectively. Remarkably, we find that symmetric manifolds admit a generalization of on-shell kinematics in which the corresponding momenta are literally the isometry generators of the spacetime acting on the external kinematic data. These isometric momenta are intrinsically non-commutative but exhibit on-shell conditions that are identical to those of flat space, thus providing a common language for computing and representing on-shell correlators which is agnostic about the underlying geometry. Afterwards, we compute tree-level on-shell correlators for biadjoint scalar (BAS) theory and the nonlinear sigma model (NLSM) and learn that color-kinematics duality is manifested at the level of fields under a mapping of the color algebra to the algebra of gauged isometries on the spacetime manifold. Last but not least, we present a field theoretic derivation of the fundamental BCJ relations for on-shell correlators following from the existence of certain conserved currents in BAS theory and the NLSM.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Data-Driven Modeling and Correction of Vehicle Dynamics

We develop a data-driven framework for learning and correcting nonautonomous vehicle dynamics. Physics-based vehicle models are often simplified for tractability and therefore exhibit inherent model-form uncertainty, motivating the need for data-driven correction. Moreover, nonautonomous dynamics are governed by time-dependent control inputs, which pose challenges in learning predictive models directly from temporal snapshot data. To address these, we reformulate the vehicle dynamics via a local parameterization of the time-dependent inputs, yielding a modified system composed ofa sequence of local parametric dynamical systems. Here, we approximate these parametric systems using two complementary approaches. First, we employ the dimension reduction and interpolation in parameter space (DRIPS) methodology to construct efficient linear surrogate models, equipped with lifted observable spaces and manifold-based operator interpolation. This enables data-efficient learning of vehicle models whose dynamics admit accurate linear representations in the lifted spaces. Second, for more strongly nonlinear systems, we employ flow map learning (FML), a deep neural network (DNN) approach that approximates the parametric evolution map without requiring special treatment of nonlinearities. We further extend FML with a transfer-learning-based model correction procedure, enabling the correction of misspecified prior models using only a sparse set of high-fidelity or experimental measurements, without assuming a prescribed form for the correction term. Through a suite of numerical experiments on unicycle, simplified bicycle, and slip-based bicycle models, we demonstrate that DRIPS offers robust and highly data-efficient learning of nonautonomous vehicle dynamics, while FML provides expressive nonlinear modeling and effective correction of model-form errors under severe data scarcity.

data-driven modeling↗
DOE OSTI2020

Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by projecting it onto a Grassmann manifold. This point-wise linear dimensionality reduction harnesses the structural information to assess the similarity between solutions at different points in the input parameter space. The method utilizes a solution clustering approach in order to identify regions of the parameter space over which solutions are sufficiently similarly such that they can be interpolated on the Grassmannian. In this clustering, the reduced-order solutions are partitioned into disjoint clusters on the Grassmann manifold using the eigen-structure of properly defined Grassmannian kernels and, the Karcher mean of each cluster is estimated. Then, the points in each cluster are projected onto the tangent space with origin at the corresponding Karcher mean using the exponential mapping. For each cluster, a Gaussian process regression model is trained that maps the input parameters of the system to the reduced solution points of the corresponding cluster projected onto the tangent space. Using this Gaussian process model, the full-field solution can be efficiently predicted at any new point in the parameter space. In certain cases, the solution clusters will span disjoint regions of the parameter space. In such cases, for each of the solution clusters we utilize a second, density-based spatial clustering to group their corresponding input parameter points in the Euclidean space. The proposed method is applied to two numerical examples. Here, the first is a nonlinear stochastic ordinary differential equation with uncertain initial conditions where the surrogate is used to predict the time history solution. The second involves modeling of plastic deformation in a model amorphous solid using the Shear Transformation Zone theory of plasticity, where the proposed surrogate is used to predict the full strain field of a material specimen under large shear strains.

42 ENGINEERING↗
DOE OSTI2022

Super-resonant four-photon collinear laser frequency multiplication in plasma

Resonant four-photon scattering could nearly double frequencies of intense laser pulses in plasma. However, transverse slippage between pulses presents a technological challenge, while collinear four-photon scattering is forbidden for classical light dispersion in plasma. Nonlinear renormalization of intense laser pulses can enable collinear four-photon resonance. However, such a very intensity-sensitive resonance is difficult to maintain for evolving pulses. Remarkably, there is a lower-dimensionality submanifold of the resonant four-photon manifold where the evolving pulses stay in resonance. Furthermore this could enable an all-optical frequency doubling of mildly relativistic-intense laser pulses in collinear geometry, advantageously free of the transverse slippage challenges.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Hamiltonian reduction of Vlasov–Maxwell to a dark slow manifold

In this work, we show that non-relativistic scaling of the collisionless Vlasov–Maxwell system implies the existence of a formal invariant slow manifold in the infinite-dimensional Vlasov–Maxwell phase space. Vlasov–Maxwell dynamics restricted to the slow manifold recovers the Vlasov–Poisson and Vlasov–Darwin models as low-order approximations, and provides higher-order corrections to the Vlasov–Darwin model more generally. The slow manifold may be interpreted to all orders in perturbation theory as a collection of formal Vlasov–Maxwell solutions that do not excite light waves, and are therefore ‘dark’. We provide a heuristic lower bound for the time interval over which Vlasov–Maxwell solutions initialized optimally near the slow manifold remain dark. We also show how the dynamics on the slow manifold naturally inherits a Hamiltonian structure from the underlying system. After expressing this structure in a simple form, we use it to identify a manifestly Hamiltonian correction to the Vlasov–Darwin model. The derivation of higher-order terms is reduced to computing the corrections of the system Hamiltonian restricted to the slow manifold.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Cavity molecular dynamics simulations of vibrational polariton-enhanced molecular nonlinear absorption

We report recent experiments have observed that the chemical and photophysical properties of molecules can be modified inside an optical Fabry– Pérot microcavity under collective vibrational strong coupling (VSC) conditions, and such modification is currently not well understood by theory. In an effort to understand the origin of such cavity-induced phenomena, some recent studies have focused on the effect of the cavity environment on the nonlinear optical response of the molecular subsystem. Here, we use a recently proposed protocol for classical cavity molecular dynamics simulations to numerically investigate the linear and the nonlinear response of liquid carbon dioxide under such VSC conditions following an optical pulse excitation. We find that applying a strong pulse of excitation to the lower hybrid light–matter state, i.e., the lower polariton (LP), can lead to an overall molecular nonlinear absorption that is enhanced by up to two orders of magnitude relative to the excitation outside the cavity. This polariton-enhanced multiphoton absorption also causes an ultrashort LP lifetime (0.2 ps) under strong illumination. Unlike usual polariton relaxation processes—whereby polaritonic energy transfers directly to the manifold of singly excited vibrational dark states—under the present mechanism, the LP transfers energy directly to the manifold of higher vibrationally excited dark states; these highly excited dark states subsequently relax to the manifold of singly excited states with a lifetime of tens of ps. Because the present mechanism is generic in nature, we expect these numerical predictions to be experimentally observed in different molecular systems and in cavities with different volumes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Extended harmonic mapping connects the equations in classical, statistical, fluid, quantum physics and general relativity

Abstract One potential pathway to find an ultimate rule governing our universe is to hunt for a connection among the fundamental equations in physics. Recently, Ren et al. reported that the harmonic maps with potential introduced by Duan, named extended harmonic mapping (EHM), connect the equations of general relativity, chaos and quantum mechanics via a universal geodesic equation. The equation, expressed as Euler–Lagrange equations on the Riemannian manifold, was obtained from the principle of least action. Here, we further demonstrate that more than ten fundamental equations, including that of classical mechanics, fluid physics, statistical physics, astrophysics, quantum physics and general relativity, can be connected by the same universal geodesic equation. The connection sketches a family tree of the physics equations, and their intrinsic connections reflect an alternative ultimate rule of our universe, i.e. , the principle of least action on a Finsler manifold.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems

Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10 n ), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides a cost-effective approach compared to alternative algorithms proposed in the literature, including recently proposed expensive deep neural network-based surrogates and can be readily applied for high-dimensional UQ in stochastic PDEs.

42 ENGINEERING↗
DOE OSTI2020

Control of hybrid boosting in highly diluted internal combustion engines

A novel hybrid system enabling both flexible supercharging and limited torque assist is studied to mitigate transient response challenges of a turbocharged spark ignition engine equipped with low pressure exhaust gas recirculation. The hybrid system, called a power split supercharger (SC), is configured with a planetary gear set that splits the supercharging power between a small low-voltage electric motor and the engine crankshaft. The air path controller relies on the coordination of four actuators on the engine side and three low-level actuators on the hybrid boosting device. A decentralized control scheme is used in this work, in which the master–slave structure of the boost pressure controller decreases the turbo-lag associated with exhaust gas recirculation, while minimizing the SC operation for fuel economy. A vector reference governor is used to prevent compressor surge during engine tip-outs. In addition, the desired intake manifold pressure is modified to provide time for evacuating the exhaust gas recirculation and avoiding misfires when transitioning to low load, while the hybrid capability of the power split SC is used to recuperate the unwanted generated power. All controllers are validated on both a mean value engine model and a high-fidelity engine model. Practical challenges of implementing the vector reference governor to the highly nonlinear engine air path with pressure pulsations originating from the engine reciprocation are discussed and some solutions are proposed.

Engineering↗
DOE OSTI2020

Time scales for nonlinear processes in preheating after multifield inflation with nonminimal couplings

We have conducted extensive lattice simulations to study the postinflation dynamics of multifield models involving nonminimal couplings. In this work, we explore the parameter dependence of preheating in these models and describe the various time scales that control such nonlinear processes as energy transfer, rescattering, and the approach to radiation domination and thermalization. In the limit of large nonminimal couplings ($ξ_I$ ~ 100), we find that efficient transfer of energy from the inflaton condensate to radiative degrees of freedom, emergence of a radiation-dominated equation of state, and the onset of thermalization each consistently occur within $N_{\text{reh}} ≲ 3 e$-folds after the end of inflation, largely independent of the values of the other couplings in the models. The exception is the case of negative ellipticity, in which there is a misalignment between the dominant direction in field space along which the system evolves and the larger of the nonminimal couplings $ξ_I$. In those cases, the field-space-driven parametric resonance is effectively shut off. More generally, the competition between the scalar fields’ potential and the field-space manifold structure can yield interesting phenomena such as two-stage resonances. Across many regions of parameter space, we find efficient re-scattering between the distinct fields, leading to a partial memory loss of the shape of the initial fluctuation spectrum. Despite the explosive particle production, which can lead to a quick depletion of the background energy density, the nonlinear processes do not induce any superhorizon correlations after the end of inflation in these models, which keeps predictions for cosmic microwave background observables unaffected by the late-time amplification of isocurvature fluctuations. Hence the excellent agreement between primordial observables and recent observations is preserved for this class of models, even when we consider postinflation dynamics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
DOE OSTI2023

Probabilistic-learning-based stochastic surrogate model from small incomplete datasets for nonlinear dynamical systems

We consider a high-dimensional nonlinear computational model of a dynamical system, parameterized by a vector-valued control parameter, in the presence of uncertainties represented by an uncontrolled parameter modeled by a vector-valued random variable, and possibly with stochastic excitation. The objective is to construct a statistical surrogate model where the input is any deterministic value of the control parameter, and the output is a vector-valued observation of the computational model, which is a random vector whose probability measure is updated using a target dataset. To construct this statistical surrogate model, the stochastic response of the computational model must be built, which is a vector-valued time-discretized stochastic process in high dimension, depending on the control parameter. It is assumed that the computational cost of a single evaluation of the deterministic model is high. For the probabilistic updating, we consider a subset of the components of the observation of the computational model, defined as the “identification observation” of the computational model, for which a small target dataset is available. Therefore, the target dataset is associated with partial observability, corresponding to an incomplete data case. Given a prior probability model of the random control and uncontrolled parameters, a training dataset is constructed, consisting of realizations of the random triplet composed of the stochastic response, the random identification observation, and the random control parameter. Since the computational cost of a single evaluation of the deterministic model is assumed to be large, the training dataset is also of small size. The main challenges in this problem are the high dimensionality, partial observability leading to incomplete data in the target dataset for the identification observation of the computational model (which is not sufficient to identify the computational stochastic responses), and the availability of a small training dataset. To address these challenges, we propose a methodology based on statistical methods for constructing necessary reduced representations, direct probabilistic learning under constraints using probabilistic learning on manifolds (PLoM) constrained by the target dataset, and the use of a weak formulation of the Fourier transform of probability measures. Statistical conditioning is also employed to explore the learned dataset. The constructed predictive statistical surrogate model can be implemented in the context of online computation. Here, we apply this approach to a problem of nonlinear stochastic dynamics in high dimensions within the framework of deformable solids mechanics.

Engineering↗
DOE OSTI2023

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗