Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “nonlinear manifolds”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems

Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10 n ), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides a cost-effective approach compared to alternative algorithms proposed in the literature, including recently proposed expensive deep neural network-based surrogates and can be readily applied for high-dimensional UQ in stochastic PDEs.

42 ENGINEERING↗
DOE OSTI2020

Control of hybrid boosting in highly diluted internal combustion engines

A novel hybrid system enabling both flexible supercharging and limited torque assist is studied to mitigate transient response challenges of a turbocharged spark ignition engine equipped with low pressure exhaust gas recirculation. The hybrid system, called a power split supercharger (SC), is configured with a planetary gear set that splits the supercharging power between a small low-voltage electric motor and the engine crankshaft. The air path controller relies on the coordination of four actuators on the engine side and three low-level actuators on the hybrid boosting device. A decentralized control scheme is used in this work, in which the master–slave structure of the boost pressure controller decreases the turbo-lag associated with exhaust gas recirculation, while minimizing the SC operation for fuel economy. A vector reference governor is used to prevent compressor surge during engine tip-outs. In addition, the desired intake manifold pressure is modified to provide time for evacuating the exhaust gas recirculation and avoiding misfires when transitioning to low load, while the hybrid capability of the power split SC is used to recuperate the unwanted generated power. All controllers are validated on both a mean value engine model and a high-fidelity engine model. Practical challenges of implementing the vector reference governor to the highly nonlinear engine air path with pressure pulsations originating from the engine reciprocation are discussed and some solutions are proposed.

Engineering↗
DOE OSTI2020

Time scales for nonlinear processes in preheating after multifield inflation with nonminimal couplings

We have conducted extensive lattice simulations to study the postinflation dynamics of multifield models involving nonminimal couplings. In this work, we explore the parameter dependence of preheating in these models and describe the various time scales that control such nonlinear processes as energy transfer, rescattering, and the approach to radiation domination and thermalization. In the limit of large nonminimal couplings ($ξ_I$ ~ 100), we find that efficient transfer of energy from the inflaton condensate to radiative degrees of freedom, emergence of a radiation-dominated equation of state, and the onset of thermalization each consistently occur within $N_{\text{reh}} ≲ 3 e$-folds after the end of inflation, largely independent of the values of the other couplings in the models. The exception is the case of negative ellipticity, in which there is a misalignment between the dominant direction in field space along which the system evolves and the larger of the nonminimal couplings $ξ_I$. In those cases, the field-space-driven parametric resonance is effectively shut off. More generally, the competition between the scalar fields’ potential and the field-space manifold structure can yield interesting phenomena such as two-stage resonances. Across many regions of parameter space, we find efficient re-scattering between the distinct fields, leading to a partial memory loss of the shape of the initial fluctuation spectrum. Despite the explosive particle production, which can lead to a quick depletion of the background energy density, the nonlinear processes do not induce any superhorizon correlations after the end of inflation in these models, which keeps predictions for cosmic microwave background observables unaffected by the late-time amplification of isocurvature fluctuations. Hence the excellent agreement between primordial observables and recent observations is preserved for this class of models, even when we consider postinflation dynamics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
NASA NTRS1995

Energy Transfer in Rotating Turbulence

The influence or rotation on the spectral energy transfer of homogeneous turbulence is investigated in this paper. Given the fact that linear dynamics, e.g. the inertial waves regime tackled in an RDT (Rapid Distortion Theory) fashion, cannot Affect st homogeneous isotropic turbulent flow, the study of nonlinear dynamics is of prime importance in the case of rotating flows. Previous theoretical (including both weakly nonlinear and EDQNM theories), experimental and DNS (Direct Numerical Simulation) results are gathered here and compared in order to give a self-consistent picture of the nonlinear effects of rotation on tile turbulence. The inhibition of the energy cascade, which is linked to a reduction of the dissipation rate, is shown to be related to a damping due to rotation of the energy transfer. A model for this effect is quantified by a model equation for the derivative-skewness factor, which only involves a micro-Rossby number Ro(sup omega) = omega'/(2(OMEGA))-ratio of rms vorticity and background vorticity as the relevant rotation parameter, in accordance with DNS and EDQNM results fit addition, anisotropy is shown also to develop through nonlinear interactions modified by rotation, in an intermediate range of Rossby numbers (Ro(omega) = (omega)' and Ro(omega)w greater than 1), which is characterized by a marco-Rossby number Ro(sup L) less than 1 and Ro(omega) greater than 1 which is characterized by a macro-Rossby number based on an integral lengthscale L and the micro-Rossby number previously defined. This anisotropy is mainly an angular drain of spectral energy which tends to concentrate energy in tile wave-plane normal to the rotation axis, which is exactly both the slow and the two-dimensional manifold. In Addition, a polarization of the energy distribution in this slow 2D manifold enhances horizontal (normal to the rotation axis) velocity components, and underlies the anisotropic structure of the integral lengthscales. Finally is demonstrated the ability of a generalized EDQNM (Eddy Damped Quasi-Normal Markovian) model to predict the underlying spectral transfer structure and all the subsequent developments of classic anisotropy indicators in physical space, when compared to recent LES results. Even if the applications mainly concern developed strong turbulence, a particular emphasis is given to the strong formal analogy of this EDQNM2 model with recent weakly nonlinear approaches to wave-turbulence.

Cambon, Claude↗
DOE OSTI2023

Probabilistic-learning-based stochastic surrogate model from small incomplete datasets for nonlinear dynamical systems

We consider a high-dimensional nonlinear computational model of a dynamical system, parameterized by a vector-valued control parameter, in the presence of uncertainties represented by an uncontrolled parameter modeled by a vector-valued random variable, and possibly with stochastic excitation. The objective is to construct a statistical surrogate model where the input is any deterministic value of the control parameter, and the output is a vector-valued observation of the computational model, which is a random vector whose probability measure is updated using a target dataset. To construct this statistical surrogate model, the stochastic response of the computational model must be built, which is a vector-valued time-discretized stochastic process in high dimension, depending on the control parameter. It is assumed that the computational cost of a single evaluation of the deterministic model is high. For the probabilistic updating, we consider a subset of the components of the observation of the computational model, defined as the “identification observation” of the computational model, for which a small target dataset is available. Therefore, the target dataset is associated with partial observability, corresponding to an incomplete data case. Given a prior probability model of the random control and uncontrolled parameters, a training dataset is constructed, consisting of realizations of the random triplet composed of the stochastic response, the random identification observation, and the random control parameter. Since the computational cost of a single evaluation of the deterministic model is assumed to be large, the training dataset is also of small size. The main challenges in this problem are the high dimensionality, partial observability leading to incomplete data in the target dataset for the identification observation of the computational model (which is not sufficient to identify the computational stochastic responses), and the availability of a small training dataset. To address these challenges, we propose a methodology based on statistical methods for constructing necessary reduced representations, direct probabilistic learning under constraints using probabilistic learning on manifolds (PLoM) constrained by the target dataset, and the use of a weak formulation of the Fourier transform of probability measures. Statistical conditioning is also employed to explore the learned dataset. The constructed predictive statistical surrogate model can be implemented in the context of online computation. Here, we apply this approach to a problem of nonlinear stochastic dynamics in high dimensions within the framework of deformable solids mechanics.

Engineering↗
NASA NTRS1975

Comparison of NASTRAN and MITAS nonlinear thermal analyses of a convectively cooled structure

Comparative steady state nonlinear thermal analyses of a scramjet fuel injection strut are presented. The analyses were performed using the NASTRAN finite element program and MITAS, a lumped-parameter thermal analyzer. The strut is subjected to aerodynamic heating on two sides and is internally cooled by hydrogen flowing from internal manifolds through heat exchangers bonded to the primary structure. Based on coolant temperatures determined by MITAS, NASTRAN predicted temperature distributions throughout the strut which were in close agreement with similar MITAS predictions.

Thornton, E. A.↗
DOE OSTI2023

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators (surrogate models) for complex physico-chemical processes exhibiting highly non-smooth dynamics is challenging. The main question is what type of surrogate models we should construct and should these models be under-parameterized or over-parameterized. In this work, we propose new developments and perform comparisons for two promising approaches: manifold-based polynomial chaos expansion (m-PCE) and the deep neural operator (DeepONet), and we examine the effect of over-parameterization on generalization. While m-PCE enables the construction of a mapping by first identifying low-dimensional embeddings of the input functions, parameters, and quantities of interest (QoIs), a neural operator learns the nonlinear mapping via the use of deep neural networks. Here, we demonstrate the performance of these methods in terms of generalization accuracy by solving the 2D time-dependent Brusselator reaction-diffusion system with uncertainty sources, modeling an autocatalytic chemical reaction between two species. We first propose an extension of the m-PCE by constructing a mapping between latent spaces formed by two separate embeddings of the input functions and the output QoIs. To further enhance the accuracy of the DeepONet, we introduce weight self-adaptivity in the loss function. We demonstrate that the performance of m-PCE and DeepONet is comparable for cases of relatively smooth input-output mappings. However, when highly non-smooth dynamics is considered, DeepONet shows higher approximation accuracy. We also find that for m-PCE, modest over-parameterization leads to better generalization, both within and outside of distribution, whereas aggressive over-parameterization leads to over-fitting. In contrast, an even highly over-parameterized DeepONet leads to better generalization for both smooth and non-smooth dynamics. Furthermore, we compare the performance of the above models with another recently proposed operator learning model, the Fourier Neural Operator, and show that its over-parameterization also leads to better generalization. Taken together, our studies show that m-PCE can provide very good accuracy at very low training cost, whereas a highly over-parameterized DeepONet can provide better accuracy and robustness to noise but at higher training cost. In both methods, the inference cost is negligible.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Derivative-free optimization of a rapid-cycling synchrotron

Here, we develop and solve a constrained optimization model to identify an integrable optics rapid-cycling synchrotron lattice design that performs well in several capacities. Our model encodes the design criteria into 78 linear and nonlinear constraints, as well as a single nonsmooth objective, where the objective and some constraints are defined from the output of Synergia, an accelerator simulator. We detail the difficulties of the 23-dimensional simulation-constrained decision space and establish that the space is nonempty. We use a derivative-free manifold sampling algorithm to account for structured nondifferentiability in the objective function. Our numerical results quantify the dependence of solutions on constraint parameters and the effect of the form of objective function.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Interpretable and flexible non-intrusive reduced-order models using reproducing kernel Hilbert spaces

This paper develops an interpretable, non-intrusive reduced-order modeling technique using regularized kernel interpolation. Existing non-intrusive approaches approximate the dynamics of a reduced-order model (ROM) by solving a data-driven least-squares regression problem for low-dimensional matrix operators. Our approach instead leverages regularized kernel interpolation, which yields an optimal approximation of the ROM dynamics from a user-defined reproducing kernel Hilbert space. We show that our kernel-based approach can produce interpretable ROMs whose structure mirrors full-order model structure by embedding judiciously chosen feature maps into the kernel. The approach is flexible and allows a combination of informed structure through feature maps and closure terms via more general nonlinear terms in the kernel. We also derive a computable a posteriori error bound that combines standard error estimates for intrusive projection-based ROMs and kernel interpolants. In conclusion, the approach is demonstrated in several numerical experiments that include comparisons to operator inference using both proper orthogonal decomposition and quadratic manifold dimension reduction.

Data-driven model reduction↗
NASA NTRS1972

Controllability of nonlinear systems.

Discussion of the controllability of nonlinear systems described by the equation dx/dt - F(x,u). Concepts formulated by Chow (1939) and Lobry (1970) are applied to establish criteria for F and its derivatives to obtain qualitative information on sets which can be obtained from x which denotes a variable of state in an arbitrary, real, analytical manifold. It is shown that controllability implies strong accessibility for a large class of manifolds including Euclidean spaces.-

Sussmann, H. J.↗
NASA NTRS1982

Global differential geometry: An introduction for control engineers

The basic concepts and terminology of modern global differential geometry are discussed as an introduction to the Lie theory of differential equations and to the role of Grassmannians in control systems analysis. To reach these topics, the fundamental notions of manifolds, tangent spaces, vector fields, and Lie algebras are discussed and exemplified. An appendix reviews such concepts needed for vector calculus as open and closed sets, compactness, continuity, and derivative. Although the content is mathematical, this is not a mathematical treatise but rather a text for engineers to understand geometric and nonlinear control.

Doolin, B. F.↗
DOE OSTI2020

Gradient-based constrained optimization using a database of linear reduced-order models

A methodology grounded in model reduction is presented for accelerating the gradient-based solution of a family of linear or nonlinear constrained optimization problems where the constraints include at least one linear Partial Differential Equation (PDE). A key component of this methodology is the construction, during an offline phase, of a database of pointwise, linear, Projection-based Reduced-Order Models (PROM)s associated with a design parameter space and the linear PDE(s). A parameter sampling procedure based on an appropriate saturation assumption is proposed to maximize the efficiency of such a database of PROMs. A real-time method is also presented for interpolating at any queried but unsampled parameter vector in the design parameter space the relevant sensitivities of a PROM. The practical feasibility, computational advantages, and performance of the proposed methodology are demonstrated for several realistic, nonlinear, aerodynamic shape optimization problems governed by linear aeroelastic constraints.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Reduced‐Order Modeling of Energetic Materials Using Physics‐Aware Recurrent Convolutional Neural Networks in a Latent Space (LatentPARC)

Physics-aware deep learning (PADL) has gained popularity for use in spatiotemporal dynamics simulations, such as those in computational modeling of energetic materials (EM). We show that the challenge PADL methods face while learning complex field evolution problems can be simplified and accelerated by decoupling it into two tasks: learning complex geometric features in evolving fields and modeling dynamics over these features in a lower-dimensional feature space. We build upon our previous work on physics-aware recurrent convolutional neural networks (PARC). PARC embeds knowledge of underlying physics into its neural network architecture for more robust and accurate prediction of evolving physical fields. PARC was shown to effectively learn complex nonlinear features such as the formation of hotspots and coupled shock fronts in various initiation scenarios of EMs, as a function of microstructures, serving effectively as a microstructure-aware burn model. Here, we further accelerate PARC and reduce its computational cost by projecting the original dynamics onto a lower-dimensional invariant manifold, or “latent space.” The projected latent representation encodes the complex geometry of evolving fields (e.g., temperature and pressure) in a set of data-driven features. The reduced dimension of this latent space allows us to learn the dynamics during the initiation of EM with a lighter and more efficient model. We observe a significant decrease in training and inference time while maintaining results comparable to PARC at inference. This work takes steps towards enabling rapid prediction of EM thermomechanics at larger scales and characterization of EM structure–property–performance linkages at a full application scale.

Mathematics and Computing↗
DOE OSTI2024

VpROM: a novel variational autoencoder-boosted reduced order model for the treatment of parametric dependencies in nonlinear systems

Reduced Order Models (ROMs) are of considerable importance in many areas of engineering in which computational time presents difficulties. Established approaches employ projection-based reduction, such as Proper Orthogonal Decomposition. The limitation of the linear nature of such operators is typically tackled via a library of local reduction subspaces, which requires the assembly of numerous local ROMs to address parametric dependencies. Our work attempts to define a more generalisable mapping between parametric inputs and reduced bases for the purpose of generative modeling. We propose the use of Variational Autoencoders (VAEs) in place of the typically utilised clustering or interpolation operations, for inferring the fundamental vectors, termed as modes, which approximate the manifold of the model response for any and each parametric input state. The derived ROM still relies on projection bases, built on the basis of full-order model simulations, thus retaining the imprinted physical connotation. However, it additionally exploits a matrix of coefficients that relates each local sample response and dynamics to the global phenomena across the parametric input domain. The VAE scheme is utilised for approximating these coefficients for any input state. This coupling leads to a high-precision low-order representation, which is particularly suited for problems where model dependencies or excitation traits cause the dynamic behavior to span multiple response regimes. Moreover, the probabilistic treatment of the VAE representation allows for uncertainty quantification on the reduction bases, which may then be propagated to the ROM response. The performance of the proposed approach is validated on an open-source simulation benchmark featuring hysteresis and multi-parametric dependencies, and on a large-scale wind turbine tower characterised by nonlinear material behavior and model uncertainty.

Conditional VAEs↗
DOE OSTI2021

Excited-State Dynamics and Nonlinear Optical Properties of Hyperpolarizable Chromophores Based on Conjugated Bis(terpyridyl)Ru(II) and Palladium and Platinum Porphyrinic Components: Impact of Heavy Metals upon Supermolecular Electro-Optic Properties

A new series of strongly coupled oscillators based upon (porphinato)Pd, (porphinato)Pt, and bis(terpyridyl)-ruthenium(II) building blocks is described. These RuPPd, RuPPt, RuPPdRu, and RuPPtRu chromophores feature bis- (terpyridyl)Ru(II) moieties connected to the (porphinato)metal unit via an ethyne linker that bridges the 4!-terpyridyl and porphyrin macrocycle meso-carbon positions. Pump–probe transient optical data demonstrate sub-picosecond excited singlet-to-triplet-state relaxation. The relaxed lowest-energy triplet (T 1 ) excited states of these chromophores feature absorption manifolds that span the 800–1200 nm spectral region, microsecond triplet-state lifetimes, and large absorptive extinction coefficients [ε(T 1 → T n ) > 4 × 10 4 M –1 cm –1 ]. Dynamic hyperpolarizability (β λ ) values were determined from hyper-Rayleigh light scattering (HRS) measurements carried out at several incident irradiation wavelengths over the 800–1500 nm spectral region. Relative to benchmark RuPZn and RuPZnRu chromophores which showed large βHRS values over the 1200–1600 nm range, RuPPd, RuPPt, RuPPdRu, and RuPPtRu displayed large βHRS values over the 850–1200 nm region. Generalized Thomas–Kuhn sum (TKS) rules and experimental hyperpolarizability values were utilized to determine excited state-to-excited state transition dipole terms from experimental electronic absorption data and thus assessed frequency-dependent β λ values, including two- and three-level contributions for both β zzz and β xzx tensor components to the RuPPd, RuPPt, RuPPdRu, and RuPPtRu hyperpolarizability spectra. Furthermore, these analyses qualitatively rationalize how the βzzz and βxzx tensor elements influence the observed irradiation wavelength-dependent hyperpolarizability magnitudes. The TKS analysis suggests that supermolecules related to RuPPd, RuPPt, RuPPdRu, and RuPPtRu will likely feature intricate dependences of experimentally determined βHRS values as a function of irradiation wavelength that derive from substantial singlet–triplet mixing, and complex interactions among multiple different β tensor components that modulate the long wavelength regime of the nonlinear optical response.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2014

Bifurcation Analysis Using Rigorous Branch and Bound Methods

For the study of nonlinear dynamic systems, it is important to locate the equilibria and bifurcations occurring within a specified computational domain. This paper proposes a new approach for solving these problems and compares it to the numerical continuation method. The new approach is based upon branch and bound and utilizes rigorous enclosure techniques to yield outer bounding sets of both the equilibrium and local bifurcation manifolds. These sets, which comprise the union of hyper-rectangles, can be made to be as tight as desired. Sufficient conditions for the existence of equilibrium and bifurcation points taking the form of algebraic inequality constraints in the state-parameter space are used to calculate their enclosures directly. The enclosures for the bifurcation sets can be computed independently of the equilibrium manifold, and are guaranteed to contain all solutions within the computational domain. A further advantage of this method is the ability to compute a near-maximally sized hyper-rectangle of high dimension centered at a fixed parameter-state point whose elements are guaranteed to exclude all bifurcation points. This hyper-rectangle, which requires a global description of the bifurcation manifold within the computational domain, cannot be obtained otherwise. A test case, based on the dynamics of a UAV subject to uncertain center of gravity location, is used to illustrate the efficacy of the method by comparing it with numerical continuation and to evaluate its computational complexity.

Smith, Andrew P.↗
NASA NTRS1985

New Directions in Asymptotically Stable Finite-dimensional Adaptive Control of Linear Distributed Parameter Systems

Distributed Parameter Systems (DPS), such as systems described by partial differential equations, require infinite-dimensional state space descriptions to correctly model their dynamical behavior. However, any adaptive control algorithm must be finite-dimensional in order to be implemented via on-line digital computers. Finite-dimensional adaptive control of linear DPS requires stability analysis of nonlinear, time-varying, infinite-dimensional systems. The structure of nonadaptive finite-dimensional control of linear DPS is summarized as it relates to the existence of limiting systems for adaptive control. Two candidate schemes for finite-dimensional adaptive control of DPS are described and critical issues in infinite-dimensional stability analysis are discussed, in particular, the invariance principle, center manifold theory, and relationships between input-output and internal stability.

Balas, M. J.↗