Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “differentiable manifold”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by projecting it onto a Grassmann manifold. This point-wise linear dimensionality reduction harnesses the structural information to assess the similarity between solutions at different points in the input parameter space. The method utilizes a solution clustering approach in order to identify regions of the parameter space over which solutions are sufficiently similarly such that they can be interpolated on the Grassmannian. In this clustering, the reduced-order solutions are partitioned into disjoint clusters on the Grassmann manifold using the eigen-structure of properly defined Grassmannian kernels and, the Karcher mean of each cluster is estimated. Then, the points in each cluster are projected onto the tangent space with origin at the corresponding Karcher mean using the exponential mapping. For each cluster, a Gaussian process regression model is trained that maps the input parameters of the system to the reduced solution points of the corresponding cluster projected onto the tangent space. Using this Gaussian process model, the full-field solution can be efficiently predicted at any new point in the parameter space. In certain cases, the solution clusters will span disjoint regions of the parameter space. In such cases, for each of the solution clusters we utilize a second, density-based spatial clustering to group their corresponding input parameter points in the Euclidean space. The proposed method is applied to two numerical examples. Here, the first is a nonlinear stochastic ordinary differential equation with uncertain initial conditions where the surrogate is used to predict the time history solution. The second involves modeling of plastic deformation in a model amorphous solid using the Shear Transformation Zone theory of plasticity, where the proposed surrogate is used to predict the full strain field of a material specimen under large shear strains.

42 ENGINEERING↗

ssys

`ssys` is a Python toolkit for exact algebraic transformation of ordinary differential equation (ODE) models into canonical S-system or Generalized Mass Action (GMA) form. Given a model in Antimony or SBML format, `ssys` produces a mathematically equivalent representation. The transformation introduces auxiliary variables as needed to decompose a broad class of nonlinearities into products of power-law terms. The recast is exact: the original and transformed systems have identical dynamics on the invariant constraint manifold defined by auxiliary variable definitions, given consistent initial conditions.

Hlavacek, William [Los Alamos National Laboratory]↗

Machine learning for the identification of phase transitions in interacting agent-based systems: A Desai-Zwanzig example

Deriving closed-form analytical expressions for reduced-order models, and judiciously choosing the closures leading to them, has long been the strategy of choice for studying phase- and noise-induced transitions for agent-based models (ABMs). In this paper, we propose a data-driven framework that pinpoints phase transitions for an ABM—the Desai-Zwanzig model—in its mean-field limit, using a smaller number of variables than traditional closed-form models. To this end, we use the manifold learning algorithm Diffusion Maps to identify a parsimonious set of data-driven latent variables, and we show that they are in one-to-one correspondence with the expected theoretical order parameter of the ABM. We then utilize a deep learning framework to obtain a conformal reparametrization of the data-driven coordinates that facilitates, in our example, the identification of a single parameter-dependent ordinary differential equation (ODE) in these coordinates. Additionally, we identify this ODE through a residual neural network inspired by a numerical integration scheme (forward Euler). We then use the identified ODE—enabled through an odd symmetry transformation—to construct the bifurcation diagram exhibiting the phase transition.

97 MATHEMATICS AND COMPUTING↗

LaSDI: Parametric Latent Space Dynamics Identification

Enabling fast and accurate physical simulations with data has become an important area of computational physics to aid in inverse problems, design-optimization, uncertainty quantification, and other various decision-making applications. This paper presents a data-driven framework for parametric latent space dynamics identification procedure that enables fast and accurate simulations. The parametric model is achieved by building a set of local latent space model and designing an interaction among them. An individual local latent space dynamics model achieves accurate solution in a trust region. By letting the set of trust region to cover the whole parameter space, our model shows an increase in accuracy with an increase in training data. Herein we introduce two different types of interaction mechanisms, i.e., point-wise and region-based approach. Both linear and nonlinear data compression techniques are used. We illustrate the framework of Latent Space Dynamics Identification (LaSDI) enable a fast and accurate solution process on various partial differential equations, i.e., Burgers’ equations, radial advection problem, and nonlinear heat conduction problem, achieving 0 (100)x speed-up and 0 (1)% relative error with respect to the corresponding full order models.

97 MATHEMATICS AND COMPUTING↗

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Data-driven Whitney forms for structure-preserving control volume analysis

Control volume analysis models physics via the exchange of generalized fluxes between subdomains. Here, we introduce a scientific machine learning framework adopting a partition of unity architecture to identify physically-relevant control volumes, with generalized fluxes between subdomains encoded via Whitney forms. The approach provides a differentiable parameterization of geometry which may be trained in an end-to-end fashion to extract reduced models from full field data while exactly preserving physics. The architecture admits a data-driven finite element exterior calculus allowing discovery of mixed finite element spaces with closed form quadrature rules. An equivalence between Whitney forms and graph networks reveals that the geometric problem of control volume learning is equivalent to an unsupervised graph discovery problem. The framework is developed for manifolds in arbitrary dimension, with examples provided for H(div) problems in $\mathbb{R}$ establishing convergence and structure preservation properties. Finally, we consider a lithium-ion battery problem where we discover a reduced finite element space encoding transport pathways from high-fidelity microstructure resolved simulations. The approach reduces the 5.89M finite element simulation to 136 elements while reproducing pressure to under 0.1% error and preserving conservation.

97 MATHEMATICS AND COMPUTING↗

Poincare: A Multi-Body, Multi-System Trajectory Design Tool

Poincare is a modular trajectory design tool based on a catalog of three-body science orbits and a differential corrector to compute connecting transfer arcs between orbits in multibody systems. Poincare attempts to offer a unified approach, i.e.,an“all-in-one”integrated search within one interface and setup in MONTE (JPL’s signature astrodynamic computing platform.) The Science Orbit Design Tool facilitates rapid and well-informed decisions regarding the selection of periodic orbits for a particular mission and enables the simultaneous study of various orbit alternatives. The Reference Trajectory Design Tool allows the user to calculate optimal transfer paths from a departure orbit to a science orbit via dynamical systems structures (invariant manifolds and Poincare maps), resulting in an end-to-end reference trajectory.

Senent, Juan↗

Decorated TQFTs and their Hilbert spaces

We discuss topological quantum field theories that compute topological invariants which depend on additional structures (or decorations) on three-manifolds. The q-series invariant $\hat{Z}$(q) proposed by Gukov, Pei, Putrov, and Vafa is an example of such an invariant. We describe how to obtain these decorated invariants by cutting and gluing and make a proposal for Hilbert spaces that are assigned to two-dimensional surfaces in the $\hat{Z}$-TQFT.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The geometric approach to sets of ordinary differential equations and Hamiltonian dynamics

The calculus of differential forms is used to discuss the local integration theory of a general set of autonomous first order ordinary differential equations. Geometrically, such a set is a vector field V in the space of dependent variables. Integration consists of seeking associated geometric structures invariant along V: scalar fields, forms, vectors, and integrals over subspaces. It is shown that to any field V can be associated a Hamiltonian structure of forms if, when dealing with an odd number of dependent variables, an arbitrary equation of constraint is also added. Families of integral invariants are an immediate consequence. Poisson brackets are isomorphic to Lie products of associated CT-generating vector fields. Hamilton's variational principle follows from the fact that the maximal regular integral manifolds of a closed set of forms must include the characteristics of the set.

Estabrook, F. B.↗

Short-Wave Infrared Upconverting Nanoparticles

Optical technologies enable real-time, noninvasive analysis of complex systems but are limited to discrete regions of the optical spectrum. While wavelengths in the short-wave infrared (SWIR) window (typically, 1700-3000 nm) should enable deep subsurface penetration and reduced photodamage, there are few luminescent probes that can be excited in this region. Here, we report the discovery of lanthanide-based upconverting nanoparticles (UCNPs) that efficiently convert 1740 or 1950 nm excitation to wavelengths compatible with conventional silicon detectors. Screening of Ln3+ ion combinations by differential rate equation modeling identifies Ho3+/Tm3+ or Tm3+ dopants with strong visible or NIR-I emission following SWIR excitation. Experimental upconverted photoluminescence excitation (U-PLE) spectra find that 10% Tm3+-doped NaYF4 core/shell UCNPs have the strongest 800 nm emission from SWIR wavelengths, while UCNPs with an added 2% or 10% Ho3+ show the strongest red emission when excited at 1740 or 1950 nm. Mechanistic modeling shows that addition of a low percentage of Ho3+ to Tm3+-doped UCNPs shifts their emission from 800 to 652 nm by acting as a hub of efficient SWIR energy acceptance and redistribution up to visible emission manifolds. Parallel experimental and computational analysis shows rate equation models are able to predict compositions for specific wavelengths of both excitation and emission. These SWIR-responsive probes open a new IR bioimaging window, and are responsive at wavelengths important for vision technologies.

Qi, Xiao↗

An inviscid three-dimensional analysis of the Space Shuttle main engine hot-gas manifold

A numerical study using an inviscid three-dimensional Lagrangian fluid dynamics code has been conducted as a part of an overall effort to understand the flow behavior in the SSME fuel side hot-gas manifold. The model simulates flow from the high-pressure fuel turbine exit through the transfer ducts, including the effects of swirl, inlet flow symmetry, and presence of straightening vanes and struts; a separate, more-detailed effort is in progress that includes viscosity and turbulence effects. The simplified model presented is divided into two parts, the first includes the 180-degree turnaround duct downstream of the turbine exit and the spherical fuel bowl section, while the second models the three transfer ducts. The two parts of the model are coupled together with the interface conditions being updated through iteration. Results indicate that a transverse pressure differential of 165 psi would be imposed on the turbine exit and that unstable flow separation occurs around the vanes, struts, and within the transfer ducts. The three transfer ducts show a mass flux split of approximately 41, 21, and 38 percent. Results to date are encouraging that certain flow characteristics can be usefuly represented using a relatively coarse grid inviscid code.

Liang, P. Y.↗

New Directions in Asymptotically Stable Finite-dimensional Adaptive Control of Linear Distributed Parameter Systems

Distributed Parameter Systems (DPS), such as systems described by partial differential equations, require infinite-dimensional state space descriptions to correctly model their dynamical behavior. However, any adaptive control algorithm must be finite-dimensional in order to be implemented via on-line digital computers. Finite-dimensional adaptive control of linear DPS requires stability analysis of nonlinear, time-varying, infinite-dimensional systems. The structure of nonadaptive finite-dimensional control of linear DPS is summarized as it relates to the existence of limiting systems for adaptive control. Two candidate schemes for finite-dimensional adaptive control of DPS are described and critical issues in infinite-dimensional stability analysis are discussed, in particular, the invariance principle, center manifold theory, and relationships between input-output and internal stability.

Balas, M. J.↗

A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems

Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10 n ), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides a cost-effective approach compared to alternative algorithms proposed in the literature, including recently proposed expensive deep neural network-based surrogates and can be readily applied for high-dimensional UQ in stochastic PDEs.

42 ENGINEERING↗

Inverse Trans Influence and Uranium-Arene σ-Bonding Drive Molecular Geometry: Ligand Modification from Hard to Soft Flips the Oxide from Axial to Equatorial

A rare example of an equatorially bound terminal uranium(V) oxo complex in a chelating sulfur-based ligand environment, namely [(mes( Me,Ad ArS) 3 )U V (O eq )(THF)] (2), is presented. Octahedrally coordinated 2 is obtained by reaction of the mesitylene-anchored tris-thiophenolate-coordinated uranium(III) complex [U III ((SAr Ad,Me ) 3 mes)] (1) with the oxygen-atom transfer reagent N 2 O. The observed, equatorially bound oxo ligand in 2 is in stark contrast to its known tris-aryloxide analog, [(mes( Me,Ad ArO) 3 )U V (O ax )(THF)] (A), where the oxo ligand occupies the typically observed axial coordination site. Complexes 1 and 2 are characterized by single-crystal X-ray diffraction analyses and spectroscopic and magnetochemical methods, including 1 H NMR, UV/vis/NIR electronic absorption, as well as EPR spectroscopy and SQUID magnetometry, thus confirming the C S symmetry and the pentavalent oxidation state of 2. Encompassing quantum chemical calculations (DFT and CASPT2) on 2 and its tris-phenolate analog A, support and rationalize the structural and electronic differences. The molecular orbital pictures show that a stabilizing σ-bonding interaction arising from the U–O eq inverse trans influence (ITI) is present in 2 but missing in A. In 2, the sulfur 3p orbitals are closer in energy to the uranium 5f manifold than the arene π-system, leading to an ITI, while U–arene σ- or δ-bonding is not observed. Although the arene orbitals remain separated from the uranium 5f orbitals in A, the absence of an ITI allows the arene a 2u orbital to engage in a σ-type interaction with the metal. Thus, incorporating a tris-thiophenolate to an arene anchor introduces a new design concept in molecular f-element chemistry. This approach stabilizes an equatorially bound U(V) oxo center, contrasting with its tris-phenolate counterpart, where oxo coordination is axial. The observed geometric divergence, driven by competing ITI and U–arene interactions, not only tunes electronic structure but also leads to differentiated reactivity: only the phenolate analogs activate H 2 O, while the thiolates do not.

Hydrocarbons↗

Self-Contained Compressed-Flow Generation Device for Use in Making Differential Measurements

A device used in making differential measurements of a flow includes a flow obstruction and a support arm. The flow obstruction's forward portion is a nose cone. The flow obstruction's aft portion is coupled to the nose cone. The support arm's first end is coupled to an exterior wall of a conduit, and its second end is coupled to the forward portion of the flow obstruction. The support arm positions the flow obstruction in the conduit such that a flow region is defined around its nose cone, and such that the support arm's first and second end are separated from one another with respect to a length dimension of the conduit. Measurement ports are provided in the support arm and flow obstruction. Manifolds extending through the flow obstruction and support arm couple the ports to points at the exterior wall of the conduit.

England, John Dwight↗

4-manifolds and topological modular forms

We build a connection between topology of smooth 4-manifolds and the theory of topological modular forms by considering topologically twisted compactification of 6d (1, 0) theories on 4-manifolds with flavor symmetry backgrounds. The effective 2d theory has (0, 1) supersymmetry and, possibly, a residual flavor symmetry. The equivariant topological Witten genus of this 2d theory then produces a new invariant of the 4-manifold equipped with a principle bundle, valued in the ring of equivariant weakly holomorphic (topological) modular forms. We describe basic properties of this map and present a few simple examples. As a byproduct, we obtain some new results on ’t Hooft anomalies of 6d (1, 0) theories and a better understanding of the relation between 2d (0, 1) theories and TMF spectra.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Excerpt from Oxygen Monitor Clean Testing Report Performed in 2010

The Rosemount X-STREAM Series X2GP is a paramagnetic oxygen analyzer with a 0-25% oxygen measurement range. It claims a drift less than 2% of span (0.10% volume oxygen) per week, and a response time of less than 5 seconds (for the analyzer to report 90% of a step change). Our test equipment was set-up such that the same gas was running through each oxygen analyzer at the same time. This allowed Calibration Error, Calibration Drift, and Loss of Power Testing to be run on all monitors at the same time, eliminating any variability between the analyzers from tolerances in the gas cylinder, ambient temperature, ambient pressure, test duration, etc. An APTech pressure regulator was placed on the gas cylinder manifold and a 23 psia Paroscientific pressure transducer measured the regulator’s outlet pressure. This did not give the inlet pressure on any one analyzer but outlet pressure from the manifold before the stream was split. The APTech pressure regulator was used to keep operating conditions consistent. A DWYER rotameter was installed on each oxygen monitor’s outlet piping. With the exception of Variation of Flow Rate Testing, the rotameter was left fully open for all testing. The flow rate through each oxygen monitor was controlled by a Swagelok needle valve that was installed on each analyzer’s inlet piping. Additionally, a filter was installed in the each monitor’s inlet piping to keep particles from the measurement cells and a Swagelok ball valve was installed on each monitor’s outlet piping to isolate each monitor between tests. No pumps were installed. Each of the cylinders used was at a pressure greater than ambient room barometric pressure. This pressure differential was used to move gas through the testing equipment. The flow rate through each analyzer was controlled by the Swagelok needle valve installed on each analyzer’s inlet piping. Finally, for all tests, a Paroscientific Digiquartz Barometer was used to measure ambient room barometric pressure and a Fluke Thermo-hygrometer was used to measure ambient room temperature.

47 OTHER INSTRUMENTATION↗

Learning physics-based reduced-order models from data using nonlinear manifolds

Here we present a novel method for learning reduced-order models of dynamical systems using nonlinear manifolds. First, we learn the manifold by identifying nonlinear structure in the data through a general representation learning problem. The proposed approach is driven by embeddings of low-order polynomial form. A projection onto the nonlinear manifold reveals the algebraic structure of the reduced-space system that governs the problem of interest. The matrix operators of the reduced-order model are then inferred from the data using operator inference. Numerical experiments on a number of nonlinear problems demonstrate the generalizability of the methodology and the increase in accuracy that can be obtained over reduced-order modeling methods that employ a linear subspace approximation.

97 MATHEMATICS AND COMPUTING↗