Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “nonlinear model order reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A Tailored Convolutional Neural Network for Nonlinear Manifold Learning of Computational Physics Data Using Unstructured Spatial Discretizations

In this work, we propose a nonlinear manifold learning technique based on deep convolutional autoencoders that is appropriate for model order reduction of physical systems in complex geometries. Convolutional neural networks have proven to be highly advantageous for compressing data arising from systems demonstrating a slow-decaying Kolmogorov n-width. However, these networks are restricted to data on structured meshes. Unstructured meshes are often required for performing analyses of real systems with complex geometry. Our custom graph convolution operators based on the available differential operators for a given spatial discretization effectively extend the application space of deep convolutional autoencoders to systems with arbitrarily complex geometry that are typically discretized using unstructured meshes. We propose sets of convolution operators based on the spatial derivative operators for the underlying spatial discretization, making the method particularly well suited to data arising from the solution of partial differential equations. We demonstrate the method using examples from heat transfer and fluid mechanics and show better than an order of magnitude improvement in accuracy over linear methods.

97 MATHEMATICS AND COMPUTING↗

Physics-Informed Active Learning With Simultaneous Weak-Form Latent Space Dynamics Identification

The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. Here, to enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form gLaSDI (WgLaSDI) framework, an autoencoder and WENDy are trained simultaneously to discover intrinsic nonlinear latent-space dynamics of high-dimensional data. Compared with the standard sparse identification of nonlinear dynamics (SINDy) employed in gLaSDI, WENDy enables variance reduction and robust latent space discovery, therefore leading to more accurate and efficient reduced-order modeling. Furthermore, the greedy physics-informed active learning in WgLaSDI enables adaptive sampling of optimal training data on the fly for enhanced modeling accuracy. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including viscous and inviscid Burgers' equations, time-dependent radial advection, and the Vlasov equation for plasma physics. With data that contains 5%–10% Gaussian white noise, WgLaSDI outperforms gLaSDI by orders of magnitude, achieving 1%–7% relative errors. Compared with the high-fidelity models, WgLaSDI achieves 121 to 1779x speed-up.

97 MATHEMATICS AND COMPUTING↗

Preconditioning for Hyper-reduction in Reduced Order Models

Many projection-based reduced order models (pROM) that utilize the governing equation and data to accelerate physical simulations can be applied to nonlinear dynamical systems. To avoid full order model (FOM) scale update for each time step, hyperreduction techniques are developed to sample high dimensional nonlinear terms. Our study aims to investigate if preconditioning the least-squares problem used for the nonlinear approximation can improve the robustness of the condition number of the problem while achieving high accuracy. In our study, we use the row-normalization matrix motivated by the Christoffel function as the preconditioner and solve the corresponding weighted least-squares problem. Numerical results for Lagrangian hydrodynamics examples are analyzed to explore how the preconditioner works compared to existing hyper-reduction techniques.

97 MATHEMATICS AND COMPUTING↗

Optimal fixed-finite-dimensional compensator for Burgers' equation with unbounded input/output operators

The problem of using reduced order dynamic compensators to control a class of nonlinear parabolic distributed parameter systems was considered. Concentration was on a system with unbounded input and output operators governed by Burgers' equation. A linearized model was used to compute low-order-finite-dimensional control laws by minimizing certain energy functionals. Then these laws were applied to the nonlinear model. Standard approaches to this problem employ model/controller reduction techniques in conjunction with linear quadratic Gaussian (LQG) theory. The approach used is based on the finite dimensional Bernstein/Hyland optimal projection theory which yields a fixed-finite-order controller.

Burns, John A.↗

The determination of third order linear models from a seventh order nonlinear jet engine model

Results are presented that demonstrate how good reduced-order models can be obtained directly by recursive parameter identification using input/output (I/O) data of high-order nonlinear systems. Three different methods of obtaining a third-order linear model from a seventh-order nonlinear turbojet engine model are compared. The first method is to obtain a linear model from the original model and then reduce the linear model by standard reduction techniques such as residualization and balancing. The second method is to identify directly a third-order linear model by recursive least-squares parameter estimation using I/O data of the original model. The third method is to obtain a reduced-order model from the original model and then linearize the reduced model. Frequency responses are used as the performance measure to evaluate the reduced models. The reduced-order models along with their Bode plots are presented for comparison purposes.

Lalonde, Rick J.↗

A fundamental theorem for the model reduction of nonlinear systems

A simple, but fundamental, theorem is given on the extent to which a nonlinear system model can have its order reduced. Essentially, the result is that the order, or the dimension of the state space representation, cannot be reduced to, or below, the dimension of the system's attractor. Several examples are given to illustrate this point. The result is especially applicable to higher order systems such as the infinite dimensional systems arising from the modeling of distributed parameter systems.

Mossayebi, Faramarz↗

A Physics-Based Data-Driven Approach for Modeling of Environmental Degradation in Elastomers

Abstract Elastomers are now commonly used in a number of industries, including aerospace, structure, transportation, shipbuilding, and automotive, due to their excellent workability, formability, and flexibility. During their activity, elastomers are subjected to harsh environmental conditions, which decreases their resilience. False predictions made early in their lives can have major financial and environmental implications. Elastomers’ performance and properties, such as strength, durability, and density, are influenced by chemical changes in these materials, known as degradation, which occurs over time. This process can alter the morphology of a polymer matrix as well as cause chain scission and cross-linking, resulting in different behaviors than that of the unaged material. To demonstrate the effect of thermaloxidative aging on the mechanical behavior of elastomers, several experimental and theoretical models have been proposed. In view of the large volume of experimental data available on micro-structural evolution in the course of aging, we propose a physics-based data-driven approach to overcome the shortcomings of both phenomenological and micro-mechanical models. This work presents a novel thermodynamically consistent, multiagent machine-learned model for predicting the constitutive behavior of cross-linked elastomers during environmental aging, such as thermo-oxidative and hydrolytic aging for various states of deformation. Single mechanism degradation changes the polymer matrix over time where it is causing chain scission, reduction of cross-links, and morphology change. To capture the idealized Mullins effect and permanent set due to the effect of single aging mechanisms on nonlinear mechanical responses of elastomers, we propose a data-driven model for simulating inelastic elements in a polymer matrix. By using a sequential order reduction, we were able to reduce the 3D stress-strain tensor mapping problem to a small number of super-constrained 1D mapping problems. To systematically classify such mapping problems into a few categories, an assembly of multiple replicated conditional neural network learning agents (L-agents) is used based on our recent work. Each category is represented by a different type of agent. The effect of deformation history, aging time, and aging temperature is captured by this model. The model is validated using a broad collection of data, ranging from our experimental results to data from the literature. In addition, thermodynamic consistency and frame independence are investigated. The most significant achievements of this model are its precision, simplicity, and prediction of inelasticity under various states of deformation. The model’s accuracy and simplicity make it a good option for commercial and industrial applications. Conveniently, due to the model modular nature, it can be expanded in the future to include viscoelasticity and non-isotropic formation for better precision.

Ghaderi, Aref↗

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.↗

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗

Proper orthogonal decomposition based reduced-order modeling of flux-Limited gray thermal radiation

Here, in this work, a proper orthogonal decomposition (POD) based reduced-order model (ROM) is developed to solve gray, flux-limited thermal radiation diffusion. We focus on the variable opacity radiation penetration benchmark posed by Olson, Auer, and Hall. The T -3 relationship for opacity in conjunction with high-temperature radiation penetrating an initially cold material produces a strong thermal radiation shock. This class of problems is particularly challenging for standard POD-based reduced-order modeling due to the nonlinearities presented by 1) the T 4 source term, and 2) flux-limited diffusion operator. To address these challenges and develop a cost competitive ROM, we employ a “hyper-reduction” technique through discrete empirical interpolation (DEIM) and allow for adaptive reduced-order projections through principal interval decomposition (PID). Performance of the proposed methodology is quantified by comparing the cost savings and accuracy relative to a full-order computation. Reference solutions and snapshot data are obtained through a full-order calculation performed by the University of Chicago maintained astrophysics code, FLASH. For consistency and potential extensibility, the developed ROM is also implemented in FLASH. We find that in the initialization regime, where the thermal radiation wave is initially created by the warming of the material, this class of problems is highly reducible and suitable for POD-based ROMs. However, the strong convective nature of the wave propagation regime is less reducible and more challenging to create an efficient ROM.

42 ENGINEERING↗

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗

Statistical Learning for Nonlinear Model Reduction from Local Simulations of Stochastic and Particle- and Agent-Based Systems

Stochastic physical systems across the sciences that have very high-dimensional state spaces, with a large number of fast degrees of freedom that force direct simulators to proceed by integration steps that are orders of magnitude smaller than events of interests (e.g., particle collisions). Examples range from molecular motion to dynamics of large populations of cells. A grand challenge in the simulation and understanding of such systems is the systematic construction of accurate, interpretable, reduced models, enabling faster simulations, revealing fundamental properties of the dynamics, and predicting phenomena of interest that the original simulator could not reached with sufficient accuracy or within a given computational budget. In this projected we developed novel statistical estimation/machine learning techniques for analyzing and building empirical reduced models for important families of high-dimensional stochastic systems, in particular: - we developed techniques for estimating interaction kernels in interacting particle- and agent-based systems, which are ubiquitous in Physics, Biology and many other sciences, given observed trajectories of the system; - we developed techniques for nonlinear model reduction for high-dimensional stochastic systems that have a small number of unknown, nonlinear slow variables, and a large number of fast modes, that are possibly of large magnitude, given observed short trajectories of the system in the form of bursts of trajectories from different initial conditions; - we developed novel techniques for estimating linear dynamical systems on graphs when both the dynamics and the underlying graph are unknown, and we have a sparse set of space-time observations; - we considered the problem of estimating an unknown nonlinear observation function of a standard process (e.g. Brownian motion), so that we can recognized if an observed dynamics is "just" a nonlinear version of a known dynamics; we also developed benchmarks for learning algorithms aimed at learning and classifying diffusion processes.

97 MATHEMATICS AND COMPUTING↗

Nonlinear proper orthogonal decomposition for convection-dominated flows

Autoencoder techniques find increasingly common use in reduced order modeling as a means to create a latent space. This reduced order representation offers a modular data-driven modeling approach for nonlinear dynamical systems when integrated with a time series predictive model. In this Letter, we put forth a nonlinear proper orthogonal decomposition (POD) framework, which is an end-to-end Galerkin-free model combining autoencoders with long short-term memory networks for dynamics. By eliminating the projection error due to the truncation of Galerkin models, a key enabler of the proposed nonintrusive approach is the kinematic construction of a nonlinear mapping between the full-rank expansion of the POD coefficients and the latent space where the dynamics evolve. We test our framework for model reduction of a convection-dominated system, which is generally challenging for reduced order models. Our approach not only improves the accuracy, but also significantly reduces the computational cost of training and testing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Generation of linear dynamic models from a digital nonlinear simulation

The results and methodology used to derive linear models from a nonlinear simulation are presented. It is shown that averaged positive and negative perturbations in the state variables can reduce numerical errors in finite difference, partial derivative approximations and, in the control inputs, can better approximate the system response in both directions about the operating point. Both explicit and implicit formulations are addressed. Linear models are derived for the F 100 engine, and comparisons of transients are made with the nonlinear simulation. The problem of startup transients in the nonlinear simulation in making these comparisons is addressed. Also, reduction of the linear models is investigated using the modal and normal techniques. Reduced-order models of the F 100 are derived and compared with the full-state models.

Daniele, C. J.↗

A method for high order linear system reduction and nonlinear system simplification

Least-squares-type algorithms for reducing the order of linear systems in the frequency domain and simplifying nonlinear systems in time domain are developed and demonstrated. The possible model structures are represented as nodes in a tree, and costs along the branches are assigned using the repeated-Gram-Schmidt orthogonalization procedure of Desrochers and Saridis (1980), permitting identification of the optimal n-term model by searching the tree to depth n, with no need for parameter identification. The efficiency and flexibility of the algorithms is shown in applications to the eighth-order linear system studied by Hsia (1972), a three-state eight-nonlinear-term aircraft-dynamics problem, and the related linear-controller problem (Garrard and Jordan, 1977).

Desrochers, A. A.↗

A pointing system design concept for Space Station attached payloads

A study has been conducted to recommend a pointing system design and architecture that can accommodate the articulated pointing requirements levied on the Space Station Freedom Attached Payload Pointing System. A conceptual design of a control system is developed using classical rate and position control techniques. A high fidelity simulation testbed has been developed as the principal tool for the pointing performance evaluation. Techniques of model reduction are applied to reduce the model order to a manageable size for incorporation into the testbed. The disturbance rich space station environment has been modeled, and nonlinearities such as bearing friction, motor and sensor noise are also considered. Simulations were performed with representatie payloads at nominal pointing orientations. The results show that the tight instrument pointing requirements and the severe Space Station disturbance environment render a marginal performance for a conventional (direct drive and hardmount) gimbal pointing system, particularly for lightweight payloads. A gimbal system that incorporates a passive base isolator and reactionless actuation appears to provide a significant imporvement in pointing performance over the conventional pointing systems.

Wong, Edward↗

Robust Output Feedback Control Design for Inertia Emulation by Wind Turbine Generators

Wind generation has gained widespread use as a renewable energy source. Most wind turbines and other renewables connected to the grid through converters result in a reduction in the natural inertial response to grid frequency changes. The doubly-fed induction generator (DFIG) can be controlled to compensate for this reduction and, in fact, provide faster response than traditional synchronous machines. This paper proposes to design observer based output feedback linear quadratic regulator (LQR) and H control laws to realize the inertia emulation function and deliver fast frequency support. Furthermore, the aim is to track the reference speed by a diesel synchronous generator (DSG) in order to reach the desired inertia. The control signal is computed based on a reduced order model using the balanced truncation technique. A comparison with selective modal analysis (SMA) and balanced truncation model reduction techniques is presented. Comprehensive results show the effective emulation of synthetic inertia by implementing the control laws on a nonlinear three- phase diesel-wind system. The proposed technique is analyzed for different short circuit ratio (SCR) scenarios.

17 WIND ENERGY↗

Singular Perturbation-Based Large-Signal Order Reduction of Microgrids for Stability and Accuracy Synthesis With Control

The increasing penetration of distributed energy resources (DERs) highlights the growing importance of microgrids (MGs) in enhancing power system reliability. Employing electromagnetic transient (EMT) analysis in MGs becomes crucial for controlling the rapid transients. However, this requires an accurate but high-order model of power electronics and their underlying control loops, complexifying the stability analysis from the viewpoint of a higher control level. To overcome these challenges, this paper proposes a large-signal order reduction (LSOR) method for MGs with considerations of external control inputs and the detailed dynamics of underlying control levels based on singular perturbation theory (SPT). Specially, we innovatively proposed and strictly proved a general stability and accuracy assessment theorem that allows us to analyze the dynamic stability of a full-order nonlinear system by only leveraging our derived reduced-order model (ROM) and boundary layer model (BLM). Furthermore, this theorem furnishes a set of conditions that determine the accuracy of the developed ROM. Lastly, by embedding such a theorem into the SPT, we propose a novel LSOR approach with guaranteed accuracy and stability analysis equivalence. Case studies are conducted on MG systems to show the effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗