Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dynamical systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Sensitivity-Driven Experimental Design to Facilitate Control of Dynamical Systems

Control of nonlinear dynamical systems is a complex and multifaceted process. Essential elements of many engineering systems include high-fidelity physics-based modeling, offline trajectory planning, feedback control design, and data acquisition strategies to reduce uncertainties. Here this article proposes an optimization-centric perspective which couples these elements in a cohesive framework. We introduce a novel use of hyper-differential sensitivity analysis to understand the sensitivity of feedback controllers to parametric uncertainty in physics-based models used for trajectory planning. These sensitivities provide a foundation to define an optimal experimental design which seeks to acquire data most relevant in reducing demand on the feedback controller. Our proposed framework is illustrated on the Zermelo navigation problem and a hypersonic trajectory control problem using data from NASA’s X-43 hypersonic flight tests.

42 ENGINEERING↗
DOE OSTI2022

Building Initial Dynamic System Models for Digital Twins of the Cryogenic Moderator System at the ORNL Spallation Neutron Source

This work describes the initial development of dynamic system models of the cryogenic moderator system (CMS) of the Spallation Neutron Source (SNS) at ORNL as a part of the ORNL LDRD funded project Building TRANSFORM to Accelerate Digital Twin Applications for Nuclear Systems, LOIS 10563. The goal of the work is to start the dynamic system modeling effort with the end goal of using them for real-time applications as digital twins. The CMS is a cryogenic liquid hydrogen flow loop that provides moderation of the neutrons that are generated by the SNS. For optimal neutron production, the CMS needs to maintain a steady and controlled density of cryogenic hydrogen in the moderator section thus requiring precise temperature and pressure control. Due to the varied time scales and system characteristics, control of the system is complex, and diagnostics are also difficult. Difficulty in accessing the flow loop during operations, limited instrumentation and unknown design details of the equipment combine to make the case for having sophisticated digital twin models of the system. Operationally the CMS also provides a strong use case for digital twins due to the constant need of optimization and for troubleshooting/diagnostics. The large amount of data collected which are freely available for using in building the model and verifying and validating the model also makes it a great candidate for a proof-of-concept for digital twins. The project extends ORNL's capacity of development and implementation of the open-source dynamic system modeling tool TRANSFORM for engineering design and digital twin/real-time applications. Specific system configuration data for the CMS have been gathered and an initial dynamic model was created in the TRANSFORM library using Dymola as the solution platform. Models of increasing complexity are created to demonstrate the need for a multi-layered approach in digital twin modeling depending on the scale and phenomena being focused on. The dynamic modeling is shown to bring the dynamic operational aspects to the design process for systems as well as serve as a digital twin to the hardware and allow for models to be tuned and compared against real time operational data. These aims should help to push forward strategic goals of application of digital twins and increase the impact of ORNL systems modeling capabilities with TRANSFORM/Modelica for various advanced energy systems.

42 ENGINEERING↗
DOE OSTI2024

DS-GL: Advancing Graph Learning via Harnessing the Power of Nature within Dynamic Systems

With the rapid digitization of the world, an increasing number of real-world applications are turning to nonEuclidean data, modeled as graphs. Due to their intrinsic high complexity and irregularity, learning from graph data demands tremendous computational power. Recently, CMOS-compatible Ising machines, i.e., dynamic systems composed of CMOS components, have emerged as a new approach that harnesses the inherent power of natural annealing within dynamic systems to efficiently resolve binary optimization problems and have been adopted for traditional graph computation, such as max-cut. However, when performing complex Graph Learning (GL) tasks, Ising machines face significant hurdles: (i) they are inherently binary and thus ill-suited for real-valued problems; (ii) their expensive all-to-all coupling network that guarantees effective natural annealing poses daunting scalability concerns. To address these challenges, this paper proposes a nature-powered graph learning framework dubbed DS-GL, which is the first effort to transform the process of solving graph learning problems into the natural annealing process within a parameterized dynamic system embodied as a CMOS chip. To tackle the two major hurdles, DS-GL first augments the Ising machine architecture to modify the self-reaction term of its Hamiltonian function from linear to quadratic, effectively serving as an energy regulator. This adjustment maintains the system’s original physical interpretation while enabling it to process continuous, real-valued data. Second, to address the scaling issue, DS-GL further upgrades the real-valued dense Ising machine by decomposing it into a mesh-based multi-PE dynamic system that supports efficient distributed spatial-temporal co-annealing across different PEs through sparse interconnects. By exploiting the inherent sparsity and component structures in real-world graphs, DS-GL is able to map complex graph learning tasks onto the scalable dynamic system while maintaining high accuracy. Evaluations with three diverse GL applications across six real-world datasets, including traffic flow and COVID-19 prediction, show that DS-GL can deliver from 102× to 106× speedups and 500× energy reduction over Graph Neural Networks on GPUs, with 5% - 20% accuracy enhancement.

Song, Ruibing↗
DOE OSTI2022

Surrogate Modeling of Nonlinear Dynamic Systems: A Comparative Study

Surrogate models play a vital role in overcoming the computational challenge in designing and analyzing nonlinear dynamic systems, especially in the presence of uncertainty. This paper presents a comparative study of different surrogate modeling techniques for nonlinear dynamic systems. Four surrogate modeling methods, namely, Gaussian process (GP) regression, a long short-term memory (LSTM) network, a convolutional neural network (CNN) with LSTM (CNN-LSTM), and a CNN with bidirectional LSTM (CNN-BLSTM), are studied and compared. All these model types can predict the future behavior of dynamic systems over long periods based on training data from relatively short periods. The multi-dimensional inputs of surrogate models are organized in a nonlinear autoregressive exogenous model (NARX) scheme to enable recursive prediction over long periods, where current predictions replace inputs from the previous time window. Three numerical examples, including one mathematical example and two nonlinear engineering analysis models, are used to compare the performance of the four surrogate modeling techniques. The results show that the GP-NARX surrogate model tends to have more stable performance than the other three deep learning (DL)-based methods for the three particular examples studied. The tuning effort of GP-NARX is also much lower than its deep learning-based counterparts.

42 ENGINEERING↗
DOE OSTI2021

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert attack. We consider the attack scenario where the attacker learns about the dynamic model during the exploration phase of the learning conducted by the designer to learn a linear quadratic regulator (LQR), and thereafter, use such information to conduct a covert attack on the dynamic system, which we refer to as doubly learning-based control and attack (DLCA) framework. We propose a dynamic camouflaging based attack-resilient reinforcement learning (ARRL) algorithm which can learn the desired optimal controller for the dynamic system, and at the same time, can inject sufficient misinformation in the estimation of system dynamics by the attacker. The algorithm is accompanied by theoretical guarantees and extensive numerical experiments on a consensus multi-agent system and on a benchmark power grid model.

Mukherjee, Sayak↗
DOE OSTI2022

Multi-element flow-driven spectral chaos (ME-FSC) method for uncertainty quantification of dynamical systems

The flow-driven spectral chaos (FSC) is a recently developed method for tracking and quantifying uncertainties in the long-time response of stochastic dynamical systems using the spectral approach. The method uses a novel concept called enriched stochastic flow maps as a means to construct an evolving finite-dimensional random function space that is both accurate and computationally efficient in time. In this paper, we present a multi-element version of the FSC method (the ME-FSC method for short) to tackle (mainly) those dynamical systems that are inherently discontinuous over the probability space. In ME-FSC, the random domain is partitioned into several elements, and then the problem is solved separately on each random element using the FSC method. Subsequently, results are aggregated to compute the probability moments of interest using the law of total probability. To demonstrate the effectiveness of the ME-FSC method in dealing with discontinuities and long-time integration of stochastic dynamical systems, four representative numerical examples are presented in this paper, including the Van-der-Pol oscillator problem and the Kraichnan-Orszag three-mode problem. Results show that the ME-FSC method is capable of solving problems that have strong nonlinear dependencies over the probability space, both reliably and at low computational cost.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Learning Distributed Geometric Koopman Operator for Sparse Networked Dynamical Systems

Koopman operator theory provides an alternative to study nonlinear networked dynamical systems by mapping the state space to an abstract higher dimensional space where the system evolution is linear. Recent works show the application of graph neural networks (GNNs) to learn state to object-centric embeddings and achieve centralized block-wise computation of Koopman operator (KO) under additional assumptions on the underlying agents properties and constraints on the KO structure. However, the computational complexity of learning the Koopman increases exponentially for networked systems where the number of possible system states grows in a combinatorial fashion with the number of nodes. The learning challenge is further amplified for sparse networks by two factors: 1) sample sparsity for learning the Koopman operator in the non-linear space, and 2) the divergence in the dynamics of individual nodes or from one subgraph to another. Our work aims to address these challenge by formulating the representation learning of networked dynamical systems into a multi-agent paradigm and learning the Koopman operator in a distributive manner. The computational as well as performance advantages of distributed Koopman is predominant for sparse networks whereas for fully connected networks, it is shown to coincide with the centralized one. The empirical study on rope system, network of oscillators and a synthetic power system show comparable and superior performance along with computational benefits with the state-of-the-art methods.

Mukherjee, Sayak↗
DOE OSTI2024

A Geometric Derivation of the Governing Equations of Motion of Nonholonomic Dynamic Systems

Here, in this paper, we present a Riemannian geometric derivation of the governing equations of motion of nonholonomic dynamic systems. A geometric form of the work-energy principle is first derived. The geometric form can be realized in appropriate generalized quantities, and the independent equations of motion can be obtained if the subspace of generalized speeds allowable by nonholonomic constraints can be determined. We provide a geometric perspective of the governing equations of motion and demonstrate its effectiveness in studying dynamic systems subjected to nonholonomic constraints.

42 ENGINEERING↗
DOE OSTI2023

On fast simulation of dynamical system with neural vector enhanced numerical solver

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a trade-off between accuracy and computational efficiency. To address this challenge, we introduce a deep learning-based corrector called Neural Vector (NeurVec), which can compensate for integration errors and enable larger time step sizes in simulations. Our extensive experiments on a variety of complex dynamical system benchmarks demonstrate that NeurVec exhibits remarkable generalization capability on a continuous phase space, even when trained using limited and discrete data. NeurVec significantly accelerates traditional solvers, achieving speeds tens to hundreds of times faster while maintaining high levels of accuracy and stability. Moreover, NeurVec’s simple-yet-effective design, combined with its ease of implementation, has the potential to establish a new paradigm for fast-solving differential equations based on deep learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Online real-time learning of dynamical systems from noisy streaming data

Abstract Recent advancements in sensing and communication facilitate obtaining high-frequency real-time data from various physical systems like power networks, climate systems, biological networks, etc. However, since the data are recorded by physical sensors, it is natural that the obtained data is corrupted by measurement noise. In this paper, we present a novel algorithm for online real-time learning of dynamical systems from noisy time-series data, which employs the Robust Koopman operator framework to mitigate the effect of measurement noise. The proposed algorithm has three main advantages: (a) it allows for online real-time monitoring of a dynamical system; (b) it obtains a linear representation of the underlying dynamical system, thus enabling the user to use linear systems theory for analysis and control of the system; (c) it is computationally fast and less intensive than the popular extended dynamic mode decomposition (EDMD) algorithm. We illustrate the efficiency of the proposed algorithm by applying it to identify the Van der Pol oscillator, the chaotic attractor of the Henon map, the IEEE 68 bus system, and a ring network of Van der Pol oscillators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Per-phase Phasor Modeling of GFL and GFM Inverters for Distribution System Dynamic Studies

A significant increase in inverter-based distributed energy resources (DERs) is expected in the near future. Existing electromagnetic models and sequential electromechanical models of DERs supporting dynamic analysis cannot be extended to largescale three-phase distribution systems usually with unbalanced construction. As such, there is a need for appropriate industry models that can support distribution system dynamic studies. This paper describes the latest phasor models of grid-following (GFL) and grid-forming (GFM) inverters that can capture distribution system dynamics under grid disturbances. The overall modeling performance is examined and compared with results from other platforms such as controller hardware-in-the-loop (CHIL), MATLAB/Simulink and PSCAD with electromagnetic transient (EMT) and/or phasor simulation capabilities under balanced and unbalanced faults.

Distribution system, Grid modelling, GridLAB-D, Po↗
DOE OSTI2024

Building a Prospective LCA Framework to Analyze Emerging Technologies in a Dynamic System Context

NREL's Lifecycle Analysis Integration into Opensource Numerical models (LiAISON) framework computes temporally explicit life cycle impacts and resource uses for specific technologies (foreground) in a dynamic system context (background). LiAISON computes results for a series of environmental mid-points enabling an analysis of prospective tradeoffs of emerging technologies toward 2100. This prospective feature is of critical importance when analyzing present-day emerging technologies whose large-scale impacts during deployment phases will occur in different, future system contexts. LiAISON systematically accounts for dynamic system changes by applying an integrated background of the future energy-economy-land-climate system, generated by exogenous integrated assessment models (IAMs). Using IAM scenarios, LiAISON generates a time-series of life cycle inventory (LCI) databases, which are then used to calculate the impacts per functional unit per time step. This expands current practice of using static, future system assumptions, e.g., a specific grid-mix each year. Further, IAM scenarios are provided in a standardized format of shared-socioeconomic pathways (SSP) and representative concentration pathways (RCP) combinations. These are coherent, regularly, published, and peer-reviewed scenario combinations that establish a reproducible and standardized societal and climate mitigation futures context. They are comparable across IAMs and expand the system boundary of the traditional LCA by including dimensions such as societal and behavioral changes. We apply the framework to assess two emerging Power-to-Hydrogen processes, high temperature electrolysis using solid oxide fuel cell (HT-SOE) and polymer electrolyte membrane electrolysis (PEME). We compare the technologies to a baseline Hydrogen production process via steam methane reforming. Despite the decarbonized electricity systems' beneficial effects on the PtH2 processes' carbon intensities, we find environmental tradeoffs, which require technology improvements via learning-by-doing to be alleviated. Future work via ongoing collaborations will focus on linking the framework to other energy-economy-land-climate models and open-source life cycle inventory databases.

ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

A Fast Time-Stepping Strategy for Dynamical Systems Equipped with a Surrogate Model

Simulation of complex dynamical systems arising in many applications is computationally challenging due to their size and complexity. Model order reduction, machine learning, and other types of surrogate modeling techniques offer cheaper and simpler ways to describe the dynamics of these systems but are inexact and introduce additional approximation errors. In order to overcome the computational difficulties of the full complex models, on one hand, and the limitations of surrogate models, on the other, this work proposes a new accelerated time-stepping strategy that combines information from both. This approach is based on the multirate infinitesimal general-structure additive Runge--Kutta framework. The inexpensive surrogate model is integrated with a small time step to guide the solution trajectory, and the full model is treated with a large time step to occasionally correct for the surrogate model error and ensure convergence. Here, we provide a theoretical error analysis, and several numerical experiments, to show that this approach can be significantly more efficient than using only the full or only the surrogate model for the integration.

Surrogate models↗
DOE OSTI2024

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗
DOE OSTI2023

Graph Learning in Physical-informed Mesh-reduced Space for Real-world Dynamic Systems

This Git repository contains codes for the 'Graph Learning in Physical-informed Mesh-reduced Space for Real-world Dynamic Systems' paper that will be published in 2023 SIGKDD. This work uses physical-informed prior (PiP) information to learn and predict fluid dynamics in a reduced mesh space. We propose a two-stage graph-based model for fluid velocity field reconstruction and prediction. In the first stage, we learn a subgraph autoencoder to summarize the information in a mesh-reduced space using physical-informed priors. In the second stage, we learn a dynamics predictor to predict subgraph evolution. We demonstrate the effectiveness of our model on two fluid flow datasets: lid-driven cavity flow data and cylinder flow data. This code is also applicable for any other dynamic systems with corresponding data.

Lei, Bo↗
DOE OSTI2022

Utilizing CellBox to Describe Varied Dynamical Systems

CellBox is a hybrid modeling framework that integrates machine-learning approaches with explicit mathematical modeling to determine the behavior of dynamical systems, intended for determining the complex interactions of molecule and phenotype within a cellular environment using perturbation/response-based data. The original work utilized analysis of a melanoma cell line, SK-Mel-133, which we sought to expand to and evaluate effectiveness in describing other nonlinear systems both within and outside of biology. We evaluated with two models. One model is based upon the free-fall of an object under a velocity-dependent drag force; this produced inherent perturbation/response data. The other model is based upon a form of mass-action molecular kinetics; for this, we ran the simulation to steady state in each species for each perturbation and select the steady state as input for CellBox. We determined that CellBox, outside of its original use case, can still strongly predict even non-biological dynamical systems in the small-perturbation regime, with r = 0.99977 to 0.85123, p < 0.05 for freefall. However, CellBox cannot accurately predict behavior within large-perturbation regimes, p >> 0.05 for freefall. In addition, we performed a naïve comparison of CellBox network structure to known network structure in the mass-action model to assess accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Optimal mitigation and control over power system dynamics for stochastic grid resilience

Optimal mitigation planning for highly disruptive contingencies to a transmission-level power system requires optimization with dynamic power system constraints, due to the key role of dynamics in system stability to major perturbations. We formulate a generalized disjunctive program to determine optimal grid component hardening choices for protecting against major failures, with differential algebraic constraints representing system dynamics (specifically, differential equations representing generator and load behavior and algebraic equations representing instantaneous power balance over the transmission system). We optionally allow stochastic optimal pre-positioning across all considered failure scenarios, and optimal emergency control within each scenario. This novel formulation allows, for the first time, analyzing the resilience interdependencies of mitigation planning, preventive control, and emergency control. Using all three strategies in concert is particularly effective at maintaining robust power system operation under severe contingencies, as we demonstrate on the western system coordinating council 9-bus test system using synthetic multi-device outage scenarios.

30 DIRECT ENERGY CONVERSION↗