Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dynamical systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Observing Chemical and Morphological Changes in a Cu@TiO x Core@Shell Catalyst: Impact of Reversible Metal-Oxide Interactions on CO 2 Activation and Hydrogenation

A combination of several in-situ techniques (XRD, XAS, AP-XPS, E-TEM) was used to explore links between the structural and chemical properties of a Cu@TiO x catalyst under CO 2 hydrogenation conditions. The active phase of the catalyst involved an inverse oxide/metal configuration, but the initial core@shell motif was disrupted during the pre-treatment in H 2 . As a consequence of strong metal-support interactions, the titania shell cracked and Cu particles migrated from the core to on top of the oxide with the simultaneous formation of a Cu-Ti-O x phase. The generated Cu particles had a diameter of 20-40 nm and were decorated by small clusters of TiO x (< 5 nm in size). Results of in-situ XAS and XRD and images of E-TEM showed a very dynamic system, where the inverse oxide/metal configuration promoted the reactivity of the system towards CO 2 and H 2 . At room temperature, CO 2 oxidized the Cu nanoparticles (CO 2,gas → CO gas + O oxide ) inducing a redistribution of the TiO x clusters and big modifications in catalyst surface morphology. The generated oxide overlayer disappeared at elevated temperatures (> 180 °C) upon exposure to H 2 , producing a transient surface that was very active for the reverse water-gas shift reaction (CO 2 + H 2 → CO + H 2 O) but was not stable at 250 °C. When oxidation and reduction occurred at the same time, under a mixture of CO 2 and H 2 , the surface structure evolved toward a dynamic equilibrium that strongly depended on the temperature. Neither CO 2 nor H 2 can be considered as passive reactants. In the Cu@TiO x system, morphological changes were linked to variations in the composition of metal-oxide interfaces which were reversible with temperature or chemical environment and affected the catalytic activity of the system. Finally, the present study illustrates the dynamic nature of phenomena associated with the trapping and conversion of CO 2 .

36 MATERIALS SCIENCE↗

Reduced-order modeling on a near-term quantum computer

Quantum computing is an advancing area of research in which computer hardware and algorithms are developed to take advantage of quantum mechanical phenomena. In recent studies, quantum algorithms have shown promise in solving linear systems of equations as well as systems of linear ordinary differential equations (ODEs) and partial differential equations (PDEs). Reducedorder modeling (ROM) algorithms for studying fluid dynamics have shown success in identifying linear operators that can describe flowfields, where dynamic mode decomposition (DMD) is a particularly useful method in which a linear operator is identified from data. In this work, DMD is reformulated as an optimization problem to propagate the state of the linearized dynamical system on a quantum computer. This reformulation was chosen as a means of facilitating implementation on a near-term quantum computer. Quadratic unconstrained binary optimization (QUBO), a technique for optimizing quadratic polynomials in binary variables, allows for quantum annealing algorithms to be applied. A quantum circuit model (quantum approximation optimization algorithm, QAOA) is utilized to obtain predictions of the state trajectories. Results are shown for the quantum-ROM predictions for flow over a 2D cylinder at Re = 220 and flow over a NACA0009 airfoil at Re = 500 and α = 15°. The quantum-ROM predictions are found to depend on the number of bits utilized for a fixed point representation and the truncation level of the DMD model. Comparisons with DMD predictions from a classical computer algorithm are made, as well as an analysis of the computational complexity and prospects for future, more fault-tolerant quantum computers.

97 MATHEMATICS AND COMPUTING↗

Dynamic probabilistic risk assessment for electric grid cybersecurity

Electric grid cybersecurity risk has become a significant concern of industries and governments. This paper proposes a dynamic probabilistic risk assessment method for electric grid cybersecurity risk analysis. The proposed method helps reduce the reliance on expert judgment, capture a broad range of components and system dynamics, and model the interactions between various contributing entities (e.g., attacker, operator). In addition, the scenarios with multiple events, such as the occurrence of both cyberattacks and failures of physical components, the occurrence of both cyberattacks and operators’ (in)correct reactions, are considered and analyzed. Further, for each cyberattack scenario, Monte Carlo simulations are used to obtain possible sequences of the system's evolution under study and then derive risk estimates. As an application of the proposed method, the risk assessment method serves as the basis of risk-informed defense resource allocation to improve electric grid cybersecurity. The proposed method is verified using the IEEE 14-bus system by evaluating different security resource allocations for selected cyberattack scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Predicting rare events using neural networks and short-trajectory data

Estimating the likelihood, timing, and nature of events is a major goal of modeling stochastic dynamical systems. When the event is rare in comparison with the timescales of simulation and/or measurement needed to resolve the elemental dynamics, accurate prediction from direct observations becomes challenging. In such cases a more effective approach is to cast statistics of interest as solutions to Feynman-Kac equations (partial differential equations). Here, we develop an approach to solve Feynman-Kac equations by training neural networks on short-trajectory data. Our approach is based on a Markov approximation but otherwise avoids assumptions about the underlying model and dynamics. This makes it applicable to treating complex computational models and observational data. Additionally, we illustrate the advantages of our method using a low-dimensional model that facilitates visualization, and this analysis motivates an adaptive sampling strategy that allows on-the-fly identification of and addition of data to regions important for predicting the statistics of interest. Finally, we demonstrate that we can compute accurate statistics for a 75-dimensional model of sudden stratospheric warming. This system provides a stringent test bed for our method.

97 MATHEMATICS AND COMPUTING↗

Metabolic multistability and hysteresis in a model aerobe-anaerobe microbiome community

Major changes in the microbiome are associated with health and disease. Some microbiome states persist despite seemingly unfavorable conditions, such as the proliferation of aerobe-anaerobe communities in oxygen-exposed environments in wound infections or small intestinal bacterial overgrowth. Mechanisms underlying transitions into and persistence of these states remain unclear. Using two microbial taxa relevant to the human microbiome, we combine genome-scale mathematical modeling, bioreactor experiments, transcriptomics, and dynamical systems theory to show that multistability and hysteresis (MSH) is a mechanism describing the shift from an aerobe-dominated state to a resilient, paradoxically persistent aerobe-anaerobe state. We examine the impact of changing oxygen and nutrient regimes and identify changes in metabolism and gene expression that lead to MSH and associated multi-stable states. In such systems, conceptual causation-correlation connections break and MSH must be used for analysis. Using MSH to analyze microbiome dynamics will improve our conceptual understanding of stability of microbiome states and transitions between states.

59 BASIC BIOLOGICAL SCIENCES↗

IDEAS-Watersheds FY21 Annual Report for July 1, 2020-June 30, 2021

Watersheds play a critical role in our water supply infrastructure and require sustainable management in a changing environment. Sustainable management of watershed systems and their interaction with the built environment rely on understanding the hydrologic and biogeochemical processes that control watershed system dynamics and water availability and quality. The overarching objective of the U.S. Department of Energy’s (DOE’s) Environmental System Science (ESS) program is to advance a robust, predictive understanding of how watersheds function and respond to perturbations as integrated hydrobiogeochemical systems. ESS supports a network of watershed testbeds within the United States where national laboratories and university partners work in interdisciplinary teams to advance watershed system science for energy.

54 ENVIRONMENTAL SCIENCES↗

Neural Ordinary Differential Equations for Nonlinear System Identification

Neural ordinary differential equations (NODE) have been recently proposed as a promising approach for nonlinear system identification tasks. In this work, we systematically compare their predictive performance with current state-of-the-art nonlinear and classical linear methods. In particular, we present a quantitative study comparing NODE's performance against neural state-space models and classical linear system identification methods and evaluate their inference speed and prediction performance on open-loop errors across eight different dynamical systems. The experiments show that NODEs can consistently improve the prediction accuracy by order of magnitude compared to benchmark methods. Besides improved accuracy, we also observed that NODEs are less sensitive to hyperparameters compared to neural state-space models by paying the cost of increased computation at the inference time.

machine leaning, system identification, physics in↗

HIRM v1.0: a hybrid impulse response model for climate modeling and uncertainty analyses

Simple climate models (SCMs) are frequently used in research and decision-making communities because of their flexibility, tractability, and low computational cost. SCMs can be idealized, flexibly representing major climate dynamics as impulse response functions, or process-based, using explicit equations to model possibly nonlinear climate and Earth system dynamics. Each of these approaches has strengths and limitations. Here we present and test a hybrid impulse response modeling framework (HIRM) that combines the strengths of process-based SCMs in an idealized impulse response model, with HIRM's input derived from the output of a process-based model. This structure enables the model to capture some of the major nonlinear dynamics that occur in complex climate models as greenhouse gas emissions transform to atmospheric concentration to radiative forcing to climate change. As a test, the HIRM framework was configured to emulate the total temperature of the simple climate model Hector 2.0 under the four Representative Concentration Pathways and the temperature response of an abrupt 4 times CO 2 concentration step. HIRM was able to reproduce near-term and long-term Hector global temperature with a high degree of fidelity. Additionally, we conducted two case studies to demonstrate potential applications for this hybrid model: examining the effect of aerosol forcing uncertainty on global temperature and incorporating more process-based representations of black carbon into a SCM. The open-source HIRM framework has a range of applications including complex climate model emulation, uncertainty analyses of radiative forcing, attribution studies, and climate model development.

54 ENVIRONMENTAL SCIENCES↗

An approximate inertial manifold (AIM) based closure for turbulent flows

A closure model for turbulent flows is developed based on a dynamical system theory. An appropriately discretized formulation of the governing equations is considered for this process. The key ingredient is an approximation of the system’s attractor, where all the trajectories in phase space are confined. This approximate inertial manifold based approach provides a path to track trajectories of the system in a lower-dimensional subspace. Unlike conventional coarse-graining approaches, the turbulent field is decomposed into resolved and unresolved dynamics using the properties of the governing equations. The novelty of the approach relies on the reconstruction of the unresolved field constrained by the governing equations. A posteriori tests for homogeneous isotropic turbulence and the Kuramoto–Sivashinsky equation show promising results for considerable dimension reduction with strong convergence properties. The proposed model outperforms the dynamic Smagorinsky model, and the computational overhead is competitive with similar approaches.

97 MATHEMATICS AND COMPUTING↗

Measured proton electromagnetic structure deviates from theoretical predictions

The visible world is founded on the proton, the only composite building block of matter that is stable in nature. Consequently, understanding the formation of matter relies on explaining the dynamics and the properties of the proton’s bound state. A fundamental property of the proton involves the response of the system to an external electromagnetic field. It is characterized by the electromagnetic polarizabilities that describe how easily the charge and magnetization distributions inside the system are distorted by the electromagnetic field. Moreover, the generalized polarizabilities map out the resulting deformation of the densities in a proton subject to an electromagnetic field. They disclose essential information about the underlying system dynamics and provide a key for decoding the proton structure in terms of the theory of the strong interaction that binds its elementary quark and gluon constituents. Of particular interest is a puzzle in the electric generalized polarizability of the proton that remains unresolved for two decades. Here we report measurements of the proton’s electromagnetic generalized polarizabilities at low four-momentum transfer squared. We show evidence of an anomaly to the behaviour of the proton’s electric generalized polarizability that contradicts the predictions of nuclear theory and derive its signature in the spatial distribution of the induced polarization in the proton. Here, the reported measurements suggest the presence of a new, not-yet-understood dynamical mechanism in the proton and present notable challenges to the nuclear theory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Posterior comparison of model dynamics in several hybrid turbulence model forms

Hybrid turbulence models that can accurately reproduce unsteady three-dimensional flow physics across the entire range of grid scales and turbulence dynamics from Reynolds-averaged Navier–Stokes (RANS), through large-eddy simulation (LES), down to direct numerical simulations (DNS) are of increasing interest to the turbulence modeling community. However, despite decades of research and development, the basic tasks of eliminating poor-performing hybrid RANS-LES models and accelerating adoption of superior models through well-designed validation and verification have yet to occur. As a step in this direction, in this work we evaluate thirteen different hybrid RANS-LES models via systematic grid refinement of decaying homogeneous isotropic turbulence. We further derive a novel mathematical framework for assessing the energy partitioning dynamics of each Hybrid RANS-LES model, wherein model-to-model variations in energy partitioning can be interpreted as different feedback mechanisms operating on a low-dimensional nonlinear dynamical system. We found that model forms similar to the flow simulation methodology—also often termed very-large eddy simulation—are dynamically inconsistent with DNS at all resolutions. Additionally, we found a strong dynamical similarity in the feedback mechanisms of all models related to detached eddy simulation and partially averaged Navier–Stokes that is inherent to their general model forms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Decision and Control of Complex Systems – A Data-Drive Framework

During the project period, we have collaborated with other team members and developed novel algorithms for novelty detection, continual learning, and graph learning algorithms for dynamic systems. The results are documented in publications and meeting notes. Moreover, we leverage virtual collaboration tools (such as Basecamp, Microsoft Teams and Zoom) for technical exchanges. Our research on novelty detection was published at AAAI 2022 and Lecture Notes in Artificial Intelligence, Springer Nature. The newly developed algorithms were successfully applied to realistic cases, including thermal data from buildings at Pacific Northwest National Lab and microelectronic data provided by GlobalFoundries. Multiple publications have been produced from this project, in collaboration with other team members. Three PhD students were supported in this project to conduct their research.

42 ENGINEERING↗

Quantum complexity in gravity, quantum field theory, and quantum information science

Quantum complexity quantifies the difficulty of preparing a state or implementing a unitary transformation with limited resources. Applications range from quantum computation to condensed matter physics and quantum gravity. Here, we seek to bridge the approaches of these fields, which define and study complexity using different frameworks and tools. We describe several definitions of complexity, along with their key properties. In quantum information theory, we focus on complexity growth in random quantum circuits. In quantum many-body systems and quantum field theory (QFT), we discuss a geometric definition of complexity in terms of geodesics on the unitary group. In dynamical systems, we explore a definition of complexity in terms of state or operator spreading, as well as concepts from tensor-networks. We also outline applications to simple quantum systems, quantum many-body models, and QFTs including conformal field theories (CFTs). Finally, we explain the proposed relationship between complexity and gravitational observables within the holographic anti-de Sitter (AdS)/CFT correspondence.

Baiguera, Stefano [Istituto Nazionale di Fisica Nu↗

Precise Linker Length and Dynamic Bond Exchange Control Penetrant Diffusion in Dense Vitrimers

Polymer networks with dynamic covalent bonds have been investigated for their self-healing ability, recyclability, and potential as more sustainable materials. Recent results have indicated that in some cases, bond exchange can enhance the transport of penetrants in dense networks, pointing to their potential for separations of membranes. Here, imine dynamic bonds in ethylene oxide (EO) networks with precise linker lengths were synthesized to investigate the transport of N,N′-bis(2,5-di-tert-butylphenyl)-3,4,9,10-perylenedicarboximide (BTBP), a large, anisotropic dye molecule. Networks with mesh sizes smaller than, comparable to, and greater than the size of the penetrant axes were investigated to probe the effects of bond exchange and network confinement on transport. Mesh sizes, which ranged from 0.5 to 1.62 nm, were determined from shear rheology, glass transitions by calorimetry, and probe diffusion coefficients by fluorescence recovery after photobleaching. Permanent networks with identical EO chain lengths were prepared as control samples, and up to a 3 orders of magnitude increase in diffusion coefficient is observed in the dynamic systems for short linkers containing 13 backbone atoms. The longest linkers with 71 backbone atoms show no difference between the permanent and dynamic networks. Linkers shorter than 11 backbone atoms, corresponding to a mesh size smaller than the penetrant small axis, diffusion is no longer observable on the experimental time scale, indicating a sharp cutoff attributed to the precise linkers and narrow mesh size distribution. The dynamic imine exchange time scales were compared to the diffusive hopping times of penetrants and indicate that exchange can occur during a diffusive displacement. Furthermore, these findings provide insights into the factors affecting penetrant transport in dense polymers and inspire the development of next-generation selective polymer membranes.

Diffusion↗

Learning effective SDEs from Brownian dynamic simulations of colloidal particles

We construct a reduced, data-driven, parameter dependent effective stochastic differential equation (eSDE) for electric-field mediated colloidal crystallization using data obtained from Brownian dynamics simulations. We use diffusion maps (a manifold learning algorithm) to identify a set of useful latent observables. In this latent space we identify an eSDE using a deep learning architecture inspired by numerical stochastic integrators and compare it with the traditional Kramers–Moyal expansion estimation. We show that the obtained variables and the learned dynamics accurately encode the physics of the Brownian dynamic simulations. We further illustrate that our reduced model captures the dynamics of corresponding experimental data. Further, our dimension reduction/reduced model identification approach can be easily ported to a broad class of particle systems dynamics experiments/models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Reduced-order autodifferentiable ensemble Kalman filters

This paper introduces a computational framework to reconstruct and forecast a partially observed state that evolves according to an unknown or expensive-to-simulate dynamical system. Our reduced-order autodifferentiable ensemble Kalman filters (ROAD-EnKFs) learn a latent low-dimensional surrogate model for the dynamics and a decoder that maps from the latent space to the state space. The learned dynamics and decoder are then used within an EnKF to reconstruct and forecast the state. Numerical experiments show that if the state dynamics exhibit a hidden low-dimensional structure, ROAD-EnKFs achieve higher accuracy at lower computational cost compared to existing methods. If such structure is not expressed in the latent state dynamics, ROAD-EnKFs achieve similar accuracy at lower cost, making them a promising approach for surrogate state reconstruction and forecasting.

Mathematics↗

Machine-learned closure of URANS for stably stratified turbulence: connecting physical timescales & data hyperparameters of deep time-series models

Stably stratified turbulence (SST), a model that is representative of the turbulence found in the oceans and atmosphere, is strongly affected by fine balances between forces and becomes more anisotropic in time for decaying scenarios. Moreover, there is a limited understanding of the physical phenomena described by some of the terms in the Unsteady Reynolds-Averaged Navier–Stokes (URANS) equations—used to numerically simulate approximate solutions for such turbulent flows. Rather than attempting to model each term in URANS separately, it is attractive to explore the capability of machine learning (ML) to model groups of terms, i.e. to directly model the force balances. We develop deep time-series ML for closure modeling of the URANS equations applied to SST. We consider decaying SST which are homogeneous and stably stratified by a uniform density gradient, enabling dimensionality reduction. We consider two time-series ML models: long short-term memory and neural ordinary differential equation. Both models perform accurately and are numerically stable in a posteriori (online) tests. Furthermore, we explore the data requirements of the time-series ML models by extracting physically relevant timescales of the complex system. We find that the ratio of the timescales of the minimum information required by the ML models to accurately capture the dynamics of the SST corresponds to the Reynolds number of the flow. The current framework provides the backbone to explore the capability of such models to capture the dynamics of high-dimensional complex dynamical system like SST flows.

97 MATHEMATICS AND COMPUTING↗

Learning Stochastic Parametric Differentiable Predictive Control Policies

We present a scalable unsupervised learning-based method for obtaining explicit control policies for model predictive control problems for stochastic linear systems with additive uncertainties subject to nonlinear chance constraints. We call the proposed method stochastic parametric differentiable predictive control (SP-DPC), which extends the recently proposed deterministic DPC policy optimization algorithm. We formulate the SP-DPC as a deterministic approximation to the stochastic parametric constrained optimal control problem via independent sampling of the problem's parameters and uncertainties. This formulation allows us to directly compute the policy gradients via automatic differentiation of the problem's value function, evaluated over sampled parameters and uncertainties. In particular, the computed expectation of the problem's value function is backpropagated through the finite-time closed-loop system rollouts parametrized by a known nominal system dynamics model and neural control policy. We also provide theoretical probabilistic guarantees on closed-loop stability and chance constraints satisfaction for systems controlled by learned neural policies. We demonstrate the computational efficiency and scalability of the proposed policy optimization algorithm in three numerical examples, including systems with a large number of states or subject to nonlinear constraints.

Drgona, Jan↗