Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dynamical systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Goal-oriented real-time Bayesian inference for linear autonomous dynamical systems with application to digital twins for tsunami early warning

We present a goal-oriented framework for constructing digital twins with the following properties: (1) they employ discretizations of high-fidelity partial differential equation (PDE) models governed by autonomous dynamical systems, leading to large-scale forward problems; (2) they solve a linear inverse problem to assimilate observational data to infer uncertain model components followed by a forward prediction of the evolving dynamics; and (3) the entire end-to-end, data-to-inference-to-prediction computation is carried out without approximation and in real time through a Bayesian framework that rigorously accounts for uncertainties. Several challenges must be overcome to realize this framework, including the large scale of the forward problem, the high dimensionality of the parameter space, and for a class of problems including those we target, the slow decay of the singular values of the parameter-to-observable map. Here we introduce a methodology to overcome these challenges by exploiting the autonomous structure of the forward model to decompose the solution of the inverse problem into a one-time-only offline phase in which the PDE model is solved a limited number of times (equal to the number of sensors), and an online phase that maps well onto GPUs and computes the parameter inference and prediction of quantities of interest in real time, given observational data. Our ultimate goal is to apply this framework to construct digital twins for subduction zones, including Cascadia, to provide early warning for tsunamis generated by megathrust earthquakes. To this end, we demonstrate how our methodology can be used to employ seafloor pressure observations, along with the coupled acoustic–gravity wave equations, to infer the earthquake-induced spatiotemporal seafloor motion (discretized with $\mathscr{O}$ (10 9 ) parameters) and forward predict the tsunami propagation. We present results of an end-to-end inference, prediction, and uncertainty quantification for a representative test problem with $\mathscr{O}$ (10 8 ) inversion parameters for which goal-oriented Bayesian inference is accomplished exactly and in real time, that is, in a matter of seconds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Dynamical System Scaling Application to Zircaloy Cladding Thermal Response During Reactivity-Initiated Accident Experiment

New fuel design and development currently requires 20 to 25 years to be qualified for use by the nuclear power industry. The thermal-hydraulics community has taken advantage of scaling theory to design reduced scale experiments that correctly preserve dominant key phenomena while quantifying distorted phenomena. These techniques can be leveraged in the design and analysis of fuel performance experiments to help reduce the timeline associated with fuel design and development. This study uses the Dynamical System Scaling (DSS) method to analyze cladding temperature data from the recent SETH-C experiment in the TREAT facility and accompanying BISON simulations to assess dynamic distortions occurring throughout the fast power excursion transient. The DSS analysis revealed that on the cool down from peak cladding temperature that the fuel radial power profile is the most sensitive modeling parameter with a heterogenous radial peaking factor corresponding to the lowest distortion compared to a uniform energy deposition. For the heat up to peak cladding temperature the heterogeneous radial power profile corresponded to the shortest process action. Finally, for the heat up to peak cladding temperature, the gap conductance model sensitivity was quantified using process action and shows that the default Light Water Reactor gap conductance model corresponded to the longest process action.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Open Source Modeling for Power Systems Dynamics

Time-domain simulations for power systems (both phasor and electromagnetic transients) are mostly dominated by commercial tools, such as PSS/E or PSCAD. However, with the increasing penetration of inverter-based resources and changes in model paradigm, new open-source tools are looking into become a possible alternative for a range of stakeholders. In this presentation we will focus on how to improve communication with industry and other stakeholders to properly showcase the value of open source simulators. Participants will identify current barriers facing the adoption of open-source time-domain tools, and will discuss how to improve the bench-marking processes across different tools, while maintaining software modularity to include new features and models as new challenges continue to happen in energy systems.

ENERGY PLANNING, POLICY, AND ECONOMY,MATHEMATICS A↗
DOE OSTI2023

Analysis of Neural Networks as Random Dynamical Systems

In this report we present our findings and outcomes of the NNRDS (analysis of Neural Networks as Random Dynamical Systems) project. The work is largely motivated by the analogy of a large class of neural networks (NNs) with a discretized ordinary differential equation (ODE) schemes. Namely, residual NNs, or ResNets, can be viewed as a discretization of neural ODEs (NODEs) where the NN depth plays the role of the time evolution. We employ several legacy tools from ODE theory, such as stiffness, nonlocality, autonomicity, to enable regularization of ResNets thus improving their generalization capabilities. Furthermore, armed with NN analysis tools borrowed from the ODE theory, we are able to efficiently augment NN predictions with uncertainty overcoming wellknown dimensionality challenges and adding a degree of trust towards NN predictions. Finally, we have developed a Python library QUiNN (Quantification of Uncertainties in Neural Networks) that incorporates improved-architecture ResNets, besides classical feed-forward NNs, and contains wrappers to PyTorch NN models enabling several major classes of uncertainty quantification methods for NNs. Besides synthetic problems, we demonstrate the methods on datasets from climate modeling and materials science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

DS-TIDE: Harnessing Dynamical Systems for Efficient Time-Independent Differential Equation Solving

Time-Independent Differential Equations (TIDEs) are central to modeling equilibrium behavior across a wide range of scientific and engineering domains, from electrostatics to porous media flow. Conventional numerical solvers offer reliable solutions but incur significant computational costs due to fine-grained discretization and iterative procedures. Machine learning-based approaches address this by replacing iterative solving processes with one-time inference; however, their sophisticated models require extensive training resources that often exceed those of traditional solvers. Consequently, designing a TIDE solver that achieves high accuracy, broad applicability, and exceptional computational efficiency remains a fundamental challenge. In this paper, we propose DS-TIDE, a novel hardware solver that is inspired by, and subsequently leverages, the intrinsic connection between Dynamical Systems (DS) and Differential Equations (DEs) to efficiently and accurately solve TIDEs. DS-TIDE employs a CMOS-compatible DS-based processor, whose physical states evolve under carefully designed DE-driven dynamics and naturally converge to equilibrium -- the solution of the target TIDE -- within ~1µs on a ~1-watt DS-TIDE processor. To enhance expressivity, DS-TIDE incorporates Heterogeneous Dynamics with Temporal Layering (HDTL), which solves TIDEs through a three-stage DS evolution -- conditioning, solving, and decoding -- each governed by specialized dynamics. The entire evolution process is analogous to an infinitely deep neural network temporally unrolled, offering the system the capability of representing complex equations. Furthermore, DS-TIDE is equipped with an on-device DS-DE Auto-Alignment mechanism that dynamically adapts intrinsic hardware dynamics within milliseconds, effectively aligning the system’s dynamics to diverse target DEs. Experimental results across TIDEs from a wide range of scientific and engineering domains demonstrate that DS-TIDE achieves ~10^3× speedup, ~10^5× energy savings, and competitive or superior accuracy compared to state-of-the-art numerical and ML-based solvers.

Liu, Chuan↗
DOE OSTI2025

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Dynamic System Scaling Application to Accelerated Nuclear Fuel Testing

The development of nuclear fuel and materials requires a continuous effort to investigate the acute and prolonged effects of irradiation, thermal-material stress, chemical change, or other conceivable damage mechanics acquired during normal operation or accident scenarios throughout its lifetime. As in-core fuel property measurement techniques advance to support in the real-time, non-invasive, and enhanced accuracy realm, it is the future of fuel development to pursue to higher degrees of control, predictability of integral test behavior via separate effects test (SET), and shorter test time intervals. The fuel development life cycle from initial concept to commercial licensing is approximated to be 20 years and current literature suggests by optimizing fuel performance codes with SETs, the process could possibly be compressed to 5 to 10 years. Recently, a research group in the Idaho National Laboratory (INL) is testing reduced scale fuel rods and increased power density to accelerate evolution of fuel phenomena in metallic fuels. In support of nuclear fuel rod development, compressing fuel test process, and accelerating fuel phenomena, it was the purpose of this study to investigate nuclear fuel performance phenomena via literature review and effectively scale the initial conditions, boundary conditions, and geometric properties to describe the time-dependent response including to fuel burnup, thermal and mechanical stress, transmutations and inter-diffusion, and other relevant observed phenomena. The study was based on BISON simulations of historic EBR-II metallic fuel experiments and Dynamical System Scaling (DSS) method are utilized to assess effects of scaling activity including fuel phenomena acceleration and calculations of time-dependent distortions. The research successfully scaled metallic fuel phenomena, accelerated fuel testing, and assessed the distortions for each scaled case derived.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Forward variable selection enables fast and accurate dynamic system identification with Karhunen-Loève decomposed Gaussian processes

A promising approach for scalable Gaussian processes (GPs) is the Karhunen-Loève (KL) decomposition, in which the GP kernel is represented by a set of basis functions which are the eigenfunctions of the kernel operator. Such decomposed kernels have the potential to be very fast, and do not depend on the selection of a reduced set of inducing points. However KL decompositions lead to high dimensionality, and variable selection thus becomes paramount. This paper reports a new method of forward variable selection, enabled by the ordered nature of the basis functions in the KL expansion of the Bayesian Smoothing Spline ANOVA kernel (BSS-ANOVA), coupled with fast Gibbs sampling in a fully Bayesian approach. It quickly and effectively limits the number of terms, yielding a method with competitive accuracies, training and inference times for tabular datasets of low feature set dimensionality. Theoretical computational complexities are O ( N P 2 ) in training and O ( P ) per point in inference, where N is the number of instances and P the number of expansion terms. The inference speed and accuracy makes the method especially useful for dynamic systems identification, by modeling the dynamics in the tangent space as a static problem, then integrating the learned dynamics using a high-order scheme. The methods are demonstrated on two dynamic datasets: a ‘Susceptible, Infected, Recovered’ (SIR) toy problem, along with the experimental ‘Cascaded Tanks’ benchmark dataset. Comparisons on the static prediction of time derivatives are made with a random forest (RF), a residual neural network (ResNet), and the Orthogonal Additive Kernel (OAK) inducing points scalable GP, while for the timeseries prediction comparisons are made with LSTM and GRU recurrent neural networks (RNNs) along with the SINDy package.

Hayes, Kyle↗
DOE OSTI2023

A greedy Galerkin method to efficiently select sensors for linear dynamical systems

A key challenge in inverse problems is the selection of sensors to gather the most effective data. In this paper, we consider the problem of inferring the initial condition to a linear dynamical system and develop an efficient control-theoretical approach for greedily selecting sensors. Our method employs a Galerkin projection to reduce the size of the inverse problem, resulting in a computationally efficient algorithm for sensor selection. As a byproduct of our algorithm, we obtain a preconditioner for the inverse problem that enables the rapid recovery of the initial condition. Here, we analyze the theoretical performance of our greedy sensor selection algorithm as well as the performance of the associated preconditioner. Finally, we verify our theoretical results on various inverse problems involving partial differential equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fast and Scalable FFT-Based GPU-Accelerated Algorithms for Block-Triangular Toeplitz Matrices with Application to Linear Inverse Problems Governed by Autonomous Dynamical Systems

In this work, we present an efficient and scalable algorithm for performing matrix-vector multiplications (matvecs) for block Toeplitz matrices. Such matrices, which are shift-invariant with respect to their blocks, arise in the context of solving inverse problems governed by autonomous systems, and time-invariant systems in particular. In this article, we consider inverse problems that infer unknown parameters from observational data of a linear time-invariant dynamical system given in the form of partial differential equations (PDEs). Matrix-free Newton-conjugate-gradient methods are often the gold standard for solving these inverse problems, but they require numerous actions of the Hessian on a vector. Matrix-free adjoint-based Hessian matvecs require solution of a pair of linearized forward/adjoint PDE solves per Hessian action, which may be prohibitive for large-scale inverse problems. Time invariance of the forward PDE problem leads to a block Toeplitz structure of the discretized parameter-to-observable (p2o) map defining the mapping from inputs (parameters) to outputs (observables) of the PDEs. This block Toeplitz structure enables us to exploit two key properties: (1) compact storage of the p2o map and its adjoint, and (2) efficient fast Fourier transform–based Hessian matvecs. The proposed algorithm is mapped onto large multi-GPU clusters and achieves more than 80% of peak bandwidth on NVIDIA A100 GPUs. Excellent weak scaling is shown for up to 48 A100 GPUs. For the targeted problems, the implementation executes Hessian matvecs within fractions of a second, which is orders of magnitude faster than can be achieved by conventional matrix-free Hessian matvecs via forward/adjoint PDE solves.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Data-driven Resilience Characterization of Control Dynamical Systems

In this paper, we define and quantify resiliency of a power network and propose data-driven algorithms for computing the same for the power grid. To do this, we use the Koopman operator framework to lift the controlled dynamical system to an abstract (possibly higher) dimensional space, where the evolution is linear. The linear system representation allows us to relate small time local controllability and observability of a general nonlinear control system to the controllability and observability of the lifted linear system. Finally, we define the resiliency of the underlying power grid in terms of the controllability and observability gramians of the lifted linear system. We illustrate the proposed approach to compute the resiliency metrics on time-series data obtained from a microgrid.

koopman operator, resilience, control↗
DOE OSTI2023

Combining Agent Based Modeling and System Dynamics to Investigate the Circularity of Plastics

The United States currently produces about 1 million metric ton of ocean plastic pollution annually. One proposed solution to combat plastic waste is a circular economy (CE), which aims to transition from today's take-make-waste linear pattern of production and consumption to a system where the value of resources is maximized over time. Two key methods in industrial ecology are useful in assessing the viability of CE: (1) System Dynamics (SD) and (2) Agent Based Modeling (ABM). In prior work, the plastic life cycle was modeled with SD and ABM. The two models calculate recycling rates and costs in different ways, making it difficult to pinpoint necessary next steps. We integrate the ABM and SD models - linking the emergent patterns from micro-level human decisions to system level processes - which allows a more comprehensive understanding of feedbacks, costs, and environmental impacts. The integrated model is more accurate, and can be used to visualize recycling rates and human health and environmental impacts over time. The difference between the integrated and original SD model prompts a Sobol sensitivity analysis, which is used to understand which behavioral factors most affect plastic recycling patterns. We find that the habitual component is typically the most influential in promoting positive recycling behavior. Additionally, we utilize the combined model to understand and visualize how various behavioral intervention scenarios, like improved access to recycling programs and cart tagging, influence recycling patterns; these results can guide future policy-making.

agent-based modeling↗
DOE OSTI2024

Weak-form inference for hybrid dynamical systems in ecology

Species subject to predation and environmental threats commonly exhibit variable periods of population boom and bust over long timescales. Understanding and predicting such behaviour, especially given the inherent heterogeneity and stochasticity of exogenous driving factors over short timescales, is an ongoing challenge. A modelling paradigm gaining popularity in the ecological sciences for such multi-scale effects is to couple short-term continuous dynamics to long-term discrete updates. We develop a data-driven method utilizing weak-form equation learning to extract such hybrid governing equations for population dynamics and to estimate the requisite parameters using sparse intermittent measurements of the discrete and continuous variables. The method produces a set of short-term continuous dynamical system equations parametrized by long-term variables, and long-term discrete equations parametrized by short-term variables, allowing direct assessment of interdependencies between the two timescales. We demonstrate the utility of the method on a variety of ecological scenarios and provide extensive tests using models previously derived for epizootics experienced by the North American spongy moth ( Lymantria dispar dispar ).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Decentralized digital twins of complex dynamical systems

Abstract In this article, we introduce a decentralized digital twin (DDT) modeling framework and its potential applications in computational science and engineering. The DDT methodology is based on the idea of federated learning, a subfield of machine learning that promotes knowledge exchange without disclosing actual data. Clients can learn an aggregated model cooperatively using this method while maintaining complete client-specific training data. We use a variety of dynamical systems, which are frequently used as prototypes for simulating complex transport processes in spatiotemporal systems, to show the viability of the DDT framework. Our findings suggest that constructing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems may be made possible by federated machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of Dynamical System Scaling for Accelerated Fuel Qualification Efforts

There are considerable ongoing research and testing campaigns to qualify new fuel designs such as metallic fuels for advanced reactor designs and the Accident Tolerant Fuel (ATF) campaign for light water reactors (LWR). The typical research and development lifecycle needed to qualify a nuclear fuel design, under ideal conditions, can take up to 20-25 years which limits the ability for new fuels to make fast deployments into commercial, test, and research reactors. While there are several efforts to accelerate nuclear fuel qualification through advanced modeling coupled with state-of-the-art experiments, there is not yet a framework to methodically quantify and rank distortions occurring in experimental test specimens needed to validate nuclear fuel performance codes. This study uses the Dynamical System Scaling (DSS) methodology to quantify transient scaling distortions that occur over experiment and simulated transients. DSS analysis metrics provide a researcher with several tools and information embedded within test data to identify dominant phenomena, associated timescales, and quantify a transient?s overall dynamic distortion. This is demonstrated with separate analyses of the SETH-C and CHF-SERTTA thermal-hydraulic experiments in the TREAT facility at Idaho National Laboratory. The outcome of this work is a scaling and data analysis approach to account for the influence a scaled fuel test specimen?s geometric and temporal distortions have on its ability to be representative of the full-scale design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems

Physics-informed machine learning (PIML) is a set of methods and tools that systematically integrate machine learning (ML) algorithms with physical constraints and abstract mathematical models developed in scientific and engineering domains. As opposed to purely data-driven methods, {PIML} models can be trained from additional information obtained by enforcing physical laws such as energy and mass conservation. More broadly, {PIML} models can include abstract properties and conditions such as stability, convexity, or invariance. The basic premise of {PIML} is that the integration of ML and physics can yield more effective, physically consistent, and data-efficient models. This paper aims to provide a tutorial-like overview of the recent advances in {PIML} for dynamical system modeling and control. Specifically, the paper covers an overview of the theory, fundamental concepts and methods, tools, and applications on topics of: 1) physics-informed learning for system identification; 2) physics-informed learning for control; 3) analysis and verification of {PIML} models; and 4) physics-informed digital twins. The paper is concluded with a perspective on open challenges and future research opportunities.

Nghiem, Truong↗
DOE OSTI2022

Digitalization, Management and Synthesis of Thermal Hydraulic Legacy Data Using Dynamical System Scaling

A unique attribute of the nuclear industry is the extent by which designers, developers, operators, and regulators pay attention to demonstrating the safety case. The safety case for nuclear systems is a written, traceable expression of safety, demonstrating the system’s protective measures against uncontrolled radiological releases. The nuclear installation resiliency or safety takes overriding priority over function and performance. The preparation of the safety case heavily relies on extensive experimental campaigns that challenge the target design under a spectrum of postulated accident scenarios. For safety reasons, these experiments are typically conducted in sub-scale test apparatuses intended to reproduce the postulated accident scenarios and event sequences realistically but subject to proven similarity criteria, often referred to as scaling analyses. Since the dawn of the nuclear industry, significant resources have been committed to the construction and operation of such test facilities and a massive amount of data has been generated. Such test data have been and are still used to validate the fundamental assumptions of nuclear power plant phenomena. As we move into the digital world, capturing this multi-decades worth of information in a transparent, easily accessible, and usable manner for the public and industry stakeholders is of paramount importance. Over the last few years FPoliSolutions has been actively developing an enterprise digital data ontology platform (FPoliDON) intended to do just that. The concept was introduced in a paper at the previous NURETH edition and has been significantly enhanced since. With the vision of helping designers use the data to assess their safety case evaluation models, the platform was designed not only to ontologically organize the experimental data, but also to guide the user in the complex analytics associated with the interpretation and use of such test results. A new feature which has been recently added is the ability for the user to access a library of sophisticated mathematical procedures for performing scaling analyses. For this purpose, the Dynamical System Scaling (DSS) procedure invented by Dr. Jose’ Reyes was formulated as one of the services in the digital platform. These methods have been demonstrated to provide an excelled mathematical apparatus to identify similarity criteria or quantify distortions between measured data and the target prototypical conditions. Moreover, DSS can provide a level of synthesis across SETs and IETs which has the promise to yield efficiency in the evaluation code assessment activities. This is often a daunting and expensive task to set up evaluation models that support the safety case of current and future nuclear power plants.

Reyes, Jose↗
DOE OSTI2025

Leveraging System Dynamics to Predict the Commercialization Success of Emerging Energy Technologies: Lessons from Wind Energy

The United States urgently needs to tackle the climate crisis while enhancing energy security and resiliency. The complexity of the U.S. energy system, with its interconnected elements, makes predicting future states challenging, especially with the introduction of novel energy systems like wind, solar, clean hydrogen, and advanced nuclear technologies. Modern systems engineering methods and tools can provide deeper insights into these dynamics and future behaviors. This research aims to develop a comprehensive model that captures the main elements and behaviors of new energy technologies within the existing energy system. We hypothesized that the market uptake of novel energy systems is influenced by multiple diverse factors, such as technological learning, availability of resources, and economic incentives; examined the history of electricity generation using land-based wind technologies; and developed a system dynamics model to investigate the relationships between capacity growth and influencing factors, both internal and external. The developed model yielded outcomes that confirmed the hypothesized dynamics of wind energy system diffusion through a quantitative comparison of installed capacity and highlighted the significant influence of resource availability, federal incentives (production tax credits), and technological learning on capacity growth and cost reduction. This research aims to support informed decision-making for investments in novel energy systems and aid in developing effective policies for technology deployment.

17 WIND ENERGY↗