Modeling Nonequilibrium Reactive Systems with REACTER
Explore the source record for details and available documents.
machine learning, polymer simulations, molecular d↗
SEARCH · Engineering Papers
Results for “dynamic model learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Temporally-consistent koopman autoencoders for forecasting dynamical systems
Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Closeout Report: Data Driven Modeling of Non-Equilibrium Dynamics in Chemical and Materials Systems [Slides]
Data from quantum mechanical calculations were generated to train a NN model for predicting phosphorescence energies. Model uses localization layer, which learns to resemble the triplet spin density without explicit training.
36 MATERIALS SCIENCE↗
Estimating building occupancy: a machine learning system for day, night, and episodic events
Building occupancy research increasingly emphasizes understanding the social and physical dynamics of how people occupy space. Opportunities in the open source domain including social media, Volunteered Geographic Information, crowdsourcing, and sensor data have proliferated, resulting in the exploration of building occupancy dynamics at varying spatiotemporal scales. At Oak Ridge National Laboratory, research into building occupancies through the development of a global learning framework that accommodates exploitation of open source authoritative sources, including governmental census and surveys, journal articles, real estate databases, and more, to report national and subnational building occupancies across the world continues through the Population Density Tables (PDT) project. This probabilistic learning system accommodates expert knowledge, experience, and open-source data to capture local, socioeconomic, and cultural information about human activity. It does so through a systematic process of data harmonization techniques in the development of observation models for over 50 building types to dynamically update baseline estimates and report probabilistic diurnal and episodic building occupancy estimates. This discussion will explore how PDT is implemented at scale and expanded based on the development of observation model classes and will explain how to interpret and spatially apply the reported probability occupancy estimates and uncertainty.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
When do short-range atomistic machine-learning models fall short?
In this work, we explore the role of long-range interactions in atomistic machine-learning models by analyzing the effects on fitting accuracy, isolated cluster properties, and bulk thermodynamic properties. Such models have become increasingly popular in molecular simulations given their ability to learn highly complex and multi-dimensional interactions within a local environment; however, many of them fundamentally lack a description of explicit long-range interactions. In order to provide a well-defined benchmark system with precisely known pairwise interactions, we chose as the reference model a flexible version of the Extended Simple Point Charge (SPC/E) water model. Our analysis shows that while local representations are sufficient for predictions of the condensed liquid phase, the short-range nature of machine-learning models falls short in representing cluster and vapor phase properties. These findings provide an improved understanding of the role of long-range interactions in machine learning models and the regimes where they are necessary.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
When ancient numerical demons meet physics-informed machine learning: adjoint-based gradients for implicit differentiable modeling
Recent advances in differentiable modeling, a genre of physics-informed machine learning that trains neural networks (NNs) together with process-based equations, have shown promise in enhancing hydrological models' accuracy, interpretability, and knowledge-discovery potential. Current differentiable models are efficient for NN-based parameter regionalization, but the simple explicit numerical schemes paired with sequential calculations (operator splitting) can incur numerical errors whose impacts on models' representation power and learned parameters are not clear. Implicit schemes, however, cannot rely on automatic differentiation to calculate gradients due to potential issues of gradient vanishing and memory demand. Here we propose a “discretize-then-optimize” adjoint method to enable differentiable implicit numerical schemes for the first time for large-scale hydrological modeling. The adjoint model demonstrates comprehensively improved performance, with Kling–Gupta efficiency coefficients, peak-flow and low-flow metrics, and evapotranspiration that moderately surpass the already-competitive explicit model. Therefore, the previous sequential-calculation approach had a detrimental impact on the model's ability to represent hydrological dynamics. Furthermore, with a structural update that describes capillary rise, the adjoint model can better describe baseflow in arid regions and also produce low flows that outperform even pure machine learning methods such as long short-term memory networks. The adjoint model rectified some parameter distortions but did not alter spatial parameter distributions, demonstrating the robustness of regionalized parameterization. Despite higher computational expenses and modest improvements, the adjoint model's success removes the barrier for complex implicit schemes to enrich differentiable modeling in hydrology.
58 GEOSCIENCES↗
X-56A Structural Dynamics Ground Testing Overview and Lessons Learned
The X-56A Multi-Utility Technology Testbed (MUTT) is a subscale, fixed-wing aircraft designed for high-risk aeroelastic flight demonstration and research. Structural dynamics ground testing for model validation was especially important for this vehicle because the structural model was directly used in the development of a flight control system with active flutter suppression capabilities. Structural dynamics ground tests of the X-56A MUTT with coupled rigid-body and structural modes provided a unique set of challenges. An overview of the ground vibration test (GVT) and moment of inertia (MOI) test setup and execution is presented. The series of GVTs included the wing by itself attached to a strongback and complete vehicle at two mass conditions: empty and full fuel. Two boundary conditions for the complete-vehicle test were studied: on landing gear and suspended free-free. Pitch MOI tests were performed using a compound pendulum method and repeated with two different pendulum lengths for independent verification. The original soft-support test configuration for the GVT used multiple bungees, resulting in unforeseen coupling interactions between the soft-support bungees and the vehicle structural modes. To resolve this problem, the soft-support test setup underwent multiple iterations. The various GVT configurations and boundary-condition modifications are highlighted and explained. Lessons learned are captured for future consideration when performing structural dynamics testing with similar vehicles.
Chin, Alexander W.↗
Enabling Predictive Scale-Bridging Simulations through Active Learning (Institutional Computing Annual Report (Project w21_alscalebridging)) [Slides]
The goal of this project was to develop, demonstrate, and provide a new capability to achieve greater physical fidelity in large-scale simulations, rather than the usual brute-force increases in the number of mesh elements or particles. Transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, is affected by molecular-level interactions. Several coarse-scale Lattice Boltzmann model (LBM) parameters cannot be directly computed, so instead we calibrate them to molecular dynamics (MD) simulations, by building emulators that mimic MD and LBM behavior and then training an upscaler. The resulting machine learning (ML)-based scale-bridging framework is up to 7 orders of magnitude faster than direct MD.
74 ATOMIC AND MOLECULAR PHYSICS↗
Detecting Risk and Anomalies in Airplane Dynamics Through Entropic Analysis of Time Series Data
Despite recent efforts to move away from traditional threshold exceedance detection methods for aircraft state monitoring, modern aircraft still rely on safety thresholds to communicate to pilots the identification of an anomaly in the aircraft when a threshold is surpassed. Current anomaly detection methods mainly depend on uninterpretable machine learning models to learn complex patterns and relationships contained in the time series data of aircraft. Although these methods are capable of identifying known anomalies, their deficiency in interpretability presents a challenge when translating them to different aircraft. To overcome this deficiency, entropic analysis of aircraft dynamics seeks to characterize the complexity, or lack thereof, of the aircraft dynamics prior to the development of a risk scenario. This complexity characterization provides a more straightforward summary of state changes in the dynamics of flight variables. To build a foundation for entropic analysis, we analyzed the complexity of unstable approaches, an anomalous event present in many of today’s aviation accidents. The analysis revealed a statistically significant difference in the complexity distribution of flight variables under a stable approach versus an unstable approach. These differences in complexity were especially notable minutes before an approach was identified as unstable. Moreover, the multiscale entropic analysis revealed the presence of signal complexity at multiple time scales across multiple time windows before landing. By capturing state changes and corrections in the aircraft dynamics using entropy, advanced, yet still interpretable, sensor systems based on entropic frameworks from this study can be constructed in the future using classical machine learning approaches.
Risk detection↗
Modeling Low Intensity Fires: Lessons Learned from 2012 RxCADRE
Coupled fire-atmosphere models are increasingly being used to study low-intensity fires, such as those that are used in prescribed fire applications. Thus, the need arises to evaluate these models for their ability to accurately represent fire spread in marginal burning conditions. In this study, wind and fuel data collected during the Prescribed Fire Combustion and Atmospheric Dynamics Research Experiments (RxCADRE) fire campaign were used to generate initial and boundary conditions for coupled fire-atmosphere simulations. We present a novel method to obtain fuels representation at the model grid scale using a combination of imagery, machine learning, and field sampling. Several methods to generate wind input conditions for the model from eight different anemometer measurements are explored. We find a strong sensitivity of fire outcomes to wind inputs. This result highlights the critical need to include variable wind fields as inputs in modeling marginal fire conditions. This work highlights the complexities of comparing physics-based model results against observations, which are more acute in marginal burning conditions, where stronger sensitivities to local variability in wind and fuels drive fire outcomes.
54 ENVIRONMENTAL SCIENCES↗
Machine Learning Interatomic Potentials for Modeling Framework Flexibility and Water Uptake in NbOFFIVE-1-Ni Metal–Organic Framework
Metal–organic frameworks (MOFs), with their distinctive porous structures and tunable chemical properties, have shown immense promise in the separation and storage of gases. Currently, the accurate simulation of their adsorptive properties remains challenging, especially for systems where the molecules fit very tightly into the pores. Traditional simulation methods often approximate the frameworks as rigid and do not account for the framework flexibility seen in materials such as NbOFFIVE-1-Ni. First-principles molecular dynamics (FPMD) simulations offer the desired accuracy in modeling this flexibility but are limited by their extensive computational demands, rendering them impractical for long simulations. Conversely, classical force field-based simulations offer computational efficiency but lack the necessary accuracy. Here, to break this accuracy-efficiency trade-off, we have developed machine learning interatomic potentials trained on energies and forces from FPMD to model the framework flexibility of NbOFFIVE-1-Ni in the presence of water over nanosecond time scales. Furthermore, by integrating MLIP-driven molecular dynamics (MLIP-MD) with grand canonical Monte Carlo (GCMC) simulations, we further incorporated framework flexibility into adsorption predictions, yielding water adsorption isotherms that better align with experimental data compared to those of conventional GCMC simulations. These advances offer new opportunities for the design and optimization of MOFs in gas storage and separation applications.
adsorption↗
A machine-learning approach to measure 3D sample properties from 2D Transmission Electron Microscopy images
Transmission Electron Microscopy (TEM) is a powerful tool for the characterization of materials at the nanoscale; however, its inherent two-dimensional (2D) nature poses significant challenges to accurately measure three-dimensional (3D) properties. We introduce a supervised machine-learning model that predicts 3D structural information, such as sample thickness and curvature, from a series of conventional 2D TEM images. The model, a U-Net convolutional neural network, is trained on a large synthetic dataset generated from dynamical diffraction simulations that model TEM’s complex, nonlinear image formation, accounting for sample thickness and curvature. This physically realistic framework enables exploration of a broad parameter space impractical to sample experimentally. We demonstrate that the trained model has accurate predictions for experimental single-crystal silicon samples, achieving performance comparable to established measurement techniques. This work highlights the critical role of robust, simulation-based training in overcoming the limitations of real-world imaging artifacts and inconsistent sample geometries. By integrating machine learning with numerical simulations, we offer an efficient and scalable framework for quantitative TEM analysis, paving the way for more sophisticated 3D characterization of complex materials.
Dynamical diffraction↗
Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint
With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.
auto-encoders↗
Diesel Generator Model Parameterization for Microgrid Simulation Using Hybrid Box-Constrained Levenberg-Marquardt Algorithm
Existing generator parameterization methods, typically developed for large turbine generator units, are difficult to apply to small kW-level diesel generators in microgrid applications. Here, this article presents a model parameterization method that estimates a complete set of kW-level diesel generator parameters simultaneously using only load-step-change tests with limited measurement points. This method provides a more cost-efficient and robust approach to achieve high-fidelity modeling of diesel generators for microgrid dynamic simulation. A two-stage hybrid box-constrained Levenberg-Marquardt (H-BCLM) algorithm is developed to search the optimal parameter set given the parameter bounds. A heuristic algorithm, namely Generalized Opposition-based Learning Genetic Algorithm (GOL-GA), is applied to identify proper initial estimates at the first stage, followed by a modified Levenberg-Marquardt algorithm designed to fine tune the solution based on the first-stage result. The proposed method is validated against dynamic simulation of a diesel generator model and field measurements from a 16kW diesel generator unit.
42 ENGINEERING↗
Biogeochemistry of hypersaline microbial mats illustrates the dynamics of modern microbial ecosystems and the early evolution of the biosphere
Photosynthetic microbial mats are remarkably complete self-sustaining ecosystems at the millimeter scale, yet they have substantially affected environmental processes on a planetary scale. These mats may be direct descendents of the most ancient biological communities in which even oxygenic photosynthesis might have developed. Photosynthetic mats are excellent natural laboratories to help us to learn how microbial populations associate to control dynamic biogeochemical gradients.
Ecosystem↗
Learning stochastic dynamics with statistics-informed neural network
We introduce a machine-learning framework named statistics-informed neural network (SINN) for learning stochastic dynamics from data. This new architecture was theoretically inspired by a universal approximation theorem for stochastic systems, which we introduce in this paper, and the projection-operator formalism for stochastic modeling. Here, we devise mechanisms for training the neural network model to reproduce the correct statistical behavior of a target stochastic process. Numerical simulation results demonstrate that a well-trained SINN can reliably approximate both Markovian and non-Markovian stochastic dynamics. We demonstrate the applicability of SINN to coarse-graining problems and the modeling of transition dynamics. Furthermore, we show that the obtained reduced-order model can be trained on temporally coarse-grained data and hence is well suited for rare-event simulations.
97 MATHEMATICS AND COMPUTING↗
Application of adjoint operators to neural learning
A technique for the efficient analytical computation of such parameters of the neural architecture as synaptic weights and neural gain is presented as a single solution of a set of adjoint equations. The learning model discussed concentrates on the adiabatic approximation only. A problem of interest is represented by a system of N coupled equations, and then adjoint operators are introduced. A neural network is formalized as an adaptive dynamical system whose temporal evolution is governed by a set of coupled nonlinear differential equations. An approach based on the minimization of a constrained neuromorphic energylike function is applied, and the complete learning dynamics are obtained as a result of the calculations.
Barhen, J.↗
Variational Autoencoders for Learning Nonlinear Dynamics of Physical Systems
We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning nonlinear state space models from observations. We develop ways to incorporate geometric and topological priors through general manifold latent space representations. We investigate the performance of our methods for learning low dimensional representations for the nonlinear Burgers equation and constrained mechanical systems.
97 MATHEMATICS AND COMPUTING↗