Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “spatio-temporal systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Big Data Meets Geothermal Exploration (CRADA Final Report)

As part of the Cyclotron Road program, Zanskar Geothermal & Minerals, Inc. investigated the application of micro-earthquake and ambient noise seismology methods to imaging and characterizing the structural characteristics and hydrothermal flux of subsurface faults. Significant advances in what could be resolved were enabled by two major developments in seismology: 1) the availability of large-n arrays of low-cost seismometers, and 2) the availability of increased computational power and semi-automated data reduction algorithms. In tandem, these advances may improve the signal-to-noise ratio and spatial precision of the data collected and enable higher-resolution characterization of subsurface fracture systems and their spatio-temporal evolution. These tools supported efforts to reduce dry-hole risk and to improve wellfield productivity for geothermal resource development. In particular, two applications of these advances were evaluated: 1) fracture-seismic imaging, which was used to detect ambient emissions from fluid-filled fractures, and 2) reservoir tomography, which used information about travel paths, source locations, and source parameters of micro-earthquakes to identify areas of enhanced permeability. Integration of these methods provided guidance for siting wells and served as prior constraints for reservoir models, informing forecasts of power potential and production and injection strategies aimed at minimizing temperature decline and improving overall resource productivity.

15 GEOTHERMAL ENERGY↗

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗

Evaluating Mean State Cloud Properties in the Simple Cloud‐Resolving E3SM Atmosphere Model (SCREAM)

Accurately simulating clouds remains a key challenge in global climate models, primarily because cloud formation involves sub-grid processes that are parameterized and crudely represented in models. This study examines the performance of DOE's Simple Cloud-Resolving Energy Exascale Earth System (E3SM) Atmosphere Model (SCREAM) in simulating cloud properties and their spatio-temporal distribution by comparing against satellite observations. Two horizontal resolutions of SCREAM (3 and 12 km) are examined, and both depict a realistic spatial structure of mean-state cloud cover but underestimate its global mean magnitude. SCREAM 3 km reasonably reproduces the distribution of mean-state cloud properties across various cloud optical thickness and cloud-top pressure regimes, with performance comparable to CMIP5 and CMIP6 ensemble and marginally outperforming SCREAM 12 km. Still, SCREAM 3 km tends to underpredict low clouds and optically thin clouds, highlighting the need for continued improvement in representing unresolved processes. This study provides a basis for confidence in the representation of clouds in SCREAM, as simulating mean-state clouds is a necessary prerequisite for trusting its cloud responses to changes in aerosols and greenhouse gases.

Geosciences↗

Causality-respecting adaptive refinement for PINNs: enabling precise interface evolution in phase field modeling

Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving physical systems described by partial differential equations (PDEs). However, their accuracy in dynamical systems, particularly those involving sharp moving boundaries with complex initial morphologies, remains a challenge. Here, this study introduces an approach combining residual-based adaptive refinement (RBAR) with causality-informed training to enhance the performance of PINNs in solving spatio-temporal PDEs. Our method employs a three-step iterative process: initial causality-based training, RBAR-guided domain refinement, and subsequent causality training on the refined mesh. Applied to the Allen-Cahn equation, a widely-used model in phase field simulations, our approach demonstrates significant improvements in solution accuracy and computational efficiency over traditional PINNs. Notably, we observe an ‘overshoot and relocate’ phenomenon in dynamic cases with complex morphologies, showcasing the method’s adaptive error correction capabilities. This synergistic interaction between RBAR and causality training enables accurate capture of interface evolution, even in challenging scenarios where traditional PINNs fail. Our framework not only resolves the limitations of uniform refinement strategies but also provides a generalizable methodology for solving a broad range of spatio-temporal PDEs. The enhanced performance of the RBAR–causality combined framework demonstrates its strong potential for advancing PINN-based modeling of physical systems characterized by complex, evolving interfaces.

Allen-Cahn equations↗

Parallel-in-Time Solution of Hyperbolic PDE Systems via Characteristic-Variable Block Preconditioning

We consider the parallel-in-time solution of both linear and nonlinear hyperbolic partial differential equation (PDE) systems in one spatial dimension. In the nonlinear setting, the discretized equations are solved with a preconditioned residual iteration based on a global linearization. The linear(ized) equation systems are approximately solved parallel-in-time using a block preconditioner applied in the characteristic variables of the underlying linear(ized) hyperbolic PDE. This change of variables is motivated by the observation that intervariable coupling between characteristic variables is weak, at least locally where spatio-temporal variations in the eigenvectors of the associated flux Jacobian are sufficiently small, while that between the original variables is not. For an ℓ-dimensional system of PDEs, applying the preconditioner consists of solving a sequence of ℓ scalar linear(ized)-advection-like problems, each associated with a different characteristic wave-speed in the underlying linear(ized) PDE. Furthermore, we approximately solve these linear advection problems using multigrid reduction-in-time (MGRIT); however, any other suitable parallel-in-time method could be used. Numerical examples are shown for the (linear) acoustics equations in heterogeneous media and for the (nonlinear) shallow water equations and Euler equations of gas dynamics with shocks and rarefactions. For many test problems, the solver converges in just a handful of iterations and with mesh-independent convergence rates.

97 MATHEMATICS AND COMPUTING↗

Spatio-temporal Fourier Transformer for Long-term Dynamics Prediction (StFT) v1.0

We propose a novel machine learning model spatio-temporal Fourier transformer (StFT) to emulate long-term dynamics of multi-scale and multi-physics systems. Our method StFT overcomes the limitations of rapid error accumulation, particularly in long-term forecasting of systems characterized by complex and coupled dynamics. StFT achieves outstanding accuracy and computational efficiency by effectively capturing multi-scale interactions, and quantify the uncertainties inherent in the predictions. Our model leverages a structured hierarchy of StFT blocks, and explicitly captures dynamics across both macro- and micro- spatial scales. Evaluations conducted on three benchmark datasets (plasma, fluid, and atmospheric dynamics) demonstrate the advantages of our approach over state-of-the-art ML methods.

Bai, Zhe [Lawrence Berkeley National Laboratory (L↗

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗

Distributed optical fibre sensing in physical oceanography: emergence and future prospects

Distributed optical fibre sensing (DOFS) is a technology that enables continuous, real-time measurements of a range of environmental parameters along the length of a fibre optic cable. In this article, we review the recently emerged applications of DOFS techniques in physical oceanography and offer a perspective on the technology's potential for future growth within the field. The introduction of DOFS to physical oceanography is contextualised with a brief history of the technology, which spun off primarily from the use of seafloor-laid optical fibres for telecommunications purposes. The key components and underpinning physics of a DOFS system are outlined and, on their basis, the suite of variables that are observable with DOFS are discussed. The implementation factors of DOFS, which include trade-offs between measurement accuracy and spatio-temporal resolutions and ranges, are also examined. The physical oceanographic applications of DOFS to date are then illustrated with case examples of four distinct DOFS techniques: distributed temperature sensing (DTS), which can provide ocean temperature observations; distributed static strain sensing (DSS) and distributed acoustic sensing (DAS), which are sensitive to temperature, cable strain and strain-associated variables, such as pressure and ocean velocity; and ultra-long-range observations of ocean currents with optical interferometry. The forthcoming prospects of DOFS in physical oceanography are considered, and are proposed to include new fibre optic-based approaches to sense ocean salinity and measure through the water column. We conclude with reflections on the future role of DOFS within the Global Ocean Observing System, and highlight the opportunities provided by the existing world-wide network of seafloor-laid optical fibres.

Naveira Garabato, Alberto C. [Univ. of Southampton↗

The ABCs of On-Demand Transit (ODT)

On-demand mobility - also referred to as on-demand transit (ODT) - is a form of public mobility that is flexible with respect to where and when service is provided, and ODT deployments have increased significantly in recent years. Transit agencies are becoming increasingly interested in ODT, and due to differing definitions and various service design and business model options, it can be difficult to learn about the emerging industry. This work provides an overview of the definitions of ODT, recent trends internationally and in the U.S., ODT's benefits and challenges (particularly compared to fixed-route transit), three primary service design options, system costs and funding considerations, and a metrics framework for evaluating ODT systems to ensure continued successful performance. Identified benefits include increased service areas, short ride and wait times, increased user flexibility, potential to reduce energy consumption and emissions through shared trips and smaller, right-sized vehicles, increased safety and comfort through door-to-door service, and rich data streams including granular spatio-temporal data that can be analyzed to continuously improve the service. Challenges include scaling ODT service up as small increases in ridership require additional supply to keep service quality high, serving peak times including keeping low wait times, the lack of fixed schedule being challenging for commuters, integrating ODT services with nearby transit systems, and equity for riders without smartphones who cannot track the vehicle in a mobile app. Finally, an overview of seven ODT case studies (in Texas, Missouri, New York, and Ontario, Canada) performed by NREL and related analysis of travel time, energy and emissions, costs, and equity are presented. Initial key findings include: ODT can be cost- and energy-effective compared to fixed-route transit, ODT serves more people than other transit options, and ODT system deployments can be followed by rapid growth.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Efficient data-driven regression for reduced-order modeling of spatial pattern formation

We present an efficient data-driven regression approach for constructing reduced-order models (ROMs) of reaction-diffusion systems exhibiting pattern formation. The ROMs are learned non-intrusively from available training data of physically accurate numerical simulations. The method can be applied to general nonlinear systems through the use of polynomial model form, while not requiring knowledge of the underlying physical model, governing equations, or numerical solvers. The process of learning ROMs is posed as a low-cost least-squares problem in a reduced-order subspace identified via Proper Orthogonal Decomposition (POD). Numerical experiments on classical pattern-forming systems–including the Schnakenberg and Mimura–Tsujikawa models–demonstrate that higher-order surrogate models significantly improve prediction accuracy while maintaining low computational cost. The proposed method provides a flexible, non-intrusive model reduction framework, well suited for the analysis of complex spatio-temporal pattern formation phenomena.

Data-driven modeling↗

Learning turbulent flows with generative models for super resolution and sparse flow reconstruction

Neural operators are promising surrogates for dynamical systems but when trained with standard L 2 losses they tend to oversmooth fine-scale turbulent structures. Here, we show that combining operator learning with generative modeling overcomes this limitation. We consider three practical turbulent-flow challenges where conventional neural operators fail: spatio-temporal super-resolution, forecasting, and sparse flow reconstruction. For Schlieren jet super-resolution, an adversarially trained neural operator (adv-NO) reduces the energy-spectrum error by 15 × while preserving sharp gradients at neural operator-like inference cost. For 3D homogeneous isotropic turbulence, adv-NO trained on only 160 timesteps from a single trajectory forecasts accurately for five eddy-turnover times and offers 114 × wall-clock speed-up at inference than the baseline diffusion-based forecasters, enabling near-real-time rollouts. For reconstructing cylinder wake flows from highly sparse Particle Tracking Velocimetry-like inputs, a conditional generative model infers full 3D velocity and pressure fields with correct phase alignment and statistics. These advances enable accurate reconstruction and forecasting at low compute cost, bringing near-real-time analysis and control within reach in experimental and computational fluid mechanics.

Fluid dynamics↗

Time-dependent-bases with local CUR decomposition method for accelerating turbulent combustion simulations

Here, this study presents a novel reduced-order modeling framework, Time-Dependent Bases with Local CUR decomposition (TDB-L-CUR), designed to efficiently and accurately approximate the species transport equations in reacting flow simulations. The method extends the existing TDB-CUR approach for chemically reacting flows (Jung et al. Comput. Methods Appl. Mech. Engrg. 437 (2025) 117758), which leverages matrix decomposition techniques to form a global-in-space, time-dependent low-dimensional manifold. While TDB-CUR performs well in homogeneous systems, it may be less well-suited to spatially heterogeneous systems such as turbulent flames, where higher-rank approximations are typically required. The proposed TDB-L-CUR framework introduces two methodological extensions to the baseline approach. First, it applies unsupervised clustering to partition the physical domain into distinct regions, enabling spatially localized manifold construction, thereby reducing the rank required for the reduced-order representation. Second, it incorporates a computational singular perturbation (CSP)-based scheme for identifying and penalizing fast species, allowing for spatio-temporally adaptive mitigation of chemical stiffness. The proposed framework is validated on a hierarchy of test cases, including a one-dimensional premixed flame, a two-dimensional nonpremixed ignition case with vortex interaction, and a three-dimensional turbulent premixed flame. TDB-L-CUR significantly improves accuracy over TDB-CUR while further reducing computational cost. The fully on-the-fly formulation of TDB-L-CUR (i.e., requiring no offline training or prior knowledge) makes it a robust and scalable tool for reduced-order modeling of reactive flows.

Local manifold↗

Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detection

The proliferation of sensors brings an immense volume of spatio-temporal (ST) data in many domains, including monitoring, diagnostics, and prognostics applications. Data curation is a time-consuming process for a large volume of data, making it challenging and expensive to deploy data analytics platforms in new environments. Transfer learning (TL) mechanisms promise to mitigate data sparsity and model complexity by utilizing pre-trained models for a new task. Despite the triumph of TL in fields like computer vision and natural language processing, efforts on complex ST models for anomaly detection (AD) applications are limited. In this study, we present the potential of TL within the context of high-dimensional ST AD with a hybrid autoencoder architecture, incorporating convolutional, graph, and recurrent neural networks. Motivated by the need for improved model accuracy and robustness, particularly in scenarios with limited training data on systems with thousands of sensors, this research investigates the transferability of models trained on different sections of the Hadron Calorimeter of the Compact Muon Solenoid experiment at CERN. The key contributions of the study include exploring TL’s potential and limitations within the context of encoder and decoder networks, revealing insights into model initialization and training configurations that enhance performance while substantially reducing trainable parameters and mitigating data contamination effects.

47 OTHER INSTRUMENTATION↗

Vortical interactions in turbulent thermoacoustic systems

This study examines the dynamics of vortical interactions and their implications for mitigating thermoacoustic instability in a turbulent combustor. The regions of intense vortical interactions are identified as vortical communities in the network space of weighted directed vortical networks constructed from two-dimensional experimental velocity data. One can expect vortical interactions in the combustor to be strongest near the moment of vortex shedding, as the shed vortices gradually weaken due to dissipation while convecting downstream. However, we show that, during the state of thermoacoustic instability, there is a non-trivial consistent phase lag of approximately 52° between the shedding of the coherent structures from the backward-facing step and the time instant when the vortical interactions attain their local maximum value. We explain this phase lag by investigating the correlation between acoustic pressure fluctuations, spatio-temporal dynamics of coherent structures and vortical interactions in the reaction field of the combustor. We also show the aperiodic variation of vortical interactions during the states of combustion noise and aperiodic epochs of intermittency. Furthermore, the spatio-temporal evolution of pairs of vortical communities with the maximum inter-community interactions provides insight into explaining the critical regions detected in the reaction field during the states of intermittency and thermoacoustic instability, also identified in previous studies. As a result, we further show that the most efficient suppression of thermoacoustic instability via air microjet injection is achieved when steady air jets are introduced to disrupt the maximum inter-community interactions present during the state of thermoacoustic instability.

Sahay, Ankit [Indian Institute of Technology Madra↗

Separability of microtearing mode and electron temperature gradient turbulence regimes

The separability of microtearing mode (MTM)-dominated and electron temperature gradient (ETG)-driven turbulence regimes is studied with multiscale nonlinear gyrokinetic simulations. The simulations are based on National Spherical Torus Experiment-like, high-confinement mode pedestal parameters, where electromagnetic perturbations are large. Linear analysis indicates a wide scale-separation between the MTM and ETG modes in binormal wavenumber space (perpendicular to the magnetic field line), with no unstable modes at intermediate scales. Likewise, single-scale nonlinear analyses, retaining ion-only or electron-only spatio-temporal scales, produce seemingly well-converged transport states. Surprisingly, the multiscale simulation, which contains both the ion and electron scales, closely follows the transport from the electron-scale simulation. This trend is robust over a wide range of electron temperature gradient. Remarkably, compared to ion-scale simulations, MTM turbulence is significantly reduced at multiscale resolution even when ETG turbulence is low. In this case, traditional ion-scale resolution overestimates the electron energy flux, and it is not possible to accurately simulate the MTM turbulence with separable ion-scale simulations. Here, while the analysis confirms the validity of electron-scale simulations for predicting the electron transport, it also indicates that multiscale simulation may be required for reproducing the turbulence spectrum for systems with coupled MTM-ETG turbulence.

H-mode↗

Interactive multiscale modeling to bridge atomic properties and electrochemical performance in Li-CO 2 battery design

Li-CO 2 batteries are promising energy storage systems due to their high theoretical energy density and CO 2 fixation capability, relying on reversible Li 2 CO 3 /C formation during discharge/charge cycles. Here, we present a multiscale modeling framework integrating Density Functional Theory (DFT), Ab-Initio Molecular Dynamics (AIMD), classical Molecular Dynamics (MD), and Finite Element Analysis (FEA) to investigate atomic and cell-level properties. The considered Li-CO 2 battery consists of a lithium metal anode, an ionic liquid electrolyte, and a carbon cloth cathode with Sb 0.67 Bi 1.33 Te 3 catalyst. DFT and AIMD determined the electrical conductivities of Sb 0.67 Bi 1.33 Te 3 and Li 2 CO 3 using the Kubo–Greenwood formalism and studied the CO 2 reduction mechanism on the cathode catalyst. MD simulations calculated the CO 2 diffusion coefficient, Li + transference number, ionic conductivity, and Li + solvation structure. The FEA model, parameterized with atomistic simulation data, reproduced the available experimental voltage–capacity profile at 1 mA/cm 2 and revealed spatio-temporal variations in Li 2 CO 3 /C deposition, porosity, and CO 2 concentration dependence on discharge rates in the cathode. Accordingly, Li 2 CO 3 can form large and thin film deposits, leading to dispersed and local porosity changes at 0.1 mA/cm 2 and 1 mA/cm 2 , respectively. The capacity decreases exponentially from 81,570 mAh/g at 0.1 mA/cm 2 to 6200 mAh/g at 1 mA/cm 2 , due to pore clogging from excessive discharge product deposition that limits CO 2 transport to the cathode interior. Therefore, the performance of Li-CO 2 batteries can be improved by enhancing CO 2 transport, regulating Li 2 CO 3 deposition, and optimizing cathode architecture.

Battery performance↗

A new biogeochemical modelling framework (FLaMe-v1.0) for lake methane emissions on the regional scale: development and application to the European domain

This study presents a new physical-biogeochemical modelling framework for simulating lake methane (CH 4 ) emissions at regional scales. The new model, FLaMe-v1.0 (Fluxes of Lake Methane), rests on an innovative, computationally efficient lake clustering approach that enables the simulation of CH 4 emissions across a large number of lakes. Building on the Canadian Small Lake Model (CSLM) that simulates the lake physics, we develop a suite of biogeochemical modules to simulate transient dynamics of organic Carbon (C), Oxygen (O 2 ), and CH 4 . We first test the performance of FLaMe-v1.0 by analyzing physical and biogeochemical processes in two theoretical lakes with characteristics that can be considered representative for many lakes (an oligotrophic, deep lake driven by cold climate versus a eutrophic, shallow lake driven by warm climate). Next, we evaluate the model by comparing simulated and observed timeseries of CH 4 emissions in four well-surveyed lakes. We then apply FLaMe-v1.0 at the European scale to evaluate simulated diffusive and ebullitive lake CH 4 fluxes against in-situ measurements in both boreal and central European regions. Finally, we provide a first assessment of the spatio-temporal variability in CH 4 emissions from European lakes with a surface area comprised between 0.1–1000 km 2 (n= 108 407, total area = 1.33 × 105 km 2 ), indicating a total emission of 0.97 ± 0.23 Tg CH 4 yr −1 , with the uncertainty constrained by combining FLaMe-v1.0 and machine learning techniques. Moreover, 30 % and 70 % of these CH 4 emissions are through diffusive and ebullitive pathways, respectively. Annually averaged CH 4 emission rates per unit lake area during 2010–2016 have a South-to-North decreasing gradient, resulting in a mean over the European domain as 7.39 g CH 4 m −2 yr −1 . Our simulations reveal a strong seasonality (with ice-blocking effects accounted for) in European lake CH 4 emissions, with nearly ten times higher emissions during late summer than during winter. This pronounced seasonal variation highlights the importance of accounting for the sub-annual variability in CH 4 emissions to accurately constrain regional CH 4 budgets. In the future, FLaMe-v1.0 could be embedded into Earth System Models to investigate the feedback between climate warming and global lake CH 4 emissions.

Maisonnier, Manon [Free Univ. of Brussels (Belgium↗