Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
DOE OSTI2022

Parameterization of generic positive sequence models to represent behavior of inverter based resources in low short circuit scenarios

The connection of large inverter based resources (IBR) in transmission systems is often located geographically and electrically far away from load centers. This, coupled with the displacement of synchronous machine plants, results in a reduction of the network short circuit strength at the point of connection. Under these conditions, state-of-the-art positive sequence simulation platforms and models can have difficulties maintaining numerical stability and/or providing an accurate representation of IBR plant dynamic behavior. As a result, computationally heavy time domain electromagnetic transient (EMT) simulations may be required to evaluate these systems. In this paper, a recently developed improved generic positive sequence model is parameterized to provide a representation of IBR behavior in low short circuit networks. Further, comparisons against generic and detailed EMT models demonstrate the suitability of the improved positive sequence model to study practical stability issues experienced with presently in-service plants. Such a model can provide some of the accuracy of an EMT representation with a much lower computational burden. The performance of the positive sequence model is validated against the behavior shown by both open white box and closed black box EMT domain models from around the world.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Stability of Kuramoto networks subject to large and small fluctuations from heterogeneous and spatially correlated noise

Oscillatory networks subjected to noise are broadly used to model physical and technological systems. Due to their nonlinear coupling, such networks typically have multiple stable and unstable states that a network might visit due to noise. In this article, we focus on the assessment of fluctuations resulting from heterogeneous and spatially correlated noise inputs on Kuramoto model networks. We evaluate the typical, small fluctuations near synchronized states and connect the network variance to the overlap between stable modes of synchronization and the input noise covariance. Going beyond small to large fluctuations, we introduce the indicator mode approximation that projects the dynamics onto a single amplitude dimension. Such an approximation allows for estimating rates of fluctuations to saddle instabilities, resulting in phase slips between connected oscillators. Statistics for both regimes are quantified in terms of effective noise amplitudes that are compared and contrasted for several noise models. In conclusion, bridging the gap between small and large fluctuations, we show that a larger network variance does not necessarily lead to higher rates of large fluctuations.

42 ENGINEERING↗
DOE OSTI2026

BMINN: Learning chemical potentials and parameters from voltage data for multi-phase battery modeling

Free-energy landscapes and chemical potentials govern the dynamics of phase transitions, transport, and stability in functional materials, yet they remain experimentally inaccessible under realistic operating conditions. Here we introduce a Bayesian model-integrated neural network (BMINN) that embeds physics-based formulations of non-autonomous partial differential-algebraic equations into probabilistic learning. This approach reconstructs hidden thermodynamics directly from macroscopic current-voltage data, providing quantitative access to metastable states, staging transitions, and energy barriers without synchrotron probes. Demonstrated on lithium-graphite electrodes, BMINN recovers full Gibbs free-energy landscapes with fidelity validated against operando X-ray diffraction. The framework generalizes across dynamical regimes, enabling accurate voltage prediction, internal state estimation, and inference of governing parameters. Beyond batteries, BMINN exemplifies a broadly applicable strategy for learning missing physics in multiphase, non-equilibrium systems, offering a new pathway to uncover hidden thermodynamic functions across condensed matter and materials physics.

25 ENERGY STORAGE↗
DOE OSTI2025

Accelerating computational fluid dynamics simulation of post-combustion carbon capture modeling with MeshGraphNets

Packed columns are commonly used in post-combustion processes to capture CO 2 emissions by providing enhanced contact area between a CO 2 -laden gas and CO 2 -absorbing solvent. To study and optimize solvent-based post-combustion carbon capture systems (CCSs), computational fluid dynamics (CFD) can be used to model the liquid–gas countercurrent flow hydrodynamics in these columns and derive key determinants of CO 2 -capture efficiency. However, the large design space of these systems hinders the application of CFD for design optimization due to its high computational cost. In contrast, data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. We build our surrogates using MeshGraphNets (MGN), a graph neural network framework that efficiently learns and produces mesh-based simulations. We apply MGN to a random packed column modeled with over 160K graph nodes and a design space consisting of three key input parameters: solvent surface tension, inlet velocity, and contact angle. Our models can adapt to a wide range of these parameters and accurately predict the complex interactions within the system at rates over 1700 times faster than CFD, affirming its practicality in downstream design optimization tasks. This underscores the robustness and versatility of MGN in modeling complex fluid dynamics for large-scale CCS analyses.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dynamics of Glyceline and Interactions of Constituents: A Multitechnique NMR Study

In this work, the dynamics of the organic components of the deep eutectic solvent (DES) glyceline are analyzed using an array of complementary nuclear magnetic resonance (NMR) methods. Fast-Field Cycling 1 H relaxometry, Pulsed Field Gradient diffusion, Nuclear Overhauser Effect Spectroscopy (NOESY), 13 C NMR relaxation and pressure dependent NMR experiments are deployed to sample a range of frequencies and modes of motion of the glycerol and choline components of the DES. Generally, translational and rotational diffusion of glycerol are more rapid than those of choline while short range rotational motions observed from 13 C relaxation indicate slow local motion of glycerol at low choline chloride (ChCl) content. The rates of glycerol and choline local motions become more similar at higher ChCl. This result taken together with pressure dependent NMR studies show that the addition of ChCl makes it easier to disrupt glycerol packing. Finally, a relatively slow hydroxyl H-exchange process between glycerol and choline protons is deduced from the data. Consistent with this, NOESY results indicate relatively little direct H-bonding between glycerol and choline. These results suggest that the glycerol H-bonding network is disrupted as choline is added, but primarily in regions where there is intimate mixing of the two components. Thus, the local dynamics of most of the glycerol, resembles that of pure glycerol until substantial choline chloride is present.

13C NMR relaxation↗
DOE OSTI2026

Topology-Dependent Performance of Free-Space Photonic Quantum Networks Under Noise

Photonic quantum communication enables secure and high-fidelity information transfer beyond classical limits, with direct relevance to emerging quantum networks operating in free-space environments. While physical-layer models of depolarizing noise, Gamma–Gamma turbulence statistics, entanglement swapping, and decoy-state QKD security bounds are individually well established, prior work typically treats these components in isolation or under fixed network assumptions. In this work, we develop a unified topology-aware analytical framework that simultaneously integrates free-space optical link budgets, turbulence-induced visibility degradation, depolarizing qubit noise, multi-hop entanglement cascade dynamics, teleportation fidelity thresholds, CHSH nonlocality certification, and asymptotic decoy-state secret key rate bounds across star, mesh, and ring graph structures. Rather than introducing new physical channel models, we demonstrate that identical physical links exhibit fundamentally different end-to-end performance once embedded within different network topologies. Mesh architectures minimize visibility cascade through hop-count reduction but incur quadratic hardware scaling. Star topologies minimize link count but concentrate noise and synchronization overhead at the hub. Ring configurations offer linear hardware scaling with multiplicative fidelity degradation. The results establish topology as a first-order design parameter in near-term free-space quantum networks operating without full quantum repeater infrastructures. While motivated by distributed multi-agent architectures, the framework applies broadly to terrestrial, airborne, and satellite-assisted photonic quantum communication systems.

QKD↗
DOE OSTI2020

Joint Design of Multimodal Transit Networks and Shared Autonomous Mobility Fleets

Providing quality transit service to travelers in low-density areas, particularly travelers without personal vehicles, is a constant challenge for transit agencies. The advent of fully-autonomous vehicles (AVs) and their inclusion in mobility service fleets may allow transit agencies to offer better service and/or reduce their own capital and operational costs. This study focuses on the problem of allocating resources between transit patterns and operating (or subsidizing) shared-use AV mobility services (SAMSs) in a large metropolitan area. To address this question, a joint transit network redesign and SAMS fleet size determination problem (JTNR-SFSDP) is introduced, and a bi-level mathematical programming formulation and solution approach are presented. The upper-level problem modifies a transit network frequency setting problem (TNFSP) formulation via incorporating SAMS fleet size as a decision variable and allowing the removal of bus routes. The lower-level problem consists of a dynamic combined mode choice-traveler assignment problem (DCMC-TAP) formulation. The heuristic solution procedure involves solving the upper-level problem using a nonlinear programming solver and solving the lower-level problem using an iterative agent-based assignment-simulation approach. To illustrate the effectiveness of the modeling framework, this study uses traveler demand from Chicago along with the regions existing multimodal transit network. The computational results indicate significant traveler benefits, in terms of improved average traveler wait times, associated with optimizing the joint design of multimodal transit networks and SAMS fleets compared with the initial transit network design.

bi-level programming↗
DOE OSTI2021

Persistent, “Mysterious” Seismoacoustic Signals Reported in Oklahoma State during 2019

Here, we report on the source of seismoacoustic pulses that were observed across the state of Oklahoma (OK) during summer of 2019, and the subject of national media coverage and speculation. Seismic network data collected across four U.S. states and interviews with witnesses to the pulse’s effect on residential structures demonstrate that they were triggered by routine ammunition disposal operations conducted by McAlester Army Ammunition Plant (McAAP). During these operations, conventional explosives destroy obsolete munitions stored in pits through a controlled sequence of electronically timed shots that occur over tens of minutes. Despite noise-abatement efforts that reduce coupling of acoustic energy with air, some lower frequency, subaudible (infrasonic) sound radiates from these shots as discrete pulses. We use nine months of blast log documents, seismic network records, analyst picks, and physical modeling to demonstrate that seismic stations as far as 640 km from McAAP sample these pulses, which record seasonal patterns in stratospheric and tropospheric winds, as well as the dynamic formation of waveguides and shadow zones. Digital short-term average to long-term average detectors that we augment with dynamic thresholds and time-binning operations identify these pulses with a fair probability, when compared with visual observations. Our analyses thereby provide estimates of observation rates for both partial and full sequences of these pulses, as well as single shots. We suggest that disposal operations can exploit existing, composite seismic networks to predict where residents are likely to witness blasting. Crucially, our data also show that dense seismic networks can record multiscale atmospheric processes in the absence of infrasound arrays.

58 GEOSCIENCES↗
DOE OSTI2021

Using Neural Network Force Fields to Ascertain the Quality of Ab Initio Simulations of Liquid Water

Accurately simulating the properties of bulk water, despite the apparent simplicity of the molecule, is still a challenge. In order to fully understand and reproduce its complex phase diagram, it is necessary to perform simulations at the ab initio level, including quantum mechanical effects both for electrons and nuclei. This comes at a high computational cost, given that the structural and dynamical properties tend to require long timescales and large simulation cells. In this work, we evaluate the errors that density functional theory (DFT)-based simulations routinely incur into due time- and size-scale limitations. These errors are evaluated using neural-network-trained force fields that are accurate at the level of DFT methods. We compare different exchange and correlation potentials for properties of bulk water that require large timescales. Here we show that structural properties are less dependent on the system size and that dynamical properties such as the diffusion coefficient have a strong dependence on the simulation size and timescale. Our results facilitate comparisons of DFT-based simulation results with experiments and offer a path to discriminate between model and convergence errors in these simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Physics-informed machine learning modeling for predictive control using noisy data

Due to the occurrence of over-fitting at the learning phase, the modeling of chemical processes via artificial neural networks (ANN) by using corrupted data (i.e., noisy data) is an ongoing challenge. Therefore, this work investigates the effect of both Gaussian and non-Gaussian noise on the performance of process-structure based recurrent neural networks (RNN) models, which take the form of partially-connected RNN models in this work, that are used to approximate a class of multi-input-multi-outputs nonlinear systems. Furthermore, two different techniques, specifically Monte Carlo dropout and co-teaching, are utilized in the development of partially-connected RNN models. Here, these two techniques are employed to reduce the over-fitting in ANNs when noisy data is used in the training process and, hence, to improve the open-loop accuracy as well as the closed-loop performance under a Lyapunov-based model predictive controller (MPC). Aspen Plus Dynamics, a well-known high-fidelity process simulator, is used to simulate a large-scale chemical process application in order to demonstrate the anticipated improvements in both open-loop approximation and closed-loop controller performance in the presence of Gaussian and non-Gaussian noise in the data set using physics-informed RNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Lie-algebraic classical simulations for quantum computing

The classical simulation of quantum dynamics plays an important role in our understanding of quantum complexity and in the development of quantum technologies. Efficient techniques such as those based on the Gottesman-Knill theorem for Clifford circuits, tensor networks for low entanglement-generating circuits, or Wick's theorem for fermionic Gaussian states have become central tools in quantum computing. In this work, we contribute to this body of knowledge by presenting a framework for classical simulations, dubbed “𝔤-sim”, which is based on the underlying Lie algebraic structure of the dynamical process. When the dimension of the algebra grows at most polynomially in the system size, there exist observables for which the simulation is efficient. Indeed, we show that 𝔤-sim enables new regimes for classical simulations, is able to deal with certain forms of noise in the evolution, as well as can be used to tackle several paradigmatic variational and nonvariational quantum computing tasks. For the former, we perform Lie-algebraic simulations to train and optimize parametrized quantum circuits (thus effectively showing that some variational models can be dequantized), design enhanced parameter initialization strategies, solve tasks of quantum circuit synthesis, and train a quantum-phase classifier. For the latter, we report large-scale noiseless and noisy simulations on benchmark problems. By comparing the limitations of 𝔤-sim and certain Wick's theorem-based simulations, we find that the two methods become inefficient for different types of states or observables, hinting at the existence of distinct, nonequivalent resources for classical simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Ambient field seismology in critical zone hydrological sciences

Passive ambient noise monitoring is an emerging tool in environmental seismology, leveraging the ambient seismic field to assess temporal variations in shallow subsurface properties. This review focuses on the potential and challenges of using scattered coda waves from noise correlation functions to monitor critical zone dynamics. The sensitivity of seismic velocities to various environmental factors, including precipitation, snowmelt, atmospheric pressure, and groundwater fluctuations, underscores the method’s versatility. While coda waves excel in detecting subtle changes due to their scattered nature, ballistic waves provide higher spatial resolution, albeit with challenges in source stability. Advances in seismic sensing, including distributed acoustic sensing and low-cost geophone networks, have enabled high-resolution monitoring of hydrological processes, subsurface deformation, and seismic hazards. Integrating seismic data with hydrological models provides insights into water storage, pore pressure changes, and soil moisture dynamics. However, limitations in spatial resolution, calibration with ground truth data, and coupled effects between environmental factors remain key challenges. This review emphasizes the importance of interdisciplinary approaches in refining methodologies, enhancing sensor deployments, and addressing data gaps. Passive seismic monitoring offers opportunities to understand critical zone processes and their broader impacts on seismic hazards and environmental sustainability.

58 GEOSCIENCES↗
DOE OSTI2025

The value of integrating a geothermal district heating system into a microgrid

As electrical grids increasingly rely on variable renewable energy, maintaining reliability and cost efficiency becomes more complex. To address these challenges, this study analyzed the integration of geothermal district heating as a grid-responsive thermal resource within a microgrid in Tuttle, Oklahoma. Building energy modeling using EnergyPlus estimated annual district heating demand at 2.9 GWh, with a peak load of 2.8 MW th . Techno-economic analyses were conducted to meet the heating demand under three geothermal scenarios, varying by production depth, flow rate, and thermal output, each supplemented by natural gas peaking boilers. In parallel, equivalent electrical load profiles were developed using typical coefficients of performance (COPs) for air-source heat pumps and electric boilers to establish an electrified baseline scenario. A complete end-use electrical load profile was also developed for the microgrid using Cambium dataset. The modeling results demonstrated reliable and economic operation of the geothermal systems over 30 years, with COPs ranging from 2.6 to 8.9 and the lowest levelized heating cost at $\$$54.6/MWh. Geothermal integration reduced electricity consumption by up to 94.7 % compared to the non-geothermal base case, yielding annual energy savings of up to $\$$803 k. Avoided grid costs ranged from $\$$65 k–$\$$147 k per year, with individual events avoiding up to $\$$4,863 per hour. Grid-responsive operation further reduced wholesale energy costs by 53–56 %. These findings demonstrate geothermal heating, traditionally treated as a non-grid-responsive thermal resource, can be reconfigured to support dynamic grid services, offering a scalable pathway to enhance reliability and reduce costs in renewable-rich microgrids and district heating networks.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

DeepONet-grid-UQ: A trustworthy deep operator framework for predicting the power grid’s post-fault trajectories

This paper proposes a novel data-driven method for the reliable prediction of the power grid’s post-fault trajectories, i.e., the power grid’s dynamic response after a disturbance or fault. Here, the proposed method is based on the recently proposed concept of Deep Operator Networks (DeepONets). Unlike traditional neural networks that learn to approximate functions, DeepONets are designed to approximate nonlinear operators, i.e., mappings between infinite-dimensional spaces. Under this operator framework, we design a novel and efficient DeepONet that (i) takes as inputs the trajectories collected before and during the fault and (ii) outputs the predicted post-fault trajectories. In addition, we endow our method with the much-needed ability to balance efficiency with reliable/trustworthy predictions via uncertainty quantification. To this end, we propose and compare two novel methods that enable quantifying the predictive uncertainty. First, we propose a Bayesian DeepONet (B-DeepONet) that uses stochastic gradient Hamiltonian Monte-Carlo to sample from the posterior distribution of the DeepONet trainable parameters. Then, we design a Probabilistic DeepONet (Prob-DeepONet) that uses a probabilistic training strategy to enable quantifying uncertainty at virtually no extra computational cost. Finally, we validate the proposed methods’ predictive power and uncertainty quantification capability using the New York-New England power grid model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Multitask Machine Learning of Collective Variables for Enhanced Sampling of Rare Events

Computing accurate reaction rates is a central challenge in computational chemistry and biology because of the high cost of free energy estimation with unbiased molecular dynamics. In this work, a data-driven machine learning algorithm is devised to learn collective variables with a multitask neural network, where a common upstream part reduces the high dimensionality of atomic configurations to a low dimensional latent space and separate downstream parts map the latent space to predictions of basin class labels and potential energies. Here, the resulting latent space is shown to be an effective low-dimensional representation, capturing the reaction progress and guiding effective umbrella sampling to obtain accurate free energy landscapes. This approach is successfully applied to model systems including a 5D Müller Brown model, a 5D three-well model, the alanine dipeptide in vacuum, and an Au(110) surface reconstruction unit reaction. It enables automated dimensionality reduction for energy controlled reactions in complex systems, offers a unified and data-efficient framework that can be trained with limited data, and outperforms single-task learning approaches, including autoencoders.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Three Decades of Wetland Methane Surface Flux Modeling by Earth System Models–Advances, Applications, and Challenges

Earth System Models (ESMs) simulate the exchange of mass and energy between the land surface and the atmosphere, with a key focus on modeling natural greenhouse gas feedbacks. Methane is the second most important greenhouse gas after carbon dioxide. There are growing concerns over the rapidly increasing methane concentration in the atmosphere, underscoring the need for accurate global modeling of its emissions using ESMs. Of the multitude of sources of methane globally, wetlands are the largest natural emitters for methane, leading to significant efforts targeting their representation in ESMs with a special focus on their methane emissions. In this review, we first provide a historical overview of including wetland–methane components in ESMs and how methane modeling approaches have evolved over time. Second, we discuss recent modeling advancements that show promise for improvements in methane emissions predictions, namely the coupling of surface and atmospheric modules of ESMs, the representation of microtopography and transport mechanisms, the resolution of microbial processes at different spatial–temporal scales, and the improved mapping of wetland area extent across the different wetland types. Third, we shed light on the different challenges hindering accurate estimations of wetland–methane emissions, as shown by the consistent discrepancy between bottom–up and top–down models' predictions. Finally, we emphasize that more detailed representation of biogeochemistry and dynamic hydrology while resolving the within–wetland vegetation heterogeneity should improve model predictions, especially when coupled with expanding ground–based measurement networks and high–resolution remote sensing mapping of methane–relevant variables, such as water elevation, water table depth, and methane concentration.

54 ENVIRONMENTAL SCIENCES↗