Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Value Gradient Learning Approach in Power and Frequency Regulation of Grid-Connected Synchronverters

In this paper, a neural network adaptive critic design (ACD) method based on value gradient learning (VGL) is used to optimally control a grid-connected synchronverter. The main drawback of the traditional synchronverters is their infeasibility to face non-inductive grids. To be able to implement a synchronverter technique in any impedance angle, a neural network-based adaptive controller is used. The advantage of adaptive dynamic programing is its ability to adjust itself when it faces changes and uncertainties in the power system. The proposed VGL consists of two subnetworks: the critic network and the action network. The action network is trained during the operation, and the critic network can be pretrained offline or can be simultaneously trained with the action network. To compare the effectiveness of the traditional synchronverter to the VGL-based synchronverter, the simulation results are provided.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference

In this work, we present two neural network approaches that approximate the solutions of static and dynamic conditional optimal transport (COT) problems. Both approaches enable conditional sampling and conditional density estimation, which are core tasks in Bayesian inference—particularly in the simulation-based (“likelihood-free”) setting. Our methods represent the target conditional distribution as a transformation of a tractable reference distribution. Obtaining such a transformation, chosen here to be an approximation of the COT map, is computationally challenging even in moderate dimensions. To improve scalability, our numerical algorithms use neural networks to parameterize candidate maps and further exploit the structure of the COT problem. Our static approach approximates the map as the gradient of a partially input convex neural network. It uses a novel numerical implementation to increase computational efficiency compared to state-of-the-art alternatives. Our dynamic approach approximates the conditional optimal transport via the flow map of a regularized neural ODE; compared to the static approach, it is slower to train but offers more modeling choices and can lead to faster sampling. We demonstrate both algorithms numerically, comparing them with competing state-of-the-art approaches, using benchmark datasets and simulation-based Bayesian inverse problems.

97 MATHEMATICS AND COMPUTING↗

Dynamic Validation of CNN-Based Surrogate Models for Inverter-Based Resources in Open-Source Solvers

Traditionally, distribution system planning has focused on steady-state analyses, with limited consideration of dynamic behavior. However, as large or medium-scale inverter-based resources (IBRs), particularly grid-following (GFL) inverters in commercial or industry buildings, become more prevalent, understanding their dynamic impact is essential for grid planning and operation. This article presents an innovative deep-learning (DL)-approach using convolutional neural networks technique to model the GFL inverters. Developed from real grid-tied commercial IBR transient data, these dynamic DL models overcome proprietary constraints by requiring minimal knowledge of internal converter physics while maintaining high accuracy and flexibility. To demonstrate their applicability, the models were incorporated into GridLAB-D, an open-source, three-phase distribution analysis tool. This integration enables dynamic simulations of large-scale distribution networks with high IBR penetration stability analysis. Rigorous testing and validation, aligned with industry standards, confirmed the reliability and efficiency of this approach, paving the way for enhanced planning and operational assessments of modern power systems.

Deep-learning↗

Exploring Li-Ion Transport Properties of Li 3 TiCl 6 : A Machine Learning Molecular Dynamics Study

We performed large-scale molecular dynamics simulations based on a machine-learning force field (MLFF) to investigate the Li-ion transport mechanism in cation-disordered Li 3 TiCl 6 cathode at six different temperatures, ranging from 25°C to 100°C. In this work, deep neural network method and data generated by ab − initio molecular dynamics (AIMD) simulations were deployed to build a high-fidelity MLFF. Radial distribution functions, Li-ion mean square displacements (MSD), diffusion coefficients, ionic conductivity, activation energy, and crystallographic direction-dependent migration barriers were calculated and compared with corresponding AIMD and experimental data to benchmark the accuracy of the MLFF. From MSD analysis, we captured both the self and distinct parts of Li-ion dynamics. The latter reveals that the Li-ions are involved in anti-correlation motion that was rarely reported for solid-state materials. Similarly, the self and distinct parts of Li-ion dynamics were used to determine Haven’s ratio to describe the Li-ion transport mechanism in Li 3 TiCl 6 . Obtained trajectory from molecular dynamics infers that the Li-ion transportation is mainly through interstitial hopping which was confirmed by intra- and inter-layer Li-ion displacement with respect to simulation time. Ionic conductivity (1.06 mS/cm) and activation energy (0.29eV) calculated by our simulation are highly comparable with that of experimental values. Overall, the combination of machine-learning methods and AIMD simulations explains the intricate electrochemical properties of the Li 3 TiCl 6 cathode with remarkably reduced computational time. Thus, our work strongly suggests that the deep neural network-based MLFF could be a promising method for large-scale complex materials.

Selvaraj, Selva Chandrasekaran (ORCID:000000029023↗

A physics-constrained neural network for multiphase flows

The present study develops a physics-constrained neural network (PCNN) to predict sequential patterns and motions of multiphase flows (MPFs), which includes strong interactions among various fluid phases. To predict the order parameters, which locate individual phases in the future time, a neural network (NN) is applied to quickly infer the dynamics of the phases by encoding observations. The multiphase consistent and conservative boundedness mapping algorithm (MCBOM) is next implemented to correct the predicted order parameters. This enforces the predicted order parameters to strictly satisfy the mass conservation, the summation of the volume fractions of the phases to be unity, the consistency of reduction, and the boundedness of the order parameters. Then, the density of the fluid mixture is updated from the corrected order parameters. Finally, the velocity in the future time is predicted by another NN with the same network structure, but the conservation of momentum is included in the loss function to shrink the parameter space. The proposed PCNN for MPFs sequentially performs (NN)-(MCBOM)-(NN), which avoids nonphysical behaviors of the order parameters, accelerates the convergence, and requires fewer data to make predictions. Numerical experiments demonstrate that the proposed PCNN is capable of predicting MPFs effectively.

Mechanics↗

Performance and usability enhancements for continuous subgraph matching queries on graph-structured data

A query graph, which includes vertices and edges, represents a query on graph-structured data. The query graph is decomposed into query subgraphs. A network analysis tool performs continuous subgraph matching queries to facilitate analysis of computer network traffic, social media events, or other streams of data represented as a dynamic data graph (graph-structured data). This can help identify emerging trends in the data. Some features of the network analysis tool enhance performance by effectively utilizing distributed computing resources (including processing cores and memory at different nodes of a cluster) to speed up the process of updating the dynamic data graph and detecting matches of query subgraphs. Features of a query graph building tool enhance usability by providing intuitive ways to specify query graphs and their subgraphs. Features of a results visualization tool enhance usability by providing an intuitive way to present the results of continuous subgraph matching queries.

Choudhury, Sutanay↗

Inference of neutrino flavor evolution through data assimilation and neural differential equations

The evolution of neutrino flavor in dense environments such as core-collapse supernovae and binary compact object mergers constitutes an important and unsolved problem. Its solution has potential implications for the dynamics and heavy-element nucleosynthesis in these environments. In this paper, we build upon recent work to explore inference-based techniques for the estimation of model parameters and neutrino flavor evolution histories. Here, we combine data assimilation, ordinary differential equation solvers, and neural networks to craft an inference approach tailored for nonlinear dynamical systems. Using this architecture, and a simple two-neutrino-beam, two-flavor model, we compare the performances of nine different optimization algorithms and expand upon previous assessments of the efficacy of inference for tackling problems in flavor evolution. We find that employing this new architecture, together with evolutionary optimization algorithms, accurately captures flavor histories in the small-scale model and allows us to quickly explore both model parameters and initial flavor content. In future work we plan to extend these inference techniques to large numbers of neutrinos.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Operator learning for predicting multiscale bubble growth dynamics

We report simulating and predicting multiscale problems that couple multiple physics and dynamics across many orders of spatiotemporal scales is a great challenge that has not been investigated systematically by deep neural networks (DNNs). Herein, we develop a framework based on operator regression, the so-called deep operator network (DeepONet), with the long-term objective to simplify multiscale modeling by avoiding the fragile and time-consuming “hand-shaking” interface algorithms for stitching together heterogeneous descriptions of multiscale phenomena. To this end, as a first step, we investigate if a DeepONet can learn the dynamics of different scale regimes, one at the deterministic macroscale and the other at the stochastic microscale regime with inherent thermal fluctuations. Specifically, we test the effectiveness and accuracy of the DeepONet in predicting multirate bubble growth dynamics, which is described by a Rayleigh–Plesset (R–P) equation at the macroscale and modeled as a stochastic nucleation and cavitation process at the microscale by dissipative particle dynamics (DPD). First, we generate data using the R–P equation for multirate bubble growth dynamics caused by randomly time-varying liquid pressures drawn from Gaussian random fields (GRFs). Our results show that properly trained DeepONets can accurately predict the macroscale bubble growth dynamics and can outperform long short-term memory networks. We also demonstrate that the DeepONet can extrapolate accurately outside the input distribution using only very few new measurements. Subsequently, we train the DeepONet with DPD data corresponding to stochastic bubble growth dynamics. Although the DPD data are noisy and we only collect sparse data points on the trajectories, the trained DeepONet model is able to predict accurately the mean bubble dynamics for time-varying GRF pressures. Taken together, our findings demonstrate that DeepONets can be employed to unify the macroscale and microscale models of the multirate bubble growth problem, hence providing new insight into the role of operator regression via DNNs in tackling realistic multiscale problems and in simplifying modeling with heterogeneous descriptions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Three-step colloidal gelation revealed by time-resolved x-ray photon correlation spectroscopy

The gelation of PEGylated gold nanoparticles dispersed in a glycerol–water mixture is probed in situ by x-ray photon correlation spectroscopy. Following the evolution of structure and dynamics over 10 4 s, a three-step gelation process is found. First, a simultaneous increase of the Ornstein–Zernike length ξ and slowdown of dynamics is characterized by an anomalous q-dependence of the relaxation times of τ ∝q -6 and strongly stretched intermediate scattering functions. After the structure of the gel network has been established, evidenced by a constant ξ, the dynamics show aging during the second gelation step accompanied by a change toward ballistic dynamics with τ ∝ q -1 and compressed correlation functions. In the third step, aging continues after the arrest of particle motion. Our observations further suggest that gelation is characterized by stress release as evidenced by anisotropic dynamics once gelation sets in.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Real-Time Neuromorphic Processing of Spatiotemporal Data for Scientific Discovery

Spiking Neural Networks (SNNs) are brain-inspired computing models incorporating unique temporal dynamics and event-driven processing. Rich dynamics in both space and time offer great challenges and opportunities for efficient processing of sparse spatiotemporal data compared with conventional artificial neural networks (ANNs). Under this context, the goal of this project is to develop spiking neural network based neuromorphic computing to enable energy-efficient real-time learning and processing of spatiotemporal data. This report summarizes the key results on network architecture design, training methods, and SNN hardware acceleration achieved under this project, demonstrating the promise of spiking neural networks.

97 MATHEMATICS AND COMPUTING↗

Elastomeric vitrimers from designer polyhydroxyalkanoates with recyclability and biodegradability

Cross-linked elastomers are stretchable materials that typically are not recyclable or biodegradable. Medium-chain-length polyhydroxyalkanoates (mcl-PHAs) are soft and ductile, making these bio-based polymers good candidates for biodegradable elastomers. Elasticity is commonly imparted by a cross-linked network structure, and covalent adaptable networks have emerged as a solution to prepare recyclable thermosets via triggered rearrangement of dynamic covalent bonds. Here, we develop biodegradable and recyclable elastomers by chemically installing the covalent adaptable network within biologically produced mcl-PHAs. Specifically, an engineered strain of Pseudomonas putida was used to produce mcl-PHAs containing pendent terminal alkenes as chemical handles for postfunctionalization. Thiol-ene chemistry was used to incorporate boronic ester (BE) cross-links, resulting in PHA-based vitrimers. mcl-PHAs cross-linked with BE at low density (<6 mole %) affords a soft, elastomeric material that demonstrates thermal reprocessability, biodegradability, and denetworking at end of life. The mechanical properties show potential for applications including adhesives and soft, biodegradable robotics and electronics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

IRIS-GNN: Leveraging Graph Neural Networks for Scheduling on Truly Heterogeneous Runtime Systems

The diversity of accelerators in computer systems poses significant challenges for software developers, such as managing vendor-specific compiler toolchains, code fragmentation requiring different kernel implementations, and performance portability issues. To address these, the Intelligent Runtime System (IRIS) was developed. IRIS works across various systems, from smartphones to supercomputers, enabling automatic performance scaling based on available accelerators. It introduces abstract tasks for seamless execution transitions between accelerators while ensuring memory consistency and task dependencies. Although IRIS simplifies system details, optimal dynamic scheduling still requires user input to understand workload structures. To address this, we introduce a new scheduling policy for IRIS, termed IRIS-GNN, which is the first IRIS hybrid policy that operates in conjunction with the dynamic policies. This policy employs a Graph-Neural Network (GNN) to conduct Graph Classification of any task graphs submitted to IRIS. This GNN analyzes the structure and attributes of the task graph, categorizing it as either locality, concurrency, or mixed. This classification subsequently guides the selection of the dynamic policy used by IRIS. We provide a comparison of the performance of IRIS-GNN against the complete spectrum of IRIS’s dynamic policies, assess the overhead introduced by the GNN within this scheduling framework, and ultimately explore its practical application in real-world scenarios.

Johnston, Beau↗

Direct observation of 3D atomic packing in monatomic amorphous materials

Liquids and solids are two fundamental states of matter. Although the structure of crystalline solids has long been solved by crystallography, our understanding of the 3D atomic structure of liquids and amorphous materials remained speculative. In 1952, Frank hypothesized that icosahedral order is the prevalent atomic motif in monatomic liquids. Over the past six decades, there have been a great deal of experimental, computational and theoretical studies to understand the structure of liquids and amorphous materials. A polytetrahedral packing model was proposed to explain the 3D atomic structure of monatomic liquids and amorphous materials, in which icosahedral order is a key feature. The icosahedral order has also been found to play an important role in the structure of metallic glasses and quasicrystals. Here we advance atomic electron tomography to determine for the first time the 3D atomic positions in monatomic amorphous materials, including a Ta thin film and two Pd nanoparticles. Despite the different chemical composition and synthesis methods, we observe that pentagonal bipyramids are the most abundant atomic motifs in these amorphous materials. Contrary to the traditional understanding, the pentagonal bipyramids do not assemble full icosahedra, but are closely connected with each other to form networks that extend to medium-range scale. Our molecular dynamic simulations, coupled with experimental results, further reveal that the 3D atomic structure of monatomic liquids is similar to the experimental amorphous material. Moreover, we find that the pentagonal bipyramid networks, prevalent in monatomic liquids, rapidly grow in size and form a fraction of full icosahedra during the quench from a liquid to a metallic glass state, providing a possible new picture of structural evolution through the glass transition.

Yuan, Yakun↗

Anticipating Technical Expertise and Capability Evolution in Research Communities Using Dynamic Graph Transformers

The ability to anticipate global technical expertise and capability evolution trends is essential for national and global security, especially in safety-critical domains such as nuclear nonproliferation (NN) and rapidly emerging fields like artificial intelligence (AI). Here, in this work, we extend traditional statistical relational learning approaches (e.g., link prediction in collaboration networks) and formulate a problem of anticipating technical expertise and capability evolution using dynamic heterogeneous graph representations. We develop novel capabilities to forecast collaboration patterns, authorship behavior, and technical capability evolution at different granularities (e.g., scientist and institution levels) in two distinct research fields. We implement a dynamic graph transformer (DGT) neural architecture, which pushes the state-of-the-art graph neural network models by: 1) forecasting heterogeneous (rather than homogeneous) nodes and edges; and 2) relying on both discrete- and continuous-time inputs. We demonstrate that our DGT models predict collaboration, partnership, and expertise patterns with 0.26, 0.73, and 0.53 mean reciprocal rank values for AI and 0.48, 0.93, and 0.22 for NN domains. DGT model performance exceeds the best-performing static graph baseline models by 30%–80% across AI and NN domains. Our findings demonstrate that DGT models boost inductive task performance when previously unseen nodes appear in the test data for the domains with emerging collaboration patterns (e.g., AI). Specifically, models accurately predict which established scientists will collaborate with early career scientists and vice versa in the AI domain.

97 MATHEMATICS AND COMPUTING↗

Entanglement and many-body effects in collective neutrino oscillations

Collective neutrino oscillations play a crucial role in transporting lepton flavor in astrophysical settings, such as supernovae, where the neutrino density is large. In this regime, neutrino-neutrino interactions are important and simulations in the mean-field approximation show evidence for collective oscillations occurring at timescales much shorter than those associated with vacuum oscillations. In this work, we study the out-of-equilibrium dynamics of a corresponding spin model using matrix product states and show how collective bipolar oscillations can be triggered by many-body correlations if appropriate initial conditions are present. We find entanglement entropies scaling at most logarithmically in the system size suggesting that classical tensor network methods could be efficient in describing collective neutrino dynamics more generally. These observation provide a clear path forward, not only to increase the accuracy of current simulations, but also to elucidate the mechanism behind collective flavor oscillations without resorting to the mean-field approximation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Investigation into the Performance Benefits of Exposing Network Backpressure in UPC++ and GASNet-EX

This document is a brief summary of the research, and supporting development efforts, conducted by the project "Investigation into Improving Dynamic Adaptivity to System-Level Asynchrony in UPC++". We tested the hypothesis "The UPC++ and GASNet-EX runtimes can expose information from the network stack that enables applications to dynamically adapt to congestion, improving total throughput". We present experimental results from both a microbenchmark and an application benchmark that support this hypothesis.

97 MATHEMATICS AND COMPUTING↗

How Does the Rate of Chain Exchange Relate to Stress Relaxation in Triblock Copolymer Networks?

The relationship between macroscopic stress relaxation and molecular-level chain exchange in triblock copolymer micelles has been explored using rheology and time-resolved small-angle neutron scattering (TR-SANS), marking the first measurements of chain exchange in concentrated triblock networks. It has long been assumed in models of transient or thermoreversible networks that the time scales for these two processes are equal. Experimentally, we find that stress relaxation occurs many orders-of-magnitude faster than chain exchange. This difference is quantitatively explained by modest dispersity in the core block that results in a slight asymmetry within any given nominally symmetric triblock. For stress relaxation to occur, only the shorter chain must pull out, while chain exchange is slowed due to the requirement of the eventual pullout of the longer block. The pullout time is extremely sensitive to the length of the core block. This mechanism is supported by measurements with an intentionally asymmetric triblock copolymer, which displays an even larger difference between the stress relaxation and chain exchange rates. These results establish a quantitative molecular-level picture of the chain dynamics associated with stress relaxation in triblock copolymer networks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantifying T Cell Cross-Reactivity: Influenza and Coronaviruses

If viral strains are sufficiently similar in their immunodominant epitopes, then populations of cross-reactive T cells may be boosted by exposure to one strain and provide protection against infection by another at a later date. This type of pre-existing immunity may be important in the adaptive immune response to influenza and to coronaviruses. Patterns of recognition of epitopes by T cell clonotypes (a set of cells sharing the same T cell receptor) are represented as edges on a bipartite network. We describe different methods of constructing bipartite networks that exhibit cross-reactivity, and the dynamics of the T cell repertoire in conditions of homeostasis, infection and re-infection. Cross-reactivity may arise simply by chance, or because immunodominant epitopes of different strains are structurally similar. We introduce a circular space of epitopes, so that T cell cross-reactivity is a quantitative measure of the overlap between clonotypes that recognize similar (that is, close in epitope space) epitopes.

59 BASIC BIOLOGICAL SCIENCES↗