SEARCH · Engineering Papers

Results for “network analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection

Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets-UNSW-NBIS for general network traffic and ROAD for automotive networks-our framework reduces communication overhead by 97.6%; (from 700.0s to 16.8s) compared to synchronous baseline approaches while maintaining comparable detection accuracy (95.10%; vs. 95.12%;). Statistical validation using Mann-Whitney U test confirms significant improvements (p < 0.05) over existing FL approaches across both datasets, demonstrating the framework's adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions.

Marfo, William [University of Texas at El Paso]↗

DOE OSTI2022

Unraveling the effects of management and climate on carbon fluxes of U.S. croplands using the USDA Long-Term Agroecosystem (LTAR) network

Understanding the carbon fluxes and dynamics from a broad range of agricultural systems has the potential to improve our ability to increase carbon sequestration while maintaining crop yields. Short-term, single-location studies have limited applicability, but long-term data from a network of many locations can provide a broader understanding across gradients of climate and management choices. Here we examine eddy covariance measured carbon dioxide (CO 2 ) fluxes from cropland sites across the United States Department of Agriculture's Long-Term Agroecosystem Research (LTAR) network. The dataset was collected between 2001 and 2020, spanning 13 sites for a total of 182 site-years. Average seasonal patterns of net ecosystem CO 2 exchange (NEE), gross primary productivity (GPP), and ecosystem respiration (R eco ) were determined, and subsequent regression analysis on these “flux climatologies” was used to identify relationships to mean annual temperature (MAT), mean annual precipitation (MAP), cropping systems, and management practices. At rainfed sites, carbon fluxes were better correlated with MAP (r2 ≤ 0.5) than MAT (r2 ≤ 0.22). Net carbon balance was different among cropping systems (p < 0.001), with the greatest net carbon uptake occurring in sugarcane (Saccharum spp. hybrids) and the least in soybean (Glycine max) fields. Crop type had a greater effect on carbon balance than irrigation management at a Nebraska site. Across cropping systems, grain crops often had higher GPP and were more likely to have net uptake when compared to legume crops. This multi-site analysis highlights the potential of the LTAR network to further carbon flux research using eddy covariance measurements.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Effects of raster terrain representation on GIS shortest path analysis

Spatial analysis extracts meaning and insights from spatially referenced data, where the results are highly dependent on the quality of the data used and the manipulations on the data when preparing it for analysis. Users should understand the impacts that data representations may have on their results in order to prevent distortions in their outcomes. We study the consequences of two common data preparations when locating a linear feature performing shortest path analysis on raster terrain data: 1) the connectivity of the network generated by connecting raster cells to their neighbors, and 2) the range of the attribute scale for assigning costs. Such analysis is commonly used to locate transmission lines, where the results could have major implications on project cost and its environmental impact. Experiments in solving biobjective shortest paths show that results are highly dependent on the parameters of the data representations, with exceedingly variable results based on the choices made in reclassifying attributes and generating networks from the raster. Based on these outcomes, we outline recommendations for ensuring geographic information system (GIS) data representations maintain analysis results that are accurate and unbiased.

Medrano, F. Antonio (ORCID:000000025913632X)↗

DOE OSTI2020

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Training toward significance with the decorrelated event classifier transformer neural network

Experimental particle physics uses machine learning for many tasks, where one application is to classify signal and background events. This classification can be used to bin an analysis region to enhance the expected significance for a mass resonance search. In natural language processing, one of the leading neural network architectures is the transformer. In this work, an event classifier transformer is proposed to bin an analysis region, in which the network is trained with special techniques. The techniques developed here can enhance the significance and reduce the correlation between the network’s output and the reconstructed mass. It is found that this trained network can perform better than boosted decision trees and feed-forward networks. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

DOE OSTI2021

De novo transcriptome in roots of switchgrass ( Panicum virgatum L. ) reveals gene expression dynamic and act network under alkaline salt stress

Background: Soil salinization is a major limiting factor for crop cultivation. Switchgrass is a perennial rhizomatous bunchgrass that is considered an ideal plant for marginal lands, including sites with saline soil. Here we investigated the physiological responses and transcriptome changes in the roots of Alamo (alkaline-tolerant genotype) and AM314/MS-155 (alkaline-sensitive genotype) under alkaline salt stress. Results: Alkaline salt stress significantly affected the membrane, osmotic adjustment and antioxidant systems in switchgrass roots, and the ASTTI values between Alamo and AM-314/MS-155 were divergent at different time points. A total of 108,319 unigenes were obtained after reassembly, including 73,636 unigenes in AM-314/MS-155 and 65,492 unigenes in Alamo. A total of 10,219 DEGs were identified, and the number of upregulated genes in Alamo was much greater than that in AM-314/MS-155 in both the early and late stages of alkaline salt stress. The DEGs in AM-314/MS-155 were mainly concentrated in the early stage, while Alamo showed greater advantages in the late stage. These DEGs were mainly enriched in plant-pathogen interactions, ubiquitin-mediated proteolysis and glycolysis/gluconeogenesis pathways. We characterized 1480 TF genes into 64 TF families, and the most abundant TF family was the C2H2 family, followed by the bZIP and bHLH families. A total of 1718 PKs were predicted, including CaMK, CDPK, MAPK and RLK. WGCNA revealed that the DEGs in the blue, brown, dark magenta and light steel blue 1 modules were associated with the physiological changes in roots of switchgrass under alkaline salt stress. The consistency between the qRT-PCR and RNA-Seq results confirmed the reliability of the RNA-seq sequencing data. A molecular regulatory network of the switchgrass response to alkaline salt stress was preliminarily constructed on the basis of transcriptional regulation and functional genes. Conclusions: Alkaline salt tolerance of switchgrass may be achieved by the regulation of ion homeostasis, transport proteins, detoxification, heat shock proteins, dehydration and sugar metabolism. These findings provide a comprehensive analysis of gene expression dynamic and act network induced by alkaline salt stress in two switchgrass genotypes and contribute to the understanding of the alkaline salt tolerance mechanism of switchgrass and the improvement of switchgrass germplasm.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

A Comparison between Invariant and Equivariant Classical and Quantum Graph Neural Networks

Machine learning algorithms are heavily relied on to understand the vast amounts of data from high-energy particle collisions at the CERN Large Hadron Collider (LHC). The data from such collision events can naturally be represented with graph structures. Therefore, deep geometric methods, such as graph neural networks (GNNs), have been leveraged for various data analysis tasks in high-energy physics. One typical task is jet tagging, where jets are viewed as point clouds with distinct features and edge connections between their constituent particles. The increasing size and complexity of the LHC particle datasets, as well as the computational models used for their analysis, have greatly motivated the development of alternative fast and efficient computational paradigms such as quantum computation. In addition, to enhance the validity and robustness of deep networks, we can leverage the fundamental symmetries present in the data through the use of invariant inputs and equivariant layers. In this paper, we provide a fair and comprehensive comparison of classical graph neural networks (GNNs) and equivariant graph neural networks (EGNNs) and their quantum counterparts: quantum graph neural networks (QGNNs) and equivariant quantum graph neural networks (EQGNN). The four architectures were benchmarked on a binary classification task to classify the parton-level particle initiating the jet. Based on their area under the curve (AUC) scores, the quantum networks were found to outperform the classical networks. However, seeing the computational advantage of quantum networks in practice may have to wait for the further development of quantum technology and its associated application programming interfaces (APIs).

Forestano, Roy T. (ORCID:0000000203552076)↗

DOE OSTI2020

Cybersecurity of Networked Microgrids: Challenges Potential Solutions and Future Directions

Networked microgrids are clusters of geographically-close, islanded microgrids that can function as a single, aggregate island. This flexibility enables customer-level resilience and reliability improvements during extreme event outages and also reduces utility costs during normal grid operations. To achieve this cohesive operation, microgrid controllers and external connections (including advanced communication protocols, protocol translators, and/or internet connection) are needed. However, these advancements also increase the vulnerability landscape of networked microgrids, and significant consequences could arise during networked operation, increasing cascading impact. To address these issues, this report seeks to understand the unique components, functions, and communications within networked microgrids and what cybersecurity solutions can be implemented and what solutions need to be developed. A literature review of microgrid cybersecurity research is provided and a gap analysis of what is additionally needed for securing networked microgrids is performed. Relevant cyber hygiene and best practices to implement are provided, as well as ideas on how cybersecurity can be integrated into networked microgrid design. Lastly, future directions of networked microgrid cybersecurity R&D are provided to inform next steps.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Nanostructuring and Underscreening of Bisalt Electrolytes with Dual-Anion Effects: Insights from Small-Angle Scattering Prepeak Analysis

Using small-angle neutron scattering, we studied the nanostructure of a prototypical D(H)-bonded network electrolyte, alkaline sodium aluminate bisalt, at concentrations up to solute volume fraction of ~0.5. Analysis of the structure factor prepeak at 0.1 < Q < 1.0 Å-1 showed that its evolution is associated with nanoscopic species distribution in water-anion network., with differences in characteristic distance d between OD- and Al(OD)4- anions related to their distinct sizes and interactions. When the solute volume fraction approached 0.5, a common/maximum value of ~4.5 Å was found for the correlation length ? that characterizes the electrostatic force in concentrated electrolyte solution before precipitation occurred. This implies that the solutions’ morphology and behavior at high concentrations may be governed by geometric factors, rather than the chemistry of the specific anion. Furthermore, the scaling of ? with concentration yielded an exponent of 1.25(1), suggesting that ? is limited to a few Å. By combining the current observations of structural heterogeneity at the nanoscale, with dynamic heterogeneity at the microscopic scale from our previous quasi-elastic neutron scattering study, we have established a structural origin of local “caging” and restricted structural relaxation processes. These local solvent-solute interactions not only control dynamics heterogeneity in concentrated electrolytes but also are responsible for crystallization processes in industrial setting, such as aluminum production and radioactive waste treatment.

Wang, Hsiu-Wen↗

DOE OSTI2022

Enhanced analysis of experimental x-ray spectra through deep learning

X-ray spectroscopic data from high-energy-density laser-produced plasmas has long required thorough, time-consuming analysis to extract meaningful source conditions. There are often confounding factors due to rapidly evolving states and finite spatial gradients (e.g., the existence of multi-temperature, multi-density, multi-ionization states, etc.) that make spectral measurements and analysis difficult. Here, in this paper, we demonstrate how deep learning can be applied to enhance x-ray spectral data analysis in both speed and intricacy. Neural networks (NNs) are trained on ensemble atomic physics simulations so that they can subsequently construct a model capable of extracting plasma parameters directly from experimental spectra. Through deep learning, the models can extract temperature distributions as opposed to single or dual temperature/density fits from standard trial-and-error atomic modeling at a significantly reduced computational cost compared to traditional trial-and-error methods. These NNs are envisioned to be deployed with high repetition rate x-ray spectrometers in order to provide detailed real-time analysis of experimental spectra.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Carbon Capture, Transport, And Storage (CTS) Cost Modeling Of The Onshore Gulf Coast

The onshore Gulf of Mexico region presents significant opportunities for CO2 capture, transport, and storage due to its numerous CO2 sources, such as power plants, refineries, and its substantial CO2 storage potential. However, operators face critical decisions in designing an efficient and cost-effective CO2 pipeline network. This study examines the economic implications of two primary strategies: constructing a trunkline with excess initial capacity versus developing dedicated pipelines incrementally as new CO2 sources come online. Building a trunkline first offers the advantage of future-proofing the network, allowing for the accommodation of increased CO2 volumes from various sources over time. However, this approach incurs higher upfront costs and risks underutilizing the transport capacity in the initial stages, potentially resulting in economic inefficiencies. Conversely, constructing dedicated pipelines for each new CO2 source as it becomes operational may avoid the initial overcapacity issue but fails to capitalize on the economies of scale. This could lead to higher overall costs due to the duplication of infrastructure and increased complexity in network management. This research employs a comprehensive cost-benefit analysis, integrating factors such as capital expenditure, operational costs, projected CO2 volumes, and potential economies of scale. Through this analysis, we aim to provide operators with insights into the most economically viable strategy for CO2 pipeline network design in the region. The findings underscore the importance of strategic planning and highlight the trade-offs between immediate capacity utilization and long-term cost savings, ultimately guiding stakeholders towards informed decision-making in the development of CO2 transport infrastructure. Presented at the 41st USAEE/IAEE North American Conference, 3-6 November 2024, Baton Rouge, LA, United States.

Shih, Chung Yan↗

DOE OSTI2023

Disturbance Propagation Stability in Droop-Controlled Microgrids

The disturbance response of the angle dynamics for a droop-controlled islanded microgrid is characterized. Specifically, a notion of propagation stability is defined, which is concerned with spatial attenuation vs amplification of input- output responses in the network in a H8 or H2 sense. Criteria for propagation stability are developed, phrased in terms of the microgrid’s inverter control parameters. The input frequency range over which the network is susceptible to amplification is also characterized, in the case that the criteria are not met. Based on the formal analysis, a the design of resilient controls that trade off coherence and disturbance propagation goals is briefly conceptualized. Finally, the propagation stability analysis is illustrate using a 15-bus example microgrid network.

Roy, Sandip↗

DOE OSTI2025

Improving microstructures segmentation via pretraining with synthetic data

Image analysis of material microstructures through microscopy is an integral capability in the field of materials science. The topological and chemical information obtained through microscopy allow us to draw vital connections between material microstructures, properties, and processing. While scanning electron microscopy (SEM) is able to yield a considerable wealth of information interpretable by the intuition of experts, there has been considerable interest in using machine learning, convolutional neural networks (CNNs) in particular, for such image analysis task. Training CNNs for an image analysis task requires a large annotated dataset. However, in many materials science applications, obtaining a large annotated dataset is cost and labor intensive. In this work, we study the use of synthetic data to enlarge the available annotated experimental data of uranium oxide. We utilize a modified Potts model to simulate uranium oxide particles with morphologies similar to those observed experimentally. We then leverage an image-to-image translation model to synthesize the simulated particles as if they are acquired with SEM. Through this process, we obtain pairs of particle images and their corresponding SEM representations, which corresponds to pairs of annotations and images. Unlike previous works, we leverage synthetic data for pretraining a CNN model prior, and finetune that model further with experimental data. We experimentally demonstrate that using synthetic data as incremental learning process benefits the overall performance compared to training a model on combined synthetic and experimental data.

36 MATERIALS SCIENCE↗

DOE OSTI2025

DONUT: physics-aware machine learning for real-time X-ray nanodiffraction analysis

Coherent X-ray scattering techniques are critical for investigating the fundamental structural properties of materials at the nanoscale. While advancements have made these experiments more accessible, real-time analysis remains a significant bottleneck, often hindered by artifacts and computational demands. In scanning X-ray nanodiffraction microscopy, which is widely used to spatially resolve structural heterogeneities, this challenge is compounded by the convolution of the divergent beam with the sample’s local structure. To address this, we introduce DONUT (Diffraction with Optics for Nanobeam by Unsupervised Training), a physics-aware neural network designed for the rapid and automated analysis of nanobeam diffraction data. By incorporating a differentiable geometric diffraction model directly into its architecture, DONUT learns to predict crystal lattice strain and orientation in real-time. Crucially, this is achieved without reliance on labeled datasets or pre-training, overcoming a fundamental limitation for supervised machine learning in X-ray science. We demonstrate experimentally that DONUT accurately extracts all features within the data over 200 times more efficiently than conventional fitting methods.

Materials science↗

DOE OSTI2025

DONUT: Physics-aware Machine Learning for Real-time X-ray Nanodiffraction Analysis

SF-25-088 Coherent X-ray scattering techniques are critical for investigating the fundamental structural properties of materials at the nanoscale. While advancements have made these experiments more accessible, real-time analysis remains a significant bottleneck, often hindered by artifacts and computational demands. In scanning X-ray nanodiffraction microscopy, which is widely used to spatially resolve structural heterogeneities, this challenge is compounded by the convolution of the divergent beam with the sample’s local structure. To address this, we introduce DONUT (Diffraction with Optics for Nanobeam by Unsupervised Training), a physics-aware neural network designed for the rapid and automated analysis of nanobeam diffraction data. By incorporating a differentiable geometric diffraction model directly into its architecture, DONUT learns to predict crystal lattice strain and orientation in real-time. Crucially, this is achieved without reliance on labeled datasets or pre-training, overcoming a fundamental limitation for supervised machine learning in X-ray science. We demonstrate experimentally that DONUT accurately extracts all features within the data over 200 times more efficiently than conventional fitting methods.

Zhou, Tao [Argonne National Laboratory (ANL), Argo↗

DOE OSTI2021

A systematic approach to generating accurate neural network potentials: the case of carbon

Abstract Availability of affordable and widely applicable interatomic potentials is the key needed to unlock the riches of modern materials modeling. Artificial neural network-based approaches for generating potentials are promising; however, neural network training requires large amounts of data, sampled adequately from an often unknown potential energy surface. Here we propose a self-consistent approach that is based on crystal structure prediction formalism and is guided by unsupervised data analysis, to construct an accurate, inexpensive, and transferable artificial neural network potential. Using this approach, we construct an interatomic potential for carbon and demonstrate its ability to reproduce first principles results on elastic and vibrational properties for diamond, graphite, and graphene, as well as energy ordering and structural properties of a wide range of crystalline and amorphous phases.

Chemistry↗

DOE OSTI2023

Inferring microbial co-occurrence networks from amplicon data: a systematic evaluation

Microbes commonly organize into communities consisting of hundreds of species involved in complex interactions with each other. 16S ribosomal RNA (16S rRNA) amplicon profiling provides snapshots that reveal the phylogenies and abundance profiles of these microbial communities. These snapshots, when collected from multiple samples, can reveal the co-occurrence of microbes, providing a glimpse into the network of associations in these communities. However, the inference of networks from 16S data involves numerous steps, each requiring specific tools and parameter choices. Moreover, the extent to which these steps affect the final network is still unclear. In this study, we perform a meticulous analysis of each step of a pipeline that can convert 16S sequencing data into a network of microbial associations. Through this process, we map how different choices of algorithms and parameters affect the co-occurrence network and identify the steps that contribute substantially to the variance. We further determine the tools and parameters that generate robust co-occurrence networks and develop consensus network algorithms based on benchmarks with mock and synthetic data sets. The Microbial Co-occurrence Network Explorer, or MiCoNE (available at https://github.com/segrelab/MiCoNE) follows these default tools and parameters and can help explore the outcome of these combinations of choices on the inferred networks. We envisage that this pipeline could be used for integrating multiple data sets and generating comparative analyses and consensus networks that can guide our understanding of microbial community assembly in different biomes.

16S rRNA↗

DOE OSTI2026

buhito

buhito is a Python library for graph analysis and machine learning. Graphs can represent networks with objects as nodes and their relationships as edges. buhito focuses on graphlet methods that study graphs through enumerating their component subgraphs to enable interpretable and fast models of complex systems. The package provides tools for different algorithmic designs for computing, analyzing, and applying graphlets to research problems such as machine learning, data compression, and anomaly detection in graph-structured data. A central feature is performing decomposition data analysis on graphs for machine learning models. Implemented in Python and built upon open-source scientific libraries such as NetworkX, NumPy, and SciPy, buhito provides high-performance methods for researchers exploring the mathematical and computational foundations of graphlet analysis applicable to systems of different sizes.

Pimonova, Yulia↗