Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Combining protein sequences and structures with transformers and equivariant graph neural networks to predict protein function

Abstract Motivation Millions of protein sequences have been generated by numerous genome and transcriptome sequencing projects. However, experimentally determining the function of the proteins is still a time consuming, low-throughput, and expensive process, leading to a large protein sequence-function gap. Therefore, it is important to develop computational methods to accurately predict protein function to fill the gap. Even though many methods have been developed to use protein sequences as input to predict function, much fewer methods leverage protein structures in protein function prediction because there was lack of accurate protein structures for most proteins until recently. Results We developed TransFun—a method using a transformer-based protein language model and 3D-equivariant graph neural networks to distill information from both protein sequences and structures to predict protein function. It extracts feature embeddings from protein sequences using a pre-trained protein language model (ESM) via transfer learning and combines them with 3D structures of proteins predicted by AlphaFold2 through equivariant graph neural networks. Benchmarked on the CAFA3 test dataset and a new test dataset, TransFun outperforms several state-of-the-art methods, indicating that the language model and 3D-equivariant graph neural networks are effective methods to leverage protein sequences and structures to improve protein function prediction. Combining TransFun predictions and sequence similarity-based predictions can further increase prediction accuracy. Availability and implementation The source code of TransFun is available at https://github.com/jianlin-cheng/TransFun.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Multifunctional Fiber-Reinforced Polymer Composites for Damage Detection and Memory

Self-structural health monitoring (SHM) functionalities for fiber-reinforced polymer composites have become highly sought after to ensure the structural safety of newly advancing components in the automotive, civil, mechanical, and aerospace industries. This paper introduces a self-damage detection and memory (SDDM) hybrid composite material, where the structural carbon fiber tow is transformed into a piezoresistive sensor network, and the structural glass fiber operates as electrical insulation. In this study, SDDM specimens were fabricated, and tensile and impact tests were performed. The tensile tests of SDDM specimens find two distinct loading peaks: first where the carbon fiber fails, and second where the glass fiber fails. A linear correlation was observed between the carbon fiber resistance and composite strain up to a threshold, beyond which a sharp nonlinear increase in resistance occurred. The resistance then approached infinity, coinciding with the first loading peak and failure of the carbon fiber elements. This demonstrates the potential for a damage early warning threshold. Additionally, the effect of stitching the sensor tow in a zig-zag pattern over a large area was investigated using tailored fiber placement (TFP) of 1-loop, 3-loop, and 5-loop specimens. Tensile testing found that increasing the number of loops improved the sensor’s accuracy for strain sensing. Furthermore, impact tests were conducted, and as the impact energy progressively increased, the sensor resistance permanently increased. This illustrates a capability for self-memory of microdamage throughout the life cycle of the structure, potentially useful for predicting the remaining life of the composite.

Demo, Luke B. (ORCID:0000000208806522)↗
DOE OSTI2022

Using Hyperoptimized Tensor Networks and First-Principles Electronic Structure to Simulate the Experimental Properties of the Giant {Mn 84 } Torus

The single-molecule magnet {Mn 84 } is a challenge to theory because of its high nuclearity. Here, we directly compute two experimentally accessible observables, the field-dependent magnetization up to 75 T and the temperature-dependent heat capacity, using parameter-free theory. In particular, we use first-principles calculations to derive short- and long-range exchange interactions and compute the exact partition function of the resulting classical Potts and Ising spin models for all 84 Mn S = 2 spins to obtain observables. The latter computation is made possible by using hyperoptimized tensor network contractions, a technique developed to simulate quantum supremacy circuits. We also synthesize the magnet and measure its heat capacity and magnetization, observing qualitative agreement between theory and experiment and identifying an unusual bump in the heat capacity and a plateau in the magnetization. Our work also identifies some limitations of current theoretical modeling in large magnets, such as sensitivity to small, long-range exchange couplings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Self-Supervised and Interpretable Anomaly Detection Using Network Transformers

Machine learning and deep neural networks (DNNs) have been proposed as a tool to identify anomalies in computer network communications. However, due the obfuscated nature of off-the-shelf machine learning models, their output often does not provide enough information to isolate the source of the anomaly to take corrective measures. In this article, we introduce the network transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. Further, the presented approach has the following advantages: first, enhanced interpretability by incorporating the graph structure of computer networks; second, provides a hierarchical set of features that enables analysis at different levels of granularity; second, self-supervised training that does not require labeled data. The NeT model was evaluated on a set of anomalous scenarios executed in a real industrial control system. The presented approach successfully identified the anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Tunable Stochasticity in an Artificial Spin Network

Metamaterials present the possibility of artificially generating advanced functionalities through engineering of their internal structure. Artificial spin networks, in which a large number of nanoscale magnetic elements are coupled together, are promising metamaterial candidates that enable the control of collective magnetic behavior through tuning of the local interaction between elements. In this work, the motion of magnetic domain-walls in an artificial spin network leads to a tunable stochastic response of the metamaterial, which can be tailored through an external magnetic field and local lattice modifications. This type of tunable stochastic network produces a controllable random response exploiting intrinsic stochasticity within magnetic domain-wall motion at the nanoscale. An iconic demonstration used to illustrate the control of randomness is the Galton board. In this system, multiple balls fall into an array of pegs to generate a bell-shaped curve that can be modified via the array spacing or the tilt of the board. A nanoscale recreation of this experiment using an artificial spin network is employed to demonstrate tunable stochasticity. Furthermore, this type of tunable stochastic network opens new paths toward post-Von Neumann computing architectures such as Bayesian sensing or random neural networks, in which stochasticity is harnessed to efficiently perform complex computational tasks.

Artificial spin network↗
DOE OSTI2026

Assessing the Application of a Genomic Network Analysis in Population Ecology: Inferring Patterns of Dispersal and Geographic Structure in the Emerging Pathogen, Coccidioides

A challenge in population ecology studies is identifying how to best group individuals into populations, especially when individual origin is unknown. Machine learning has improved upon traditional methods of identifying population structure and is more efficient at handling large, complex datasets. We demonstrate the applicability of a machine learning method to identify hierarchical population structure in an emerging pathogen, Coccidioides spp., the causative agent of Valley fever. We compared the network clusters to structure identified by traditional tools as a validation of the network performance. We used publicly available whole-genome data for 48 C. immitis and 102 C. posadasii, resulting in 168,211 genome-wide SNPs among the two species. The network analysis grouped samples into populations comparable to the literature for these species but also identified fine-scale geographic structure and travel-associated cases not reported thus far. Exploring different resolutions in the network made it easy to identify unique genotypes specific to California and possibly Nevada, as well as Phoenix- and Tucson-acquired infections in non-endemic areas, regardless of reported travel history. The present study provides a promising example of how a ML-based network analysis can improve our ability to understand pathogen ecology, group cases into populations and infer travel-associated infections.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Microsolvation in V + (H 2 O) n Clusters Studied with Selected-Ion Infrared Spectroscopy

Gas phase ion-molecule clusters of the form V + (H 2 O) n (n = 1-30) are produced by laser vaporization in a supersonic expansion. These ions are analyzed and mass-selected with a time-of-flight mass spectrometer and investigated with infrared laser photodissociation spectroscopy. The small clusters (n ≤ 7) are studied with argon tagging, while the larger clusters are studied via the elimination of water molecules. The vibrational spectra for the small clusters include only free O-H stretching vibrations, while larger clusters exhibit red-shifted hydrogen bonding vibrations. The spectral patterns reveal that the coordination around V + ions is completed with four water molecules. A symmetric square-planar structure forms for the n = 4 ion, and this becomes the core ion in larger structures. Clusters up to n = 8 have mostly two-dimensional structures, but hydrogen bonding networks evolve to three-dimensional structures in larger clusters. The free O-H vibration of AAD (acceptor-acceptor-donor) coordinated surface molecules converges to a frequency near that of bulk water by the cluster size of n = 30. However, the splitting of this vibration for AAD- versus AD-coordinated molecules is still different compared to other singly-charged or doubly-charged cation-water clusters. Finally, this indicates that cation identity and charge-site location in the cluster can produce discernible spectral differences for clusters in this size range.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Fracture Network Influence on Rock Damage and Gas Transport following an Underground Explosion

Simulations of rock damage and gas transport following underground explosions that omit preexisting fracture networks in the subsurface cannot fully characterize the influence of geo-structural variability on gas transport. Previous studies do not consider the impact that fracture network structure and variability have on gas seepage. In this study, we develop a sequentially coupled, axi-symmetric model to look at the damage pattern and resulting gas breakthrough curves following an underground explosion given different fracture network realizations. We simulate 0.327 and 0.164 kT chemical explosives with burial depths of 100 m for 90 stochastically generated fracture networks. Gases quickly reach the surface in 30% of the higher yield simulations and 5% of the lower yield simulations. The fast breakthrough can be attributed to the formation of connected pathways between fractures to the surface. The formation of a connected damage pathway to the surface is not clearly correlated with the fracture intensity (P32) in our simulations. Breakthrough curves with slower transport are highly variable depending on the fracture network sample. The variability in the breakthrough behavior indicates that ignoring the influence of fracture networks on rock damage, which strongly influences the hydraulic properties following an underground explosion, will likely lead to a large underestimation of the uncertainty in the gas transport to the surface. This work highlights the need for incorporation of fracture networks into models for accurately predicting gas seepage following underground explosions.

58 GEOSCIENCES↗
DOE OSTI2020

A Look Inside the Black Box: Using graph-theoretical descriptors to interpret a Continuous-Filter Convolutional Neural Network (CF-CNN) trained on the global and local minimum energy structures of neutral water clusters

A Continuous Filter Convolutional Neural Network (CF-CNN) was trained to predict the potential energy of water cluster networks \ce{(H2O)_{\textit{N}}}, \textit{N}=10--30, corresponding to local minima lying within 5 kcal/mol from the putative minima taken from a newly published database containing over 5 million unique networks. The chemical sampling space of the database was characterized using chemical descriptors derived from graph theory, which led to the identification of important trends in the topology, connectivity, polygon structures associated with the various networks as a function of cluster size. The resulting graphs are available alongside the original database at \url{https://sites.uw.edu/wdbase/}. The CF-CNN trained on a subset of 500,000 networks for (\textit{N}=10, 30) yielded a mean absolute error of 0.002$\pm$0.002 kcal/mol per water molecule, giving the trained CF-CNN the highest accuracy of any neural network-based surrogate model to date. In addition, clusters of sizes not included in the training set exhibited errors of the same magnitude, indicating that the CF-CNN ptotocol is general enough to accurately predict energies of networks for both smaller and larger sizes than those used during training. The graph-theoretical descriptors were developed in order to analyze the properties of the full database and interpret the predictive power of the CF-CNN. Using topology measures, such as the Wiener index and the average shortest path length along with two similarity measures, we showed that all networks from the test set were within the range of the ones from the training set, suggesting that the training set covered the chemical space of interest quite well. Our graph analysis suggests that the mean degree and number of polygons for networks with larger errors tend to lie further from the mean than those with lower errors. The generality of the used CF-CNN was thus demonstrated, while the use of the graph-theoretical descriptors assisted in interpreting the predicted results.

Bilbrey, Jenna A.↗
DOE OSTI2020

Flexibility in the Energy Balancing Network of Photosynthesis Enables Safe Operation under Changing Environmental Conditions

Given their ability to harness chemical energy from the sun and generate the organic compounds necessary for life, photosynthetic organisms have the unique capacity to act simultaneously as their own power and manufacturing plant. This dual capacity presents many unique challenges, chiefly that energy supply must be perfectly balanced with energy demand to prevent photodamage and allow for optimal growth. From this perspective, we discuss the energy balancing network using recent studies and a quantitative framework for calculating metabolic ATP and NAD(P)H demand using measured leaf gas exchange and assumptions of metabolic demand. We focus on exploring how the energy balancing network itself is structured to allow safe and flexible energy supply. We discuss when the energy balancing network appears to operate optimally and when it favors high capacity instead. We also present the hypothesis that the energy balancing network itself can adapt over longer time scales to a given metabolic demand and how metabolism itself may participate in this energy balancing.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗
DOE OSTI2021

Lithium Oxide Superionic Conductors Inspired by Garnet and NASICON Structures

Abstract The key component in lithium solid‐state batteries (SSBs) is the solid electrolyte composed of lithium superionic conductors (SICs). Lithium oxide SICs offer improved electrochemical and chemical stability compared with sulfides, and their recent advancements have largely been achieved using materials in the garnet‐ and NASICON (sodium superionic conductor)‐ structured families. In this work, using the ion‐conduction mechanisms in garnet and NASICON as inspiration, a common pattern of an “activated diffusion network” and three structural features that are beneficial for superionic conduction: a 3D percolation Li diffusion network, short distances between occupied Li sites, and the “homogeneity” of the transport path are identified. A high‐throughput computational screening is performed to search for new lithium oxide SICs that share these features. From this search, seven candidates are proposed exhibiting high room‐temperature ionic conductivity evaluated using ab initio molecular dynamics simulations. Their structural frameworks including spinel, oxy‐argyrodite, sodalite, and LiM(SeO 3 ) 2 present new opportunities for enriching the structural families of lithium oxide SICs.

36 MATERIALS SCIENCE↗