Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

..delta..-Learning of High-Fidelity Electronic Structure Using Graph Neural Networks with Modified Node-Level Features

In this work, we present a ..delta..-learning approach for predicting the eigenvalues calculated with the hybrid functional HSE06 (..epsilon..nkHSE) for a set of metal and nitrogen doped graphene catalysts (MNCs) from Perdew-Burke-Ernzerhof (PBE) inputs. The model presented here incorporates electronic scalar features along with structural information in a graph neural network (GNN). In particular, the PBE eigenvalues for different bands and k-points and orbital-resolved projectors are combined with the applied potential as node-level features along with structural information within the Atomistic Line Graph Neural Network (ALIGNN) architecture. These features enable flexibility for systems with electrified interfaces, such as in electrocatalysts and achieves mean absolute error (MAE) of less than 0.1 eV. The machine learning model reported here achieves a strong generalization to left-out adsorbates (MAE = 0.074 eV) and leave-one-chemical-space-out (MAE = 0.08 eV) and completely left-out metals (MAE = 0.072 eV), confirming the robustness of the machine learning (ML) model in predicting ..epsilon..nkHSE.

36 MATERIALS SCIENCE↗

Lamb wave imaging with actuator network for damage quantification in aluminum plate structures

Lamb waves have been widely used for damage detection on plate-like structures. However, there are still considerable interests on quantifying damage with complex profile. In this article, quantification of complex damage in plate-like structures using a network of actuators and time-space Lamb wavefield is investigated. The actuator network inspection system is implemented with multiple PZT transducers for Lamb wave actuation in round robin pattern and scanning laser Doppler vibrometer for wavefield sensing. The PZT network is arranged in a way that the target area is fully enclosed and Lamb waves come to the damage from all directions. Waves induced by the damage are subsequently obtained through frequency-wavenumber filtering, using the experimentally acquired dispersion curves presented in the paper. The filtered waves from all wave actuators are then used to generate a synthetic image of the damage being inspected. Two cases of complex damage are evaluated on aluminum plates, mass loss with triangular profile and mass addition with a three-letter cluster profile. Our results show that the damages are not only detected but also their profiles are clearly outlined in the images. We believe the subject methods provide improved evaluation of damage profile for Lamb wavefield based damage quantification.

Materials Science↗

Accurate and rapid acoustic damage characterization in complex structures using sparse sensor networks and deep learning models

Damage diagnosis in critical components is essential for ensuring the safety and reliability of operations across industries, spanning manufacturing, aerospace, and energy. Traditional acoustic nondestructive testing methods primarily focus on detecting defects through the direct scattering of single-mode incident waves from the damage, which limit their applicability to simple structures and small inspection areas. Our earlier research demonstrated that machine learning algorithms combined with sparse sensor networks can identify critical defect signatures even from multiply scattered, multi-mode acoustic signals, indicating the potential for improved defect inspection in complex, real-world structures. In this work, we demonstrate the successful implementation of this approach in a fixed sensor configuration to rapidly and accurately detect simulated defects in a geometrically complex, real-world structure, a brake rotor hub. Three different types of defects were physically simulated on the surface of the hub, and the collected data were used to train an autoencoder-based deep learning model. Two models were tested, one using single measurements and the other using multiple measurements taking advantage of the spatial distribution of the sensor network. After training, the multi-measurement model achieved 100 % accuracy in identifying, classifying, and locating unseen, unique damages. This work illustrates the potential of the proposed method for a wide range of industrial applications.

36 MATERIALS SCIENCE↗

Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets

Abstract Modern data mining methods have demonstrated effectiveness in comprehending and predicting materials properties. An essential component in the process of materials discovery is to know which material(s) will possess desirable properties. For many materials properties, performing experiments and density functional theory computations are costly and time-consuming. Hence, it is challenging to build accurate predictive models for such properties using conventional data mining methods due to the small amount of available data. Here we present a framework for materials property prediction tasks using structure information that leverages graph neural network-based architecture along with deep-transfer-learning techniques to drastically improve the model’s predictive ability on diverse materials (3D/2D, inorganic/organic, computational/experimental) data. We evaluated the proposed framework in cross-property and cross-materials class scenarios using 115 datasets to find that transfer learning models outperform the models trained from scratch in 104 cases, i.e., ≈90%, with additional benefits in performance for extrapolation problems. We believe the proposed framework can be widely useful in accelerating materials discovery in materials science.

Chemistry↗

Quartz Dissolution Effects on Flow Channelization and Transport Behavior in Three‐Dimensional Fracture Networks

We perform a set of reactive transport simulations in three-dimensional fracture networks to characterize the impact of geochemical reactions on flow channelization. Flow channelization, a frequently observed phenomenon in porous and fractured subsurface rock formations, results from the spatially variable hydraulic resistance offered by a geological structure. In addition to geo-structural features such as network connectivity, geometry, and hydraulic resistance, geochemical reactions, for example, dissolution and precipitation, can dynamically inhibit or enhance flow channelization. These geochemical processes can change the fracture permeability leading to increased flow channelization, which are localized connected regions of high volumetric flow rates that are seemingly ubiquitous in the subsurface. In our simulations, fractures partially filled with quartz are gradually dissolved until quasi-steady state conditions are obtained. We compare the flow field's initial unreacted and final dissolved states in terms of flow and transport observations. We observe that the dissolved fracture networks provide less resistance to flow and exhibit increased flow channelization when compared to their unreacted counterparts. However, there is substantial variability in the magnitude of these changes which implies that the channelization strongly depends on the network structure. In turn, we identify the interplay between the particular network structure and the impact of geochemical dissolution on flow channelization. The presented results indicate that geological systems that have been weathering or reactive for longer times in older landscapes are likely to have increased flow channelization compared to their equivalent but younger counterparts, which implies a time dependence on flow channelization in fractured media.

Hyman, Jeffrey D.↗

Inferring Structural Parameters of Low-Surface-Brightness-Galaxies with Uncertainty Quantification using Bayesian Neural Networks

Measuring the structural parameters (size, total brightness, light concentration, etc.) of galaxies is a significant first step towards a quantitative description of different galaxy populations. In this work, we demonstrate that a Bayesian Neural Network (BNN) can be used for the inference, with uncertainty quantification, of such morphological parameters from simulated low-surface-brightness galaxy images. Compared to traditional profile-fitting methods, we show that the uncertainties obtained using BNNs are comparable in magnitude, well-calibrated, and the point estimates of the parameters are closer to the true values. Our method is also significantly faster, which is very important with the advent of the era of large galaxy surveys and big data in astrophysics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

4D structural changes and pore network model of biomass during pyrolysis

Biochar is an engineered carbon-rich substance used for soil improvement, environmental management, and other diverse applications. To date, the understanding of how biomass affects biochar microstructure has been limited due to the complexity of analysis involved in tracing the changes in the physical structure of biomass as it undergoes thermochemical conversion. In this study, we used synchrotron x-ray micro-tomography to visualize changes in the internal structure of biochar from diverse feedstock (miscanthus straw pellets, wheat straw pellets, oilseed rape straw pellets, and rice husk) during pyrolysis by collecting a sequence of 3D scans at 50 °C intervals during progressive heating from 50 °C to 800 °C. The results show a strong dependence of biochar porosity on feedstock as well as pyrolysis temperature, with observed porosity in the range of 7.41–60.56%. Our results show that the porosity, total surface area, pore volume, and equivalent diameter of the largest pore increases with increasing pyrolysis temperature up to about 550 °C. The most dramatic development of pore structure occurred in the temperature range of 350–450 °C. This understanding is pivotal for optimizing biochar’s properties for specific applications in soil improvement, environmental management, and beyond. By elucidating the nuanced variations in biochar’s physical characteristics across different production temperatures and feedstocks, this research advances the practical application of biochar, offering significant benefits in agricultural, environmental, and engineering contexts.

54 ENVIRONMENTAL SCIENCES↗

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis

The Theory of Bottleneck Structures is a recently-developed framework for studying the performance of data networks. It describes how local perturbations in one part of the network propagate and interact with others. This framework is a powerful analytical tool that allows network operators to make accurate predictions about network behavior and thereby optimize performance. Previous work implemented a software package for bottleneck structure analysis, but applied it only to toy examples. In this work, we introduce the first software package capable of scaling bottleneck structure analysis to production-size networks. Here, we benchmark our system using logs from ESnet, the Department of Energy's high-performance data network that connects research institutions in the U.S. Using the previously published tool as a baseline, we demonstrate that our system achieves vastly improved performance, constructing the bottleneck structure graphs in 0.21 s and calculating link derivatives in 0.09 s on average. We also study the asymptotic complexity of our core algorithms, demonstrating good scaling properties and strong agreement with theoretical bounds. These results indicate that our new software package can maintain its fast performance when applied to even larger networks. They also show that our software is efficient enough to analyze rapidly changing networks in real time. Overall, we demonstrate the feasibility of applying bottleneck structure analysis to solve practical problems in large, real-world data networks.

benchmark↗

Rigidity‐Driven Structural Isomers in the NaCl–Ga 2 S 3 System: Implications for Energy Storage

Alternative energy sources require the search for innovative materials with promising functionalities. Systems with unusual chemical properties represent an insufficiently explored domain, concealing unexpected features. Using diffraction and Raman spectroscopy over a wide temperature range, supported by first‐principles simulations, a rare phenomenon is unveiled: phase‐dependent chemical interactions between binary components in the NaCl–Ga 2 S 3 system. In this unique occurrence, previously intact binary crystalline species transform upon melting into mixed liquid structural isomers, forming bonds with new partners. The chemical combinatorics appears to be fully reversible for stable crystals and liquids. Despite this, rapidly frozen glasses out of thermodynamic equilibrium remain in a metastable isomeric state, offering remarkable properties, particularly a high room‐temperature Na + conductivity, comparable to the best sodium halide superionic conductors and therefore encouraging for sodium solid‐state batteries and energy applications. A rigidity paradigm is responsible for the observed phenomenon, as the extremely constrained Ga 2 S 3 crystal lattice does not survive viscous flow, breaking up at a short‐range level. The removal of rigidity constraints and dense packing leads to a significant increase in empty space, which is the origin of high sodium diffusivity. Broadly, the rigidity‐driven structural isomerism opens up an inspiring path to the discovery of atypical materials.

25 ENERGY STORAGE↗

Reconstructing cosmological initial conditions from late-time structure with convolutional neural networks

ABSTRACT We present a method to reconstruct the initial linear-regime matter density field from the late-time non-linearly evolved density field in which we channel the output of standard first-order reconstruction to a convolutional neural network (CNN). Our method shows dramatic improvement over the reconstruction of either component alone. We show why CNNs are not well-suited for reconstructing the initial density directly from the late-time density: CNNs are local models, but the relationship between initial and late-time density is not local. Our method leverages standard reconstruction as a preprocessing step, which inverts bulk gravitational flows sourced over very large scales, transforming the residual reconstruction problem from long-range to local and making it ideally suited for a CNN. We develop additional techniques to account for redshift distortions, which warp the density fields measured by galaxy surveys. Our method improves the range of scales of high-fidelity reconstruction by a factor of 2 in wavenumber above standard reconstruction, corresponding to a factor of 8 increase in the number of well-reconstructed modes. In addition, our method almost completely eliminates the anisotropy caused by redshift distortions. As galaxy surveys continue to map the Universe in increasingly greater detail, our results demonstrate the opportunity offered by CNNs to untangle the non-linear clustering at intermediate scales more accurately than ever before.

Astronomy & Astrophysics↗

FY24 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

Algorithms for Machine Learning (ML) and data analysis for the 3013 Surveillance Program have been developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). The objective of the algorithms is to automate the identification of corrosion and crack formation in the Inner Container Closure Weld Region (ICCWR) of the canister system used to store Pu-bearing material. Data for corrosion and cracking is collected from large binary files generated by a Laser Confocal Microscope (LCM), the Wide Area 3D Measurement System (WAMS), or,in a recent proposal, by a Scanning Electron Microscope (SEM). The ML software uses the physical attributes in the data files (e.g., one or more of: height, color, and 16-bit grayscale values as functions of position in a plane projection) to detect signs of surface corrosion and cracking after being trained on similar data, with the features to be detected. Although the initial scope included screening for broader indicators of corrosion, e.g., pitting, identification of potential cracks was prioritized for the past several years at the request of program leadership. Labeled training data is essential to developing the ML algorithm, and enhancements to data labeling capability have been developed to address this essential precursor to application of ML routines. Efficient labeling is particularly important in view of the large volume of data required to train ML algorithms and the relative rarity of cracks in the ICCWR data set. The updated program will read binary data from either LCM, WAMS or SEM files, interrogate data attributes, facilitate user labeling of data for training ML algorithms, execute ML algorithms, output parameters from trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. In FY24, hourglass neural networks (HNNs) that were initiated in FY22 were further developed and tested using available LCM data, and their performance was tested against that of the alternative U-Net Neural Network algorithm structure. HNNs along with previously developed Convolutional Neural Networks (CNNs) and Deep Neural Networks (DNNs) comprise a suite of ML tools for identification of cracks in the ICCWR

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Templates for Risk Informed Assurance with Curvature Embeddings (TRACE)

We investigate recovery of geometric structure from networks embedded in manifolds with spatially varying curvature, extending the constant-curvature framework of Lubold et al. (2023). Our work supports cascade risk assessment in critical infrastructure through the Templates for Risk-informed Assurance with Curvature Embeddings (TRACE) framework. Simulations on a bi-modal Gaussian surface show that constant-curvature methods yield weighted averages shaped by clique patterns, while hierarchical clustering identifies distinct regimes. Localized estimation, however, reveals boundary contamination in transitional regions. To address heterogeneity, we develop distance metrics for graphs with edge and node features, proving their metric validity, and validate them via deterministic graph generation from canonical tilings. We further propose a diffusion-based anomaly detection approach that treats networks as glued manifolds, using curvature discontinuities to detect structural anomalies. Employing the carré-du-champ operator and scalar curvature, we achieve robust anomaly discrimination, demonstrated on the Singapore Water Treatment (SWaT) dataset with joint network-traffic and sensor features. Integration with TRACE reveals how curvature shapes cascade dynamics: positive curvature impedes, while negative curvature accelerates propagation. This geometric perspective provides interpretable risk metrics and visualization tools for critical infrastructure managers. While full validation remains ongoing, our contributions establish a rigorous foundation for geometric analysis of network resilience and cascade vulnerability.

97 MATHEMATICS AND COMPUTING↗