Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “layered networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Layer size polydispersity in hydrated montmorillonite creates multiscale porosity networks

The aluminosilicate layers of the swelling clay mineral montmorillonite, and the saturated pores they delineate, control the mechanical properties and the transport of solutes in many natural and engineered environments. However, the structural basis of montmorillonite porosity remains poorly characterized due to the difficulty in visualizing hydrated samples in their native state. Here in this paper, we used cryogenic transmission electron microscopy (cryo-TEM) and cryo electron tomography (cryo-ET) to show that stacking defects within minimally altered, fully hydrated montmorillonite particles define multiscale porosity networks. Variations in layer lateral dimensions over tens to thousands of nanometers cause a range of topological and dynamic defects that generate pervasive curvature and introduce previously uncharacterized solute transport pathways. Observations of long-range rotational order between neighboring layers indicate that the layer-layer interactions that govern clay swelling involve three dimensional orienting forces that operate across nanoscale pores. These direct observations of the hierarchical structure of hydrated montmorillonite pore networks with nanoscale resolution reveal potentially general aspects of colloidal interactions in fluid-saturated clay minerals.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Overview of RFID Applications Utilizing Neural Networks

As Radio Frequency Identification (RFID) methods continue to evolve to higher levels of complexity, one form of machine learning is making its appearance. The use of Neural Networks (NN) in the RFID field is steadily increasing, and in the fields of localization and activity recognition, promising results are being shown from a variety of research. RFID applications fall primarily under two types of problems including regression and classification. We analyze RIFD localization techniques which fall under regression, and activity recognition which falls under classification. Many works don’t classify themselves as activity recognition methods, but because they fall under the classification category, we still consider them as activity recognition techniques. This research overviews the Neural Network models in the localization field based on whether they can perform independently of the environment in which they were tested. For activity recognition and accessory fields, the major methods involve tag-based and tag-free approaches. In conclusion, after the models are surveyed, a comparison study is given to examine what may be the cause for increased accuracy between different Neural Network models.

42 ENGINEERING↗
DOE OSTI2020

Network structure in alteration layer of boroaluminosilicate glass formed by aqueous corrosion

Exogenously-added LiCl has been shown to slightly accelerate the corrosion rate of a boroaluminosilicate glass called International Simple Glass (ISG) in aqueous solutions over forward- and residual-rate regimes, while KCl and CsCl impede. To understand the effect of exogenously added electrolytes on resulting hydrous species and the network structure of alteration layers, infrared spectroscopy was implemented. It was found that the fraction of molecular water relative to the surface-bound hydroxyl species is lower in the KCl and CsCl conditions compared to the LiCl and pure water conditions. An approximation for the spectral features of the thin surface films from an experimentally-obtained specular-reflectance infrared (SR-IR) spectrum was proposed; results indicate no significant difference in the Si-O bonding network of the alteration layers formed in the presence of exogenously added LiCl, KCl and CsCl. Furthermore, the observed change in corrosion rates might be linked to the relative abundance of molecular water species in the porous network, rather than the silicate bonding structure.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Efficient Sampling of Complex Interdependent and Multiplex Networks

Efficient sampling of interdependent and multiplex infrastructure networks is critical for effectively applying failure and recovery algorithms in real-world settings, as well as to generate property-preserving reduced-order graph-based ensembles that address topological uncertainties. In this paper, we first explore the performance, i.e. the success in preserving graph properties, of graph sampling algorithms for interdependent and multiplex networks with synthetic and real-world graphs. We simulate sampling algorithms under different parameter settings. These settings include probabilistic graph generators, coupling patterns, and various performance metrics. Our results show that while Random Node and Random Walk sampling algorithms perform best for interdependent networks, Random Edge and Forest Fire sampling algorithms perform best for multiplex networks. Second, we propose and implement a novel similarity-based sampling algorithm for multiplex networks that samples only log(N) number of layers of an N-layer multiplex network while yielding computational savings with performance guarantees. Experimental results show that similarity sampling outperforms complete sampling of all layers while decreasing performance costs from a linear scale to a logarithmic one. Our results also indicate that similarity-based sampling outperforms complete sampling and random selection in nearly all scenarios when tested with real-world data.

Subasi, Omer↗
DOE OSTI2022

A Dynamic Pore Network Model for Imbibition Simulation Considering Corner Film Flow

Wetting films can develop in the corners of angular pores under strong wetting conditions. Modeling the dynamics of corner film remains elusive using direct numerical simulations because of the significant scale difference between main meniscus and corner film flow. In this paper, the modified interacting capillary bundle model (ICB), developed in our previous work to describe accurately corner film dynamics in a single square tube, is incorporated into a single-pressure dynamic pore network model (DPNM) to simulate imbibition in strongly wetting porous media with corner film flow. The traditional pore network is decomposed into several layers of interacting subpore networks where the 0th layer of subpore network simulates the main meniscus flow and higher layers the corner film flow. The fluid flow between different layers is captured by interlayer throats. In addition, the snap-off mechanism caused by the thickening of wetting corner film is considered. The accuracy of the developed model is validated for four cases: spontaneous imbibition in a single square tube, wetting fluid redistribution through corner films under a capillary pressure difference, snap off in a narrow throat connecting two large pores, and imbibition dynamics in a real microfluidic porous geometry. The validated model is then used to simulate both spontaneous and controlled imbibition in a pore network with random pore size distribution. Finally, the interaction between corner film and main meniscus flow in porous media is analyzed from a pore-scale perspective.

58 GEOSCIENCES↗
DOE OSTI2025

TorchBraid: High-Performance Layer-Parallel Training of Deep Neural Networks with MPI and GPU Acceleration

TorchBraid is a high-performance implementation of layer-parallel training for deep neural networks (DNNs) supporting MPI-based parallelism and GPU acceleration. Layer-parallel training has been developed to overcome the serialization inherent in forward and backward propagation of DNNs that limits utilization of computational resources in the strong scaling limit. To achieve this, TorchBraid integrates the PyTorch neural network framework with the state-of-the-art XBraid time-parallel library. Furthermore, this article presents the use and performance of TorchBraid, in addition to solutions for overcoming the algorithmic challenges inherent in combining automatic differentiation with layer-parallel. Results are presented with and without GPU acceleration for the Tiny ImageNet and MNIST image classification data sets, as well as recurrent neural networks. Overall, TorchBraid enables fast training of DNNs, both in a strong and weak scaling context. In addition to the TorchBraid software, several new advances in applying layer-parallel algorithms are detailed. Integration of layer-parallel with data-parallel algorithms is presented for the first time, showing the computational advantages of the combination. Standard deep learning techniques, like batch-normalization, are developed for layer-parallel training. Finally, a new approach combining layer-parallel with spatial coarsening in order to accelerate training for 3D image classification shows roughly a 10× speedup over serial execution.

Layer-parallel↗
DOE OSTI2023

Transparent application-layer/os deeper packet inspector

A computer-implemented method of deep packet inspection (DPI) in a network is provided. The method comprises collecting data packets comprising a number of traffic flows from a number of devices via a number of traffic taps and classifying each traffic flow according to data about network protocol layers of the packets comprising the traffic flow. Application layer metadata is extracted from the packets. Traffic flow classification data and the extracted metadata are ingested into a data cluster and normalized. The normalized classification data and extracted metadata is then correlated to other data sets.

Urias, Vincent↗
DOE OSTI2025

Benchmarking a Tunable Quantum Neural Network on Trapped-Ion and Superconducting Hardware

We implement a quantum generalization of a neural network on trapped-ion and IBM superconducting quantum computers to classify MNIST images, a common benchmark in computer vision. The network feedforward involves qubit rotations whose angles depend on the results of measurements in the previous layer. The network is trained via simulation, but inference is performed experimentally on quantum hardware. The classical-to-quantum correspondence is controlled by an interpolation parameter, $a$, which is zero in the classical limit. Increasing $a$ introduces quantum uncertainty into the measurements, which is shown to improve network performance at moderate values of the interpolation parameter. We then focus on particular images that fail to be classified by a classical neural network but are detected correctly in the quantum network. For such borderline cases, we observe strong deviations from the simulated behavior. We attribute this to physical noise, which causes the output to fluctuate between nearby minima of the classification energy landscape. Such strong sensitivity to physical noise is absent for clear images. We further benchmark physical noise by inserting additional single-qubit and two-qubit gate pairs into the neural network circuits. Our work provides a springboard toward more complex quantum neural networks on current devices: while the approach is rooted in standard classical machine learning, scaling up such networks may prove classically non-simulable and could offer a route to near-term quantum advantage.

FOS: Physical sciences↗
DOE OSTI2022

Impact of aqueous solution pH on network structure of corrosion–induced surface layers of boroaluminosilicate glass

Understanding of the long-term stability of vitrified nuclear waste glass is critical to its safe storage, but knowledge gaps remain regarding the corrosion mechanism, especially with respect to surface alteration layers whose presence changes the observed corrosion rates. Here, we report the aqueous corrosion of a model boroaluminosilicate glass at ground water relevant pHs as investigated by vibrational spectroscopy to understand the network structure of the alteration layer that we hypothesize controls the corrosion rates. Both specular reflection infrared spectroscopy and infrared variable angle spectroscopic ellipsometry were used to elucidate details of the structure of the alteration layers formed at pH 7 and pH 9. After 2312 days, the thickness of the alteration layer is found to be ~2000 nm for corrosion at pH 7 and ~300 nm for corrosion at pH 9. Here, the interpretation of the vibrational spectra suggests that alteration layers formed at pH 7 and pH 9 both exhibit a porous network with "silica-like" structures, but with differences in the bond lengths and bond angles in the glass network. Moreover, the relative abundance of the hydrous species within the porous network appears to be dependent on pH. Additionally, the spectroscopic data suggest that the B and Ca trapped in the alteration layer during the secondary corrosion of the pH 9 pre-corroded sample in pH 3 solution are hydrated within the nano-porous layer and not bound to the silicate network. However, the precise chemical form remains to be determined. Based on these findings, we propose that the combination of the network structure of the alteration layer and the relative abundance of hydrous species within the alteration layer act to control the transport of ionic species dissolved from the reaction front to the aqueous solution outside the glass.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Uncertainty propagation in feed-forward neural network models

We develop new uncertainty propagation methods for feed-forward neural network architectures with leaky ReLU activation functions subject to random perturbations in the input vectors. In particular, we derive analytical expressions for the probability density function (PDF) of the neural network output and its statistical moments as a function of the input uncertainty and the parameters of the network, i.e., weights and biases. A key finding is that an appropriate linearization of the leaky ReLU activation function yields accurate statistical results even for large perturbations in the input vectors. This can be attributed to the way information propagates through the network. We also propose new analytically tractable Gaussian copula surrogate models to approximate the full joint PDF of the neural network output. To validate our theoretical results, we conduct Monte Carlo simulations and a thorough error analysis on a multi-layer neural network representing a nonlinear integro-differential operator between two polynomial function spaces. Our findings demonstrate excellent agreement between the theoretical predictions and Monte Carlo simulations.

MLP networks↗
DOE OSTI2025

Testing CP properties of the Higgs boson coupling to τ leptons with heterogeneous graphs

In this paper we explore the possibility of utilizing Deep Learning in measuring the CP properties of the coupling of Higgs boson to τ leptons at the High Luminosity Large Hadron Collider. We employ three Deep Learning (DL) networks, Multi-Layer Perceptron (MLP), Graph Convolution Network (GCN), and Graph Transformer Network (GTN) to enhance signal-to-background separation. The angle between τ lepton decay planes at the detector level is CP-sensitive observables, and we develop Heterogeneous Graphs that integrate diverse node and edge structures to incorporate the CP-sensitive observable efficiently. Using simplified detector simulations we estimate the reconstruction accuracy of the angle between τ lepton planes at the detector level, considering hadronic τ decay modes and standard model backgrounds. With $\sqrt{s}$ = 14 TeV and $\mathcal{L}$ = 100 fb -1 , MLP excludes CP mixing angles above 20° at 68% confidence level (CL), while GCN and GTN achieve exclusions at 90% CL and 95% CL, respectively. The networks also achieve a 3σ significance in excluding a pure CP-odd state.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Discovery of Ternary Antimonides A–Al–Sb (A = Rb or Cs) with Desired Structural Motifs Guided by Machine Learning

Specific structural motifs in inorganic solids are often related to their targeted physical properties. For many classes of solids, such as Zintl phases and polar intermetallics, the crystal structures are diverse and not easy to predict. Various antimonides that are potential thermoelectric materials were proposed to be synthesizable on the basis of their estimated formation energies. Their structures were broadly classified as clathrate, channel, layered, or network through a machine learning model trained on existing ternary phases and features based on elemental properties using the sure independence screening and sparsifying operator algorithm. Through experimental validation, three new ternary antimonides were synthesized and confirmed to form layered structures: tetragonal RbAlSb 2 and CsAlSb 2 , which are isopointal but not isotypic to LiBSi 2 ; and monoclinic Rb 2 Al 2 Sb 3 , which adopts the Na 2 Al 2 Sb 3 -type structure. Finally, reinvestigation of the related compound Cs 2 In 2 Sb 3 revealed a low thermal conductivity and p-type semiconducting behavior.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, AD model validation through real-world sensor data is important for applications in nuclear facilities. In this paper, we propose an Autoencoder (AE)—a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD)—as another AD scheme for identifying irregularities withinthe same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, validation of AD models through real-world sensor data is important for their application in nuclear facilities. In this paper, we propose an Autoencoder (AE)— a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD) — as another AD scheme for identifying irregularities within the same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We also validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗