Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “heterogeneous networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Deep structural clustering for single-cell RNA-seq data jointly through autoencoder and graph neural network

Abstract Single-cell RNA sequencing (scRNA-seq) permits researchers to study the complex mechanisms of cell heterogeneity and diversity. Unsupervised clustering is of central importance for the analysis of the scRNA-seq data, as it can be used to identify putative cell types. However, due to noise impacts, high dimensionality and pervasive dropout events, clustering analysis of scRNA-seq data remains a computational challenge. Here, we propose a new deep structural clustering method for scRNA-seq data, named scDSC, which integrate the structural information into deep clustering of single cells. The proposed scDSC consists of a Zero-Inflated Negative Binomial (ZINB) model-based autoencoder, a graph neural network (GNN) module and a mutual-supervised module. To learn the data representation from the sparse and zero-inflated scRNA-seq data, we add a ZINB model to the basic autoencoder. The GNN module is introduced to capture the structural information among cells. By joining the ZINB-based autoencoder with the GNN module, the model transfers the data representation learned by autoencoder to the corresponding GNN layer. Furthermore, we adopt a mutual supervised strategy to unify these two different deep neural architectures and to guide the clustering task. Extensive experimental results on six real scRNA-seq datasets demonstrate that scDSC outperforms state-of-the-art methods in terms of clustering accuracy and scalability. Our method scDSC is implemented in Python using the Pytorch machine-learning library, and it is freely available at https://github.com/DHUDBlab/scDSC.

Gan, Yanglan↗
DOE OSTI2024

On the Training and Generalization of Deep Operator Networks

Here, we present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two subnetworks, namely the branch and trunk networks. Typically, the two subnetworks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram–Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.

deep operator networks↗
DOE OSTI2023

A Comprehensive Analysis of Real-World Accelerometer Data Quality in a Global Smartphone-based Seismic Network

The proliferation of low-cost sensors in smartphones has facilitated numerous applications; however, large-scale deployments often encounter performance issues. Sensing heterogeneity, which refers to varying data quality due to factors such as device differences and user behaviors, presents a significant challenge. In this research, we perform an extensive analysis of 3-axis accelerometer data from the MyShake system, a global seismic network utilizing smartphones. We systematically evaluate the quality of approximately 22 million 3-axis acceleration waveforms from over 81 thousand smartphone devices worldwide, using metrics that represent sampling rate and noise level. We explore a broad range of factors influencing accelerometer data quality, including smartphone and accelerometer manufacturers, phone specifications (release year, RAM, battery), geolocation, and time. Our findings indicate that multiple factors affect data quality, with accelerometer model and smartphone specifications being the most critical. In addition, we examine the influence of data quality on earthquake parameter estimation and show that removing low-quality accelerometer data enhances the accuracy of earthquake magnitude estimation.

58 GEOSCIENCES↗
DOE OSTI2021

Design and Performance of a Smartphone-based Cosmic Ray Observatory

This dissertation examines the feasibility of appropriating the global network of smartphones as an observatory for ultra-high-energy cosmic rays. An application and cloud-based data-acquisition system are first proposed for such an observatory, in which heterogenous devices self-calibrate and server feedback optimizes individual device triggers. Methods of monitoring and manually controlling this network are also examined. Detection efficiencies for cosmic muons, MeV-scale gamma rays, and 120 GeV protons are then measured for this trigger, with which a Monte Carlo pixel model is fine-tuned. Extending this model to cosmic ray showers, the effective area of the observatory for super-GZK primaries is shown to equal that of the Pierre Auger Observatory with a global participation rate under 0.1%, far below initial estimates presented in Ref. [83]. A vastly improved sensitivity to photons and more precise modeling of electrons are primarily responsible for this discrepancy, though more refined models of the combinatorial background may yet lead to more stringent requirements.

Swaney, Jeff↗
DOE OSTI2025

Hybrid Quantum Networks with Discrete Polarizations and Continuous Quadrature Variables

Final Scientific/Technical Report for DOE Project DE-SC0022069. Quantum communication and computation systems have evolved along two largely independent paradigms: discrete-variable (DV) systems that encode information in qubits such as photon polarizations or photon-number states, and continuous-variable (CV) systems that encode information in optical field quadratures. Each approach offers distinct advantages—DVs provide low error rates and compatibility with single-photon platforms, while CVs support deterministic operations and efficient quantum state manipulation. A fundamental challenge for building a scalable Quantum Internet lies in interfacing these two regimes into a unified hybrid architecture that can coherently distribute and process quantum information across heterogeneous quantum nodes. This project aims to develop and demonstrate a hybrid optical quantum network that seamlessly integrates DV and CV systems. Specifically, we investigate a new class of hybrid entanglement between the discrete polarizations of single photons and the continuous quadrature variables of optical cat states, overcoming incompatibilities in existing DV–CV demonstrations. Using this new entanglement resource, the team investigates a multi-node hybrid quantum local area network (Q-LAN) testbed capable of DV–CV entanglement generation, swapping, and distribution across fiber links.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

The influence of physical and algorithmic factors on simulated far-field waveforms and source–time functions of underground explosions using unsupervised machine learning

SUMMARY Characterizing explosion sources and differentiating between earthquake and underground explosions using distributed seismic networks becomes non-trivial when explosions are detonated in cavities or heterogeneous ground material. Moreover, there is little understanding of how changes in subsurface physical properties affect the far-field waveforms we record and use to infer information about the source. Simulations of underground explosions and the resultant ground motions can be a powerful tool to systematically explore how different subsurface properties affect far-field waveform features, but there are added variables that arise from how we choose to model the explosions that can confound interpretation. To assess how both subsurface properties and algorithmic choices affect the seismic wavefield and the estimated source functions, we ran a series of 2-D axisymmetric non-linear numerical explosion experiments and wave propagation simulations that explore a wide array of parameters. We then inverted the synthetic far-field waveform data using a linear inversion scheme to estimate source–time functions (STFs) for each simulation case. We applied principal component analysis (PCA), an unsupervised machine learning method, to both the far-field waveforms and STFs to identify the most important factors that control variance in the waveform data and differences between cases. For the far-field waveforms, the largest variance occurs in the shallower radial receiver channels in the 0–50 Hz frequency band. For the STFs, both peak amplitude and rise times across different frequencies contribute to the variance. We find that the ground equation of state (i.e. lithology and rheology) and the explosion emplacement conditions (i.e. tamped versus cavity) have the greatest effect on the variance of the far-field waveforms and STFs, with the ground yield strength and fracture pressure being secondary factors. Differences in the PCA results between the far-field waveforms and STFs could possibly be due to near-field non-linearities of the source that are not accounted for in the estimation of STFs and could be associated with yield strength, fracture pressure, cavity radius and cavity shape parameters. Other algorithmic parameters are found to be less important and cause less variance in both the far-field waveforms and STFs, meaning algorithmic choices in how we model explosions are less important, which is encouraging for the further use of explosion simulations to study how physical Earth properties affect seismic waveform features and estimated STFs.

58 GEOSCIENCES↗
DOE OSTI2020

Scalable Asynchronous Domain Decomposition Solvers

We discuss how parallel implementations of linear iterative solvers generally alternate between phases of data exchange and phases of local computation. Increasingly large problem sizes and more heterogeneous compute architectures make load balancing and the design of low latency network interconnects that are able to satisfy the communication requirements of linear solvers very challenging tasks. In particular, global communication patterns such as inner products become increasingly limiting at scale. We explore the use of asynchronous communication based on one-sided Message Passing Interface primitives in the context of domain decomposition solvers. In particular, a scalable asynchronous two-level Schwarz method is presented. We discuss practical issues encountered in the development of a scalable solver and show experimental results obtained on a state-of-the-art supercomputer system that illustrate the benefits of asynchronous solvers in load balanced as well as load imbalanced scenarios. Using the novel method, we can observe speedups of up to four times over its classical synchronous equivalent.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Understanding Contaminant Migration within a Dynamic River Corridor through Field Experiments and Reactive Transport Modeling

The behavior of a persistent uranium plume within an extended river corridor at the DOE Hanford site is dominantly controlled by river stage fluctuations in the adjacent Columbia River. The plume behavior is further complicated by substantial heterogeneity in physical and geochemical properties of the host aquifer sediments. Multi-scale field and laboratory experiments and reactive transport modeling were integrated to understand the complex plume behavior influenced by highly variable hydrologic and geochemical conditions in time and space. In this paper, we (1) describe multiple data sets from field-scale uranium adsorption and desorption experiments performed at our experimental well-field, (2) develop a reactive transport model that incorporates hydrologic and geochemical heterogeneities characterized from multi-scale and multi-type datasets and a surface complexation reaction network based on laboratory studies, and (3) compare the modeling and observation results to provide insights on how to refine the conceptual model and reduce prediction uncertainties. The experimental results revealed significant spatial variability in uranium adsorption/desorption behavior, while modeling demonstrated that ambient hydrologic and geochemical conditions and heterogeneities in sediment physical and chemical properties both contributed to complex plume behavior and its persistence. This research underscores the great challenges in adequately characterizing this type of site to model the reactive transport processes over scales of 10 m or more. Our analysis provides important insights into the characterization, understanding, modeling, and remediation of groundwater contaminant plumes influenced by dynamic surface water and groundwater interactions.

Chen, Xingyuan↗
DOE OSTI2026

Effects of Dissolution Regimes on Flow Channelization and Solute Transport in 3D Fracture Networks: Insights From Graph‐Based Reactive Transport Modeling

We investigate how mineral dissolution reshapes flow pathways and solute transport in three‐dimensional discrete fracture networks using a computationally efficient graph‐based reactive transport model. The DFNs are inspired by field‐site observations of fractured carbonate and represent realistic connectivity and structural heterogeneity. Flow is simulated with the Reynolds equation, and dissolution follows first‐order kinetics with diffusive limitations captured through an effective mass‐transfer coefficient. By systematically varying two key dimensionless parameters, the effective Damköhler number (Da), governing reaction versus advection rates, and a transport parameter (Da), analogous to the Thiele modulus, distinct flow channelization regimes emerge: mildly channelized at low G, highly channelized at intermediate Da, and extreme wormhole formation at high Da and low G. Eulerian and Lagrangian analyses, including breakthrough curves, particle tortuosity, dispersivity, and flow channeling indicators quantitatively characterize the progression of dissolution‐driven network restructuring. Across all regimes, initial fracture heterogeneity persists. The results underscore how the interplay between this initial structure, advection, reaction, and diffusion critically shapes subsurface flow pathways, with implications for applications ranging from groundwater remediation to enhanced geothermal systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Cyber-Secure and Safe Operation of Solar Photovoltaic Power Distribution Systems

Solar photovoltaic (PV)-rich power distribution systems are networked Cyber-Physical Systems (CPS). These are control systems where multiple computing nodes and diverse intelligent agents interact with the physical world in real-time. However, the presence of networked components renders them vulnerable to potential cyber-attacks, cyber-intrusions, and other malicious events. This is because these systems depend on the measurements reported from their heterogeneous sensors. This makes them vulnerable to potential cyber-attacks where malicious agents can compromise the sensors or the communication networks carrying the sensor measurements. This paper proposes a novel methodology for enhancing the cyber-security and cyber-resilient post-attack safe operation of solar PV-rich power distribution systems against potential cyber-attacks through the Dynamic Watermarking (DW), using online system identification. The resiliency of the proposed technique is tested and validated with several attack scenarios on both a lab-scale 3kW grid-connected PV inverter and a Hardware-in-the-Loop (HiL) system. The proposed approach can be applied to other types of power distribution systems to enhance their cyber-secure and cyber-resilient safe operation. This paper thereby contributes to the field of cyber-security of Cyber-Physical Energy Systems (CPES).

Kim, Jaewon↗
DOE OSTI2024

The dynamics and stratigraphy of distributary channel networks (Final Technical Report)

Sedimentary reservoirs are frequently composed of the deposits of distributary channel networks. These networks are associated with coarse sediments (and high permeability) within the channel network, and relatively fine sediments (and low permeability) outside the channel network. The shape of the network is complex, and a product of the environmental boundary conditions under which it grows (Figure 1). These systems control heterogeneity at small and large scales within sedimentary basins, and understanding this heterogeneity and the links between scales represents the important scientific frontier addressed by this project.

58 GEOSCIENCES↗
DOE OSTI2024

Network-level encoding of local neurotransmitters in cortical astrocytes

Abstract Astrocytes, the most abundant non-neuronal cell type in the mammalian brain, are crucial circuit components that respond to and modulate neuronal activity through calcium (Ca 2+ ) signalling 1–7 . Astrocyte Ca 2+ activity is highly heterogeneous and occurs across multiple spatiotemporal scales—from fast, subcellular activity 3,4 to slow, synchronized activity across connected astrocyte networks 8–10 —to influence many processes 5,7,11 . However, the inputs that drive astrocyte network dynamics remain unclear. Here we used ex vivo and in vivo two-photon astrocyte imaging while mimicking neuronal neurotransmitter inputs at multiple spatiotemporal scales. We find that brief, subcellular inputs of GABA and glutamate lead to widespread, long-lasting astrocyte Ca 2+ responses beyond an individual stimulated cell. Further, we find that a key subset of Ca 2+ activity—propagative activity—differentiates astrocyte network responses to these two main neurotransmitters, and may influence responses to future inputs. Together, our results demonstrate that local, transient neurotransmitter inputs are encoded by broad cortical astrocyte networks over a minutes-long time course, contributing to accumulating evidence that substantial astrocyte–neuron communication occurs across slow, network-level spatiotemporal scales 12–14 . These findings will enable future studies to investigate the link between specific astrocyte Ca 2+ activity and specific functional outputs, which could build a consistent framework for astrocytic modulation of neuronal activity.

Science & Technology - Other Topics↗
DOE OSTI2025

Resolving three-dimensional nanoscale heterogeneities in lithium metal batteries with cryoelectron tomography

Current direct observation of sensitive battery materials and interfaces primarily relies on two-dimensional (2D) imaging, leaving out their three-dimensional (3D) relationship. Here, in this study, we used cryoelectron tomography (cryo-ET) to visualize the lithium metal anode in 3D at nanometer resolution and cryoelectron microscopy (cryo-EM) to reveal atomic details in local regions. We imaged both freshly prepared and calendar-aged Li metal anodes to reveal the development of LiH in Li dendrites and the Li-LiH interface, as well as the development of the solid-electrolyte interphase (SEI). Using a convolutional neural network-based technique, the 3D arrangement of Li metal, along with nanoscale LiH and Cu heterogeneities in dendrites, was visualized and annotated. In longer-term calendar aging, we observed more substantial LiH growth accompanied by extended SEI growth. Our results show that the growth of LiH and the extended SEI during battery calendar aging are temporally and spatially separate processes.

LiH↗
DOE OSTI2021

Understanding Reaction Networks through Controlled Approach to Equilibrium Experiments Using Transient Methods

We report a combined experimental/theoretical approach to studying heterogeneous gas/solid catalytic processes using low-pressure pulse response experiments achieving a controlled approach to equilibrium that combined with quantum mechanics (QM)-based computational analysis provides information needed to reconstruct the role of the different surface reaction steps. We demonstrate this approach using model catalysts for ammonia synthesis/decomposition. Polycrystalline iron and cobalt are studied via low-pressure TAP (temporal analysis of products) pulse response, with the results interpreted through reaction free energies calculated using QM on Fe-BCC(110), Fe-BCC(111), and Co-FCC(111) facets. In TAP experiments, simultaneous pulsing of ammonia and deuterium creates a condition where the participation of reactants and products can be distinguished in both forward and reverse reaction steps. This establishes a balance between competitive reactions for D* surface species that is used to observe the influence of steps leading to nitrogen formation as the nitrogen product remains far from equilibrium. Here, the approach to equilibrium is further controlled by introducing delay timing between NH 3 and D 2 which allows time for surface reactions to evolve before being driven in the reverse direction from the gas phase. The resulting isotopic product distributions for NH 2 D, NHD 2 , and HD at different temperatures and delay times and NH 3 /D 2 pulsing order reveal the role of the N 2 formation barrier in controlling the surface concentration of NH x * species, as well as providing information on the surface lifetimes of key reaction intermediates. Conclusions derived for monometallic materials are used to interpret experimental results on a more complex and active CoFe bimetallic catalyst.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2018

Method and System for Name Resolution Across Heterogeneous Architectures

One embodiment of the present invention provides a system for resolving a name request in a network comprising a plurality of groups that use different name-resolution schemes. During operation, the system receives, at a first group, the name request; identifies a parent group of the first group, which is a member of the parent group; and in response to failing to resolve the name request within the first group, forwards the name request to the identified parent group.

Sevilla, Spencer↗
DOE OSTI2020

Deciphering a Reaction Network for the Switchable Production of Tetrahydroquinoline or Quinoline with MOF-Supported Pd Tandem Catalysts

A mechanistic study of heterogeneous tandem catalytic systems is crucial for understanding and improving catalyst activity and selectivity but remains challenging. Here, we demonstrate that a thorough mechanistic study of a multistep reaction can guide us to the controllable selective synthesis of phenyltetrahydroquinoline or phenylquinoline with easily accessible precursors. The one-pot production can be achieved, catalyzed by a well-defined, bifunctional metal–organic framework-supported Pd nanoparticles, with only water as the side product. Our mechanistic study identifies six transient intermediates and ten transformation steps from the operando magic angle spinning nuclear magnetic resonance study under 27.6 bar H 2 . In particular, reactive intermediate 2-phenyl-3,4-dihydroquinoline cannot be observed with conventional chromatographic techniques but is found to reach the maximal concentration of 0.11 mol L –1 under the operando condition. The most probable reaction network is further deduced based on the kinetic information of reaction species, obtained from both operando and ex situ reaction studies. This deep understanding of the complex reaction network enables the kinetic control of the conversions of key intermediate, 2-phenyl-3,4-dihydroquinoline, with the addition of a homogeneous co-catalyst, allowing the selective production of tetrahydroquinoline or quinoline on demand. Finally, the demonstrated methods in this work open up new avenues toward efficient modulation of reactions with a complex network to achieve desired selectivities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Cross-Feature Transfer Learning for Efficient Tensor Program Generation

Tuning tensor program generation involves navigating a vast search space to find optimal program transformations and measurements for a program on the target hardware. The complexity of this process is further amplified by the exponential combinations of transformations, especially in heterogeneous environments. This research addresses these challenges by introducing a novel approach that learns the joint neural network and hardware features space, facilitating knowledge transfer to new, unseen target hardware. A comprehensive analysis is conducted on the existing state-of-the-art dataset, TenSet, including a thorough examination of test split strategies and the proposal of methodologies for dataset pruning. Leveraging an attention-inspired technique, we tailor the tuning of tensor programs to embed both neural network and hardware-specific features. Notably, our approach substantially reduces the dataset size by up to 53% compared to the baseline without compromising Pairwise Comparison Accuracy (PCA). Furthermore, our proposed methodology demonstrates competitive or improved mean inference times with only 25–40% of the baseline tuning time across various networks and target hardware. The attention-based tuner can effectively utilize schedules learned from previous hardware program measurements to optimize tensor program tuning on previously unseen hardware, achieving a top-5 accuracy exceeding 90%. This research introduces a significant advancement in autotuning tensor program generation, addressing the complexities associated with heterogeneous environments and showcasing promising results regarding efficiency and accuracy.

97 MATHEMATICS AND COMPUTING↗