Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “heterogeneous networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

NuGraph2: A Graph Neural Network for Neutrino Event Reconstruction

Neutrino experiments are set to probe some of the most important open questions in physics, from CP violation and the nature of dark matter. The technology of choice for many of these experiments is the liquid argon time projection chamber (LArTPC). In current LArTPC experiments, reconstruction performance often represents a limiting factor for the sensitivity. New developments are therefore needed to unlock the full potential of LArTPC experiments. NuGraph2 is a state of the art Graph Neural Network for reconstruction of data in LArTPC experiments [https://arxiv.org/abs/2403.11872]. NuGraph2 utilizes a heterogeneous graph structure, with separate subgraphs of 2D nodes (hits in each plane) connected across planes via 3D nodes (space points). The model provides a consistent description of the neutrino interaction across all planes. NuGraph2 is a multi-purpose network, with a common message-passing attention engine connected to multiple decoders with different classification or regression tasks. These include the classification of detector hits according to the particle type that produced them (semantic segmentation) and the separation of hits from the neutrino interaction from hits due to noise or cosmic-ray background. Additional decoders are being developed, performing tasks such as the regression of the neutrino interaction vertex position. Performance results will be presented based on publicly available samples from MicroBooNE. These include both physics performance metrics, achieving 95% accuracy for semantic segmentation and 98% classification of neutrino hits, as well as computational metrics for training and for inference on CPU or GPU. The status of the NuGraph integration in the LArSoft software framework will be presented, as well as initial studies about model interpretability and injection of domain knowledge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A dynamic solvent chamber propagation estimation framework using RNN for warm solvent injection in heterogeneous reservoirs

Warm solvent injection (WSI), injecting low-temperature solvent into formations to reduce the viscosity of heavy oil, is a clean technology for heavy oil production through reducing greenhouse gas emissions and water usage. The success of WSI operation depends on the uniform development and propagation of solvent chambers in reservoirs. However, reservoir heterogeneity stemming from shale barriers plays a detrimental role in the conformance of solvent chamber development and oil production rate. In this work, we developed a novel recurrent neural network (RNN)-based framework with the capability of efficiently tracking and estimating the solvent chamber positions in heterogeneous reservoirs based on only production time-series data. The developed estimation model utilizes the “sequence-to-sequence" mapping methodology to correlate observed production time-series sequence and solvent chamber edge sequence via a long short-term memory (LSTM) algorithm. The trained RNN models exhibit high accuracy, evidenced by the predicted dynamic solvent chamber locations match the corresponding true locations from numerical simulation, with a high coefficient of determination (R 2 ) and a low mean squared error. Specifically, the achieved R 2 values exceed 0.98 on both the training and testing data. The developed RNN-based workflow was tested via several cases from both regularly- and irregularly-shaped shale barriers, and the results were promising. The predicted solvent chambers showed strong agreement with those obtained from numerical simulations. The major benefits of this workflow include reducing computational time and saving overall monitoring and tracking costs for conventional techniques. In conclusion, the present work would provide a good demonstration of the capability of practical integration of machine learning methods in solving engineering problems.

58 GEOSCIENCES↗

Identifying the Community Structure of the Food-Trade International Multi-Network

Achieving international food security requires improved understanding of how international trade networks connect countries around the world through the import-export flows of food commodities. The properties of international food trade networks are still poorly documented, especially from a multi-network perspective. In particular, nothing is known about the multi-network's community structure. Here we find that the individual crop-specific layers of the multi-network have densely connected trading groups, a consistent characteristic over the period 2001-2011. Further, the multi-network is characterized by low variability over this period but with substantial heterogeneity across layers in each year. In particular, the layers are mostly assortative: more-intensively connected countries tend to import from and export to countries that are themselves more connected. We also fit econometric models to identify social, economic and geographic factors explaining the probability that any two countries are co-present in the same community. Our estimates indicate that the probability of country pairs belonging to the same food trade community depends more on geopolitical and economic factors-such as geographical proximity and trade-agreement co-membership-than on country economic size and/or income. These community-structure findings of the multi-network are especially valuable for efforts to understand past and emerging dynamics in the global food system, especially those that examine potential 'shocks' to global food trade.

complex networks↗

Permeability Prediction Using Vision Transformers

Accurate permeability predictions remain pivotal for understanding fluid flow in porous media, influencing crucial operations across petroleum engineering, hydrogeology, and related fields. Traditional approaches, while robust, often grapple with the inherent heterogeneity of reservoir rocks. With the advent of deep learning, convolutional neural networks (CNNs) have emerged as potent tools in image-based permeability estimation, capitalizing on micro-CT scans and digital rock imagery. This paper introduces a novel paradigm, employing vision transformers (ViTs)—a recent advancement in computer vision—for this crucial task. ViTs, which segment images into fixed-sized patches and process them through transformer architectures, present a promising alternative to CNNs. We present a methodology for implementing ViTs for permeability prediction, its results on diverse rock samples, and a comparison against conventional CNNs. The prediction results suggest that, with adequate training data, ViTs can match or surpass the predictive accuracy of CNNs, especially in rocks exhibiting significant heterogeneity. This study underscores the potential of ViTs as an innovative tool in permeability prediction, paving the way for further research and integration into mainstream reservoir characterization workflows.

58 GEOSCIENCES↗

Active Site Engineering via Optimizing the Heterogeneous Support Structure for Single-Atom Catalysis

Supported single-atom catalysts show a large range of activities and selectivities that depend on the local environment of the catalytic sites. Here a theory-based optimization strategy is presented that is based on a density functional theory determination of the transition states and intermediates for a low-dimensional coordinate representation of the heterogeneity of the active sites. The approach is applied to a vanadium catalyst on an amorphous SiO 2 support that involves a large kinetic network described using a full chemistry model. Without assuming a priori scaling relations or mechanism reduction, the optimal state of heterogeneity is found to lie at atomic configurations where the activation energies for two distinct key chemical processes are equal. It is found a posteriori that the behavior of the system is consistent with linear free energy scaling relations in the randomness parameters. The energetic span theory proves quite useful in reducing the full chemistry model to a small number of key reactions. The use of a nonlinear optimization algorithm in combination with energetic span theory provides significant simplification in treating disordered systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

It's a Sooty Problem: Black Carbon and Aerosols from Space

Our knowledge of atmospheric aerosols (smoke, pollution, dust or sea salt particles, small enough to be suspended in the air), their evolution, composition, variability in space and time and interaction with solar radiation, clouds and precipitation is lacking despite decades of research. Just recently we recognized that understanding the global aerosol system is fundamental for progress in climate change and hydrological cycle research. While a single instrument was used to demonstrate 50 yrs ago that the global CO2 levels are rising, posing thread to our climate, we need an may of satellites, surface networks of radiometers, elaborated laboratory and field experiments coupled with chemical transport models to understand the global aerosol system. This complexity of the aerosol problem results from their short lifetime (1 week), variability of the chemical composition and complex chemical and physical processes in the atmosphere. The result is a heterogeneous distribution of aerosol and their properties. The new generation of satellites and surface networks of radiometers provides exciting opportunities to measure the aerosol properties and their interaction with clouds and climate. However farther development in the satellite capability, aerosol chemical models and climate models is needed to fully decipher the aerosol secrets with accuracy required to predict future climates.

Kaufman, Yoram J.↗

Towards POI-based large-scale land use modeling: spatial scale, semantic granularity, and geographic context

The combination of spatial distribution, semantic characteristics, and sometimes temporal dynamics of POIs inside a geographic region can capture its unique land use characteristics. Most previous studies on POI-based land use modeling research focused on one geographic region and select one spatial scale and semantic granularity for land use characterization. There is a lack of understanding on the impact of spatial scale, semantic granularity, and geographic context on POI-based land use modeling, particularly large-scale land use modeling. In this study, we developed a scalable POI-based land use modeling framework and examined the impact of these three factors on POI-based land use characterization using data from three geographic regions. We developed a unified semantic representation framework for POI semantics that can help fuse heterogeneous POI data sources. Then, by combining POIs with a neural network language model, we developed a spatially explicit approach to learn the embedding representation of POIs and AOIs. We trained multiple supervised classifiers using AOI embeddings as input features to predict AOI land use at different semantic granularities. The classification performance of different land use classes was analyzed and compared across three geographic regions to identify the semantic representativeness of POI-based AOI embedding and the impact of geographic context.

58 GEOSCIENCES↗

Stochastic simulations of temporally and spatially variable Fe cycling within a floodplain aquifer

This data package contains model input and output files for local and global sensitivity analysis (SA) of a reactive transport model simulating redox cycling within a floodplain aquifer. The reaction network is implemented in CrunchFlow and focuses on spatially and temporally heterogeneous Fe cycling, though it contains several other species and redox pathways (37 aqueous species and 7 minerals in total). The package contains data from 600 Monte Carlo simulations (for global SA) and 104 one-at-a-time simulations (for local SA). It includes all input files required to run the CrunchFlow model, as well as limited model output – .csv files containing time series of primary species concentrations at 21 grid cells within the domain. These time series files contain the following species: H+, CO32-, SO42-, Cl-, Ca2+, Mg2+, Na+, K+, Fe(II), Fe(III), HS-, CH3COO-, O2(aq), S(aq), and Br-.These data were used to demonstrate the application of a novel form of global SA, distance-based generalized sensitivity analysis (DGSA) to a reactive transport model. The 2D model simulates the export of reduced species from pockets of fine-grained, organic-rich sediments embedded in a coarse sand aquifer. Stochastic simulations jointly varied 17 key model input parameters across several orders of magnitude, including the spatial variability of each parameter. DGSA on the model results reveal that the amplitude and variability of exported Fe(II) are most sensitive to the interaction between sand permeability and individual reaction rates. By contrast, the propagation of reducing conditions downgradient from the fine-grained lenses depends most heavily on the rate of dissolved organic carbon and sulfate release from the fines.

54 ENVIRONMENTAL SCIENCES↗

Multiscale Cryo Electron Microscopy Reveals Interfacial Degradation and Stabilization in Battery Electrodes

Electrochemical interfaces are dynamic systems, evolving based on their local environment and reactant surface structures. The electrode-electrolyte interface in Li-ion batteries can be protective, limiting parasitic reactions with the electrolyte to passivate the surface [1]. Additionally, this interphase has an impact on the Li-ion transport through that layer based on its composition, bonding environment, and thickness. These parameters are challenging to collect and may vary depending on the electrode surface site investigated relative to its spatial position in a coin cell. This study will detail a multiscale cryogenic electron microscopy approach where millimeter-scale cross-sections through the coin cell batteries were made using a cryogenic stage within a fs-laser plasma focused ion beam (laser PFIB) with complementary energy dispersive X-ray spectroscopy able to detect variations in the composition at electrode interfaces [2]. Microscale cross-sectioning and lamella sample preparation of battery electrodes was conducted at the Center for Integrated Nanotechnologies using a Ga-ion focused ion beam (FIB) with air-free and cryo-transfer [3], followed by nanoscale mapping of composition and bonding within the CEI through cryo-scanning transmission electron microscopy (cryo-STEM) electron energy loss spectroscopy [4]. This multiscale approach enabled identification of millimeter-scale features of a battery stack with visualization of degradation in electrodes such as cracks in cathode particles, gas evolution, and SEI evolution; microscale interfacial characteristics, such as heterogeneity in the SEI or barrier layer and identification of electrolyte networks to the electrode surfaces; and nanoscale measurement of the CEI thickness, mapping of transition metal bonding within the cathode particles to identify loss of active materials, and identification of beneficial electrolyte additives incorporated into the CEI structure. This multiscale approach allows for a statistical understanding of the primary mechanisms and parasitic degradation pathways that impact performance by limiting the ion transport pathways within Li+ batteries.

36 MATERIALS SCIENCE↗

A global distributed storage architecture

NSA architects and planners have come to realize that to gain the maximum benefit from, and keep pace with, emerging technologies, we must move to a radically different computing architecture. The compute complex of the future will be a distributed heterogeneous environment, where, to a much greater extent than today, network-based services are invoked to obtain resources. Among the rewards of implementing the services-based view are that it insulates the user from much of the complexity of our multi-platform, networked, computer and storage environment and hides its diverse underlying implementation details. In this paper, we will describe one of the fundamental services being built in our envisioned infrastructure; a global, distributed archive with near-real-time access characteristics. Our approach for adapting mass storage services to this infrastructure will become clear as the service is discussed.

Lionikis, Nemo M.↗

Coupling of Lipid Peroxidation and Criegee Intermediate Mediated Autoxidation in the Heterogeneous Oxidation of Linoleic Acid Aerosols

Autoxidation is an established mechanism for the degradation of organic molecules, which is relevant in the atmosphere, combustion processes, the environment, and the rancidification of lipids (commonly known as lipid peroxidation). Autoxidation proceeds via radical chain reactions involving hydroxyl (•OH), peroxy (RO2•), and alkoxy radicals, which are also prominent oxidants in the atmosphere. Recent reports have provided evidence for an alternative autoxidation mechanism driven instead by Criegee intermediates (CIs), which are produced from the reaction of β-hydroxy peroxy radicals (β-OH-RO2•). This work evaluates the contributions of these two mechanisms in the •OH initiated heterogeneous oxidation of linoleic acid (LA) aerosols. Reaction kinetics and product distributions are monitored using a vacuum ultraviolet photoionization aerosol time-of-flight mass spectrometer. To explain the observed kinetics, a kinetic model is developed that incorporates both the conventional peroxidation and alternative CI-mediated autoxidation mechanisms. We observe that the CI-mediated autoxidation pathways enhance the heterogeneous autoxidation rate, while the peroxidation reactions, although present, contributes less to the overall oxidation rate. α-Acyloxyalkyl hydroperoxides (AAHPs) are identified as key indicators for bimolecular reactions of CI with LA, highlighting the role of LA as a CI scavenger. Moreover, the measured functionalized LA products with hydroxyl or carbonyl group(s), serve as markers for the peroxidation reactions. In summary, this work presents a quantitative framework to understand the coupled reaction network of •OH, RO2•, β-OH-RO2• radicals, and CI in driving heterogeneous autoxidation, which is crucial for understanding degradation mechanisms of organic molecules in the environment and atmosphere.

Criegee intermediate↗

Graph Partitioning for Parallel Applications in Heterogeneous Grid Environments

The problem of partitioning irregular graphs and meshes for parallel computations on homogeneous systems has been extensively studied. However, these partitioning schemes fail when the target system architecture exhibits heterogeneity in resource characteristics. With the emergence of technologies such as the Grid, it is imperative to study the partitioning problem taking into consideration the differing capabilities of such distributed heterogeneous systems. In our model, the heterogeneous system consists of processors with varying processing power and an underlying non-uniform communication network. We present in this paper a novel multilevel partitioning scheme for irregular graphs and meshes, that takes into account issues pertinent to Grid computing environments. Our partitioning algorithm, called MiniMax, generates and maps partitions onto a heterogeneous system with the objective of minimizing the maximum execution time of the parallel distributed application. For experimental performance study, we have considered both a realistic mesh problem from NASA as well as synthetic workloads. Simulation results demonstrate that MiniMax generates high quality partitions for various classes of applications targeted for parallel execution in a distributed heterogeneous environment.

Bisws, Rupak↗

Street-level temperature estimation using graph neural networks: Performance, feature embedding and interpretability

Estimating street-level air temperature is a challenging task due to the highly heterogeneous urban surfaces, canyon-like street morphology, and the diverse physical processes in the built environment. Though pioneering studies have embarked on investigations via data-driven approaches, many questions remain to be answered. Here, in this study, we leveraged an innovative framework and redefined the street-level temperature estimation problem using Graph Neural Networks (GNN) with spatial embedding techniques. The results showed that GNN models are more capable and consistent of estimating street-level temperature among tested locations, benefiting from its unique strength in handling extensive data over unstructured graph topology. In addition, we conducted in-depth analysis of feature importance to enhance the model interpretability. Among the urban features analyzed in this study, the time-variant canopy density and meter-level land use data emerge as crucial factors. Our findings highlight GNN 's high potential in capturing the complex dynamics between urban elements and their impacts on microclimate, thus offering valuable insights for comprehensive urban data collection and urban climate modeling in general. Collectively, this study also contributes to urban planning and policy by providing avenues to enhance city resilience against climate change, thereby advancing the agenda for environmental stewardship and urban sustainability.

54 ENVIRONMENTAL SCIENCES↗

Optimal service allocation among two heterogeneous traffic types with no queueing

Two communication traffic streams with Poisson statistics arrive at a network node. These are to be transmitted across a channel with a total bandwidth capacity of C slots. Messages not accepted at the node are assumed to be lost. Under the assumptions of exponential service time distributions, the problem of dynamic allocation of available channel bandwidth among the two traffic types is studied in order to minimize a weighted sum of blocking probabilities. Modeling the system as a two-dimensional Markov chain is studied to minimize a weighted sum of blocking probabilities. Modeling the system as a two-dimensional Markov chain, it is shown by an application of dynamic programming principles that the optimal policy has the form of a 'switching curve'.

Lambadaris, I.↗

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE↗

HGQ: High Granularity Quantization for Real-time Neural Networks on FPGAs

Neural networks with sub-microsecond inference latency are required by many critical applications. Targeting such applications deployed on FPGAs, we present High Granularity Quantization (HGQ), a quantization-aware training framework that optimizes parameter bit-widths through gradient descent. Unlike conventional methods, HGQ determines the optimal bit-width for each parameter independently, making it suitable for hardware platforms supporting heterogeneous arbitrary precision arithmetic. In our experiments, HGQ shows superior performance compared to existing network compression methods, achieving orders of magnitude reduction in resource consumption and latency while maintaining the accuracy on several benchmark tasks. These improvements enable the deployment of complex models previously infeasible due to resource or latency constraints. HGQ is open-source and is used for developing next-generation trigger systems at the CERN ATLAS and CMS experiments for particle physics, enabling the use of advanced machine learning models for real-time data selection with sub-microsecond latency.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep Learning Method for Detecting Precursors to Adverse Events

With the recent advancements in Deep Learning methods, the ability to model large complex heterogeneous data sets are fundamentally changing industry and research. Coupled with hardware improvements, and ease of implementation, a wide variety of deep neural network architectures can quickly be developed to solve a sweeping range of problems such as: object detection in images, automatic healthcare diagnosis using heterogenous data sources, real time language translating and sentence prediction, upscaling low resolution images, and forecasting of multivariate timeseries. Generally, many of these architectures outperform classical machine learning approaches in their respective tasks, however, this typically comes at a cost of interpretability. These black box algorithms generally suffer from lack of transparency in both model complexity as well as the rationale behind the prediction. This lack of comprehension, is driving an emerging area of interest in “Explainable AI”. An algorithm called: “Deep Temporal Multiple Instance Learning”1 was a recently developed to identify precursors to adverse events and has been applied in the aviation domain. The deep learning architecture is designed to capture the evolution of the probability of the outcome over the time preceding the adverse event using a multiple instance learning approach as illustrated in Figure 1. Precursors are defined when the probability of the event has exceeded a threshold at some point in the timeseries, at which point, a sensitivity analysis is performed to determine contributing factors. The contributing factors are used to explain and define the precursor during the periods where the probability score is high. The identified contributing factors are then presented to subject matter experts to provide objective insights into the leading factors associated with the particular adverse event. The algorithm has been tested on flight data from a commercial airline and has the ability to discover precursors to known adverse events that take the form of safety critical operations, such as unstable approach events on final approach. Apart from detecting precursors to adverse events, the converse can also be leveraged to discover corrective actions. These positive actions manifest themselves as periods in the timeseries when the precursor score has been lowered from an elevated state; meaning that if the system had been left uncorrected, it would have eventually reached the adverse event state. Characterizing these state changes can help identify successful interventions that may not have been known before. Policy makers and procedure designers can use this additional knowledge to craft more safety and efficient resilient procedures for future operations and therefore improve the overall performance of the National Airspace.

Matthews, Bryan L.↗

Electrical Load Forecasting Over Multihop Smart Metering Networks With Federated Learning

Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) record household energy data. Traditional machine learning (ML) methods are often employed for load forecasting, but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. Here, this article presents a novel personalized FL (PFL) method for high-quality load forecasting in metering networks. A meta-learning-based strategy is developed to address data heterogeneity at local SMs in the collaborative training of local load forecasting models. Moreover, to minimize the load forecasting delays in our PFL model, we study a new latency optimization problem based on optimal resource allocation at SMs. A theoretical convergence analysis is also conducted to provide insights into FL design for federated load forecasting. Extensive simulations from real-world datasets show that our method outperforms existing approaches regarding better load forecasting and reduced operational latency costs.

Rahman, Ratun [Univ. of Alabama, Huntsville, AL (U↗