SEARCH · Engineering Papers

Results for “Complex Network Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Non-Intrusive Appliance Identification with Appliance-Specific Networks

The problem of noninstrusive load monitoring (NILM) is usually formulated as a single-channel blind source separation task, whose successful solution enable fast and convenient load identification and energy disaggregation. When applied at test time, NILM algorithms aim to identify the operating characteristics of individual appliances from an aggregate power measurement of the entire house. Recent advances in deep learning gave rise to many methods that mostly focus on learning a direct mapping from aggregate measurement to individual appliance power. However, these methods are not only computationally expensive, but they often suffer from overfitting and do not generalize very well. In this article, we propose a novel NILM method that leverages advances in statistical learning that have not been properly applied in this domain before. The proposed method consists of three stages: first, a Bayesian nonparametric learning-based approach for appliance state extraction; second, synthetic minority oversampling technique for data augmentation and mitigating the heavy imbalance in switching events; and third, appliance-specific lightweight long short-term memory networks for status classification for each appliance. Here, we adopt a “differential” input (the difference before and after the switching event) to reduce the complexity of network training and make the proposed method robust to multiappliance switching events. Experiments are conducted to demonstrate the effectiveness of the proposed method, achieving superior performance when compared to recent methods. An ablation study is conducted to demonstrate the effectiveness of each module of our method. Finally, we investigate the quality of generated synthetic samples.

42 ENGINEERING↗

DOE OSTI2025

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Graph learning for particle accelerator operations

Particle accelerators play a crucial role in scientific research, enabling the study of fundamental physics and materials science, as well as having important medical applications. This study proposes a novel graph learning approach to classify operational beamline configurations as good or bad. By considering the relationships among beamline elements, we transform data from components into a heterogeneous graph. We propose to learn from historical, unlabeled data via our self-supervised training strategy along with fine-tuning on a smaller, labeled dataset. Additionally, we extract a low-dimensional representation from each configuration that can be visualized in two dimensions. Leveraging our ability for classification, we map out regions of the low-dimensional latent space characterized by good and bad configurations, which in turn can provide valuable feedback to operators. This research demonstrates a paradigm shift in how complex, many-dimensional data from beamlines can be analyzed and leveraged for accelerator operations.

43 PARTICLE ACCELERATORS↗

DOE OSTI2020

Understanding Contaminant Migration within a Dynamic River Corridor through Field Experiments and Reactive Transport Modeling

The behavior of a persistent uranium plume within an extended river corridor at the DOE Hanford site is dominantly controlled by river stage fluctuations in the adjacent Columbia River. The plume behavior is further complicated by substantial heterogeneity in physical and geochemical properties of the host aquifer sediments. Multi-scale field and laboratory experiments and reactive transport modeling were integrated to understand the complex plume behavior influenced by highly variable hydrologic and geochemical conditions in time and space. In this paper, we (1) describe multiple data sets from field-scale uranium adsorption and desorption experiments performed at our experimental well-field, (2) develop a reactive transport model that incorporates hydrologic and geochemical heterogeneities characterized from multi-scale and multi-type datasets and a surface complexation reaction network based on laboratory studies, and (3) compare the modeling and observation results to provide insights on how to refine the conceptual model and reduce prediction uncertainties. The experimental results revealed significant spatial variability in uranium adsorption/desorption behavior, while modeling demonstrated that ambient hydrologic and geochemical conditions and heterogeneities in sediment physical and chemical properties both contributed to complex plume behavior and its persistence. This research underscores the great challenges in adequately characterizing this type of site to model the reactive transport processes over scales of 10 m or more. Our analysis provides important insights into the characterization, understanding, modeling, and remediation of groundwater contaminant plumes influenced by dynamic surface water and groundwater interactions.

Chen, Xingyuan↗

DOE OSTI2020

PersGNN: Applying Topological Data Analysis and Geometric Deep Learning to Structure-Based Protein Function Prediction

Understanding protein structure-function relationships is a key challenge in computational biology, with applications across the biotechnology and pharmaceutical industries. While it is known that protein structure directly impacts protein function, many functional prediction tasks use only protein sequence. In this work, we isolate protein structure to make functional annotations for proteins in the Protein Data Bank in order to study the expressiveness of different structure-based prediction schemes. We present PersGNN - an end-to-end trainable deep learning model that combines graph representation learning with topological data analysis to capture a complex set of both local and global structural features. While variations of these techniques have been successfully applied to proteins before, we demonstrate that our hybridized approach, PersGNN, outperforms either method on its own as well as a baseline neural network that learns from the same information. PersGNN achieves a 9.3% boost in area under the precision recall curve (AUPR) compared to the best individual model, as well as high F1 scores across different gene ontology categories, indicating the transferability of this approach.

Swenson, Nicolas↗

DOE OSTI2025

Hierarchical Resilience Planning for Networked Microgrids: A Case Study of Puerto Rico

Microgrids can be designed to enhance the energy resilience of communities and critical infrastructures, such as hospitals, data centers, and communication networks, which are vulnerable to frequent weather-related disruption. Coordinating multiple microgrids in a network can leverage the geographical diversity of load and generation resources while enabling resilient and cost-effective planning of the distribution system. Designing a networked microgrid is complex, involving intricate technical assessment, cost-benefit analysis, site-specific requirements, and the evaluation of existing resources. Therefore, this paper proposes a hierarchical resilience planning framework and performs an extensive techno-economic analysis for the design of a networked microgrid. Hierarchical resilience planning involves technology sizing at an individual community level to meet the critical load and satisfy resilience criteria, and resource optimization at networked microgrid level to provide a higher level of resilience and energy adequacy. A real-world case of Puerto Rico's cooperative microgrid “Microrred de la Montaña” is investigated considering localized electricity tariffs, site-specific demand profiles, solar generation, and existing hydro resources. Multiple optimization scenarios are developed based on the resiliency requirement to estimate the capacity of solar photovoltaic and battery energy storage (BES) to be installed at each substation. The results provide the optimal sizing for individual community and networked microgrid to withstand 1day and 3-day outages along with the criteria for critical load.

13 - HYDRO ENERGY↗

DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Street-level temperature estimation using graph neural networks: Performance, feature embedding and interpretability

Estimating street-level air temperature is a challenging task due to the highly heterogeneous urban surfaces, canyon-like street morphology, and the diverse physical processes in the built environment. Though pioneering studies have embarked on investigations via data-driven approaches, many questions remain to be answered. Here, in this study, we leveraged an innovative framework and redefined the street-level temperature estimation problem using Graph Neural Networks (GNN) with spatial embedding techniques. The results showed that GNN models are more capable and consistent of estimating street-level temperature among tested locations, benefiting from its unique strength in handling extensive data over unstructured graph topology. In addition, we conducted in-depth analysis of feature importance to enhance the model interpretability. Among the urban features analyzed in this study, the time-variant canopy density and meter-level land use data emerge as crucial factors. Our findings highlight GNN 's high potential in capturing the complex dynamics between urban elements and their impacts on microclimate, thus offering valuable insights for comprehensive urban data collection and urban climate modeling in general. Collectively, this study also contributes to urban planning and policy by providing avenues to enhance city resilience against climate change, thereby advancing the agenda for environmental stewardship and urban sustainability.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Identifying Sample Provenance From SEM/EDS Automated Particle Analysis via Few-Shot Learning Coupled With Similarity Graph Clustering

Automated particle analysis (APA) provides a vast amount of compositional data via energy-dispersive X-ray spectroscopy along with size and shape data via scanning electron microscopy for individual particles in a sample. In many instances, APA data are leveraged to support identification of the source of a sample based on the detection of particles of a specific composition. Often, the particles that provide context make up a minuscule portion of the sample. Additionally, the interpretation of complex samples can be difficult due to the diversity of compositions both in the mixture and within a particle. In this work, we demonstrate a method to compute and cluster similarity graphs that describe inter-particle relationships within a sample using a multi-modal few-shot learning neural network. Here, as a proof-of-concept, we show that samples known to have been exposed to gunshot residue can be distinguished from samples occasionally mistaken for gunshot residue. Our workflow builds upon standard APA techniques and data processing methods to unveil additional information in a readily interpretable and quantitatively comparable format.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Advanced Long-Term Environmental Monitoring Systems (ALTEMIS) Artificial Intelligence Data Management Plan

Across the Department of Energy’s Environmental and Legacy Management sites, complex groundwater plumes exist that will require long-term monitoring to ensure remedial actions that have been put in place remain effective decades into the future. The current monitoring paradigm predominantly consists of groundwater well sampling, whereby samples are collected, concentrations analyzed, and plume anomalies are detected after they have occurred. The Advanced Long Term Environmental Monitoring Systems (ALTEMIS) program is a multi-lab, multi-institution team of researchers that is deploying spatially integrative technologies (i.e., real-time in situ sensor networks), coupled with artificial intelligence and machine learning, to establish a more proactive monitoring paradigm. Within this approach, plume anomalies can be predicted, and corrective actions can be established prior to the occurrence, offering a more cost-effective and robust approach to long-term monitoring. The team has deployed a variety of different in situ sensing technologies at the Savannah River Site’s F-Area Hazardous Waste Management Facility around the F-Area Seepage Basins, which are unlined basins that received 7 billion liters of acidic low-level radioactive waste from the 1950s until the late 1980s. The technologies and techniques that the team is deploying are intended to ensure that the remedial actions that have been taken by the site remain effective decades into the future. Foundational to this approach is a robust, integrated data management and analysis plan to ensure accurate and timely reporting from the variety of sensor systems that are in place. This report will outline the data management plan that has been implemented by the ALTEMIS team at the Savannah River Site and will serve as a blueprint as the technology is translated to new sites across the DOE Complex.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Seasonal dynamics of core fungi in the switchgrass phyllosphere, and co-occurrence with leaf bacteria

Plant leaves harbor complex microbial communities that influence plant health and productivity. Nevertheless, a detailed understanding of phyllosphere community assembly and drivers is needed, particularly for phyllosphere fungi. Here, we investigated seasonal dynamics of epiphytic phyllosphere fungal communities in switchgrass ( Panicum virgatum L.), a focal bioenergy crop. We also leverage previously published data on switchgrass phyllosphere bacterial communities from the same experimental plants, allowing us to compare fungal and bacterial dynamics and explore inter-Domain network associations in the switchgrass phyllosphere. Overall, we found a strong impact of sampling date on fungal community composition, with multiple taxonomic levels exhibiting clear temporal patterns in relative abundance. In addition, leaf nitrogen concentration, leaf dry matter content, plant height, and minimum daily air temperature explained significant variation in phyllosphere fungal communities, likely due to their correlation with sampling date. Finally, among the core taxa, fungal-bacterial network associations were much more common than bacteria-bacteria associations, suggesting the importance of inter-Domain phylogenetic diversity in microbiome assembly. Although our findings highlight the complexity of phyllosphere microbiome assembly, the clear temporal patterns in lineage-specific fungal abundances give promise to the potential for accurately predicting shifts in fungal phyllosphere communities throughout the growing season, a key research priority for sustainable agriculture.

16S rRNA↗

DOE OSTI2024

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Spatial scales of competition and a growth–motility trade-off interact to determine bacterial coexistence

The coexistence of competing species is a long-lasting puzzle in evolutionary ecology research. Despite abundant experimental evidence showing that the opportunity for coexistence decreases as niche overlap increases between species, bacterial species and strains competing for the same resources are commonly found across diverse spatially heterogeneous habitats. We thus hypothesized that the spatial scale of competition may play a key role in determining bacterial coexistence, and interact with other mechanisms that promote coexistence, including a growth–motility trade-off. To test this hypothesis, we let two Pseudomonas putida strains compete at local and regional scales by inoculating them either in a mixed droplet or in separate droplets in the same Petri dish, respectively. We also created conditions that allow the bacterial strains to disperse across abiotic or fungal hyphae networks. We found that competition at the local scale led to competitive exclusion while regional competition promoted coexistence. When competing in the presence of dispersal networks, the growth–motility trade-off promoted coexistence only when the strains were inoculated in separate droplets. Our results provide a mechanism by which existing laboratory data suggesting competitive exclusion at a local scale is reconciled with the widespread coexistence of competing bacterial strains in complex natural environments with dispersal.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Machine learning of consistent thermodynamic models using automatic differentiation

In this study, we propose a data-driven method to describe consistent equations of state (EOS) for arbitrary systems. Complex EOS are traditionally obtained by fitting suitable analytical expressions to thermophysical data. A key aspect of EOS is that the relationships between state variables are given by derivatives of the system free energy. In this work, we model the free energy with an artificial neural network and utilize automatic differentiation to directly learn the derivatives of the free energy. We demonstrate this approach on two different systems, the analytic van der Waals EOS and published data for the Lennard-Jones fluid, and we show that it is advantageous over direct learning of thermodynamic properties (i.e., not as derivatives of the free energy but as independent properties), in terms of both accuracy and the exact preservation of the Maxwell relations. Furthermore, the method implicitly provides the free energy of a system without explicit integration.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2024

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗

DOE OSTI2021

Toward a Seamless Integration of Computing, Experimental, and Observational Science Facilities: A Blueprint to Accelerate Discovery

The Department of Energy, Office of Science operates world-leading facilities for experimental, observational, and computational science. DOE supercomputing facilities will reach performance at the scale of ExaFLOPs in the coming years, enabling new vistas of scale and precision for large scale simulations and data analysis. Experimental scientific facilities are undergoing similar upgrades that will lead to higher data rates and correspondingly larger computational demands, and will increase the need for near-real-time processing and resilient support for more complex workflows. A transformation of science is underway, with workloads at supercomputing facilities increasingly driven by this explosion of data from instruments and experimental facilities, as well as the accelerating use of Artificial Intelligence (AI) as a tool for scientific discovery. A seamless integration of computing, networking, instruments, and experimental facilities is required to support these emerging workloads and open up a new frontier of U.S. leadership in scientific discovery. We propose to accomplish this by providing frictionless access to the ASCR supercomputing facilities. We describe our vision of combining the power of ASCR supercomputers and networking infrastructure into an integrated scalable fabric, available to end user scientists via interfaces that aim to automate and simplify access to high performance computing systems. This will enable unprecedented computational science capabilities for experimental and observational facilities, and will create new opportunities to combine large simulations and modeling with experimental facility data analysis. This blueprint for creating an integrated network of computational and experimental facilities will provide an enriched discovery environment and open doors for new scientific communities to access the DOE’s world-leading computing and networking capabilities.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

7-8 GHz Point-to-Point Testing

Wireless spectrum is a limiting resource for continued economic growth in the United States. As discussed in the recent National Spectrum Strategy (NSS), wireless spectrum underpins several aspects of the U.S. economy and the demand for additional spectrum is driving the need for realizing spectrum sharing to enable continued development. At the same time, wireless spectrum is an essential foundation of critical energy infrastructure, including electric, oil, and natural gas resources. In particular, wireless point-to-point (P2P) links are the backbone of vast infrastructure networks that enable the flow of sensor and control information needed to manage critical energy sector infrastructure in the United States. These links will only become more important as the energy sector incorporates more diverse sensing and more efficient control mechanisms, which increases system complexity and data volume requiring more resilient communications. Therefore, the continued economic development of the U.S. depends on determining novel approaches to spectrum management that balance both broad access for advanced wireless technologies and resilience for critical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Finding Real Uncertainties From Physical Simulations

Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting lensing parameters, such as the Einstein radius. Mean-variance Estimators (MVEs) are a common approach for obtaining aleatoric (data) uncertainties from a neural network prediction. However, neural networks have not been demonstrated to perform well on out-of-domain target data successfully - e.g., when trained on simulated data and applied to real, observational data. In this work, we perform the first study of the efficacy of MVEs in combination with unsupervised domain adaptation (UDA) on strong lensing data. The source domain data is noiseless, and the target domain data has noise mimicking modern cosmology surveys. We find that adding UDA to MVE increases the accuracy on the target data by a factor of about two over an MVE model without UDA. Including UDA also permits much more well-calibrated aleatoric uncertainty predictions. Advancements in this approach may enable future applications of MVE models to real observational data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗