Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Graph Analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Fast Parallel Tensor Times Same Vector for Hypergraphs

Hypergraphs are a popular paradigm to rep- resent complex real-world networks exhibiting multi-way relationships of varying sizes. Mining centrality in hyper- graphs via symmetric adjacency tensors has only recently become computationally feasible for large and complex datasets. To enable scalable computation of these and related hypergraph analytics, here we focus on the Sparse Symmetric Tensor Times Same Vector (S3TTVC) oper- ation. We introduce the Compound Compressed Sparse Symmetric (CCSS) format, an extension of the compact CSS format for hypergraphs of varying hyperedge sizes and present a shared-memory parallel algorithm to compute S3TTVC. We experimentally show S3TTVC computation using the CCSS format achieves better performance than the naive baseline, and is subsequently more performant for hypergraph H-eigenvector centrality.

Shivakumar, Shruti↗

An improved hyperbolic embedding algorithm

Because hyperbolic space has properties that make it amenable to graph representations, there is significant interest in scalable hyperbolic-space embedding methods. These embeddings enable constant-time approximation of shortest-path distances, and so are significantly more efficient than full shortest-path computations. In this article, we improve on existing landmark-based hyperbolic embedding algorithms for large-scale graphs. Whereas previous methods compute the embedding by using the derivative-free Nelder–Mead simplex optimization method, our approach uses the limited-memory BFGS (LBFGS) method, which is quasi-Newton optimization, with analytic gradients. Our method is not only significantly faster but also produces higher-quality embeddings. Moreover, we are able to include the hyperbolic curvature as a variable in the optimization. We compare our hyperbolic embedding method implementation in Python (called Hypy) against the best publicly available software, Rigel. Our method is an order of magnitude faster and shows significant improvements in the accuracy of the shortest-path distance calculations. Furthermore, tests are performed on a variety of real-world networks, and we show the scalability of our method by embedding a graph with 1.8 billion edges and 65 million nodes.

97 MATHEMATICS AND COMPUTING↗

Identifying the Unique Properties of α-Bi 2 Mo 3 O 12 for the Activation of Propene

In order to understand the remarkable activity of α-Bi 2 Mo 3 O 12 for selective oxidation and ammoxidation of propene, the propene activation ability of four molybdenum-based mixed metal oxides - Bi 2 Mo 3 O 12 , PbMoO 4 , Bi 2 Pb 5 Mo 8 O 32 , and MoO 3 - was investigated using density functional theory. Propene activation is considered to occur via abstraction of a hydrogen atom from the methyl group of physisorbed propene by lattice oxygen. For each material, the apparent activation energy was estimated by summing the heat of adsorption of propene, the C-H bond dissociation energy, and the hydrogen attachment energy (HAE) for hydrogen addition to lattice oxygen; this sum provides a lower bound for the apparent activation energy. It was found that two structural features of oxide surfaces are essential to achieve low activation barriers: under-coordinated surface cation sites enable strong propene adsorption, and suitable 5- or 6-coordinate geometries at molybdenum result in favorable HAEs. The impact of molybdenum coordination on HAE was elucidated by carrying out a molecular orbital analysis using a cluster model of the molybdate unit. This effort revealed that, in 5- and 6-coordinate molybdates, oxygen donor atoms trans to molybdenyl oxo atoms destabilize the molybdate prior to H addition but stabilize the molybdate after H addition, thereby providing an HAE ~15 kcal/mol more favorable than that on 4-coordinate molybdate oxo atoms. Bi 3+ cations in Bi 2 Mo 3 O 12 thus promote catalytic activity by providing both strong adsorption sites for propene and forcing molybdate into 5-coordinate geometries that lead to particularly favorable values of the HAE. (Graph Presented).

36 MATERIALS SCIENCE↗

Physics-informed, empirically constrained machine learning for designing Fe-9Cr alloys

<span style="font-family: Calibri, sans-serif; font-size: 12pt;">Materials data analytics can be used to significantly shorten development time of specialized alloys needed for next generation energy applications. Incorporation of the domain knowledge into deep-learning graph structure via fuzzy pre-training and causal process imitation presents a viable approach to developing accurate data-driven models and reliable alloy design tools, with limited datasets. It was demonstrated that the domain knowledge-based empirical constraints not only inhibit overfitting but also allow training more accurate and reliable ML models with improved transparency of the output interpretation. In this study, alloy tensile properties were interpreted with three competing virtual-microstructure models.</span>

Romanov, Vyacheslav↗

Introducing Molecular Hypernetworks for Discovery in Multidimensional Metabolomics Data

Orthogonal separations of data from high-resolution mass spectrometry can provide insight into sample composition and address challenges of complete annotation of molecules in untargeted metabolomics. “Molecular networks” (MNs), as used in the Global Natural Products Social Molecular Networking platform, are a prominent strategy for exploring and visualizing molecular relationships and improving annotation. MNs are mathematical graphs showing the relationships between measured multidimensional data features. MNs also show promise for using network science algorithms to automatically identify targets for annotation candidates and to dereplicate features associated with a single molecular identity. Here, this paper introduces “molecular hypernetworks” (MHNs) as more complex MN models able to natively represent multiway relationships among observations. Compared to MNs, MHNs can more parsimoniously represent the inherent complexity present among groups of observations, initially supporting improved exploratory data analysis and visualization. MHNs also promise to increase confidence in annotation propagation, for both human and analytical processing. We first illustrate MHNs with simple examples, and build them from liquid chromatography- and ion mobility spectrometry-separated MS data. We then describe a method to construct MHNs directly from existing MNs as their “clique reconstructions”, demonstrating their utility by comparing examples of previously published graph-based MNs to their respective MHNs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Learning Coordinate-Free Quantum Chemistry

Computing quantum chemical properties of small molecules and polymers can provide insights valuable to physicists, chemists and biologists when designing new materials, catalysts, biological probes and drugs. Deep learning can compute quantum chemical properties accurately in a fraction of the time required by commonly used methods such as density functional theory (DFT). However, many of these deep learning architectures require energy minimized molecular geometries as input, which is also computationally expensive, and decreasing the reproducibility and throughput of these methods. In this study, we demonstrate that accurate quantum chemical computations can be performed without optimized geometries by operating in the coordinate-free domain using deep learning on graph encodings. Furthermore, we also find that the choice of graph-encoding architecture substantially affects the performance of these methods. The Wave architecture outperforms graph convolution architectures, particularly on complex molecules. Furthermore, the structures of these graph encoding architectures provide an opportunity to probe an important, outstanding question in quantum mechanics: What types of quantum chemical properties can be represented by local-variable models? We find that Wave, a local-variable model, is more accurately calculates quantum chemical properties. Graph convolutional architectures require global variables, and are not as effective as as Wave. We anticipate that coordinate-free, deep-learning models of quantum chemistry will become valuable tools in chemistry and biology, enabling researchers to rapidly screen chemical databases or identify new molecules using automated, de-novo design algorithms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geospatial-Temporal Semantic Graph Evaluation for Induced Seismicity Analysis

We assess how geospatial-temporal semantic graphs and our GeoGraphy code implementation might contribute to induced seismicity analysis. We focus on evaluating strengths and weaknesses of both 1) the fundamental concept of semantic graphs and 2) our current code implementation. With extensions and research effort, code implementation limitations can be overcome. The paper also describes relevance including possible data input types, expected analytical outcomes and how it can pair with other approaches and fit into a workflow.

58 GEOSCIENCES↗

Benders Decomposition Using Graph Modeling and Multi-Parametric Programming

Benders decomposition is a widely used method for solving large and structured optimization problems, but its performance is affected by the repeated solution of subproblems. We propose a flexible and modular algorithmic framework for accelerating Benders decomposition. Specifically, we express the problem structure by using a graph-theoretic modeling abstraction in which nodes represent optimization subproblems and edges represent connectivity between subproblems. A key innovation of our approach is that we embed multiparametric programming (mp) surrogates for node subproblems, which maps the exact analytical map of the subproblem solution space. The use of mp surrogates allows us to replace subproblem solves with fast look-ups and function evaluations for primal and dual variables during the iterative Benders process. We formally show the equivalence between classical Benders cuts and those derived from the mp solution. We implement our framework in the open-source PlasmoBenders.jl software package. To demonstrate the capabilities of the proposed framework, we apply it to a two-stage stochastic programming problem, which aims to make optimal capacity expansion decisions under market uncertainty. We evaluate both single-cut and multicut variants of Benders decomposition and show that the use of mp surrogates achieves substantial speedups in subproblem solve time, while preserving the convergence guarantees of Benders decomposition. We highlight advantages in solution analysis and interpretability that is enabled by mp critical region tracking; specifically, we show that these reveal how decisions evolve geometrically across the Benders search. Our results aim to demonstrate that combining surrogate modeling with graph modeling offers a promising and extensible foundation for structure-exploiting decomposition. In addition, by decomposing the problem into more tractable subproblems, the proposed approach also aims to overcome scalability issues of mp. Finally, the use of mp surrogates provides a unifying and modular optimization framework that enables the representation of heterogeneous node subproblems as modeling objects with a homogeneous structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis

Checkpoint/Restart (C/R) has been widely deployed in numerous HPC systems, Clouds, and industrial data centers, which are typically operated by system engineers. Nevertheless, there is no existing approach that helps system engineers without domain expertise and domain scientists without system fault tolerance knowledge identify those critical variables accounted for correct application execution restoration in a failure for C/R. To address this problem, we propose an analytical model and a tool (AutoCheck) that can automatically identify critical variables to checkpoint for C/R. AutoCheck relies on first, analytically tracking and optimizing data dependency between variables and other application execution state, and second, a set of heuristics that identify critical variables for checkpointing from the refined data dependency graph (DDG). AutoCheck allows programmers to pinpoint critical variables to checkpoint quickly within a few minutes. We evaluate AutoCheck on 13 representative HPC benchmarks, demonstrating that AutoCheck can efficiently identify correct critical variables to checkpoint.

HPC↗

Explaining Missing Data in Graphs: A Constraint-based Approach

Abstract: This paper introduces a constraint-based approach to clarify missing values in graphs. Our method capitalizes on a set S of graph data constraints. An explanation is a sequence of operational enforcement of S towards the recovery of interested yet missing data (e.g., attribute values, edges). We show that constraint-based approach helps us to understand not only why a value is missing, but also how to recover the missing value. We study S-explanation problem, which is to compute the optimal explanations with guarantees on the informativeness and conciseness. We show the problem is in ?P^2 for established graph data constraints such as graph keys and graph association rules. We develop an efficient bidirectional algorithm to compute optimal explanations, without enforcing S on the entire graph. We also show our algorithm can be easily extended to support graph refinement within limited time, and to explain missing answers. Using real-world graphs, we experimentally verify the effectiveness and efficiency of our algorithms.

Data Analytics↗

Molecular Hypernetworks for Exploration of Multi-Dimensional Metabolomics Data (Chyper)

Orthogonal separations of data from high-resolution mass spectrometry can provide insight into sample composition and help address the challenge of complete annotation of molecules in untargeted metabolomics. “Molecular networks” (MNs), as used, for example, in the Global Natural Products Social Molecular Networking platform, are an increasingly popular computational strategy for exploring and visualizing molecular relationships and improving annotation. MNs use graph representations to show the relationships between measured multidimensional data features. MNs also show promise for using network science algorithms to automatically identify targets for annotation candidates and to dereplicate features associated to a single molecular identity. However, more advanced methods may better represent the complexity present in samples. Our work aims to increase confidence in annotation propagation by extending molecular network methods to include “molecular hypernetworks” (MHNs), able to natively represent multiway relationships among observations supporting both human and analytical processing. In this paper we first introduce MHNs illustrated with simple examples, and demonstrate how to build them from liquid chromatography- and ion mobility spectrometry- separated MS data. We then describe a method to construct MHNs directly from existing MNs as their “clique reconstructions”, demonstrating their utility by comparing examples of previously published graph-based MNs to their respective MHNs.

59 BASIC BIOLOGICAL SCIENCES↗

Graph-based featurization methods for classifying small molecule compounds

For over a decade, drug-induced liver injury (DILI) has posed significant drawbacks in the synthesis and development of drugs and remains a consequential concern. With finite success within the existing preclinical models, DILI is one of the main causes of drug withdrawal or termination from the market. Particularly, this withdrawal occurs during the late stages of drug development (Kullak-Ublick, 2017). Since DILI is difficult to diagnose and treat, it has become an obstacle in the drug production market that in turn affects clinicians, pharmaceutical companies, and consumers. We propose a method for learning features of DILI-positive drugs based on the graphical relationships and patterns they possess within a network of biological databases. We also train various statistical and machine learning models on these learned features in order to classify the drugs as DILI-positive or negative. Our methods include Random Forest, Neural networks, and logistic regression classification. We utilize labeled DILI-positive and DILI-negative datasets, which were developed by the FDA and the National center for toxicological research, as well as additional literature datasets (Thakkar, 2020) in order to validate our results and assess our featurization and model accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Post-Disaster Microgrid Formation for Enhanced Distribution System Resilience

This paper proposes a deep reinforcement learning (DRL) based approach for post-disaster critical load restoration in active distribution systems to form microgrids through network reconfiguration to minimize critical load curtailments. Distribution networks are represented as graph networks, and optimal network configurations with microgrids are obtained by searching for the optimal spanning forest. The constraints to the research question being explored are the radial topology and power balance. Unlike existing analytical and population-based approaches, which necessitate the repetition of entire analyses and computation for each outage scenario to find the optimal spanning forest, the proposed approach, once properly trained, can quickly determine the optimal, or near-optimal, spanning forest even when outage scenarios change. When multiple lines fail in the system, the proposed approach forms microgrids with distributed energy resources in active distribution systems to reduce critical load curtailment. The proposed DRL-based model learns the action-value function using the REINFORCE algorithm, which is a model-free reinforcement learning technique based on stochastic policy gradients. A case study was conducted on a 33-node distribution test system, demonstrating the effectiveness of the proposed approach for post-disaster critical load restoration.

active distribution systems↗

Dynamic Nested Tracking Graphs

This work describes an approach for the interactive visual analysis of large-scale simulations, where numerous superlevel set components and their evolution are of primary interest. The approach first derives, at simulation runtime, a specialized Cinema database that consists of images of component groups, and topological abstractions. This database is processed by a novel graph operation-based nested tracking graph algorithm (GO-NTG) that dynamically computes NTGs for component groups based on size, overlap, persistence, and level thresholds. Finally, the resulting NTGs are in turn used in a feature-centered visual analytics framework to query specific database elements and update feature parameters, facilitating flexible post hoc analysis.

97 MATHEMATICS AND COMPUTING↗

Data Validation Package November 2015 Groundwater and Surface Water Sampling at the Old and New Rifle, Colorado, Processing Sites February 2016

Water samples were collected from 36 locations at New Rifle and Old Rifle, Colorado, Processing Sites. Duplicate samples were collected from New Rifle locations 0659 and 0855, and Old Rifle location 0304. One equipment blank was collected after decontamination of non-dedicated equipment used to collect one surface water sample. Sampling and analyses were conducted as specified in the Sampling and Analysis Plan for U.S. Department of Energy Office of Legacy Management Sites (LMS/PRO/S04351, continually updated). New Rifle Site Samples were collected at the New Rifle site from 16 monitoring wells and 7 surface locations in compliance with the December 2008 Groundwater Compliance Action Plan [GCAP] for the New Rifle, Colorado, Processing Site (LMS/RFN/S01920), with one exception: New Rifle location 0635 could not be sampled because it was inaccessible; a fence installed by the Colorado Department of Transportation prevents access to this location. DOE is currently negotiating access with the Colorado Department of Transportation. Analytes measured at the New Rifle site included contaminants of concern (COCs) (arsenic, molybdenum, nitrate + nitrite as nitrogen, selenium, uranium, and vanadium) ammonia as nitrogen, major cations, and major anions. Field measurements of total alkalinity, oxidation- reduction potential, pH, specific conductance, turbidity, and temperature were made at each location, and the water level was measured at each sampled well. A proposed alternate concentration limit (ACL) for vanadium of 50 milligrams per liter (mg/L), specific to the compliance (POC) wells (RFN-0217, -0659, -0664, and -0669) is included in the New Rifle GCAP. Vanadium concentrations in the POC wells were below the proposed ACL as shown in the time-concentration graphs in the Data Presentation section (Attachment 2). Time-concentration graphs from all other locations sampled are also included in Attachment 2. Sampling location RFN-0195 was misidentified for the June/August 2014 and November 2014 sampling events. (Well RFN-0609 was inadvertently sampled instead of RFN-0195 in 2014.) The results for RFN-0195 have been corrected, and are included in associated time-concentration graphs for this location. Recent results for RFN-0195 are consistent with established trends with the possible exception of vanadium. The most recent result for vanadium showed an increase over recent values. Vanadium concentrations at RFN-0195 and other locations will continue to be evaluated in the future to determine the potential for deviations from established trends. The surface water locations were sampled to monitor the impact of groundwater discharge. COC concentrations at Colorado River surface water locations RFN-0324 and RFN-0326, downgradient of the site, remained low and were consistent with historical results, as shown in the time-concentration graphs. COC concentrations did not indicate there are any impacts related to groundwater discharge to the river. In many cases, elevated COC concentrations at the New Rifle site pond locations were observed, as shown in the time-versus concentration graphs. As noted in the GCAP, this indicates impacts from groundwater discharge to the ponds. Old Rifle Site Samples were collected at the Old Rifle site from eight monitoring wells and five surface locations in compliance with the December 2001 Groundwater Compliance Action Plan for the Old Rifle, Colorado, UMTRA Project Site (GJ0-2000-177-TAR). Analytes measured at the Old Rifle site included COCs (selenium, uranium, and vanadium), major cations, and major anions. Field measurements of total alkalinity, oxidation-reduction potential, pH, specific conductance, turbidity, temperature, were made at each location, and the water level was measured at each sampled well. The monitoring strategy described in the GCAP is designed to determine progress of the natural flushing process in meeting compliance standards for site COCs. Standards for selenium and vanadium are the proposed ACLs of0.05 mg/L and 1.0 mg/L, respectively. For uranium the cleanup goal is the UMTRA standard of 0.044 mg/L or background, whichever is higher. As shown in the time concentration graphs, the uranium concentration exceeds the cleanup goal at groundwater monitoring locations RF0-0304, -0305, -0310, -0655, and -0656. The surface water locations were sampled to monitor the impact of groundwater discharge at Colorado River surface water locations adjacent to (RF0-0396) and downgradient of the site (RF0-0741). COC concentrations remain low and consistent with historical concentrations as shown in the time-concentration graphs (Attachment 2), which indicate no impacts from groundwater discharge to the river.

2015 Old and New Rifle↗

Improved Force-Field Parameters for QM/MM Simulations of the Energies of Adsorption for Molecules in Zeolites and a Free Rotor Correction to the Rigid Rotor Harmonic Oscillator Model for Adsorption Enthalpies

Quantum mechanics/molecular mechanics (QM/MM) simulations provide an efficient avenue for studying reactions catalyzed in zeolite systems; however, the accuracy of such calculations is highly dependent on the zeolite MM parameters used. Previously reported parameters (P1), which were chosen to minimize the root mean square (RMS) deviations of adsorption energies compared with full QM ωB97X-D/6-31+G** adsorption energies, are shown to overestimate binding energies compared with experimental values, particularly for larger substrates. To address this issue, a new parameter set (P2) is derived by rescaling the previously reported characteristic energies of the Lennard-Jones potential in P1. The accuracy of the thermal correction for adsorption enthalpies determined by the rigid rotor-harmonic oscillator approximation (RRHO) is examined and shown to be improved by treating low-lying vibrational modes as free translational and rotational modes via a quasi-RRHO model. Here, with P2 and quasi-RRHO, adsorption energies calculated with QM/MM agree with experimental values with an RMS error of 1.8 kcal/mol for both nonpolar and polar molecules adsorbed in MFI, H-MFI, and H-BEA. By contrast, the RMS error for the same test sets obtained using parameter set P1 is 8.3 kcal/mol. Glucose-fructose isomerization catalyzed by Sn-BEA is taken as an example to demonstrate that improved values for apparent activation energies can be obtained using the methodology reported here. With parameter set P2, the apparent activation energy calculated with QM/MM reproduces the experimental value to within 1 kcal/mol. By contrast, using parameter set P1, the error is -12.9 kcal/mol. (Graph Presented).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Theoretical guarantees for permutation-equivariant quantum neural networks

Despite the great promise of quantum machine learning models, there are several challenges one must overcome before unlocking their full potential. For instance, models based on quantum neural networks (QNNs) can suffer from excessive local minima and barren plateaus in their training landscapes. Recently, the nascent field of geometric quantum machine learning (GQML) has emerged as a potential solution to some of those issues. The key insight of GQML is that one should design architectures, such as equivariant QNNs, encoding the symmetries of the problem at hand. Here, we focus on problems with permutation symmetry (i.e., symmetry group $S_n$), and show how to build $S_n$-equivariant QNNs We provide an analytical study of their performance, proving that they do not suffer from barren plateaus, quickly reach overparametrization, and generalize well from small amounts of data. To verify our results, we perform numerical simulations for a graph state classification task. Our work provides theoretical guarantees for equivariant QNNs, thus indicating the power and potential of GQML.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗