Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed influence maximization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

DIMPLES: Distributed Influence Maximization for Pandemic pLanning on Exascale Systems

We study exascale parallel algorithms for the selection of intervention or monitoring strategies in massive realistic socio-technical networks through scalable Influence Maximization (InfMax) algorithms. We employ novel techniques to enable efficient scaling on up to 8k nodes of OLCF Frontier, with 65k AMD GPUs and 458k AMD CPU cores. Current state-of-the-art InfMax tools are limited to networks with only a few million actors (vertices) and a few hundred million interactions (edges). By overcoming these limitations, we show that our approach is capable of processing a realistic social contact network of the United States with 285 million nodes and about 8 billion edges. This two orders-of-magnitude improvement over the previous state-of-the-art is obtained by leveraging algorithmic advancements for the InfMax problem and designing several problem-specific approaches to overlap communication with computation, improve GPU efficiency, and lower the application’s memory requirements. We evaluate strong scaling for computing 10k most influential seeds using up to 8k nodes of an exascale system, and weak scaling from 128 to 8k system nodes for seed sets ranging from 625 to 40k seeds. We achieve the fastest-known runtime of 25 minutes while performing 48 million diffusion simulations totaling 2.31 petabytes to identify 40k influential seeds using 8k nodes, and take 5.75 minutes to identify 10k seeds while using 4k nodes.

Minutoli, Marco [Pacific Northwest National Labora↗
DOE OSTI2019

Fast and Scalable Implementations of Influence Maximization Algorithms

The Influence Maximization problem has been extensively studied in the past decade because of its practical applications in finding the key influencers in social networks. Due to the hardness of the underlying problem, existing algorithms have tried to trade off practical efficiency with approximation guarantees. However, even such approximate solutions take several hours of compute time on modest sized real world inputs. On the other hand, there is a lack of effective parallel and distributed algorithms to solve this problem. In this paper, we present efficient parallel algorithms for multithreaded and distributed systems to solve the influence maximization with approximation guarantee. Our algorithms extend state-of-the-art sequential approach based on computing reverse reachability sets. We present a detailed experimental evaluation, and analyze their performance and their sensitivity to input parameters, using real world inputs. Our experimental results demonstrate significant speedup on parallel architectures. We further show a speedup of up to 586X relative to the state-of-the-art sequential baseline using 1024 nodes of a supercomputer at far greater accuracy and twice the seed set size. To the best of our knowledge, this is the first effort in parallelizing the influence maximization operation at scale.

Minutoli, Marco↗
DOE OSTI2024

FuseIM: Fusing Probabilistic Traversals for Influence Maximization on Exascale Systems

Probabilistic breadth-first traversals (BPTs) are used in many network science and graph machine learning applications. In this paper, we are motivated by the application of BPTs in stochastic diffusion-based graph problems such as influence maximization. These applications heavily rely on BPTs to implement a Monte-Carlo sampling step for their approximations. Given the large sampling complexity, stochasticity of the diffusion process, and the inherent irregularity in real-world graph topologies, efficiently parallelizing these BPTs remains significantly challenging. In this paper, we present a new algorithm to fuse massive number of concurrently executing BPTs with random starts on the input graph. Our algorithm is designed to fuse BPTs by combining separate traversals into a unified frontier on distributed multi-GPU systems. To show the general applicability of the fused BPT technique, we have incorporated it into two state-of-the-art influence maximization parallel implementations (gIM and Ripples). Our experiments on up to 4K nodes of the OLCF Frontier supercomputer (32,768 GPUs and 196K CPU cores) show strong scaling behavior, and that fused BPTs can improve the performance of these implementations up to 34x (for gIM) and ~360x (for Ripples).

Neff, Reece W.↗
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Cell Utilized Partitioning Model as a Predictive Tool for Optimizing Counter-Current Chromatography Processes

Counter-current chromatography (CCC) is capable of unique elution modes that isolate analytes using the movement of the stationary phase in addition to moving the mobile phase. These modes include elution-extrusion CCC (EECCC) and dual-mode CCC (DM CCC) that are not possible in traditional solid-liquid chromatography systems. Although EECCC and DM CCC are widely used to recover highly retained components, to our knowledge, optimizing the elution process in these modes with predictive models has not been reported. To address this gap, we developed a predictive model for CCC dubbed the Cell Utilized Partitioning (CUP) model. The CUP model accurately predicts the effluents of multicomponent separations in EECCC and DM CCC modes when compared to experimental data. Furthermore, CUP model simulations were extended to investigate the influence of operating and intrinsic parameters on the yield and productivity, and to compare the separation performances of EECCC and DM CCC in various conditions. The results demonstrate that low distribution constants, usually a KD less than 1, and a selectivity > 1.3, under specific flowrate ranges, increase both productivity and yield. From these results, generalized optimization and scaleup guidelines are proposed that can apply to research settings and to industrial processes to maximize preparative CCC performance.

BIOMASS FUELS,INORGANIC, ORGANIC, PHYSICAL, AND AN↗
DOE OSTI2024

A hierarchical framework for aggregating grid-interactive buildings with thermal and battery energy storage

The behind-the-meter (BTM) thermal and battery energy storage can help improve energy efficiency, reduce energy costs, and enhance energy resilience, particularly in rural areas and for disadvantaged communities. Aggregating numerous BTM energy storage systems can act as a price influencer with a significant source of load shifting and peak demand reduction. An integrated and scalable control mechanism is required to effectively utilize energy storage systems and flexible building loads to maximize the economic benefits, considering various distribution system constraints. Here, this paper presents an innovative hierarchical coordination framework for energy storage and flexible load in buildings, considering various factors such as electricity prices, thermal comfort, and distribution system modeling and constraints. At the upper level, a distribution system operator optimizes the power flow to minimize its power procurement costs from the electricity wholesale market, while at the lower level, aggregators determine the optimal dispatch of battery and thermal energy storage systems in multiple buildings on behalf of end-users to minimize operating costs according to the power prices. These problems are solved using a game-theoretic approach through negotiations between the distribution system operator and aggregators as a bi-level decision model. Simulation case studies have been performed for a test distribution network with a number of building end-users using energy storage systems to quantify the performance of aggregators. The results demonstrate that the proposed strategy can reduce peak load for a reliable electricity distribution network while saving electricity bills for customers.

25 ENERGY STORAGE↗
DOE OSTI2019

Game-Theoretic Approach for Electricity Pricing Between Distribution System Operator and Load Aggregators

Transactive energy has emerged and gained more and more attention in recent years along with smart grid two-way communication technologies. Electricity pricing strategies play a critical role in influencing and shaping the customers’ energy load profile. In this paper, we investigate the electricity pricing strategy between a distribution system operator (DSO) and load aggregators (LAs) by adopting a bi-level Stackelberg game approach. With the purpose of maximizing its own operating revenue as well as better serving its customers, the upper level DSO will determine the price considering how lower level LAs will respond to it. Peak-to-average ratio of the total demand is modeled as a constraint and peak load is penalized at the upper optimization level. Classical backward induction is used to obtain a Nash equilibrium for the formulated bi-level Stackelberg game. Numerical results demonstrate the effectiveness of the proposed game approach in leveraging flexible demand potential to benefit both DSO and LAs.

Chen, Yang↗
DOE OSTI2018

Prospects for enhancing leaf photosynthetic capacity by manipulating mesophyll cell morphology

Leaves are beautifully specialized organs designed to maximize the use of light and CO 2 for photosynthesis. Engineering leaf anatomy therefore holds great potential to enhance photosynthetic capacity. In this work, we review the effect of the dominant leaf anatomical traits on leaf photosynthesis and confirm that a high chloroplast surface area exposed to intercellular airspace per unit leaf area (S c ) is critical for efficient photosynthesis. The possibility of improving S c through appropriately increasing mesophyll cell density is further analyzed. The potential influences of modifying mesophyll cell morphology on CO 2 diffusion, light distribution within the leaf, and other physiological processes are also discussed. Some potential target genes regulating leaf mesophyll cell proliferation and expansion are explored. Indeed, more comprehensive research is needed to understand how manipulating mesophyll cell morphology through editing the potential target genes impacts leaf photosynthetic capacity and related physiological processes. This will pinpoint the targets for engineering leaf anatomy to maximize photosynthetic capacity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Enhancement of operational Flexibility of Power Plants Using IN740

Headers are crucial components within diverse industries, especially in the energy sector, as they enable the efficient transfer of fluids. The selection of materials for headers is determined by their specific applications; for example, Grade 91 and Grade 92 steels are commonly utilized. In our research, we recommend the adoption of INCONEL alloy 740 due to its exceptional robustness and heat-resistant characteristics. One critical parameter in header systems is the heat transfer coefficient, which directly influences the efficiency of heat exchange processes and can thereby impact the structural integrity of the headers. This coefficient is closely linked with factors such as the Nusselt number, which is influenced by fluid flow characteristics and thermal properties. The flow direction within headers, whether unidirectional or multidirectional—significantly affects the overall dynamics of heat transfer. This research focuses on exploring the behavior of headers, a specific pipeline system component, using ANSYS simulation software. The study aims to predict heat transfer and mechanical behavior within headers under various conditions through steady-state and transient simulations (parts 1 and 2 of the report). Key parameters such as heat transfer coefficient, velocity, and temperature are examined with the goal of optimizing header design. Part 3 of the report addresses the critical yet underexplored relationship between pressure drop and heat transfer coefficients in the transient flow regime within headers, specifically focusing on smooth horizontal circular tubes. Limited experimental work has been conducted in this area, prompting the need for comprehensive analysis. By leveraging machine learning techniques, this research aims to establish a correlation between pressure drop and heat transfer across various flow conditions, including laminar, transient, quasi-turbulent, and turbulent regimes. The data utilized for this analysis were meticulously gathered from existing literature, capturing simultaneous measurements of pressure drops and heat transfer. Part 4: In the context of power plants, header pipes are essential components that significantly influence system performance by facilitating the collection and distribution of steam. This report highlights the critical role of header pipes in enhancing reliability, efficiency, and overall power plant performance. A key aspect of this investigation is shape optimization, which aims to maximize performance while minimizing material usage. By focusing on shape optimization, this research contributes to improved efficiency and a reduced environmental footprint for power plant installations. The methodology developed in this study emphasizes optimizing header shapes to decrease reliance on expensive alloy materials and lower maintenance costs. Furthermore, a case study was conducted using a header from an operational power plant to validate the proposed optimization techniques. Finally, part 5 addresses the challenges associated with flexible operations in boiler systems, the study outlines several strategies for enhancing the durability and reliability of steam headers. Key approaches include material selection, which involves utilizing advanced materials with superior high-temperature properties and enhanced fatigue resistance to extend the lifespan of steam headers. Design modifications are also recommended, focusing on implementing changes that mitigate thermal stress and cyclic loading to reduce the likelihood of failures under varying operating conditions. Additionally, the study emphasizes the importance of regular inspection and monitoring by establishing rigorous protocols to detect early signs of damage, allowing for timely maintenance and minimizing the risks of catastrophic failures. Furthermore, operational guidelines are developed to minimize the frequency and severity of thermal transients, ensuring stable and efficient operations. Collectively, these strategies provide a robust framework for overcoming the unique challenges posed by flexible operation in boiler systems, ultimately contributing to improved reliability and performance in power plant operations. Through this comprehensive approach, the study not only enhances the understanding of pressure drop and heat transfer relationships but also promotes advancements in design and operation that will benefit the entire power generation industry.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2019

Evaluation of Stream and Wetland Restoration Using UAS-Based Thermal Infrared Mapping

Large-scale wetland restoration often focuses on repairing the hydrologic connections degraded by anthropogenic modifications. Of these hydrologic connections, groundwater discharge is an important target, as these surface water ecosystem control points are important for thermal stability, among other ecosystem services. However, evaluating the effectiveness of the restoration activities on establishing groundwater discharge connection is often difficult over large areas and inaccessible terrain. Unoccupied aircraft systems (UAS) are now routinely used for collecting aerial imagery and creating digital surface models (DSM). Lightweight thermal infrared (TIR) sensors provide another payload option for generation of sub-meter-resolution aerial TIR orthophotos. This technology allows for the rapid and safe survey of groundwater discharge areas. Aerial TIR water-surface data were collected in March 2019 at Tidmarsh Farms, a former commercial cranberry peatland located in coastal Massachusetts, USA (41°54′17″ N 70°34′17″ W), where stream and wetland restoration actions were completed in 2016. Here, we present a 0.4 km2 georeferenced, temperature-calibrated TIR orthophoto of the area. The image represents a mosaic of nearly 900 TIR images captured by UAS in a single morning with a total flight time of 36 min and is supported by a DSM derived from UAS-visible imagery. The survey was conducted in winter to maximize temperature contrast between relatively warm groundwater and colder ambient surface environment; lower-density groundwater rises above cool surface waters and thus can be imaged by a UAS. The resulting TIR orthomosaic shows fine detail of seepage distribution and downstream influence along the several restored channel forms, which was an objective of the ecological restoration design. The restored stream channel has increased connectivity to peatland groundwater discharge, reducing the ecosystem thermal stressors. Such aerial techniques can be used to guide ecological restoration design and assess post-restoration outcomes, especially in settings where ecosystem structure and function is governed by groundwater and surface water interaction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A General Method for Estimating Zonal Transmission Interface Limits from Nodal Network Data: Preprint

Capacity expansion models for the electric power system often employ zonal (rather than nodal) resolution, necessitating estimates of aggregate power transfer limits across the interfaces between model zones. Interface limits between planning areas are sometimes published, but they are not generalizable to arbitrary zone shapes. There is thus a need for a reproducible method for estimating interface transfer limits (ITLs) between user-defined zones directly from nodal transmission system data. Here, we present a simple method for estimating ITLs using a DC power flow approximation via the power transfer distribution factor (PTDF) matrix. Linear optimization is performed to identify the distribution of power flows that maximizes the total flow on interface-crossing lines, subject to individual line ratings, limits on bus injection/withdrawal, and the relationships among flows, injections, and withdrawals imposed by the PTDF matrix. We demonstrate the application of the method on a 134-zone ~65000-bus system, and we explore the influence of flow direction, contingency level, and zone size on the estimated ITLs. There is significant heterogeneity in the ratio of the ITL to the sum of interface-crossing line ratings, which highlights the importance of accounting for the physical constraints on power flows imposed by Kirchhoff's laws when estimating zonal ITLs.

17 WIND ENERGY↗
DOE OSTI2021

Linear Combination of Atomic Dipoles to Calculate the Bond and Molecular Dipole Moments of Molecules and Molecular Liquids

Here we report a linear combination of atomic dipole (LCAD) method for calculating the bond dipole moments of molecules. We show that the LCAD method reproduces the known molecular dipole moments of small to large molecules with a small error with respect to experimental and benchmark ab initio calculations, and molecular dipole distributions of bulk water that agree with maximally localized Wannier functions. The bond dipole moments derived from LCAD are also chemically interpretable in terms of the trend in bond ionicity in going from neutral to charged molecules. Moreover, the LCAD method accurately captures the influence of electric fields, supported by the correct trend in the change of the dipole moment under a uniform external electric field. The better grounding of bond dipole calculations indicates that it should also serve as a useful approach to bond dipole-field models used in catalysis or to reconstruct the small dipole of a H-terminated graphene flake.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Tornadoes in Southeast South America: Mesoscale to Planetary-Scale Environments

Abstract A multiscale analysis of the environment supporting tornadoes in southeast South America (SESA) was conducted based on a self-constructed database of 74 reports. Composites of environmental and convective parameters from ERA5 were generated relative to tornado events. The distribution of the reported tornadoes maximizes over the Argentine plains, while events are rare close to the Andes and south of Sierras de Córdoba. Events are relatively common in all seasons except in winter. Proximity environment evolution shows enhanced instability, deep-layer vertical wind shear, storm-relative helicity, reduced convective inhibition, and a lowered lifting condensation level before or during the development of tornadic storms in SESA. No consistent signal in low-level wind shear is seen during tornado occurrence. However, a curved hodograph with counterclockwise rotation is present. The Significant Tornado Parameter (STP) is also maximized prior to tornadogenesis, most strongly associated with enhanced CAPE. Differences in the convective environment between tornadoes in SESA and the U.S. Great Plains are discussed. On the synoptic scale, tornado events are associated with a strong anomalous trough crossing the southern Andes that triggers lee cyclogenesis, subsequently enhancing the South American low-level jet (SALLJ) that increases moisture advection to support deep convection. This synoptic trough also enhances vertical shear that, along with enhanced instability, sustains organized convection capable of producing tornadic storms. At planetary scales, the tornadic environment is modulated by Rossby wave trains that appear to be forced by convection near northern Australia. Madden–Julian oscillation phase 3 preferentially occurs 1–2 weeks ahead of tornado occurrence. Significance Statement The main goal of this study is to describe what atmospheric conditions (from local to global scales) are present prior to and during tornadic storms impacting southeast South America (SESA). Increasing potential for deep convection, wind shear, and potential for rotating updrafts, as well as reducing convective inhibition and cloud-base height, are predominant a few hours before and during the events in connection to low-level northerly winds enhancing moisture transport to the region. Remote convective activity near northern Australia appears to influence large-scale atmospheric circulation that subsequently triggers convective storms supporting tornadogenesis 1–2 weeks later in SESA. Our findings highlight the importance of accounting for atmospheric processes occurring at different scales to understand and predict tornado occurrences.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

Shape Optimization of Header Pipes in Power Plants for Enhanced Efficiency and Environmental Sustainability

In a power plant, the header pipe plays a pivotal role in optimizing the performance of diverse systems by serving as a central conduit for the collection and distribution of steam within the plant. This paper investigates the significance of header pipes within power plant setups, highlighting their critical influence on reliability, efficiency, and the performance of the power plant as a whole. The concept of shape optimization emerges as a crucial factor in power plant design and operation, with the potential to maximize performance while minimizing the use of materials. Shape optimization not only enhances efficiency but also contributes to reducing the environmental footprint of power plant installations. In this paper, we initially developed a methodology designed for optimizing header shapes with the primary goal of reducing the usage of costly new alloy materials and lowering the overall maintenance operation expenses. Secondly, we conducted a case study based on an authentic header sourced from an operational power plant.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Dynamically Learning Incentives for Load Control

As electrical generation becomes more distributed and volatile, and loads become more uncertain, controllability of distributed energy resources (DERs), regardless of their ownership status, will be necessary for grid reliability. Grid operators lack direct control over end-users' grid interactions, such as energy usage, but incentives can influence behavior -- for example, an end-user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. A key challenge in studying such incentives is the lack of data about human behavior, which usually motivates strong assumptions, such as distributional assumptions on compliance or rational utility-maximization. In this paper, we propose a general incentive mechanism in the form of a constrained optimization problem -- our approach is distinguished from prior work by modeling human behavior (e.g., reactions to an incentive) as an arbitrary unknown function. We propose feedback-based optimization algorithms to solve this problem that each leverage different amounts of information and/or measurements. We show that each converges to an asymptotically stable incentive with (near)-optimality guarantees given mild assumptions on the problem. Finally, we evaluate our proposed techniques in voltage regulation simulations on standard test beds. We test a variety of settings, including those that break assumptions required for theoretical convergence (e.g., convexity, smoothness) to capture realistic settings. In this evaluation, our proposed algorithms are able to find near-optimal incentives even when the reaction to an incentive is modeled by a theoretically difficult (yet realistic) function.

demand response↗
DOE OSTI2020

PREEMPT: Scalable Epidemic Interventions Using Submodular Optimization on Multi-GPU Systems

Preventing and slowing the spread of epidemics is achieved through techniques such as vaccination and social distancing. Given practical limitations on the number of vaccines and cost of administration, optimization becomes a necessity. Previous approaches using mathematical programming methods have shown to be effective but are limited by computational costs. In this work, we make several contributions: First, we present a new approach for intervention via maximizing the influence of vaccinated nodes on the network. We call this method \preempt. Next, we prove submodular properties associated with the objective function of our method so that it aids in construction of an efficient greedy approximation strategy. Consequently, we present a new parallel algorithm based on greedy hill climbing for \preempt, and present an efficient parallel implementation for distributed CPU-GPU heterogeneous platforms. Our results demonstrate that \preempt{} is able to achieve a significant reduction (up to 6.75$\times$) in the percentage of people infected on a city-scale network. We also show strong scaling results of \preempt{} on 128 nodes of the Summit supercomputer. Our parallel implementation is able to significantly reduce time to solution, from hours to minutes on large networks. This work represents a first-of-its-kind effort in parallelizing greedy hill climbing and applying it toward devising effective interventions for epidemics.

Minutoli, Marco↗
DOE OSTI2023

HBMax: Optimizing Memory Efficiency for Parallel Influence Maximization on Multicore Architectures

The goal of influence maximization is to select k most-influential vertices or seeds in a network, where influence is defined by a given diffusion process. The problem has a number of important applications such as viral marketing, information spread, and epidemic control. Although computing optimal seed set is NP-Hard, due to the submodular nature of the problem efficient approximation algorithms exist. However, even state-of-the-art parallel implementations are limited by a sampling step that incurs large memory footprints. This in turn limits the problem size reach and approximation quality. In this work, we study the memory footprint of the sampling process collecting reverse reachability information in the IMM algorithm over large real-world social networks. We present an adaptive and memory-efficient optimization approach for a state-of-the-art multi-threaded parallel influence maximization algorithm. Our approach,HuffMax, uses a portion of the reverse reachable (RR) sets collected by the algorithm to learn the characteristics of the graph. Then, it compresses the intermediate reverse reachability information with Huffman coding, and queries directly on the compressed data to preserve the memory savings obtained through compression. We also propose an efficient sampling strategy based on the distribution of RR sets, which can further reduce the computation time for typical social networks with long-tail distributions. Considering a NUMA architecture, we scale up our solution on 128-core CPUs and reduce the memory footprint by up to 45.7% with negligible time overhead (or even faster) and without perceivable loss of accuracy.

Chen, Xinyu↗