Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system partition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

FPDeep: Scalable Acceleration of CNN Training on Deeply-Pipelined FPGA Clusters

In this paper, we propose a framework called FPDeep, which uses a hybrid of model and layer paral- lelism to configure distributed reconfigurable clusters to train DNNs. This approach has numerous benefits. First, the design does not suffer from batch size growth. Second, novel workload and weight partitioning leads to balanced loads of both among nodes. And third, the entire system is fine-grained pipeline. This leads to high parallelism and utilization and also minimizes the time features need to be cached while waiting for back-propagation.

Wang, Tianqi↗
DOE OSTI2023

A Robust Parallel Distributed State Estimation for Large Scale Distribution Systems

The growing need and interest in real-time monitoring of large distribution networks motivated by the rapid population of renewable sources, EVs and etc. demand a computationally efficient state estimation framework. Furthermore, this paper presents an improved computational framework for implementing a robust state estimator using a multi-core processor. The main contribution of the paper is the proposed computational framework along with two partitioning strategies which enable fast and robust state estimation for large scale radial and/or meshed distribution systems. Formulation of the proposed method and its implementation are described in detail. Performance of the estimator is tested by simulations first using a small 84-bus radial distribution system. Then the method’s scalability is demonstrated by simulations on two very large scale distribution networks one configured radially and the other meshed each containing over 12,500 buses.

42 ENGINEERING↗
DOE OSTI2021

GASNet-EX Memory Kinds: Support for Device Memory in PGAS Programming Models

There is an emerging need for adaptive, lightweight communication in irregular HPC applications at exascale, where GPU accelerators provide the majority of available compute cycles. To address this need, Lawrence Berkeley National Lab is developing a programming system to support distributed-memory HPC application development using the Partitioned Global Address Space (PGAS) model. This work includes two major components: UPC++ and GASNet-EX. UPC++ is a C++ template library providing Remote Memory Access (RMA) and Remote Procedure Call (RPC) communication interfaces. GASNet-EX is a portable, high-performance communication middleware library, used by the implementations of UPC++ and many other PGAS programming models. We describe recent advances in GASNet-EX to efficiently implement zero-copy Remote Memory Access (RMA) communication to and from memory on accelerator devices such as GPUs. We demonstrate performance improvements via benchmark results from UPC++ (on Summit) and the Legion programming system (on DGX-1), both using GASNet-EX for communication.

Hargrove, Paul H↗
DOE OSTI2025

Lectures on statistical mechanics

Presented here is a transcription of the lecture notes from Professor Allan N. Kaufman’s graduate statistical mechanics course Physics 212A and 212B at the University of California Berkeley from the 1972–1973 academic year. 212A addressed equilibrium statistical mechanics with topics: fundamentals (micro-canonical and sub-canonical ensembles, adiabatic law and action conservation, fluctuations, pressure, and virial theorem), classical fluids and other systems (equation of state, deviations from ideality, virial coefficients and van der Waals potential, canonical ensemble and partition function, quasistatic evolution, grand-canonical ensemble and partition function, chemical potential, simple model of a phase transition, quantum virial expansion, numerical simulation of equations of state, and phase transition), chemical equilibrium (systems with multiple species and chemical reactions, law of mass action, Saha equation, chemical equilibrium including ionization and excited states), and long-range interactions (including Coulomb, dipole, and gravitational interactions, Debye–Hückel theory, and shielding). 212B addressed nonequilibrium statistical mechanics with topics: fundamentals (definitions: realizations, moments, characteristic function, and discrete variables), Brownian motion (Langevin equation, fluctuation–dissipation theorem, spatial diffusion, Boltzmann’s H-theorem), Liouville and Klimontovich equations, Landau equation (derivation, elaboration, and H-theorem, and irreversibility), Markov processes and Fokker–Planck equation (derivations of the Fokker–Planck equation and a master equation), linear response and transport theory (linear Boltzmann equation, linear response theory of Kubo and Mori, relation of entropy production to electrical conductivity, transport relations and coefficients, normal mode solutions of the transport equations, sketch of a generalized Langevin equation method for transport theory), and an introduction to nonequilibrium quantum statistical mechanics.

plasma dynamics↗
DOE OSTI2021

Phase transition to blob-hole coherent structure in the Hasegawa–Mima model for plasmas

An equilibrium statistical mechanics theory for the Hasegawa–Mima equations of toroidal plasmas, with canonical constraint on energy and microcanonical constraint on potential enstrophy, is solved exactly as a spherical model. The use of a canonical energy constraint instead of a fixed-energy microcanonical approach is justified by the preference for viewing real plasmas as an open system. A significant consequence of the results obtained from the partition function, free energy and critical temperature, is the condensation into a ground state exhibiting a blob-hole-like structure observed in real plasmas.

Physics↗
DOE OSTI2021

Substrate Partitioning into Protein Macromolecular Frameworks for Enhanced Catalytic Turnover

Spatial partitioning of chemical processes is an important attribute of many biological systems, the effect of which is reflected in the high efficiency of enzymes found within otherwise chaotic cellular environments. Barriers, often provided through the formation of compartments or phase segregation, gate the access of macromolecules and small molecules within the cell and provide an added level of metabolic control. Taking inspiration from nature, we have designed virus-like particles (VLPs) as nanoreactor compartments that sequester enzyme catalysts and have used these as building blocks to construct 3D protein macromolecular framework (PMF) materials, which are structurally characterized using small-angle X-ray scattering (SAXS). Additionally, the highly charged PMFs form a separate phase in suspension, and by tuning the ionic strength, we show positively charged molecules preferentially partition into the PMF, while negatively charged molecules are excluded. This molecular partitioning was exploited to tune the catalytic activity of enzymes enclosed within the individual particles in the PMF, the results of which showed that positively charged substrates had turnover rates that were 8500× faster than their negatively charged counterparts. Moreover, the catalytic PMF led to cooperative behavior resulting in charge dependent trends opposite to those observed with individual P22 nanoreactor particles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Local-Field Effects in Linear Response Properties within a Polarizable Frozen Density Embedding Method

In this work, we present a polarizable frozen density embedding (FDE) method for calculating polarizabilities of coupled subsystems. The method (FDE-pol) combines a FDE method with an explicit polarization model such that the expensive freeze/thaw cycles can be bypassed, and approximate nonadditive kinetic potentials are avoided by enforcing external orthogonality between the subsystems. To describe the polarization of the frozen environment, we introduce a Hirshfeld partition-based density-dependent method for calculating the atomic polarizabilities of atoms in molecules, which alleviates the need to fit the atomic parameters to a specific system of interest or to a larger general set of molecules. Further, we show that the Hirshfeld partition-based method predicts molecular polarizabilities close to the basis set limit, and thus, a single basis set-dependent scaling parameter can be introduced to improve the agreement against the reference polarizability data. To test the model, we characterized the uncoupled and coupled response of small interacting molecular complexes. Here, the coupled response properties include the perturbation of the frozen system due to the external perturbation which is ignored in the uncoupled response. We show that FDE-pol can accurately reproduce both the exact uncoupled polarizability and the coupled polarizabilities of the supermolecular systems. Using damped response theory, we also demonstrate that the coupled frequency-dependent polarizability can be described by including local field effects. The results emphasize the necessity of including local-field effects for describing the response properties of coupled subsystems, as well as the importance of accurate atomic polarizability models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Spatial heterogeneity effects on land surface modeling of water and energy partitioning

Abstract. Understanding the influence of land surface heterogeneity on surface water and energy fluxes is crucial for modeling earth system variability and change. This study investigates the effects of four dominant heterogeneity sources on land surface modeling, including atmospheric forcing (ATM), soil properties (SOIL), land use and land cover (LULC), and topography (TOPO). Our analysis focused on their impacts on the partitioning of precipitation (P) into evapotranspiration (ET) and runoff (R), partitioning of net radiation into sensible heat and latent heat, and corresponding water and energy fluxes. An initial set of 16 experiments were performed over the continental US (CONUS) using the E3SM land model (ELMv1) with different combinations of heterogeneous and homogeneous datasets. The Sobol' total and first-order sensitivity indices were utilized to quantify the relative importance of the four heterogeneity sources. Sobol' total sensitivity index measures the total heterogeneity effects induced by a given heterogeneity source, consisting of the contribution from its own heterogeneity (i.e., the first-order index) and its interactions with other heterogeneity sources. ATM and LULC are the most dominant heterogeneity sources in determining spatial variability of water and energy partitioning, mainly contributed by their own heterogeneity and slightly contributed by their interactions with other heterogeneity sources. Their heterogeneity effects are complementary, both spatially and temporally. The overall impacts of SOIL and TOPO are negligible, except TOPO dominates the spatial variability of R/P across the transitional climate zone between the arid western and humid eastern CONUS. Accounting for more heterogeneity sources improves the simulated spatial variability of water and energy fluxes when compared with ERA5-Land reanalysis dataset. An additional set of 13 experiments identified the most critical components within each heterogeneity source, which are precipitation, temperature, and longwave radiation for ATM, soil texture, and soil color for SOIL and maximum fractional saturated area parameter for TOPO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Hierarchical Network Partitioning for Solution of Potential-Driven, Steady-State Nonlinear Network Flow Equations

The solution of potential-driven steady-state flow in large networks is a task which manifests in various engineering applications, such as transport of natural gas or water through pipeline networks. The resultant system of nonlinear equations depends on the network topology, and in general, there is no numerical algorithm that offers guaranteed convergence to the solution (assuming a solution exists). Some methods offer guarantees in cases where the network topology satisfies certain assumptions, but these methods fail for larger networks. On the other hand, the Newton-Raphson algorithm offers a convergence guarantee if the starting point lies close to the (unknown) solution. It would be advantageous to compute the solution of the large nonlinear system through the solution of smaller nonlinear sub-systems wherein the solution algorithms (Newton-Raphson or otherwise) are more likely to succeed. Here, this letter proposes and describes such a procedure, a hierarchical network partitioning algorithm that enables the solution of large nonlinear systems corresponding to potential-driven steady-state network flow equations.

42 ENGINEERING↗
DOE OSTI2021

Thermodynamic analysis of hydrogel swelling in aqueous sodium chloride solutions

Here, a comprehensive thermodynamic model is presented for swelling and salt partitioning of poly (n-isopropyl acrylamide) hydrogels in aqueous sodium chloride (NaCl) solutions at 298 K. Together with a Helmholtz energy expression for network elastic energy, a modified electrolyte Nonradom Two-Liquid activity coefficient model is used to represent both the long-range electrostatic interactions and the short-range van der Waals interactions present in the gel phase. The model parameters include one network parameter per hydrogel system plus two binary parameters per interaction pair in the polymer–solvent-salt systems. With semiquantitave agreement with experimental data for both hydrogel swelling and salt partitioning up to salt saturation, the analysis suggests the ion hydration between NaCl and water is the root cause for hydrogel deswelling in aqueous NaCl solution at high NaCl concentrations, i.e., NaCl weight fraction >0.03. On the other hand, the strong repulsive interaction between NaCl and hydrogel polymer is the dominant factor for salt partitioning.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

CORE-BFS: Communication-Optimized REctangular-partitioned BFS Achieving 160.845 TeraTEPS on Frontier Supercomputer

Distributed Breadth-First Search (BFS) is fundamental to many large-scale graph applications, but its performance on parallel systems is often limited by high communication overhead. This paper presents CORE-BFS, an extremely scalable GPU-based BFS implementation that introduces a unique rectangular 2D partitioning-based design for Frontier supercomputer. To further improve performance, we propose four key optimizations: (1) Rectangular 2D-partition specific data formats that use two compressed row and one compressed column status array bitmaps combined with a Double Compressed Sparse Row (DCSR) format per partition, reducing memory footprint and inter-rank traffic; (2) Adaptive frontier & communication strategy that unifies top-down and bottom-up traversal on the rectangular layout, uses lazy synchronization in top-down levels, and switches variants based on frontier size to minimize communication overhead; (3) Frontier-split degree-aware update that maps frontier vertices to thread-centric, wavefront-centric, and block-centric kernels based on their degree to improve GPU utilization and memory coalescing; (4) Row-reduction pipeline that overlaps bottom-up adjacency list processing with row-wise bitmap reduction to hide inter-rank latency. Together, these techniques increase parallelism while reducing memory and communication overhead. On the Graph500 benchmark, CORE - BFS scales up to 9,248 Frontier nodes with scale-42 graphs and reaches 160.845 TTEPS, delivering a 5.42 × speedup over our previous Frontier implementation.

Yang, Haoshen [Rutgers University]↗
DOE OSTI2020

Deep learning for characterizing the self-assembly of three-dimensional colloidal systems

Creating a systematic framework to characterize the structural states of colloidal self-assembly systems is crucial for unraveling the fundamental understanding of these systems’ stochastic and non-linear behavior. The most accurate characterization methods create high-dimensional neighborhood graphs that may not provide useful information about structures unless these are well-defined reference crystalline structures. Dimensionality reduction methods are thus required to translate the neighborhood graphs into a low-dimensional space that can be easily interpreted and used to characterize non-reference structures. We investigate a framework for colloidal system state characterization that employs deep learning methods to reduce the dimensionality of neighborhood graphs. The framework next uses agglomerative hierarchical clustering techniques to partition the low-dimensional space and assign physically meaningful classifications to the resulting partitions. In this work, we first demonstrate the proposed colloidal self-assembly state characterization framework on a three-dimensional in silico system of 500 multi-flavored colloids that self-assemble under isothermal conditions. We next investigate the generalizability of the characterization framework by applying the framework to several independent self-assembly trajectories, including a three-dimensional in silico system of 2052 colloidal particles that undergo evaporation-induced self-assembly.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Developing Ultrahigh-Resolution E3SM Land Model for GPU Systems

Designing and refactoring complex scientific code, such as the E3SM land model (ELM), for new computing architectures is challenging. This paper presents design strategies and technical approaches to develop a data-oriented, GPU-ready ELM model using compiler directives (OpenACC/OpenMP). We first analyze the datatypes and processes in the original ELM code. Then we present design considerations for ultrahigh-resolution ELM (uELM) development for massive GPU systems. These techniques include the global data-oriented simulation workflow, domain partition, code porting and data copy, memory reduction, parallel loop restructure and flattening, and race condition detection. We implemented the first version of uELM using OpenACC targeting the NVidia GPUs in the Summit supercomputer at Oak Ridge National Laboratory. During the implementation, we developed a software tool (named SPEL) to facilitate code generation, verification, and performance tuning using these techniques. The first uELM implementation for Nvidia GPUs on Summit delivered promising results: 1) over 98% of the ELM code was automatically generated and tuned by scripts. Most ELM modules had better computational performances than the original ELM code for CPUs. The GPU-ready uELM is more scalable than the CPU code on fully-loaded Summit nodes. Example profiling results from several modules are also presented to illustrate the performance improvements and race condition detection. The lessons learned and toolkit developed in the study are also suitable for further uELM deployment using OpenMP on the first US exascale computer, Frontier, equipped with AMD CPUs and GPUs.

Schwartz, Peter↗
DOE OSTI2020

GronOR: Massively Parallel and GPU-Accelerated Non-Orthogonal Configuration Interaction for Large Molecular Systems

GronOR is a program package for non-orthogonal configuration interaction calculations for an electronic wave function built in terms of anti-symmetrized products of multi-configuration molecular fragment wave functions. The two-electron integrals that have to be processed may be expressed in terms of atomic orbitals or in terms of an orbital basis determined from the molecular orbitals of the fragments. The code has been specifically designed for execution on distributed memory massively parallel and Graphics Processing Unit (GPU)-accelerated computer architectures, using an MPI+OpenACC/OpenMP programming approach. The task-based execution model used in the implementation allows for linear scaling with the number of nodes on the largest pre-exascale architectures available, provides hardware fault resiliency, and enables effective execution on systems with distinct central processing unit-only and GPU-accelerated partitions. The code interfaces with existing multi-configuration electronic structure codes that provide optimized molecular fragment orbitals, configuration interaction coefficients, and the required integrals. Algorithm and implementation details, parallel and accelerated performance benchmarks, and an analysis of the sensitivity of the accuracy of results and computational performance to thresholds used in the calculations are presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Nitrogen Source Governs Community Carbon Metabolism in a Model Hypersaline Benthic Phototrophic Biofilm

Increasing anthropogenic inputs of fixed nitrogen are leading to greater eutrophication of aquatic environments, but it is unclear how this impacts the flux and fate of carbon in lacustrine and riverine systems. Here, we present evidence that the form of nitrogen governs the partitioning of carbon among members in a genome-sequenced, model phototrophic biofilm of 20 members. Consumption of NO 3 – as the sole nitrogen source unexpectedly resulted in more rapid transfer of carbon to heterotrophs than when NH 4 + was also provided, suggesting alterations in the form of carbon exchanged. The form of nitrogen dramatically impacted net community nitrogen, but not carbon, uptake rates. Furthermore, this alteration in nitrogen form caused very large but focused alterations to community structure, strongly impacting the abundance of only two species within the biofilm and modestly impacting a third member species. Our data suggest that nitrogen metabolism may coordinate coupled carbon-nitrogen biogeochemical cycling in benthic biofilms and, potentially, in phototroph-heterotroph consortia more broadly. It further indicates that the form of nitrogen inputs may significantly impact the contribution of these communities to carbon partitioning across the terrestrial-aquatic interface.

carbon cycling↗
DOE OSTI2020

Dominant Wave Energy Systems and Conditional Wave Resource Characterization for Coastal Waters of the United States

Opportunities and constraints for wave energy conversion technologies and projects are evaluated by identifying and characterizing the dominant wave energy systems for United States (US) coastal waters using marginal and joint distributions of the wave energy in terms of the peak period, wave direction, and month. These distributions are computed using partitioned wave parameters generated from a 30 year WaveWatch III model hindcast, and regionally averaged to identify the dominant wave systems contributing to the total annual available energy ( A A E ) for eleven distinct US wave energy climate regions. These dominant wave systems are linked to the wind systems driving their generation and propagation. In addition, conditional resource parameters characterizing peak period spread, directional spread, and seasonal variability, which consider dependencies of the peak period, direction, and month, are introduced to augment characterization methods recommended by international standards. These conditional resource parameters reveal information that supports project planning, conceptual design, and operation and maintenance. The present study shows that wave energy resources for the United States are dominated by long-period North Pacific swells (Alaska, West Coast, Hawaii), short-period trade winds and nor’easter swells (East Coast, Puerto Rico), and wind seas (Gulf of Mexico). Seasonality, peak period spread, and directional spread of these dominant wave systems are characterized to assess regional opportunities and constraints for wave energy conversion technologies targeting the dominant wave systems.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

A Greening Future Elevates Flash Drought Risk in Northern Mid‐to‐High Latitudes

Flash droughts have become a growing concern, as they can emerge rapidly and increase the risk of crop failure. Although past studies have investigated the meteorological drivers and future changes of flash drought, why flash drought is more frequent over humid and vegetated regions remains underexplored. This study delves further into the mechanism by which vegetation regulates flash drought and its future change using observations from multiple data sets and large ensemble simulations from three Earth system models. On an interannual timescale, both observations and simulations show robust increases in flash drought frequency and a higher flash-to-sub-seasonal drought ratio during spring or antecedent conditions with dense vegetation, supporting the important role of vegetation in flash drought occurrence, especially in the northern mid-to-high latitudes. In the latter regions, the large ensemble simulations show robust increases in flash drought (e.g., 67% and 46% increases in Eastern U.S. and North Asia in 2050–2100 relative to 1950–2000 under the high emission scenario), where the growing season is lengthening. Although greening might suggest reduced drought stress, it drives precipitation-soil moisture-evapotranspiration decoupling by increasing evapotranspiration partitioning to transpiration. As transpiration can access deep soil water through the plant root system, its increased portion can weaken the constraints of concurrent precipitation on evapotranspiration, thus accelerating soil moisture depletion under high evaporative demand, driving a slow-to-rapid drought transition. How vegetation regulates flash drought by regulating surface moisture budget is supported by observations and simulations. Although warming supports early planting, agriculture may increasingly be threatened by surging flash drought risk.

Drought↗