Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Next Generation Workload Management System For Big Data on Heterogeneous Distributed Computing

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS and ALICE are the largest collaborations ever assembled in the sciences and are at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, both experiments rely on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System (WMS) for managing the workflow for all data processing on hundreds of data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. The scale is demonstrated by the following numbers: PanDA manages O(10 2 ) sites, O(10 5 ) cores, O(10 8 ) jobs per year, O(10 3 ) users, and ATLAS data volume is O(10 17 ) bytes. In 2013 we started an ambitious program to expand PanDA to all available computing resources, including opportunistic use of commercial and academic clouds and Leadership Computing Facilities (LCF). The project titled 'Next Generation Workload Management and Analysis System for Big Data' (BigPanDA) is funded by DOE ASCR and HEP. Extending PanDA to clouds and LCF presents new challenges in managing heterogeneity and supporting workflow. The BigPanDA project is underway to setup and tailor PanDA at the Oak Ridge Leadership Computing Facility (OLCF) and at the National Research Center "Kurchatov Institute" together with ALICE distributed computing and ORNL computing professionals. Our approach to integration of HPC platforms at the OLCF and elsewhere is to reuse, as much as possible, existing components of the PanDA system. Finally, we will present our current accomplishments with running the PanDA WMS at OLCF and other supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications.

97 MATHEMATICS AND COMPUTING↗

Subhaloes are anisotropically distributed and aligned with the smooth matter distribution of their host haloes

ABSTRACT We investigate the distributions of subhaloes about their hosts in two suites of zoom-in N-body simulations of halo growth – one suite focused on Milky Way-Mass haloes ($\sim 10^{12} \, \mathrm{M}_{\odot }$) and another focused on cluster-mass haloes ($\sim 10^{15} \, \mathrm{M}_{\odot }$) in the Symphony simulation suite. We find, in agreement with previous work on this subject, that subhaloes are distributed anisotropically about their host haloes. In particular, the positions of subhaloes lie preferentially near the major axes of their host haloes, possibly implying that satellite galaxies will exhibit a similar alignment. Furthermore, we show that in two-dimensional projection subhaloes are more likely to be observed near the halo centre (where the central galaxy presumably resides) when the host halo is projected nearly along its major axis. This projection effect is significant. Within projected radii of a few per cent of the virial radius of the host halo, the fraction of mass in subhaloes is $\sim 175~{{\ \rm per\ cent}}$ larger for Milky Way-mass haloes and as much as $\sim 195~{{\ \rm per\ cent}}$ larger for cluster haloes when projected along the major axis as compared to the average from a random projection. This result has consequences for many applications including the interpretation of gravitational lenses. Finally, we find that the orbital angular momentum vector of subhaloes is aligned with the angular momentum vector of their host halo, indicating that a significant component of a halo’s angular momentum may be carried in its subhaloes. This has consequences for galaxy formation models which use host halo angular momentum as a proxy for galaxy momentum.

Mezini, Lorena (ORCID:0000000300053973)↗

Survival function analysis of planet size distribution with Gaia Data Release 2 updates

Applying the survival function analysis to the planet radius distribution of the Kepler confirmed/candidate planets, we have identified two natural divisions of planet radius at 4 Earth radii (R ⊕ ) and 10 R ⊕ . These divisions place constraints on planet formation and interior structure model. The division at 4 R ⊕ separates small exoplanets from large exoplanets above. When combined with the recently discovered radius gap at 2 R ⊕ , it supports the treatment of planets in between 2 and 4 R ⊕ as a separate group, likely water worlds. For planets around solar-type FGK main-sequence stars, we argue that 2 R ⊕ is the separation between water-poor and water-rich planets, and 4 R ⊕ is the separation between gas-poor and gas-rich planets. Here, we confirm the slope of the survival function in between 4 and 10 R ⊕ to be shallower compared to either ends, indicating a relative paucity of planets in between 4 and 10 R ⊕ , namely the sub-Saturnian desert there. We name them transitional planets, as they form a bridge between the gas-poor small planets and gas giants. Accordingly, we propose the following classification scheme: (<2 R ⊕ ) rocky planets, (2–4 R ⊕ ) water worlds, (4–10 R ⊕ ) transitional planets, and (>10 R ⊕ ) gas giants.

79 ASTRONOMY AND ASTROPHYSICS↗

Umbrella sampling: a powerful method to sample tails of distributions

We present the umbrella sampling (US) technique and show that it can be used to sample extremely low-probability areas of the posterior distribution that may be required in statistical analyses of data. In this approach sampling of the target likelihood is split into sampling of multiple biased likelihoods confined within individual umbrella windows. We show that the US algorithm is efficient and highly parallel and that it can be easily used with other existing Markov Chain Monte Carlo (MCMC) samplers. The method allows the user to capitalize on their intuition and define umbrella windows and increase sampling accuracy along specific directions in the parameter space. Alternatively, one can define umbrella windows using an approach similar to parallel tempering. We provide a public code that implements US as a standalone PYTHON package. We present a number of tests illustrating the power of the US method in sampling low-probability areas of the posterior and show that this ability allows a considerably more robust sampling of multimodal distributions compared to standard sampling methods. We also present an application of the method in a real world example of deriving cosmological constraints using the supernova type Ia data. We show that US can sample the posterior accurately down to the approximate to 15 sigma credible region in the Omega(m) - Omega(Lambda) plane, while for the same computational effort the affine-invariant MCMC sampling implemented in the emcee code samples the posterior reliably only to approximate to 3 sigma.

cosmology: cosmological parameters↗

Next-to-Leading Order Predictions for W + 3-Jet Distributions at Hadron Colliders

We present next-to-leading order QCD predictions for a variety of distributions in W + 3-jet production at both the Tevatron and the Large Hadron Collider. We include all subprocesses and incorporate the decay of the W boson into leptons. Our results are in excellent agreement with existing Tevatron data and provide the first quantitatively precise next-to-leading order predictions for the LHC. We include all terms in an expansion in the number of colors, confirming that the specific leading-color approximation used in our previous study is accurate to within three percent. The dependence of the cross section on renormalization and factorization scales is reduced significantly with respect to a leading-order calculation. We study different dynamical scale choices, and find that the total transverse energy is significantly better than choices used in previous phenomenological studies. We compute the one-loop matrix elements using on-shell methods, as numerically implemented in the BlackHat code. The remaining parts of the calculation, including generation of the real-emission contributions and integration over phase space, are handled by the SHERPA package.

43 PARTICLE ACCELERATORS↗

Transverse-Momentum and Pseudorapidity Distributions of Charged Hadrons in pp Collisions at {radical}(s)=7 TeV

Charged-hadron transverse-momentum and pseudorapidity distributions in proton-proton collisions at {radical}(s)=7 TeV are measured with the inner tracking system of the CMS detector at the LHC. The charged-hadron yield is obtained by counting the number of reconstructed hits, hit pairs, and fully reconstructed charged-particle tracks. The combination of the three methods gives a charged-particle multiplicity per unit of pseudorapidity dN{sub ch}/d{eta}|{sub |{eta}|<0.5}=5.78{+-}0.01(stat){+-}0.23(syst) for non-single-diffractive events, higher than predicted by commonly used models. The relative increase in charged-particle multiplicity from {radical}(s)=0.9 to 7 TeV is [66.1{+-}1.0(stat){+-}4.2(syst)]%. The mean transverse momentum is measured to be 0.545{+-}0.005(stat){+-}0.015(syst) GeV/c. The results are compared with similar measurements at lower energies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Pair distribution functions of amorphous organic thin films from synchrotron X-ray scattering in transmission mode

Using high-brilliance high-energy synchrotron X-ray radiation, for the first time the total scattering of a thin organic glass film deposited on a strongly scattering inorganic substrate has been measured in transmission mode. The organic thin film was composed of the weakly scattering pharmaceutical substance indomethacin in the amorphous state. The film was 130 µm thick atop a borosilicate glass substrate of equal thickness. The atomic pair distribution function derived from the thin-film measurement is in excellent agreement with that from bulk measurements. This ability to measure the total scattering of amorphous organic thin films in transmission will enable accurate in situ structural studies for a wide range of materials.

36 MATERIALS SCIENCE↗

Exploring the Landscape of Distributed Graph Clustering on Leadership Supercomputers

The rapid growth of large-scale datasets in fields like biology and social networks has driven the need for advanced graph analytics techniques. Community detection, a fundamental task in graph analytics, identifies closely connected groups of nodes within a network, providing valuable insights across various disciplines. This study focuses on two classic community detection methods, the Louvain algorithm and Markov Clustering (MCL), and evaluates the performance of two prominent distributed community detection algorithms: HiPDPL-GPU, our prior implementation, and HipMCL. We conduct experiments on GPU-accelerated heterogeneous HPC systems, Summit and Frontier, to assess their performance under varying conditions. Our objective is to identify the strengths and weaknesses of these algorithms in terms of scalability, and quality of solutions. We evaluate these algorithms on a diverse set of 70+ networks spanning 13 domains, with sizes ranging up to 4.2 billion edges. Our results demonstrate that HiPDPL-GPU consistently outperforms HipMCL, especially for large-scale networks. HiPDPL-GPU achieves significantly faster runtimes (47x to 1439x), higher modularity scores, and improved scalability. These findings highlight HiPDPL-GPU as a promising solution for efficient and effective large-scale graph analytics in diverse application domains, and provide insights into the feasibility of using MCL-based approaches for certain application domains.

Community detection, graph algorithms↗

Dynamic Distribution Voltage Stability Control Using Distributed Energy Resources for Improved Resiliency

The main goal of this paper is to present the development and simulation of a new dynamic voltage stability control technique, with a focus on effective control and coordination of all available reactive power generation resources in a microgrid setting. Both power electronics and synchronous generator based distributed energy resources (DERs), and grid-supporting functions, are considered to accommodate a high penetration of diverse DERs and energy storage by using an enhanced microgrid voltage stabilizer. A systematic controller parameter synthesizing method is employed, and the overall dynamic voltage stability of the system is studied and evaluated with a time-domain dynamic simulation during emergency, hazard and disaster events. The results with the new approach show significant improvements and enhancements on the dynamic voltage profile of the distribution system, leading towards a more resilient grid system with high penetration of diverse DERs during emergency, hazard and disaster events.

Hatipoglu, Kenan↗

Model Predictive Control-based Optimal Coordination of Distributed Energy Resources

Distributed energy resources, such as renewable energy resources (wind, solar), energy storage and demand response, can be used to complement conventional generators. The uncertainty and variability due to high penetration of wind makes reliable system operations and controls challenging, especially in isolated systems. In this paper, an optimal control strategy is proposed to coordinate energy storage and diesel generators to maximize wind penetration while maintaining system economics and normal operation performance. The goals of the optimization problem are to minimize fuel costs and maximize the utilization of wind while considering equipment life of generators and energy storage. Model predictive control (MPC) is used to solve a look-ahead dispatch optimization problem and the performance is compared to an open loop look-ahead dispatch problem. Simulation studies are performed to demonstrate the efficacy of the closed loop MPC in compensating for uncertainties and variability caused in the system.

Mayhorn, Ebony T.↗

Distributed Workflows for Modeling Experimental Data

Modeling helps explain the fundamental physics hidden behind experimental data. In the case of material modeling, running one simulation rarely results in output that reproduces the experimental data. Often one or more of the force field parameters are not precisely known and must be optimized for the output to match that of the experiment. Since the simulations require high performance computing (HPC) resources and there are usually many simulations to run, a workflow is very useful to prevent errors and assure that the simulations are identical except for the parameters that need to be varied. These workflows are usually distributed because the simulations require HPC, but the optimization and steps to compare the simulation results and experimental data are done on a local workstation. We will present results from force field refinement of data collected at the Spallation Neutron Source using Kepler, Pegasus, and Beam workflows and discuss what we have learned from using these workflows.

Lynch, Vickie E.↗

Distributed Macroscopic Traffic Simulation with Open Traffic Models

This paper presents OTM-MPI, an extension of the Open Traffic Models platform (OTM) for running macroscopic traffic simulations in high-performance computing environments. OTM-MPI represents the first open-source, distributed-memory, macroscopic simulation model developed for modern high performance parallel machines and large networks. Macroscopic simulations are appropriate for studying regional traffic scenarios when aggregate trends are of interest, rather than individual vehicle traces. They are also appropriate for studying the routing behavior of classes of vehicles, such as app-informed vehicles. The network partitioning was performed with METIS. Inter-process communication was done with MPI (message-passing interface). Results are provided for two networks: one realistic network which was obtained from Open Street Maps for Chattanooga, TN, and another larger synthetic grid network. The software recorded a speedups of 198x using 256 cores for Chattanooga, and 475x with 1,024 cores for the synthetic network.

macro-scopic traffic simulation↗

Restoration using Distributed Energy Resources for Resilient Power Distribution Networks

In this paper, we propose a restorative method to minimize the unserved demand in a power distribution network where some islands are formed due to multiple line outages. The restoration is achieved by tie-line switching and by solving a mixed-integer non-linear problem. Due to combinatorial issues of the optimization problem, a method is proposed which restores the system by setting up microgrids boundaries within the islands and connecting them through tie-lines for exchange of active power in between them. The optimal tie-line to interconnect the microgrids is decided through information exchange between the microgrid operators. Case studies on IEEE 33-bus distribution network is presented to illustrate the results and validate the performance of the proposed method.

Sarkar, Ranadhir↗