Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

NWChem: scalable parallel computational chemistry

NWChem is a general purpose computational chemistry code specifically designed to run on distributed memory parallel computers. The core functionality of the code focuses on molecular dynamics, Hartree-Fock and density functional theory methods for both plane-wave basis sets as well as Gaussian basis sets, tensor contraction engine based coupled cluster capabilities and combined quantum mechanics/molecular mechanics descriptions. It was realized from the beginning that scalable implementations of these methods required a programming paradigm inherently different from what message passing approaches could offer. In response a global address space library, the Global Array Toolkit, was developed. The programming model it offers is based on using predominantly one-sided communication. This model underpins most of the functionality in NWChem and the power of it is exemplified by the fact that the code scales to tens of thousands of processors. In this paper the core capabilities of NWChem are described as well as their implementation to achieve an efficient computational chemistry code with high parallel scalability. NWChem is a modern, open source, computational chemistry code1 specifically designed for large scale parallel applications2. To meet the challenges of developing efficient, scalable and portable programs of this nature a particular code design was adopted. This code design involved two main features. First of all, the code is build up in a modular fashion so that a large variety of functionality can be integrated easily. Secondly, to facilitate writing complex parallel algorithms the Global Array toolkit was developed. This toolkit allows one to write parallel applications in a shared memory like approach, but offers additional mechanisms to exploit data locality to lower communication overheads. This framework has proven to be very successful in computational chemistry but is applicable to any engineering domain. Within the context created by the features above NWChem has grown into a general purpose computational chemistry code that supports a wide variety of energy expressions and capabilities to calculate properties based there upon. The main energy expressions are classical mechanics force fields, Hartree-Fock and DFT both for finite systems and condensed phase systems, coupled cluster, as well as QM/MM. For most energy expressions single point calculations, geometry optimizations, excited states, and other properties are available. Below we briefly discuss each of the main energy expressions and the critical points involved in scalable implementations thereof.

99 GENERAL AND MISCELLANEOUS↗

Quantum Divide and Compute: Exploring the Effect of Different Noise Sources

Abstract Our recent work (Ayral et al. in Proceedings of IEEE computer society annual symposium on VLSI, ISVLSI, pp 138–140, 2020. 10.1109/ISVLSI49217.2020.00034 ) showed the first implementation of the Quantum Divide and Compute (QDC) method, which allows to break quantum circuits into smaller fragments with fewer qubits and shallower depth. This accommodates the limited number of qubits and short coherence times of quantum processors. This article investigates the impact of different noise sources—readout error, gate error and decoherence—on the success probability of the QDC procedure. We perform detailed noise modeling on the Atos Quantum Learning Machine, allowing us to understand tradeoffs and formulate recommendations about which hardware noise sources should be preferentially optimized. We also describe in detail the noise models we used to reproduce experimental runs on IBM’s Johannesburg processor. This article also includes a detailed derivation of the equations used in the QDC procedure to compute the output distribution of the original quantum circuit from the output distribution of its fragments. Finally, we analyze the computational complexity of the QDC method for the circuit under study via tensor-network considerations, and elaborate on the relation the QDC method with tensor-network simulation methods.

97 MATHEMATICS AND COMPUTING↗

Tools Assessing Performance (TAP) 2.0

Dmitry Duplyakin will be presenting on the latest research and results in the Tools Assessing Performance (TAP) 2.0 project. This presentation will include updates on the latest data the group has produced, integration of obstacle models in the computational pipeline for distributed wind siting, and the plans for the near-term analysis and validation efforts. The talk will acknowledge the work of collaborators from NREL and three other national labs - ANL, LANL, and PNNL - all contributing to this multi-year project.

distributed wind↗

Numerical Analysis of Liquid Metal MHD Flow and Heat Transfer for Open-Surface Li Divertor in FNSF

Within the ongoing U.S.-based program on the development of liquid metal plasma-facing components, numerical simulations and analyses are performed to address the feasibility of the open-surface Li divertor. In the previous scoping studies (Smolentsev, 2021), heat-removal capabilities of the divertor were assessed using a simplified flow model for a slug-type velocity profile and constant flow thickness. Here, new analyses take into account forces acting on the flowing Li layer. Three reduced-order mathematical models are applied under the conditions of the U.S. Fusion Nuclear Science Facility (FNSF) to access magnetohydrodynamic (MHD) flow development effects, velocity distribution, and surface waves: 1) fully developed MHD flow; 2) quasi-2-D developing MHD flow; and 3) multiphase MHD flow. The obtained results for MHD flows and the surface heat flux computed with the plasma code scrape-off layer plasma simulation for ITER (SOLPS-ITER) are then used as input data to compute the temperature distribution in the divertor by solving the convection–diffusion energy equation.

Smolentsev, Sergey↗

Efficient Phasor-Based Dynamic Volt/VAr and Volt/Watt Analysis of Large Distribution Grid with High Penetration of Smart Inverters

As the penetration of power-electronics based smart inverters (SIs) is increasing in distribution grids, it adds computational challenges in solving dynamic models of large-scale distribution feeders. Voltage and reactive power (Volt/VAr), and voltage and active power (Volt/Watt) dynamics have been analyzed at slower time scales akin to the control of legacy grid devices. However, smart inverters, being power-electronics based devices, can provide dynamic active/reactive power support at a faster time scale, which necessitates Volt/VAr and Volt/Watt dynamics to be analyzed at a faster time scale. The existing dynamic models are overly detailed and computationally intractable for distribution feeders with a large number of inverters. In this context, this proposed work aims towards developing a computationally tractable, scalable, and accurate phasor-based model for dynamic Volt/VAr and Volt/Watt analyses of large distribution systems with high penetration of smart inverters. Case studies demonstrate that the proposed phasor-based model sufficiently captures the Volt/VAr and Volt/Watt dynamics, and is computationally faster by one order of magnitude compared to the average model and by two orders of magnitude compared to the detailed switching model. Case studies also demonstrate the efficacy and scalability of the proposed model in analyzing Volt/VAr and Volt/Watt dynamics of large-scale power networks with hundreds of SIs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Gamma-ray momentum reconstruction from Compton electron trajectories by filtered back-projection

Gamma-ray imaging utilizing Compton scattering has traditionally relied on measuring coincident gamma-ray interactions to map directional information of the source distribution. This coincidence requirement makes it an inherently inefficient process. We present an approach to gamma-ray reconstruction from Compton scattering that requires only a single electron tracking detector, thus removing the coincidence requirement. From the Compton scattered electron momentum distribution, our algorithm analytically computes the incident photon's correlated direction and energy distributions. Because this method maps the source energy and location, it is useful in applications, where prior information about the source distribution is unknown. We demonstrate this method with electron tracks measured in a scientific Si charge coupled device. While this method was demonstrated with electron tracks in a Si-based detector, it is applicable to any detector that can measure electron direction and energy, or equivalently the electron momentum. For example, it can increase the sensitivity to obtain energy and direction in gas-based systems that suffer from limited efficiency.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Lustre Distributed Name Space (DNE) Evaluation at the Oak Ridge Leadership Computing Facility (OLCF)

This document describes the Lustre Distributed Name Space (DNE) evaluation carried at the Oak Ridge Leadership Computing Facility (OLCF) between 2014 and 2015. DNE is a development project funded by the OpenSFS, to improve Lustre metadata performance and scalability. The development effort has been split into two parts, the first part (DNE P1) providing support for remote directories over remote Lustre Metadata Server (MDS) nodes and Metadata Target (MDT) devices, while the second phase (DNE P2) addressed split directories over multiple remote MDS nodes and MDT devices. The OLCF have been actively evaluating the performance, reliability, and the functionality of both DNE phases. For these tests, internal OLCF testbed were used. Results are promising and OLCF is planning on a full DNE deployment by mid-2016 timeframe on production systems.

97 MATHEMATICS AND COMPUTING↗

Visualization and prediction of supercritical CO 2 distribution in sandstones during drainage: An in situ synchrotron X-ray micro-computed tomography study

Pore-scale distribution of supercritical CO 2 (scCO 2 ) exerts significant control on a variety of key hydrologic as well as geochemical processes, including residual trapping and dissolution. Despite such importance, only a small number of experiments have directly characterized the three-dimensional distribution of scCO 2 in geologic materials during the invasion (drainage) process. Here, we present a study which couples dynamic high-resolution synchrotron X-ray micro-computed tomography imaging of a scCO 2 /brine system at in situ pressure/temperature conditions with quantitative pore-scale modeling to allow direct validation of a pore-scale description of scCO2 distribution. The experiment combines high-speed synchrotron radiography with tomography to characterize the brine saturated sample, the scCO 2 breakthrough process, and the partially saturated state of a sandstone sample from the Domengine Formation, a regionally extensive unit within the Sacramento Basin (California, USA). The availability of a 3D dataset allowed us to examine correlations between grains and pores morphometric parameters and the actual distribution of scCO 2 in the sample, including the examination of the role of small-scale sedimentary structure on CO2 distribution. The segmented scCO 2 /brine volume was also used to validate a simple computational model based on the local thickness concept, able to accurately simulate the distribution of scCO 2 after drainage. The same method was also used to simulate Hg capillary pressure curves with satisfactory results when compared to the measured ones. Finally, this predictive approach, requiring only a tomographic scan of the dry sample, proved to be an effective route for studying processes related to CO 2 invasion structure in geological samples at the pore scale.

3D quantitative morphometric analysis↗

High-Q cavity interface for color centers in thin film diamond

Quantum information technology offers the potential to realize unprecedented computational resources via secure channels distributing entanglement between quantum computers. Diamond, as a host to optically-accessible spin qubits, is a leading platform to realize quantum memory nodes needed to extend such quantum links. Photonic crystal (PhC) cavities enhance light-matter interaction and are essential for an efficient interface between spins and photons that are used to store and communicate quantum information respectively. Here, we demonstrate one- and two-dimensional PhC cavities fabricated in thin-film diamonds, featuring quality factors (Q) of 1.8 × 10 5 and 1.6 × 10 5 , respectively, the highest Qs for visible PhC cavities realized in any material. Importantly, our fabrication process is simple and high-yield, based on conventional planar fabrication techniques, in contrast to the previous with complex undercut processes. We also demonstrate fiber-coupled 1D PhC cavities with high photon extraction efficiency, and optical coupling between a single SiV center and such a cavity at 4 K achieving a Purcell factor of 18. The demonstrated photonic platform may fundamentally improve the performance and scalability of quantum nodes and expedite the development of related technologies.

97 MATHEMATICS AND COMPUTING↗

Distributed Real-Time Simulation and its Applications to Wind Energy Research

This paper presents a novel approach - distributed Real-Time Simulations (RTS) - for innovative wind energy and grid integration research. Distributed RTS is performed with Digital Real-Time Simulators (DRTS) in different geographical locations and connected over the Internet. Geographically distributed RTS supports - higher computation capability for RTS, leveraging distributed assets, novel testing techniques and hybridized smart grid testbeds. This paper discusses some of the basic aspects of distributed RTS with the communication delay as a probabilistic variable. To leverage hardware resources and enable flexible collaboration of national laboratories, the distributed RTS connection between the simulators at Idaho National Laboratory (INL) and National Wind Test Center (NWTC) at National Renewable Energy Laboratory (NREL) is established. The main objective of this distributed lab setup is to perform wind turbine characterization and assessment of wind integration studies in large scale grids. Several systematic steps based on integrating models are carried out to assess the impact of communication delay on distributed RTS.

17 WIND ENERGY↗

Distributed Augmentation, Hypersweeps, and Branch Decomposition of Contour Trees for Scientific Exploration

Contour trees describe the topology of level sets in scalar fields and are widely used in topological data analysis and visualization. A main challenge of utilizing contour trees for large-scale scientific data is their computation at scale using highperformance computing. To address this challenge, recent work has introduced distributed hierarchical contour trees for distributed computation and storage of contour trees. However, effective use of these distributed structures in analysis and visualization requires subsequent computation of geometric properties and branch decomposition to support contour extraction and exploration. In this work, we introduce distributed algorithms for augmentation, hypersweeps, and branch decomposition that enable parallel computation of geometric properties, and support the use of distributed contour trees as query structures for scientific exploration. Finally, we evaluate the parallel performance of these algorithms and apply them to identify and extract important contours for scientific visualization.

97 MATHEMATICS AND COMPUTING↗

Comparison of fixed charge and polarizable models for predicting the structural, thermodynamic, and transport properties of molten alkali chlorides

Results from extensive molecular dynamics simulations of molten LiCl, NaCl, KCl, and RbCl over a wide range of temperatures are reported. Comparison is made between the “Polarizable Ion Model” (PIM) and the non-polarizable “Rigid Ion Model” (RIM). Densities, self-diffusivities, shear viscosities, ionic conductivities, and thermal conductivities are computed and compared with experimental data. In addition, radial distribution functions are computed from ab initio molecular dynamics simulations and compared with the two sets of classical simulations as well as experimental data. Here, the two classical models perform reasonably well at capturing structural and dynamic properties of the four molten alkali chlorides, both qualitatively and often quantitatively. With the singular exception of liquid density, for which the PIM is more accurate than the RIM, there are few clear trends to suggest that one model is more accurate than the other for the four alkali halide systems studied here.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Phase distribution in Fischer-Tropsch mimicked slurry bubble column via computed tomography

This study aims to investigate the phases distribution and hydrodynamics in an air-Therminol LT-glass beads slurry bubble column reactor in bubbly and churn-turbulent flow regimes by implementing a gamma-ray computed tomography. It is found that gas holdup increases with increasing superficial gas velocity and operating pressure while increasing solids loading has an opposite effect on gas holdup measurements. It is noticed that the pressure effect is more significant at high solids loading and the solids loading is relatively more substantial at lower pressure. Solids loading has the most significant a stronger effect on the solids holdup profile than on the gas holdup profile. Current results were compared with the Sedimentation-Dispersion Model (SDM) predictions. Overall, the findings of this study advance the knowledge of the true behavior of phases distribution in FT mimicked slurry bubble columns which are pertinent in designing such reactors.

42 ENGINEERING↗

Inverse Modeling of Hydrologic Parameters in CLM4 via Generalized Polynomial Chaos in the Bayesian Framework

In this work, generalized polynomial chaos (gPC) expansion for land surface model parameter estimation is evaluated. We perform inverse modeling and compute the posterior distribution of the critical hydrological parameters that are subject to great uncertainty in the Community Land Model (CLM) for a given value of the output LH. The unknown parameters include those that have been identified as the most influential factors on the simulations of surface and subsurface runoff, latent and sensible heat fluxes, and soil moisture in CLM4.0. We set up the inversion problem in the Bayesian framework in two steps: (i) building a surrogate model expressing the input–output mapping, and (ii) performing inverse modeling and computing the posterior distributions of the input parameters using observation data for a given value of the output LH. The development of the surrogate model is carried out with a Bayesian procedure based on the variable selection methods that use gPC expansions. Our approach accounts for bases selection uncertainty and quantifies the importance of the gPC terms, and, hence, all of the input parameters, via the associated posterior probabilities.

97 MATHEMATICS AND COMPUTING↗

Analysis of Shutdown Dose Rate in Fusion Energy Systems Using Hybrid Monte Carlo/Deterministic Techniques - Paper 138

Accurate assessments of shutdown dose rate (SDDR) are critical to support operation, maintenance, and waste disposal planning and to guide possible design changes of critical components in fusion energy systems. An SDDR calculation involves three steps: 1. a neutron transport calculation to determine the space and energy neutron flux distributions, 2. an activation calculation for computing the photon source distribution, and 3. a photon transport calculation for the estimation of the final SDDR. A companion paper describes the challenges of SDDR computations in fusion energy systems and the status of the techniques that are currently being used in SDDR analysis. Of these techniques, the rigorous 2-step (R2S) computational system entails Monte Carlo (MC) neutron and photon transport calculations coupled with a comprehensive activation step using a dedicated inventory code and library. The use of global MC variance reduction techniques was suggested for accelerating the SDDR MC neutron transport calculation. These techniques, which attempt to calculate MC tallies with nearly uniform relative uncertainties in both the low-flux space-energy regions and the high-flux space-energy regions, do not preferentially focus the MC computational efforts toward space-energy regions of high importance to the final decay dose. The ability of these approaches to accurately predict SDDR is inhibited by their prohibitive computational costs, which will be on the order of thousands of processor-years for full-scale modeling of an entire fusion plant. The companion paper describes the theoretical background of the Multi-Step Consistent Adjoint Driven Importance Sampling (MS-CADIS) method, which has been proposed to speed up SDDR MC neutron calculations. The MS-CADIS method uses the CADIS method, which has been successfully used for more than a decade in shielding calculations, but focuses on multistep shielding calculations such as SDDR analyses. The companion paper also describes a new method for calculating the uncertainties in SDDR due to uncertainties in the MC neutron calculation. This new method of uncertainty propagation uses the MS-CADIS neutron adjoint source to propagate the uncertainties in the neutron fluxes to the SDDR. This paper describes the application of the MS-CADIS method for speeding up the SDDR MC calculations and for calculating the SDDR uncertainty due to the neutron flux uncertainties. A new metric for assessing the reliability of SDDR calculations was also suggested and used in this analysis. The ITER benchmark problem was used in this analysis. The problem resembles the configuration and geometrical arrangement of an upper port plug in ITER. The analysis compared the efficiency of the MS-CADIS method to the traditional approach of using global MC variance reduction techniques for speeding up SDDR MC neutron calculation. The application of the MS-CADIS method to SDDR calculations in fusion energy systems was tested using the ITER benchmark problem. Compared to the standard FW-CADIS method, the increase in the efficiency of the SDDR neutron MC calculation due to the use of the MS-CADIS method was between 18% and 69%. The MS-CADIS method also increases the fraction of non-zero-scoring mesh tally elements in the space-energy regions of high importance to the final SDDR. Implementation of the MS-CADIS method in the SCALE and the ADVANTG code systems is currently under way. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Supporting shared resource usage for a diverse user community: The OSG experience and lessons learned

The Open Science Grid (OSG) supports a diverse community of new and existing users in adopting and making effective use of the Distributed High Throughput Computing (DHTC) model. The LHC user community has deep local support within the experiments. For other smaller communities and individual users the OSG provides consulting and technical services through the User Support area. We describe these sometimes successful and sometimes not so successful experiences and analyze lessons learned that are helping us improve our services. The services offered include forums to enable shared learning and mutual support, tutorials and documentation for new technology, and troubleshooting of problematic or systemic failure modes. For new communities and users, we bootstrap their use of the distributed high throughput computing technologies and resources available on the OSG by following a phased approach. We first adapt the application and run a small production campaign on a subset of friendly sites. Only then do we move the user to run full production campaigns across the many remote sites on the OSG, adding to the community resources up to hundreds of thousands of CPU hours per day. This scaling up generates new challenges - like no determinism in the time to job completion, and diverse errors due to the heterogeneity of the configurations and environments - so some attention is needed to get good results. We cover recent experiences with image simulation for the Large Synoptic Survey Telescope (LSST), small-file large volume data movement for the Dark Energy Survey (DES), civil engineering simulation with the Network for Earthquake Engineering Simulation (NEES), and accelerator modeling with the Electron Ion Collider group at BNL. We will categorize and analyze the use cases and describe how our processes are evolving based on lessons learned.

Garzoglio, Gabriele↗