Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Portable Software Environment for Ultrahigh-Resolution ELM Development on GPUs

This paper presents our endeavors in developing the large-scale, ultra-high-resolution E3SM Land Model (uELM), specifically designed for exascale computers furnished with accelerators such as Nvidia GPUs. The uELM is a sophisticated code that substantially relies on High-Performance Computing (HPC) environments, necessitating particular machine and software configurations. To facilitate community-based uELM developments employing GPUs, we have created a portable, standalone software environment preconfigured with uELM input datasets, simulation cases, and source code. This environment, utilizing Docker, encompasses all essential code, libraries, and system software for uELM development on GPUs. It also features a functional unit test framework and an offline model testbed for comprehensive numerical experiments. From a technical perspective, the paper discusses GPU-ready container generations, uELM code management, and input data distribution across computational platforms. Lastly, the paper demonstrates the use of environment for functional unit testing, end-to-end simulation on CPUs and GPUs, and collaborative code development.

E3SM Land Model↗

Optical analysis of parabolic dish concentrators for solar dynamic power systems in space

An optical analysis of a parabolic solar collection system operating in Earth orbit was performed using ray tracing techniques. The analysis included the effects of: (1) solar limb darkening, (2) parametric variation of mirror surface error, (3) parametric variation of mirror rim angle, and (4) parametric variation of alignment and pointing error. This ray tracing technique used numerical integration to combine the effects of rays emanating from different parts of the sun at different intensities with the effects of normally distributed mirror-surface errors to compute the angular intensity distribution of rays leaving the mirror surface. A second numerical integration was then performed over the surface of the parabolic mirror to compute the radial distribution of brightness at the mirror focus. Major results of the analysis included: (1) solar energy can be collected at high temperatures with high efficiency, (2) higher absorber temperatures can be achieved at lower efficiencies, or higher efficiencies can be achieved at lower temperatures, and (3) collection efficiency is near its maximum level across a broad plateau of rim angles from 40 deg to 70 deg.

Jefferies, K. S.↗

On Large Deviations for Sums of i.i.d. Bernoulli Random Variables

Tail probabilities are studied for the binomial distribution. The Hoeffding inequality is sharpened in this particular case through estimating an integral factor in the Esscher transform, which is omitted in Hoeffding’s proof. This approach was already used by Talagrand (1995) in the general case. However, our results are much more precise. In particular, all involved constants are given in the explicit form.

97 MATHEMATICS AND COMPUTING↗

O(N) Quantum Molecular Dynamics (QMD) Algorithms, Code Requirements, Release Notes, and Library Deployment

The Exascale Computing Project (ECP) Co-design Center for Particle Applications (CoPA) is addressing the challenges for particle applications to run on upcoming exascale computing architectures. This includes short- and long-range molecular dynamics (MD), particle-in-cell (PIC), and quantum molecular dynamics (QMD). This document addresses $\mathcal{O}(N)$ QMD. The goal of this CoPA team is to develop $\mathcal{O}(N)$ linear scaling methods for QMD optimized for new and next generation architectures. This will provide the capability to simulate larger systems and run for longer timeframes than is possible today. Focus is initially on the density matrix construction. This requires efficient matrix formats and linear algebra operations for distributed architectures. A significant reduction in the wallclock time for an MD timestep is necessary to achieve practical large scale QMD. Equally challenging is to develop scalable distributed implementations. This requires the exploration of efficient data formats (dense, sparse, etc.), data decomposition and distribution across compute nodes using block- and graph-based methods. Traditional programming models such as MPI/OpenMP, hybrid MPI/OpenMP/Accelerator, as well as asynchronous task-based models will be explored to achieve maximum parallelism. Parallelism at the level of a matrix operation, solver, and/or application needs to be explored to gain the most benefit on new and emerging architectures. This report serves as a “living document” of the additions and enhancements throughout the ECP CoPA project for $\mathcal{O}(N)$ QMD. The following sections address the applications we are working with, the quantum chemistry libraries (BML and PROGRESS), and our co-design exploration through the use of a proxy application.

36 MATERIALS SCIENCE↗

TH-A-19A-08: Intel Xeon Phi Implementation of a Fast Multi-Purpose Monte Carlo Simulation for Proton Therapy

Purpose: Recent studies have demonstrated the capability of graphics processing units (GPUs) to compute dose distributions using Monte Carlo (MC) methods within clinical time constraints. However, GPUs have a rigid vectorial architecture that favors the implementation of simplified particle transport algorithms, adapted to specific tasks. Our new, fast, and multipurpose MC code, named MCsquare, runs on Intel Xeon Phi coprocessors. This technology offers 60 independent cores, and therefore more flexibility to implement fast and yet generic MC functionalities, such as prompt gamma simulations. Methods: MCsquare implements several models and hence allows users to make their own tradeoff between speed and accuracy. A 200 MeV proton beam is simulated in a heterogeneous phantom using Geant4 and two configurations of MCsquare. The first one is the most conservative and accurate. The method of fictitious interactions handles the interfaces and secondary charged particles emitted in nuclear interactions are fully simulated. The second, faster configuration simplifies interface crossings and simulates only secondary protons after nuclear interaction events. Integral depth-dose and transversal profiles are compared to those of Geant4. Moreover, the production profile of prompt gammas is compared to PENH results. Results: Integral depth dose and transversal profiles computed by MCsquare and Geant4 are within 3%. The production of secondaries from nuclear interactions is slightly inaccurate at interfaces for the fastest configuration of MCsquare but this is unlikely to have any clinical impact. The computation time varies between 90 seconds for the most conservative settings to merely 59 seconds in the fastest configuration. Finally prompt gamma profiles are also in very good agreement with PENH results. Conclusion: Our new, fast, and multi-purpose Monte Carlo code simulates prompt gammas and calculates dose distributions in less than a minute, which complies with clinical time constraints. It has been successfully validated with Geant4. This work has been financialy supported by InVivoIGT, a public/private partnership between UCL and IBA.

07 ISOTOPE AND RADIATION SOURCES↗

Toroidal nanotraps for cold polar molecules

Electronic excitations in metallic nanoparticles in the optical regime that have been of great importance in surface-enhanced spectroscopy and emerging applications of molecular plasmonics, due to control and confinement of electromagnetic energy, may also be of potential to control the motion of nanoparticles and molecules. Here, we propose a concept for trapping polarizable particles and molecules using toroidal metallic nanoparticles. Specifically, gold nanorings are investigated for their scattering properties and field distribution to computationally show that the response of these optically resonant particles to incident photons permit the formation of a nanoscale trap when proper aspect ratio, photon wavelength, and polarization are considered. However, interestingly the resonant plasmonic response of the nanoring is shown to be detrimental to the trap formation. The results are in good agreement with analytic calculations in the quasistatic limit within the first-order perturbation of the scalar electric potential. The possibility of extending the single nanoring trapping properties to two-dimensional arrays of nanorings is suggested by obtaining the field distribution of nanoring dimers and trimers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Compton scattering of microwave background radiation by gas in galaxy clusters

Based on data on the X-ray spectrum of the Coma cluster, interpreted as thermal bremsstrahlung, the expected brightness depletion from Compton scattering of the microwave background in the direction of the cluster is computed. The calculated depletion is about one-third that recently observed by Gull and Northover, and the discrepancy is discussed. In comparing the observed microwave depletion in the direction of other clusters which are X-ray sources it is found that there is no correlation with the cluster X-ray luminosity. Consequently, the microwave depletion observations cannot yet be taken as good evidence for a thermal bremsstrahlung origin for the X-ray emission. The perturbation from Compton scattering of photons on the high-frequency (Wien) tail of the blackbody distribution is computed and found to be much larger than predicted in previous calculations. In the Wien tail the effect is a relative increase in the blackbody intensity that is appreciably greater in magnitude than the depletion in the Rayleigh-Jeans domain.

Gould, R. J.↗

Simulation of radar reflectivity and surface measurements of rainfall

Raindrop size distributions (RSDs) are often estimated using surface raindrop sampling devices (e.g., disdrometers) or optical array (2D-PMS) probes. A number of authors have used these measured distributions to compute certain higher-order RSD moments that correspond to radar reflectivity, attenuation, optical extinction, etc. Scatter plots of these RSD moments versus disdrometer-measured rainrates are then used to deduce physical relationships between radar reflectivity, attenuation, etc., which are measured by independent instruments (e.g., radar), and rainrate. In this paper RSDs of the gamma form as well as radar reflectivity (via time series simulation) are simulated to study the correlation structure of radar estimates versus rainrate as opposed to RSD moment estimates versus rainrate. The parameters N0, D0 and m of a gamma distribution are varied over the range normally found in rainfall, as well as varying the device sampling volume. The simulations are used to explain some possible features related to discrepancies which can arise when radar rainfall measurements are compared with surface or aircraft-based sampling devices.

Chandrasekar, V.↗

Citizen Science

Scientists and engineers constantly face new challenges, despite myriad advances in computing. More sets of data are collected today from earth and sky than there is time or resources available to carefully analyze them. Some problems either don't have fast algorithms to solve them or have solutions that must be found among millions of options, a situation akin to finding a needle in a haystack. But all hope is not lost: advances in technology and the Internet have empowered the general public to participate in the scientific process via individual computational resources and brain cognition, which isn't matched by any machine. Citizen scientists are volunteers who perform scientific work by making observations, collecting and disseminating data, making measurements, and analyzing or interpreting data without necessarily having any scientific training. In so doing, individuals from all over the world can contribute to science in ways that wouldn't have been otherwise possible.

distributed computing↗

The impact of fuel particle size distribution on neutron transport in stochastic media

This paper presents a study of the particle size distribution impact on neutron transport in three-dimensional stochastic media. An eigenvalue problem is simulated in a cylindrical container consisting of fissile fuel particles with five different size distributions: constant, uniform, power, exponential and Gaussian. We construct 15 cases by altering the fissile particle volume packing fraction and its optical thickness, but keeping the mean chord length of the spherical fuel particle the same at different size distributions. The tallied effective multiplication factor (k{sub eff}) and flux distribution along axial and radial directions are compared between different size distributions. At low packing fraction and low optical thickness, the size distribution has a significant impact on radiation transport in stochastic media, which can cause as high as {approx}270 pcm difference in k{sub eff} value and {approx}2.6% relative error difference in peak flux. As the packing fraction and optical thickness increase, the impact gradually dissipates. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Virtual Infrastructure Twins: Software Testing Platforms for Computing-Instrument Ecosystems

Science ecosystems are being built by federating computing systems and instruments located at geographically distributed sites over wide-area networks. These computing-instrument ecosystems are expected to support complex workflows that incorporate remote, automated AI-driven science experiments. Their realization, however, requires various designs to be explored and software components to be developed, in order to support the orchestration of distributed computations and experiments. It is often too expensive, infeasible, or disruptive for the entire ecosystem to be available during the typically long software development and testing periods. We propose a Virtual Infrastructure Twin (VIT) of the ecosystem that emulates its network and computing components, and incorporates its instrument software simulators. It provides a software environment nearly identical to the ecosystem to support early development and testing, and design space exploration. We present a brief overview of previous digital infrastructure twins that culminated in the VIT concept, including (i) the virtual science network environment for developing software-defined networking solutions, and (ii) the virtual federated science instrument environment for testing the federation software stack and remote instrument control software. We briefly describe VITs for Nion microscope steering and access to GPU systems.

Rao, Nageswara↗

Virtual Infrastructure Twins: Software Testing Platforms for Computing-Instrument Ecosystems

Science ecosystems are being built by federating computing systems and instruments located at geographically distributed sites over wide-area networks. These computing-instrument ecosystems are expected to support complex workflows that incorporate remote, automated AI-driven science experiments. Their realization, however, requires various designs to be explored and software components to be developed, in order to support the orchestration of distributed computations and experiments. It is often too expensive, infeasible, or disruptive for the entire ecosystem to be available during the typically long software development and testing periods. We propose a Virtual Infrastructure Twin (VIT) of the ecosystem that emulates its network and computing components, and incorporates its instrument software simulators. It provides a software environment nearly identical to the ecosystem to support early development and testing, and design space exploration. We present a brief overview of previous digital infrastructure twins that culminated in the VIT concept, including (i) the virtual science network environment for developing software-defined networking solutions, and (ii) the virtual federated science instrument environment for testing the federation software stack and remote instrument control software. We briefly describe VITs for Nion microscope steering and access to GPU systems.

Rao, Nageswara↗

Phase Demodulation by Frequency Chirping in Coherence Microwave Photonic Interferometry

This paper presents a signal processing method to demodulate the optical interference phase of cascaded individual optical fiber intrinsic Fabry-Perot interferometric (IFPI) sensors in a coherent microwave-photonic interferometry (CMPI) distributed sensing system. The new method utilizes the chirp effect of electro-optic modulator (EOM) to create a quasi-quadrature optical interference phase shift between two adjacent pulses which correspond to two adjacent reflection points in the time domain. The phase shift can be controlled by adjusting the bias voltage that is applied to the EOM. The interference phase is calculated by elliptically fitting the phase shift. The interference phase change is proportional to the optical path difference (OPD) change of the interferometer, and the sign can be used to differentiate the increase or decrease of the OPD. The method is demonstrated for distributed strain sensing, showing good linearity, high resolution and large dynamic range.

42 ENGINEERING↗

Validation of HELIOS for ATR Core Follow Analyses

This work summarizes the validation analyses for the HELIOS code to support core design and safety assurance calculations of the Advanced Test Reactor (ATR). Past and current core safety assurance is performed by the PDQ-7 diffusion code; a state of the art reactor physics simulation tool from the nuclear industry’s earlier days. Over the past twenty years, improvements in computational speed have enabled the use of modern neutron transport methodologies to replace the role of diffusion theory for simulation of complex systems, such as the ATR. More exact methodologies have enabled a paradigm-shift away from highly tuned codes that force compliance with a bounding safety envelope, and towards codes regularly validated against routine measurements. To validate HELIOS, the 16 ATR operational cycles from late-2009 to present were modeled. The computed power distribution was compared against data collected by the ATR’s on-line power surveillance system. It was found that the ATR’s lobe-powers could be determined with ±10% accuracy. Also, the ATR’s cold startup shim configuration for each of these 16 cycles was estimated and compared against the reported critical position from the reactor log-book. HELIOS successfully predicted criticality within the tolerance set by the ATR startup procedure for 13 out of the 16 cycles. This is compared to 12 times for PDQ (without empirical adjustment). These findings, as well as other insights discussed in this report, suggest that HELIOS is highly suited for replacing PDQ for core safety assurance of the ATR. Furthermore, a modern verification and validation framework has been established that allows reactor and fuel performance data to be computed with a known degree of accuracy and stated uncertainty.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support

GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.

Dost, Jeffrey↗

Scaling Deep Learning on GPU and Knights Landing clusters

The speed of deep neural networks training has become a big bottleneck of deep learning research and development. For example, training GoogleNet by ImageNet dataset on one Nvidia K20 GPU needs 21 days. To speed up the training process, the current deep learning systems heavily rely on the hardware accelerators. However, these accelerators have limited on-chip memory compared with CPUs. To handle large datasets, they need to fetch data from either CPU memory or remote processors. We use both self-hosted Intel Knights Landing (KNL) clusters and multi-GPU clusters as our target platforms. From an algorithm aspect, current distributed machine learning systems are mainly designed for cloud systems. These methods are asynchronous because of the slow network and high fault-tolerance requirement on cloud systems. We focus on Elastic Averaging SGD (EASGD) to design algorithms for HPC clusters. Original EASGD used round-robin method for communication and updating. The communication is ordered by the machine rank ID, which is inefficient on HPC clusters. First, we redesign four efficient algorithms for HPC systems to improve EASGD's poor scaling on clusters. Async EASGD, Async MEASGD, and Hogwild EASGD are faster \textcolor{black}{than} their existing counterparts (Async SGD, Async MSGD, and Hogwild SGD, resp.) in all the comparisons. Finally, we design Sync EASGD, which ties for the best performance among all the methods while being deterministic. In addition to the algorithmic improvements, we use some system-algorithm codesign techniques to scale up the algorithms. By reducing the percentage of communication from 87% to 14%, our Sync EASGD achieves 5.3x speedup over original EASGD on the same platform. We get 91.5% weak scaling efficiency on 4253 KNL cores, which is higher than the state-of-the-art implementation.

60 APPLIED LIFE SCIENCES↗

Fusion neutron generation computations in a stellarator-mirror hybrid with neutral beam injection

In the paper [Moiseenko V.E., Noack K., Agren O. 'Stellarator-mirror based fusion driven fission reactor' J Fusion Energy 29 (2010) 65.], a version of a fusion driven system (FDS), i.e. a sub-critical fast fission assembly with a fusion plasma neutron source, is proposed. The plasma part of the reactor is based on a stellarator with a small mirror part. Hot ions with high perpendicular energy are assumed to be trapped in the magnetic mirror part. The stellarator part which connects to the mirror part and provides confinement for the bulk (deuterium) plasma. In the magnetic well of the mirror part, fusion reactions occur from collisions between a of hot ion component (tritium) with cold background plasma ions. RF heating is one option to heat the tritium. A more conventional method to sustain the hot ions is neutral beam injection (NBI), which is here studied numerically for the above-mentioned hybrid scheme. For these studies, a new kinetic code, KNBIM, has been developed. The code takes into account Coulomb collisions between the hot ions and the background plasma. The geometry of the confining magnetic field is arbitrary for the code. It is accounted for via a numerical bounce averaging procedure. Along with the kinetic calculations the neutron generation intensity and its spatial distribution are computed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗