Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data parallelism”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Distributed Large Data-Object Environments: End-to-End Performance Analysis of High Speed Distributed Storage Systems in Wide Area ATM Networks

We have developed and deployed a distributed-parallel storage system (DPSS) in several high speed asynchronous transfer mode (ATM) wide area networks (WAN) testbeds to support several different types of data-intensive applications. Architecturally, the DPSS is a network striped disk array, but is fairly unique in that its implementation allows applications complete freedom to determine optimal data layout, replication and/or coding redundancy strategy, security policy, and dynamic reconfiguration. In conjunction with the DPSS, we have developed a 'top-to-bottom, end-to-end' performance monitoring and analysis methodology that has allowed us to characterize all aspects of the DPSS operating in high speed ATM networks. In particular, we have run a variety of performance monitoring experiments involving the DPSS in the MAGIC testbed, which is a large scale, high speed, ATM network and we describe our experience using the monitoring methodology to identify and correct problems that limit the performance of high speed distributed applications. Finally, the DPSS is part of an overall architecture for using high speed, WAN's for enabling the routine, location independent use of large data-objects. Since this is part of the motivation for a distributed storage system, we describe this architecture.

Johnston, William↗
DOE OSTI2022

Shocks in the stacked Sunyaev-Zel’dovich profiles of clusters II: Measurements from SPT-SZ + Planck Compton- y map

ABSTRACT We search for the signature of cosmological shocks in stacked gas pressure profiles of galaxy clusters using data from the South Pole Telescope (SPT). Specifically, we stack the latest Compton-y maps from the 2500 deg2 SPT-SZ survey on the locations of clusters identified in that same data set. The sample contains 516 clusters with mean mass $\langle M_{\rm 200m}\rangle = 10^{14.9} \, {\rm M}_\odot$ and redshift 〈z〉 = 0.55. We analyse in parallel a set of zoom-in hydrodynamical simulations from the three hundred project. The SPT-SZ data show two features: (i) a pressure deficit at R/R200m = 1.08 ± 0.09, measured at 3.1σ significance and not observed in the simulations, and; (ii) a sharp decrease in pressure at R/R200m = 4.58 ± 1.24 at 2.0σ significance. The pressure deficit is qualitatively consistent with a shock-induced thermal non-equilibrium between electrons and ions, and the second feature is consistent with accretion shocks seen in previous studies. We split the cluster sample by redshift and mass, and find both features exist in all cases. There are also no significant differences in features along and across the cluster major axis, whose orientation roughly points towards filamentary structure. As a consistency test, we also analyse clusters from the Planck and Atacama Cosmology Telescope Polarimeter surveys and find quantitatively similar features in the pressure profiles. Finally, we compare the accretion shock radius ($R_{\rm sh,\, acc}$) with existing measurements of the splashback radius (Rsp) for SPT-SZ and constrain the lower limit of the ratio, $R_{\rm sh,\, acc}/R_{\rm sp}\gt 2.16 \pm 0.59$.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2006

NavP: Structured and Multithreaded Distributed Parallel Programming

This slide presentation reviews some of the issues around distributed parallel programming. It compares and contrast two methods of programming: Single Program Multiple Data (SPMD) with the Navigational Programming (NAVP). It then reviews the distributed sequential computing (DSC) method and the methodology of NavP. Case studies are presented. It also reviews the work that is being done to enable the NavP system.

parallel programming↗
NASA NTRS1991

The NAS parallel benchmarks

A new set of benchmarks has been developed for the performance evaluation of highly parallel supercomputers in the framework of the NASA Ames Numerical Aerodynamic Simulation (NAS) Program. These consist of five 'parallel kernel' benchmarks and three 'simulated application' benchmarks. Together they mimic the computation and data movement characteristics of large-scale computational fluid dynamics applications. The principal distinguishing feature of these benchmarks is their 'pencil and paper' specification-all details of these benchmarks are specified only algorithmically. In this way many of the difficulties associated with conventional benchmarking approaches on highly parallel systems are avoided.

Bailey, D. H.↗
NASA NTRS1980

An experimental evaluation of the Hamrock and Dowson minimum film thickness equation for fully flooded EHD point contacts

Fifty-seven measurements of the minimum lubricant film separating the elastohydrodynamically lubricated point contact of a steel crowned roller and a flat sapphire disk were made by an optical interferometry technique. The data collected were used to evaluate the Hamrock and Dowson minimum EHD film thickness model over a practical range of contact ellipticity ratio where the major axis of the contact ellipse is aligned both parallel and perpendicular to the direction of motion. A statistical analysis of the measured film thickness data showed that on the average the experimental data averaged 30 percent greater film thickness than the Hamrock and Dowson model predicts.

Koye, K. A.↗
NASA NTRS2003

The X-38 Spacecraft Fault-Tolerant Avionics System

In 1995 NASA began an experimental program to develop a reusable crew return vehicle (CRV) for the International Space Station. The purpose of the CRV was threefold: (i) to bring home an injured or ill crewmember; (ii) to bring home the entire crew if the Shuttle fleet was grounded; and (iii) to evacuate the crew in the case of an imminent Station threat (i.e., fire, decompression, etc). Built at the Johnson Space Center, were two approach and landing prototypes and one spacecraft demonstrator (called V201). A series of increasingly complex ground subsystem tests were completed, and eight successful high-altitude drop tests were achieved to prove the design concept. In this program, an unprecedented amount of commercial-off-the-shelf technology was utilized in this first crewed spacecraft NASA has built since the Shuttle program. Unfortunately, in 2002 the program was canceled due to changing Agency priorities. The vehicle was 80% complete and the program was shut down in such a manner as to preserve design, development, test and engineering data. This paper describes the X-38 V201 fault-tolerant avionics system. Based on Draper Laboratory's Byzantine-resilient fault-tolerant parallel processing system and their "network element" hardware, each flight computer exchanges information on a strict timescale to process input data, compare results, and issue voted vehicle output commands. Major accomplishments achieved in this development include: (i) a space qualified two-fault tolerant design using mostly COTS (hardware and operating system); (ii) a single event upset tolerant network element board, (iii) on-the-fly recovery of a failed processor; (iv) use of synched cache; (v) realignment of memory to bring back a failed channel; (vi) flight code automatically generated from the master measurement list; and (vii) built in-house by a team of civil servants and support contractors. This paper will present an overview of the avionics system and the hardware implementation, as well as the system software and vehicle command & telemetry functions. Potential improvements and lessons learned on this program are also discussed.

Kouba,Coy↗
NASA NTRS1992

Surface navigation on Mars with a Navigation Satellite

Radiometric navigation data from the Deep Space Network (DSN) stations on the earth to transponders and other surface elements such as rovers and landers on Mars, can determine their positions to only within a kilometer in inertial space. The positional error is mostly in the z-component of the surface element parallel to the Martian spin-axis. However, with Doppler and differenced-Doppler data from a Navigation Satellite in orbit around Mars to two or more of such transponders on the planetary surface, their positions can be determined to within 15 meters (or 20 meters for one-way Doppler beacons on Mars) in inertial space. In this case, the transponders (or other vehicles) on Mars need not even be capable of directly communicating to the earth. When the Navigation Satellite data is complemented by radiometric observations from the DSN stations also, directly to the surface elements on Mars, their positions can be determined to within 3 meters in inertial space. The relative positions of such surface elements on Mars (relative to one another) in Mars-fixed coordinates, however, can be determined to within 5 meters from simply range and Doppler data from the DSN stations to the surface elements. These results are obtained from covariance studies assuming X-band data noise levels and data-arcs not exceeding 10 days. They are significant in the planning and deployment of a Mars-based navigation network necessary to support real-time operations during critical phases of manned exploration of Mars.

Vijayaraghavan, A.↗
NASA NTRS2011

Computer-Aided Parallelizer and Optimizer

The Computer-Aided Parallelizer and Optimizer (CAPO) automates the insertion of compiler directives (see figure) to facilitate parallel processing on Shared Memory Parallel (SMP) machines. While CAPO currently is integrated seamlessly into CAPTools (developed at the University of Greenwich, now marketed as ParaWise), CAPO was independently developed at Ames Research Center as one of the components for the Legacy Code Modernization (LCM) project. The current version takes serial FORTRAN programs, performs interprocedural data dependence analysis, and generates OpenMP directives. Due to the widely supported OpenMP standard, the generated OpenMP codes have the potential to run on a wide range of SMP machines. CAPO relies on accurate interprocedural data dependence information currently provided by CAPTools. Compiler directives are generated through identification of parallel loops in the outermost level, construction of parallel regions around parallel loops and optimization of parallel regions, and insertion of directives with automatic identification of private, reduction, induction, and shared variables. Attempts also have been made to identify potential pipeline parallelism (implemented with point-to-point synchronization). Although directives are generated automatically, user interaction with the tool is still important for producing good parallel codes. A comprehensive graphical user interface is included for users to interact with the parallelization process.

Jin, Haoqiang↗
NASA NTRS1994

Automated Instrumentation, Monitoring and Visualization of PVM Programs Using AIMS

We present views and analysis of the execution of several PVM (Parallel Virtual Machine) codes for Computational Fluid Dynamics on a networks of Sparcstations, including: (1) NAS Parallel Benchmarks CG and MG; (2) a multi-partitioning algorithm for NAS Parallel Benchmark SP; and (3) an overset grid flowsolver. These views and analysis were obtained using our Automated Instrumentation and Monitoring System (AIMS) version 3.0, a toolkit for debugging the performance of PVM programs. We will describe the architecture, operation and application of AIMS. The AIMS toolkit contains: (1) Xinstrument, which can automatically instrument various computational and communication constructs in message-passing parallel programs; (2) Monitor, a library of runtime trace-collection routines; (3) VK (Visual Kernel), an execution-animation tool with source-code clickback; and (4) Tally, a tool for statistical analysis of execution profiles. Currently, Xinstrument can handle C and Fortran 77 programs using PVM 3.2.x; Monitor has been implemented and tested on Sun 4 systems running SunOS 4.1.2; and VK uses XIIR5 and Motif 1.2. Data and views obtained using AIMS clearly illustrate several characteristic features of executing parallel programs on networked workstations: (1) the impact of long message latencies; (2) the impact of multiprogramming overheads and associated load imbalance; (3) cache and virtual-memory effects; and (4) significant skews between workstation clocks. Interestingly, AIMS can compensate for constant skew (zero drift) by calibrating the skew between a parent and its spawned children. In addition, AIMS' skew-compensation algorithm can adjust timestamps in a way that eliminates physically impossible communications (e.g., messages going backwards in time). Our current efforts are directed toward creating new views to explain the observed performance of PVM programs. Some of the features planned for the near future include: (1) ConfigView, showing the physical topology of the virtual machine, inferred using specially formatted IP (Internet Protocol) packets: and (2) LoadView, synchronous animation of PVM-program execution and resource-utilization patterns.

Mehra, Pankaj↗
NASA NTRS1994

Automated Instrumentation, Monitoring and Visualization of PVM Programs Using AIMS

We present views and analysis of the execution of several PVM codes for Computational Fluid Dynamics on a network of Sparcstations, including (a) NAS Parallel benchmarks CG and MG (White, Alund and Sunderam 1993); (b) a multi-partitioning algorithm for NAS Parallel Benchmark SP (Wijngaart 1993); and (c) an overset grid flowsolver (Smith 1993). These views and analysis were obtained using our Automated Instrumentation and Monitoring System (AIMS) version 3.0, a toolkit for debugging the performance of PVM programs. We will describe the architecture, operation and application of AIMS. The AIMS toolkit contains (a) Xinstrument, which can automatically instrument various computational and communication constructs in message-passing parallel programs; (b) Monitor, a library of run-time trace-collection routines; (c) VK (Visual Kernel), an execution-animation tool with source-code clickback; and (d) Tally, a tool for statistical analysis of execution profiles. Currently, Xinstrument can handle C and Fortran77 programs using PVM 3.2.x; Monitor has been implemented and tested on Sun 4 systems running SunOS 4.1.2; and VK uses X11R5 and Motif 1.2. Data and views obtained using AIMS clearly illustrate several characteristic features of executing parallel programs on networked workstations: (a) the impact of long message latencies; (b) the impact of multiprogramming overheads and associated load imbalance; (c) cache and virtual-memory effects; and (4significant skews between workstation clocks. Interestingly, AIMS can compensate for constant skew (zero drift) by calibrating the skew between a parent and its spawned children. In addition, AIMS' skew-compensation algorithm can adjust timestamps in a way that eliminates physically impossible communications (e.g., messages going backwards in time). Our current efforts are directed toward creating new views to explain the observed performance of PVM programs. Some of the features planned for the near future include: (a) ConfigView, showing the physical topology of the virtual machine, inferred using specially formatted IP (Internet Protocol) packets; and (b) LoadView, synchronous animation of PVM-program execution and resource-utilization patterns.

Mehra, Pankaj↗
NASA NTRS1980

Cross-field transport of less than 1 MeV protons in energetic particle events

A systematic analysis of hourly averaged low-energy anisotropy data (0.3-0.5 MeV) has been carried out with the JHU/APL detectors onboard the IMP-7 and 8 spacecraft from 1972-1975. The energetic particle events were divided into two major groups: flare-associated or nonimpulsive. Resolving the anistropy vectors into components parallel and perpendicular to the measured magnetic field leads directly to the following model-independent conclusions: (1) the average perpendicular anisotropy component is entirely accounted for in terms of the ExB drift, and hence transverse diffusion is negligible at these energies; application of the diffusion model to the nonimpulsive data set implies a ratio of the diffusion mean free paths parallel and perpendicular to the magnetic field much less than 0.051; (2) the parallel anisotropy component averages nearly to zero in the nonimpulsive data set, indicating virtually no net streaming along the field at 1 AU, averaged over all events.

Zwickl, R. D.↗
DOE OSTI2023

Model-parallel Fourier neural operators as learned surrogates for large-scale parametric PDEs

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep learning approaches. Once trained, FNOs can achieve speed-ups of multiple orders of magnitude over conventional numerical PDE solvers. However, due to the high dimensionality of their input data and network weights, FNOs have so far only been applied to two-dimensional or small three-dimensional problems. To remove this limited problem-size barrier, we propose a model-parallel version of FNOs based on domain-decomposition of both the input data and network weights. Here, we demonstrate that our model-parallel FNO is able to predict time-varying PDE solutions of over 2.6 billion variables on Perlmutter using up to 512 A100 GPUs and show an example of training a distributed FNO on the Azure cloud for simulating multiphase CO 2 dynamics in the Earth’s subsurface.

58 GEOSCIENCES↗
DOE OSTI2022

Novel approaches in hadron spectroscopy

The last two decades have witnessed the discovery of a myriad of new and unexpected hadrons. The future holds more surprises for us, thanks to new-generation experiments. Understanding the signals and determining the properties of the states requires a parallel theoretical effort. To make full use of available and forthcoming data, a careful amplitude modeling is required, together with a sound treatment of the statistical uncertainties, and a systematic survey of the model dependencies. We review the contributions made by the Joint Physics Analysis Center to the field of hadron spectroscopy.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Phased plan for the implementation of the time-resolving magnetic recoil spectrometer on the National Ignition Facility (NIF)

The time-resolving magnetic recoil spectrometer (MRSt) is a transformative diagnostic that will be used to measure the time-resolved neutron spectrum from an inertial confinement fusion implosion at the National Ignition Facility (NIF). It uses a CD foil on the outside of the hohlraum to convert fusion neutrons to recoil deuterons. An ion-optical system positioned outside the NIF target chamber energy-disperses and focuses forward-scattered deuterons. A pulse-dilation drift tube (PDDT) subsequently dilates, un-skews, and detects the signal. While the foil and ion-optical system have been designed, the PDDT requires more development before it can be implemented. Therefore, a phased plan is presented that first uses the foil and ion-optical systems with detectors that can be implemented immediately—namely CR-39 and hDISC streak cameras. These detectors will allow the MRSt to be commissioned in an intermediate stage and begin collecting data on a reduced timescale, while the PDDT is developed in parallel. A CR-39 detector will be used in phase 1 for the measurement of the time-integrated neutron spectra with excellent energy-resolution, necessary for the energy calibration of the system. Streak cameras will be used in phase 2 for measurement of the time-resolved spectrum with limited spectral coverage, which is sufficient to diagnose the time-resolved ion temperature. Simulations are presented that predict the performance of the streak camera detector, indicating that it will achieve excellent burn history measurements at current yields, and good time-resolved ion-temperature measurements at yields above 3 × 10 17 . The PDDT will be used for optimal efficiency and resolution in phase 3.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Scalable Deep Learning-Based Microarchitecture Simulation on GPUs

Cycle-accurate microarchitecture simulators are essential tools for designers to architect, estimate, optimize, and manufacture new processors that meet specific design expectations. However, conventional simulators based on discrete-event methods often require an exceedingly long time-to-solution for the simulation of applications and architectures at full complexity and scale. Given the excitement around wielding the machine learning (ML) hammer to tackle various architecture problems, there have been attempts to employ ML to perform architecture simulations, such as Ithemal and SimNet. However, the direct application of existing ML approaches to architecture simulation may be even slower due to overwhelming memory traffic and stringent sequential computation logic. This work proposes the first graphics processing unit (GPU)-based microarchitecture simulator that fully unleashes the potential of GPUs to accelerate state-of-the-art ML-based simulators. First, considering the application traces are loaded from central processing unit (CPU) to GPU for simulation, we introduce various designs to reduce the data movement cost between CPUs and GPUs. Second, we propose a parallel simulation paradigm that partitions the application trace into sub-traces to simulate them in parallel with rigorous error analysis and effective error correction mechanisms. Combined, this scalable GPU-based simulator outperforms by orders of magnitude the traditional CPU-based simulators and the state-of-the-art ML-based simulators, i.e., SimNet and Ithemal.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Pervasive shifts in forest dynamics in a changing world

Forest dynamics arise from the interplay of environmental drivers and disturbances with the demographic processes of recruitment, growth, and mortality, subsequently driving biomass and species composition. However, forest disturbances and subsequent recovery are shifting with global changes in climate and land use, altering these dynamics. Changes in environmental drivers, land use, and disturbance regimes are forcing forests toward younger, shorter stands. Rising carbon dioxide, acclimation, adaptation, and migration can influence these impacts. Recent developments in Earth system models support increasingly realistic simulations of vegetation dynamics. In parallel, emerging remote sensing datasets promise qualitatively new and more abundant data on the underlying processes and consequences for vegetation structure. In combination, these advances hold promise for improving the scientific understanding of changes in vegetation demographics and disturbances.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Scalable Asynchronous Domain Decomposition Solvers

We discuss how parallel implementations of linear iterative solvers generally alternate between phases of data exchange and phases of local computation. Increasingly large problem sizes and more heterogeneous compute architectures make load balancing and the design of low latency network interconnects that are able to satisfy the communication requirements of linear solvers very challenging tasks. In particular, global communication patterns such as inner products become increasingly limiting at scale. We explore the use of asynchronous communication based on one-sided Message Passing Interface primitives in the context of domain decomposition solvers. In particular, a scalable asynchronous two-level Schwarz method is presented. We discuss practical issues encountered in the development of a scalable solver and show experimental results obtained on a state-of-the-art supercomputer system that illustrate the benefits of asynchronous solvers in load balanced as well as load imbalanced scenarios. Using the novel method, we can observe speedups of up to four times over its classical synchronous equivalent.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1976

Solid-propellant rocket motor internal ballistic performance variation analysis, phase 2

The Monte Carlo method was used to investigate thrust imbalance and its first time derivative throughtout the burning time of pairs of solid rocket motors firing in parallel. Results obtained compare favorably with Titan 3 C flight performance data. Statistical correlations of the thrust imbalance at various times with corresponding nominal trace slopes suggest several alternative methods of predicting thrust imbalance. The effect of circular-perforated grain deformation on internal ballistics is discussed, and a modified design analysis computer program which permits such an evaluation is presented. Comparisons with SRM firings indicate that grain deformation may account for a portion of the so-called scale factor on burning rate between large motors and strand burners or small ballistic test motors. Thermoelastic effects on burning rate are also investigated. Burning surface temperature is calculated by coupling the solid phase energy equation containing a strain rate term with a model of gas phase combustion zone using the Zeldovich-Novozhilov technique. Comparisons of solutions with and without the strain rate term indicate a small but possibly significant effect of the thermoelastic coupling.

Sforzini, R. H.↗