DOE OSTI · 1001602
A simple, pipelined algorithm for large, irregular all-gather problems.
Abstract
We present and evaluate a new, simple, pipelined algorithm for large, irregular all-gather problems, useful for the implementation of the MPI-Allgatherv collective operation of MPI. The algorithm can be viewed as an adaptation of a linear ring algorithm for regular all-gather problems for single-ported, clustered multiprocessors to the irregular problem. Compared to the standard ring algorithm, whose performance is dominated by the largest data size broadcast by a process (times the number of processes), the performance of the new algorithm depends only on the total amount of data over all processes. The new algorithm has been implemented within different MPI libraries. Benchmark results on NEC SX-8, Linux clusters with InfiniBand and Gigabit Ethernet, Blue Gene/P, and SiCortex systems show huge performance gains in accordance with the expected behavior.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Traff, J L, Ripke, A, Siebert, C, Balaji, P, Thakur, R, Gropp, W. 2008-01-01. A simple, pipelined algorithm for large, irregular all-gather problems.. https://doi.org/10.1007/978-3-540-87475-1_16. https://engineeringpapers.com/record/osti%3A1001602/a-simple-pipelined-algorithm-for-large-irregular-all-gather-problems
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.