Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “spatial pattern”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A Melanoma Brain Metastasis CTC Signature and CTC:B-cell Clusters Associate with Secondary Liver Metastasis: A Melanoma Brain–Liver Metastasis Axis

Melanoma brain metastasis is linked to dismal prognosis and low overall survival and is detected in up to 80% of patients at autopsy. Circulating tumor cells (CTC) are the smallest functional units of cancer and precursors of fatal metastasis. We previously used an unbiased multilevel approach to discover a unique ribosomal protein large/small subunit (RPL/RPS) CTC gene signature associated with melanoma brain metastasis. In this study, we hypothesized that CTC-driven melanoma brain metastasis secondary metastasis (“metastasis of metastasis” per clinical scenarios) has targeted organ specificity for the liver. We injected parallel cohorts of immunodeficient and newly developed humanized NBSGW (huNBSGW) mice with cells from CTC-derived melanoma brain metastasis to identify secondary metastatic patterns. We found the presence of a melanoma brain–liver metastasis axis in huNBSGW mice. Furthermore, RNA sequencing analysis of tissues showed a significant upregulation of the RPL/RPS CTC gene signature linked to metastatic spread to the liver. Additional RNA sequencing of CTCs from huNBSGW blood revealed extensive CTC clustering with human B cells in these mice. CTC:B-cell clusters were also upregulated in the blood of patients with primary melanoma and maintained either in CTC-driven melanoma brain metastasis or melanoma brain metastasis CTC–derived cells promoting liver metastasis. CTC-generated tumor tissues were interrogated at single-cell gene and protein expression levels (10x Genomics Xenium and HALO spatial biology platforms, respectively). Collectively, our findings suggest that heterotypic CTC:B-cell interactions can be critical at multiple stages of metastasis.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Depot-Based Vehicle Data for National Analysis of Medium- and Heavy-Duty Electric Vehicle Charging

Medium- and heavy-duty vehicles (MHDVs) are a major source of greenhouse gases and local criteria air pollutants. Electrifying MHDVs may reduce these harmful emissions, which disproportionately impact disadvantaged communities. Due to their relatively high per-vehicle energy needs, consistent fleet operations, and frequent colocation of multiple vehicles at depots, MHDVs may have more spatially and temporally concentrated charging demands than light-duty passenger electric vehicles. That charging concentration means their electrification may require careful advance planning and coordination to manage potential impacts to the electrical grid via charge management or infrastructure upgrades. However, MHDV duty cycles and parking schedules are highly variable across vocations of operation, and there is a shortage of nationally representative, vocationally diverse public data describing typical MHDV operations. This report summarizes the methodology - designed with national representativeness in mind - used to create a new set of data describing typical daily driving distances, dwell durations, and normalized electric vehicle depot charging load curves for MHDVs. The dataset reflects the subset of MHDV operating patterns that may originate from a consistent depot each day and rely on the same depot for charging. In addition to trucks with depot-centric vocational patterns, the data describes operations of transit buses and school buses, each with a depot-centric focus. The dataset is available to the public and suitable for national analysis. It can inform research, infrastructure planning, and policymaking regarding the electrification of MHDVs.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

Molten-salt reactors (MSRs) represent a promising solution for next-generation nuclear energy, offering advantages in safety, fuel efficiency, and waste minimization. However, their liquid-fueled design presents unique challenges for spent fuel management, making post-shutdown waste characterization essential for developing effective strategies. Despite this need, there is a notable absence of visualization platforms specifically tailored to the unique characteristics and analytical requirements of MSR waste management. Existing tools in the nuclear industry are primarily designed for reactor operations or generic data exploration and lack both integration with MSR-specific multiphysics frameworks and the ability to simultaneously visualize time-dependent thermal fields, chemical composition evolution, and radiation distribution patterns. To address these limitations, this paper presents an immersive virtual reality (VR) visualization platform that processes and displays high-fidelity multiphysics simulation output from the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework in real-time, using Unity. The platform visualizes MSR waste characteristics such as nuclide decay, salt cooling, and corrosion by using Exodus II output data and running on a VR headset. It includes a user-friendly interface with features such as visibility toggling, cross-sectional slicing, and time-series animation for exploring simulation data. These capabilities support experimental design, stakeholder engagement, and public communication by making complex reactor behavior more accessible and understandable. By enhancing spatial reasoning and reducing cognitive load, this immersive environment fosters more effective communication and decision-making in MSR waste management.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Direct LiF imaging diagnostics on refractive X-ray focusing at the EuXFEL High Energy Density instrument

The application of fluorescent crystal media in wide-range X-ray detectors provides an opportunity to directly image the spatial distribution of ultra intense X-ray beams including investigation of the focal spot of free-electron lasers. Here the capabilities of the micro- and nano-focusing X-ray refractive optics available at the High Energy Density instrument of the European XFEL are reported, as measured in situ by means of a LiF fluorescent detector placed into and around the beam caustic. The intensity distribution of the beam focused down to several hundred nanometers was imaged at 9 keV photon energy. A deviation from the parabolic surface in a stack of nanofocusing Be compound refractive lenses (CRLs) was found to affect the resulting intensity distribution within the beam. Comparison of experimental patterns in the far field with patterns calculated for different CRL lens imperfections allowed the overall inhomogeneity in the CRL stack to be estimated. The precise determination of the focal spot size and shape on a sub-micrometer level is essential for a number of high energy density studies requiring either a pin-size backlighting spot or extreme intensities for X-ray heating.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Comment on “Five Decades of Observed Daily Precipitation Reveal Longer and More Variable Drought Events Across Much of the Western United States”

Abstract Changes in precipitation patterns with climate change could have important impacts on human and natural systems. Zhang et al. (2021, https://doi.org/10.1029/2020gl092293 ) report trends in daily precipitation patterns over the last five decades in the western United States, focusing on meteorological drought. They report that dry intervals (calculated at the annual or seasonal level) have increased across much of the southwestern U.S., with statistical assessment suggesting the results are statistically robust. However, Zhang et al. (2021, https://doi.org/10.1029/2020gl092293 ) preprocess their annual (or seasonal) averages to compute 5‐year moving window averages before using established statistical techniques for trend analysis that assume independence about some fixed trend. Here we show that the moving window preprocessing violates that independence assumption and inflates the statistical significance of their trend estimates. This raises questions about the robustness of their results. We conclude by discussing the difficulty of adjusting for spatial structure when assessing time trends in a regional context.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Imaging antiferromagnetic domain fluctuations and the effect of atomic scale disorder in a doped spin-orbit Mott insulator

Correlated oxides can exhibit complex magnetic patterns. Understanding how magnetic domains form in the presence of disorder and their robustness to temperature variations has been of particular interest, but atomic scale insight has been limited. We use spin-polarized scanning tunneling microscopy to image the evolution of spin-resolved modulations originating from antiferromagnetic (AF) ordering in a spin-orbit Mott insulator perovskite iridate Sr 3 Ir 2 O 7 as a function of chemical composition and temperature. We find that replacing only several percent of lanthanum for strontium leaves behind nanometer-scale AF puddles clustering away from lanthanum substitutions preferentially located in the middle strontium oxide layer. Thermal erasure and reentry into the low-temperature ground state leads to a spatial reorganization of the AF puddles, which nevertheless maintain scale-invariant fractal geometry in each configuration. Our experiments reveal multiple stable AF configurations at low temperature and shed light onto spatial fluctuations of the AF order around atomic scale disorder in electron-doped Sr 3 Ir 2 O 7 .

36 MATERIALS SCIENCE↗
DOE OSTI2025

Investigation of design principles for metal-binding and conductive protein assemblies

Throughout the lifetime of this initiative, including renewals, we focused on understanding the fundamental principles of protein-protein interface design that enable predictable and modular spatial and kinetic control of multi-component protein self-assembly in 1D, 2D, and 3D, including the interface with inorganic materials, small molecules, and metal ions. We designed individual protein components that bind specific metal ions, including REEs and transport ions across lipid membranes. We created helical 1D filaments of repeating units with programmed periodicity, pitch, and multi-component environmentally responsive self-assembling protein fibers. We showed that these filaments reversibly assemble and disassemble under specific pH conditions and created end-specific caps that independently tune the balance of attachment and detachment rates at each terminus of the filament. Using similar filaments, we succeeded in binding arrays of heme and chlorophyll molecules and assembling patterned helical coatings around carbon nanotubes in efforts to create de novo conductive nanowires. By arraying REE binding sites in a large circular tandem array with a repeat protein-based cyclic oligomer, we created a molecular scaffold for superradiance and paramagnetic quantum sensing. We created a range of one-component and two-component self-assembling 2D arrays and showed that when designed to engage cell receptors, these arrays can control cell behavior from outside the cell signal to inside the cell. We designed helical repeat proteins with variable lengths displaying charged residues in a pattern matched to the cation lattice of mica. achieved a range of ordered states with an epitaxial match to the underlying crystal lattice. We further applied the learned principles of protein-induced biomineralization to design proteins with an interface lattice matching CaCO 3 and guide the formation of specific crystal forms of CaCO 3 from solution, a significant advance toward the global need to manage carbon. In all cases of mineral lattice matching and biomineralization, we followed assembly using molecularly resolved in situ AFM imaging and extracted information about assembly pathways and energetics, applying deep learning to quantify the dynamics of protein self-organization. We developed techniques for using dynamic metal-dependent interfaces on protein nanopores for discriminatively sensing dilute REEs in solution and demonstrated the use of strong metal-binding interfaces to drive nanocage disassembly for conditional nanocompartmentalization applications. This grant supported 11 people, including Asim Bera, Evans Brackenbrough, Andrew Borst, Nikita Hanikel, Timothy Huddy, Emily Joyce, Alex Young-Seug Kang, Ryan Kibler, Joshua Morris Lubner, Harley Pyles, and Shuai Zhang. The research effort culminated in the production of published papers and theses. Electronic Thesis/Dissertation are distributed by ProQuest/UMI Dissertation Publishing and made available on an open access basis through UW Libraries ResearchWorks Service.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Using automated machine learning for the upscaling of gross primary productivity

Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Deciphering exopolysaccharide functional specificity via visualization of chemical motifs that mediate microbial-microenvironment interactions in soil micromodels

Exopolysaccharides (EPS) are carbohydrate-based matrices of microbial biofilms that microbes use to adapt to their surroundings. Microbial EPS also promotes soil aggregate stability and contributes toward soil health by reducing erosion caused by continued land use. The chemical structure of EPS, even within single species biofilms, can vary greatly: from repeating units and branching patterns to the non-carbohydrate decorations. Despite the wealth of knowledge on EPS chemistry, many unresolved questions regarding the biological implications of EPS chemical variations remain. Here, we develop a mass spectrometry imaging toolbox that reveal how EPS chemistry enables microbial adaptation to different microenvironments such as specific moisture, soil-biofilm interfaces, and food source proximity. First, we developed emulated soil micromodels (ESMs), microfluidic channels that simulate the physical properties of soil, for biofilm formation in different microenvironments. Then, in order to map chemical features of EPS in these micromodels, we develop strategies for in-situ releasing of oligosaccharides using specific enzymes. Lastly, we optimized matrix-assisted laser desorption ionization (MALDI) mass spectrometry imaging (MSI) to spatially analyze the released compounds in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Nanoscale Electronic Transparency of Wafer-Scale Hexagonal Boron Nitride

We report monolayer hexagonal boron nitride (hBN) has attracted interest as an ultrathin tunnel barrier or environmental protection layer. Recently, wafer-scale hBN growth on Cu(111) was developed for semiconductor chip applications. For basic research and technology, understanding how hBN perturbs underlying electronically active layers is critical. Encouragingly, hBN/Cu(111) has been shown to preserve the Cu(111) surface state (SS), but it was unknown how tunneling into this SS through hBN varies spatially. Here, we demonstrate that the Cu(111) SS under wafer-scale hBN is homogeneous in energy and spectral weight over nanometer length scales and across atomic terraces. In contrast, a new spectral feature-not seen on bare Cu(111)-varies with atomic registry and shares the spatial periodicity of the hBN/Cu(111) moiré. This work demonstrates that, for some 2D electron systems, an hBN overlayer can act as a protective yet remarkably transparent window on fragile low-energy electronic structure below.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

Contributions of biofilm-induced flow heterogeneities to solute retention and anomalous transport features in porous media

We report that microbial biofilms are ubiquitous within porous media and the dynamics of their growth influence surface and subsurface flow patterns which impacts the physical properties of porous media and large-scale transport of solutes. Here, a two-dimensional pore-scale numerical model was used to evaluate the impact of biofilm-induced flow heterogeneities on conservative transport. Our study integrates experimental biofilm images of Paenibacillus 300A strain in a microfluidic device packed with cylindrical grains in a hexagonal distribution, with mathematical modeling. Biofilm is represented as a synthetic porous structure with locally varying physical properties that honors the impact of biofilm on the porous medium. We find that biofilm plays a major role in shaping the observed conservative transport dynamics by enhancing anomalous characteristics. More specifically, when biofilm is present, the pore structure in our geometry becomes more spatially correlated. We observe intermittent behavior in the Lagrangian velocities that switches between fast transport periods and long trapping events. Our results suggest that intermittency enhances solute spreading in breakthrough curves which exhibit extreme anomalous slope at intermediate times and very marked late solute arrival due to solute retention. The efficiency of solute retention by the biofilm is controlled by a transport regime which can extend the tailing in the concentration breakthrough curves. These results indicate that solute retention by the biofilm exerts a strong control on conservative solute transport at pore-scale, a role that to date has not received enough attention.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Substantial differences in soil viral community composition within and among four Northern California habitats

Abstract Viruses contribute to food web dynamics and nutrient cycles in diverse ecosystems, yet the biogeographical patterns that underlie these viral dynamics are poorly understood, particularly in soil. Here, we identified trends in soil viral community composition in relation to habitat, moisture content, and physical distance. We generated 30 soil viromes from four distinct habitats (wetlands, grasslands, woodlands, and chaparral) by selectively capturing virus-sized particles prior to DNA extraction, and we recovered 3432 unique viral ‘species’ (dsDNA vOTUs). Viral communities differed significantly by soil moisture content, with viral richness generally higher in wet compared to dry soil habitats. However, vOTUs were rarely shared between viromes, including replicates <10 m apart, suggesting that soil viruses may not disperse well and that future soil viral community sampling strategies may need to account for extreme community differences over small spatial scales. Of the 19% of vOTUs detected in more than one virome, 93% were from the same habitat and site, suggesting greater viral community similarity in closer proximity and under similar environmental conditions. Within-habitat differences indicate that extensive sampling would be required for rigorous cross-habitat comparisons, and results highlight emerging paradigms of high viral activity in wet soils and soil viral community spatial heterogeneity.

Durham, Devyn M.↗
DOE OSTI2022

Modeling and experimental validation of dynamical effects in Bragg coherent x-ray diffractive imaging of finite crystals

Bragg coherent diffractive imaging (BCDI) is a noninvasive microscopy technique that can visualize the shape and internal lattice deviations of crystals with nanoscale spatial resolution and picometer deformation sensitivity. Its strain imaging capability relies on Fourier transform–based iterative phase retrieval algorithms, which are mostly developed under the kinematical approximation. Such approximation prohibits the application of BCDI on larger crystals, which are commonly seen in most emerging functional materials. Understanding the dynamical effect in BCDI, as well as developing a validated method for modeling BCDI at the dynamical diffraction limit, is crucial for applying BCDI to hierarchical systems that contain micron-sized crystals and grains. Thus we report a comparative study on the impact of dynamical diffraction effects by comparing the reconstruction results from two measurements of the same crystal. Forward simulation is implemented to show subtle changes of interference fringes in the diffraction pattern due to the dynamical diffraction, and is compared directly with the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2026

The Q 10 of in situ microbial soil respiration varies with mean annual temperature, precipitation, pH, and plant cover: a meta-analysis and spatial prediction of Q 10

The temperature sensitivity of soil microbial respiration, commonly quantified using the Q 10 coefficient, is a key parameter in carbon cycle models. Uncovering how environmental factors affect in situ Q 10 values can therefore provide critical insight into potential shifts in global carbon stocks under climate change. We collected data from previously published field experiments that measured soil microbial respiration across a range of temperatures. We hypothesized that the Q 10 coefficient of in situ soil microbial respiration would vary based on environmental factors including mean annual temperature (MAT), mean annual precipitation (MAP), plant cover type, pH, soil C:N, and latitude. Linear regression revealed that Q 10 correlates negatively with MAT and MAP and positively with pH and absolute latitude. Additionally, average Q 10 varied significantly across different plant cover types; it was highest in mountain grasslands and lowest in tropical moist forests. Variation in microbial Q 10 across environmental factors may arise from underlying mechanisms such as enzyme kinetics, substrate availability and complexity, and microbial adaptation. To capture patterns in Q 10 more comprehensively, we developed a multiple linear regression model of Q 10 based on the most individually significant environmental drivers and applied it to public datasets to generate a global map of predicted Q 10 . Q 10 was higher in high-latitude and high-altitude regions, where large permafrost carbon stores are vulnerable to thawing and decomposition. We also compared fits between the Q 10 equation and a model produced from macromolecular rate theory (MMRT). We found that the MMRT model had the superior fit and may be better suited to model temperature sensitivity of complex biological reactions. Overall, our results emphasize that relationships between microbial Q 10 and environmental variables should be accounted for in climate models. Incorporating these variations in the Q 10 parameter, rather than using a fixed value, will help predict whether CO 2 emissions will be buffered or exacerbated by soil microbial respiration under climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Geospatial Analysis of Built Infrastructure and Modeled Household Driving Patterns

The level of access to opportunities for a location can be quantified in the amount of time it takes to travel from a departure point to the destinations that somebody would want or need to visit. Isochrone maps are geometric representations of the area accessible from a departure point within a set amount of time. Informed in part by the National Household Travel Survey, this report merges location data for amenities and opportunities across six frequent destination categories – employment, education, health, food, community, and transportation – with isochrone maps generated by the TravelTime API, whose departure points are census tract population-weighted centroids. Using a “Points-In-Polygon” analysis, destinations that fall within a census tract’s isochrone are tallied as accessible from the region within one of three time thresholds: 15-, 30-, and 45-minutes by the walking, cycling, public transit, and driving modes of travel. We find that access to a high number of jobs within a typical commute duration is negatively correlated with annual household vehicle miles traveled (VMT). The spatial distribution of our data suggests that the high household VMT frequently seen surrounding the edges of major cities may be related to worker commutes into the city core, and that the high household VMT frequently seen in rural tracts may be related to the longer travel distances required to access a variety of key opportunities from these areas.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Effect of modeled time horizon on quantifying the need for long-duration storage

Long-Duration Energy Storage (LDES) has gained interest due to its key role in attaining a decarbonized, low-cost, and stable grid driven by variable renewable electricity (VRE). Currently, there is a wide range of LDES technologies being developed to provide electricity with 8+ hours of consecutive discharge. However, current capacity expansion models used in long-term planning processes rarely consider low cost LDES as a candidate technology. If they do, the storage balancing horizon (SBH) of the model usually only considers non-consecutive 1-day periods that do not capture the potential of LDES to shift energy across multiple days or even seasons. Addressing these limitations in existing models, this work explores the ways in which the optimal energy storage changes when increasing the number of consecutive days in the SBH and how these changes will impact planners who are determining the future roles of energy storage. Our analysis uses SWITCH, an open-source capacity expansion model with a high spatial resolution for the entire Western Electricity Coordinating Council (WECC) in a zero-carbon scenario in 2050. We find that the number of consecutive days in the SBH changes both the total selected power and energy capacity of LDES when storage energy and power capacity overnight costs are $\$$13 USD/kWh (or less) and $113 USD/kW, respectively. We also find that the amount of required energy in storage to drive a future VRE-driven WECC grid ranges from 2.5 TWh to 16.0 TWh depending on the length of the SBH. The optimal storage duration (energy to power ratio) we obtain ranges from 10 h to 620 h among all the scenarios. Furthermore, depending on the storage cost assumption, we observe different charge/discharge patterns when varying the length of the SBH. Given our results, we anticipate that as more LDES technologies become commercially available, it will be critical to increase the length of the SBH to fully capture the benefits of LDES assets in long-term planning processes of high VRE-driven grids.

42 ENGINEERING↗
DOE OSTI2020

Climate mediates continental scale patterns of stream microbial functional diversity

Understanding the large-scale patterns of microbial functional diversity is essential for anticipating climate change impacts on ecosystems worldwide. However, studies of functional biogeography remain scarce for microorganisms, especially in freshwater ecosystems. Here we study 15,289 functional genes of stream biofilm microbes along three elevational gradients in Norway, Spain and China. We find that alpha diversity declines towards high elevations and assemblage composition shows increasing turnover with greater elevational distances. These elevational patterns are highly consistent across mountains, kingdoms and functional categories and exhibit the strongest trends in China due to its largest environmental gradients. Across mountains, functional gene assemblages differ in alpha diversity and composition between the mountains in Europe and Asia. Climate, such as mean temperature of the warmest quarter or mean precipitation of the coldest quarter, is the best predictor of alpha diversity and assemblage composition at both mountain and continental scales, with local non-climatic predictors gaining more importance at mountain scale. Under future climate, we project substantial variations in alpha diversity and assemblage composition across the Eurasian river network, primarily occurring in northern and central regions, respectively. We conclude that climate controls microbial functional gene diversity in streams at large spatial scales; therefore, the underlying ecosystem processes are highly sensitive to climate variations, especially at high latitudes. This biogeographical framework for microbial functional diversity serves as a baseline to anticipate ecosystem responses and biogeochemical feedback to ongoing climate change.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Rendezvous algorithms for large-scale modeling and simulation

Rendezvous algorithms encode a communication pattern that is useful when processors sending data do not know who the receiving processors should be, or vice versa. The idea is to define an intermediate decomposition where datums from different sending processors can ”rendezvous” to perform a computation, in a manner that both the senders and eventual receivers of the results can identify the appropriate rendezvous processor. Though they were originally designed for interpolating between overlaid grids with independent parallel decompositions (Plimpton et al., 2004), we have recently found rendezvous algorithms useful for a variety of operations in particle- or grid-based simulation codes when running large problems on large numbers of processors. In particular, we show they can perform well when a load-balanced intermediate decomposition is randomized and not spatial, requiring all-to-all communication to move data between processors. In this case rendezvous algorithms leverage the large bisection communication bandwidths which parallel machines provide. We describe how rendezvous algorithms work in a scientific computing context and give specific examples for molecular dynamics and Direct Simulation Monte Carlo codes which result in dramatic performance improvements versus simpler algorithms which do not scale as well. We explain how a generic rendezvous algorithm can be implemented, and also point out similarities with the MapReduce paradigm popularized by Google and Hadoop.

97 MATHEMATICS AND COMPUTING↗