Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “global support”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Construction Methodology Transformation for the Benefit of Workforce Development

Construction is a key economic engine driving both national and global economies. While manual, onsite construction methods dominate the U.S. construction industry, a major shift towards offsite methods has been underway due to its efficiency, speed, and potential cost savings. The workforce necessary for offsite construction growth does not exist in its current form because of the focus on onsite methodologies and the lack of exposure to offsite building methods at all levels of a student’s learning journey. The growth of the U.S. construction industry and competitiveness in an increasingly global construction market over the coming decades can only be supported by a dramatic increase in the use of offsite methods, which requires ramping up workforce training for certain skillsets. The goal of Construction Methodology Transformation for the Benefit of Workforce Development was to understand the opportunities and barriers in both education and industry and to identify best practices for offering curriculum and training to educators, industry, and students that would support skills needed for careers in offsite construction. Our team proposed combining three offsite construction workforce development needs: content development, exposure and training, and job placement - under a single Platform model that would increase experience and career opportunities for students and help match them with potential industry members. Through our proposed solution we expected to see: developed offsite curriculum being utilized by educators and students; an increase in the identification of construction technology and offsite construction methods; an average increase in knowledge gain of at least 25% after participation in pilots; better equipped candidates who are prepared for jobs in offsite construction; and a beta workforce development platform that helps build more pathways for students looking for careers in offsite construction. The two pilots included almost 250 students and resulted in an average knowledge gain of 37 percent. Our research has identified areas of opportunity, for both education and industry to make collaborative training programs more efficient and successful. The chosen techniques for this program are extremely effective when both the school and factory have solid processes and cultures in place to accept students into training programs. This project serves as an important stepping stone to industrywide collaboration to move workforce development for offsite construction forward across the country. With continued collaboration programs like this can provide much needed early exposure and training in offsite construction and we can begin to fill important positions for the future of construction.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

GASNet-EX Memory Kinds: Support for Device Memory in PGAS Programming Models

There is an emerging need for adaptive, lightweight communication in irregular HPC applications at exascale, where GPU accelerators provide the majority of available compute cycles. To address this need, Lawrence Berkeley National Lab is developing a programming system to support distributed-memory HPC application development using the Partitioned Global Address Space (PGAS) model. This work includes two major components: UPC++ and GASNet-EX. UPC++ is a C++ template library providing Remote Memory Access (RMA) and Remote Procedure Call (RPC) communication interfaces. GASNet-EX is a portable, high-performance communication middleware library, used by the implementations of UPC++ and many other PGAS programming models. We describe recent advances in GASNet-EX to efficiently implement zero-copy Remote Memory Access (RMA) communication to and from memory on accelerator devices such as GPUs. We demonstrate performance improvements via benchmark results from UPC++ (on Summit) and the Legion programming system (on DGX-1), both using GASNet-EX for communication.

Hargrove, Paul H↗
DOE OSTI2023

Distribution Grid Management in the Presence of Distributed Energy Resources

The global concerns over climate change, government policies, and incentives in support of distributed energy resources (DERs) are accelerating the growth of DERs in distribution networks. The growth in DER penetration levels can create various issues such as over/under voltages, reverse power flows, overloading, and protection miscoordination. State-of-the-art grid automation solutions such as advanced distribution management systems (ADMS) and distributed energy resource management systems (DERMS) can leverage the DERs to improve distribution grid operations. The ADMS offers advanced grid management functions such as Volt-VAR optimization (VVO), fault management, and outage management to the distribution operator to improve situational awareness and optimize network operations. The DERMS solutions aggregate the small-scale BTM DERs to provide grid services including demand response, voltage regulation, and situational awareness. In this presentation, distribution grid management approaches in the presence of DERs using ADMS and DERMS will be discussed.

ADMS↗
DOE OSTI2024

Gut microbiota carbon and sulfur metabolisms support Salmonella infections

Abstract Salmonella enterica serovar Typhimurium is a pervasive enteric pathogen and ongoing global threat to public health. Ecological studies in the Salmonella impacted gut remain underrepresented in the literature, discounting microbiome mediated interactions that may inform Salmonella physiology during colonization and infection. To understand the microbial ecology of Salmonella remodeling of the gut microbiome, we performed multi-omics on fecal microbial communities from untreated and Salmonella-infected mice. Reconstructed genomes recruited metatranscriptomic and metabolomic data providing a strain-resolved view of the expressed metabolisms of the microbiome during Salmonella infection. These data informed possible Salmonella interactions with members of the gut microbiome that were previously uncharacterized. Salmonella-induced inflammation significantly reduced the diversity of genomes that recruited transcripts in the gut microbiome, yet increased transcript mapping was observed for seven members, among which Luxibacter and Ligilactobacillus transcript read recruitment was most prevalent. Metatranscriptomic insights from Salmonella and other persistent taxa in the inflamed microbiome further expounded the necessity for oxidative tolerance mechanisms to endure the host inflammatory responses to infection. In the inflamed gut lactate was a key metabolite, with microbiota production and consumption reported amongst members with detected transcript recruitment. We also showed that organic sulfur sources could be converted by gut microbiota to yield inorganic sulfur pools that become oxidized in the inflamed gut, resulting in thiosulfate and tetrathionate that support Salmonella respiration. This research advances physiological microbiome insights beyond prior amplicon-based approaches, with the transcriptionally active organismal and metabolic pathways outlined here offering intriguing intervention targets in the Salmonella-infected intestine.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Effect of Support on Iron-Based Catalyst Toward CO2-Free H2 Production From Methane Pyrolysis

The global demand for low-emission hydrogen production is increasing rapidly due to the potential for hydrogen to substitute conventional fossil fuels in energy related applications. Among all the current practical technologies – Steam Reforming of Methane (SMR), Water Electrolysis, and Methane Pyrolysis – methane pyrolysis has the potential to produce economical- and near-zero-emission hydrogen because the reaction produces a solid carbon by-product that can be monetized to offset production costs. However, this route is not without research challenges, and the selective formation of high-value carbon remains a critical issue. Supported nickel, iron, and cobalt, have been widely investigated for methane pyrolysis. Although iron-based catalysts are less active than Ni, iron catalysts offer less resistance to coke formation, are inexpensive, and have a longer lifetime. One area not sufficiently explored is the effect of support materials other than Al2O3 for the iron-based catalysts. Therefore, in this study we investigated a detailed variation of support material to study their influence on the catalytic performance. Moreover, this study offers a fair comparison because all catalytic materials were synthesized and studied under identical conditions, allowing a direct comparison of the obtained results; this is important because results reported in different publications in literature are often not comparable, due to very different reaction conditions.

Aireddy, Divakar Reddy↗
DOE OSTI2024

Effect of Support on Iron-Based Catalyst Toward CO2-Free H2 Production From Methane Pyrolysis

The global demand for low-emission hydrogen production is increasing rapidly due to the potential for hydrogen to substitute conventional fossil fuels in energy-related applications. Among practical technologies such as steam reforming of methane (SMR), water electrolysis, and methane pyrolysis, methane pyrolysis has the most potential to produce economical- and near-zero-emission hydrogen. The reaction during methane pyrolysis produces a solid carbon by-product that can be monetized to offset production costs. However, this route is not without research challenges, and the selective formation of high-value carbon remains a critical issue. Supported nickel, iron, and cobalt, have been widely investigated for methane pyrolysis. Although iron-based catalysts are less active than Ni, iron catalysts offer less resistance to coke formation, are inexpensive, and have a longer lifetime. One area not sufficiently explored is the effect of support materials other than Al2O3 for the iron-based catalysts. Therefore, we investigated a detailed variation of support materials to study their influence on the catalytic performance. Moreover, this study offers a fair and direct comparison among all catalytic materials which were synthesized and studied under identical conditions. This direct comparison of the obtained results is important because results reported in different publications are often not comparable due to very different reaction conditions.

Gull, Nathan↗
DOE OSTI2020

Validation and Sensitivity Analysis of a 1-D Lake Model Across Global Lakes

Lakes have important influence on weather and climate from local to global scales. However, their prediction using numerical models is notoriously difficult because lakes are highly heterogeneous across the globe, but observations are sparse. In this study, we assessed the performance of a 1-D lake model in simulating the thermal structures of 58 lakes with diverse morphometric and geographic characteristics by following the phase 2a local lake protocol of the Inter-sectoral Impact Model Intercomparison Project (ISIMIP2a). After calibration, the root-mean-square errors (RMSE) were below 2 °C for 70% and 75% of the lakes for epilimnion and full-profile temperature simulations, with an average of 1.71 °C and 1.43 °C, respectively. The model performance mainly depended on lake shape rather than location, supporting the possibility of grouping model parameters by lake shape for global applications. Furthermore, through machine-learning based parameter sensitivity tests, we identified turbulent heat fluxes, wind-driven mixing and water transparency as the major processes controlling lake thermal and mixing regimes. Snow density was also important for modeling the ice phenology of high-latitude lakes. The relative influence of the key processes and the corresponding parameters mainly depended on lake latitude and depth. Turbulent heat fluxes showed a decreasing importance in affecting epilimnion temperature with increasing latitude. Wind-driven mixing was less influential to lake stratification for deeper lakes while the impact of light extinction, on the contrary, showed a positive correlation with depth. Our findings may guide improvements in 1-D lake model parameterizations to achieve higher fidelity in simulating global lake thermal dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Root anatomy helps to reconcile observed root trait syndromes in tropical tree species

Premise Studying the organization of functional traits in plant leaves and stems has revealed notable patterns linking function and form; however, evidence of similarly robust organization in root tissues remains controversial. We posit that anatomical traits in roots can provide insight on the overall organization of the root system. We hypothesized that size variation in the tissue outside the stele is related in a nonlinear fashion with functional traits associated with direct resource uptake, including a negative relationship with root architectural traits, and that similar relationships detected in tropical areas also hold true in other biomes. Methods We addressed our hypotheses using empirical data from 24 tropical tree species in French Guiana, including anatomical measurements in first order roots and functional trait description for the entire fine root system. In addition, we compiled a global meta‐analysis of root traits for 500+ forest species across tropical, subtropical, and temperate forests. Results Our results supported the expected nonlinear relationships between cortical size and morphological traits and a negative linear trend with architectural traits. We confirmed a global negative relationship among specific root length (SRL), diameter, and tissue density, suggesting similar anatomical constraints in root systems across woody plants. However, the importance of factors varies across biomes, possibly related to the unequal phylogenetic representation across latitudes. Conclusions Our findings imply that the rhizocentric hypothesis can be a valuable approach to understand fine root trait syndromes and the evolution of absorptive roots in vascular plants.

Valverde‐Barrantes, Oscar J.↗
DOE OSTI2025

LandScan HD: a high-resolution gridded ambient population methodology for the world

Unwarned population distributions accounting for routine human activities are needed to address many global human security challenges, including disasters, conflict, and infrastructure demand. LandScan High Definition (LSHD) supports this need through gridded ambient population estimates that measure average human presence between daytime and nighttime at a high spatial resolution of 3 arcseconds (approximately 90 m). Although LSHD has traditionally been produced on a country-specific basis, advances in global foundational data and computational resources now enable scaling its methodology to the world. Combining aspects of top-down and bottom-up gridded population methods, LSHD allocates subnational population totals from authoritative statistics to built-up areas based on occupancy estimates for multiple facility types (e.g., residential, commercial) and then reaggregates these estimates to a global population grid. We scale this approach by organizing the LSHD data stack into a 1° resolution tileset of vector analytic features, enabling an efficient and repeatable workflow for all countries worldwide. Examining the Philippines as an output of the global LSHD baseline dataset, we contrast unwarned and residential (WorldPop) population distributions by (1) exploring a practical application of flood risk assessment and (2) evaluating their congruence with outcomes of collective human activities (subnational CO 2 emissions). Finally, we discuss plans to address current LSHD limitations through data/modeling and uncertainty quantification improvements and provide outlook for workflow automation and extending the model to social, demographic and economic population characteristics.

Building morphology↗
DOE OSTI2025

Benefits and challenges of vibroacoustic process monitoring to support operators in nuclear research facilities

According to the International Atomic Energy Agency in 2024, global nuclear energy capacity is projected to increase by 2.5 times by 2050 in their high-case scenario. Research on the laboratory scale of innovative processes within nuclear facilities is ongoing to improve nuclear fuel cycle capabilities. Vibroacoustic process monitoring of these techniques has potential to inform operators regarding process specific metrics, predictive maintenance, and anomalous event detection. Additionally, this type of monitoring has the potential to aid in nuclear safeguards. Challenges regarding vibroacoustic monitoring in these environments include high temperature, high radiation, limited access, and shielded equipment limiting sensor type and placement. Microphones, accelerometers, and temperature sensors were deployed both inside and near these environments during operation to determine environment driven limitations, sound attenuation of containment enclosures, process specific metrics, and future potential of vibroacoustic monitoring in these environments. Overall, this work highlights the benefits and limitations of vibroacoustic process monitoring in nuclear research facilities.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Using Eye-Tracking to Quantify Reverse Engineering Expertise

Software reverse engineering (RE) requires analysts to closely read and make decisions about code. Little is known about what makes an analyst successful, making it difficult to train new analysts or design tools to augment existing ones. The goal of this project was to quantify the eye movement behaviors supporting RE and code comprehension more generally. We applied eye-tracking methods from the language comprehension literature to understand where analysts direct their attention over time when completing tasks (e.g., function identification, bug detection). Across three studies, we manipulated aspects of code hypothesized to impact comprehension (e.g., variable name meaningfulness, code complexity) and presentation methods (e.g., line-by-line, free viewing, gaze-contingent moving window) to understand effects on accuracy and gaze patterns. Results showed clear benefits of meaningful variable names, and effects of expertise on global and line-specific viewing patterns. Findings could inspire empirically-supported tool or analytic adaptations that help to reduce analyst workload.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Demand for a Domestic Offshore Wind Energy Supply Chain

In March of 2021, the Biden-Harris Administration established a National Offshore Wind Target to install 30 GW by 2030. This ambitious goal was not only intended to help reduce dependencies on fossil fuels, but also represents an opportunity to establish a new and sustainable industry in the United States. The announcement referenced the potential benefits of establishing a domestic supply chain, including the opportunity for existing suppliers to produce thousands of components while creating tens of thousands of jobs over the course of the decade. This vision by the Biden-Harris Administration aligns with the perspective of the offshore wind industry. At a Leadership 100 event hosted by the Business Network for Offshore wind in 2019, offshore wind developers and manufacturers identified the need for a roadmap outlining a pathway to a domestic supply chain as the top priority facing the industry. Building up domestic manufacturing capabilities will not only energize local industries but can potentially de-risk individual project by reducing reliance on importing resources from European or Asian markets. Although establishing a domestic supply chain will require significant investment, it has the potential to create substantial benefits throughout the industry and, by extension, on the decarbonization goals of the United States. This study characterizes the challenges and opportunities facing the growth of a domestic supply chain industry and evaluates the potential benefits that could be achieved through the creation of the supply chain. This report is the first of a two-part series which will describe the full supply chain roadmap and the associated benefits; the current report focuses on the high-level deployment, workforce, and component requirements that need to be met to achieve the National Offshore Wind Target. We will present: 1. A deployment pipeline that demonstrates the pathway to 30 GW, the associated demand for major fixed-bottom and floating offshore wind components (turbines, foundations, cables, substations), and the vessel and port requirements to support these installation activities. 2. A series of sensitivity analyses showing how the demand for components, ports, and vessels changes for different technology pathways and availability of the global supply chain. 3. An estimate of the total number of jobs that would be required to support these deployment scenarios under varying levels of assumed domestic content. 4. A comprehensive list of the Tier 1, 2, and 3 components (finished components, subassemblies, and subcomponents) required to construct fixed-bottom and floating offshore wind projects. 5. A discussion of critical path components that represent a significant challenge, bottleneck, or risk for a future domestic supply chain.

17 WIND ENERGY↗
DOE OSTI2024

Microbiome processing of organic nitrogen input supports growth and cyanotoxin production of Microcystis aeruginosa cultures

Abstract Nutrient-induced blooms of the globally abundant freshwater toxic cyanobacterium Microcystis cause worldwide public and ecosystem health concerns. The response of Microcystis growth and toxin production to new and recycled nitrogen (N) inputs and the impact of heterotrophic bacteria in the Microcystis phycosphere on these processes are not well understood. Here, using microbiome transplant experiments, cyanotoxin analysis, and nanometer-scale stable isotope probing to measure N incorporation and exchange at single cell resolution, we monitored the growth, cyanotoxin production, and microbiome community structure of several Microcystis strains grown on amino acids or proteins as the sole N source. We demonstrate that the type of organic N available shaped the microbial community associated with Microcystis, and external organic N input led to decreased bacterial colonization of Microcystis colonies. Our data also suggest that certain Microcystis strains could directly uptake amino acids, but with lower rates than heterotrophic bacteria. Toxin analysis showed that biomass-specific microcystin production was not impacted by N source (i.e. nitrate, amino acids, or protein) but rather by total N availability. Single-cell isotope incorporation revealed that some bacterial communities competed with Microcystis for organic N, but other communities promoted increased N uptake by Microcystis, likely through ammonification or organic N modification. Our laboratory culture data suggest that organic N input could support Microcystis blooms and toxin production in nature, and Microcystis-associated microbial communities likely play critical roles in this process by influencing cyanobacterial succession through either decreasing (via competition) or increasing (via biotransformation) N availability, especially under inorganic N scarcity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Reproductive and leaf litterfall fluxes in forest ecosystem sites globally (1950-2022)

Forest allocation of net primary productivity (NPP) to reproduction is poorly quantified globally, despite its critical role in forest regeneration and a well-supported trade-off with allocation to growth. Although field measurements of total NPP are rare, our work finds that a proxy for reproductive carbon allocation constructed from leaf (L) and reproductive (R) litterfall fluxes, R/(R+L), is strongly correlated with R/NPP, facilitating analysis across a wide range of sites where biometric estimates of NPP are not available (R² = 0.85; Hanbury-Brown et al., 2022, Ward et al., in prep). To investigate relationships between ecosystem-scale reproductive allocation (RA) and climate, soil fertility, and stand age gradients, we conducted a literature search and synthesized 824 observations of annual average leaf and reproductive litterfall fluxes across forest sites globally. The zip file includes 1) a folder Data/ containing the litterfall data ("GlobalForestRA_data.csv") and metadata ("GlobalForestRA_metadata.doc") files. The data file includes geographic coordinates, long-term mean annual temperature and precipitation (1970-2000, extracted from WorldClim2.1), leaf and reproductive litterfall fluxes, sampling interval and protocols, forest characteristics (dominant leaf morphology, information pertaining to forest age and successional stage, and disturbance history) and soil properties (% sand, %silt, %clay, total phosphorus (P), nitrogen (N), cation exchange capacity (CEC) and pH) extracted from SoilGrids250 and from on-site measurements, where available. The metadata file contains information about each variable reported in the data file, including data sources, processing methods, and all references. The Data folder contains two additional files used to create Figure 1; these are described in greater detail in the README.2) R scripts GloalForestRA_analysis.r and GlobalForestRA_SI.r and a folder /Functions used to produce results, figures, and tables in the manuscript Ward et al. (in press)3) a README file describing how the data and R scripts can be used to reproduce statistical results, figures, and tables found in the manuscript. Ward et al. (in press)This repository can also be found at: https://github.com/r-ward/Global_Analysis_ForestRA.Ward, R.E., Zhang-Zheng, H. Aernethy, K., Adu-Bredu, S., Arroyo, L., Bailey, A. et al. (in press). Forest age rivals climate to explain reproductive allocation patterns in forest ecosystems globally. Ecology Letters. Hanbury-Brown, A.R., Ward, R.E. & Kueppers, L.M. (2022). Forest regeneration within Earth system models: current process representations and ways forward. New Phytol., 235, 20–40.Ward et al. (2025), Forest age rivals climate to explain reproductive allocation patterns in forest ecosystems globally, in prep.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Collaborative Research: Improved Efficiency and Coupling of the Radiation Code in the ACME Earth System Model. Final Report

This final report details all work performed on the project by both project partners. This project provided support to properly couple RTE+RRTMGP, a high-performance broadband radiation code, within DOE’s Energy Exascale Earth System Model (E3SM). RTE+RRTMGP is a successor to the RRTMG radiation code, which has been widely accepted for its speed and accuracy by the global modeling community, and has been in use in the NCAR CESM for many years and was implemented in the initial version of E3SM. However, the computational cost of RRTMG remains high relative to other components in part due to its complexity and to its inefficient use of modern optimization strategies, issues that were rectified by the development of RTE+RRTMGP. Many of the accomplishment in this project necessitated significant collaboration with the E3SM development team. One focus of the project was to enhance the code’s optimization on the limited number of emerging computing systems on which the model is expected be used, including Many Integrated Core (MIC) architectures and Graphics Processing Unit (GPU) hardware. We also developed additional capabilities for RTE+RRTMGP that E3SM scientists identified as important for the planned applications of the model. The result of our project was optimization of a key physical component (radiative transfer calculations) of E3SM, directly supporting E3SM’s overarching global modeling objectives. More broadly, this project provided overall advancements in the use of radiative transfer calculations in atmospheric modeling and simulation, particularly for climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Crop models: integrating systems from the molecular to global for agricultural productivity and sustainability

Mathematical models that simulate crop growth in response to environmental conditions and management practices are essential tools for exploring agriculture-based strategies to address food security and environmental sustainability challenges. Early applications of crop models focused on supporting farmers in making management decisions. Applications have since expanded to estimating future impacts on local and global food production from changing climates. Emerging applications of crop models aim to leverage how these models integrate plant processes across biological scales to identify engineering or breeding strategies that account for environmentally-responsive dynamics at field scales and for exploring solutions to improve sustainability. In this review, we highlight recent studies across these four broad application areas and highlight potential future directions for the crop modeling field.

Piao, Ximin [Univ. of Illinois at Urbana-Champaign↗
DOE OSTI2022

Light-Duty Vehicle Trip Classification Using One-Class Novelty Detection and Exhaustive Feature Extraction

Travel mode classification within travel survey data sets, especially light-duty vehicle (LDV) trips, is foundational, though nontrivial, to emerging mobility systems, travel behavior analysis, and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. The detection approaches are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the dataset requirements. This work proposes an LDV trip detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique - one-class support vector machines (OCSVMs) - and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size and feature selection, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multi-modal trip prediction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Efficient distributed continual learning for steering experiments in real-time

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training suffers from catastrophic forgetting (i.e., new patterns are reinforced at the expense of previously acquired knowledge). Training from scratch each time new training data becomes available would result in extremely long training times and massive data accumulation. Rehearsal-based continual learning has shown promise for addressing the catastrophic forgetting challenge, but research to date has not addressed performance and scalability. To fill this gap, we propose an approach based on a distributed rehearsal buffer that efficiently complements data-parallel training on multiple GPUs to achieve high accuracy, short runtime, and scalability. It leverages a set of buffers (local to each GPU) and uses several asynchronous techniques for updating these local buffers in an embarrassingly parallel fashion, all while handling the communication overheads necessary to augment input minibatches using unbiased, global sampling. We further propose a generalization of rehearsal buffers to support both classification and generative learning tasks, as well as more advanced rehearsal strategies (notably Dark Experience Replay, leveraging knowledge distillation). We illustrate this approach with a real-life HPC streaming application from the domain of ptychographic image reconstruction. Furthermore, we run extensive experiments on up to 128 GPUs of the ThetaGPU supercomputer to compare our approach with baselines representative of training-from-scratch (the upper bound in terms of accuracy) and incremental training (the lower bound). Results show that rehearsal-based continual learning achieves a top-5 validation accuracy close to the upper bound, while simultaneously exhibiting a runtime close to the lower bound.

Asynchronous data management↗