Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Concurrent effect”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Development and validation of a humidified CAPS-PMSSA with an improved methodology to calculate the truncation correction factor

Absorbing aerosols play an important role in the Earth’s radiation budget, and current uncertainties associated with their radiative impacts remain substantial. An element of this uncertainty derives from insufficient understanding of the extent to which water, as a coating on absorbing particles, enhances the absorption. Here, we describe and characterize the performance of a cavity-attenuated phase shift single scatter albedo spectrometer (CAPS-PMSSA) system that has been modified to enable concurrent aerosol extinction and scattering measurements, from which aerosol absorption is derived, at relative humidities up to ~90%. The modified instrument is referred to as the humidified CAPS (HCAPS). Additionally, we develop and validate an update to a method to calculate the truncation correction factor, used to correct the scattering measurements, that can account for the effects of particle growth and compositional changes resulting from water uptake. The method can be applied to experiments that use either size-selected or polydisperse aerosol samples of either known or unknown composition. Overall, we show that measurements made with the HCAPS, when processed using the updated truncation correction method, enable accurate measurement of the influence of water uptake on light absorption.

Dal Porto, Rachael [University of California, Davi↗
DOE OSTI2023

Ectomycorrhizal fungi enhance pine growth by stimulating iron‐dependent mechanisms with trade‐offs in symbiotic performance

Iron (Fe) is crucial for metabolic functions of living organisms. Plants access occluded Fe through interactions with rhizosphere microorganisms and symbionts. Yet, the interplay between Fe addition and plant–mycorrhizal interactions, especially the molecular mechanisms underlying mycorrhiza-assisted Fe processing in plants, remains largely unexplored. Here, we conducted mesocosms in Pinus plants inoculated with different ectomycorrhizal fungi (EMF) Suillus species under conditions with and without Fe coatings. Meta-transcriptomic, biogeochemical, and X-ray fluorescence imaging analyses were applied to investigate early-stage mycorrhizal roots. While Fe addition promoted Pinus growth, it concurrently reduced mycorrhiza formation rate, symbiosis-related metabolites in plant roots, and aboveground plant carbon and macronutrient content. This suggested potential trade-offs between Fe-enhanced plant growth and symbiotic performance. However, the extent of this trade-off may depend on interactions between host plants and EMF species. Interestingly, dual EMF species were more effective at facilitating plant Fe uptake by inducing diverse Fe-related functions than single-EMF species. This subsequently triggered various Fe-dependent physiological and biochemical processes in Pinus roots, significantly contributing to Pinus growth. However, this resulted in a greater carbon allocation to roots, relatively reducing the aboveground plant carbon content. Our study offers critical insights into how EMF communities rebalance benefits of Fe-induced effects on symbiotic partners.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quantitative Characterization of Hyper-Local Atmospheric Greenhouse Gas Sources

Atmospheric greenhouse gas (GHG) emissions are often characterized using stationary, tower-based sensors. Ground based sensors reside in the turbulent boundary layer and are subject to intense concentration impulses from hyper-local (<100m) point sources of emissions. These high frequency spikes are often filtered out in broader emission flux studies, losing valuable information about how hyper-local sources influence receptors. In this study, we investigated how empirical atmospheric data can be used to locate and quantify a concurrently measured hyper-local point source in a dense urban setting. An eddy covariance style tower and a low-cost sensor tower were deployed in various locations around an urban, hyper-local CO2/CH4 emissions source (a continuously measured restaurant exhaust vent). A model using different processing and statistical techniques was built to examine the most effective procedures for source isolation, directional location, and emission quantification. Using excess concentrations above a minimum baseline, we identify the source using bivariate polar plots and quantify the relationship between source size, receptor distance, and statistical proxies. Furthermore, we find that varying statistical thresholds allows for identification of less influential sources which are drowned out by larger or closer sources. Finally, we show that large sources can be effectively characterized using low-cost sensors, a valuable outcome informing how networks for monitoring larger areas could be implemented. This work may provide a basis for source identification and monitoring protocols for networks that feature sensors influenced by hyper-local point sources, subject to site-specific assumptions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Dispatch Manager for NEML2 Constitutive Model Calculations Embedded in MOOSE

This report describes the extended capabilities of the NEML2 constitutive modeling library, including a flexible and efficient work dispatching system designed to leverage both CPU and GPU resources. This enhancement addresses one of the primary computational challenges in large-scale simulations: the ability to distribute and execute batches of material model evaluations across heterogeneous computing devices. The new dispatch system introduces a modular set of dispatcher and scheduler classes that coordinate the flow of data and execution between devices. The dispatcher is responsible for efficiently packaging work, managing device-specific memory operations, and synchronizing results. This modularity allows for extensibility, making it straightforward to integrate additional computing backends in the future. From an implementation standpoint, the dispatcher system interfaces seamlessly with NEML2's existing models. They handle device-aware tensor operations, optimize memory transfers, and support asynchronous execution when applicable. This design ensures that batches of material points can be evaluated concurrently, substantially improving throughput compared to previous single-device or serial implementations. These improvements not only enhance the raw performance of NEML2 but also improve its usability in multiscale and high-fidelity simulations, where the simultaneous evaluation of large material point batches is critical. Benchmarks included in the report demonstrate the system’s scalability, highlighting its effectiveness when leveraging modern GPU architectures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Concurrent Pressure-Induced Spin-State Transitions and Jahn–Teller Distortions in MnTe

Cooperative Jahn-Teller (JT) distrotion accompanied by electromagnetic-lattice coupling plays a crucial role in numerous important phenomena in materials science. The JT distortion occurring in high-spin 3d 4 and 3d 9 configurations in octahedral complexes is common, but similarly large distortion due to lifting the degeneracy of t 2g orbits has so far seldomly observed. Here we report the discovery of pressure-induced cooperative JT effect coupled with a large volume-collapse of ~12.8% and a magnetic moment collapse from S = 5/2 to S = 1/2 at ~20.9 GPa in MnTe. The first-principles calculation indicates that weakened p-d hybridization and enhanced d states localization result in lifting t 2g orbital degeneracy in Mn 2+ (d 5 ) which induced a cooperative JT effect-triggered electromagnetic-lattice coupling. Furthermore, these findings suggest a new mechanism for the cooperative JT distortion via pressure induced ligand distortion in antiferromagnetic materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Concurrent measurement of strain and chemical reaction rates in a calcite grain pack undergoing pressure solution: Evidence for surface-reaction controlled dissolution

Pressure solution is inferred to be a significant contributor to sediment compaction and lithification, especially in carbonate sediments. For a sediment deforming primarily by pressure solution, the compaction rate should be directly related to the rate of calcite dissolution, transport along grain contacts, and calcite reprecipitation. Previous experimental work has shown that there is evidence that deformation in wet calcite grain packs is consistent with control by pressure solution, but considerable ambiguity remains regarding the rate limiting mechanism. We present the results of laboratory compaction experiments designed to directly measure calcite dissolution and precipitation rates (recrystallization rates) concurrently with strain rate to test whether measured rates are consistent with predicted rates both in absolute magnitude and time evolution. Recrystallization rates are measured using trace element chemistry (Sr/Ca, Mg/Ca) and isotopes (87Sr/86Sr) of fluids flowing slowly through a compacting grain pack as it is being triaxially compressed. Imaging techniques are used to characterize the grain contacts and strain effects in the post-experiment grain pack. Our data show that calcite recrystallization rates calculated from all three geochemical parameters are in approximate agreement and that the rates closely track strain rate. The geochemically inferred rates are close to predicted rates in absolute magnitude. Uncertainty in grain contact dimensions makes distinguishing between surface reaction control and diffusion control difficult. Measured reaction rates decrease faster than predicted from standard pressure solution creep flow laws. This inconsistency may indicate that calcite dissolution rates at grain contacts are more complex, and more time-dependent, than suggested by geometric models designed to predict grain contact stresses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Enabling selective zinc-ion intercalation by a eutectic electrolyte for practical anodeless zinc batteries

Abstract Two major challenges hinder the advance of aqueous zinc metal batteries for sustainable stationary storage: (1) achieving predominant Zn-ion (de)intercalation at the oxide cathode by suppressing adventitious proton co-intercalation and dissolution, and (2) simultaneously overcoming Zn dendrite growth at the anode that triggers parasitic electrolyte reactions. Here, we reveal the competition between Zn 2+ vs proton intercalation chemistry of a typical oxide cathode using ex-situ/ operando techniques, and alleviate side reactions by developing a cost-effective and non-flammable hybrid eutectic electrolyte. A fully hydrated Zn 2+ solvation structure facilitates fast charge transfer at the solid/electrolyte interface, enabling dendrite-free Zn plating/stripping with a remarkably high average coulombic efficiency of 99.8% at commercially relevant areal capacities of 4 mAh cm −2 and function up to 1600 h at 8 mAh cm −2 . By concurrently stabilizing Zn redox at both electrodes, we achieve a new benchmark in Zn-ion battery performance of 4 mAh cm −2 anode-free cells that retain 85% capacity over 100 cycles at 25 °C. Using this eutectic-design electrolyte, Zn | |Iodine full cells are further realized with 86% capacity retention over 2500 cycles. The approach represents a new avenue for long-duration energy storage.

25 ENERGY STORAGE↗
DOE OSTI2021

Analysis of mobility data to build contact networks for COVID-19

As social distancing policies and recommendations went into effect in response to COVID-19, people made rapid changes to the places they visit. These changes are clearly seen in mobility data, which records foot traffic using location trackers in cell phones. While mobility data is often used to extract the number of customers that visit a particular business or business type, it is the frequency and duration of concurrent occupancy at those sites that governs transmission. Understanding the way people interact at different locations can help target policies and inform contact tracing and prevention strategies. This paper outlines methods to extract interactions from mobility data and build networks that can be used in epidemiological models. Several measures of interaction are extracted: interactions between people, the cumulative interactions for a single person, and cumulative interactions that occur at particular businesses. Network metrics are computed to identify structural trends which show clear changes based on the timing of stay-at-home orders. Measures of interaction and structural trends in the resulting networks can be used to better understand potential spreading events, the percent of interactions that can be classified as close contacts, and the impact of policy choices to control transmission.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Reinforced AEM Separators Based on Triblock Copolymers for Electrode-decoupled RFBs

Washington University in St. Louis (WUSTL), in collaboration with The University of Texas at San Antonio (UTSA) and Giner Inc. developed highly selective anion exchange membranes (AEMs) and a novel electrode-decoupled redox flow battery (RFB) for grid scale energy storage as part of the ARPA-E IONICS program (with connections to the DAYS program in the later part of the project). RFBs exhibit the crucial characteristic of system-level decoupled scaling of energy and power which makes them cost effective for the multi-GWh scales envisioned for grid-scale energy storage solutions. This has led to extensive (and deserved) research interest and attention. This project aimed to enhance the design space available for redox-flow batteries (RFBs) by enabling the long-term separation of disparate cationic (elemental) actives using a highly selective membrane separator, while concurrently permitting the transport of anions to balance charge. The approach proposed was to design and develop a highly selective anion-exchange membrane (AEM), which would in turn permit the design and development of electrode-decoupled RFBs. Pairs of (different element) cationic species with redox reactions exhibiting a large difference in their standard electrode potentials were identified to develop high voltage, high power RFBs while disrupting the existing paradigm of using a single element which can ionize to more than two soluble oxidation states (e.g.: Vanadium).

25 ENERGY STORAGE↗
DOE OSTI2022

Drugsniffer: An Open Source Workflow for Virtually Screening Billions of Molecules for Binding Affinity to Protein Targets

The SARS-CoV2 pandemic has highlighted the importance of efficient and effective methods for identification of therapeutic drugs, and in particular has laid bare the need for methods that allow exploration of the full diversity of synthesizable small molecules. While classical high-throughput screening methods may consider up to millions of molecules, virtual screening methods hold the promise of enabling appraisal of billions of candidate molecules, thus expanding the search space while concurrently reducing costs and speeding discovery. Here, we describe a new screening pipeline, called drugsniffer, that is capable of rapidly exploring drug candidates from a library of billions of molecules, and is designed to support distributed computation on cluster and cloud resources. As an example of performance, our pipeline required ~40,000 total compute hours to screen for potential drugs targeting three SARS-CoV2 proteins among a library of ~3.7 billion candidate molecules.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Geophysical Signatures of Crack Network Coalescence in Rocks at Multiple Length Scales

The main goal of the research project was to identify the geophysical signatures of fracture growth in natural rocks by utilizing novel geophysical techniques. The research objectives were to (a) investigate the potential for geophysical methods to determine when cracks initiate, the types and locations of propagated cracks, and the coalescence of networks of cracks in natural rocks at multiple scales, (b) determine how damage at the microscale evolved into damage at the macroscale and then link the microscopic and macroscopic observations, (c) quantify crack coalescence in rocks under realistic stress conditions using coupled mechanical-geophysical-optical visualization, and (d) identify the precursors in geophysical signals to crack coalescence. The following research thrusts were explored to achieve the research objectives: (1) uniaxial compression testing of rock specimens with and without a set of pre‐existing flaws and (2) triaxial compression testing of natural rock specimens. These thrusts allowed for exploring fracturing in rocks under realistic in situ environments and at multiple scales. This project provided educational opportunities for nine graduate and undergraduate students and resulted in 27 peer-reviewed publications. This first research thrust focused on investigating the micromechanics of fractures in rocks through uniaxial compression testing combined with advanced geophysical and imaging techniques, specifically acoustic emission (AE) monitoring, ultrasonic imaging, and 2-dimensional Digital Image Correlation (2D-DIC). By examining damage processes under time-independent and time-dependent loading conditions, insights into damage localization, crack initiation, and fracturing mechanisms were gained. It was observed that the AE signals and the strain-based measurements directly reflect the state of damage in the rock specimen and could be used to identify the cracking levels, such as the crack initiation (CI) and crack damage (CD), and the mode of deformation. A novel calibration apparatus was developed to enhance the accuracy of AE sensors, allowing for the estimation of key parameters such as magnitude, source dimension, stress drop, and radiated seismic energy associated with the fractures. The findings highlighted significant variations in the temporal evolution of AE source parameters during the primary, secondary, and tertiary stages of creep, identifying tensile cracking as the primary deformation mode. The second research thrust focused on enhancing the understanding of fracturing processes in natural rocks through triaxial compression testing, real-time AE monitoring, and ultrasonic monitoring. We investigated the impact of various factors such as fracture propagation regimes, injection parameters, rock types, and pre-existing conditions on the hydraulic fracture (HF) behavior using scaled true-triaxially loaded specimens of Barre granite and Lyons sandstone. Custom sensor housing facilitated concurrent active and passive monitoring to analyze hydro-mechanical responses and microseismicity associated with different HF scenarios. A coupled investigation of passive microseismicity and active signal attributes permitted a detailed comprehension of the various HF processes (aseismic deformation, fracture initiation and propagation, fluid permeation, and leak-off) and their dependence on the specific rock type. The findings of this research demonstrated the effectiveness of AE monitoring techniques in providing valuable insights into the impact of various factors on the behavior and dynamics of HF processes. The advancements in monitoring techniques, offering a more thorough and precise approach, represent a significant step towards optimizing HF practices and ensuring sustainable resource extraction.

58 GEOSCIENCES↗
DOE OSTI2026

Discovery of spontaneous mesoscopic strain waves in nematic domains using dark-field x-ray microscopy

Electronic nematic order arises when correlated electrons spontaneously break the rotational symmetry of a crystal lattice. When electronic nematic order couples bilinearly to symmetry-breaking lattice strain, both appear together at a single ferroelastic phase transition, producing structural twin domains with distinct orientations of the nematic director. While the effects of applied strain on these domains are well established, the intrinsic behavior of spontaneous subdomain strain fields has remained unexplored. Here, we report the discovery of spontaneous mesoscopic strain waves within individual nematic domains of an iron-based superconductor, observed using dark-field x-ray microscopy (DFXM). Using this advanced full-field imaging technique, we visualize subdomain strain modulations emerging concurrently with nematic order. Elastic compatibility relations governing inhomogeneous strains provide a natural mechanism for the strain waves. Our findings reveal a broadly relevant form of strain self-organization and position DFXM as a powerful probe of the local interplay between lattice strain and electronic order.

36 MATERIALS SCIENCE↗
DOE OSTI2021

VTO_2021_APR_LLNL_Ye

Traditional batteries are composed of two-dimensional films that are stacked and/or rolled. Thin film batteries display high power density while their thick film counterparts show good energy density, but it has proven difficult to concurrently achieve both within these planar form factors. In addition, conventional Li-ion batteries based on liquid organic electrolytes or gel polymer electrolytes have raised severe safety concerns due to the intrinsic flammable properties of the organic electrolytes. They are also not ideal for the use of high energy density metallic lithium (Li) anodes due to Li dendrite growth, or sulfur cathodes due to shuttling effects that result in fast capacity fade. There is an urgent need to develop safe, high-performance solid-state batteries (SSBs) with advanced electrolyte and separator technologies. Although in recent years a series of superionic conductors have been developed for electrolytes and separators, their performance does not satisfy demanding criteria due to large impedance from poor solid electrolyte-electrode contact and questionable electrochemical and mechanical stability. Unlike the well-established roll-to-roll fabrication of conventional Li-ion batteries, the processing of SSBs is unique due to the brittleness of solid-state electrolytes (SSEs). The commercially available or lab-developed SSE discs are usually very thick (hundreds of micrometers to millimeters) to overcome their brittle nature, which unfortunately increases the cell impedance and accounts for the majority of the overall cell weight and volume, leading to dramatically decreased power and energy densities. In this project, we will investigate 3D printing techniques to overcome safety, fabrication, mechanical, and electrochemical issues in SSBs. 3D printing builds complex structures in a layer-by-layer fashion, which allows rapid production of hierarchical architectures, gradient and multi-material structures, and multi-component assemblies. 3D printing is an emerging area that could fundamentally transform energy storage devices. For example, 3D printing can produce batteries with arbitrary form factors to fit a product’s specific volume requirements and can create interwoven electrode arrangements over a wide range of length scales to improve transport and increase power density for a given energy density. For SSBs, 3D printing may dramatically reduce the separator thickness from ~1 mm (by hydraulic pressing) to tens of micrometers or less. In addition, the interfacial contact area between the electrolyte and the electrode may be increased via 3D interdigitated designs. Hence, we expect a significant reduction of the overall cell impedance and enhancement of both energy and power densities of SSBs by harnessing an array of 3D printing technologies being developed at Lawrence Livermore National Laboratory (LLNL).

25 ENERGY STORAGE↗
DOE OSTI2025

Towards a multiscale approach for understanding irradiation induced swelling and creep in 316 stainless steels - A coupled cluster dynamics and crystal plasticity approach

Structural materials undergo mechanical degradation, in part due to irradiation-induced swelling and creep, under nuclear reactor conditions. While swelling results from the migration and clustering of irradiation-induced atomic-scale mobile defects, the interaction of mesoscale dislocations with these defects causes creep deformation. A coupled crystal plasticity (CP) and mean-field cluster dynamics (CD) approach is presented to investigate the effect of irradiation on the long-term mechanical behavior of 316 stainless steel, which are under consideration for use in nuclear reactors. The temporal evolution of Frenkel pairs and extended defect population, under a chosen irradiation flux and temperature, is predicted using the CD model. The impact of the irradiation defects on the stress state, and the resulting dislocation-mediated inelastic deformation, is modeled concurrently with the CP model. The inelastic deformation is irradiation flux dependent, and early-stage defect evolution determines the later-stage mechanical behavior in 316 stainless steel.

36 - MATERIALS SCIENCE↗
DOE OSTI2021

Conditioning the Surface and Bulk of High-Nickel Cathodes with a Nb Coating: An In Situ X-ray Study

Surface coating is commonly employed by industries to improve the cycling and thermal stability of high-nickel (Ni) transition metal (TM) layered cathodes for their practical use in lithium-ion batteries. Niobium (Nb) coating or substitution has been shown to be effective in stabilizing LiNi 0.8 Mn 0.1 Co 0.1 O 2 (NMC811) cathodes; in addition, the electrochemical performance of the final products varies depending on the postprocessing. In this follow-up study, we use in situ synchrotron X-ray diffraction to investigate the kinetic processes and the involved structural evolution in Nb-coated NMC811 upon heat treatment. Furthermore, quantitative structure analysis reveals thermally driven concurrent changes in the bulk and surface, in particular, the phase evolution of the coating layer and Nb/TM interdiffusion that facilitates penetration of Nb into the bulk and particle growth at the increased temperatures. Findings from this study highlight the new opportunities for the intended control of the structure and surface properties of high-Ni cathodes through surface coating in conjunction with postprocessing.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Fair Concurrent Training of Multiple Models in Federated Learning

Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be trained simultaneously, sharing clients’ computing resources, which we call Multiple-Model Federated Learning (MMFL). Current MMFL algorithms use naïve average-based client-task allocation schemes that often lead to unfair performance when FL tasks have heterogeneous difficulty levels, as the more difficult tasks may need more client participation to train effectively. Furthermore, in the MMFL setting, we face a further challenge that some clients may prefer training specific tasks to others, and may not even be willing to train other tasks, e.g., due to high computational costs, which may exacerbate unfairness in training outcomes across tasks. We address both challenges by firstly designing FedFairMMFL, a difficulty-aware algorithm that dynamically allocates clients to tasks in each training round, based on the tasks’ current performance levels. We provide guarantees on the resulting task fairness and FedFairMMFL’s convergence rate. We then propose novel auction designs that incentivizes clients to train multiple tasks, so as to fairly distribute clients’ training efforts across the tasks, and extend our convergence guarantees to this setting. Here, we finally evaluate our algorithm with multiple sets of learning tasks on real world datasets, showing that our algorithm improves fairness by improving the final model accuracy and convergence speed of the worst performing tasks, while maintaining the average accuracy across tasks.

Federated learning↗
DOE OSTI2024

Shifts in belowground processes along a temperate forest edge

Abstract Context Forests are increasingly fragmented, and as a result most forests in the United States are within one km of an edge. Edges change environmental conditions of the forest—especially radiation, roughness, temperature, and moisture—that can have consequences for plant productivity and ecosystem functions. However, edge effects on aboveground characteristics of plants and the environment are better understood relative to plant roots and soil in the belowground environment. Objectives Our main objectives were to determine if soil C pools and fluxes are higher at the edge relative to other landscape positions, and to understand how specific belowground processes contribute to bulk differences in pools and fluxes. Methods We measured environmental conditions, live and dead fine root traits, soil chemistry, and soil respiration along a 75 m transect from interior forest to meadow in Gaithersburg, MD. Results We observed differences in the soil chemical, biological and hydrological environment between the forest interior, edge and adjacent meadow. In some cases, the forest edge represented a mid-point in environmental or belowground characteristics between the forest interior and meadow ( e.g. , pH, C-to-N ratio [C:N], live fine root biomass, heterotrophic respiration), likely reflecting the change in litter type and quality associated with the transition from grass to woody species. In other cases, neighboring landscape positions were different from the forest edge, which was drier and had higher dead fine root biomass. Although soil C contents were not significantly different across landscape positions, there was a tendency towards higher average soil C content at the edge relative to other landscape positions, suggesting that increased C loss related to root decay and greater soil respiration at the edge relative to the forest interior may have been offset by increased C gain from high plant productivity and subsequent inputs to soil. Conclusions This research provides insight into how forest edge environments may differ from the interior and how concurrent processes above- and belowground may contribute to those differences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗