Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. Furthermore, this is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.

97 MATHEMATICS AND COMPUTING↗

Bundling measures for food systems transformation: a global, multimodel assessment

Background Current food systems leave one in ten individuals at risk of hunger while driving unsustainable environmental impacts. Inaction risks further exacerbating negative impacts on both human and planetary health. These challenges emerge from complex system interactions, requiring approaches that engage with this complexity and consider how transformation measures interact across food systems. We aimed to quantify the magnitude and uncertainty of the impacts of key food systems transformation measures both individually and in a bundle using an ensemble of global economic models. Methods In this global multimodel assessment, we applied an ensemble of ten state-of-the-art global economic models to evaluate the potential of four key measures in transforming food systems: increasing agricultural productivity, halving food loss and waste, shifting towards healthier diets, and economy-wide climate mitigation policies aligned with limiting warming to 1·5°C. The scenarios used a middle-of-the-road shared socioeconomic pathway for population and gross domestic product growth, climate impact data from Jägermeyr and colleagues, Thornton and colleagues, and Nelson and colleagues, and dietary targets based on the EAT–Lancet healthy reference diet, with model simulations conducted from 2020 to 2050. We then assessed the effect of these measures in isolation and in combination in a bundled scenario. To further understand the interactions between these measures, we conducted a decomposition analysis that distinguishes between the individual effects of a measure (effect when implemented alone), total effects (its contribution within the bundle), and interaction effects (the difference between total and individual effects). This approach aimed to show complementarities and trade-offs that emerge when multiple measures are implemented simultaneously. Findings Our analysis showed that individual measures in isolation are insufficient to achieve high-level environmental objectives and might generate unintended consequences. In contrast, bundling measures produces co-benefits: avoiding 50% of projected agricultural greenhouse gas emissions by 2050 and almost 20% of anticipated land conversion, while moderating food price increases associated with ambitious climate change mitigation policies. Our decomposition analysis further shows that measures can have varying effects across different dimensions. Although dietary shifts and climate mitigation policies are the largest drivers of environmental benefits (each contributing to a median decline of >10 percentage points in non-CO 2 emissions and 5 percentage points in agricultural land use globally), productivity improvements and reducing food loss and waste play essential roles in moderating price increases (each contributing to a median decline of >5 percentage points in average prices). Interpretation This study highlights the importance of implementing coordinated approaches to food system transformation and climate change mitigation rather than relying on isolated interventions. Comprehensive transformation requires understanding how supply-side and demand-side changes can interact with climate mitigation policies, enabling policy makers to design intervention packages that maximise benefits while minimising trade-offs across environmental, economic, and social dimensions.

Sundiang, Marina [Cornell Univ., Ithaca, NY (Unite↗

Scenario Discovery Analysis of Drivers of Solar and Wind Energy Transitions Through 2050

Deep human-Earth system uncertainties and strong multi-sector dynamics make it difficult to anticipate which conditions are most likely to lead to higher or lower adoption of renewable energy, and models project a broad range of future solar and wind energy shares across future scenarios. To elucidate these dynamics, we explore a large data set of scenarios simulated from the Global Change Analysis Model (GCAM) and use scenario discovery to identify the most significant factors affecting solar and wind adoption by mid-century. We generated a data set of over 4,000 scenarios from GCAM by varying 12 different socioeconomic factors at high and low levels, including assumptions about future energy demand, resource costs, and fossil fuel emissions paths, as well as specific technology assumptions including wind and solar backup requirements and storage costs. Using scenario discovery, we assess the most important factors globally and regionally in creating high fractions of solar and wind energy and explore interconnected effects on other systems including water and non-CO 2 emissions. Globally and regionally, we found that solar and wind-related technology costs were the primary drivers of high wind and solar energy adoption, though a few regions depend heavily on other parameters like carbon capture and storage costs, population and gross domestic product trajectories, and fossil fuel costs. We also identify four key paths to high solar and wind energy by mid-century and discuss their tradeoffs in terms of other outcomes.

14 SOLAR ENERGY↗

Characterization and dynamics of the peculiar stream Jhelum: A tentative role for the Sagittarius dwarf galaxy

Stellar streams are a promising tool to study the Milky Way’s dark matter subhalo population, as interactions with subhalos are expected to leave visible imprints in the streams in the form of substructure. However, there may be other causes of substructure. Here we studied the kinematics and the unusual morphology of the stellar stream Jhelum. Using a combination of ground-based photometry and Gaia EDR3 astrometry, we characterized the morphology of Jhelum. We combined this new data with radial velocities from the literature to perform orbit integrations of the stream in static Galactic potentials. We also carried out N-body simulations in the presence of the Sagittarius dwarf galaxy. The new data reveal a previously unreported tertiary component in the stream, as well as several gaps and a kink-like feature in its narrow component. We find that for a range of realistic Galactic potentials, no single orbit is able to reproduce Jhelum’s radial velocity data entirely. A generic property of the orbital solutions is that they share a similar orbital plane to Sagittarius and this leads to repeated encounters with the stream. Using N-body simulations that include a massive Sagittarius, we explored its effect on Jhelum, and we show that these encounters are able to qualitatively reproduce the narrow and broad components in Jhelum, as well as create a tertiary component in some cases. We also find evidence that such encounters can result in an apparent increase in the velocity dispersion of the stream by a factor up to four due to overlapping narrow and broad components. Our findings suggest that the Jhelum stream is even more complex than once thought; however, its morphology and kinematics can tentatively be explained via the interactions with Sagittarius. In this scenario, the formation of Jhelum’s narrow and broad components occurs naturally, yet some of the smaller gap-like features remain to be explained.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing gravity with the DES-CMASS sample and BOSS spectroscopy

ABSTRACT The DES-CMASS sample (DMASS) is designed to optimally combine the weak lensing measurements from the Dark Energy Survey (DES) and redshift-space distortions (RSD) probed by the CMASS galaxy sample from the Baryonic Oscillation Spectroscopic Survey. In this paper, we demonstrate the feasibility of adopting DMASS as the equivalent of CMASS for a joint analysis of DES and BOSS in the framework of modified gravity. We utilize the angular clustering of the DMASS galaxies, cosmic shear of the DES metacalibration sources, and cross-correlation of the two as data vectors. By jointly fitting the combination of the data with the RSD measurements from the CMASS sample and Planck data, we obtain the constraints on modified gravity parameters $\mu _0=-0.37^{+0.47}_{-0.45}$ and $\Sigma _0=0.078^{+0.078}_{-0.082}$. Our constraints of modified gravity with DMASS are tighter than those with the DES Year 1 redMaGiC sample with the same external data sets by 29 per cent for μ0 and 21 per cent for Σ0, and comparable to the published results of the DES Year 1 modified gravity analysis despite this work using fewer external data sets. This improvement is mainly because the galaxy bias parameter is shared and more tightly constrained by both CMASS and DMASS, effectively breaking the degeneracy between the galaxy bias and other cosmological parameters. Such an approach to optimally combine photometric and spectroscopic surveys using a photometric sample equivalent to a spectroscopic sample can be applied to combining future surveys having a limited overlap such as DESI and LSST.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Electroluminescence Analysis and Grading of Hail Damaged Solar Panels

We analyzed more than 4000 electroluminescence images of hail damaged solar panels from a cluster of houses in Texas. We enhanced the images for ease of analysis and classified the defects within each solar cell into categories of glass breakage, installer damage, inactive substrings, crack severity, interconnect wire problems, and whether the damage was likely caused by hail. From these statistics, we quantified each panel into five levels of hail damage for insurance claims, and four levels of overall quality for potential resale pricing. Here, we share here some statistics regarding the defects with the hope that the data is useful to others attempting to predict the invisible damage to systems based just on the easily observable glass breakage statistics.

14 SOLAR ENERGY↗

High-Mileage Courier Fleet Vehicle Laboratory Battery Pack Testing

For one of each of the AVTA's plug-in hybrid electric vehicles, battery electric vehicles, and some hybrid electric vehicles tested in high-mileage courier fleets, the high-voltage traction battery packs were removed from the vehicle and tested at the beginning and end of fleet testing. For some vehicles, batteries also were tested at periodic intervals during fleet testing. Standard reference performance tests were conducted to characterize battery degradation over time. This dataset contains results from two or more rounds of battery tests for 21 distinct year/make/model vehicles (see reference ["INL Advanced Vehicle Testing Activity: On-road Logger and Laboratory Battery Pack Testing Vehicle List"](https://avt.inl.gov/sites/default/files/pdf/reports/DatasetVehicleList.pdf) for full list of vehicles). Each round of battery testing included the "Static Capacity Test" and the "Hybrid Pulse Power Characterization (HPPC) Test", conducted according to test procedures published in the United States Advanced Battery Consortium ["Battery Test Manual For Power-Assist Hybrid Electric Vehicles"](https://www.uscar.org/commands/files_download.php?files_id=57), ["Battery Test Manual For Plug-In Hybrid Electric Vehicles"](https://www.uscar.org/commands/files_download.php?files_id=168), and ["Electric Vehicle Battery Test Procedures Manual"](https://www.uscar.org/commands/files_download.php?files_id=5) prior to the time of testing. These tests were performed by Intertek Testing Services, North America. (This dataset will be shared by API; a small sample of the vehicle battery and test data has been extracted and is available for download while the API is being developed.)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

High-Mileage Courier Fleet Vehicle Laboratory Battery Pack Testing

For one of each of the AVTA's plug-in hybrid electric vehicles, battery electric vehicles, and some hybrid electric vehicles tested in high-mileage courier fleets, the high-voltage traction battery packs were removed from the vehicle and tested at the beginning and end of fleet testing. For some vehicles, batteries also were tested at periodic intervals during fleet testing. Standard reference performance tests were conducted to characterize battery degradation over time. This dataset contains results from two or more rounds of battery tests for 21 distinct year/make/model vehicles (see reference ["INL Advanced Vehicle Testing Activity: On-road Logger and Laboratory Battery Pack Testing Vehicle List"](https://avt.inl.gov/sites/default/files/pdf/reports/DatasetVehicleList.pdf) for full list of vehicles). Each round of battery testing included the "Static Capacity Test" and the "Hybrid Pulse Power Characterization (HPPC) Test", conducted according to test procedures published in the United States Advanced Battery Consortium ["Battery Test Manual For Power-Assist Hybrid Electric Vehicles"](https://www.uscar.org/commands/files_download.php?files_id=57), ["Battery Test Manual For Plug-In Hybrid Electric Vehicles"](https://www.uscar.org/commands/files_download.php?files_id=168), and ["Electric Vehicle Battery Test Procedures Manual"](https://www.uscar.org/commands/files_download.php?files_id=5) prior to the time of testing. These tests were performed by Intertek Testing Services, North America. This dataset is shared by API; a small sample of the vehicle battery and test data has been extracted and is also available for download.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Emulating the Android Boot Process

Critical vulnerabilities continue to be discovered in the boot process of Android smartphones used around the world. The entire device's security is compromised if boot security is compromised, so any weakness presents undue risk to users. Vulnerabilities persist, in part, because independent security analysts lack access and appropriate tools. In response to this gap, we implemented a procedure for emulating the early phase of the Android boot process. This work demonstrated feasibility and utility of emulation in this space. By using HALucinator, we derived execution context and data flow, as well as incorporated peripheral hardware behavior. While smartphones with shared processors have substantial code overlap regardless of vendor, generational changes can have a significant impact. By applying our approach to older and modern devices, we learned interesting characteristics about the system. Such capabilities introduce new levels of introspection and operation understanding not previously available to mobile researchers.

97 MATHEMATICS AND COMPUTING↗

Safer Foundation Solar Demands Skill Collaborative

The milestones and accomplishments achieved in Safer’s Solar Demands Skill Training program required a collective effort of stakeholders. The ability to achieve the desired results and impact lives of the population we serve works best when collaborating with community stakeholders such as community-based organizations, faith-based organizations, community activists, local law enforcement, community residents, employers, and elected and appointed officials. We are working harder than ever to place clients in-demand careers and high-growth industry sectors. Our employer engagement with high growth sectors continues to increase, we have been able to deepen our relationships in this space by providing in demand stackable credential training. Launched our initiative in the green job space by partnering with organizations like ComEd, the Department of Energy, community-based organizations, faith-based organizations, and manufacturers that helped to train clients in the green jobs and renewable energy space. By the end of the year, we will have completed our tenth cohort of photovoltaic solar installation training. The training has been used as a foundation for solar panel installers to acquire new skills in in the green jobs career pathways, such as sales and customer service. It has also served as a pipeline to union-level trade positions through the skills participants obtained through partnership engagement. Safer Foundation's policy and advocacy team plays a major role in expanding opportunities for people with records to over one hundred occupations, including the trades. This reform has allowed many to secure living wage employment, reducing the high recidivism rate within Illinois. Safer continues to build our social enterprise with Reconstructive Technology Partners (RTP). RTP is introducing people with records to the construction trades such as solar, carpentry and electrical through residential remodeling of homes on smaller construction projects. Understanding the need to have a greater community presence, outreach was extended to a boots on the ground model, including, but not limited to door-to-door engagement, DE-EE0008571 Safer Foundation Page 4 of 29 local radio broadcasting and print ads in local newspapers. We continue to seek innovative ways to increase Safer Foundations' presence in the renewable energy space. Outreach efforts gave us an opportunity to share critical reentry information and opportunities about our PV installer program. Giving us reach with local and national audiences alike. We launched a systematic approach to improving client data and client tracking through an evidence-based practices initiative. That implemented an agency wide cross-functional data management system. The system supported our goal of reviewing, evaluating, and making recommendations to improve operational processes, program delivery, information sharing, and more. Played a significant part in the success of the solar program. Finally, economists around the nation agree that there is a significant labor shortage. The shortage directly threatens our ability to sustain our economic growth; if employers do not have access to the workers they need, it can lead to a shutdown in the economic recovery. The demand for Safer Foundation services is more important and impactful than ever. We will continue to build upon our 50 years of experience to address the challenges ahead and serve more people in a better way. We are confident we will accomplish beautiful things that benefit everyone involved because together, we are powerful.

14 SOLAR ENERGY↗

Progress Update from the EV Charging Working Group (#982)

The EV charging working group (#982) was formed in summer 2022 to define the equip, points, relationships, and operational data related to Level 1-2 (AC) and Level 3 (DC) Electric Vehicle Supply Equipment (EVSE). Last year, the working group developed formal EVSE-related equipment definitions, where were merged into the Project Haystack documentation in November 2022. More recently the group has also been working to expand and improve Haystack definitions related to electrical equipment and circuits. This initiative is important both for EV charging related applications and to improve Project Haystack's appeal to other industry verticals such as data centers, commercial building electrification, and more. In this presentation we will share the working group's motivation, progress, and near-term objectives.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

Results from Laboratory and Field Study of Thin Triple Pane Windows

Heat transfer through windows accounts for a significant percentage of a building’s energy use and adds substantially to the peak cooling load of a home. In recent years, improvements in glass manufacturing have enabled the use of a very thin central pane of glass similar to a cell phone screen to produce a thin triple-pane window, for finished insulated glass units (IGUs) with an overall thickness similar to standard double-pane windows. Because this highly insulating “thin triple” glass product can be incorporated into almost any existing window frame and can be fabricated at a modest added cost, the U.S. Department of Energy sponsored laboratory and field demonstration testing of thin triple-pane windows to validate thermal performance and installation requirements in real-life field settings. Thin triple pane windows were evaluated at the PNNL Lab Homes, a matched pair of manufactured houses located on PNNL’s campus in Richland, Washington and also at 16 different field study sites around the country. The experimental results include a comparison of heating, ventilation, and air-conditioning (HVAC) energy usage, condensation potential, occupant comfort, sound infiltration, and thermal performance. Field study data will be gathered through June of 2022; preliminary results are being shared in this paper. The lab houses are identical except that the reference house had standard double pane windows with assembly U-0.66 and the test house had thin triple pane windows with assembly U-0.19. Across the experimental test days, the daily HVAC savings ranged from 0.2 to 18.7 kWh (3%–18%) for the heating season and from 2.5 to 8.0 kWh (23%–41%) for the cooling season. The higher thermal performance of the thin triple-pane windows also reduced the condensation potential on the interior surface during winter months and provided more even distribution of temperatures throughout the home in comparison to the baseline. In addition to the added thermal performance, the thin triple-pane windows demonstrated significant acoustic benefits, reducing sound infiltration by 8 dB to 10 dB. For the field test portion of the project thin triple pane insulated glass units were produced by two different manufacturers, and then installed without modification into the ½” IGU pockets of the standard double pane frames of four other manufacturers. Field tests performed on existing homes in Washington, Montana, Colorado, and New York compared thin triple pane retrofits to original window conditions (before and after). Field tests at new construction sites in Minnesota, Michigan, and New York compared thin triple pane windows to commercially available solutions such as double pane or traditional triple pane (with a standard-thickness center pane). Field test work is ongoing, but preliminary results appear to follow the sound, surface temperature, and energy improvement results from the Lab Homes comparison. Additionally, reports from builders and installers indicate that thin triples require almost no added time or effort to install and look nearly identical to other windows, indicating the possibility of offering next-level performance with a product that requires very little modification to current production or installation practices, long considered a major barrier to technology uptake in the construction market.

energy efficiency, home retrofit, Windows, window ↗

Smart-DS: Synthetic Models for Advanced, Realistic Testing: Distribution Systems and Scenarios

The explosion of new ideas for distributed energy resources and advanced distribution grid algorithms faces a critical challenge: how can one effectively develop and evaluate these breakthrough technologies without an adequate set of power systems network, load, and resource data to test against? Today's open test systems, particularly for distribution systems, are tiny and incomplete; and though with enough effort, obtaining utility data under NDA can overcome scale challenges, the results can't be openly shared, preventing fair comparison. The Smart-DS project-led by NREL in partnership with MIT, Universidad Pontificia Comillas, CYME, and EDD-is working to overcome this gap by generating multiple large-scale, open, synthetic, distribution systems that are realistic but not real. These datasets go beyond a single medium voltage feeder (~1000 customers) to cover entire metropolitan areas and their surrounds with up to hundreds of feeders and millions of customers, complete with low voltage customer connections and high voltage sub-transmission. This scale allows adequate testing and analysis of not just local controls and advanced DERs, but also multiple substation interactions, optimized switching, full-scale distribution-OPF, and more. To accompany these datasets, the project is also building a rich set of scenario generation tools that can be used for distribution and transmission systems alike. This includes automated, spatially aware access to world-class, high-resolution solar, wind, and weather data: forward looking generation mixes: and highly configurable DER, load, climate, outage, control-scheme, and other scenarios. We will also highlight DiTTo, an exciting open-source, multi-way distribution dataset transformation tool for many-to-many format translation with scenario, merge/split, and many other manipulation capabilities.

DERs↗

Designing resilient IoT and Edge Computing with federated tinyML

The rapid growth of the Internet of Things (IoT) and Edge Computing (EC) has brought significant conveniences to modern society but has also greatly expanded the cyber attack surfaces, particularly as these technologies are being increasingly integrated into critical systems such as power grids, healthcare, and smart homes. Here, to improve IoT/EC’s cybersecurity posture, we leveraged Artificial Intelligence (AI) and Machine Learning (ML) by employing tinyML to monitor voluminous IoT data for cyber threats while addressing devices’ resource constraints, and utilizing Federated Learning (FL) to share local detection knowledge across the system while preserving privacy. Building on our three-layer architecture combining tinyML and FL to enhance autonomous cyber attack detection, this paper demonstrated that the architecture improves detection accuracy, reduces resource consumption, and enables lightweight, secure IoT device monitoring. These results were validated using the public N-BaIoT dataset as well as real IoT network traffic data collected under multiple attack scenarios from our testbeds. Additionally, we introduced an enhanced FL methodology with a novel preprocessing stage, including federated feature selection and global preprocessor construction, to address IoT/EC data heterogeneity. We developed a physical IoT testbed for attack simulations and data collection, implemented a tinyML-powered detector for realistic model validation, and also built a virtual testbed for scalable evaluations of FL models across diverse network environments.

Cognitive cyber↗

FunM2C: A Filter for Uncertainty Visualization of Multivariate Data on Multi-Core Devices

Uncertainty visualization is an emerging research topic in data visualization because neglecting uncertainty in visualization can lead to inaccurate assessments. In this paper, we study the propagation of multivariate data uncertainty in visualization. Although there have been a few advancements in probabilistic uncertainty visualization of multivariate data, three critical challenges remain to be addressed. First, the state-of-the-art probabilistic uncertainty visualization framework is limited to bivariate data (two variables). Second, existing uncertainty visualization algorithms use computationally intensive techniques and lack support for cross-platform portability. Third, as a consequence of the computational expense, integration into production visualization tools is impractical. In this work, we address all three issues and make a threefold contribution. First, we take a step to generalize the state-of-the-art probabilistic framework for bivariate data to multivariate data with an arbitrary number of variables. Second, through utilization of VTK-m’s shared-memory parallelism and cross-platform compatibility features, we demonstrate acceleration of multivariate uncertainty visualization on different many-core architectures, including OpenMP and AMD GPUs. Third, we demonstrate the integration of our algorithms with the ParaView software. We demonstrate the utility of our algorithms through experiments on multivariate simulation data with three and four variables.

Hari, Gautam↗

iMaNGA: mock MaNGA galaxies based on IllustrisTNG and MaStar SSPs – I. Construction and analysis of the mock data cubes

ABSTRACT Galaxy formation and evolution simulations are essential tools to probe poorly known astrophysics processes, but particular care is needed to compare simulations with galaxy observations, as observed data need to be modelled as well. We present a method to generate mock galaxies from the hydro-dynamical IllustrisTNG simulations which are suited to compare with integral field spectroscopic observation of galaxies from the SDSS-IV/Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey. First, we include the same instrumental effects and procedures as adopted in the acquisition and analysis of real data. Furthermore, we generate the galaxy spectra from the simulations using new stellar population models based on the MaNGA stellar library (MaStar). In this way, our mock data cubes have the same spatial sampling, cover the same wavelength range (3600–10 300 Å), and share the same spectral resolution (R ≈ 1800) and flux calibration of real MaNGA galaxy spectra. In this first paper, we demonstrate the method over an early- and a late-type simulated galaxy from TNG50. We analyse the correspondent mock MaNGA-like data cubes with the same full spectral fitting code, firefly, which was used for the observed spectra. We find that the intrinsic and recovered age and metallicity gradients are consistent within 1σ, with residuals over all tassels consistent with 0 at the 68 ${{\ \rm per\ cent}}$ confidence level. We also perform the challenging test at comparing intrinsic and recovered star formation histories, finding a close resemblance between input and output. In follow-up papers, we will present a full simulated MaNGA-like catalogue (≈10 000 galaxies) with a comprehensive comparison of TNG50 simulations to MaNGA observational results.

79 ASTRONOMY AND ASTROPHYSICS↗

Constraints and variation in food web link-species space

Predicting food web structure in future climates is a pressing goal of ecology. These predictions may be impossible without a solid understanding of the factors that structure current food webs. Here, the most fundamental aspect of food web structure—the relationship between the number of links and species—is still poorly understood. Some species interactions may be physically or physiologically ‘forbidden'—like consumption by non-consumer species—with possible consequences for food web structure. We show that accounting for these ‘forbidden interactions' constrains the feasible link-species space, in tight agreement with empirical data. Rather than following one particular scaling relationship, food webs are distributed throughout this space according to shared biotic and abiotic features. Our study provides new insights into the long-standing question of which factors determine this fundamental aspect of food web structure.

59 BASIC BIOLOGICAL SCIENCES↗

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗