Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hosting Capacity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Controlling Solid–Liquid Conversion Reactions for a Highly Reversible Aqueous Zinc–Iodine Battery

Aqueous rechargeable batteries are desirable for many energy storage applications due to their low cost and high safety. However, low capacity and short cycle life are the significant obstacles to their practical applications. Here, we demonstrate a highly reversible aqueous zinc-iodine battery using encapsulated iodine in microporous active carbon fibers (ACFs) as cathode materials through the rational control of solid-liquid conversion reactions. The experiments and density function theory (DFT) calculations were employed to investigate the effects of solvents and properties of carbon hosts, e.g. pore size, surface chemistries, on the adsorption of iodine species. The rational manipulation of the competition between the adsorption in carbon and solvation in electrolytes for iodine species is responsible for the high reversibility and cycling stability. The zinc-iodine batteries deliver a high capacity of 180 mAh g-1 at 1C and a stable cycle life over 3000 cycles with ~90% capacity retention as well as negligible self-discharge. We believe the principles for stabilizing the zinc-iodine system could provide new insight into conversion systems such as Li-S systems.

Environmental Molecular Sciences Laboratory↗
DOE OSTI2016

The structural and chemical origin of the oxygen redox activity in layered and cation-disordered Li-excess cathode materials

Lithium-ion batteries are now reaching the energy density limits set by their electrode materials, requiring new paradigms for Li + and electron hosting in solid-state electrodes. Reversible oxygen redox in the solid state in particular has the potential to enable high energy density as it can deliver excess capacity beyond the theoretical transition-metal redox-capacity at a high voltage. Nevertheless, the structural and chemical origin of the process is not understood, preventing the rational design of better cathode materials. We demonstrate how very specific local Li-excess environments around oxygen atoms necessarily lead to labile oxygen electrons that can be more easily extracted and participate in the practical capacity of cathodes. The identification of the local structural components that create oxygen redox sets a new direction for the design of high-energy-density cathode materials.

25 ENERGY STORAGE↗
DOE OSTI2024

Retrofitting Holcim Ste. Genevieve Cement Plant with CO2 Capture Plant Using Air Liquide Cryocap™ FG Technology

The global cement manufacturing industry is a major contributor to carbon dioxide emissions. The International Energy Agency's "Net Zero Emissions by 2050 Scenario" identifies CCS as a major strategy for meeting that goal. This project is among the first attempts to transfer capture technology developed at coal-fired power plants to the cement industry. The main objective of the project is to execute and complete a front-end engineering and design (FEED) studies for commercial-scale, carbon capture projects that separates 95% of the total CO2 emissions at the Holcim (US) Ste. Genevieve cement manufacturing facility using Air Liquide’s Pressure Swing Adsorption system (PSA) assisted Cryocap™ technology. The Holcim Ste. Genevieve cement plant in Missouri, US, boasts one of the largest single cement production lines in the world, with a capacity of approximately 12,000 t/day. The plant currently uses traditional fuels, namely coal and petcoke. The captured CO2 will be pipeline and geological storage grade. The industrial host site emits approximately 3.0 million tonne CO2/yr. Air Liquide’s Cryocap™ technology has been developed over the last 18+ years for CO2 capture applications. It has been shown to be applicable to a variety of industrial applications (e.g., steel, cement, SMR, Fluidized Catalytic Crackers (FCCs)). Cryocap™ FG consists of a Pressure Swing Adsorption (PSA) unit coupled with a Cryogenic System. The PSA pre-concentrates the CO2 from the flue gas, while the cryogenic unit enables the CO2 purity to be increased to the desired level. The project team is led by the Prairie Research Institute at the University of Illinois at Urbana-Champaign. The tasks include: complete FEED study for retrofitting the industrial facility with a carbon capture system to support developing a detailed cost estimate; business case analysis outlining the anticipated revenue and credits if projects was built and operated; technoeconomic analysis (TEA) outlining how capture system achieves DOE capture goals; and life cycle (LCA) analysis demonstrating zero net carbon emissions. The FEED study was successfully completed. This includes completing the process basis of design; preliminary engineering; outside battery limits (OSBL) detailed engineering including a Zero Liquid Discharge (ZLD) wastewater treatment system; inside battery limits (ISBL) detailed engineering [1]. An overall project capital cost estimate within a -20%/+30% accuracy was developed. The major contributors to the Total Plant Cost (TPC), by system, are the costs associated with the Outside Battery Limit (OSBL) section of the plant which includes a new river water intake structure and a Zero Liquid Discharge (ZLD) system. By cost category, the major contributors to the TPC are equipment and subcontractor costs, followed closely by engineering, construction management, home office and contractor fees. The TEA has been created to reflect the findings of the project. It analyzes the economic performance of the Cryocap™ technology by reviewing the estimated capital costs, operating cost, and revenue. The Cost of Capture (COC) associated with the Cryocap™ technology for 95% CO2 capture, when considering NETL 2018 economic assumptions (42/58 debt/equity ratio, 5.15% interest on debt and 1.42% return on equity in real dollars) and 2022 economic assumptions (42/58 debt/equity ratio, 8.82% interest on debt and 4.90% return on equity in real dollars) was found to be much lower than that for the DOE-NETL’s base-line cases. The highest contributors to the COC are annualized capital expenditures (CAPEX) and electricity consumption which can be offset by using lower cost renewable sources. The LCA was conducted using OpenLCA which is an open-source software that is recommended by NETL. The database utilized for this study was a modified version of TRACI 2.1 (developed by the US. Environmental Protection Agency’s National Risk Management Research Laboratory and modified by NETL). The Cryocap™ FG technology does not consume fuels in significant quantities and does not utilize specialized chemical solvents subject to decomposition, such as those utilized in amine-based carbon capture systems. The Cryocap™ FG technology mainly utilizes electricity as its energy input; hence, its calculated emissions are mainly associated with the generation of electricity offsite and are dependent on the energy matrix of the grid at the time of project implementation. The water consumption impact of the Cryocap™ FG is mostly for makeup of the water lost by evaporation in the cooling tower; however, the carbon capture plant will be equipped with a ZLD system to avoid effluent streams and minimize water consumption. The successful construction and operation of this plant based on this study results will provide a means to demonstrate an economically attractive and transformational capture technology that can be used to retrofit existing plants and be deployed at new plants.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2013

End-System Network Interface Controller for 100 Gb/s Wide Area Networks: Final Report

In recent years, network bandwidth requirements have scaled multiple folds, pushing the need for the development of data exchange mechanisms at 100 Gb/s and beyond. High performance computing, climate modeling, large-scale storage, and collaborative scientific research are examples of applications that can greatly benefit by leveraging high bandwidth capabilities of the order of 100 Gb/s. Such requirements and advances in IEEE Ethernet standards, Optical Transport Unit4 (OTU4), and host-system interconnects demand a network infrastructure supporting throughput rates of the order of 100 Gb/s with a single wavelength. To address such a demand Acadia Optronics in collaboration with the University of New Mexico, proposed and developed a end-system Network Interface Controller (NIC) for the 100Gbps WANs. Acadia’s 100G NIC employs an FPGA based system with a high-performance processor interconnect (PCIe 3.0) and a high capacity optical transmission link (CXP) to provide data transmission at the rate of 100 Gbps.

100 Gb/s network interface controller↗
DOE OSTI2021

Thickness-independent scalable high-performance Li-S batteries with high areal sulfur loading via electron-enriched carbon framework

Abstract Increasing the energy density of lithium-sulfur batteries necessitates the maximization of their areal capacity, calling for thick electrodes with high sulfur loading and content. However, traditional thick electrodes often lead to sluggish ion transfer kinetics as well as decreased electronic conductivity and mechanical stability, leading to their thickness-dependent electrochemical performance. Here, free-standing and low-tortuosity N, O co-doped wood-like carbon frameworks decorated with carbon nanotubes forest (WLC-CNTs) are synthesized and used as host for enabling scalable high-performance Li-sulfur batteries. EIS-symmetric cell examinations demonstrate that the ionic resistance and charge-transfer resistance per unit electro-active surface area of S@WLC-CNTs do not change with the variation of thickness, allowing the thickness-independent electrochemical performance of Li-S batteries. With a thickness of up to 1200 µm and sulfur loading of 52.4 mg cm −2 , the electrode displays a capacity of 692 mAh g −1 after 100 cycles at 0.1 C with a low E/S ratio of 6. Moreover, the WLC-CNTs framework can also be used as a host for lithium to suppress dendrite growth. With these specific lithiophilic and sulfiphilic features, Li-S full cells were assembled and exhibited long cycling stability.

36 MATERIALS SCIENCE↗
DOE OSTI2021

High Ammonia Adsorption in MFM-300 Materials: Dynamics and Charge Transfer in Host–Guest Binding

Ammonia (NH 3 ) is a promising energy resource owing to its high hydrogen density. However, its widespread application is restricted by the lack of efficient and corrosion-resistant storage materials. In this work, we report high NH 3 adsorption in a series of robust metal-organic framework (MOF) materials, MFM-300(M) (M = Fe, V, Cr, In). MFM-300(M) (M = Fe, V III , Cr) show fully reversible capacity for >20 cycles, reaching capacities of 16.1, 15.6, and 14.0 mmol g -1 , respectively, at 273 K and 1 bar. Under the same conditions, MFM-300(V IV ) exhibits the highest uptake among this series of MOFs of 17.3 mmol g -1 . In situ neutron powder diffraction, single-crystal X-ray diffraction, and electron paramagnetic resonance spectroscopy confirm that the redox-active V center enables host-guest charge transfer, with V IV being reduced to V III and NH 3 being oxidized to hydrazine (N 2 H 4 ). A combination of in situ inelastic neutron scattering and DFT modeling has revealed the binding dynamics of adsorbed NH 3 within these MOFs to afford a comprehensive insight into the application of MOF materials to the adsorption and conversion of NH 3 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Metagenomics-resolved genomics provides novel insights into chitin turnover, metabolic specialization, and niche partitioning in the octocoral microbiome

Abstract Background The role of bacterial symbionts that populate octocorals (Cnidaria, Octocorallia) is still poorly understood. To shed light on their metabolic capacities, we examined 66 high-quality metagenome-assembled genomes (MAGs) spanning 30 prokaryotic species, retrieved from microbial metagenomes of three octocoral species and seawater. Results Symbionts of healthy octocorals were affiliated with the taxa Endozoicomonadaceae , Candidatus Thioglobaceae , Metamycoplasmataceae , unclassified Pseudomonadales , Rhodobacteraceae , unclassified Alphaproteobacteria and Ca. Rhabdochlamydiaceae . Phylogenomics inference revealed that the Endozoicomonadaceae symbionts uncovered here represent two species of a novel genus unique to temperate octocorals, here denoted Ca. Gorgonimonas eunicellae and Ca. Gorgonimonas leptogorgiae . Their genomes revealed metabolic capacities to thrive under suboxic conditions and high gene copy numbers of serine-threonine protein kinases, type 3-secretion system, type-4 pili, and ankyrin-repeat proteins, suggesting excellent capabilities to colonize, aggregate, and persist inside their host. Contrarily, MAGs obtained from seawater frequently lacked symbiosis-related genes. All Endozoicomonadaceae symbionts harbored endo-chitinase and chitin-binging protein-encoding genes, indicating that they can hydrolyze the most abundant polysaccharide in the oceans. Other symbionts, including Metamycoplasmataceae and Ca. Thioglobaceae , may assimilate the smaller chitin oligosaccharides resulting from chitin breakdown and engage in chitin deacetylation, respectively, suggesting possibilities for substrate cross-feeding and a role for the coral microbiome in overall chitin turnover. We also observed sharp differences in secondary metabolite production potential between symbiotic lineages. Specific Proteobacteria taxa may specialize in chemical defense and guard other symbionts, including Endozoicomonadaceae , which lack such capacity. Conclusion This is the first study to recover MAGs from dominant symbionts of octocorals, including those of so-far unculturable Endozoicomonadaceae , Ca. Thioglobaceae and Metamycoplasmataceae symbionts. We identify a thus-far unanticipated, global role for Endozoicomonadaceae symbionts of corals in the processing of chitin, the most abundant natural polysaccharide in the oceans and major component of the natural zoo- and phytoplankton feed of octocorals. We conclude that niche partitioning, metabolic specialization, and adaptation to low oxygen conditions among prokaryotic symbionts likely contribute to the plasticity and adaptability of the octocoral holobiont in changing marine environments. These findings bear implications not only for our understanding of symbiotic relationships in the marine realm but also for the functioning of benthic ecosystems at large.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Integrated lipidomic and proteomic profiling reveals metabolic network disruption by SARS-CoV-2 variants

The rapid evolution of SARS-CoV-2 has produced myriad viral strains with increasing transmissibility and capacity for immune evasion. While effective vaccination campaigns have reduced the fatalities associated with SARS-CoV-2, infections continue, and a detailed understanding of how this virus manipulates host biochemical pathways remains elusive. We asked both whether the patterns of host lipid rewiring remained consistent across variants and whether the changes in the abundance of lipid classes are related to changes in the expression of the enzymes involved in their biosynthesis. We compared global nontargeted lipidomics on A549-ACE2 cells infected with the delta variant (B.1.617.2), or the omicron (B.1.1.529) variant to our previous results of global nontargeted lipidomics on A549-ACE2 cells infected with the original WA1 strain and further performed quantitative proteomics to assess changes in the host proteome. We found that metabolic rewiring, both on the lipid and the enzymatic level, is remarkably consistent across all three variants. We further mapped changes in the expression of host metabolic enzymes, linking enzyme expression to alterations in the abundance of specific lipids during infection. This analysis identified key proteins related to virus-mediated changes in lipid abundance, including fatty acid synthase (FASN), lysosomal acid lipase (LIPA), and ORMDL, a regulator of sphingolipid biosynthesis. These integrated lipidomic and proteomic experiments shed light on the importance of the complex network of host metabolism networks that support SARS-CoV-2 infection and suggest that lipid metabolism may be a promising avenue for uncovering conserved therapeutic targets.

SARS-CoV-2↗
DOE OSTI2022

Pushing Lithium–Sulfur Batteries towards Practical Working Conditions through a Cathode–Electrolyte Synergy

The commercialization of lithium-sulfur (Li-S) batteries is still hindered by the unsatisfactory cell performance under practical working conditions, which is mainly caused by the sluggish cathode redox kinetics, severe polysulfide shuttling, and poor Li striping/platting reversibility. We reported an effective strategy by combining Se-doped S hosted in an ordered macroporous framework with highly fluorinated ether (HFE)-based electrolyte to simultaneously address the aforementioned issues in both cathode and anode. A reversible and stable high areal capacity of > 5.4 mAh cm -2 with high coulombic efficiency > 99.2% can be achieved under high areal Se/S loading (5.8 mg cm -2 ), while the underlying mechanism was further revealed through synchrotron X-ray probes and Time-of-Flight Secondary Ion Mass Spectrometry (ToF-SIMS). The practical application potential was further evaluated at low (0 °C) and high (55 °C) temperatures under high areal Se/S loading (> 5.0 mg cm -2 ) and thin Li metal (40 µm).

25 ENERGY STORAGE↗
DOE OSTI2023

Climate change–induced stress disrupts ectomycorrhizal interaction networks at the boreal–temperate ecotone

The interaction networks formed by ectomycorrhizal fungi (EMF) and their tree hosts, which are important to both forest recruitment and ecosystem carbon and nutrient retention, may be particularly susceptible to climate change at the boreal–temperate forest ecotone where environmental conditions are changing rapidly. Here, we quantified the compositional and functional trait responses of EMF communities and their interaction networks with two boreal ( Pinus banksiana and Betula papyrifera ) and two temperate ( Pinus strobus and Quercus macrocarpa ) hosts to a factorial combination of experimentally elevated temperatures and reduced rainfall in a long-term open-air field experiment. The study was conducted at the B4WarmED (Boreal Forest Warming at an Ecotone in Danger) experiment in Minnesota, USA, where infrared lamps and buried heating cables elevate temperatures (ambient, +3.1 °C) and rain-out shelters reduce growing season precipitation (ambient, ~30% reduction). EMF communities were characterized and interaction networks inferred from metabarcoding of fungal-colonized root tips. Warming and rainfall reduction significantly altered EMF community composition, leading to an increase in the relative abundance of EMF with contact-short distance exploration types. These compositional changes, which likely limited the capacity for mycelial connections between trees, corresponded with shifts from highly redundant EMF interaction networks under ambient conditions to less redundant (more specialized) networks. Further, the observed changes in EMF communities and interaction networks were correlated with changes in soil moisture and host photosynthesis. Collectively, these results indicate that the projected changes in climate will likely lead to significant shifts in the traits, structure, and integrity of EMF communities as well as their interaction networks in forest ecosystems at the boreal–temperate ecotone.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

3-D composite anodes for Li-ion batteries with high capacity and fast charging capability

An anode for a lithium ion battery is disclosed includes a first major face, a second major face that, together with the first major face, defines a thickness of the anode, and at least one carbonaceous electrochemically active lithium host material distributed between the first and second major faces of the anode. The at least one carbonaceous electrochemically active lithium host material is selected from the group consisting of graphite, hard carbon, or a blend of graphite and hard carbon. The anode additionally defines a plurality of vertical channels extending at least partially through the thickness of the anode. A lithium-ion batter that includes the disclosed anode and a method of charging a lithium-ion battery that includes the disclosed anode are also disclosed.

Chen, Kuan-Hung↗
DOE OSTI2015

Logistics Modeling of Emplacement Rate and Duration of Operations for Generic Geologic Repository Concepts

This study identified potential geologic repository concepts for disposal of spent nuclear fuel (SNF) and (2) evaluated the achievable repository waste emplacement rate and the time required to complete the disposal for these concepts. Total repository capacity is assumed to be approximately 140,000 MT of spent fuel. The results of this study provide an important input for the rough-order-of-magnitude (ROM) disposal cost analysis. The disposal concepts cover three major categories of host geologic media: crystalline or hard rock, salt, and argillaceous rock. Four waste package sizes are considered: 4PWR/9BWR; 12PWR/21BWR; 21PWR/44BWR, and dual purpose canisters (DPCs). The DPC concepts assume that the existing canisters will be sealed into disposal overpacks for direct disposal. Each concept assumes one of the following emplacement power limits for either emplacement or repository closure: 1.7 kW; 2.2 kW; 5.5 kW; 10 kW; 11.5 kW, and 18 kW.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Pushing Lithium–Sulfur Batteries towards Practical Working Conditions through a Cathode–Electrolyte Synergy

Abstract The commercialization of lithium–sulfur (Li−S) batteries is still hindered by the unsatisfactory cell performance under practical working conditions, which is mainly caused by the sluggish cathode redox kinetics, severe polysulfide shuttling, and poor Li stripping/plating reversibility. Herein, we report an effective strategy by combining Se‐doped S hosted in an ordered macroporous framework with a highly fluorinated ether (HFE)‐based electrolyte to simultaneously address the aforementioned issues in both cathode and anode. A reversible and stable high areal capacity of >5.4 mAh cm −2 with high Coulombic efficiency >99.2 % can be achieved under high areal Se/S loading (5.8 mg cm −2 ), while the underlying mechanism was further revealed through synchrotron X‐ray probes and Time‐of‐Flight Secondary Ion Mass Spectrometry (ToF‐SIMS). The practical application potential was further evaluated at low (0 °C) and high (55 °C) temperatures under high areal Se/S loading (>5.0 mg cm −2 ) and thin Li metal (40 μm).

Zhao, Chen↗
DOE OSTI2023

The effect of pore structure in ethane-selective metal-organic frameworks for ethylene purification

Separation of ethylene from ethane is of great importance in petrochemical industry. Adsorptive separation making use of porous materials such as metal-organic frameworks (MOFs) is an energy efficient technology compared to the conventional cryogenic distillation. However, preferential adsorption of ethylene over ethane represents the major current challenge. Here we demonstrate how pore structure can significantly alter the adsorption selectivity in two isoreticular Zr-MOFs. A simple ligand functionalization in UiO-66 yields smaller/better matching pore for ethane, and weaker interaction with ethylene, greatly enhancing ethane/ethylene selectivity in MOF-801. Ab initio calculations combined with in situ infrared spectroscopic analysis unveil the nature of host-guest interactions and differences in the overall binding energies. Polymer-grade ethylene (99.9%) can be produced directly from ethane/ethylene mixture in a single step. Having well-balanced adsorption capacity and selectivity, low-cost synthesis and easy scalability MOF-801 stands out as a promising ethane-selective adsorbent for one-step ethylene purification under ambient conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Vanadium Oxide Pillared by Interlayer Mg 2+ Ions and Water as Ultralong-Life Cathodes for Magnesium-Ion Batteries

Magnesium-ion batteries (MIBs) show great potential for large-scale energy storage because of the advantages of low cost and safety, but their application is severely hindered by the difficulty in finding desirable electrode materials. In this work, we develop a bilayer-structured vanadium oxide (Mg 0.3 V 2 O 5 ·1.1H 2 O) with synergistic effect of Mg 2+ ions and lattice water as the cathode material for MIBs. The pre-intercalated Mg 2+ ions provide high electronic conductivity and excellent structural stability. The lattice water enables fast Mg 2+ ions mobility because of its charge shielding effect. As a result, the Mg 0.3 V 2 O 5 ·1.1H 2 O exhibits excellent rate performance and an unprecedented cycling life with capacity retention of 80.0% after 10,000 cycles. Furthermore, the Mg 0.3 V 2 O 5 ·1.1H 2 O exhibits good electrochemical performance in full MIBs. This scalable Mg 2+ host material is an enticing candidate as a cathode for MIBs, and its high performance is expected to meet the requirements for large-scale storage applications.

25 ENERGY STORAGE↗
DOE OSTI2014

Consequences of Optimal Bond Valence on Structural Rigidity and Improved Luminescence Properties in Sr x Ba 2-x SiO 4 :Eu 2+ Orthosilicate Phosphors

The orthosilicate phosphors Sr x Ba 2–x SiO 4 :Eu 2+ have now been known for over four decades and have found extensive recent use in solid-state white lighting. It is well-recognized in the literature and in practice that intermediate compositions in the solid-solutions between the orthosilicates Sr 2 SiO 4 and Ba 2 SiO 4 yield the best phosphor hosts when the thermal stability of luminescence is considered. We employ a combination of synchrotron X-ray diffraction, total scattering measurements, density functional theory calculations, and low-temperature heat capacity measurements, in conjunction with detailed temperature- and time-resolved studies of luminescence properties to understand the origins of the improved luminescence properties. We observe that in the intermediate compositions, the two cation sites in the crystal structure are optimally bonded as determined from bond valence sum calculations. Optimal bonding results in a more rigid lattice, as established by the intermediate compositions possessing the highest Debye temperature, which are determined experimentally from low-temperature heat capacity measurements. Greater rigidity in turn results in the highest luminescence efficiency for intermediate compositions at elevated temperatures.

Denault, Kristin A.↗
DOE OSTI2020

Mechanochemical synthesis of pillar[5]quinone derived multi-microporous organic polymers for radioactive organic iodide capture and storage

The incorporation of supramolecular macrocycles into porous organic polymers may endow the material with enhanced uptake of specific guests through host–guest interactions. Here we report a solvent and catalyst-free mechanochemical synthesis of pillar[5]quinone (P5Q) derived multi-microporous organic polymers with hydrophenazine linkages (MHP-P5Q), which show a unique 3-step N 2 adsorption isotherm. In comparison with analogous microporous hydrophenazine-linked organic polymers (MHPs) obtained using simple twofold benzoquinones, MHP-P5Q is demonstrated to have a superior performance in radioactive iodomethane (CH 3 I) capture and storage. Mechanistic studies show that the rigid pillar[5]arene cavity has additional binding sites though host–guest interactions as well as the halogen bond (-I···N = C-) and chemical adsorption in the multi-microporous MHP-P5Q mainly account for the rapid and high-capacity adsorption and long-term storage of CH 3 I.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Efficient I/O for Neural Network Training with Compressed Data

FanStore is a shared object store that enables efficient and scalable neural network training on supercomputers. By providing a global cache layer on node-local burst buffers using a compressed representation, it significantly enhances the processing capability of deep learning (DL) applications on existing hardware. In addition, FanStore allows POSIX-compliant file access to the compressed data in user space. We investigate the tradeoff between runtime overhead and data compression ratio using real-world datasets and applications, and propose a compressor selection algorithm to maximize storage capacity given performance constraints. We consider both asynchronous (i.e., with prefetching) and synchronous I/O strategies, and propose mechanisms for selecting compressors for both approaches. Using FanStore, the same storage hardware can host 2-13x more data for example applications without significant runtime overhead. Empirically, our experiments show that FanStore scales to 512 compute nodes with near linear performance scalability.

Zhang, Zhao↗