Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “direct liquid cooling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Direct Liquid Cooling for Electronic Equipment

This report documents a demonstration of an electronic-equipment cooling system in the engineering prototype development stage that can be applied in data centers. The technology provides cooling by bringing a water-based cooling fluid into direct contact with high-heat-generating electronic components. This direct cooling system improves overall data center energy efficiency in three ways: 1) High-heat-generating electronic components are more efficiently cooled directly using water, capturing a large portion of the total electronic equipment heat generated. This captured heat reduces the load on the less-efficient air-based data center room cooling systems. The combination contributes to the overall savings. 2) The power consumption of the electronic equipment internal fans is significantly reduced when equipped with this cooling system. 3) The temperature of the cooling water supplied to the direct cooling system can be much higher than that commonly provided by facility chilled water loops, and therefore can be produced with lower cooling infrastructure energy consumption and possibly compressor-free cooling. Providing opportunities for heat reuse is an additional benefit of this technology. The cooling system can be controlled to produce high return water temperatures while providing adequate component cooling. The demonstration was conducted in a data center located at Lawrence Berkeley National Laboratory in Berkeley, California. Thirty-eight servers equipped with the liquid cooling system and instrumented for energy measurements were placed in a single rack. Two unmodified servers of the same configuration, located in an adjacent rack, were used to provide a baseline. The demonstration characterized the fraction of heat removed by the direct cooling technology, quantified the energy savings for a number of cooling infrastructure scenarios, and provided information that could be used to investigate heat reuse opportunities. Thermal measurement data were used with data center energy use modeling software to estimate overall site energy use. These estimates show that an overall data center energy savings of approximately 20 percent can be expected if a center is retrofitted as specified in the models used. Increasing the portion of heat captured by this technology is an area suggested for further development.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Long Term Per-Component Power and Thermal Measurements of the OLCF Summit System

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide a dataset that records the long-term power and thermal behavior of the 200PF pre-exascale supercomputer at the Oak Ridge Leadership Computing Facility (OLCF), Summit. This system is an IBM AC922 based system that has 9,252 IBM Power9 CPUs and 27,756 Nvidia V100 GPUs and can consume up to 13MW power at peak. Heat removal is performed using medium temperature direct liquid cooling and rear-door heat exchanger based secondary cooling loop. Originally extracted from a high-resolution (1Hz) per-component (GPUs, CPUs) measurements from the system, we primarily provide a dataset that has 10-second and 1-minute mean power and thermal measurements selected from five month-long segments over the course of 2020 (January and August), 2021 (February and August), and 2022 (January). For convenience, we also provide various sub datasets randomly sampled from the time and space (hosts) of the cluster. Further details and example code for analysis can be found in the following GitHub repository: https://github.com/at-aaims/summit_power_and_thermal_data

97 MATHEMATICS AND COMPUTING↗

Providing Thermal Stability for an Exascale Supercomputer: A Case Study of Frontier's Cooling System

High performance computing (HPC) systems frequently produce large dynamic power swings, even under typical operating conditions, that can present a significant challenge for their direct-liquid cooling systems. Further, the primary cooling loops that must remove this waste heat have response times measured in minutes while the underlying HPC component thermal stress is measured in seconds. The per-socket power demand for both compute processing units (CPUs) and graphic processing units ( GPUs) continues to increase with each successive generation while case temperatures are declining. New HPC systems are expected to exacerbate the challenge of these dynamic power swings and the impact on effective and timely cooling systems. This paper describes the cooling and controls system for Oak Ridge National Laboratory’s Frontier Supercomputer, the first sustained exascale system, as a case study for this situation. The cooling and control system for Frontier demonstrates specific success, but with a number of trade-offs and decisions that suggest further design and operating optimizations for the community at large to consider.

42 ENGINEERING↗

Advanced Data Center Energy Opportunities: Cloud and Infrastructure CoP - Data Center Energy and Efficiency with AI Adoption

The NLR portion of the "Cloud & Infrastructure CoP - Data Center Energy and Efficiency with AI Adoption" web meeting will cover data center locations, energy use and load growth, best practices, performance metrics, transition to direct liquid cooled data center equipment, and NLR's approach to optimizing data center.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Aircraft electric motor with integrated cooling system

Aircraft electric motors include a motor unit having a rotor and a stator. The stator includes a plurality of windings and cooling channels arranged to provide cooling thereto. A drive unit is configured to drive operation of the motor unit. A cooling system includes a working fluid arranged within a cooling fluid flow path, wherein the cooling fluid flow path includes a liquid cooling path configured to direct flow of the working fluid through, at least, the cooling channels of the motor unit and a vapor cooling path configured to direct flow of the working fluid through the drive unit and a separator arranged upstream of each of the liquid cooling path and the vapor cooling path and configured to direct a liquid portion of the working fluid into the liquid cooling path and configured to direct a vapor portion of the working fluid into the vapor cooling path.

Alahyari, Abbas A.↗

Energy Performance Testing of Asetek's RackCDU System at NREL's High Performance Computing Data Center

In this study, we report on the first tests of Asetek's RackCDU direct-to-chip liquid cooling system for servers at NREL's ESIF data center. The system was simple to install on the existing servers and integrated directly into the data center's existing hydronics system. The focus of this study was to explore the total cooling energy savings and potential for waste-heat recovery of this warm-water liquid cooling system. RackCDU captured up to 64% of server heat into the liquid stream at an outlet temperature of 89 degrees F, and 48% at outlet temperatures approaching 100 degrees F. This system was designed to capture heat from the CPUs only, indicating a potential for increased heat capture if memory cooling was included. Reduced temperatures inside the servers caused all fans to reduce power to the lowest possible BIOS setting, indicating further energy savings potential if additional fan control is included. Preliminary studies manually reducing fan speed (and even removing fans) validated this potential savings but could not be optimized for these working servers. The Asetek direct-to-chip liquid cooling system has been in operation with users for 16 months with no necessary maintenance and no leaks.

97 MATHEMATICS AND COMPUTING↗

Sandia’s Liquid-Cooled Data Center Boosts Efficiency and Resiliency

The Federal Energy Management Program (FEMP) encourages federal agencies and organizations to improve data center energy efficiency, which can offer tremendous opportunities for energy and cost savings. In this success story, a novel liquid cooling system provides reliable, resilient, and energy-efficient cooling for high performance computing (HPC) systems at Sandia National Laboratories.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The environmental footprint of data centers in the United States

Much of the world's data are stored, managed, and distributed by data centers. Data centers require a tremendous amount of energy to operate, accounting for around 1.8% of electricity use in the United States. Large amounts of water are also required to operate data centers, both directly for liquid cooling and indirectly to produce electricity. For the first time, we calculate spatially-detailed carbon and water footprints of data centers operating within the United States, which is home to around one-quarter of all data center servers globally. Our bottom-up approach reveals one-fifth of data center servers direct water footprint comes from moderately to highly water stressed watersheds, while nearly half of servers are fully or partially powered by power plants located within water stressed regions. Approximately 0.5% of total US greenhouse gas emissions are attributed to data centers. We investigate tradeoffs and synergies between data center's water and energy utilization by strategically locating data centers in areas of the country that will minimize one or more environmental footprints. Our study quantifies the environmental implications behind our data creation and storage and shows a path to decrease the environmental footprint of our increasing digital footprint.

54 ENVIRONMENTAL SCIENCES↗

"Hot" for Warm Water Cooling

Liquid cooling is key to reducing energy consumption for this generation of supercomputers and remains on the roadmap for the foreseeable future. This is because the heat capacity of liquids is orders of magnitude larger than that of air and once heat has been transferred to a liquid, it can be removed from the datacenter efficiently. The transition from air to liquid cooling is an inflection point providing an opportunity to work collectively to set guidelines for facilitating the energy efficiency of liquid-cooled High Performance Computing (HPC) facilities and systems. The vision is to use non-compressor-based cooling, to facilitate heat re-use, and thereby build solutions that are more energy-efficient, less carbon intensive and more cost effective than their air-cooled predecessors. The Energy Efficient HPC Working Group is developing guidelines for warmer liquid-cooling temperatures in order to standardize facility and HPC equipment, and provide more opportunity for reuse of waste heat. This report describes the development of those guidelines.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimal environmental and economic performance trade-offs for fifth generation district heating and cooling network topologies with waste heat recovery

Network topology greatly influences both the economic and environmental performance of fifth generation district heating and cooling (5GDHC) systems. In this study the optimal trade-offs between the environmental and economic performance of 5GDHC network topologies for a five-building district with waste heat recovery were explored. A life cycle assessment method was used to calculate the total life cycle CO 2 emissions (LCCO2) associated with the installation and operation of various network topologies. Twelve months of empirical data from a data center cooling system were analyzed to assess its suitability for integration into a 5GDHC system. The most suitable method for utilizing this waste heat was selected based on the ambient loop warm pipe setpoint, waste heat temperature, and district energy system configuration. A multi-objective optimization algorithm was used to select the 5GDHC network topology that provided the optimal trade-off between LCCO2 and life cycle cost (LCC). A trade-off parameter was employed to weigh the importance of each objective in the selection process. The results showed waste heat from the data center was suitable for integration into the 5GDHC system due to its availability and consistent temperature profile. When return temperatures of 25 °C or higher were available from the liquid-cooled system, direct pre-heating of the ambient loop warm pipe was found to be the most effective waste heat integration method. The selection of the network topology that provided the optimal trade-off between LCCO2 and LCC (optimal trade-off topology) was highly dependent on factors such as fuel prices, CO 2 prices, electricity CO 2 emissions factors, availability of waste heat, embodied CO 2 emissions associated with network installation and network infrastructure costs. Optimal trade-off topologies produced substantial LCCO2 reductions relative to corresponding LCC increases. LCCO2 reduction to LCC increase ratios from 5.78 to 117.79 were identified with CO 2 offset costs ranging from 4.77 to 60.08 ($/tCO 2 e).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

OLCF Summit Supercomputer GPU Snapshots During Double-Bit Errors and Normal Operations

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide double-bit errors using system telemetry data and logs collected from the Summit supercomputer, equipped with 27,648 Tesla V100 GPUs with 2nd-generation high-bandwidth memory (HBM2). The dataset relies on Nvidia XID records internally collected by GPU firmware at the time of failure occurrence, on the reboot-time logs of each Summit node, on node-level job scheduler records collected after each job termination, and on a 1Hz data rate from the baseboard management controllers (BMCs) of each Summit compute node using the OpenBMC event subscription protocol. Technical details can be found in the paper Oles et. al “Understanding GPU Memory Corruption at Extreme Scale: The Summit Case Study” ICS’24 (https://doi.org/10.1145/3650200.3656615).

97 MATHEMATICS AND COMPUTING↗

Generation and Characterization of Anisotropic Microstructures in Rare Earth-Iron-Boron Alloys

The goal of this work is to investigate methods in which anisotropy could be induced in fine-grained alloys. We have identified two general processing routes to creating a fine, textured microstructure: form an amorphous precursor and devitrify in a manner that induces texture or form the fine, textured microstructure upon cooling directly from the liquid state. Since it is possible to form significant amounts of amorphous material in RE-Fe-B alloys, texture could be induced through biasing the orientationof the crystallites upon crystallization of the amorphous material. One method of creating this bias is to form glassy material and apply uniaxial pressure during crystallization. Experiments on this are presented. All of the work presented here utilizes melt-spinning, either to create precursor material, or to achieve a desired final microstructure. To obtain greater control of the system to process these materials, a study was done on the effects of heating the wheel and modifying the wheel’s surface finish on glass formation and phase selection. The second general approach—creating the desired microstructure directly from the liquid—can be done through directional rapid solidification. In particular, alloys melt-spun at low tangential wheel speeds often display directional columnar growth through a portion of the ribbon. By refining and stabilizing the columnar growth, a highly textured fine microstructure is achieved. The effects of adding a segregating element (Ag) on the columnar growth are characterized and presented.

36 MATERIALS SCIENCE↗

Light-Weight, Single-Phase, Liquid-Cooled Cold Plate (Presentation)

This presentation, 'Light-Weight, Low-Cost, Single-Phase Liquid-Cooled Cold Plate,' directly addresses program goals of increased power density, specific power, and lower cost of power electronics components through improved thermal management.

33 ADVANCED PROPULSION SYSTEMS↗

U-gas +Cool GTL™ - A New Integrated Process for Direct Biomass Conversion to Liquid Fuels

The U-Gas gasification technology, marketed by Sungas, is a proven fluid bed gasification technology for biomass conversion. U-Gas has been tested on a wide variety of biomass feeds including wood and waste streams. The U-Gas Technology has successfully converted wood for more than 20 years in a gasification plant in Skive Denmark at the 150t/d size. GTI has also recently developed the Cool GTL process for converting biogas to high quality gasoline, jet, and diesel fuels. The technoeconomics and LCA for the combination of the two technologies results an integrated optimized process, which will be discussed. The Cool GTL process is still in development and the development should be complete by 2023. Cool GTL converts high CO2 content feeds to synthesis gas with a 2-2.4/1 H2/CO ratio suitable for fuels synthesis. The process is based on a novel, highly stabile CO2/steam reforming catalyst. The 2.0-2.4/1 H2/CO synthesis gas ratio is always achieved, independently of feed CO2 content, by adjusting the amount of water added according to the amount of CO2 in the feed. The reformer catalyst has been tested for 500 hours and shows no measurable deactivation. The product from the reformer then goes directly to a low temperature slurry bed Fischer Tropsch reactor with an integrated finishing hydroisomerization reactor which makes hydrocarbon liquids from the synthesis gas. With this configuration no wax is produced. The technoeconomics and carbon intensity for the integration of UGas and the Cool GTL processes will be compared to other biomass conversion approaches. The use of electrolysis to boost H2 in the feed and increase liquid production will also be analyzed as a potential process improvement with sensitivities to the cost of electricity and the use of renewable electricity.

09 BIOMASS FUELS↗