Engineering PapersSearch

SEARCH · Engineering Papers

Results for “hyperscaler”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Shedding light on U.S. small and midsize data centers: Exploring insights from the CBECS survey

As demand for digital services accelerates, the energy and environmental footprint of data centers faces increasing scrutiny. While hyperscale cloud facilities have driven efficiency gains, small and midsize U.S. data centers remain a critical yet underexamined segment with significant untapped potential for energy savings. This study leverages data from the Commercial Buildings Energy Consumption Survey (CBECS) to analyze trends in server stocks, computing customers, cooling system adoption and efficiency, and geospatial distribution from 2012 to 2018. Findings reveal a sharp decline in small and midsize data centers, from 1.764 million to 1.398 million, with server counts dropping from 5.177 million to 4.262 million—aligning with the broader shift toward cloud computing. More than 40 % of servers in small data centers and 55 % in midsize data centers are housed in office buildings, and over half of all servers are concentrated in climate zones 5A (cold), 3A (mixed-humid), and 4A (mixed-humid), with the highest densities in metropolitan hubs. While direct expansion units remain the dominant cooling system, a clear transition toward more energy-efficient solutions, particularly air economizers, is evident. By integrating server and cooling system distributions, we estimate Power Usage Effectiveness (PUE) and Water Usage Effectiveness (WUE) for U.S. data centers by size and year. Results show that midsize data centers are more energy-efficient but more water-intensive due to the widespread use of water-cooled chillers. These findings highlight the trade-offs in cooling system selection and provide a critical foundation for policies aimed at enhancing efficiency in an evolving data center landscape.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Demonstrating the data center as a flexible grid asset using a C-HIL setup

Increasing data center demand is outpacing grid infrastructure development. Artificial intelligence workloads and hyperscale cloud growth are creating unprecedented demand for power, while traditional grid expansion faces multiyear development timelines. Verrus is developing an innovative datacenter solution for this challenge, data centers that act as active grid-supportive assets rather than passive loads. Our approach integrates a novel grid-aware power flow management system with battery energy storage systems(BESS) into a microgrid-controlled, medium-voltage power distribution architecture that delivers critical capabilities, such as: * Fast response to grid disturbances such over/ under voltage or over/ under frequency * Demand flexibility that can service requests from the utility within 10 s * Uninterrupted transition to islanded operation during grid outages * Continuous uptime assurance for compute loads while maintaining all customer service level agreements. Through Verrus' strategic partnership with the National Renewable Energy Laboratory (NREL), these capabilities were validated using NREL's Advanced Research on Integrated Energy Systems (ARIES) virtual emulation environment to model a 70-MW grid-interactive data center. This paper outlines the design, methodology, and results of this emulated deployment, demonstrating that data centers can provide both critical load resilience and ancillary grid support without compromising uptime requirements. Specifically, we present a digital real time simulation of a 70 MW data center integrated with a physical microgrid controller, and demonstrate the data center response in the event of a grid voltage and frequency event, utility demand response request and utility outage.

24 POWER TRANSMISSION AND DISTRIBUTION

Energy Infrastructure Futures: A Multiscale Evaluation of Projected Power Plant Siting Across the Western Interconnection

The US Western Interconnection is facing unprecedented challenges in the form of less predictable peak demand, increasingly diverse generating resources, and fast-growing loads due to the onset of artificial intelligence, hyperscale computing, and electrification. Projecting where future generation may be developed is critical to maintaining a robust and resilient electric grid under this mounting uncertainty and variability. Using an integrated multisectoral, multiscale modeling framework that links a human-Earth systems model, an hourly load model, a geospatial power plant siting model, and an hourly grid operations model, we evaluate the power plant landscape evolution under eight alternative futures between 2020 and 2055. These futures represent a wide but plausible range of atmospheric conditions, emissions constraints, and economic, technological, and population growth assumptions. We find that local-level development can vary substantially both by generation type and capacity buildout across these futures. Specific regions of the Western Interconnection are projected to see large amounts of capacity development regardless of the future scenario. We additionally determine that projected power plant locations are more heavily influenced by the cost to interconnect to the electric grid than the locational energy value.

Mongird, Kendall

Cooling Matters: Benchmarking Large Language Models and Vision-Language Models on Liquid-Cooled Versus Air-Cooled H100 GPU Systems

The unprecedented growth in artificial intelligence (AI) workloads, recently dominated by large language models (LLMs) and vision-language models (VLMs), has intensified power and cooling demands in data centers. This study benchmarks LLMs and VLMs on two HGX nodes, each with 8× NVIDIA H100 graphics processing units (GPUs), using liquid and air cooling. Leveraging GPU Burn, Weights & Biases, and IPMItool, we collect detailed thermal, power, and computation data. Results show that the liquid-cooled systems maintain GPU temperatures between 41-50$^\circ$C, while the air-cooled counterparts fluctuate between 54-72$^\circ$C under load. This thermal stability of liquid-cooled systems yields 17% higher performance (54 TFLOPs/ GPU vs. 46 TFLOPs/GPU), performance-per-watt, reduced energy overhead, and greater system efficiency than the air-cooled counterparts. These findings underscore the energy and sustainability benefits of liquid cooling, offering a compelling path forward for hyperscale data centers seeking to optimize AI infrastructure. https://github.com/iscaas/Cooling-Matters.

Latif, Imran

Vulcan Test Platform: Demonstrating the Data Center as a Flexible Grid Asset

Explosive data center demand is outpacing grid infrastructure development. AI workloads and hyperscale cloud growth are creating unprecedented power requirements, while traditional grid expansion faces multi-year development timelines, regulatory hurdles, and decarbonization challenges. Sidewalk Infrastructure Partners recognized this impending crisis years ago and founded Verrus to develop an innovative solution: data centers that function as grid assets rather than passive loads. The Verrus approach integrates proprietary grid-aware controls with battery energy storage systems (BESS) in a medium-voltage architecture that delivers three critical capabilities: Fast-responding demand flexibility that can service requests from the utility within 10 seconds, Uninterrupted transition to islanded operation during grid disturbances, Continuous uptime assurance while maintaining all customer service level commitments Through Verrus' strategic partnership with the National Renewable Energy Laboratory (NREL), we validated these capabilities on Vulcan, a 70 MW utility-scale test platform powered by NREL's ARIES Virtual Emulation Environment. This deployment-ready technology has successfully demonstrated that Verrus data centers can deliver meaningful grid services while maintaining mission-critical reliability. This technical report outlines the design, methodology, and results of this emulated deployment, demonstrating that data centers can play a pivotal role in enhancing grid flexibility and reliability, without sacrificing service level guarantees.

24 POWER TRANSMISSION AND DISTRIBUTION

Preliminary Analysis of Nuclear-Powered Data Center Scenarios

This report provides a comprehensive analysis of the potential for nuclear energy to meet the growing energy demands of data centers (DCs). It evaluates the technical, economic, and socio-environmental implications of coupling Nuclear Power Plants (NPPs) with DCs, providing initial responses to several key research questions: What is the potential increased energy demand from DCs in the U.S., in the short, medium and long term? The U.S. is experiencing a rapid increase in energy demand from DCs, with projections indicating a total increase of 24-74 GWy(e) by 2028. Meeting this demand with nuclear energy would require 27–85 GWe of installed capacity. While this surge is expected to slow in the long term, the DC industry needs reliable, scalable, and clean energy sources. How much nuclear capacity can be deployed to meet DC demand and in which timeframe? Several pathways for increasing nuclear capacity were identified, including uprates, restarts of recently retired reactors, power purchase agreements with existing fleet, and new construction. Approximately 20‒28 GWe of nuclear capacity could be dedicated to DCs by the early 2030s. How much High Assay Low Enriched Uranium (HALEU) would be needed to support some nuclear deployment scenarios for DCs? Meeting the deployment targets announced by Google and Amazon for the Kairos Power Fluoride-Salt-Cooled High-Temperature Reactor or KP-FHR (~500 MWe by 2035) and the Xe-100 (~1 GWe by 2040), respectively, requires ramping up 19.75% enriched HALEU production to ~6 t/yr by 2040. What types of nuclear energy/DC coupling options exist, and what are the different benefits/challenges? Five coupling options were analyzed, ranging from grid-connected configurations to colocated, behind-the-meter setups. Key design considerations include the proximity to high- and/or medium-voltage transmission lines, the desired internal fault tolerance, and the sources of alternative/backup power during outages. Each coupling option offers unique benefits and challenges in terms of reliability, system costs, regulation, timeline, etc. A list of NPP/DC deployment scenarios was developed, considering existing or newly built NPP or DC projects. Colocated DCs with new small modular reactors or large reactors on greenfield and brownfield sites are the focus of this report. What types of reactors, especially what size, may be incentivized by DCs? Reactor sizing optimization revealed that the ideal reactor size and number of units depend on DC demand, coupling configurations defined in this report, and other economic factors. Larger reactors are preferred for high-demand DCs and grid-connected systems, while larger number of smaller reactors are better suited for DC configurations without grid backup. Which sites may be compatible with co-located nuclear-powered DCs? Siting those projects is a complicated evaluation factoring local water resources, grid connection availability and reliability, IT infrastructure, local work force, proximity to population zones, etc. For this effort greenfield and brownfield sites such as retired coal-fired plants were used to evaluate this question. This evaluation is not meant to recommend any particular site but it highlights key siting criteria and demonstrates large-scale site availability. What are the socio-economic impacts of co-located nuclear-powered DCs? Those projects generate substantial economic benefits to the local economy, particularly in urban settings. Hyperscale DCs colocated with nuclear power plants (sized around 1 GW of power) can create nearly 1,700 jobs for annual operations and more than 7,300 jobs among the supply chain and local businesses as a result of increased household spending. Rural projects also provide significant benefits, but at lower magnitudes compared to urban deployments.

22 GENERAL STUDIES OF NUCLEAR REACTORS

Data Center Market Report

The data center market is poised to explode in the coming decade due to undeniable drivers such as continued adoption of generative AI, increased data storage needs, and enterprise integration of AI in numerous industries [1] [2] [3]. Scalable power and increased computational capacity are at the forefront of considerations for hyperscalers, the major cloud service providers in this space. Lawrence Livermore National Laboratory is uniquely poised to help with informed decision making for data center market leaders during this phase of explosive expansion. National grid modeling expertise and cutting edge innovations in computer cooling systems place LLNL in an enviable position for creating economic impact in the data center industry by leveraging its expertise in these areas which can help the data center market keep up with growing demand.

97 MATHEMATICS AND COMPUTING

Los Alamos Innovation Enables Carbon-Negative Infrastructure Through an AI Infrastructure Partnership

A material innovation first developed at Los Alamos National Laboratory (LANL) is now enabling a major step forward in carbon management. Licensed by Spiritus, the technology is being deployed in a $500 million partnership with Prometheus Hyperscale and Casper Carbon Capture to build one of the largest carbon-negative digital infrastructure projects in the world. Located in Casper, Wyoming, the initiative directly integrates permanent carbon removal with advanced computing systems, illustrating how Los Alamos research continues to advance national goals in energy, security, and innovation.

54 ENVIRONMENTAL SCIENCES

The Role of the U.S. Electric Distribution System in Serving Data Center and Other Large Loads

The rapid expansion of data centers in the United States is reshaping how the electric distribution system must plan for and accommodate large load interconnections. This report evaluates the role of the distribution grid in serving these loads, from small edge facilities to hyperscale campuses. Using national datasets, utility filings, and industry studies, we assess demand growth, reliability requirements, interconnection thresholds, and infrastructure needs at substations and feeders. The analysis highlights the mismatch between fast data center development timelines and slower utility planning and construction cycles, as well as strategies such as phased energization, on-site generation, hosting capacity maps, and structured interconnection frameworks. While focused on data centers, the insights also apply to other high-density loads such as advanced manufacturing, hydrogen production, and electrified transportation. The report concludes with approaches to align planning processes, transparency tools, and regulatory frameworks so utilities can manage new large loads in ways that support a reliable and resilient grid.

29 ENERGY PLANNING, POLICY, AND ECONOMY

A Methodology to Evaluate the Grid Reliability Impact of Oscillations Induced by Large Loads

The rapid growth of hyperscale AI data centers is bringing renewed attention to the reliability risk that sustained forced oscillations pose to bulk power systems, with cyclic computational workloads emerging as a new forcing source. Unlike the broadband, stochastic disturbances from traditional industrial loads such as arc furnaces, AI training and inference facilities can inject large active power swings concentrated at specific frequencies over extended durations - characteristics that existing grid planning practices do not account for. While the North American Electric Reliability Corporation (NERC) has recognized this gap and called for system-level studies of large load interconnections, no standardized methodology exists to screen, simulate, and quantify these risks at the planning stage. This report presents the Risk Assessment Tool for Large Load-induced Events (RATLLE), a Python-based, publicly available script suite developed at the Pacific Northwest National Laboratory to evaluate bulk power system reliability risks from data center-induced oscillations. RATLLE implements a three-module workflow: a screening module that identifies vulnerable interconnection locations and excitable system modes; a simulation module that models cyclic data center load behavior using a commercial positive sequence simulation platform; and an analysis module that computes risk metrics and generates interactive visualization dashboards. The risk metrics, formulated around simulation observables, map oscillation impacts to a three-stage severity scale spanning latent equipment fatigue through imminent cascading failure. The methodology is demonstrated on two Western Electricity Coordinating Council (WECC) system models: a publicly available 240-bus reduced representation and a detailed 2031 Heavy Winter planning case. Case studies illustrate that even modest 50 MW forced oscillations at resonant frequencies can produce wide-area power swings, N-1 security constraint violations, and cascading generator trips through protection actions - outcomes that would not occur under normal operating conditions without oscillations present. The results underscore the need for standardized oscillation impact assessment in large load interconnection studies and provide a reproducible, extensible framework for utilities to adopt or customize within their existing planning workflows.

Biswas, Shuchismita

Modeling Framework for Data Center

This chapter highlights the critical need for advanced modeling of data centers due to their rapidly increasing energy consumption and impact on grid reliability. Driven by the demand for AI applications, data centers are projected to consume a significant portion of US energy by 2028, putting stress on an already challenged power grid. The chapter emphasizes the importance of "fast" time-scale models to understand the dynamic interactions between data centers and the grid, especially given the rapid power fluctuations of AI workloads. It outlines a modeling framework that includes both offline and real-time EMT domain simulations, detailing the necessary representations for various components like utility interfaces, transformers, IT loads, UPS, cooling loads, Battery Energy Storage Systems (BESS), generators, protection systems, and higher-level control systems. While standard simulation tools like PSCAD offer basic models, custom development is often required to accurately capture the unique and fast-changing behaviors of modern data centers. The chapter also discusses key metrics and test cases for validating these models, focusing on transient load responses, protection relay coordination, and demand flexibility. Finally, it addresses the challenges of modeling large-scale data centers, such as computational complexity and the trade-off between model fidelity and practicality, suggesting hybrid modeling approaches as a solution. The overarching goal is to create a robust framework that helps assess data center impacts on grid stability, identify vulnerabilities, and inform the development of standards for reliable integration of these large loads into the bulk power system.

25 ENERGY STORAGE