Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “grid and infrastructure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Sustainable Energy Solutions for Thermal Load in Buildings—Role of Heat Pumps, Solar Thermal, and Hydrogen-Based Cogeneration Systems

Economic and population growth is leading to increased energy demand across all sectors—buildings, transportation, and industry. Adoption of new energy consumers such as electric vehicles could further increase this growth. Sensible utilization of clean renewable energy resources is necessary to sustain this growth. Thermal needs in a building pose a significant challenge to the energy infrastructure. Potential technological solutions to address growing energy demand while simultaneously lowering the carbon footprint and enhancing the grid flexibility are presented in this study. Performance assessment of heat pumps, solar thermal collectors, nonfossil fuel-based cogeneration systems, and their hybrid configurations is reported in this study. The impact of design configuration, coefficient of performance (COP), electric grid’s primary energy efficiency on the key attributes of total carbon footprint, life cycle costs, operational energy savings, and site-specific primary energy efficiency are analyzed and discussed in detail. In conclusion, heat pumps and hydrogen-fueled solid oxide fuel cells (SOFCs) are highly effective building energy resources compared to traditional approaches; however, the carbon intensity of electrical energy and hydrogen production are keys to the overall environmental benefit.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Energy Infrastructure Futures: A Multiscale Evaluation of Projected Power Plant Siting Across the Western Interconnection

Energy Infrastructure Futures: A Multiscale Evaluation of Projected Power Plant Siting Across the Western Interconnection Description This dataset contains input and output data for the manuscript Mongird, K. et al. (under review) titled "Energy Infrastructure Futures: A Multiscale Evaluation of Projected Power Plant Siting Across the Western Interconnection". Input data corresponds to gridded spatial siting attributes that are necessary to conduct a random forest machine learning analysis of siting feature importance. Output data includes SHAP feature analysis outputs, and classification report values. For data on power plant siting results referred to in the manuscript, please refer to the CERF: IM3 Projected Western US Power Plant Locations data download page. The downloadable data includes values for eight different future scenarios for the Western US. The scenarios include combinations of two Shared Socioeconomic Pathways (SSP3 and SSP5) with four high-resolution climate projections specific to the United States (see, https://tgw-data.msdlive.org/). These climate projections include "hotter" and "cooler" variants for two Representative Concentration Pathways (RCP4.5 and RCP8.5). The resulting eight simulations are: rcp45cooler_ssp3 rcp45cooler_ssp5 rcp45hotter_ssp3 rcp45hotter_ssp5 rcp85cooler_ssp3 rcp85cooler_ssp5 rcp85hotter_ssp3 rcp85hotter_ssp5 Technical Information The dataset includes two sets of data files: (1) CERF gridded siting parameters and (2) Feature analysis outputs and classification reports. All downloadable data is in csv file format. Files with x/y coordinate information use the Albers Equal Area Conic projection (ESRI:102003). 1. CERF Gridded Siting Parameters This directory provides a balanced sample of gridded CERF siting parameters data for eight different scenarios for the Western US through 2055, seven different technologies, and eight timesteps. This data serves as input to the feature analysis. It contains the following parameters. region_name - name of region (i.e., state) sited - binary value representing whether the grid cell received a siting of that technology type (1=True) rcp - binary value representing scenario resource concentration pathway (0 = RCP4.5, 1 = RCP8.5) ssp - binary value representing scenario shared socioeconomic pathway (0 = SSP3, 1 = SSP5) climate - binary value representing cooler (0) or hotter (1) GCM forcing tech_name - generation technology name sited_year - year that values correspond to transmission_cost - cost of transmission interconnection pipeline_cost - cost of natural gas pipeline interconnection interconnection_cost - total interconnection cost (sum of transmission cost and gas pipeline cost) lmp - associated locational marginal value ($/MWh) associated with the grid cell, timestep, scenario, and technology xcoord - x-coordinate of location ycoord - y-coordinate of location 2a. Feature Analysis Output The dataset includes the feature analysis shap output for locational marginal price and interconnection cost. It contains the following parameters. technology - generator technology name scenario - name of scenario feature - name of feature, either locational_marginal_price or interconnection_cost value - the mean of absolute value of SHAP values for given feature 2b. Feature Analysis Classification Report This download includes the classification report associated with each random forest model. The dataset contains the following parameters. technology - generation technology name scenario - name of scenario test - one of precision (the proportion of predicted positives that are actually correct), recall (the proportion of actual positives that were correctly identified), f1-score (the harmonic mean of precision and recall) 0.0 - value of test for classification of 0 (grid cell not chosen for siting) 1.0 - value of test for classification of 1 (grid cell chosen for siting) accuracy - accuracy of model (i.e., fraction of all predictions that were right) macro avg - Simple average of test values for all classes weighted avg - Weighted average of test values for all classes, weighted based on Acknowledgment IM3 is a multi-institutional effort led by Pacific Northwest National Laboratory and supported by the U.S. Department of Energy's Office of Science as part of research in MultiSector Dynamics, Earth and Environmental Systems Modeling Program. License This data is made available under a CCBY4 License Disclaimer This material was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government nor the United States Department of Energy, nor the Contractor, nor any or their employees, nor any jurisdiction or organization that has cooperated in the development of these materials, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness or any information, apparatus, product, software, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof, or Battelle Memorial Institute. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof. PACIFIC NORTHWEST NATIONAL LABORATORYoperated byBATTELLEfor theUNITED STATES DEPARTMENT OF ENERGYunder Contract DE-AC05-76RL01830

Mongird, Kendall [Pacific Northwest National Labor↗

A Blockchain and PKI-Based Secure Vehicle-to-Vehicle Energy-Trading Protocol

With the increasing awareness for sustainable future and green energy, the demand for electric vehicles (EVs) is growing rapidly, thus placing immense pressure on the energy grid. To alleviate this, local trading between EVs should be encouraged. In this paper, we propose a blockchain and public key infrastructure (PKI)-based secure vehicle-to-vehicle (V2V) energy-trading protocol. A permissioned blockchain utilizing the proof of authority (PoA) consensus and smart contracts is used to securely store data. Encrypted communication is ensured through transport layer security (TLS), with PKI managing the necessary digital certificates and keys. A multi-leader, multi-follower Stackelberg game-based trade algorithm is formulated to determine the optimal energy demands, supplies, and prices. Finally, we propose a detailed communication protocol that ties all the components together, enabling smooth interaction between them. Key findings, such as system behavior and performance, scalability of the trade algorithm and the blockchain, smart contract execution costs, etc., are presented through numerical results by implementing and simulating the protocol in various scenarios. This work not only enhances local energy trading among EVs, encouraging efficient energy usage and reducing burden on the power grid, but also paves a way for future research in sustainable energy management.

Stackelberg game↗

A Review of Edge Computing Technology and Its Applications in Power Systems

Recent advancements in network-connected devices have led to a rapid increase in the deployment of smart devices and enhanced grid connectivity, resulting in a surge in data generation and expanded deployment to the edge of systems. Classic cloud computing infrastructures are increasingly challenged by the demands for large bandwidth, low latency, fast response speed, and strong security. Therefore, edge computing has emerged as a critical technology to address these challenges, gaining widespread adoption across various sectors. This paper introduces the advent and capabilities of edge computing, reviews its state-of-the-art architectural advancements, and explores its communication techniques. A comprehensive analysis of edge computing technologies is also presented. Furthermore, this paper highlights the transformative role of edge computing in various areas, particularly emphasizing its role in power systems. It summarizes edge computing applications in power systems that are oriented from the architectures, such as power system monitoring, smart meter management, data collection and analysis, resource management, etc. Additionally, the paper discusses the future opportunities of edge computing in enhancing power system applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Renewable energy integration and system operation challenge: control and optimization of millions of devices

The electric power infrastructure, originally designed and built on large-scale power plants, is evolving into a more resilient power generation and delivery system in which millions of smaller units of distributed energy generation resources units will be installed in sub-transmission and distribution networks. In order to control, manage and optimize the future grid, a hierarchical design is presented in this chapter which enables the distributed control on grid edge while inheriting the existing centralized control structure. This layered design of large-scale power system operation and control uses the following principle: reactive power control is treated as a primary control for voltage stability, and the real power control is primarily a grid-level control but can also be a supplementary control for voltage support in the case of insufficient reactive power control capacity. For the purpose of active control and operation at the distribution level, a recursive power network model is derived from nodal injection and branch power flow models. Based on the model, the proposed algorithms of hierarchical control, grid-edge inference and dynamic hosting allowance are developed and presented for multi-level controlled operation. And, a co-simulation architecture of integrated T&D system is presented to validate and demonstrate the feasibility and scalability of proposed algorithms.

Xu, Ying↗

High-Fidelity Analysis of EV Integration on Real Utility Feeders in Colorado

Residential electric vehicle (EV) charging has the potential to alter long-held assumptions on load characteristics impacting distribution grid planning, operations, and design standards. This study identifies analysis and control methods to increase the affordability of residential EV charging both for Xcel Energy and their customers. The project also provides solutions for more reliable grid interconnection that can support a reliable utility business model prepared for increasing EV charging load in the coming years. For this project, we referenced Level 2 alternating current (AC) onboard charging profiles for various vehicle models and high-fidelity charging data collected at the experimental setup established at the EV Research Infrastructure Laboratory at the National Renewable Energy Laboratory (NREL). Next, we developed EV adoption models for 2030 and 2040 for the Boulder and Aurora regions in Colorado. Moreover, we evaluated different smart charging control algorithms and compared their performance. We developed time-of-use (TOU)-based and grid-aware active EV charging control methods and integrated them within the study region to understand field impacts. Diving deeper, we selected 10 feeders in Boulder and Aurora for high-fidelity grid modeling down to the house level. We executed detailed grid analysis comparing the smart charge management (SCM) algorithms we developed. Finally, we created a novel tool, Electric Vehicle Infrastructure--Distribution System Integration Tool (EVI-DiST), to integrate all the approaches in a single software environment to provide easy integration, fast simulation, and detailed evaluation capability for utility engineers and other stakeholders.

33 ADVANCED PROPULSION SYSTEMS↗

Constraints and Potentials of Future Irrigation Water Availability on Agricultural Production Under Climate Change

Freshwater availability is relevant to almost all socioeconomic and environmental impacts of climate and demographic change and their implications for sustainability. We compare ensembles of water supply and demand projections driven by ensemble output from five global climate models. Our results suggest reasons for concern. Direct climate impacts to maize, soybean, wheat, and rice involve losses of 400–2,600 Pcal (8–43% of present-day total). Freshwater limitations in some heavily irrigated regions could necessitate reversion of 20–60 Mha of cropland from irrigated to rainfed management, and a further loss of 600–2,900 Pcal. Freshwater abundance in other regions could help ameliorate these losses, but substantial investment in infrastructure would be required. We compare ensembles of water supply and demand projections from 10 global hydrological models and six global gridded crop models. These are produced as part of the Inter-Sectoral Impacts Model Intercomparison Project, with coordination from the Agricultural Model Intercomparison and Improvement Project, and driven by outputs of general circulation models run under representative concentration pathway 8.5 as part of the Fifth Coupled Model Intercomparison Project. Models project that direct climate impacts to maize, soybean, wheat, and rice involve losses of 400–1,400 Pcal (8–24% of present-day total) when CO2 fertilization effects are accounted for or 1,400–2,600 Pcal (24–43%) otherwise. Freshwater limitations in some irrigated regions (western United States; China; and West, South, and Central Asia) could necessitate the reversion of 20–60 Mha of cropland from irrigated to rainfed management by end-of-century, and a further loss of 600–2,900 Pcal of food production. In other regions (northern/eastern United States, parts of South America, much of Europe, and South East Asia) surplus water supply could in principle support a net increase in irrigation, although substantial investments in irrigation infrastructure would be required.

agriculture↗

Oilwell Conversion (Well API 121913310501) to Geothermal Heat Storage Well for Flexible Electricity Storage

Geothermal growth is limited by a lack of geographically dispersed high-temperature thermal resources and high initial upfront investment in characterization and well construction. This project intended to address the challenges of energy supply intermittency and enhance grid resilience, reliability, and energy security by storing energy provided from currently available renewable resources in the subsurface to harvest it a later time during at-peak energy demand. This project intended to improve geothermal adoption, reduce initial project risk, and improve price competitiveness through utilizing existing oil and gas infrastructure such as non-productive wells, non-economic fields, dry holes, and orphaned wells. The project also intended to address the lack of geographically dispersed thermal resources and enhance grid resilience, reliability, and energy security by introducing an economical method for storing energy from currently available renewable resources in the subsurface for usage during at-peak energy demand. During this research, the project furthered the understanding of the feasibility of utilizing abandoned oil and gas wells as geothermal heat storage wells. The project team investigated the heat storage and hydrogeological characteristics of subsurface reservoirs in the Illinois Basin to evaluate their response to heat injection for determining the evolution of temperature profiles and heat losses over time using existing and available data sets. The project team then performed modeling and simulation to evaluate the heat losses of returning fluids during heat extraction. The outputs were used to select an optimal candidate reservoir and location in Southern Illinois. The team designed and performed a small-scale field test in an existing oil well to refine the model and to demonstrate the permitting and regulatory pathways necessary for the conversion of oil and gas assets to geothermal use. The field test also serves as a proof of concept and can guide the procedures for future research and implementation. Additionally, the project team, conducted initial market research and customer discovery to develop a go to market strategy for an Advanced Geothermal Energy Storage (AGES) system. The project team in this research also identified the parameters to be refined in future research, to improve the current go to market strategy economic model. To this end several subject matter experts were also identified to assist in future research with geothermal infrastructure setup, energy storage policy and law, energy storage market demand, potential siting based on demand etc. Future research will involve further sophistication of the site commercial modeling, implementing a larger-scale test, and further refinement of the thermodynamic modeling/simulation process. The output will be lifecycle costs and economics suitable for comparison to alternative approaches from a validated full-scale demonstration for venture capital investment into this technology. The project successfully demonstrated the ability to leverage existing oilfield infrastructure, permits, and land access and leasing agreements, to enable geothermal storage projects to come online faster and cheaper than a greenfield development could. This technology could allow for greater energy independence and security through long-term energy storage solutions. The longer duration allows for greater storage for renewables currently limited by hours-long storage durations of lithium-ion. The AGES system would support the growth of renewable energy farms, and provide greater opportunities for a cleaner energy infrastructure.

15 GEOTHERMAL ENERGY↗

Modular High-Energy Systems for Solar Power Satellites

Modular High-Energy Systems are Stepping Stones to provide capabilities for energy-rich infrastructure located in space to support a variety of exploration scenarios as well as provide a supplemental source of energy during peak demands to ground grid systems. Abundant renewable energy at lunar or other locations could support propellant production and storage in refueling scenarios that enable affordable exploration. Renewable energy platforms in geosynchronous Earth orbits can collect and transmit power to satellites, or to Earth-surface locations. Energy-rich space technologies also enable the use of electric-powered propulsion systems that could efficiently deliver cargo and exploration facilities to remote locations. A first step to an energy-rich space infrastructure is a 100-kWe class solar-powered platform in Earth orbit. The platform would utilize advanced technologies in solar power collection and generation, power management and distribution, thermal management, electric propulsion, wireless avionics, autonomous in space rendezvous and docking, servicing, and robotic assembly. It would also provide an energy-rich free-flying platform to demonstrate in space a portfolio of technology flight experiments. This paper summary a preliminary design concept for a 100-kWe solar-powered satellite system to demonstrate in-flight a variety of advanced technologies, each as a separate payload. These technologies include, but are not limited to state-of-the-art solar concentrators, highly efficient multi-junction solar cells, integrated thermal management on the arrays, and innovative deployable structure design and packaging to enable the 100-kW satellite feasible to launch on one existing launch vehicle. Higher voltage arrays and power distribution systems (PDS) reduce or eliminate the need for massive power converters, and could enable direct-drive of high-voltage solar electric thrusters.

Howell, Joe T.↗

Improving Resiliency in Planning MW-Scale Medium and Heavy Duty EV Charging Stations Considering TSCOTS Optimization

Electrification of heavy-duty (HD) vehicles marks an important milestone and technical challenge in the electric vehicle (EV) industry and the public grid. However, implementing EV charging at this scale will necessitate that traditional truck stops be updated with EV charging infrastructure that could represent 10's of MW in electricity consumption. Furthermore, as the transportation sector is represented as critical infrastructure, supporting resiliency considerations in EV charging infrastructure will be critical. This paper proposes an optimization-based approach for optimally designing a MW-scale microgrid charging network. This approach transforms conventional designed truck stops into a reliable HDEV charging stations capable of overnight slow charging and 30-minute to 1 hour fast charging. Using a mixed-integer linear program formulation blending capacity planning and reliability constraints, an optimal network configuration can be solved for a proposed EV charging station that includes photovoltaic and battery energy storage capabilities.

Ponce, Moises [University of Tennessee, Knoxville ↗

Deployment Readiness Framework Subtask 1.2 Outreach Report: Common Themes Among Clean Energy Transition Technical Assistance Projects

Island and remote coastal communities face an uncertain energy future. These communities build, operate, and maintain energy infrastructure in extremely challenging environments and pay the highest prices for electricity and fuels. Moreover, climate change increasingly affects grid reliability, resiliency, and, ultimately, the cost of energy. Marine energy could address many of the challenges faced by island and remote coastal communities, but these communities often have limited resources and capacity to invest in complex energy and coastal resilience issues. The Deployment Readiness Framework (DRF) is being developed to support community-driven energy transitions in these coastal communities and to better understand the readiness of communities for marine energy demonstration and operation. Led by the National Renewable Energy Laboratory and Pacific Northwest National Laboratory, the DRF builds on the Energy Transitions Initiative Partnership Project (ETIPP) supported in part by the U.S. Department of Energy's Water Power Technologies Office. This report details the results from the stakeholder outreach and engagement effort linked to the previously reported literature review.

16 TIDAL AND WAVE POWER↗

Key Goals and Innovations Needed for a U.S. Compact Fusion Pilot (Final Technical Report)

Fusion energy offers the prospect of addressing the nation's energy needs and contributing to the transition to a low-carbon emission electrical generation infrastructure. Technology and research results from U.S. investments in the major fusion burning plasma experiment known as ITER, coupled with a strong foundation of research funded by the Department of Energy (DOE), position the United States to begin planning for its first fusion pilot plant. Strong interest from the private sector is an additional motivating factor, as the process of decarbonizing and modernizing the nation's electric infrastructure accelerates and companies seek to lead the way. At the request of DOE, Bringing Fusion to the U.S. Grid builds upon the work of the 2019 report Final Report of the Committee on a Strategic Plan for U.S. Burning Plasma Research to identify the key goals and innovations - independent of confinement concept - that are needed to support the development of a U.S. fusion pilot plant that can serve as a model for producing electricity at the lowest possible capital cost.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Floating Solar at Lima's Twin Lakes Reservoir

The City of Lima, Ohio is developing a floating photovoltaic (FPV) facility on the surface of Twin Lake Reservoir, adjacent to the City’s water treatment plant. The FPV array is designed with a capacity of 2 megawatts (MW) and will consist of approximately 3,500 solar panels spanning more than four acres of water surface. Based on regional solar conditions, the system will generate 2,000 megawatt-hours (MWh) of electricity annually. While the FPV system will interconnect to the electrical infrastructure serving the water treatment plant, power produced by the system will be net-metered through the utility grid, with energy credits applied to offset the plant’s overall electrical demand rather than directly supplying all plant loads in real time.

14 SOLAR ENERGY↗

Regional Analysis for an Economically and Environmentally Viable Transition to Heavy-Duty Vehicles with Alternative Powertrains

The transportation sector is responsible for a significant portion of greenhouse gas emissions. Within the sector, truck freight is responsible for a third of the associated emissions. Alternative powertrains are seen as a viable approach to significantly reduce these emissions. Prior to making a large-scale transition, it is important to consider the following questions: will the power grid support a transition to alternative powertrains?; will the transition truly reduce carbon emissions?; and will the transition impose an unnecessary economic burden on companies within the industry? The answer to these questions, however, can vary by geography, maturity/capacity of the energy distribution network or predicted vehicle load. We focus on the latter two questions, investigating the variation in estimated total cost of ownership and carbon emissions across the United States at the zip code level for both heavy-duty battery electric vehicles and heavy-duty fuel cell electric vehicles. As a benchmark, we compare estimated emissions and costs of alternative powertrain vehicles to that of conventional heavy-duty vehicles powered by diesel internal combustion engines. This work highlights areas with electric grids primed for a transition to alternative powertrain vehicles, such as the Pacific Northwest, and areas that require further infrastructure investment in renewables, such as many of the Mountain states, Missouri, and Florida. Additionally, this work illustrates the current advantages in carbon emissions of battery electric vehicles compared to fuel-cell electric vehicles, while providing insights into required regional investments for narrowing the gap.

Goulet, Nate [ORNL] (ORCID:0000000237314965)↗

Addressing Rising Energy Demand Through Innovation

The U.S. is facing a significant increase in energy demand, driven by AI advancements, the rapid expansion of data centers, manufacturing and industrial growth, and the electrification of transportation and buildings. Buildings alone account for approximately 75% of U.S. electricity consumption and 40% of total energy use. To address these challenges, NLR leverages its state-of-the-art research facilities, advanced energy modeling, hardware-in-the-loop emulation, and real-world demonstrations to provide data-driven insights that de-risk emerging energy solutions, increase efficiency and demand flexibility, optimize grid controls, and identify vulnerabilities to enhance energy security. This presentation will highlight our research ecosystem and its role in supporting a more reliable, affordable, and adaptive energy infrastructure in the face of accelerating demand.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Situational Awareness of Grid Anomalies (SAGA) for Visual Analytics—Near-Real-Time Cyber-Physical Resiliency Through Machine Learning

The Situational Awareness of Grid Anomalies (SAGA) project built upon foundational power system tools developed at the National Renewable Energy Laboratory (NREL) integrated with an ever-increasing set of Gridmetrics data extracted from the cable television (CATV) broadband network infrastructure while assimilating other time-series geospatial data and information, such as weather and cyber-physical phenomena, to demonstrate a disruptive technology for power system data analytics relying on existing infrastructure. Three research thrusts supported (1) visual analytics, (2) cyber-physical power system simulation, and (3) anomaly detection. SAGA created technology that leverages, couples, and fortifies two vastly different realms - power and broadband - to increase the resiliency of the power grid in the face of increasing cyberattacks and operational challenges related to integrating DERs. The exploration of potential synergies of broadband-enabled grids resulted in identifying a mutually beneficial symbiosis that can increase the resiliency of both power and broadband services. Broadband networks perform better with reliable power and are good at providing real-time measurements that identify where the grid is under attack, is failing, or is weak. Likewise, sensor-starved distribution grids perform better and can be more reliable when their operation is buttressed with observations of broadband-detected anomalies. Future research can explore broadband's contribution to continuing to improve grid resiliency, reliability, and cost-effective operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Solar Power + Electric Vehicle Charging: Capturing Synergies in Minnesota

Despite the state policy support, significant market barriers to decarbonization of transportation remain. Analysis conducted by the National Renewable Energy Laboratory (NREL) and others confirm that without routine access to charging infrastructure, both at home and in non-residential locations, bullish market forecasts are unlikely to materialize. Similarly, the expansion of EV charging and variable renewable energy deployment each have potentially disruptive and costly effects on the distribution grid. Finally, electrification of passenger vehicles is not enough to decarbonize transportation without pathways to carbon-free electrification, linking EV charging and clean energy generation. This document examines the opportunity to jointly deploy solar energy and EV charging infrastructure to capture synergistic value, mitigate for risks associated with integrating and scaling both solar and EV charging, and accelerate their mutual deployment.

14 SOLAR ENERGY↗

Optimization of distributed compute resources utilization in the CMS Global Pool

The CMS Submission Infrastructure is the primary system for managing computing resources for CMS workflows, including data processing, simulation, and analysis. It integrates geographically distributed resources from Grid, HPC, and cloud providers into federated pools managed by HTCondor and Glidein- WMS, for a total of around 500k CPU cores. This system dynamically manages workloads based on priorities defined by the collaboration. Additionally, CMS scheduling strategies must be flexible to handle multiple concurrent workloads while considering changing processing demands and resource availability from various providers.Efficient utilization of vast amounts of distributed compute resources is a key element for the success of the scientific programs of the LHC experiments. Optimizing the system is essential to maximize resource efficiency and fully utilize the distributed computing power. The CMS Submission Infrastructure team thus systematically investigates sources of inefficiency in workload scheduling to reduce their impact. In addition, a strategy of pilot overloading has been introduced to compensate for other inefficiency sources, thereby optimizing resource utilization and enhancing computational throughput.

Mascheroni, Marco [UC, San Diego (main)]↗