Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “demand modelling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Insights on Nuclear Energy from Long-Term System Models: Inter-Model Comparison Results

A variety of US electric power sector capacity expansion models are used by decision makers and analysts to evaluate competition among generation, transmission, and storage technologies to meeting the demands of the system. CEMs use least-cost optimization to identify optimal portfolios of investments capable of satisfying all specified requirements. While CEMs are a useful tool to inform pathways to meet future needs, projections can differ significantly between tools for apparently similar scenario assumptions. Differences in model structure, scope, and input assumption contribute to this issue. This work compares model response with harmonization between four modeling teams on issues significant to the representation and development of nuclear energy.

capacity expansion model↗

Oilwell Conversion (Well API 121913310501) to Geothermal Heat Storage Well for Flexible Electricity Storage

Geothermal growth is limited by a lack of geographically dispersed high-temperature thermal resources and high initial upfront investment in characterization and well construction. This project intended to address the challenges of energy supply intermittency and enhance grid resilience, reliability, and energy security by storing energy provided from currently available renewable resources in the subsurface to harvest it a later time during at-peak energy demand. This project intended to improve geothermal adoption, reduce initial project risk, and improve price competitiveness through utilizing existing oil and gas infrastructure such as non-productive wells, non-economic fields, dry holes, and orphaned wells. The project also intended to address the lack of geographically dispersed thermal resources and enhance grid resilience, reliability, and energy security by introducing an economical method for storing energy from currently available renewable resources in the subsurface for usage during at-peak energy demand. During this research, the project furthered the understanding of the feasibility of utilizing abandoned oil and gas wells as geothermal heat storage wells. The project team investigated the heat storage and hydrogeological characteristics of subsurface reservoirs in the Illinois Basin to evaluate their response to heat injection for determining the evolution of temperature profiles and heat losses over time using existing and available data sets. The project team then performed modeling and simulation to evaluate the heat losses of returning fluids during heat extraction. The outputs were used to select an optimal candidate reservoir and location in Southern Illinois. The team designed and performed a small-scale field test in an existing oil well to refine the model and to demonstrate the permitting and regulatory pathways necessary for the conversion of oil and gas assets to geothermal use. The field test also serves as a proof of concept and can guide the procedures for future research and implementation. Additionally, the project team, conducted initial market research and customer discovery to develop a go to market strategy for an Advanced Geothermal Energy Storage (AGES) system. The project team in this research also identified the parameters to be refined in future research, to improve the current go to market strategy economic model. To this end several subject matter experts were also identified to assist in future research with geothermal infrastructure setup, energy storage policy and law, energy storage market demand, potential siting based on demand etc. Future research will involve further sophistication of the site commercial modeling, implementing a larger-scale test, and further refinement of the thermodynamic modeling/simulation process. The output will be lifecycle costs and economics suitable for comparison to alternative approaches from a validated full-scale demonstration for venture capital investment into this technology. The project successfully demonstrated the ability to leverage existing oilfield infrastructure, permits, and land access and leasing agreements, to enable geothermal storage projects to come online faster and cheaper than a greenfield development could. This technology could allow for greater energy independence and security through long-term energy storage solutions. The longer duration allows for greater storage for renewables currently limited by hours-long storage durations of lithium-ion. The AGES system would support the growth of renewable energy farms, and provide greater opportunities for a cleaner energy infrastructure.

15 GEOTHERMAL ENERGY↗

Incorporating Residential Smart Electric Vehicle Charging in Home Energy Management Systems

Electric vehicles (EVs) are expected to drastically increase residential electricity consumption and could provide a significant source of flexible demand. Aggregating smart EV charge controllers with other smart home devices through a home energy management system can lead to more optimal outcomes that benefit homeowners, utilities, and grid operators. Control strategies should consider occupant convenience by accounting for the need for fully charged EVs near the EV departure time. In this paper, we develop an EV charging framework that accounts for occupant convenience using OCHRE, a residential energy model, and foresee, a home energy management system. We simulate a community with high EV penetration and show that integrated, smart EV charging reduces peak demand and smooths night-time energy consumption. Simulation results show that the proposed control strategy nearly eliminates peak period EV charging and reduces the daily peak demand from EVs by 23%.

ADVANCED PROPULSION SYSTEMS,ENERGY CONSERVATION, C↗

Heating and Cooling Energy Modeling of 3D-Printed Concrete Construction of Residential Buildings [Slides]

3D printed concrete construction (C3DP) is an emerging technology that comes with the associated benefits of high thermal mass walls. We investigated using BEopt software the heating and cooling energy use of a single story C3DP-constructed house. We then compared the heating/cooling energy use of the C3DP house against the corresponding energy use in a traditional timber (wood) frame construction (WFC), as well as a concrete masonry unit (CMU) construction. Both peak energy use for heating and cooling (Btu), as well as base energy use for both heating and cooling (MMBtu/yr) of the C3DP design were compared against the WFC and CMU baseline construction of identical geometries and orientations across all eight climate zones defined in the International Energy Conservation Code (IECC). The BEopt models for all three constructions (C3DP, WFC, and CMU) were built to comply with the 2018 IECC code. Results indicate that C3DP construction has significant heating and cooling energy benefits in certain climate zones, with the highest peak cooling energy savings (9% compared to WFC, and 5% compared to CMU) in the IECC Climate Zone 1 in the month of July. The peak heating and cooling energy demand reduction of C3DP were found to be more significant than the base heating and cooling energy demand in all IECC climate zones. The 2018 IECC compliance-related U-Factor adjustments of all models also resulted in more peak energy savings of the C3DP design in the cooling-dominated climate zones (climate zones 1 and 2), moderate energy savings in moderate climate zones (climate zones 3, 4, and 6), and little to no change in energy savings in very cold climates (climate zones 7 and 8).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Modeling Variable Renewable Energy and Storage in the Power Sector

The emergence of variable renewable energy and battery storage technologies have fundamentally transformed the electric power sector and generated demand for analysis to understand their roles in future energy systems. Although unique characteristics of these resources are well-recognized and require more sophisticated methodologies to capture effectively, guidance is limited on best practices and research gaps. This paper selectively reviews recent literature and draws upon our collective modeling experience to offer recommendations to analysts and consumers of model outputs on approaches for modeling variable renewable energy and storage in long-term electric sector models. We focus on regional- and national-scale models with technological, temporal, and spatial detail given their prevalence in planning and policy analysis, though insights are applicable in other settings. The review highlights how the research frontier has advanced in representing renewables and energy storage over the past decade; however, given the many considerations involved with appropriately capturing salient economic and operational characteristics of renewables, there is a gap between commonly used models and state-of-the-art methods. Model simplifications can materially impact policy analysis associated with power sector decarbonization and high renewables deployment, and improving model representations of variable renewables can enhance insights for policymakers and other stakeholders. This review can point the way for improved methods for established models and designs for emerging ones.

energy and environmental policy↗

3D Reality Energy Modeling Software

The team will combine Bentley Systems’ ContextCapture and extend Oak Ridge National Laboratory’s building energy modeling capabilities in order to create digital twins of buildings that allow simulation-informed improvement for energy efficiency and demand response in the design and operation of the built environment. Bentley Systems’ ContextCapture software processes data from 3D laser scanning and photographs (through photogrammetry) to create a photorealistic, 3D mesh with a scale of individual objects to building to city-sized. This capability easily provides city-level visualization models and platforms where sustainable design alternatives are readily evaluated. Oak Ridge National Laboratory (ORNL) serves the U.S. Dept. of Energy (DOE) as one of three core laboratories developing building energy modeling tools EnergyPlus and OpenStudio. ORNL’s AutoBEM software (bit.ly/AutoBEM) can process imagery (satellite, aerial, and street level), LiDAR, cartographic layers, tax assessor’s data, and other data sources to extract building footprints, height, window-to-wall ratio, building type, vintage, and other building properties. AutoBEM has created 178,368 building energy models that were empirically validated with 15-minute whole-building electrical data from a utility.

97 MATHEMATICS AND COMPUTING↗

The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on‐orbit close proximity operations

Abstract On‐orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on‐orbit assembly, repair, and astronaut assistance. Of these scenarios, on‐orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on‐orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free‐flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on‐orbit assembly and other scenarios require collision‐avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long‐horizon planning, accomplished using offline and online sampling‐based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information‐aware planning framework for on‐orbit reconfiguration model learning; and (3) connection with robust control tools to provide low‐level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on‐orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free‐flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free‐flyers will need to consider.

Robotics↗

Impacts of Climate Change on Energy Systems in Global and Regional Scenarios

A growing number of studies report the impact of climate change on the supply, demand, transport, and cost of energy. However, there is lack of comprehensive overview and understanding of climate change impacts on energy across technologies and scales. Here, we conduct a systematic assessment of results from 186 papers on potential impacts of climate change on energy. Results show that increased cooling demand and decreased heating demand is anticipated globally. Similarly, increases in bio-energy and hydro power and a possible decrease in thermal electricity supply is projected. Overall changes in heating and cooling demand, increased thermal cooling, and reduced hydropower supply in Europe, India and Latin America are projected 35 at the regional scale. Furthermore, our review revealed that studies use a wide range of inconsistent methods and data sources. To move forward, the study proposes a consistent multi-model assessment framework for a comprehensive understanding of climate impacts on energy.

Yalew, Seleshi G.↗

ResStock Measure Documentation: Residential Two-Stage Geothermal Heat Pump (4.0 COP, 20.5 EER) With Envelope Improvements and Advanced Air Sealing

The goal of this work is to develop energy efficiency, demand flexibility, and other retrofit end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to retrofits that can be applied to buildings during modeling. An "end-use savings shape" is the difference in energy consumption between a baseline building and a building with an energy efficiency, demand flexibility, or other retrofit measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ResStock is a highly granular, physics-based, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the residential building stock across the United States. The baseline model intends to represent the U.S. residential building stock as it existed in 2018. Technical documentation for the inputs and assumptions in the baseline building stock model is available in Reyna et al. (2025). Calibration and validation of the baseline model results are available in the final technical report of the End-Use Load Profiles project (Wilson, et al. 2022). This document focuses on a single end-use savings shape measure: Residential Two-Stage Geothermal Heat Pump (GHP) (4.0 COP, 20.5 EER) With Envelope Improvements. This measure combines a two-stage GHP with envelope improvements as a single package. As this package is a combination of two other measures, this document focused on documenting the results associated with this combination of technologies, with individual measure documents for two-stage GHPs and envelope improvements providing the information on the details of these measures. When the two technologies are combined, envelope improvements can modestly reduce energy consumption by a further 10%-15%, but also reduce the required size of the ground heat exchanger and heat pump by approximately 33% on average across all sites. The cost of installing envelope improvements in these homes is likely to be more than paid for by the reduction in equipment and drilling costs in these buildings for the majority of the stock.

15 GEOTHERMAL ENERGY↗

ResStock Measure Documentation: Residential Single-Stage Geothermal Heat Pump (3.8 COP, 18.6 EER)

The goal of this work is to develop energy efficiency, demand flexibility, and other retrofit end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to retrofits that can be applied to buildings during modeling. An "end-use savings shape" is the difference in energy consumption between a baseline building and a building with an energy efficiency, demand flexibility, or other retrofit measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ResStock is a highly granular, physics-based, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the residential building stock across the United States. The baseline model intends to represent the U.S. residential building stock as it existed in 2018. Technical documentation for the inputs and assumptions in the baseline building stock model is available in Reyna et al. (2025). Calibration and validation of the baseline model results are available in the final technical report of the End-Use Load Profiles project (Wilson et al. 2022). This documentation focuses on a single end-use savings shape measure: Residential Single-Stage Geothermal Heat Pump (GHP).?Single-stage GHPs are able to reduce energy consumption by 31% for the entire stock. Additional results provided below detail how savings changes for sections of the housing stock with different base heating fuel and in different climate zones, as well as the savings potential by state for both heating and cooling. Utility bills and electric panel impacts are also shown and discussed.

15 GEOTHERMAL ENERGY↗

ResStock Measure Documentation: Residential Two-Stage Geothermal Heat Pump (4.0 COP, 20.5 EER)

The goal of this work is to develop energy efficiency, demand flexibility, and other retrofit end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to retrofits that can be applied to buildings during modeling. An "end-use savings shape" is the difference in energy consumption between a baseline building and a building with an energy efficiency, demand flexibility, or other retrofit measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ResStock is a highly granular, physics-based, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the residential building stock across the United States. The baseline model intends to represent the U.S. residential building stock as it existed in 2018. Technical documentation for the inputs and assumptions in the baseline building stock model is available in Reyna et al. (2025). Calibration and validation of the baseline model results are available in the final technical report of the End-Use Load Profiles project (Wilson et al. 2022). This document focuses on a single end-use savings shape measure: Residential Two-Stage Geothermal Heat Pump (4.0 COP, 20.5 EER). This document builds on details established in the single-stage document (Maguire et al. 2025) to detail differences in the approach to modeling this higher efficiency, but more commonly deployed, type of geothermal heat pump. Specific EnergyPlus objects and product specific curves used are highlighted along with showing the results of this measure compared to the baseline and single-speed geothermal heat pumps. Two-speed geothermal heat pumps are able to save even more energy and on utility bills than single-speed products, albeit at the expense of a higher first cost.

15 GEOTHERMAL ENERGY↗

Assessing the Costs of Hydropower at Non-Powered Dams Using a Reference Site Model

Hydropower capacity in the United States currently stands at approximately 103 GW, and there are remaining water resources that could help meet the rapidly increasing demand for electricity and ancillary grid services. Existing dams that do not generate power, known as non-powered dams, are a near-term solution to enhance the contribution of hydropower to the US power grid. However, there are thousands of such sites, and the lack of detailed information about their specific characteristics and associated costs presents significant challenges for stakeholders. This study addresses these challenges by developing a reference site model to evaluate the potential costs of hydropower at non-powered dams using currently available technologies. An application of the model reveals a wide range of estimates for capacity, capital costs, levelized cost of electricity, and cost components. While many sites are competitive with current technologies, the majority would need cost-reducing innovations to be viable. Despite the limited available information, the model offers valuable insights into the relative competitiveness of hydropower projects at non-powered dams. The simulation results highlight the need for continued technological advancements in hydropower and provide a basis for evaluating the benefits of new innovations.

cost drivers↗

ResStock Measure Documentation: Residential Variable-Speed Geothermal Heat Pump (4.4 COP, 30.9 EER)

The goal of this work is to develop energy efficiency, demand flexibility, and other retrofit end-use load shapes (electricity, gas, propane, or fuel oil) that cover a majority of the high-impact, market-ready (or nearly market-ready) measures. "Measures" refers to retrofits that can be applied to buildings during modeling. An "end-use savings shape" is the difference in energy consumption between a baseline building and a building with an energy efficiency, demand flexibility, or other retrofit measure applied. It results in a time-series profile that is broken down by end use and fuel (electricity or on-site gas, propane, or fuel oil use) at each time step. ResStock (TM) is a highly granular, physics-based, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the residential building stock across the United States. The baseline model intends to represent the U.S. residential building stock as it existed in 2018. Technical documentation for the inputs and assumptions in the baseline building stock model is available in Reyna et al. (2025). Calibration and validation of the baseline model results are available in the final technical report of the End-Use Load Profiles project (Wilson et al. 2022). This documentation focuses on a single end-use savings shape measure: Residential Variable-Speed Geothermal Heat Pump (GHP). This document provides the relevant new modeling information for variable-speed systems not previously covered in either the single-stage or two-stage documents. Variable-speed GHPs represent the most efficient option available for this technology: They provide the most savings, with up to 46% for the applicable portion of the housing stock, compared to 31% for less efficient single-stage GHPs. Additional results shown here detail how the savings change for sections of the housing stock with different base heating fuels and in different climate zones, and they show the savings potential by state for both heating and cooling. Utility bills and electric panel impacts are also shown and discussed.

15 GEOTHERMAL ENERGY↗

Buildings Sector Scenarios: Demand-side data to support energy system planning in the United States

The US energy system is in a period of high uncertainty about load growth, its implications for the energy generation mix, and downstream impacts on customer energy costs. In this context, there is a need for comprehensive, credible, and readily-customized projections of energy demand to ensure that planning decisions account for end-use management opportunities to improve system reliability and affordability. Here we introduce the Buildings Sector Scenarios (BSS) dataset, which includes a benchmark suite of such projections for the buildings sector — a key source of energy consumption, peak electricity demand, and consumer energy expenditures. The dataset contains projections through 2050 covering the contiguous United States (CONUS) resolved down to the county, hourly level by sector and end use for electricity demand and to the state, annual level by sector and end use for non-electric fuels. We summarize the BSS analysis workflow and the tools and datasets that support it, document key BSS scenario inputs and modeling assumptions, and outline BSS scenario outputs. We assess the technical quality of the dataset against historical surveys and projected estimates of buildings sector demand. Finally, we provide guidance on how stakeholders can access, use, and reproduce the dataset, and/or create new scenarios to explore their own analysis questions.

Langevin, Jared↗

A hybrid architecture for volt-var control in active distribution grids

Modern active distribution grids are characterized by the increasing penetration of distributed energy resources (DERs). The proper coordination and scheduling of a large numbers of these small-scale and spatially distributed DERs is necessary, and warrants the use of novel distributed approaches. In this paper, we propose a hybrid volt-var control architecture for the distribution grid, which leverages existing centralized and local approaches to planning, decision making, and control, and augments it with distributed optimization and distributed control for DER management. First, we propose a convex model to describe the power physics of distribution grids of meshed topology and unbalanced structure, based on current injection and McCormick Envelopes. Second, we employ the distributed proximal atomic coordination (PAC) algorithm to coordinate DERs to provide voltage support. We implement volt-var optimization by optimally coordinating DERs including PV smart inverters and demand response. We present results using the IEEE-34 bus network, using real data from a distribution feeder in Hawaii, to model load and PV generation. Different levels of DER penetration and objective functions are simulated. Finally, our results show the need for the coordination of DERs to improve voltage profiles, even in networks with existing voltage control devices. Further, we show the need for flexible reactive power capabilities to achieve desired grid performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Assessing Simulations of Forest Hurricane Disturbance and Recovery in Puerto Rico by ELM-FATES Using Field Measurements

In the past three decades, Puerto Rico (PR) experienced five hurricanes that met or exceeded category three, and they caused severe forest structural damage and elevated tree mortality. To improve our mechanistic understanding of hurricane impacts on tropical forests and assess hurricane-affected forest dynamics in Earth system models, we use in situ forest measurements at the Bisley Experimental Watersheds in Northeast PR to evaluate the Functionally Assembled Terrestrial Ecosystem Simulator coupled with the Energy Exascale Earth System Model Land Model (ELM-FATES). The observations show that before Hurricane Hugo, 77.3% of the aboveground biomass (AGB) is from the shade-tolerant plant function type (PFT). The Hugo-induced mortality rates are over ~50%, and they induce a ~39% AGB reduction, which recovers to a level like the pre-Hugo condition in 2014, following a second, lower intensity hurricane, Georges. We perform numerical experiments that simulate damage from Hugo and Georges on the forests, including defoliation, sapwood and structural biomass damage, and hurricane-induced mortality. ELM-FATES can reasonably represent coexistence between the two PFTs–light-demanding and shade-tolerant–for both the pre-Hugo and post-Hugo conditions. The model represents a reasonable size distribution of mid-and large-sized trees although it underestimates AGB, likely due to the overestimated nonhurricane mortality. ELM-FATES temporarily stimulated leaf biomass and diameter increment after Georges, an effect that should be tested with observations of future hurricane defoliation events. This research indicates that addressing model-data mismatches in tree mortality and understory dynamics are essential to simulation of more extreme hurricane effects under climate change.

58 GEOSCIENCES↗

Energy Requirements for Integration of Nuclear Reactors with Iron and Steel Plants

This report identifies energy needs of heavy energy users within the domestic iron and steel industry and suggests solutions for integrating nuclear energy. The iron and steel industry, composed of several types of plants which perform different processes with varied energy demands and vectors, is a heavy consumer of electric power and fossil fuels including coke and natural gas. Almost all major process temperatures exceed the temperatures of direct heat available from advanced reactors, and so electricity and hydrogen were considered instead. Reference units were adopted and estimated energy demands computed for the blast furnace (BF), direct reduced iron (DRI) unit, electric arc furnace (EAF), and reheat furnaces. By utilizing production capacity data from industry reports, the ranges of power demands were estimated, including for hydrogen production by high temperature steam electrolysis (HTSE). For the EAF and DRI unit, more detailed integration studies with thermodynamic modeling were also conducted and determined a possible solution with a specific reactor design and number of modules. Furthermore, because many unit processes are co-located, entire plants were considered by adding the energy demands of the unit processes to form four hypothetical reference plants. The range of power needs for the reference plants is compatible with multi-unit banks of microreactors at the low end, and would create a need for multiple larger-capacity SMRs at the high end (1 GWe plus 0.14 GWt). Although the overall power need at the high end is well-matched with one present-day large reactor offering (1.1 GWe), redundancy considerations may require a minimum of two reactors, potentially eliminating the single large reactor from consideration. Auxiliary or house loads would increase the reference plant estimates. Finally, the report provides total estimated energy needs under integration of all U.S. units of each process (BF, DRI, EAF, and reheat furnaces), representing a national potential for nuclear energy in the industry. U.S. iron and steel plants may be candidates for integration with nuclear reactors via electricity and hydrogen, and many sites have energy requirements that correspond well to the capacities of several advanced nuclear power designs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CoSim: A Simulator for Co-Scheduling of Batch and On-Demand Jobs in HPC Datacenters

The increasing scale and complexity of scientific applications are rapidly transforming the ecosystem of tools, methods, and workflows adopted by the high-performance computing (HPC) community. Big data analytics and deep learning are gaining traction as essential components in this ecosystem in a variety of scenarios, such as, steering of experimental instruments , acceleration of high-fidelity simulations through surrogate computations, and guided ensemble searches. In this context, the batch job model traditionally adopted by the supercomputing in-frastructures needs to be complemented with support to schedule opportunistic on-demand analytics jobs, leading to the problem of efficient preemption of batch jobs with minimum loss of progress. In this paper, we design and implement a simulator, CoSim, that enables on-the-fly analysis of the trade-offs arising between delaying the start of opportunistic on-demand jobs, which leads to longer analytics latency, and loss of progress due to preemption of batch jobs, which is necessary to make room for on-demand jobs. To this end, we propose an algorithm based on dynamic programming with predictable performance and scalability that enables supercomputing infrastructure schedulers to analyze the aforementioned trade-off and take decisions in near real-time. Compared with other state-of-art approaches using traces of the Theta pre-Exascale machine, our approach is capable of finding the optimal solution, while achieving high performance and scalability.

batch job preemption↗