Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “demand uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Non-Nuclear Advanced Controls Testbed Reactor Mockup

The research presented in this report describes our progress in applying stochastic methods and uncertainty quantification, parametric study, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated with Griffin, with the goal of developing a reduced order (surrogate) model which can be rapidly sampled while perturbing multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums, which are controlled by a hybrid proportional, integral and derivative (PID) controller, actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time and $\beta$ from a transient Griffin simulation executed with the improved quasi-static method to provide the kinetic parameters) as inputs to functions which control the CD rotation angle. Using a number of stochastic method approaches, we developed a dual purpose training-surrogate model of the NTP system using polynomial regression. The trained model can be rapidly sampled while simultaneously perturbing various input parameters of the model, such as coefficients on the PID control, or temperature (directly affect the neutron cross section). The surrogate model delivers accurate results orders-of-magnitude faster (minutes, not days) than the base model. Once the base model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs and their effect on the output. For example, coefficients used in the PID control system may vary due to some physical interference, or there may be uncertainty in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters and operational boundaries can be determined. The goal of this work is to support development of an advanced control system to operate CDs in a functioning NTP system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Identifying Robust Decarbonization Pathways for the Western U.S. Electric Power System Under Deep Climate Uncertainty

Climate change threatens the resource adequacy of future power systems. Existing research and practice lack frameworks for identifying decarbonization pathways that are robust to climate-related uncertainty. We create such an analytical framework, then use it to assess the robustness of alternative pathways to achieving 60% emissions reductions from 2022 levels by 2040 for the Western U.S. power system. Our framework integrates power system planning and resource adequacy models with 100 climate realizations from a large climate ensemble. Climate realizations drive electricity demand; thermal plant availability; and wind, solar, and hydropower generation. Among five initial decarbonization pathways, all exhibit modest to significant resource adequacy failures under climate realizations in 2040, but certain pathways experience significantly less resource adequacy failures at little additional cost relative to other pathways. By identifying and planning for an extreme climate realization that drives the largest resource adequacy failures across our pathways, we produce a new decarbonization pathway that has no resource adequacy failures under any climate realizations. This new pathway is roughly 5% more expensive than other pathways due to greater capacity investment, and shifts investment from wind to solar and natural gas generators. Our analysis suggests modest increases in investment costs can add significant robustness against climate change in decarbonizing power systems. Our framework can help power system planners adapt to climate change by stress testing future plans to potential climate realizations, and offers a unique bridge between energy system and climate modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Molecular structure determination: Equilibrium structure of pyrimidine (m-C 4 H 4 N 2 ) from rotational spectroscopy (reSE) and high-level ab initio calculation (re) agree within the uncertainty of experimental measurement

The pure rotational spectrum of pyrimidine (m-C 4 H 4 N 2 ), the meta-substituted dinitrogen analog of benzene, has been studied in the millimeter-wave region from 235 GHz to 360 GHz. The rotational spectrum of the ground vibrational state has been assigned and fit to yield accurate rotational and distortion constants. Over 1700 distinct transitions were identified for the normal isotopologue in its ground vibrational state and least-squares fit to a partial sextic S-reduced Hamiltonian. Transitions for all four singly substituted 13 C and 15 N isotopologues were observed at natural abundance and were likewise fit. Deuterium-enriched samples of pyrimidine were synthesized, giving access to all eleven possible deuterium-substituted isotopologues, ten of which were previously unreported. Experimental values of rotational constants and computed values of vibration–rotation interaction constants and electron-mass corrections were used to determine semi-experimental equilibrium structures (r e SE ) of pyrimidine. The r e SE structure obtained using coupled-cluster with single, double, and perturbative triple excitations [CCSD(T)] corrections shows exceptional agreement with the re structure computed at the CCSD(T)/cc-pCV5Z level (≤0.0002 Å in bond distance and ≤0.03° in bond angle). Of the various computational methods examined, CCSD(T)/cc-pCV5Z is the only method for which the computed value of each geometric parameter lies within the statistical experimental uncertainty (2σ) of the corresponding semi-experimental coordinate. The exceptionally high accuracy and precision of the structure determination is a consequence of the large number of isotopologues measured, the precision and extent of the experimental frequency measurements, and the sophisticated theoretical treatment of the effects of vibration–rotation coupling and electron mass. Taken together, these demanding experimental and computational studies establish the capabilities of modern structural analysis for a prototypical monocyclic aromatic compound.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Estimating Future Surface Water Availability Through an Integrated Climate‐Hydrology‐Management Modeling Framework at a Basin Scale Under CMIP6 Scenarios

Abstract Climate change and increasing water demand due to population growth pose serious threats to surface water availability. The biggest challenge in addressing these threats is the gap between climate science and water management practices. Local water planning often lacks the integration of climate change information, especially with regard to its impacts on surface water storage and evaporation as well as the associated uncertainties. Using Texas as an example, state and regional water planning relies on the use of reservoir “Firm Yield” (FY)—an important metric that quantifies surface water availability. However, this existing planning methodology does not account for the impacts of climate change on future inflows and on reservoir evaporation. To bridge this knowledge gap, an integrated climate‐hydrology‐management (CHM) modeling framework was developed, which is generally applicable to river basins with geographical, hydrological, and water right settings similar to those in Texas. The framework leverages the advantages of two modeling approaches—the Distributed Hydrology Soil Vegetation Model (DHSVM) and Water Availability Modeling (WAM). Additionally, the Double Bias Correction Constructed Analogues method is utilized to downscale and incorporate Coupled Model Intercomparison Project Phase 6 GCMs. Finally, the DHSVM simulated naturalized streamflow and reservoir evaporation rate are input to WAM to simulate reservoir FY. A new term—“Ratio of Firm Yield” (RFY)—is created to compare how much FY changes under different climate scenarios. The results indicate that climate change has a significant impact on surface water availability by increasing reservoir evaporation, altering the seasonal pattern of naturalized streamflow, and reducing FY.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Uncertainty Quantification of Fatigue Behavior of Rough AM Surfaces and Microstructures to Enable Hydrogen Gas Turbine

Modifying fossil-fueled industrial gas turbines to utilize low or zero-carbon fuels, such as hydrogen or hydrogen-natural gas blends, is a complex endeavor. The successful implementation of this technology hinges on three key design criteria: (1) developing new fuel injectors capable of efficiently burning alternative fuels, (2) ensuring manufacturability to meet cost and time-to-market goals, and (3) achieving component durability in the demanding environment of an operating gas turbine. Additive manufacturing (AM) accelerates product development, yet concerns persist regarding the durability of parts with rough AM surfaces. A fully experimental approach to quantify the fatigue performance of rough AM microstructures is both costly and labor-intensive. To address this, ORNL and Solar Turbines Incorporated (Solar) employed a crystal plasticity finite element (CPFE) model to identify the factors influencing AM surface fatigue behavior. These CPFE findings, combined with targeted experimental data, were used to develop a computationally efficient surrogate model suitable for assessing the lifespan of gas turbine engine components.

08 HYDROGEN↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Subsurface hydrological controls on the short-term effects of hurricanes on nitrate–nitrogen runoff loading: a case study of Hurricane Ida using the Energy Exascale Earth System Model (E3SM) Land Model (v2.1)

When the nutrient level in the soil surpasses vegetation demand, nutrient losses due to surface runoff and subsurface leaching are the major reasons for the deterioration of water quality. The lower Mississippi River basin (LMRB) is one of the sub-basins that deliver the highest nitrogen loads to the Gulf of Mexico. Potential changes in episodic events induced by hurricanes may exacerbate water quality issue in the future. However, uncertainties in modeling the hydrologic response to hurricanes may limit the modeling of nutrient losses during such events. Using a machine learning approach, we calibrated the land component of the Energy Exascale Earth System Model (E3SM), or ELM, version 2.1, based on the water table depth (WTD) of a calibrated 3D subsurface hydrology model. While the overall performance of the calibrated ELM is satisfactory, some discrepancies in WTD remain in slope areas with low precipitation due to the missing lateral flow process in ELM. Simulations including biogeochemistry performed using ELM with and without model calibration showed important influences of soil hydrology, precipitation intensity, and runoff parameterization on the magnitude of nitrogen runoff loss and the leaching pathway. Despite such sensitivities, both ELM simulations produced reduced WTD and increased runoff and accelerated nitrate–nitrogen runoff loading during Hurricane Ida in August 2021, consistent with the observations. With observations suggesting more pronounced effects of Hurricane Ida on nitrogen runoff than the simulations, we identified factors for model improvement to provide a useful tool for studying hurricane-induced nutrient losses in the LMRB region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Robustness of energy performance of Zero-Net-Energy (ZNE) homes

Zero-net-energy (ZNE) homes produce an adequate amount of energy on-site to meet their energy demand based on source energy for an entire year. California building energy efficiency standards require new residential buildings started in 2020 to be ZNE. For various reasons, a home designed as ZNE may not achieve ZNE performance in real operation. Here we aimed to quantify the robustness of the energy performance of ZNE homes due to weather variability, climate change, and the uncertainty of occupant behavior. A single-family ZNE house, based on the optimal cost-effective design in three California climate zones, was used to develop the EnergyPlus simulation models. Weather variations were considered from a combination of the historical 30 years’ actual meteorological year (AMY) weather data, typical year weather data in TMY3, and future weather data based on Intergovernmental Panel on Climate Change scenarios. Three scenarios of occupant behavior from the energy perspective were defined to represent the uncertainty about occupants’ activities, comfort requirements, and their adaptive interactions with buildings and systems. In terms of annual source energy, the simulation results of the ZNE homes showed: (1) a decrease of 23–38 percent for occupants with energy austerity behavior and an increase of 120–130 percent for occupants with energy wasteful behavior, compared with the baseline assumption of normal occupants; (2) a variation range of –15 percent to +14 percent for the results using 30-year AMY weather data compared with the baseline results using TMY3 weather data; (3) an increase of 10–13 percent with future weather in Fresno and Riverside and a decrease of 15 percent with San Francisco; and (4) climate change can reduce the gap between the austerity and wasteful consumption. These findings provide insights into how ZNE homes may perform in reality and inform architects, engineers, occupants, and policymakers to pay more attention to occupant behavior on design, operation, and regulations of ZNE homes to ensure energy performance robustness.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

A Review of Behind-the-Meter Solar Generation Modeling and Forecasting

Solar photovoltaic systems largely integrated within the distribution grid are operated 'behind-the-meter' and power generation cannot be directly monitored by most utilities. The increasing penetration of behind-the-meter solar photovoltaic systems can deter efficient network and market operations due to variability and uncertainty in net load, which is exacerbated by limited visibility and the difficulty in analyzing the hosting capacity. Risk introduced by behind-the-meter solar contributions may hinder reliable and secure grid operations due to biased system monitoring and forecasts. Accurate behind-the-meter estimations, together with capacity and specification forecasts, thus play a key role in balancing supply and demand and this article reviews the pertinent literature, identifying key characteristics and predictive methods for efficient behind-the-meter solar photovoltaic generation. Forecasting is central to methods herein. The fundamental characteristics of behind-the-meter solar forecasting, including which methods are applicable for scenario-driven use cases, are driven by the metrics most useful for system-wide performance evaluation. To this aim, the literature is reviewed with a focus on forecasting applications for aggregate, regional behind-the-meter generation useful to bulk system and utility operations. As distinguished from net load forecasting, subtleties in these coincident tasks are explored before concluding with recommendations for current practice and future implementations.

behind-the-meter↗
DOE OSTI2024

Improvements to the characterization of Agfa x-ray film for use on opacity spectroscopy diagnostics

The National Ignition Facility uses a soft x-ray opacity spectrometer for x-ray spectral imaging in high-energy-density experiments. The increased demand for a better spectral resolution prompted the investigation into the Agfa D4 film. Characterization is already under way for the film. A Manson x-ray source using six different anodes was used to expose film to the linear optical density (OD) region. This is a continuation of the previous work, and the updated analysis process is communicated here. The identified uncertainties have been reduced with the updated steps that improve the results of the characterization process. In conclusion, when the Stanford Synchrotron Radiation Lightsource Beamline 16-2 was operational, the film was characterized at that source. Its beam offered a higher fluency with a lower exposure time needed to reach saturation. Results for both sources are compared in this paper.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Plant Water Profiler: A Water Balance and True Cost of Water Calculator for Manufacturing Plants

As the uncertainty of a sustained water supply, regulatory constraints, competition among end users, and public scrutiny increases, a growing number of manufacturing sectors are adapting to current and emerging water-related risks by optimizing productivity and reducing waste. As a step toward increasing water use efficiency and making informed business decisions, corporations must make an effort to understand and track their water demands, losses, and costs associated with each subsystem within their facilities. Manufacturers are often unaware of the “true cost of water” (i.e., the total costs associated with procurement, treatment, and consumption of water, and wastewater disposal), which reduces the visibility of the actual impact of water-saving measures. To help manufacturers account for water procurement and use in manufacturing operations, quantify the true cost of water, and identify potential areas for water and associated energy cost savings, an open access tool—Plant Water Profiler (PWP)—was developed. The tool is based on water mass balance analysis and has been adopted as the core analysis tool for plant water use assessments, Water In-Plant Training (Water INPLT), as part of the US Department of Energy’s Better Plants program. During three pilot INPLTs conducted in 2019 at three manufacturing facilities, the PWP tool allowed users to understand water flows within the facilities and provided additional capabilities to analyze their water use. This paper describes the methodology behind the PWP tool and its implementation through pilot Water INPLT trainings delivered in three manufacturing facilities in the United States. The three case studies demonstrate opportunities to improve water efficiency and reduce associated costs and the challenges encountered in three different manufacturing sectors.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Uncertainty quantification and sensitivity analysis of a nuclear thermal propulsion reactor startup sequence

The research presented in this article describes progress in applying stochastic methods, uncertainty quantification, parametric studies, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated via the radiation transport code Griffin to simulate neutronics. Our goal is to develop a reduced-order (surrogate) model that can be rapidly sampled with perturbations to multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums (CDs), which is itself controlled by a hybrid proportional-integral-derivative (PID) controller actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time [Λ] and effective delayed neutron fraction [ β eff ] from a transient Griffin simulation executed via Griffin’s improved quasi-static solver to provide the kinetic parameters) as inputs to functions that control the CD rotation angle. By investigating numerous stochastic approaches, we developed a dual-purpose surrogate model of the NTP system, using polynomial regression in the Multiphysics Object-Oriented Simulation Environment (MOOSE) Stochastic Tools Module (STM). The trained model can be rapidly sampled while simultaneously perturbing various input parameters, such as coefficients on the PID control or temperature (directly affecting the neutron cross section). The surrogate model delivers accurate (within 5%) results at speeds orders of magnitude faster (minutes, not days of computational time) than the base model. Once the surrogate model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs as well as the effects of these inputs on the model output. For example, coefficients used in the PID control system may vary due to some type of physical interference, or uncertainty may exist in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters, and operational boundaries can be determined. The goal of this work is to support development of an advanced control system for operating CDs in a functioning NTP system. This work is a scoping study of the MOOSE STM.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2022

Projected U.S. drought extremes through the twenty-first century with vapor pressure deficit

Global warming is expected to enhance drought extremes in the United States throughout the twenty-first century. Projecting these changes can be complex in regions with large variability in atmospheric and soil moisture on small spatial scales. Vapor Pressure Deficit (VPD) is a valuable measure of evaporative demand as moisture moves from the surface into the atmosphere and a dynamic measure of drought. Here, VPD is used to identify short-term drought with the Standardized VPD Drought Index (SVDI); and used to characterize future extreme droughts using grid dependent stationary and non-stationary generalized extreme value (GEV) models, and a random sampling technique is developed to quantify multimodel uncertainties. The GEV analysis was performed with projections using the Weather Research and Forecasting model, downscaled from three Global Climate Models based on the Representative Concentration Pathway 8.5 for present, mid-century and late-century. Results show the VPD based index (SVDI) accurately identifies the timing and magnitude short-term droughts, and extreme VPD is increasing across the United States and by the end of the twenty-first century. The number of days VPD is above 9 kPa increases by 10 days along California’s coastline, 30–40 days in the northwest and Midwest, and 100 days in California’s Central Valley.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

SENTRA: A Modular Computational Graph Framework for Critical Mineral and Materials Supply Chains: Part I: Network Construction Latent-Quantity Estimation, and Temporal Graph Forecasting

Global supply chains for critical minerals and materials are complex, evolving networks of countries, products, production stages, and trade relationships. Existing analytical approaches are limited by fragmented data and static network representations that do not capture the dynamic production dependencies linking raw materials, intermediate products, and final goods across multiple countries. Trade and production statistics provide only a partial view of domestic production, inventories, and material flows, making it difficult to identify indirect sourcing pathways, hidden dependencies, and embedded foreign exposures. This paper introduces the Supply Chain Exposure Network Tracking and Risk Assessment (SENTRA) framework, a modular graph-based computational framework for constructing, analyzing, and forecasting dynamic supply chain networks. As the first paper in a three-part methodological series, it establishes the computational foundation of SENTRA by constructing a temporal attributed multi-relational graph whose nodes represent product–country pairs and whose edges encode observed trade and within-country value-chain relationships. Statistical estimation and constrained optimization recover latent production, final demand, and product input dependency coefficients while enforcing economic accounting constraints. Graph-derived exposure measures quantify direct, transshipment, value-chain, and multi-hop supply chain dependencies independently of the forecasting model. A temporal graph forecasting architecture based on a relational graph neural network then forecasts the evolution of the graph under mass-balance constraints with distribution-free conformal uncertainty quantification. Validation on the global aluminum supply chain shows that the learned graph representations recover economically meaningful supply chain structure, accurately forecast out-of-sample trade relationships, and produce well-calibrated prediction intervals. Subsequent papers apply this computational foundation to exposure assessment, disruption analysis, and scenario-based policy analysis, and extend the framework to multimaterial supply chain modeling and decision support.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Evaluation of Fish-Related Properties of Kaplan Turbines at the Design Phase: Simulation-based outcomes vs. Experimental Data

The development of turbine technology faces growing demands to maximize the survival of migratory fish passing through turbine flows. In this context, two strategies have emerged for quantifying hazardous hydraulic conditions: computer-based evaluations at design stage and recordings with autonomous sensors deployed in prototypes. The former is a desktop evaluation with many modelling assumptions (idealization) and the latter is a field technique that introduces various unknown and uncontrollable factors (uncertainty.) The present work introduces and implements a third method based on test rig measurements and the corresponding computer-based predictions of conditions that negatively affect fish survivability. The experimental work was conducted in a five-bladed Kaplan turbine model in which miniaturized autonomous sensors (SF Mini, developed at the Pacific Northwest National Laboratory, U.S.) measured fish-relevant hydraulic features. The modelling work involved flow simulations according to industry practices and the representation of fish trajectories through the simulated flow conditions. We compared both the experimental measurements and CFD outcomes and discussed the challenges and advantages of the modelling strategies, as well as the benefits for turbine engineers in need of incorporating effective design concepts to mitigate fish mortality through turbines.

Romero-Gomez, Pedro↗
DOE OSTI2022

A reinforcement learning approach to long-horizon operations, health, and maintenance supervisory control of advanced energy systems

In this work, we develop a Reinforcement Learning (RL) approach to the supervisory control problem for advanced energy systems, such as novel nuclear reactors and other demand-driven, mission-critical, and component-health-sensitive energy plants. The inclusive problem landscape considered captures the stochastic confluence of plant performance, component health evolution, power demand from the grid, diverse maintenance actions, and operator-defined goals and constraints, all considered over meaningfully long-enough reasoning horizons. Key aspects of the proposed approach are a receding horizon control-inspired technique dictating time- or event-triggered supervisory policy (re-)constructions, as well as additional capability-enabling contributions such as timescale compression, to handle long reasoning horizons and uncertainty in parts of the problem, and practical yet demonstrably-effective handling of hybrid action spaces with continuous and discrete decision variables. The resulting algorithm consists of a simulation-based RL agent constructing stochastic supervisory control policies over nontrivial action spaces and for long horizons, applying the learned policy to the system for a much shorter interval, and perpetually repeating, to construct the next long-horizon policy. That next policy will only be applied, again, for a short interval, yet originally far-in-time events move progressively closer, their associated uncertainty decreases, and new events and aspects enter the reasoning horizon. The proposed methodology bridges fundamental receding horizon concepts with the unequivocally stronger and more scalable reasoning of contemporary RL. Numerical examples using Soft Actor–Critic Deep RL illustrate the operation and efficacy of the proposed technique for a power plant tasked with health-aware load following missions in a dynamic electricity market landscape.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Review of Coupled Geochemical–Geomechanical Impacts in Subsurface CO 2 , H 2 , and Air Storage Systems

Increased demand for decarbonization and renewable energy has led to increasing interest in engineered subsurface storage systems for large-scale carbon reduction and energy storage. In these applications, a working fluid (CO 2 , H 2 , air, etc.) is injected into a deep formation for permanent sequestration or seasonal energy storage. The heterogeneous nature of the porous formation and the fluid–rock interactions introduce complexity and uncertainty in the fate of the injected component and host formations in these applications. Interactions between the working gas, native brine, and formation mineralogy must be adequately assessed to evaluate the efficiency, risk, and viability of a particular storage site and operational regime. This study reviews the current state of knowledge about coupled geochemical–geomechanical impacts in geologic carbon sequestration (GCS), underground hydrogen storage (UHS), and compressed air energy storage (CAES) systems involving the injection of CO 2 , H 2 , and air. Specific review topics include (1) existing injection induced geochemical reactions in these systems; (2) the impact of these reactions on the porosity and permeability of host formation; (3) the impact of these reactions on the mechanical properties of host formation; and (4) the investigation of geochemical-geomechanical process in pilot scale GCS. This study helps to facilitate an understanding of the potential geochemical–geomechanical risks involved in different subsurface energy storage systems and highlights future research needs.

08 HYDROGEN↗