Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Nuclear renewable integrated energy system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗
DOE OSTI2025

Digital Real-Time Simulation and Power Quality Analysis of a Hydrogen-Generating Nuclear-Renewable Integrated Energy System

This paper investigates the challenges and solutions associated with integrating a hydrogen-generating nuclear-renewable integrated energy system (NR-IES) under a transactive energy framework. The proposed system directs excess nuclear power to hydrogen production during periods of low grid demand while utilizing renewables to maintain grid stability. Using digital real-time simulation (DRTS) in the Typhoon HIL 404 model, the dynamic interactions between nuclear power plants, electrolyzers, and power grids are analyzed to mitigate issues such as harmonic distortion, power quality degradation, and low power factor caused by large non-linear loads. A three-phase power conversion system is modeled using the Typhoon HIL 404 model and includes a generator, a variable load, an electrolyzer, and power filters. Active harmonic filters (AHFs) and hybrid active power filters (HAPFs) are implemented to address harmonic mitigation and reactive power compensation. The results reveal that the HAPF topology effectively balances cost efficiency and performance and significantly reduces active filter current requirements compared to AHF-only systems. During maximum electrolyzer operation at 4 MW, the grid frequency dropped below 59.3 Hz without filtering; however, the implementation of power filters successfully restored the frequency to 59.9 Hz, demonstrating its effectiveness in maintaining grid stability. Future work will focus on integrating a deep reinforcement learning (DRL) framework with real-time simulation and optimizing real-time power dispatch, thus enabling a scalable, efficient NR-IES for sustainable energy markets.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Modeling and control of nuclear–renewable integrated energy systems: Dynamic system model for green electricity and hydrogen production

The need for decarbonization and diversification of energy resources has led to the development of integrated energy systems (IESs), where multiple resources supply more than one energy sector. Here, one such IES with small modular nuclear reactors and renewables (wind and solar) as generating resources, catering to the demand of the electric grid while producing hydrogen for industries, is modeled in this paper. The physics-based component models are represented using the Modelica language and interconnected to form the IES. The control and coordination of the overall system are ensured by designing a suitable control architecture composed of individual subsystem-level controls and supervisory control. The dynamic performance and the load-following capability of the IES are evaluated, while satisfying the safe operational limits of the components. Different configurations and modes of IES operation are considered, where the adaptability of the control system in the presence of varying demands and renewable generations is validated. The simulation results indicate that hydrogen as a flexible load facilitates the supply of varying grid demand. Additionally, the renewables are also accommodated into the IES owing to the flexibility of the balance of plant associated with the nuclear reactors.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Nuclear-Renewable-Storage Systems: Enhancing Planning and Operations of Integrated Energy Systems

Nuclear-renewable-storage integrated energy systems (IES) are multi-carrier energy systems that include not only electricity but also other forms of demands. Because individual IES components must observe their thermo-physical limits, including ramp rates, start-up, and shut-down time, we formulate operations of the IES as an optimization model by minimizing the total operations costs subject to physical limits of all constituent components. In addition, we develop a data-driven approach to improve the computational performance of the economic dispatch model by using reinforcement learning, where an agent is rewarded by meeting demands and penalized otherwise when shifting to the next state.

25 ENERGY STORAGE↗
DOE OSTI2025

An analysis of physics limited dispatch of nuclear renewable integrated energy systems using deep reinforcement learning and dynamic modeling

Previous approaches to dispatching nuclear integrated energy systems (NIES) have focused on the profitability and flexibility of these systems to operate on energy grids with highly variable pricing. However, due to the complexity involved in modeling and designing these systems, there has been less emphasis on ensuring that these dispatch strategies are physically achievable. It is imperative to develop methods that allow the system to remain within the desired NIES operating conditions and perform this based on realistic limited forecasted information. This research employs next generation artificial intelligence, namely deep reinforcement learning (DRL), and a dynamic system model written in Modelica to find a safe and profitable dispatch strategy for a solar nuclear hybrid design. The DRL agent is shown to find a novel dispatch strategy that manages both power ramping and power levels while respecting operational limits. This DRL-based dispatch is compared to other dispatching strategies including an optimal design solution from mixed integer linear programming (MILP). It is found that incorporating the physics of such a tightly coupled NIES limits the profitability of the MILP-based dispatch strategy. As a result, the MILP solution overestimates the design’s generated revenue. In contrast, DRL significantly reduces the number of breaches of safe operational conditions during energy arbitrage while maintaining profitability. Furthermore, this work paves the way for a more detailed assessment of NIES profitability and could be used to aid operator decisions on future NIES projects.

14 - SOLAR ENERGY↗
DOE OSTI2023

Design, modeling and simulation of nuclear-powered integrated energy systems with cascaded heating applications

Nuclear-renewable integrated energy systems (IES) consist of a variety of energy generation and conversion technologies and can be used to meet heterogeneous end uses (e.g., electricity, heat, and cooling demands). In addition to supply-demand balance, end-use heat demands usually require heat supply of certain temperature ranges. The effective and efficient utilization of heat produced within an IES is, therefore, a critical challenge. Here, this paper examines design options of an IES that includes heating processes of multiple temperature grades. We investigate a cascaded design configuration, where the remaining residual heat after high-grade heating processes [e.g., hydrogen production through high-temperature steam electrolysis (HTSE)] is recovered to meet the low-grade heating needs [e.g., district heating (DH)]. Additionally, a thermal energy storage system is integrated into the DH system to address the imbalance between heat supply and demand. This paper primarily focuses on the design and modeling of the proposed system and evaluates its operation with a 24-h transient process simulation using a DH demand profile with hourly resolution. The results indicate that the residual heat from the HTSE exhaust is insufficient for the DH demand, and additional topping heat directly from the reactor process steam is needed. Furthermore, the inclusion of thermal energy storage within the DH system provides the necessary balance between thermal generation and demand, thereby ensuring a consistent rated temperature of the DH supply water. This approach helps minimize the control actions needed on the reactor side.

08 HYDROGEN↗
DOE OSTI2024

Design and optimization of a modular hydrogen-based integrated energy system to maximize revenue via nuclear-renewable sources

Here, this paper demonstrates a novel modular distributed framework that uses optimal energy-dispatching strategies to enable greater flexibility and profitability in nuclear-renewable integrated energy systems (NR-IES). Hydrogen is used as a commodity in this framework since its production can improve grid stability and system operational flexibility, decarbonize heavy industry, and create an additional revenue stream for electricity generators, particularly nuclear power plants with high operational expenses. The proposed solution addresses the challenges associated with merging multiple software and services from various domains by using functional mock-up units (FMU) to co-simulate diverse subsystems designed in various platforms. The tightly coupled integrated energy system (IES) is optimized to maximize revenue by utilizing the deep reinforcement learning (DRL) technique to make smart dispatching decisions based on variable electricity prices and the availability of renewable energy. Proximal policy optimization (PPO) algorithm is used in training and testing the DRL agent. Over a period of 120 days, the proposed hydrogen-based IES framework showed about 10% revenue boost compared to a non-hydrogen generating baseline IES while also providing an easily-adoptable framework which can help to improve the flexibility of future generation nuclear power plants.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Optimal Economic Dispatch and Load-Following Strategies for Nuclear Integrated Energy Systems

The need for distributed and adaptable energy resources that can handle the growing unpredictability in both supply and demand is rising as the power system continues to modernize. In order to satisfy those needs and maintain grid resilience, nuclear power plants can dynamically control their output, despite typically being used as baseload generators. By incorporating energy storage and renewable energy sources, nuclear integrated energy systems are designed to satisfy the electrical and thermal demands of different end-user applications while ensuring flexible power operation. These systems generate revenue by participating in both wholesale and ancillary services electricity markets, as well as commodity markets for various byproducts generated from coupled industrial processes. This study addresses the economic dispatch efficiency of a tightly coupled nuclear integrated energy system comprising a gigawatt-scale light water reactor, commercialized in the U.S., a high-temperature steam electrolysis unit, a district heating network, and specified electrical loads. To demonstrate the nuclear power plant’s flexibility within the day-ahead unit commitment and economic dispatch framework, while maintaining equilibrium even during periods of refueling outages, this paper develops a mixed-integer linear programming framework that models the subsystems and components of its nuclear steam supply system. A systematic comparative analysis of flexible versus baseload nuclear power plant operation under varying levels of renewable energy integration indicates that flexible operation enhances system profitability by more than 18% while also increasing energy storage utilization, improving reactor responsiveness to load fluctuations, and allowing for greater participation across numerous electricity markets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Siting Analysis of a Solar-Nuclear-Desalination Integrated Energy System

Nuclear power is typically deployed as a baseload generator. Increased penetration of variable renewables motivates combining nuclear and renewable technologies into Integrated Energy Systems (IES) to improve dispatchability, component synergies and, through cogeneration, address multiple markets. However, combining multiple energy resources heavily depends on the proper selection of each system’s location and design limitations. In this paper, co-siting options for IES that couple nuclear and concentrating solar power (CSP) with thermal desalination are investigated. A comprehensive siting analysis is performed that utilizes global information survey data to determine possible co-siting options for nuclear and solar thermal generation in the United States. Viable co-siting options are distributed across the Southwestern U.S., with the greatest concentration of siting options in the southern Great Plains, although siting with higher solar direct normal irradiance is possible in other states such as Arizona and New Mexico. Brackish water desalination is also attractive across the southwest U.S. due to high water stress, but for brackish water desalination reverse osmosis (an electricity driven process) is most cost- and energy-efficient, which does not require co-siting with the thermal generator. The most attractive state for nuclear and thermal desalination (which is more attractive when using seawater) is Texas, although other areas may become attractive as water stress increases over the coming decades. Co-siting of all CSP and thermal desalination is challenging as attractive CSP sites are not coastal.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

A Rapid Procedure Development Approach for Multi-stage Validation of Novel Nuclear Power Plant Systems

The integration of renewable energy sources into the modern grid introduces variability in generation, challenging nuclear reactors to remain economically viable amid low wholesale electricity prices. To address this, Idaho National Laboratory?s Flexible Plant Operation and Generation program explores alternative revenue streams, including commoditizing excess thermal energy. A Thermal Power Dispatch (TPD) system enables steam extraction from the secondary loop for industrial uses like hydrogen production via high-temperature steam electrolysis.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Stochastic Optimization and Uncertainty Quantification of Natrium-based Nuclear-Renewable Energy Systems for Flexible Power Applications in Deregulated Markets

Rapid integration of variable renewable energy sources (VRES) has made modeling and stochastic optimization of hybrid energy systems crucial for studying their long-term performance and viability. However, most studies have focused on just historical data, which may be unreliable for capturing short-term fluctuations, rare events, and long-term patterns of energy demand, price, and the variability of renewable energy sources. For this study, optimal synthetic time series models were developed using Wasserstein distance. The models were validated by comparing the key statistical measures against those of the historical data. They were then used to optimize the integrated Natrium-style advanced energy systems and their long-term (30 years) economics. The stochastic model performs bi-level optimization to find the optimal sizes for the balance of plant and thermal energy storage, while also optimizing energy dispatch to achieve the maximum net present value. In studies of two deregulated markets (California ISO and the Electric Reliability Council of Texas), the integrated Natrium-style system performed better in CAISO than in ERCOT, given higher and more consistent electricity prices during peak-demand periods. The potentially enlarged cost associated with the variable operation and maintenance of the TES system also plays a significant role in driving the system sizing, thus its impacts on the system are investigated in detail through comparison against a baseline case. The study also finds that the bi-level optimization results based on stochastic gradient descent closely match the grid search results. The uncertainty quantification of the stochastic signals provides further NPV-related insights and probability distributions for the case studies. The normal standard error of the mean of NPV for the case with and without TES VOM for CAISO were found to be 7.73M (plus-minus sign) 1.09M USD and 104.99M (plus-minus sign) 1.25M USD, respectively based on a 95% confidence. Given the relatively small NPV variance based on 150 samples, the analysis affords the most robust possible prediction of the techno-economic performance of the integrated Natrium-style energy systems.

25 ENERGY STORAGE↗
DOE OSTI2025

Beyond Price-Taker: Multiscale Optimization of Wind and Battery Integrated Energy Systems

Integrating renewable energy into the electric grid is challenging due to the intermittency and variability of wind and other non-dispatchable resources. Integrated energy systems (IESs) combine multiple energy technologies (e.g., fossil, nuclear, renewables, storage) to reduce costs and improve flexibility and reliability. However, standard techno-economic analysis (TEA) methods often overestimate the benefits of IESs because they fail to account for energy market adjustments. This paper systematically studies the limitations of the prevailing price-taker assumption for TEA and optimization of hybrid energy systems. As an illustrative case study, we retrofit an existing wind farm in the RTS-GMLC test system (which loosely mimics the Southwest U.S.) with battery energy storage to form an IES. We show that the standard price-taker model overestimates the electricity revenue and the net present value (NPV) of the IES up to 178% and 30.4%, respectively, compared to our more rigorous multiscale optimization. These differences arise because introducing storage creates a more flexible resource that impacts the larger wholesale electricity market. Moreover, this work highlights the impact of the IES has on the market via various strategic bidding, and underscores the importance of moving beyond price-taker for optimal storage sizing and TEA of IESs. We conclude by discussing opportunities to generalize the proposed framework to other IESs, and highlight emerging research questions regarding the complex interactions between IESs and markets.

25 ENERGY STORAGE↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Thermal Modeling and Simulation of the Packed-bed Thermal Energy Storage Combined with INL Thermal Energy Distribution System

Dynamic Energy Transport and Integration Lab (DETAIL) at Idaho National Laboratory is to support experimental demonstration and validation research on Nuclear-Renewable Hybrid Energy System [1]. The Thermal Energy Distribution System (TEDS) is a thermal-hydraulic flow loop in DETAIL with its own dedicated control system to support the integration of co-located multiple experimental systems, where a packed-bed thermal energy storage (TES) is installed as a thermal buffer and storage unit. Among various TES options, the packed-bed TES is adopted in TEDS because it offers a low-cost single-tank thermal storage option compared to the traditional two-tank TES. However, since the TES tank is filled with granular fillers having different thermophysical properties from those of TES tank wall, there is a potential thermo-mechanical issue to be carefully addressed like thermal ratcheting which may pose a significant design concern for the packed-bed TES tank. Thermal ratcheting is a thermomechanical process caused by the repeated rearrangement of granular filler inside a TES tank during continuous thermal cycling operation of the packed-bed TES system. If the thermally induced stress exceeds the yield strength of a TES tank wall, catastrophic consequences may happen like rupture of the TES tank. Thus, it is important to understand the phenomenon to ensure the robust operation of the packed-bed TES tank. Given that thermal ratcheting is caused by complex interaction of thermal transport in the porous bed and solid mechanics, the accurate prediction of transient thermal behavior of the packed-bed TES tank, which is the focus of this paper, is critical to the reliable thermal ratcheting analysis. This paper discusses the numerical modeling, simulation, and validation studies that are ongoing at INL to investigate the transient thermal behavior of the packed-bed TES. Of particular concern is the transient thermal process occurring in the packed-bed TES unit that is operated in conjunction with the INL TEDS. The main goal of this research is three-fold: (i) provide preliminary insights into the transient thermal behavior of the TEDS TES tank, (ii) support the thermal measurement and validation plan for TEDS experiment, and (iii) provide transient thermal boundary conditions to support the reliable thermal ratcheting analysis of the TEDS TES tank. For the transient thermal modeling and analysis, a CFD model was developed, and the validity of the modeling approach was examined via comparing the numerical simulation results with the experimental data obtained from various design characteristics of packed-bed TES tanks. Then, the present modeling method was applied for the transient thermal analysis of the TEDS TES tank, and the results are discussed along with the potential improvement of data acquisition strategy for the future TEDS experiments for more precise validation study.

25 ENERGY STORAGE↗
DOE OSTI2023

Achieving Economy-wide Net-Zero Emissions: Is it an impossible goal?

Meeting growing energy demands while eliminating emissions, maintaining affordability, and ensuring energy justice is one of the most significant grand challenges of our time. Governments and private industry around the world have established aggressive goals to achieve net-zero emissions by mid-century. In the U.S., this equates to a net-zero electricity sector by 2035 and across all energy use sectors—including electricity, industry, and transportation—by 2050. The key question then becomes: Can we get there from here? Meeting these aggressive goals demands immediate action, and they require us to think more holistically about our clean energy options. Currently, almost 85% of global energy demands are met by unabated fossil fuels. That means we have a lot of work to do, and we need to consider all of the non-emitting generation options available in each region—including fossil with carbon capture, renewables, and nuclear. And we need to reach our goal while establishing energy justice, which refers to the goal of achieving equity in social and economic participation in the energy system, while remediating past social, economic, and health burdens on communities that have been brought about by our energy system. This presentation will describe U.S. and global efforts focused on novel energy system solutions that strive to maximize use of all clean energy generation options to meet our energy demands, while ensuring sustainability, customer affordability, and a just energy system.

08 HYDROGEN↗
DOE OSTI2024

Integrating an Ensemble Reward System into an Off-Policy Reinforcement Learning Algorithm for the Economic Dispatch of Small Modular Reactor-Based Energy Systems

Nuclear Integrated Energy Systems (NIES) have emerged as a comprehensive solution for navigating the changing energy landscape. They combine nuclear power plants with renewable energy sources, storage systems, and smart grid technologies to optimize energy production, distribution, and consumption across sectors, improving efficiency, reliability, and sustainability while addressing challenges associated with variability. The integration of Small Modular Reactors (SMRs) in NIES offers significant benefits over traditional nuclear facilities, although transferring involves overcoming legal and operational barriers, particularly in economic dispatch. This study proposes a novel off-policy Reinforcement Learning (RL) approach with an ensemble reward system to optimize economic dispatch for nuclear-powered generation companies equipped with an SMR, demonstrating superior accuracy and efficiency when compared to conventional methods and emphasizing RL’s potential to improve NIES profitability and sustainability. Finally, the research attempts to demonstrate the viability of implementing the proposed integrated RL approach in spot energy markets to maximize profits for nuclear-driven generation companies, establishing NIES’ profitability over competitors that rely on fossil fuel-based generation units to meet baseload requirements.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗