Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “flexible power generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

It's Not Just About the Megawatts - ARC Industry Forum, The Future of Power Generation

As the world transitions to less carbon intensive energy portfolios, much of the attention understandably centers on generating capacity – replacing megawatts of fossil fuel with megawatts of solar, wind, nuclear, hydroelectric, hydrogen, and more. The actual operation of a reliable grid needs more than just megawatts though: adequate quantities of a portfolio of essential reliability services; flexible and capable power delivery systems; governance to operate in 5-10 minute intervals, forecast hourly, and plan and build on a generational time horizon; and dependable and secure communications. We can choose our fuel mix for climate reasons, but the grid itself and the society that relies upon it impose constraints on those choices that we ignore at our peril.

13 HYDRO ENERGY↗
DOE OSTI2020

Frequency Analysis of Solar PV Power to Enable Optimal Building Load Control

In this paper, we present a flexibility estimation mechanism for buildings’ thermostatically controlled loads (TCLs) to enable the distribution level consumption of the majority of solar photovoltaic (PV) generation by local building TCLs. The local consumption of PV generation provides several advantages to the grid operation as well as the consumers, such as reducing the stress on the distribution network, minimizing voltage fluctuations and two-way power flows in the distribution network, and reducing the required battery storage capacity for PV integration. This would result in increasing the solar PV generation penetration levels. The aims of this study are twofold. First, spectral (frequency) analyses of solar PV power generation together with the power consumption of multiple building TCLs (such as heating, ventilation, and air conditioning (HVAC) systems, water heaters, and refrigerators) are performed. These analyses define the bandwidth over which these TCLs can operate and also describe the PV generation frequency bandwidth. Such spectral analyses, in frequency domain, can help identify the flexible components of PV generation that can be consumed by the various TCLs through optimal building load utilization. Second, a quadratic optimization problem based on model predictive control is formulated to allow consuming most of the low and medium frequency content of the PV power locally by building TCLs, while maintaining occupants’ comfort and TCLs’ physical constraints. The solution to the proposed optimization problem is achieved using optimal control strategies. Numerical results show that most of the low and medium frequency content of the PV generation can be consumed locally by building TCLs. The remaining high-frequency content of the PV generation can then be stored/offset using energy storage systems.

14 SOLAR ENERGY↗
DOE OSTI2021

Modelling and control coordination scheme of a wind‐to‐hydrogen set for future renewable‐based power systems

New challenges regarding system stability and efficiency arise when power systems operate with a high penetration level of inverter‐based renewable sources (IBRSs) and few synchronous generators. Since IBRSs have been on the rise, to secure the stable operation of future power systems, IBRSs will be required to support systems without having to rely on remaining synchronous generators. Also, to efficiently manage the uncertainty of renewable production, power‐to‐gas technology can provide the required flexibility. This study proposes modelling and a control coordination scheme (CCS) of a wind‐to‐hydrogen (W2H) set to optimise electricity production from a variable‐speed wind turbine generator (WTG) while helping balance between supply and demand in a system. To achieve this, a grid‐forming (GFM) inverter‐based WTG is modelled and a set of electrolyser and fuel cell is integrated at the DC circuit of a GFM‐WTG to be coordinated. Furthermore, the CCS offers an opportunity to reduce the investment cost for deploying a W2H set by utilising the control capabilities of a WTG and reducing the need for an additional device. The performance of the proposed W2H set with the CCS was verified considering the variations in system load and wind speed by using Power System Computer Aided Design (PSCAD)/ElectroMagnetic Transients including Direct Current (EMTDC).

Kim, Jinho↗
NASA NTRS1999

Manipulating Liquids With Acoustic Radiation Pressure Phased Arrays

High-intensity ultrasound waves can produce the effects of "Acoustic Radiation Pressure" (ARP) and "acoustic streaming." These effects can be used to propel liquid flows and to apply forces that can be used to move or manipulate floating objects or liquid surfaces. NASA's interest in ARP includes the remote-control agitation of liquids and the manipulation of bubbles and drops in liquid experiments and propellant systems. A high level of flexibility is attained by using a high-power acoustic phased array to generate, steer, and focus a beam of acoustic waves. This is called an Acoustic Radiation Pressure Phased Array, or ARPPA. In this approach, many acoustic transducer elements emit wavelets that converge into a single beam of sound waves. Electronically coordinating the timing, or "phase shift," of the acoustic waves makes it possible to form a beam with a predefined direction and focus. Therefore, a user can direct the ARP force at almost any desired point within a liquid volume. ARPPA lets experimenters manipulate objects anywhere in a test volume. This flexibility allow it to be used for multiple purposes, such as to agitate liquids, deploy and manipulate drops or bubbles, and even suppress sloshing in spacecraft propellant tanks.

Oeftering, Richard C.↗
DOE OSTI2022

Conceptual Design of Pulverized Coal Electricity Generating Units for Flexible Operation

This presentation was given by Marc Turner, NETL Support Contractor, at the International Center for Sustainable Carbon's "The Energy Transition - the Role for Sustainable Carbon" workshop held in Sardinia, Italy on November 16-18, 2022. The presentation addresses the NETL report titled "Conceptual Design of Pulverized Coal Electricity Generating Units for Flexible Operation" published on September 6, 2022. This study presents an independent conceptual assessment of the features, cost, and performance of pulverized coal power plants (without carbon dioxide capture) intended for flexible, rather than baseload, operation. The objective was to leverage the already substantial knowledge base about flexible operation and develop state-of-the-art pulverized coal power plant cases that are designed to accommodate flexible operation within an electric grid having a high level of renewable generation. This is of significant importance in coal-dependent regions of the world as variable renewable energy becomes more prevalent.

Turner, Marc↗
DOE OSTI2026

Organic Rankine Cycle Integration and Optimization for High Efficiency CHP Genset Systems (Final Technical Report)

This project successfully advanced the integration of Organic Rankine Cycle (ORC) technology with reciprocating engine–based combined heat and power (CHP) systems to improve electrical efficiency, total CHP efficiency, and grid-responsive operation. Over three budget periods, the work progressed from high-temperature ORC component development and thermodynamic model validation to next-generation system design, working fluid transition, and techno-economic analysis. Key technical accomplishments include development and validation of a thermodynamic model capable of accurately predicting ORC performance across an expanded temperature and pressure envelope; successful identification and validation of low-global-warming-potential (GWP) working fluids—most notably R1233zd(E)—as viable replacements for R245fa; and demonstration of scalable ORC architectures suitable for integration with 1–20 MW class reciprocating engines. These advances enable flexible CHP configurations that can increase electrical output while maintaining high overall utilization of available thermal energy. The project also produced a clean-sheet design for a next-generation ORC system targeting substantially higher power output per unit, supported by detailed component selection, heat exchanger evaluation, and system-level modeling. Techno-economic analyses indicate that ORC-enabled flexible CHP systems can meet or exceed Department of Energy (DOE) efficiency targets while providing value to both facility operators and the electric grid.. Late-stage testing of the largest next-generation ORC prototype identified limitations related to pump net positive suction head (NPSH) requirements and condenser flooding under certain operating conditions. Although these issues constrained full validation of that configuration within the project timeframe, they provided clear and actionable design guidance for future system refinements. Importantly, validated modeling, smaller-scale testing, and working fluid evaluations confirmed the technical viability of the overall approach. In aggregate, this project met its core objectives by establishing validated design tools, de-risking key ORC technologies for CHP applications, and defining a credible pathway toward commercialization of flexible, high-efficiency CHP systems. The results form a strong foundation for continued development and deployment beyond the conclusion of the DOE-funded effort.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2025

A review of Geological Thermal Energy Storage for seasonal, grid-scale dispatching

Energy storage is essential for the decarbonization of the U.S. energy grid, especially with the increasing deployment of variable renewable energy sources like solar and wind. Geological thermal energy storage (GeoTES) has emerged as a promising long duration, grid scale solution, providing stability and security through flexible operations and valuable grid services. GeoTES utilizes subsurface reservoirs to store thermal energy for power generation and direct-use heating and cooling. This approach significantly enhances the use of low-temperature reservoirs, which would otherwise be unsuitable for geothermal power plants. It also aligns well with depleted oil and gas reservoirs, concentrating solar power, non-flexible renewables (photovoltaic and wind), and geothermal-related power cycles. Given the favorable marginal costs of GeoTES as storage duration increases, it becomes particularly competitive for seasonal, grid-scale dispatch, where few technologies are viable. This paper provides a comprehensive review of GeoTES systems and the research underpinning itsr development. This analysis begins by defining and categorizing the unique characteristics of thermal energy storage techniques, setting GeoTES apart from other technologies. The various components, configurations, subsurface characteristics, and modeling efforts that guide GeoTES development are then explored. Finally, challenges in GeoTES research, development, and deployment are discussed, along with mitigation strategies and lessons from related technologies. Beyond their economic benefits, GeoTES systems support grid resilience and decarbonize industrial processes. Their scalability, broad distribution, seasonal storage potential, and flexible dispatch capacity make GeoTES a valuable tool for expanding renewable energy deployment and addressing climate change.

15 - GEOTHERMAL ENERGY↗
DOE OSTI2025

Feasibility of Recycling Discharged Microreactor Heavy Metal in Light Water and Sodium-Cooled Fast Reactors: A Neutronics Analysis

Nuclear microreactors (MRs) offer unique advantages, such as rapid deployment, potability, low maintenance requirements, and operational flexibility. Their compact size makes them a promising solution for decentralized power generation, particularly in remote areas, military bases, and disaster-stricken regions. However, MRs face challenges, including unutilized fissile material at the end of life, economic inefficiency, increased heavy metal (HM) waste complicating disposal, and the accumulation of plutonium (Pu) with high 239 Pu concentrations raising proliferation risks. Here, this study investigated the neutronics feasibility of a novel three-stage fuel cycle where discharged HM from MRs is recycled and burned in light water reactors and sodium-cooled fast reactors. This approach converts discharged HM into valuable fuel, enhancing the efficiency of MR deployments while improving the safeguardability of their final waste products. Neutronics analysis demonstrated that the safety characteristics of reactor designs in each stage were minimally impacted by the proposed cycle. For two representative MR designs, a fast-spectrum MR with solid pellet fuel and a thermal-spectrum MR with TRISO (TRi-structural-ISOtropic) fuel compacts, the proposed fuel cycle reduced the uranium disposal mass flow rate by ~60%, decreased the 235 U enrichment of the discharge fuel to ~1 wt%, eliminated plutonium disposal, and increased the cumulative fuel burnup to ~580 gigawatt-day per metric ton of initial heavy metal (GWd/t-iHM) or 60% fissions per initial metal atom. Despite the significant differences between the two MR designs, the performance and infrastructure requirements of the developed fuel cycles were remarkably similar, indicating its generalizability to a broader class of MRs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Plug into NREL's Resilient CUBE

Designed for mobility and flexibility, NREL's Consolidated Utility Base Energy (CUBE) is a hybrid power generation system that converts energy from different sources - solar panels, batteries, diesel generators, and host grid power - into tactical electricity, improving the efficiency and reliability of power for the military's forward operating bases. By reducing dependence on diesel generators, the CUBE also helps reduce the number of soldiers, sailors, airmen and marines shipping fuel across dangerous territory.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Geothermal Flexibility Characteristics

This spreadsheet identifies various flexibility characteristics for flash and binary geothermal power plants which could potentially facilitate provision of grid services beyond bulk power generation. Characteristics are differentiated between resource characteristics such as metal concentration and plant characteristics such as flow rates of pumps used in flash vs. binary plants.

15 GEOTHERMAL ENERGY↗
NASA NTRS2018

Thin-Film Solar Arrays for Small Spacecraft

The use of thin-film based solar arrays for space applications has long been recognized as an advantageous power generation option. Thinner materials yield a mass savings, equating to lighter launch loads, larger arrays, and/or more payload allocation. Further, their mechanical flexibility lends itself well to stowage and deployment schemes, allowing for a vast improvement to both specific power (W/kg - watts per kilogram) as well as stowed power density (W/m3 - watts per cubic meter). A key application of thin-film space solar arrays is in the small satellite community; where spacecraft are largely power-starved. Their need for higher power generation coupled with the extreme mass and volume restrictions of the small spacecraft bus is driving the requirement for advanced solar arrays. And, when coupled with the relatively short operational requirements (e.g. less than 2 years) of small spacecraft, yields the perfect application for these thin-film arrays. In this presentation, NASA’s recent work on developing the Lightweight Integrated Solar Array and anTenna (LISA-T - also known as Lightweight Integrated Solar Array and Transceiver)), a thin-film solar array for small spacecraft, will be discussed. The array configuration will be shown alongside bench top deployment videos, a summary of environmental testing to date, and forward plans to a flight test. Advanced, robotic additive manufacturing of the thin-film web will also be discussed.

Carr, John A.↗
NASA NTRS2018

A Review of Distributed Electric Propulsion Concepts for Air Vehicle Technology

The emergence of distributed electric propulsion (DEP) concepts for aircraft systems has enabled new capabilities in the overall efficiency, capabilities, and robustness of future air vehicles. Distributed electric propulsion systems feature the novel approach of utilizing electrically-driven propulsors which are only connected electrically to energy sources or power-generating devices. As a result, propulsors can be placed, sized, and operated with greater flexibility to leverage the synergistic benefits of aero-propulsive coupling and provide improved performance over more traditional designs. A number of conventional aircraft concepts that utilize distributed electric propulsion have been developed, along with various short and vertical takeoff and landing platforms. Careful integration of electrically-driven propulsors for boundary-layer ingestion can allow for improved propulsive efficiency and wake-filling benefits. The placement and configuration of propulsors can also be used to mitigate the trailing vortex system of a lifting surface or leverage increases in dynamic pressure across blown surfaces for increased lift performance. Additionally, the thrust stream of distributed electric propulsors can be utilized to enable new capabilities in vehicle control, including reducing requirements for traditional control surfaces and increasing tolerance of the vehicle control system to engine-out or propulsor-out scenarios. If one or more turboelectric generators and multiple electric fans are used, the increased effective bypass ratio of the whole propulsion system can also enable lower community noise during takeoff and landing segments of flight and higher propulsive efficiency at all conditions. Furthermore, the small propulsors of a DEP system can be installed to leverage an acoustic shielding effect by the airframe, which can further reduce noise signatures. The rapid growth in flight-weight electrical systems and power architectures has provided new enabling technologies for future DEP concepts, which provide flexible operational capabilities far beyond those of current systems. While a number of integration challenges exist, DEP is a disruptive concept that can lead to unprecedented improvements in future aircraft designs.

electric propulsion↗
NASA NTRS2015

Thin, Flexible IMM Solar Array

NASA needs solar arrays that are thin, flexible, and highly efficient; package compactly for launch; and deploy into large, structurally stable high-power generators. Inverted metamorphic multijunction (IMM) solar cells can enable these arrays, but integration of this thin crystalline cell technology presents certain challenges. The Thin Hybrid Interconnected Solar Array (THINS) technology allows robust and reliable integration of IMM cells into a flexible blanket comprising standardized modules engineered for easy production. The modules support the IMM cell by using multifunctional materials for structural stability, shielding, coefficient of thermal expansion (CTE) stress relief, and integrated thermal and electrical functions. The design approach includes total encapsulation, which benefits high voltage as well as electrostatic performance.

Walmsley, Nicholas↗
DOE OSTI2023

Market analysis for the integration of new power technologies: A case study of the deployment of hybrid fossil-based generator plus energy storage (ES-FE)

This study examines the national landscape of hybridized fossil energy (FE) power plants with energy storage (ES) technologies (“ES-FE”) and presents the compilation of an ES-FE dataset, which includes over 65 ES-FE projects and concepts in the United States, comprising approximately 500 MWh of co-located ES capacity with FE power plants. This study also estimates the economic feasibility of adding ES to existing FE power plants by characterizing the potential revenues that can be generated by the ES component through flexibility and capacity value. The analysis focuses on ES technologies with 2- to 10-h. durations located in four U.S. independent system operators (ISOs): Midcontinent ISO (MISO), Electric Reliability Council of Texas (ERCOT), PJM Interconnection (PJM), and California ISO (CAISO), which have +70,000 MW of combined FE power capacity that could add ES. Annual revenues are estimated for the ES component using a what-if-analysis approach, for capacity value, price arbitrage, or ancillary services provision. The results show that annual revenues depend on the end-use storage service, wholesale electricity and capacity market prices, and ES technology operation parameters such as discharging duration and cycling frequency. When performing a sensitivity analysis, ES accrues $7–178/kW-yr. via price arbitrage and ancillary services provision in the four ISOs, and $13–92/kW-yr. when providing capacity value only in MISO and PJM. A cash flow analysis is performed to estimate the net present value (NPV) of the ES addition using a range of ES costs. The study finds that for most ES technologies considered, these revenues alone are insufficient to achieve economic feasibility. In conclusion, of the 1645 total runs analyzed, 115 had positive NPVs (7%). Therefore, other revenue streams or monetizable benefits are necessary to achieve the break-even point.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2023

Modular Staged Pressurized Oxy-Combustion (SPOC) Power Plant for Coal and Biomass – Integration of Combustor Boiler and DCC

Critical to the future of power generation is the development of a power plant that will be capable of flexible operation to meet the needs of the modern grid, providing resilient, low-emissions power to a grid that is increasingly seeing a large penetration of intermittent wind and solar. The modular Staged, Pressurized Oxy-Combustion (SPOC) process envisioned by and under development at Washington University in St. Louis (WUSTL) has the potential to achieve these goals. The process offers: 1) a modular plant design for improved operational flexibility; 2) fuel-staging combined with pressurized oxy-combustion, which leads to smaller plant size, higher plant efficiency, and lower cost for pollutant and greenhouse gas removal compared with traditional carbon-capture equipped coal power plants; and 3) small modular boilers and pollutant removal units that can be fabricated in shop and assembled on site, further reducing plant capital costs. Under DOE's support (DE-FE0031925), WUSTL is advancing the development of the critical components for the SPOC power plant, including the integrated combustion system and the direct contact cooler (DCC) from Technology Readiness Level (TRL) 4 to TRL-5, which would allow these technologies to be subsequently incorporated into a pilot plant. This talk will present an overview of the SPOC technology, CFD modeling and validation for burner and boiler development, and recent results to evaluate critical components for system integration needed to advance its TRL.

Magalhaes, Duarte↗
DOE OSTI2023

Development of the Modular Staged Pressurized Oxy-Combustion (SPOC) Power Plant for Coal and Biomass

Critical to the future of power generation is the development of a power plant that will be capable of flexible operation to meet the needs of the modern grid, providing resilient, low-emissions power to a grid that is increasingly seeing a large penetration of intermittent wind and solar. The modular Staged, Pressurized Oxy-Combustion (SPOC) process envisioned by and under development at Washington University in St. Louis (WUSTL) has the potential to achieve these goals. The process offers: 1) a modular plant design for improved operational flexibility; 2) fuel-staging combined with pressurized oxy-combustion, which leads to smaller plant size, higher plant efficiency, and lower cost for pollutant and greenhouse gases removal compared with traditional carbon-capture equipped coal power plants; and 3) small modular boilers and pollutant removal units that can be fabricated in shop and assembled on site, further reducing plant capital costs. Under DOE's support (DE-FE0031925), WUSTL is advancing the development of the critical components for the SPOC power plant, including the integrated combustion system and the direct contact cooler (DCC) from Technology Readiness Level (TRL) 4 to TRL-5, which would allow these technologies to be subsequently incorporated into a pilot plant. This talk will present an overview of the SPOC technology, CFD modeling and validation for burner and boiler development, and recent results to evaluate critical components needed to advance its TRL.

Magalhaes, Duarte↗
DOE OSTI2022

Combined Cycle Integrated Thermal Energy Storage “CiTES” (Final Scientific/Technical Report)

The Phase I of this project confirmed the technical feasibility of a Combined Cycle integrated Thermal Energy Storage “CiTES” system, calculated the key performance parameters like power efficiency and costs, and proved its commercial value with full-year simulations for several US electricity markets with high degree of variable renewable generation and volatile hourly electricity prices. The core element of this project is the Electro Thermal Energy Storage (ETES) technology from Siemens Gamesa Renewable Energy GmbH, using thermally stable and inexpensive volcanic rocks as storage material and air as heat transfer medium. This technology is backed by more than 10 years of experience and a 440MMBTU (130MWh-th) pilot plant in Hamburg, Germany, which is in operation since 2019. The integration of this thermal storage in an existing combined cycle power plant (CCPP) is typical power plant technology without any major technology risks. It allows the storage of inexpensive renewable energy during times of surplus renewable generation and the discharge of this energy in times of high energy demand when the fossil plant is in operation. This supplements the fossil power generation with CO2-emission-free energy. The secondary effect of the CiTES system is that a small part of the stored thermal energy is used to keep the heat recovery steam generator (HRSG) and steam turbine (ST) of the combined cycle power plant in hot and ready-to-start condition. This enables the plant to start rapidly when fossil generation is required to satisfy demand as soon variable generation drops off in the evenings or during cloud cover and calm wind periods. Without pre-warming of the HRSG and ST, the CCPP would need several hours for a cold or warm start, burn a lot of gas and release high NOx emissions during start and wouldn’t be able to use the short times of high energy prices in an efficient or economical manner. The economic parameters of CiTES were determined by a full year “8760” simulation using a data set calculation for each of the hours of the year, and historical electricity and gas prices. For consistency, the simulations were focused on the pre-COVID year 2019. The financially most attractive markets were in the Energy Reliability Council of Texas (ERCOT) region, which allowed substantial value generation with arbitrage (charge with cheap energy during renewable surplus times and discharge when energy is needed and expensive). The improvement of flexibility with the CiTES system by pre-heating and warm-keeping of the CCPP allowed for additional power generation during short time periods when demand is high but renewable generation is down; when the hourly energy prices are highest in these markets. The simulations are based on 2019 data, when ERCOT had 27GW of installed photovoltaic (PV) and wind generation. They showed that the created revenue with the prototypically sized CiTES system of 1,000MMBTU (300MWh-th) falls a little bit short of what is expected from a commercially viable investment. The system has optimization opportunities for cost reduction and increased effectiveness which will be realized during a potential Phase II Pre-FEED study following this project. Furthermore, it is safe to assume that a lot of renewable generation capacity will be added all over the US in the coming years. As an example, ERCOT is predicting to more than double its renewable generation from 27GW in 2019 to a forecasted 63GW in 2023. This will increase the amount of renewable overproduction exponentially. This rapid increase of local overproduction and the need to curtail renewable generation is well documented by the California ISO (www.CAISO.com / managing oversupply). However, the simulations also revealed a weakness in the structure of the electricity markets in the US. More specifically, when electricity prices are very low and approaching negative levels, the owners of Variable Renewable Energy (VRE) will curtail a part of their facility to stabilize the price by reducing supply. This results in a situation in which storage facilities, which are integrated in existing fossil assets and don’t have the behind-the-meter benefit of a VRE, won’t be able to purchase low cost – otherwise curtailed – renewable energy off the grid. A special tariff, which motivates VRE owners to sell otherwise curtailed renewable energy to storage facilities (Hydrogen, thermal, pumped hydro, etc.) can solve this issue. The implementation of such a regulating tariff by Independent System Operators, thus avoiding renewable curtailment, is a pre condition for successful commercialization for renewable energy storage technologies. With this advancement of design and technology and improvements in the market environment, it can be expected that the Combined Cycle integrated Thermal Energy Storage proves itself as an important innovation to keep highly efficient, natural gas-based power generation economically successful and relevant for the power industry in the United States of America.

Wolf, Thorsten↗
DOE OSTI2022

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗