Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “renewable integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Life cycle assessment of a novel gas switching reforming for sustainable hydrogen production with CO2 capture

Gas switching reforming for hydrogen production (GSR-H2) presents an efficient, low-carbon hydrogen production method that incorporates integrated carbon capture, offering efficiency gains over traditional methods such as proton exchange membrane (PEM) electrolysis, steam methane reforming (SMR) and the newer method of chemical looping reforming (CLR). GSR-H2 has been demonstrated in lab scale which operates as an exothermic process that eliminates the need for additional natural gas combustion, using its own waste heat to generate process steam and partially offset energy usage through electricity production. Beyond its thermal self-sufficiency, GSR-H2 advances upon CLR by integrating all reaction stages within a single reactor cluster, eliminating the complexities of solid circulation, reducing capital costs, and enhancing overall process efficiency. This streamlined design simplifies scale-up and enables inherent CO2 separation with minimal energy penalty, making GSR-H2 a highly competitive pathway for low-carbon hydrogen production. This study presents the first life cycle assessment (LCA) of GSR-H2, offering a novel evaluation of this new process’s environmental impacts across diverse energy scenarios. Key findings reveal that in the renewables-powered scenario, GSR-H2 achieves a GWP of 2.77 kg CO2 eq per kg H2, a substantial improvement over SMR’s 10.4 kg CO2 eq and close to the low emissions of CLR (1.84 kg CO2 eq) and PEM electrolysis (1.85 kg CO2 eq). These results demonstrate GSR-H2’s competitive advantage as a lower-emission alternative, combining design simplicity and efficiency gains, especially in renewable-integrated systems. These results establish GSR-H2 as a competitive, scalable option for hydrogen production, particularly in decarbonization efforts.

03 NATURAL GAS↗

Quantifying Impacts of Renewable Electricity Deployment on Air Quality and Human Health in Southeast Asia Based on AIMS III Scenarios

This study augments the ASEAN Interconnection Masterplan Study III (AIMS III) by quantifying changes to air quality and human health that result from its renewable integration and transmission interconnection scenarios. Performing this analysis requires translation of the changes in projected generation from different power sector fuel sources in the AIMS III scenarios to changes in air pollutant emissions, developing what is known as an emissions inventory for each scenario and year evaluated. An emissions inventory represents who emits air pollutants, from where the pollutants are emitted, when, and how much of which air pollutants are emitted. With the assistance of the ASEAN Centre for Energy and leveraging the best available in-region public data sources, the National Renewable Energy Laboratory (NREL) team compiled a detailed inventory of power plants in the ASEAN region, mapping their PM 2.5 , sulfur oxides (SOx), and nitrogen oxides (NOx) emissions. A new, first-of-its-kind, and user-friendly global air quality model, Global InMAP (Thakrar et al. 2022), is then used to transform the inventory of changes in emissions to changes in concentration of fine particulate matter. Global InMAP then maps the location of human populations in ASEAN countries to calculate humans' exposure to PM 2.5 and estimate excess PM 2.5 -caused mortality attributable to thermal generation sources, as modeled in the AIMS III scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Africa Battery Energy Storage Systems (BESS) Capacity Building Utility-Scale Storage: BESS Valuation, Tariffs, and Remuneration [Slides]

Utility-scale Battery Energy Storage Systems (BESS) are key to enhancing grid reliability, integrating renewable energy, and providing operational flexibility. Designing effective valuation, remuneration, and tariff frameworks is essential to ensure both system benefits and financial viability for developers. This presentation outlines a structured methodology for evaluating BESS projects, covering policy and legal considerations, cost and revenue analysis, benchmarking, financial sensitivity, and risk assessment, while ensuring alignment with public interest. It also explores valuation of multiple storage services - bulk energy, ancillary services, and infrastructure support - and monetization strategies through capacity payments, energy tariffs, tolling, arbitrage, and non-wires alternative payments. Technical factors, including round-trip efficiency, degradation, and storage duration, are integrated into financial and operational modeling to quantify both system-wide and project-level benefits. Through case studies and simulation-based approaches, this framework provides regulators, utilities, and developers with practical guidance for tariff design, payment structures, and investment decisions, maximizing the economic and societal value of BESS deployment.

25 ENERGY STORAGE↗

Application of a Prize Mechanism to Address Data Utilization Challenges at Utilities

The electric industry sector is facing an “explosion” of data from a variety of sources. Electric sector stakeholders need to define how to capitalize on large datasets, both those they create and those from other sources (like data on weather, buildings, electric vehicles, etc.), to improve reliability and resilience and meet the changing system dynamics from renewable integration. For the electricity sector to fully utilize these vast new datasets, it must undergo a transformation in how it manages data quality, storage, and processing. The U.S. Department of Energy (DOE) Office of Electricity (OE) is committed to accelerating research, development, and demonstration of new technologies and tools within the electricity sector to advance reliability, resilience, and affordable operation of the power system. Through the prize mechanism, OE identified two widespread data-related challenges for utilities—load modeling and data analysis automation—and offered an opportunity for utilities and teams of software engineers to identify additional challenges faced by utilities. After completing one round of the American-Made Digitizing Utilities Prize, OE, the National Renewable Energy Laboratory (NREL) as the prize administrator, and Pacific Northwest National Laboratory (PNNL) as the domain experts have compiled the results and lessons learned to feed into the second round of the prize.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

An Analysis Framework for Distribution Network DER Integration Analysis in India: Distributed Solar in Tamil Nadu

This report is part of a two-part series that represents a year-long collaboration with the Tamil Nadu Generation and Distribution Corporation Limited (TANGEDCO) on power sector planning. The first report in this series, the Pathways for Tamil Nadu’s Electric Power Sector 2017-2030 report outlines NREL’s work with TANGEDCO's electricity sector planning department to develop a model of the State’s power system and evaluate multiple scenarios of system growth given resource constraints, costs of technologies, and power sector policies. This second report in this series focuses on the rapidly transforming distribution network in the State. The report outlines a framework developed by NREL with TANGEDCO's distribution utility to quickly and accurately analyze the impacts of integrating renewable energy, specifically rooftop solar PV onto Tamil Nadu's distribution system. Together these studies help to prepare Tamil Nadu for a rapidly transforming power system.

14 SOLAR ENERGY↗

Develop a weather-aware climate model to understand and predict extremes and associated power outages and renewable energy shortages with uncertainty-aware and physics-informed machine learning

Focal Area(s): The focus area is predictive modeling through the use of AI techniques and AI-derived model components with a particular emphasis on extreme weather in Atmospheric Science and power outages and shortages in Energy Science. Science Challenge: Predicting weather extremes (e.g., heavy precipitation, strong wind, and large hailstones), and weather-related power system outages and shortages can mitigate economic losses, save lives, support renewables integration, and improve power system resiliency. However, currently, the poor reliability and large uncertainty associated with the weather extreme prediction in the current climate models make the problem intractable. The key challenges are: (1) physical factors like green-house gases (GHGs), aerosols, and land use and land cover (LULC) can significantly impact extreme storms, but the understanding of these impacts is limited, particularly globally; (2) the convective permitting resolutions needed to model severe convective storms and their impacts are computationally prohibitive with global climate models (GCMs); (3) interactions between weather extremes and power system outages are complex and subject to great uncertainty. Current outage prediction models are short lead (~ 3 days), which do not allow for long-time planning of energy production and distribution. Moreover, we have limited capacity to predict weather events leading to sustained shortages in a renewable-energy-dominated power system. These challenges drive motivation for mechanistic understanding and reliable and efficient predictive modeling of extremes and their impacts from the sub-seasonal to long term projections.

54 ENVIRONMENTAL SCIENCES↗

Strong and recyclable bio-derived poly(ester amide) hot-melt adhesive

Bio-based adhesives offer inherent advantages over conventional petrochemical-derived systems, including renewable sourcing, reduced environmental impact and potential degradability. However, most bio-based adhesives suffer from poor adhesion strength, limited substrate compatibility and a lack of chemical recyclability. Here, in this work, we present a bio-derived multiblock poly(ester amide) adhesive that leverages microphase segregation between different segments to reconcile mechanical robustness with strong interfacial bonding. Notably, this multiblock architecture is accessed through a one-pot, selective acceptorless dehydrogenative polymerization, obviating the need for multistep synthesis. The materials exhibit excellent adhesion across a range of substrates including metals, glass and wet wood surpassing commercial benchmarks, while also demonstrating thermal stability, tunable mechanical properties and closed-loop chemical recyclability even in the presence of other commodity plastics. Furthermore, the adhesive strength of these materials could be tuned for various potential applications through control over the chemical composition of the polymer. By integrating renewable feedstocks, high-performance functionality and efficient chemical circularity within a single platform, this work provides a viable pathway toward more sustainable adhesive technologies and contributes to advancing circular materials manufacturing.

09 BIOMASS FUELS↗

West Africa Battery Energy Storage Systems (BESS) Capacity Building - Discussion of BESS Tariffs: Payment Structures and Case Studies [Slides]

Battery Energy Storage Systems (BESS) are emerging as critical assets for enhancing grid reliability, integrating renewable energy, and enabling system flexibility. Yet, the regulatory and financial frameworks that determine how BESS projects are compensated vary widely across jurisdictions. This presentation explores international case studies - from Honduras, Costa Rica, Chile, South Africa, Mexico, and Brazil - to illustrate how tariff design and payment structures are evolving to support large-scale BESS deployment. The cases highlight a range of ownership and revenue models, including cost-of-service mechanisms, energy and capacity payments, and market-based arbitrage, as well as hybrid approaches under development. The discussion will examine key challenges such as defining remuneration for ancillary services, addressing double charging, and accounting for efficiency losses and degradation over time. By comparing experiences across markets, the presentation identifies emerging best practices for valuing BESS and designing tariffs that align technical performance with economic incentives, providing insights for regulators, utilities, and policymakers pursuing storage integration.

25 ENERGY STORAGE↗

Megawatt-Scale Low Temperature Electrolyzer Research Expansion

The development and installation of a flexible low-temperature electrolyzer research capability at the multi-MW scale with integrated renewables will help lower the cost barrier to entry for electrolyzer manufactures needing at scale system and stack evaluation and enable more electrolyzer manufactures to accelerate to commercialization with building block scale demonstration and validation. This NREL capability represents a DOE HFTO investment to support the $1B DOE Clean Hydrogen Electrolysis Program working to achieve the Hydrogen Shot goal of $1 for 1 kg hydrogen in 1 decade, lower greenhouse gas emissions and criteria pollutants, build clean energy infrastructure, and provide pathways to private sector uptake.

Advanced Research on Integrated Energy Systems (AR↗

Megawatt-Scale Low Temperature Electrolyzer Research Capability

The development and installation of a flexible low-temperature electrolyzer research capability at the multi-MW scale with integrated renewables will help lower the cost barrier to entry for electrolyzer manufactures needing at scale system and stack evaluation and enable more electrolyzer manufactures to accelerate to commercialization with building block scale demonstration and validation. This NREL capability represents a DOE HFTO investment to support the $1B DOE Clean Hydrogen Electrolysis Program working to achieve the Hydrogen Shot goal of $1 for 1 kg hydrogen in 1 decade, lower greenhouse gas emissions and criteria pollutants, build clean energy infrastructure, and provide pathways to private sector uptake.

electrical grid↗

Minimizing grid energy consumption in wastewater treatment plants: Towards green energy solutions, water sustainability, and cleaner environment

Wastewater treatment plants (WWTPs) consume significant amount of energy to sustain their operation. From this point, the current study aims to enhance the capacity of these facilities to meet their energy needs by integrating renewable energy sources. The study focused on the investigation of two primary solar energy systems in As Samra WWTP in Jordan. The first system combines parabolic trough collectors (PTCs) with thermal energy storage (TES). This system primarily serves to fulfill the thermal energy demands of the plant by reducing the demands from boiler units, which allows more biogas for electricity generation. The second system is a photovoltaic (PV) system with Lithium-Ion batteries, which directly produces electricity that will be used to cover part of the electrical energy demands of plant. To assess the optimal configuration, two distinct scenarios have been formulated and compared to the current case scenario (SC#1). The first scenario focuses on maximizing the net present value (NPV) and minimizing the levelized cost of electricity (LCOE). The second scenario is centred on minimizing the levelized cost of heat (LCOH). The findings indicate that both scenarios succeeded in reducing the reliance on the grid to a value that reach 1 %. Moreover, they both reduced biogas percentage in energy production from 88 % to approximately 65 % through the integration of the PV system. In terms of thermal demand, SC#2 reduced the reliance on biogas boiler units from 100 % to 25 %, while SC#3 achieved an even more impressive reduction to just 8 %. The best LCOE value was attained in SC#2, at 0.0895 USD/kWh, with an NPV of 10.54 million USD. Conversely, SC# 3 yielded an LCOH value of 0.0432 USD/kWh th compared to 0.0534 USD/kWh th USD for SC#2. In conclusion, despite their relatively high capital and operating costs, SC#2 and SC#3 managed to substantially decrease the annual electricity expenditure from approximately 2 million USD to 86,000 USD and 0 USD, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

STOCHASTIC OPTIMAL POWER FLOW FOR REAL-TIME MANAGEMENT OF DISTRIBUTED RENEWABLE GENERATION AND DEMAND RESPONSE (Final Report)

To meet the grand challenge of a sustainable energy future, there has been a surge of interest in renewable energy. Today, the uncertainty associated with renewable resources is handled by using operating reserves. The high penetration of renewable resources, however, introduces difficult-to-control dynamics and challenges for power system operation. Decision support tools are necessary at the bulk system operational level to recognize and efficiently utilize renewable resources and distributed demand response products in concert with traditional grid resources. It is envisaged that responsive load can potentially have very significant cost advantages over either spinning or non-spinning ramping reserve. Critical decisions are made during hour(s)-ahead and real-time power system operation regarding the commitment and dispatch of generators to ensure power delivery is both reliable and economic. These decisions are typically made by a security constrained optimal flow, which determines future generator commitments, dispatches, and ensures adequate reserves are available in the event of a contingency (unexpected outage) or if future system conditions deviate from forecasts. However, security has been always based on a pre-specified subset of contingency constraints whose enforcement does not guarantee security under all possible future possibilities while also giving little or no weight to the likelihood of each contingent event or the severity of its consequences. Existing tools, which are based exclusively on deterministic optimization models, do not yield optimal operational decisions to address these new challenges, in terms of both reliability and cost-effectiveness. This project has focused on developing a stochastic optimal power flow (SOPF) framework, which integrates renewable resource uncertainty, load uncertainty, distributed storage (DS), demand response (DR) products, in a holistic manner to address the uncertainty associated with ever-increasing renewable resources, along with the inclusion of distributed demand response products in future power systems. A proof-of-concept problem was created using the Pennsylvania-Jersey-Maryland (PJM) power system network. Synthetic wind generation was added to the system to simulate 50% wind penetration. A 1-hour test of SOPF operation indicated more than 6% operational cost savings. The project continued by adding the Midwestern Independent System Operator (MISO) as a partner, with focus shifting from SOPF to Stochastic Look-Ahead Unit Commitment (SLAC). Unlike PJM, MISO is faced with significant renewable energy resources within its footprint and is challenged with substantial uncertainty in its operations. The SLAC distinguishes itself from existing tools that operators use. At best, today’s tools solve two to three cases independently, where one or two system parameters, such as forecasted load level (e.g., a low, base, and high forecast), are varied and the resulting scenarios are analyzed independently. The stochastic-based optimization of SLAC leverages statistical information from an ensemble of potential operational scenarios and their respective likelihood. The SLAC output can be translated into valuable information to the operator such as suggested commitments, optimal scheduling and dispatch of resources, reserve requirements at both locational and zonal resolutions, ramping availability and requirements, availability of demand response including operational guidance concerning the near-term and real-time coordination between distributed energy resources, and utilization of distributed storage resources. The developed SOPF/SLAC tool, a stand-alone tool compatible with existing EMSs, will provide system operators with unprecedented visibility, flexibility and predictability to these resources and operational guidance concerning the real-time coordination between DERs and DR/DS products. The game changing and practical impact of this disruptive technology will be dramatic and will usher in a new era in the electric power industry, wherein green energy concepts are fully embraced, and electric power costs are lowered throughout the nation.

42 ENGINEERING↗

Quantifying Impacts of Renewable Electricity Deployment on Air Quality and Human Health in Southeast Asia Based on Aims III Scenarios

Exposure to outdoor air pollution is the largest environmental risk factor for death and disease worldwide, associated with millions of cases of excess deaths (mortality) each year. Although there are many pollutants in the air that affect our health, the most important class of pollutants is fine particulate matter, PM 2.5 , which are airborne particles of diameter ≤2.5 micrometers (µm). These particles are small enough to deposit deep in the respiratory system where they can then enter the bloodstream, traveling and causing damage to other bodily systems. Exposure to outdoor (ambient) PM 2.5 has been found to be the most important environmental risk factor for mortality in Southeast Asia, associated with 130,000 - 320,000 excess deaths in Association of Southeast Asian Nations (ASEAN) member countries in 2019. Southeast Asia, especially its mega-cities, but also other areas, has some of the worst air quality in the world. Almost all human activity emits air pollutants. Fine particulate matter is both directly emitted and formed in the atmosphere through chemical reactions, the latter of which requires modeling to predict. Power generation is one of the major sources of air pollutants that lead to elevated concentrations of fine particulate matter, including in Southeast Asia. Fossil fuel combustion for power generation, especially coal but also diesel, is the main source of air pollutant emissions from power generation. While natural gas burns cleaner than coal or diesel, in the quantities combusted for power generation in Southeast Asia, it is also a significant emitter. This study augments the ASEAN Interconnection Masterplan Study III (AIMS III) by quantifying changes to air quality and human health that result from its renewable integration and transmission interconnection scenarios. Performing this analysis requires translation of the changes in projected generation from different power sector fuel sources in the AIMS III scenarios to changes in air pollutant emissions, developing what's known as an emissions inventory for each scenario and year evaluated. We then use for the first time a new global, reduced-complexity air quality model to transform the changes in emissions to changes in air pollutant concentration of the deadliest air pollutant for human health, fine particulate matter (or PM 2.5 ). The air quality model, Global InMAP, then utilizes the location of human population in ASEAN countries to calculate exposure to PM 2.5 concentration changes and translates that to estimates of excess mortality attributable to the AIMS III scenarios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Energy, economic, and environmental tradeoffs at run-of-river hydropower facilities

Hydropower’s ability to quickly adapt to variability from wind and solar generation by fluctuation flow rates can allow the electricity grid to integrate more renewable capacity. However, these rapid flow fluctuations, required to meet variability needs, can negatively impact aquatic ecosystems. In this study, we quantified energy-economic-environment tradeoffs at five conventional hydropower facilities (i.e. hydropower produced ad a dam on a river channel) across the United States to identify a mix of operational regimes that can provide flexibility to support variable renewable energy integration and environmental protections. Model results show a range of ability to meet demand from 4.7% to 97.8% depending on which case study is considered. Additionally, when modeling the case study facilities on a range of RoR conditions, allowing a % of inflow as discharge, we found the range of 140–200% of inflow allowed as discharge lead to lowest environmental impact while meeting the highest amount of demand. Our sensitivity analysis results demonstrated the Richard-Baker Flashiness Index, used to measure flowrate changes, and Revenue, were negatively correlated with the percent of hydropower generation within the defined Regional Energy Deployment System balancing area (i.e. region in which energy demand and energy supply is balanced based on the Regional Energy Deployment System model) yet positively correlated to the variable renewable energy generation percentage in the defined balancing area. In conclusion, our results suggest hydropower operations can aid in increasing renewable energy generation while limiting environmental impacts when considering a holistic analysis of energy-economic-environment tradeoffs.

Economic impact↗

Bipolar Membrane Electrodialyzers as Flexible Demand Response Resources: Co-Optimization of Cost Savings and Product Formation

Bipolar membrane electro dialyzers (BPMED) are widely used for chemical production and processing, including in the emerging ocean alkalinity enhancement (OAE) industry. In this paper, we explore the potential of BPMED devices as flexible electrochemical loads within power system operations. Using a multi-objective optimization framework, we evaluate BPMED operation across 24-hour and monthly horizons to examine how dispatch strategies respond to electricity price and grid conditions. Simulation results show that altering the relative weights of the choices in the objective function strongly shape the operating patterns, with cost-focused strategies that suppress the operation during peak prices. Furthermore, we propose alternative formulations that optimize operations to achieve both cost savings and alignment with periods of lower grid-side carbon intensity (CI), as low grid-side CI is key to maximize OAE efficiency. Additionally, a detailed sensitivity analysis highlights the importance of device properties, where low area-specific resistance (ASR) of membrane and high current efficiency (CE) are observed to jointly unlock cost-effective operation. However, even modest shunt efficiency losses are observed to erode performance and decrease system value. Importantly, the analysis demonstrates that BPMED can serve as a controllable and flexible demand response resource, shifting load to support multiple grid-side objectives, including (but not limited to) renewable integration, alleviate peak demand, and provide co-benefits for system reliability. These findings underscore BPMED’s dual role as a process technology and a grid-supporting asset, pointing to promising pathways for operational optimization of multiple objectives.

Bhattacharya, Saptarshi (ORCID:0000000308902060)↗

Strategies for microgrid operation under real-world conditions

Microgrids are an increasingly relevant technology for integrating renewable energy sources into electricity systems. Based on a microgrid implementation in California, in this study we investigate microgrid operation under real-world conditions. These conditions have not yet been considered in combination and encompass energy charges, demand charges, export limits, as well as uncertainty about future electricity demand and generation in the microgrid. Under these conditions, we evaluate the performance of two frequently applied groups of strategies for microgrid operation. The first group is composed of proactive strategies that optimize decisions based on forecasts of future electricity generation and demand. The second group includes reactive strategies that make operational decisions based exclusively on the current state of the microgrid. We evaluate the performance of the strategies under varying operational parameters, forecast accuracies, and microgrid configurations—well beyond our Californian showcase. Our results confirm the expectation that proactive strategies outperform reactive ones in the majority of settings. Yet, reactive strategies can perform better under short control intervals or under moderate prediction errors of PV generation or demand. Furthermore, the interplay between real-world conditions and operational strategies reveals several additional insights for research on microgrid operation. First, we find that demand charges and export limits decisively affect microgrid performance. Second, the impact of forecast errors is highly non-linear and non-monotonous. Third, escalating negative interactions between forecast errors and demand charges make proactive strategies benefit from longer control intervals. This result is contrary to existing best practice, which promotes short control intervals to minimize the impact of uncertainty.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The flexibility gap: Socioeconomic and geographical factors driving residential flexibility

Residential consumers are moving to the center of electricity systems and their flexibility is seen as a key resource to integrate renewable energy sources and support the grid. However, residential flexibility capacities are not homogeneous, as they depend on household appliances, comfort patterns, occupancy, and climate conditions. In this work, we calculate the technical flexibility capacities of 45 consumer types in mainland Spain, organised according to income and regional criteria. We show that flexibility gaps exist at both regional and socioeconomic (income) levels with flexibility differences of up to 10 times more capacity between the household groups from the lowest to the highest capacities. These geographical and socioeconomic gaps in flexibility can lead to distortions in national markets and have the potential to exclude citizens from the provision of flexibility services. Our results show in quantitative terms that a consumer-centered approach without considering correcting measures nor these gaps in drafting energy policies may lead to increasing inequality levels in the residential sector. Under an economic competitive paradigm, households with lower income levels or located in regions with lower flexibility potential may be excluded from the provision of flexibility to the detriment of households with larger potential, raising justice concerns in a flexibility-based energy transition.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Microgrid energy scheduling under uncertain extreme weather: Adaptation from parallelized reinforcement learning agents

Microgrids are useful solutions for integrating renewable energy resources and providing seamless green electricity to minimize carbon footprint. In recent years, extreme weather events happened often worldwide and caused significant economic and societal losses. Such events bring uncertainties to the microgrid energy scheduling problems and increase the challenges of microgrid operation. Traditional optimization approaches suffer from the inaccuracy of the uncertain microgrid model and the unseen events. Existing reinforcement learning (RL) - based approaches are also hampered by the limited generalization and the increasing computational burden when stochastic formulations are required to accommodate the uncertainties. This paper proposes a new parallelized reinforcement learning (PRL) method based on the probabilistic events to handle the microgrid energy uncertainties. Specifically, several local learning agents are employed to interact with pertinent microgrid environments in a distributed manner and report outcomes to the global agent, which will optimize microgrid energy resources online during extreme events. The stochastic microgrid energy optimization problem is reformulated to include all possible scenarios with probabilities. The advantage estimate functions of learning agents are designed with a backward sweep to transfer the outcomes to the value function updating process. Two simulation studies, stochastic optimization and online testing, are performed to compare with several existing RL approaches. Results substantiate that the proposed PRL method can achieve up to 20% optimization performance improvement with 4 and 28 times less computation cost than Q-learning with experience replay and multi-agent Q-learning approaches, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗