Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Are better combinations of DERs more profitable?: Combinatorial optimization for aggregation of DERs in wholesale electricity markets

Recently, regulatory changes in various countries have enabled the participation of small-scale distributed energy resources (DERs) aggregated in virtual power plants (VPPs) in wholesale electricity markets. The inherent uncertainty and variability of resources comprising VPPs can lead to imbalances between forecasted and metered outputs, potentially resulting in the deficient settlement of generation under imbalance settlement rules. To address this challenge, it is essential to manage variability in the planning phase and uncertainty in the operation phase. Most current research focuses on managing forecasting errors in the operational phase, with insufficient attention given to the planning phase. Here, to bridge this gap, this paper proposes an optimal combination strategy for DERs to maximize the market participation revenue of VPPs by proactively managing variability in the planning phase. To estimate the expected revenue, we conducted analyses for homogeneous and heterogeneous DERs using Monte Carlo simulations and genetic algorithms. Remarkably, the proposed method demonstrated approximately 8 % higher revenue compared to the neighboring group case when considering diversity in DER set configuration with equal proportions of photovoltaics and wind.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

AGGREGATE: dAta-driven modelinG preservinG contRollable dEr for outaGe mAnagemenT and rEsiliency (Final Report)

The AGGREGATE project team successfully developed and validated various modules for outage management. Brief summaries of each module are provided to showcase their strength for outage management and restoration for a distribution system with a high penetration of connected distribution energy resources (DERs). In recent years, inverter-based DERs have been widely deployed in distribution system. A most of behind-the-meter (BTM) solar power generation is not visible to the utility. The data-driven DER and load estimation modules are using machine learning (ML) and artificial intelligence (AI) to manage this issue, which provides an opportunity for distribution system operators (DSOs) to operate systems and make decisions in real-time for a distribution system with a high penetration of DERs deployed. Also, the estimated DER and true load can be further leveraged in network aggregation and cold-load pick up estimation for reducing the computing complexity and providing for fast restoration. After load demand and DER power generations have been estimated, the information will support topology and state estimation (SE). The topology estimation module demonstrated the viability of mixed integer linear programming (MILP) formulation to estimate the most likely operational radial topology and outage sections using power flow measurements, historical/estimated load and DERs data and smart meter ping measurements. Formulation includes continuous (power flow, load and DERs data) and binary measurements (smart meter ping measurements) in a single formulation. Errors in continuous data and binary data are modeled as normal distribution and Bernoulli distribution, respectively. In the future distribution grid, the power injection from controllable DERs will be essential for efficient and resilient grid operation. However, determining the optimal DER injections and restoration actions is dependent on knowledge of the system states. State estimation (SE), already the cornerstone of transmission energy management systems, will become commonplace in distribution management systems as more measurements become available from deployment of automated metering infrastructure (AMI). Observability analysis is the first step in SE, as it determines the sufficiency of the available measurements for accurately estimating the current system states. A new type of pseudo-measurement called a Correlational Measurement (CM) is introduced in this module, to enhance the observability of the system to enable more accurate SE. CMs encapsulate knowledge of correlation between demand patterns for similar classes of loads as well as injection patterns for same-technology renewable DERs. During grid contingency scenarios, DERs have been traditionally disconnected, without any fault ride-through capabilities. However, with new regulations and better technology, it is feasible for these resources to contribute to the grid’s restoration after an adverse event and hence enhance resilience. The controllability module proposes a two-step restoration scheme for the power system restoration process by leveraging additional degrees of freedom in power electronics interfaced DERs for mitigating voltage problems. In a resilience mode without the utility system, the distribution grid relies on DERs to serve critical load. In such a severe event with multiple faults on the distribution feeders, actuation of various protective devices (PDs) divides the distribution system into electrical islands. The undetected actuated PDs due to fault current contributions from DERs can delay the restoration process, thereby reducing the system resilience. The Advanced Outage Management (AOM) and the Advanced Feeder Restoration (AFR) modules developed in this project provide improved system resilience with multiple DERs. AOM identifies the faulted sections and actuated PDs in a distribution system with DERs by incorporating smart meter data. The most credible outage scenario including fault locations, PD actuations, and fault indicator (FI) failures is identified by a set of binary integer linear programming incorporating hypotheses. The AFR module serves to restore a distribution system with available energy resources taking into consideration the availability of utility sources and DERs. By partitioning the system into islands, critical load will be served with the available generation resources within islands based on the solution of a MILP. When the utility systems become available, the optimal path will be determined by a spanning tree search algorithm that reconnects these islands back to substations and restores the remaining load. The transmission and distribution (T&D) co-simulation module was used to validate the effect of a control action performed on the distribution side assets as it propagates to the transmission side. This ensures that the control action performed results in a feasible operating point on both the transmission and the distribution system. In addition to validation, the team used the T&D co-simulation module to demonstrate how distribution system assets can be used to mitigate issues on the transmission system. Specifically, the team demonstrated that appropriate switching operations on the distribution side can alleviate the line overload condition on the transmission side without causing new operational constraint violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Solar+ Optimizer: A Model Predictive Control Optimization Platform for Grid Responsive Building Microgrids

With the falling costs of solar arrays and battery storage and reduced reliability of the grid due to natural disasters, small-scale local generation and storage resources are beginning to proliferate. However, very few software options exist for integrated control of building loads, batteries and other distributed energy resources. The available software solutions on the market can force customers to adopt one particular ecosystem of products, thus limiting consumer choice, and are often incapable of operating independently of the grid during blackouts. In this paper, we present the “Solar+ Optimizer” (SPO), a control platform that provides demand flexibility, resiliency and reduced utility bills, built using open-source software. SPO employs Model Predictive Control (MPC) to produce real time optimal control strategies for the building loads and the distributed energy resources on site. SPO is designed to be vendor-agnostic, protocol-independent and resilient to loss of wide-area network connectivity. The software was evaluated in a real convenience store in northern California with on-site solar generation, battery storage and control of HVAC and commercial refrigeration loads. Preliminary tests showed price responsiveness of the building and cost savings of more than 10% in energy costs alone.

14 SOLAR ENERGY↗
DOE OSTI2020

Linear Approximation Line Pack Model for Integrated Electricity and Natural Gas Systems OPF

With the increasing installation of renewable energy electricity generation capacity, the penetration of natural gas fired generation is also substantailly increasing in power systems due to their fast response capability to mitigate system variability and uncertainty. The dependencies between the electricity system and the natural gas system are becoming more important to maintain the reliability of both systems. In integrated electricity and natural gas systems (IEGSs) operations, the nonlinearity of the natural gas system brings challenges to the system operators. In this paper, the IEGSs optimal power flow (OPF) model is proposed that includes the line pack of the gas system via linear approximation. The simulation results demonstrate that the proposed model can obtain optimal solutions efficiently that are comparable in accuracy as the nonlinear line pack model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Model-free estimation of completeness, uncertainties, and outliers in atomistic machine learning using information theory

Abstract An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets. However, atomistic ML often relies on unsupervised learning or model predictions to analyze information contents from simulation or training data. Here, we introduce a theoretical framework that provides a rigorous, model-free tool to quantify information contents in atomistic simulations. We demonstrate that the information entropy of a distribution of atom-centered environments explains known heuristics in ML potential developments, from training set sizes to dataset optimality. Using this tool, we propose a model-free UQ method that reliably predicts epistemic uncertainty and detects out-of-distribution samples, including rare events in systems such as nucleation. This method provides a general tool for data-driven atomistic modeling and combines efforts in ML, simulations, and physical explainability.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Integrating Resilience Planning in Distribution System Planning

Electric utilities, regulators, and stakeholders face increasing risks of severe storms, freezes, floods, and heat waves damaging grid infrastructure and causing power outages—and increasing risks of utility equipment igniting wildfires. At the same time, customer electricity rates have risen substantially in recent years, due in part to replacing aging infrastructure and improving resilience to natural hazards and physical threats. To address these challenges, utilities are beginning to move beyond traditional, siloed planning processes to balance resilience with other fundamental grid objectives such as affordability, reliability, safety, and serving new loads. This study presents a framework for states and utilities that want to advance integration of resilience and distribution planning processes to improve planning efficiency, better prioritize cost-effective grid expenditures, and balance planning objectives. The framework includes 7 key integration points between these planning processes: -Strategy process -Data -Threat assessments -Solution identification and prioritization -Optimization opportunities -Consideration of other grid needs -Metrics Lawrence Berkeley National Laboratory reviewed utility distribution system plans and interviewed subject matter experts to identify emerging practices for each of the 7 integration points. This report presents these practices, which can be used as a guide toward more holistic planning and cohesive investment strategies. It also includes 3 case studies to provide practical examples of how utilities apply such integrated planning processes: two pole hardening programs and one microgrid planning effort. The report concludes by identifying opportunities for future research.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Multi-delay coherence imaging spectroscopy optimized for ion temperature measurements in the divertor plasma of the Wendelstein 7-X stellarator

A new coherence imaging spectroscopy (CIS) diagnostic optimized to measure the C 2+ impurity ion temperature T i spatial distribution in the divertor plasma of the W7-X stellarator is designed, tested, and validated. Using CIS to obtain T i in the edge of magnetically confined plasmas has historically been challenging because Doppler broadening and Zeeman splitting have comparable effects on the shape of spectral emission lines. To distinguish between these two mechanisms, a novel approach to birefringent crystal design is employed to minimize the diagnostic’s sensitivity to Zeeman splitting. The recently developed pixelated multi-delay CIS approach is also used to obtain four times as much spectral information as traditional CIS approaches. The T i -optimized CIS diagnostic is validated in a long-pulse W7-X plasma by comparison with a high-resolution spectrometer whose sightlines overlap with the CIS field of view. The CIS and spectrometer T i profiles have the same shape and agree to within 10% on average and 25% in the worst case. Images of the T i distribution near the divertor show toroidally elongated bands aligned with the magnetic field, with T i ranging between 10 and 40 eV.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Model-Free Voltage Control of Active Distribution System with PVs Using Surrogate Model-Based Deep Reinforcement Learning

Accurate knowledge of the distribution system topology and parameters is required to achieve good voltage control performance, but this is difficult to obtain in practice. This paper proposes a physical-model-free voltage control method based on a surrogate-model-enabled deep reinforcement learning approach. Specifically, a surrogate model is trained in a supervised manner using the recorded limited number of historical data to learn the relationship between the power injections and voltage fluctuations of each node. Then, the deep reinforcement learning algorithm is applied to learn an optimal control strategy from the experiences obtained by continuous interactions with the surrogate model. The proposed method can achieve physical-model-free control of unbalanced distribution network and inform real-time decisions to deal with fast voltage fluctuations caused by the rapid variation of PV generation. Simulation results on an unbalance IEEE 123-bus system show that the proposed method can achieve similar performance as that of perfect physical-model-based approaches while being advantageous over other traditional methods.

active distribution network↗
DOE OSTI2020

Multistage distributionally robust mixed-integer programming with decision-dependent moment-based ambiguity sets

We study multistage distributionally robust mixed-integer programs under endogenous uncertainty, where the probability distribution of stage-wise uncertainty depends on the decisions made in previous stages. We first consider two ambiguity sets defined by decision-dependent bounds on the first and second moments of uncertain parameters and by mean and covariance matrix that exactly match decision-dependent empirical ones, respectively. For both sets, we show that the subproblem in each stage can be recast as a mixed-integer linear program (MILP). Moreover, we extend the general moment-based ambiguity set in to the multistage decision-dependent setting, and derive mixed-integer semidefinite programming (MISDP) reformulations of stage-wise subproblems. We develop methods for attaining lower and upper bounds of the optimal objective value of the multistage MISDPs, and approximate them using a series of MILPs. We deploy the Stochastic Dual Dynamic integer Programming (SDDiP) method for solving the problem under the three ambiguity sets with risk-neutral or risk-averse objective functions, and conduct numerical studies on multistage facility-location instances having diverse sizes under different parameter and uncertainty settings. Furthermore, our results show that the SDDiP quickly finds optimal solutions for moderate-sized instances under the first two ambiguity sets, and also finds good approximate bounds for the multistage MISDPs derived under the third ambiguity set. We also demonstrate the efficacy of incorporating decision-dependent distributional ambiguity in multistage decision-making processes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Prototype Modeling for a Light-Trapping Planar-Cavity Enclosed Particle Solar Receiver

Concentrating solar thermal (CST) systems present a promising avenue for affordable and reliable energy production. Solar receivers are key components that determine the efficiency and longevity of these systems. Particle-based solar receivers have emerged as a compelling alternative to traditional technologies, offering several advantages that address limitations in current CST systems. This is especially true as next-generation CST technologies target applications including electricity generation, thermochemical processes, and industrial process heat, many of which necessitate higher operating temperatures than current commercial molten salt systems. Molten-salt thermal energy storage (TES) systems, commonly used in CSP, face challenges related to freezing and corrosion. Particle-based TES systems, in contrast, do not experience these issues, as particles are stable at high temperatures, exceeding 1000 degrees Celsius. This capability allows for a wider range of applications, including those requiring higher temperatures for industrial processes and efficient electricity generation. A novel innovation in particle-based solar receiver technology is the light-trapping planar cavity receiver (LTPCR) configuration developed by NREL. The LTPCR design consists of small cavity-like structures using opaque planar surfaces, enabling efficient capture and absorption of solar energy. A high incident flux concentration at the cavity aperture is absorbed on the receiver walls, and subsequently transferred to particles on the inside of cavities. The particles flow through the system, forming a fluidized bed inside of the receiver panels, effectively capturing the absorbed solar heat. Air is used as a fluidizing medium in this process to enhance particle heat transfer and mixing. The effectiveness of this design lies in its ability to manage solar flux conditions and ensure high solar-to-thermal receiver efficiency. A 100-kW prototype is currently being tested at the King Saud University in Saudi Arabia to assess the receiver performance. A range of modeling analyses for the optical, thermal, and mechanical effects were conducted to assess the performance of the receiver under on-sun conditions. The solar flux resulting from the KSU heliostat field was modeled using NREL SolTrace software and produced up to 600 kW/m2 at the receiver aperture. The solar flux absorbed on the receiver walls was then used within a computational fluid dynamics (CFD) model to predict wall temperature distributions along with radiation and convection loss. A two-phase CFD model was developed for the fluidized bed of silica sand inside the receiver panels to predict local wall-to-particle heat transfer coefficients, particle temperature distributions, and outlet temperature of the particles. We have also conducted analyses to understand the thermomechanical behavior of these innovative enclosed light-trapping solar receivers optimized for particle heating. We used finite element analysis (FEA) to predict the receiver's performance using temperature distributions obtained from CFD and based on the resulting stress profiles, evaluated creep-fatigue damage with a goal of achieving a 30-year service life. Analysis showed a significant impact of the particle-to-wall heat transfer coefficients (HTCs) on receiver performance, with higher HTCs resulting in reduced stress and increased lifespan. For instance, when using Inconel 740H, increasing the HTC from 800 W/m2 K to 1400 W/m2 K increased the creep life from 4,000 hours to over 100,000 hours. This highlights the importance of understanding and optimizing heat transfer in the design of high-efficiency receivers.

14 SOLAR ENERGY↗
DOE OSTI2022

Conceptual design of inverted core lead bismuth eutectic fast reactor for marine applications

The development of an inverted core fast reactor aims to generate 60 MWth for about 30 Effective Full Power Years without refueling. The reactor design is a transportable reactor using UO{sub 2} fuel and lead-bismuth-eutectic cooled designed for marine applications and is intended to improve the reactor performances compared to the normal core design: better condition for passive cooling system capability by lower core pressure drop, taking advantage of potential power uprate from the lower maximum fuel temperature. Systematic design processes are presented in this work: fuel pin geometry selection, fuel assembly (FA) design, and core design. A relationship between pressure drops, coolant velocity, maximum fuel temperature, coolant channel diameter, and fuel volume fraction was introduced in a single graph used as a tool to select fuel pin geometry. Fuel fabrication capability also took place in consideration of FA design which led to 7 holes per FA, and two-dimensional temperature distribution studies were also carried out. Core design processes including radial zoning, axial zoning, and core optimization were conducted using Monte Carlo code MCS, which is UNIST CORE laboratory in-house code. The current core design uses 3 fuel enrichment levels and 3 FA types to control the local power distribution and power shift during its lifetime. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Conservation Voltage Reduction with Distributed Energy Resource Management System, Grid-Edge, and Legacy Devices

Distribution utilities use conservation voltage reduction (CVR) to obtain energy savings and lower peak demand by reducing bus voltages. Traditionally, the CVR is accomplished by controlling the legacy assets such as load tap changers, voltage regulators, and capacitor banks. The deployment of the advanced distribution management system (ADMS) and distributed energy resource management system (DERMS) enables the integration of distributed energy resources into the distribution networks and provide the grid services including CVR. This paper studies the coordinated operation of an ADMS and a DERMS in achieving CVR and voltage regulation. A commercial ADMS uses legacy devices and Edge-of-Network Grid Optimization (ENGO) devices to obtain energy savings through CVR. A prototype DERMS dispatches the photovoltaic smart inverters based on real-time optimal power low to ensure voltage regulation across the feeder. The results show that the coordinated operation of ADMS and DERMS is effective in achieving CVR and voltage regulation. Specifically, energy savings of up to 4.7% are observed in the real utility distribution system used in this study.

advanced distribution management system↗
DOE OSTI2023

Conservation Voltage Reduction with Distributed Energy Resource Management System, Grid-Edge, and Legacy Devices

Distribution utilities use conservation voltage reduction (CVR) to obtain energy savings and lower peak demand by reducing bus voltages. Traditionally, the CVR is accomplished by controlling the legacy assets such as load tap changers, voltage regulators, and capacitor banks. The deployment of the advanced distribution management system (ADMS) and distributed energy resource management system (DERMS) enables the integration of distributed energy resources into the distribution networks and provide the grid services including CVR. This paper studies the coordinated operation of an ADMS and a DERMS in achieving CVR and voltage regulation. A commercial ADMS uses legacy devices and Edge-of-Network Grid Optimization (ENGO) devices to obtain energy savings through CVR. A prototype DERMS dispatches the photovoltaic smart inverters based on real-time optimal power low to ensure voltage regulation across the feeder. The results show that the coordinated operation of ADMS and DERMS is effective in achieving CVR and voltage regulation. Specifically, energy savings of up to 4.7% are observed in the real utility distribution system used in this study.

advanced distribution management system↗
DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Correcting the PFNS for more consistent fission modeling

For FY20, we had a deliverable to write a report detailing efforts to simultaneously evaluate both the prompt neutron multiplicity, $\overline{ν}$, and the prompt neutron fission neutron spectrum, PFNS, using CGMF. CGMF is the LANL-developed fission fragment decay code that consistently evaporates prompt neutrons and γ rays using the Hauser-Feshbach statistical theory of compound reactions. The decay begins by constructing the initial conditions of the fission fragments, then decaying each one from the excited state by neutrons and γ rays, conserving energy, momentum, spin, and parity in each step of the emission. The initial conditions of the fragments, along with the multiplicity, energy, and direction of each emitted neutron or γ ray, are recorded, allowing for the full reconstruction of the fission event. These event histories allow us to reconstruct average quantities, as well as correlations between observables, that can be compared with experimental or evaluated data. In that initial report, although there was already a favorable comparison between $\overline{ν}$ from CGMF, experiment, and the current ENDF/B-VIII.0 evaluation, we showed that there was still significant work to be done to improve the PFNS from CGMF. Historically, the PFNS is calculated too soft by Hauser-Feshbach fission models, and CGMF is no exception. The incorrect shape presents a significant challenge in fission modeling, including for our understanding of the fission process and for our ability to consistently calculate and predict a variety of prompt fission observables (such as fission fragment initial conditions, neutron and γ-ray multiplicities and energies, and the correlations between all observables). In our companion report, we detail our success in using CGMF to evaluate $\overline{ν}$. Although not included in the optimization explicitly, we also keep the initial conditions of the fission fragments physical, along with reproducing reasonably well the neutron multiplicity distribution. As we would expect from the sensitivities calculations from, the average neutron energies change very little from the $\overline{ν}$ optimization along with the PFNS (as will be shown in Sec. 2.6). The conclusion was that the global and statistical models would have to be investigated instead of just the fission fragment initial conditions (as is sufficient for $\overline{ν}$). This report details those efforts.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Per-Phase and 3-Phase Optimal Coordination of Directional Overcurrent Relays Using Genetic Algorithm

Penetration of the power grid by renewable energy sources, distributed storage, and distributed generators is becoming increasingly common. Increased utilization of these distributed energy resources (DERs) has given rise to additional protection coordination concerns, particularly where they are utilized in an unbalanced manner or where loading among phases is unbalanced. Digital relays such as the SEL-751 (produced by Schweitzer Engineering Laboratories, Pullman, WA, USA) series have the capability of being set on a per-phase basis. This capability is underutilized in common practice. Additionally, in optimization algorithms for determining relay settings, the time-overcurrent characteristics (TOCs) of relays are generally not treated as variables and are assigned before running the optimization algorithm. In this paper, TOC options themselves are treated as discrete variables to be considered in the optimization algorithm. A mixed integer nonlinear programming problem (MINLP) is set up where the goal is to minimize relay operating times. A genetic algorithm (GA) approach is implemented in MATLAB where two cases are considered. In the first case, the TOC and Time dial setting (TDS) of each relay is set on a three-phase basis. In the second case, per-phase settings are considered. Relay TDSs and TOCs are both considered as simultaneous discrete control variables. Despite the stochastic nature of using per-phase settings for unbalanced systems is found to generally allow for shorter operating times. However, for relatively balanced systems, it is best to use three-phase settings if computation time is of importance.

Matthews, Ronald C.↗
DOE OSTI2022

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Data-driven Minimum Entropy Control for Stochastic Nonlinear Systems using the Cumulant-Generating Function

Here, we present a novel minimum entropy control algorithm for a class of stochastic nonlinear systems subjected to non-Gaussian noises. The entropy control can be considered as an optimization problem for the system randomness attenuation, but the mean value has to be considered separately. To overcome this disadvantage, a new representation of the system stochastic properties was given using the cumulant-generating function based on the moment-generating function, in which the mean value and the entropy was reflected by the shape of the cumulant-generating function. Based on the samples of the system output and control input, a time-variant linear model was identified, and the minimum entropy optimization was transformed to system stabilization. Then, an optimal control strategy was developed to achieve the randomness attenuation, and the boundedness of the controlled system output was analyzed. The effectiveness of the presented control algorithm was demonstrated by a numerical example. In this paper, a data-driven minimum entropy design is presented without pre-knowledge of the system model; entropy optimization is achieved by the system stabilization approach in which the stochastic distribution control and minimum entropy are unified using the same identified structure; and a potential framework is obtained since all the existing system stabilization methods can be adopted to achieve the minimum entropy objective.

42 ENGINEERING↗