Engineering Papers⌕ Search

Engineering topics

Bai, Linquan

Publications and source records attributed to Bai, Linquan.

5 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Federated Deep Reinforcement Learning for Decentralized VVO of BTM DERs

The future of grid control requires a hybrid approach combining centralized and decentralized methods to fully utilize the potential of smart edge devices with artificial intelligence (AI) capabilities. This paper aims to develop and evaluate a federated deep reinforcement learning (FDRL) framework for decentralized adaptive volt-var optimization (VVO) of behind-the-meter (BTM) distributed energy resources (DERs). First, this paper models a single deep reinforcement learning (DRL) agent using the Markov Decision Process (MDP) framework for decentralized adaptive VVO of BTM DERs. Two DRL algorithms, soft actor-critic (SAC) and twin-delayed deep deterministic policy gradient (TD3), are compared for their effectiveness in optimizing VVO. Results show that TD3 outperforms SAC, achieving a 71.3% improvement in mean reward. Finally, the DRL agent is deployed within the FDRL framework, using the Flower platform, to enhance learning, provide adaptive control, and ensure data privacy for BTM DERs.

Ravi, Abhijith↗
DOE OSTI2024

Towards the Flexibility of HVDC-Interconnected Systems: A Novel Emergency Freqeuncy Response Model

In this paper, we propose a novel multi-time scale emergency frequency response model by unlocking the flexibility of High Voltage Direct Current (HVDC) systems. Unlike assigning power ramping rates for FACTS to regulate frequency in traditional methods, this paper designs a step-change electromagnetic power frequency response (EPFR) scheme, by leveraging the temporal over/under DC voltage capability of HVDC. Wherein the Kullback-Leibler Divergence is adopted to convexify the modified swing equation after integrating the step-change power. Further, to avoid the complicated differential equations, we equivalently reformulate the duration limits of DC voltage deviation into the HVDC decreasing power ramping rates, which participate in the system primary frequency response. Finally, the new steady-state operation level of HVDC is involved with the secondary frequency response. As a result, an improved three-level algorithm is developed to solve the model, wherein the instant step-change, primary, and secondary frequency response are coordinated together. After applying the proposed frequency response scheme on the test system, the EPFR is validated to effectively provide the most instantaneous supports when faced with bulk power loss due to extreme contingencies, and the resilience is ensured within acceptable expenditures.

Jiang, Sufan↗
DOE OSTI2024

Impedance-Aware Graph Convolutional Networks for Voltage Estimation in Active Distribution Networks

Voltage estimation plays a key role in ensuring the effective control and reliability of distribution networks. However, traditional machine learning methods often fail to capture the details of the distribution network’s topology. To overcome this challenge, graph convolutional networks (GCN) have emerged as an alternative. Graph convolutional networks inherently capture the topology of the grid, utilizing correlations to achieve precise voltage estimation. Other machine learning models and conventional GCNs fail to account for the distribution line characteristics found in the real world, limiting their effectiveness. This paper proposes an advanced variant of GCN called the Impedance-Aware Graph Convolutional Network (IA-GCN). The IA-GCN layer incorporates the magnitude of the impedance into the graph convolution mechanism, allowing it to capture topological nuances and provide valuable insights into node interrelationships by considering impedance as an intrinsic dimension. The performance of the IA-GCN layer is then compared with that of GCN and GraphSAGE layers through a surrogate model for voltage estimation. The performance analysis demonstrates that IA-GCN outperforms GCN by reducing the MAE by 87.55% and improving the R-squared value by 98%.

Ravi, Abhijith↗
DOE OSTI2024

Multi-Edge Graph Convolutional Networks for Power Systems

The exponential electrification of transportation has contributed to highly intermittent load variations in the distribution grid. This uncertainty has raised challenges for distribution system operation and control. Accurate nodal voltage estimation is highly essential for the safe and reliable operation of the grid. Graph convolutional networks have been used in machine-learning-based models for power grid applications like voltage estimation for their ability to capture the network topology of the grid. This paper presents a novel multi-edge graph convolutional layer that considers resistance and reactance as edge attributes. This layer is created by modifying the message-passing function within the graph convolutional network. The novel layer is then used to create a multi-edge graph convolutional network-based surrogate model for estimating voltage in the distribution network with highly uncertain electric vehicle loads. Results indicate improved performance of the multi-edge graph convolutional network model when compared to a standard graph convolutional network model.

Ravi, Abhijith↗