Abstract

Conventionally, a virtual synchronous generator (VSG) is designed for islanded mode (IM) operation to meet specific operational requirements such as the rate of change of frequency (RoCoF). However, the operation of VSG designed for IM may not meet the operational and control criteria in grid connected mode (GCM) when the grid conditions vary. In addition, conventional VSG control technology does not consider the influence of the presynchronization scheme when connected to a weak grid, which degrades the RoCoF in IM. To overcome the aforementioned challenges, the proposed study presents a twin-delayed deep deterministic policy gradient (TD3) algorithm to improve the seamless transition performance of VSG from IM to GCM and vice versa. In the first step, the VSG-based power system model is used as a foundation for problem formulation of the proposed TD3 algorithm. Secondly, a reward function is designed according to the performance requirements, i.e., frequency and RoCoF requirements, of the VSG in order to guide the training of the agent in varying load, power reference, and grid conditions. Finally, the superiority of the proposed algorithm over existing methods is validated in MATLAB/SIMULINK and RTDS based real-time simulation environment.

Department(s)

Electrical and Computer Engineering

Comments

U.S. Department of Defense, Grant EW20-5331

Keywords and Phrases

Data-driven control; deep reinforcement learning; grid conditions; microgrid; virtual synchronous generator (VSG)

International Standard Serial Number (ISSN)

1937-4208; 0885-8977

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2025 Institute of Electrical and Electronics Engineers, All rights reserved.

Publication Date

01 Jan 2025

Download

Full Text Link

Share

 
COinS