Reinforcement Learning-Based Cooperative Optimal Output Regulation Via Distributed Adaptive Internal Model

Abstract

In this article, a data-driven distributed control method is proposed to solve the cooperative optimal output regulation problem of leader-follower multiagent systems. Different from traditional studies on cooperative output regulation, a distributed adaptive internal model is originally developed, which includes a distributed internal model and a distributed observer to estimate the leader's dynamics. Without relying on the dynamics of multiagent systems, we have proposed two reinforcement learning algorithms, policy iteration and value iteration, to learn the optimal controller through online input and state data, and estimated values of the leader's state. By combining these methods, we have established a basis for connecting data-distributed control methods with adaptive dynamic programming approaches in general since these are the theoretical foundation from which they are built.

Department(s)

Electrical and Computer Engineering

Research Center/Lab(s)

Intelligent Systems Center

Publication Status

Early Access

Keywords and Phrases

Adaptation Models; Adaptive Optimal Control; Cooperative Output Regulation; Distributed Adaptive Internal Model; Multi-Agent Systems; Optimal Control; Power System Dynamics; Regulation; Reinforcement Learning.; Symmetric Matrices; Vehicle Dynamics

International Standard Serial Number (ISSN)

2162-237X; 2162-2388

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2021 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

01 Jan 2021

Link to Full Text

Share

 
COinS