Non-cooperative coupled microgrid-transportation coordination system: A deep deterministic policy gradient-based approach

Zhang, Shiyao1; Zhu, Xingzheng1; Zhang, Shengyu2; Yu, James J. Q.3

2024-09-01

10.1016/j.ijepes.2024.110092

INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS   影响因子和分区

0142-0615

1879-3517

The cooperation between multiple microgrids (MGs) take a substantial role in enabling the process of information and energy exchange, which can increase the reliability of multi-microgrid (MMG) systems. Since MGs tend to be selfish in real-world operations, it is vital to address the way to motivate MGs to cooperate efficiently in MMG systems. In addition, considering the participated connected electric vehicles (CEVs) in CMT systems, the synergy between the MG-transportation coupled networks shall be accounted. In this paper, we propose a Stackelberg game theoretic approach for the non-cooperative coupled microgrid-transportation (CMT) system by exploiting connected electric vehicles (CEVs). This formulated game can jointly trigger the MG energy trading and vehicle-to-grid coordination schemes in the system. To solve the CMT game with imperfect information, a Markov Decision Process (MDP) and a deep deterministic policy gradient-based methods are developed. The devised algorithm can learn a deterministic optimal response from the opponents. The game's Nash equilibrium can be approximately converged when the game is with imperfect information. Simulation results show that the proposed model can guarantee the effectiveness of the energy trading process in the CMT system. In addition, through the efficient CEV coordination strategies, the V2G regulation service is provided efficiently while it can further alleviate the grid power fluctuations. Furthermore, large economic benefits can be achieved under the CMT system.

Coupled microgrid-transportation system Connected electric vehicles Deep deterministic policy gradient Markov decision process Microgrid Non-cooperative system

SCI ; EI

英语

第一

Stable Support Plan Program of Shenzhen Natural Science Fund, China[2022081511 1111002]

Engineering

Engineering, Electrical & Electronic

WOS:001265619800001

ELSEVIER SCI LTD

20242716646607

Electric vehicles ; Game theory ; Power markets ; Vehicle-to-grid

Electric Power Systems:706.1 ; Probability Theory:922.1

ENGINEERING

Web of Science

1.Southern Univ Sci & Technol, Res Inst Trustworthy Autonomous Syst, Shenzhen 518055, Peoples R China
2.Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore 487372, Singapore
3.Univ York, Dept Comp Sci, Heslington YO10 5GH, England

Zhang, Shiyao,Zhu, Xingzheng,Zhang, Shengyu,et al. Non-cooperative coupled microgrid-transportation coordination system: A deep deterministic policy gradient-based approach[J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS,2024,160.

Zhang, Shiyao,Zhu, Xingzheng,Zhang, Shengyu,&Yu, James J. Q..(2024).Non-cooperative coupled microgrid-transportation coordination system: A deep deterministic policy gradient-based approach.INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS,160.

Zhang, Shiyao,et al."Non-cooperative coupled microgrid-transportation coordination system: A deep deterministic policy gradient-based approach".INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS 160(2024).