Local Sensing based Multi-agent Pursuit-evasion with Deep Reinforcement Learning

Shaoxin Wang1; Bo Wang1; Zhimin Han1; Zhiyun Lin2

10.1109/CAC57257.2022.10055841

2022

2688-092X

978-1-6654-6534-2

2022 China Automation Congress (CAC)

6748-6752

25-27 Nov. 2022

Xiamen, China

In this paper, a problem of multi-agent pursuit-evasion in which multiple pursuers try to round up a single evader as soon as possible in a 2D limited space is considered. A cooperative approach of pursuit strategy through sensing among pursuits is developed under the multi-agent deep deterministic policy gradient (MADDPG) reinforcement learning (RL) method, which adopts the centralized training and distributed execution to deal with the pursuit problem by a fully distributed approach. Instead of using the communication information, each pursuer is supposed that can only obtain the sensing information of its neighbors and the evader. By introducing the sensing range segment and relative-position average strategy, we allow that the number of the pursuer can be changeable, which is different from some existing results that assume that the number of pursuers is fixed. To demonstrate the feasibility of the proposed method above, we implement it in a simulation environment. Simulation results show that the pursuer can learn a highly cooperative control strategy and capture the evader with a high success rate.

multi-agent pursuit-evasion reinforce learning

其他

IEEE

1.School of Automation (Artifical Intellengence), Hangzhou Dianzi University, Hangzhou, China
2.Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, China

Shaoxin Wang,Bo Wang,Zhimin Han,et al. Local Sensing based Multi-agent Pursuit-evasion with Deep Reinforcement Learning[C],2022:6748-6752.