Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times

Ming Chen1; Yonghao Du1; Ke Tang2; Lining Xing3; Yuning Chen1; Yingwu Chen1

2024

10.1109/TSMC.2024.3411640

IEEE Transactions on Systems, Man, and Cybernetics: Systems   影响因子和分区

2168-2232

The agile earth observation satellite scheduling problem (AEOSSP) with time-dependent transition times is a complex combinational optimization problem that has emerged from the development of large-scale satellite management techniques. To address this problem, we propose a deep reinforcement learning-based construction model (DRL-CM) that consists of five parts: 1) a Markov decision process (MDP); 2) a feature engineering; 3) a constructive heuristic neural network (CHNN); 4) an RL training method; and 5) an evaluation system. Specifically, the CHNN comprises six modules containing three special components that we propose: a dynamic encoder, a dynamic global layer, and a two-stage attention layer. First, we build the MDP of the AEOSSP and the feature engineering with effective features required for decision-making. Second, we design the CHNN to function as the MDP policy and train it with an RL model. Finally, we propose a comprehensive evaluation system for the validation of our model. The experimental results indicate that the proposed DRL-CM outperforms the state-of-the-art algorithm in terms of both optimization speed and quality. In addition, the feature engineering and network architecture built in our model are verified to be effective in comprehensive experiments.

SCI

其他

1.College of Systems Engineering, National University of Defense Technology, Changsha, China
2.Department of Computer Science and Engineering and the Research Institute of Trustworthy Autonomous Systems, Southern University of Science and Technology, Shenzhen, China
3.College of Electronic Engineering, Xidian University, Xi’an, China

Ming Chen,Yonghao Du,Ke Tang,et al. Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems,2024,PP(99).

Ming Chen,Yonghao Du,Ke Tang,Lining Xing,Yuning Chen,&Yingwu Chen.(2024).Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times.IEEE Transactions on Systems, Man, and Cybernetics: Systems,PP(99).

Ming Chen,et al."Learning to Construct a Solution for the Agile Satellite Scheduling Problem With Time-Dependent Transition Times".IEEE Transactions on Systems, Man, and Cybernetics: Systems PP.99(2024).