Automated Metaheuristic Algorithm Design With Autoregressive Learning

Qi Zhao1; Tengfei Liu1; Bai Yan2; Qiqi Duan1; Jian Yang1; Yuhui Shi1

2024

10.1109/TEVC.2024.3464677

IEEE Transactions on Evolutionary Computation   影响因子和分区

1941-0026

Automated design of metaheuristic algorithms offers an attractive avenue to reduce human effort and gain enhanced performance beyond human intuition. Current automated methods design algorithms within a fixed structure and operate from scratch. This poses a clear gap towards fully discovering potentials over the metaheuristic family and fertilizing from prior design experience. To bridge the gap, this paper proposes an autoregressive learning-based designer for automated design of metaheuristic algorithms. Our designer formulates metaheuristic algorithm design as a sequence generation task, and harnesses an autoregressive generative network to handle the task. This offers two advances. First, through autoregressive inference, the designer generates algorithms with diverse lengths and structures, enabling to fully discover potentials over the metaheuristic family. Second, prior design knowledge learned and accumulated in neurons of the designer can be retrieved for designing algorithms for future problems, paving the way to continual design of algorithms for open-ended problem-solving. Extensive experiments on numeral benchmarks and real-world problems reveal that the proposed designer generates algorithms that outperform all human-created baselines on 24 out of 25 test problems. The generated algorithms display various structures and behaviors, reasonably fitting for different problem-solving contexts. Code is available at https://github.com/auto4opt/ALDeshttps://github.com/auto4opt/ALDes.

第一

1.Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
2.Research Institute of Trustworthy Autonomous Systems, Southern University of Science and Technology, Shenzhen, China

Qi Zhao,Tengfei Liu,Bai Yan,et al. Automated Metaheuristic Algorithm Design With Autoregressive Learning[J]. IEEE Transactions on Evolutionary Computation,2024,PP(99).

Qi Zhao,Tengfei Liu,Bai Yan,Qiqi Duan,Jian Yang,&Yuhui Shi.(2024).Automated Metaheuristic Algorithm Design With Autoregressive Learning.IEEE Transactions on Evolutionary Computation,PP(99).

Qi Zhao,et al."Automated Metaheuristic Algorithm Design With Autoregressive Learning".IEEE Transactions on Evolutionary Computation PP.99(2024).