Predicting CMA-ES Operators as Inductive Biases for Shape Optimization Problems

Friess，Stephen1; Tino，Peter1; Menzel，Stefan2; Sendhoff，Bernhard2; Yao，Xin1,3

10.1109/SSCI50451.2021.9660001

2021

IEEE Symposium Series on Computational Intelligence (IEEE SSCI)

978-1-7281-9049-5

2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021)

01-07

DEC 05-07, 2021

null,null,ELECTR NETWORK

345 E 47TH ST, NEW YORK, NY 10017 USA

IEEE

Domain-dependent expertise knowledge and high-level abstractions to arbitrate between different problem domains can be considered to be essential components of how human problem-solvers build experience and reuse it over the course of their lifetime. However, replicating it from an algorithmic point of view is a less trivial endeavor. Existing knowledge transfer methods in optimization largely fail to provide more specific guidance on specifying the similarity of different optimization problems and the nature of complementary experiences formed on them. A more rigorously grounded approach can be found alternatively in metalearning. This notion neglects any hurdles on characterizing problem similarity in favor of focusing instead on methodology to form domain-dependent inductive biases and mechanisms to arbitrate between them. In principle, we proposed within our previous research methods for constructing inductive biases and predict these from procedural optimization data. However, while we obtained effective methodology, it does not allow the joint construction of predictive components and biases in a cohesive manner. We therefore show in our following study, that improved configurations can be derived for the CMA-ES algorithm which can serve as inductive biases, and that predictors can be trained to recall them. Particularly noteworthy, this scenario allows the construction of predictive component and bias iteratively in a joint manner. We demonstrate the efficacy of this approach in a shape optimization scenario, in which the inductive bias is predicted through an operator configuration in a problem-specific manner during run-time.

Inductive Biases Algorithm Configuration Operator Representation Design Optimization

其他

英语

CPCI-S ; EI

European Union[766186]

Computer Science ; Engineering ; Operations Research & Management Science ; Mathematics

Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Operations Research & Management Science ; Mathematics, Applied

WOS:000824464300181

20221011761329

Iterative methods ; Shape optimization

Computer Applications:723.5 ; Information Retrieval and Use:903.3 ; Optimization Techniques:921.5 ; Numerical Methods:921.6

2-s2.0-85125760826

Web of Science

1.University of Birmingham,CERCIA,School of Computer Science,United Kingdom
2.Honda Research Institute Europe,Offenbach,Germany
3.Southern University of Science and Technology,Shenzhen,China

Friess，Stephen,Tino，Peter,Menzel，Stefan,et al. Predicting CMA-ES Operators as Inductive Biases for Shape Optimization Problems[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2021:01-07.