Hybridizing Target- and SHAP-Encoded Features for Algorithm Selection in Mixed-Variable Black-Box Optimization

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

Exploratory landscape analysis (ELA) is a well-established tool to characterize optimization problems via numerical features. ELA is used for problem comprehension, algorithm design, and applications such as automated algorithm selection and configuration. Until recently, however, ELA was limited to search spaces with either continuous or discrete variables, neglecting problems with mixed variable types. This gap was addressed in a recent study that uses an approach based on target-encoding to compute exploratory landscape features for mixed-variable problems. In this work, we investigate an alternative encoding scheme based on SHAP values. While these features do not lead to better results in the algorithm selection setting considered in previous work, the two different encoding mechanisms exhibit complementary performance. Combining both feature sets into a hybrid approach outperforms each encoding mechanism individually. Finally, we experiment with two different ways of meta-selecting between the two feature sets. Both approaches are capable of taking advantage of the performance complementarity of the models trained on target-encoded and SHAP-encoded feature sets, respectively.

Details

OriginalspracheEnglisch
TitelParallel Problem Solving from Nature – PPSN XVIII
Redakteure/-innenMichael Affenzeller, Stephan M. Winkler, Anna V. Kononova, Thomas Bäck, Heike Trautmann, Tea Tušar, Penousal Machado
Seiten154–169
Seitenumfang16
ISBN (elektronisch)978-3-031-70068-2
PublikationsstatusVeröffentlicht - 7 Sept. 2024
Peer-Review-StatusJa

Publikationsreihe

ReiheLecture Notes in Computer Science
Band15149
ISSN0302-9743

Externe IDs

Scopus 85204586637

Schlagworte

Schlagwörter

  • Automated Algorithm Selection, Mixed-Variable Optimisation, SHAP