Our paper has been accepted to The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS 2026) Evaluations and Datasets Track. This paper introduces BBOWP-Bench, a benchmark for evaluating the ability of large language models to design search spaces and select optimization algorithms for black-box optimization problems described in natural language.
Yutaro Yamada, Kei Hiroshima, Nozomu Yoshinari, Kento Uchida, and Shinichi Shirakawa: BBOWP-Bench: Evaluating LLMs on Black-Box Optimization Word Problems, The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS 2026) Evaluations and Datasets Track, Sydney, Australia, December 6-12, 2026. (Accepted) [arXiv] [Code]