Benchmarked: Optimization Meets Machine Learning

- This workshop is organized online -

9 - 13 November 2020

Venue: Lorentz Center@Oort

If you are invited or already registered for this workshop, you have received login details by email.

This week we organize an online kick-off. The physical workshop will be rescheduled to 2022.

Description
The dramatic increase of computational resources, the availability of enormous data, and the significant advances in machine learning and artificial intelligence are currently shaking up our societies. As part of this change, our use of technology is evolving at a fast pace, with lasting effects on our traditional routines. Decisions that always required considerable expert knowledge can suddenly be taken (or be prepared) by automated procedures. This automation does not only support manual work, but it also drastically changes the objectives of various research domains, including Computer Science itself.

In the Benchmarked: Optimization Meets Machine Learning workshop we will discuss the impact of automated decision-making on an important sub-domain: heuristic optimization. More specifically, we will discuss how the possibility to automatically select and configure optimization heuristics changes the requirements for their benchmarking.

The key objectives of this Lorentz Center workshop are: 

  • to develop a joint vision on the next generation of benchmarking optimization heuristics in the context of automated algorithm selection and configuration, and
  • to design a clear road-map guiding the research community towards this vision.

The workshop brings together researchers from different sub-domains in optimization heuristics with colleagues from automated machine learning. Together we will discuss what an ideal benchmarking environment would look like, how such an ``ideal tool'' compares to existing software, and how we can close the gap by improving the compatibility between ongoing and future projects.

Concretely, we aim at designing a full benchmarking engine that ranges from modular algorithm frameworks over problem instance generators and landscape analysis tools to automated algorithm configuration and selection techniques, all the way to a statistically sound evaluation of the experimental data.

Read more...

    Monday 9 November

    09:3010:00 Virtual Coffee (- get together)
    10:0010:20 Workshop opening
    10:2010:50 5 short Presenations and Discussions (details tba)
    10:5011:00 Break
    11:0011:30 Open Discussion
    11:3012:00 

    5 short Presenations and Discussions (details tba)

    12:0013:30 

    Lunch break (get together tbd)

    13:3014:30 Breakout session
    14:3015:00 Feedback from Breakout sessions and Open Discussion
    15:0015:30 5 short Presenrations and Discussions (details tba)
    15:3016:30 Virtual Coffee (- get together) and/or individual discussions
    20:3022:00 "Wine and cheese party" (=virtual get together)

    Tuesday 10 November

    09:3010:00 Virtual Coffeee (= get together)
    10:0010:40 Invited Presentation by Frank Hutter (25+15) 'Automated Algorithm Selection and Configuration
    10:4011:10 5 short Presentations and Discussions (details tba)
    11:1011:20 Break
    11:2012:00 7 Short Presentations and Discussions (details tba)
    12:0013:30 Lunch break (get together tbd)
    13:3015:00 Breakout Sessions
    15:0015:30 Feedback from Breakout Sessions and Open Discussion
    15:3016:30 Virtual Coffee (= get together) and/or individual Discussion

    Wednesday 11 November

    09:3010:00 Virtual Coffee (= get together)
    10:0010:40 Invited Presentation by Nikolaus Hansen '10 Years of Benchmartking with COCO/BBOB'
    10:4011:20 Invited Presentation by Manuel lópez-Ibáñes 'Benchmarking combinatorial' Optimization Algorithms
    11:2012:00 Plenary discussion or breakouts
    12:0013:30 Lunch break ( get together tbd)
    13:3015:30 Breakouts or plenary discussions (details tba)
    15:3016:30 Virtual Coffee (= get together) and/or individual discussions

    Thursday 12 November

    Possibility for group work 

    09:3010:00 Virtual Coffee (= get together)
    10:0018:00 Individual discussions and group work. Plenary sessions tbd

    Friday 13 November

    Possibility for group work

    09:3010:00 Virtual Coffee ( = get together)
    10:0018:00 Individual discussions and group work. Plenary sessions tbd
    Please log in to view the participants information...

    Carola Doerr, CNRS and Sorbonne University  

    Thomas Stützle, Université Libre de Bruxelles (ULB)  

    Mike Preuss, Leiden University  

    Marc Schoenauer, INRIA Saclay  

    Joaquin Vanschoren, Eindhoven University of Technology  


Michelle Grandia

+31 71-5275579

grandia@lorentzcenter.nl

Follow us on:

Niels Bohrweg 1 & 2

2333 CA Leiden

The Netherlands

+31 71 527 5400