18–20 Sept 2024
Europe/Vienna timezone

Optimizing Google Search and beyond with pluggable scheduling

18 Sept 2024, 11:40
20m
"Hall L1" (Austria Center)

"Hall L1"

Austria Center

135
Sched-Ext: The BPF extensible scheduler class MC Sched-Ext: The BPF extensible scheduler class MC

Speakers

Barret Rhoden (Google) Josh Don (Google)

Description

A look at some of the BPF based policies we've developed that are currently running (or will soon be running), large chunks of Google's infrastructure. The focus of the talk will be on some of the scheduling design choices, how they differ from CFS, and what we've learned along the way. We'll discuss how these changes may inspire CFS or other pluggable schedulers. For example, one key tradeoff we've been able to make is to represent scheduling entities more strongly at the group level, rather than treat everything as independent threads (which CFS must do). This gives better grouping properties for keeping jobs constrained on shared server environment.

Co-authors

Barret Rhoden (Google) Josh Don (Google)

Presentation materials