Speakers
Boqun Feng
Gregoire Pean
Jatin Kataria
Description
We would like to share some of the challenges we have encountered in a multi-tenant GPU environment, discuss the solutions we have explored, and gather feedback from the community.
To provide context for the audience, we will start by giving an overview of our multi-tenant architecture. We then plan to discuss several areas where we have encountered challenges, including:
- GPU reset and debugging
- Identifying the problematic tenant session among many concurrent sessions
- Missing resource management capabilities, especially around memory cgroups
- Lock contention in drivers
- Power distribution across different system components
We would like to close the session with an open discussion on the issues and solutions presented. If the right audience is present, we would also like to discuss what a reasonable roadmap could look like for improving Linux support for multi-tenant GPU platforms.