Maximizing GPU usage with MIGs, MPS, and time-Slicing [online, CIP203]

Unlock the full potential of your GPU resources! Learn resource-sharing techniques to transform how you use your GPUs. Maximize your computational efficiency through the use of fractional GPUs or by sharing resources between multiple jobs and tasks. This hands-on workshop is particularly essential for users of powerful H100 systems, as poor GPU utilization leads to wasted resources, lower job priority, and potential job termination.

Prerequisites

• Know the basics of the Linux command line or have completed the workshop “Introduction to the Linux Command Line (LNX101)”
• Know the basics of submitting jobs to a compute cluster or have completed the workshop “First steps on supercomputers (CIP101)"
• Know how to identify and correct inefficient jobs or have completed the workshop “Benefits of using computing resources effectively (CIP102)“
• Have a general understanding of GPUs and basic experience in running GPU tasks

Agenda

• Why bother maximizing GPU usage
• How to waste GPU cycles
• CUDA streams
• Wasting less GPU resources with the MIGs
• Sharing one GPU between multiple tasks with the MPS
• TimeSlicing
• Lots of exercises (executing jobs on the cluster, running tests, measuring execution times, etc)

Registration

• Academic: $10 (anyone who studies, teaches, or works at a university, CEGEP, CCTT, or university-affiliated research institute)
• NPO: $10 (anyone who works for a non-profit organization)
• Other: $250 (any other profile)

Instructor

Nikolaï Sergueev, analyst in advanced research computing at Calcul Québec.

Language

English

Technical prerequisites

We will use the Zoom platform. Because this event is a practical workshop, it is very useful having a secondary screen where you would get the instructor window on one screen and your own window on your main screen.

We will use the Jupyter Lab interface. Make sure you have a modern Web browser like Google Chrome, Firefox, Edge or Safari.

Notes

• A certificate of participation will be send to each participant who attends at least 60% of the workshop.
• The workshop is not recorded.
• The workshop could be canceled if the number of registrations is too low.

Contact

For any question, please write us to training@calculquebec.ca

To stay up to date on our upcoming events, subscribe to our Eventbrite page!