RCC Users can run jobs either interactively or by submitting jobs to be scheduled to run on allocated resources (CPU time, memory, etc.) by a resource manager. The RCC uses SLURM (Simple Linux Utility for Resource Management) to manage workloads on its compute clusters (Midway and MidwayR). In addition to learning the best practices, this workshops will provide users with a clear understanding of all the compute partitions available at the RCC to which a job can be submitted to, how to configure a Slurm job, to use Slurm commands, to submit a job and how to avoid common mistakes that usually result in a job waiting for a long time in the queue before running or failing to run.

Objectives:

Participants will :

learn the various Midway resources and partitions for running jobs
learn slurm commands, how to create a slurm batch script and how to submit batch jobs
acquire a good understanding of RCC module system and run time environments
how to submit serial single processor and parallel (OpenMP and MPI) multiple processor jobs
how to submit GPU jobs
how to submit a job that is carried on several times by a given code, differing only in the initial value of some high-level parameter for each run ( Slurm job array)
how to pack jobs and schedule independent processes inside a Slurm job allocation
how to submit hybrid jobs, a mix multi-processing (MPI) and multi-threading (OpenMP)
how to request a slurm interactive session
best practices and how to debug your slurm script

Level: Introductory

Duration: 1.5 hours

Github repository: https://github.com/rcc-uchicago/Intro_to_SLURM

Running Jobs on RCC Systems Using the SLURM Batch Scheduler -Best Practices