Running Jobs on RCC Systems Using the Slurm Workload Manager

Research Computing Center

Running Jobs on RCC Systems Using the Slurm Workload Manager and Best Practices

John Crerar Library - Kathleen A. Zar Room

The Research Computing Center (RCC) provides the University of Chicago community with access to high-end computing, data storage, and visualization resources, as well as a wide variety of software packages, workshops, and one-on-one consulting by computational scientists.  The RCC Midway high-Performance computing (HPC) ecosystem includes a range of cross-mounted systems, such as the Midway2 (Shared Nodes, DaLI, GM4), Midway3 (Shared Nodes, MidwaySSD, Beagle3); the MidwayR for restricted or sensitive data in the Secure Data Enclave; and the Skyway platform for seamless access to commercial cloud resources like Amazon Web Services (AWS) and Google Cloud Platform   (GCP). This hands-on workshop will introduce participants to the computational resources and services available at the RCC.  What we'll cover: <ul><li>Overview of RCC programs and services, including the Cluster Partnership Program (CPP), Consultant Partnership Program (ConPP), grant support, and the affiliate program with Argonne. </li><li>Key differences between Midway2 and Midway3 compute and storage ecosystems. </li></ul><ul><li> File transfer techniques within Midway systems and between external locations (e.g.: personal PCs, lab computers, and other clouds)  using SFTP, SCP, Globus, and SMB.</li><li><ul><li>Transferring files within and between Midway2 and Midway3 ecosystems.</li><li>Introduction to the Secure Data Enclave (SDE) for handling sensitive research data.</li></ul></li></ul><ul><li>Running jobs interactively and in the queue using the SLURM job scheduler.</li><li><ul><li>Creating and running jobs using SLURM.</li><li>Leveraging the Skyway platform to access and use cloud resources.</li></ul></li><li>Policies regarding computing resource usage (QoS) and data storage (quota).</li><li><ul><li>Understanding the concept of Service Units (SU) allocations.</li></ul></li></ul> What you'll learn from the workshop: By the end of the workshop, participants will be able to:<ul><li>Differentiate between Midway2 and Midway3 computing and storage ecosystems.</li><li>Execute Linux commands proficiently on Midway clusters.</li><li>Manage and transfer data effectively within the Midway ecosystem and with external systems. </li><li>Run jobs interactively and via batch scripts using SLURM. </li><li>Understand RCC policies on computing resource usage (QoS) and data storage (quotas).</li><li>Perform file transfers within Midway ecosystems and with external locations.</li><li>Access RCC programs and services, including grant support, Cluster Partnership Program (CPP), Consultant Partnership Program (ConPP), and the Affiliate Program with Argonne. </li></ul> Level: Introductory Duration: 2 hours Prerequisites: None

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Running Jobs on RCC Systems Using the Slurm Workload Manager

More events from Research Computing Center

Discover more events from Research Computing Center, from Science & Tech to other experiences you might love.

Running Jobs on RCC Systems Using the Slurm Workload Manager

More events from Research Computing Center

Discover more events from Research Computing Center, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.