Effective data management and sharing are essential for researchers using high-end computing systems. This hands-on workshop provides a comprehensive overview of data management and sharing resources on the Midway HPC systems at the Research Computing Center (RCC). Beginning with a review of the Research Data Management cycle, participants will learn the various RCC storage pools, discover the data sharing tools and applications available on Midway systems, and learn how to transfer and store data across platforms.
This workshop will cover key topics such as transferring data to and from Midway, sharing data with external collaborators, implementing data security protocols, and navigating file permissions to ensure secure and efficient data sharing. Additionally, best practices for optimizing resource usage will be discussed.
Objectives:
By the end of this workshop, participants will be able to:
- Understand the different RCC storage pools and their intended use cases.
- Navigate and apply data management and sharing tools on RCC systems and workflows.
- Seamlessly transfer data of any size across platforms while ensuring data integrity and performance.
- To use their own datasets during the hands practice sessions.
- Manage file permissions to control access and optimize data sharing workflows.
Prerequisites:
Basic familiarity with Linux command line is recommended. While an RCC account is not required, having one will enhance the hands-on experience.
Duration:
2 hours
