HPC Carpentry part 1 - Using the shell

General Information

This workshop is an introduction to using high-performance computing systems effectively. We obviously can't cover every case or give an exhaustive course on parallel programming in just two days of teaching time. Instead, this workshop is intended to give students a good introduction and overview of the tools available and how to use them effectively.

By the end of this workshop, students will know how to:

Instructors and helpers

Part 2

The material for the second part of this workshop is available at: https://aniabrown.github.io/hpc-carpentry-WHPC/.


Who: The course is aimed at graduate students and other researchers. You don't need to have any previous knowledge of the tools that will be presented at the workshop.

Where: COM-G12-Main Lewin, Computer Science Department, Regent Court, 211 Portobello St, Sheffield. Get directions with OpenStreetMap or Google Maps.

When: 09:00-17:00, 30 Jan 2020, 09:00-16:00 31 Jan 2020. Add to your Google Calendar.

Requirements: Participants must bring a laptop with a Mac, Linux, or Windows operating system (not a tablet, Chromebook, etc.) that they have administrative privileges on. They should have a few specific software packagesSetup installed. They are also required to abide by Software Carpentry's Code of Conduct

Accessibility: We are committed to making this workshop accessible to everybody. The workshop organizers have checked that:

Contact: Please email mozhgank@nvidia.com for more information.

Getting Started

To get started, follow the directions on the Setup page to ensure you have the bash shell and an SSH client installed.

Pre workshop survey

To help us support you as best as possible during the workshop, we request that you please complete the following pre-course survey. It should only take a few moments.

We will use this collaborative document for chatting, taking notes, and sharing URLs and bits of code.

Course Notes

Course notes are available in pdf form below:


Setup Download files required for the lesson
09:30 1. Why Use a Cluster? Why would I be interested in High Performance Computing (HPC)?
What can I expect to learn from this course?
09:50 2. Connecting to the remote HPC system How do I open a terminal?
How do I connect to a remote computer?
10:20 3. Coffee Break Break
10:50 4. Moving around and looking at things How do I navigate and look around the system?
11:10 5. Writing and reading files How do I create/edit text files?
How do I move/copy/delete files?
11:55 6. Lunch Break Break
12:55 7. Wildcards and pipes How can I run a command on multiple files at once?
Is there an easy way of saving a command’s output?
13:50 8. Scripts, variables, and loops How do I turn a set of commands into a program?
14:45 9. Coffee Break Break
15:15 Finish

The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.