High-Throughput Computation on the Open Science Grid and AWS, RMACC17
Aug 17, 2017
8:30 am - 12:00 Noon
Instructors: Benedikt Riedel, Mats Rynge
Helpers: Suchandra Thapa, Rob Gardner
General Information
The Open Science Grid provides a fabric of services to enable distributed, high-throughput computing capabilities across the US. In general, OSG is organized into VOs (Virtual Organizations) around large experiments, but individual PIs and groups too small for the VO model can use the hosted services provided by OSG Connect.
The format of this tutorial is a mix of lecture and hands-on exercises, so please bring your laptop and make sure you have an SSH client installed.
The goal of this session is to learn how to run and scale up workloads, manage your data and also spill over into Amazon cloud resources. Topics to include: Introduction to the OSG; Job Scheduling with HTCondor; Scaling Up Workloads; High throughput submission to Amazon cloud
Instructors: Benedikt Riedel, Mats Rynge
Helpers: Suchandra Thapa, Rob Gardner
Where: N129.
Requirements: Participants must bring a laptop with a few specific software packages installed (see Setup).
Contact: Please mail user-support@opensciencegrid.org for more information.
Conference: https://www.rmacc.org/hpcsymposium
Registration
Space is limited for the event. To register, please visit here .
Schedule
High-Throughput Computation on the Open Science Grid and AWS
August 17th, 8:30 AM - 12:00 Noon
Location: TBD
Instructors: TBD
| 08:30 - 08:45 | Introduction to OSG [Slides] |
| 08:45 - 09:30 | Job Scheduling with HTCondor |
| 09:30 - 10:00 | Large scale Computation with HTCondor |
| 10:00 - 10:30 | Coffee break |
| 10:30 - 11:50 | Adding Resources from Amazon AWS [Slides] |
| 11:50 - 12:00 | Wrap up, survey and account signups |
Setup Instructions
Instructions to set up the required software on Linux, Windows and Mac laptops