High-Throughput Computation on the Open Science Grid and AWS, AHM-2018
March 22, 2018
9:00 am - 12:30 pm
Instructors: Mats Rynge, Rob Gardner
Helpers: TBD
General Information
The Open Science Grid provides a fabric of services to enable distributed, high-throughput computing capabilities across the US. In general, OSG is organized into VOs (Virtual Organizations) around large experiments, but individual PIs and groups too small for the VO model can use the hosted services provided by OSG Connect.
The format of this tutorial is a mix of lecture and hands-on exercises, so please bring your laptop and make sure you have an SSH client installed.
The goal of this session is to learn how to run and scale up workloads, manage your data and also spill over into Amazon cloud resources. Topics to include: Introduction to the OSG; Job Scheduling with HTCondor; Scaling Up Workloads; High throughput submission to Amazon cloud
Instructors: Mats Rynge, Rob Gardner
Helpers: TBD
Where: Officers Club, University of Utah, Salt Lake City.
Requirements: Participants must bring a laptop with a few specific software packages installed (see Setup).
Contact: Please mail user-support@opensciencegrid.org for more information.
Registration
Space is limited for the event. To register, please visit the OSG-AHM registration page .
Schedule
High-Throughput Computation on the Open Science Grid and AWS
March 22, 2018, 9:00 AM - 12:30 AM
Location: Officers Club, University of Utah, Salt Lake City.
Instructors: TBD
| 09:00 - 09:15 | Introduction to OSG [Slides] |
| 09:15 - 10:00 | Job Scheduling with HTCondor |
| 10:00 - 10:30 | Large scale Computation with HTCondor |
| 10:30 - 11:00 | Coffee break |
| 11:00 - 11:45 | HTCondor DAGMan |
| 11:45 - 12:20 | Adding Resources from Amazon AWS [Slides] |
| 12:20 - 12:30 | Wrap up, feedback for the workshop and account signups |
Setup Instructions
Instructions to set up the required software on Linux, Windows and Mac laptops