Presentation at Rocky Mountain HPC Symposium, University of Colorado Boulder, August 12, 2015

1. Rob Gardner • University of Chicago
Open Science Grid
Rocky Mountain HPC Symposium
University of Colorado, August 12, 2015
OSG User Support and Campus Grids area coordinator
rwg@uchicago.edu

2. OSG: distributed high throughput (HTC)
aggregate of individual
clusters > 100k cores

3. ● 2014 stats
○ 67% size of XD, 35% BlueWaters
○ 2.5 Million CPU hours/day
○ 800M hours/year
○ 125M/y provided opportunistic
● >1 petabyte of data/day xfered
● 50+ research groups
● thousands of users
● XD service provider for XSEDE
Rudi Eigenmann
Program Director Division of
Advanced Cyberinfrastructure (ACI)
NSF CISE
CASC Meeting, April 1, 2015
OSG: distributed high throughput (HTC)

4. OSG for users - HTC profile (vs HPC)
● Does your science workflow involve computations that can be split into many
independent jobs?
● Can individual jobs be run on a single processor (as opposed to a single large-
scale MPI job simultaneously utilizing many processors)?
● Can your applications be interrupted and restarted at a later time or on
another processor or computing site?
● Is your application software “portable”?
● How does computing fit into your science workflow? Are results needed
immediately after submission?
● Do your computations require access to or produce huge amounts of data?

5. Login Service:
connect users to national ACI

6. OSG Connect Service
OSG as a
campus cluster
★ Login host
★ Job scheduler
★ Software
★ Storage

7. Submit jobs to OSG with HTCondor
● Simple HTCondor submission
● Complexity hidden from the user
● No grid (X509) certificates required
● Uses HTCondor ClassAd and glidein
technology
● DAGMan and other workflow tools

8. Software & tools on the OSG
● Distributed software file system
● Special module command
○ identical software on all clusters
● Common tools & libs
● Curate on demand
continuously
● HTC apps in XSEDE
campus bridging
yum repo
$ switchmodules oasis
$ module avail
$ module load R
$ module load namd
$ module purge
$ switchmodules local
https://goo.gl/A7kNkf

9. Storage service: “Stash”
● Storage service for job input/output data
● Globus Server for managed transfers between
campus and the OSG
● POSIX access provided to the login host
● 500 TB capacity
● Personalized http endpoint
● Connected to 100 Gbps SciDMZ (I2, ESnet)

10. campus to OSG stash

11. Connecting campus to
national ACI

12. OSG for resource providers
● Connect your campus users to the OSG
○ connect-client - job submit client for the local cluster
○ provide “burst” like capability for HTC jobs to shared
opportunistic resources
● Connect campus cluster to OSG
○ Lightweight connect : OSG sends “glidein” jobs to
your cluster, using a simple user account
■ No local software or services needed!
○ Large scale: deploy the OSG software stack
■ Support more science communities at larger scale

13. @OsgUsers
support.opensciencegrid.org
user-support@opensciencegrid.org
opensciencegrid