Introduction to Grid IIT and the Open Science Grid

1. GridIIT/OSG Computing Grid
(project status and perspectives)
Office of Technology Services
Illinois Institute of Technology
Chicago, IL

2. *XSEDE
OSG Computing Grid
*Extreme Science and Engineering Discovery Environment
Fermi-
lab
Globus
UofC
Argonne
lab
UofW
Madison
IIT
SDSC

3. GridIIT/OSG Computing Grid Diagram
IIT campus
resources
RDC
resources
Inbound Inbound *CVMFS IIT submit
*CernVM File System was developed to assist High Energy Physics (HEP) collaborations
to deploy software on the worldwide-distributed computing infrastructure used to
run data-processing applications.
OSG
osg-connect

4. GridIIT - Shared Resources with OSG
•Number of shared clusters: 11
•Number of shared CPU cores: Over 300
•Number of contributed CPU cores: 40
Note: A Physics Department cluster’s OSG integration has been
postponed to the no earlier than the first week of May.

5. GridIIT/OSG – Statistics (6 months)

6. GridIIT/OSG Computing Grid Statistics (6M)
Note:
The graph represents Wall Hours by project
submitted by OSG, using IIT computer
resources.

7. David Minh’s Group’s Use of GridIIT/OSG (3M)
Note:
Jobs submitted by David Minh’s group on the IIT_SUBMIT server.

8. OSG – Technical Specifications
What kinds of computational research
work well on the OSG?
• Software should preferably be single-threaded, using less than 2GB of
memory, and each use should run for 1-24 hours
• Computing sites on the OSG can be configured to use preemption
• Binaries should preferably be statically linked
• Interpreted languages, such as Python or Perl, will work as long as
there are no special module requirements
• Input and output data for each job should be less than 10GB
• OSG’s Virtual Cluster does not currently have a global, shared-file
system
• Software dependencies can be difficult to accommodate, unless the
software can be staged with the job or installed on the read-only,
distributed, OASIS file system
• IIT does not provide any permanent data storage or backup of any
users’ data

9. OSG – Technical Specifications (cont.)
What kinds of computational research
are not a good match for the OSG?
• Tightly-coupled computations, such as MPI-based
communication, e.g.
• Computations requiring a shared file system will
not work
• Computations requiring complex software
deployments are not a good fit
• Computations that require proprietary, license-
based applications

10. Requirements to Open an Account
on the GridIIT/OSG server
• Principal Investigator and/or Faculty Advisor
• Grant or project title
• Field of science
• Basic knowledge of Linux OS
• Basic knowledge of scripting languages and
job submission schedulers

11. IIT/OSG Computing Grid
Next Steps:
• Continue expansion of shared computing
resources.
• Announce IIT/OSG computing grid to our faculty
and research groups.
For More Information/To Join:
Please contact Grigoriy Abramov, OTS’s
System Administrator for the Research Data Center
gabramov@iit.edu