gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 gLite Administration Workshop
...
Contents

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus        1 Overview
Overview

Grid
midd...
Overview

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Monday
Overview         Grid Co...
Time table

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus        11:00   Brief introduction
O...
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010
                 Resource sharing in early days of ...
Why Grid middlewares?

gLite Adminis-
    tration      Maybe you have heard...
  Workshop
     2010
                 If th...
Why Grid middlewares? - Intervention

gLite Adminis-
    tration
  Workshop
     2010
                 You could ask: ”Why...
Why Grid middlewares?

gLite Adminis-
    tration          Over time resources became affordable for research
  Workshop
  ...
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 Fosters...
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Fosters checklist:...
Grid middleware implementations

gLite Adminis-
    tration
  Workshop
     2010
                     gLite
S. Freitag, F....
Grid middleware implementations

gLite Adminis-
    tration
  Workshop
     2010
                     ARC (Advanced Resour...
Grid middleware

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 Most services...
Globus Toolkit 5

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus

Overview

Grid
middleware

P...
gLite

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.   Execution Management
  Feldhaus

Overview        ...
gLite

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
                 Data management
  Feldhaus

Overvi...
gLite Interaction

gLite Adminis-
    tration
                 is more complex than you can imagine.
  Workshop
     2010
...
Plan for today

gLite Adminis-
    tration
  Workshop
     2010
                 Focus: Installation & Configuration
S. Fre...
Worker Node

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       eager beaver of the Grid site
  Feldhau...
Batch System Server

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       consists of different queues
  F...
Compute Element

gLite Adminis-
    tration
  Workshop
     2010            Contact point for WMS and end users to submit ...
siteBDII

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
                     Contact point for TopLevelB...
VO Box

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       allows virtual organizations to run their ow...
APEL node

gLite Adminis-
    tration
  Workshop
     2010
                     Publishes accounting information to the Gr...
Plan for today

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       Group to small teams of 4 - 6 people...
Hints

gLite Adminis-
    tration
  Workshop
                 Hint 1
     2010
                 Make an initial sketch of ...
gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Our experience
Overview
                 ...
Upcoming SlideShare
Loading in...5
×

gLite Administration Workshop, Slides

1,101

Published on

Slides used for the gLite Administration Workshop at GridKA Summerschool 2010

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,101
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

gLite Administration Workshop, Slides

  1. 1. gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus gLite Administration Workshop Overview GridKa Summer School 2010 Grid middleware Plan for Today Stefan Freitag, Florian Feldhaus Services Robotics Research Institute TU Dortmund September 8, 2010
  2. 2. Contents gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus 1 Overview Overview Grid middleware 2 Grid middleware Plan for Today Services 3 Plan for Today 4 Brief introduction to gLite services
  3. 3. Overview gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Monday Overview Grid Computing and Cloud Computing, an Overview (T. Cass) Grid middleware Plan for Today Tuesday Services gLite Introduction Course (M. Sober) Today gLite Administration Course (S. Freitag, F. Feldhaus)
  4. 4. Time table gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus 11:00 Brief introduction Overview 11:30 site BDII Grid 12:30 Lunch (northern canteen) middleware 13:45 Batch system Plan for Today 14:45 CREAM Compute Element Services 15:30 Coffee break 16:00 User Interface 17:00 Advanced exercises and site testing 18:30 End of the workshop
  5. 5. Why Grid middlewares? gLite Adminis- tration Workshop 2010 Resource sharing in early days of computing S. Freitag, F. Feldhaus 1 only few scientists had access to compute and storage Overview resources Grid middleware 2 resources only available at a very limited number of sites Plan for Today Services If you were not working at such a site → What a pity!
  6. 6. Why Grid middlewares? gLite Adminis- tration Maybe you have heard... Workshop 2010 If the mountain won’t come to Mohammed, Mohammed must S. Freitag, F. Feldhaus go to the mountain. Overview Consequences Grid middleware Plan for Today Scientists moved to the places where the required Services resources were available. Resource sharing allowed multiple scientists to access the resources at the same time
  7. 7. Why Grid middlewares? - Intervention gLite Adminis- tration Workshop 2010 You could ask: ”Why did those scientists move? If I was a one S. Freitag, F. Feldhaus of those scientists I would have simply used something like ssh?” Overview Grid Brief historical overview middleware Plan for Today rsh originated as part of the BSD Unix operating system Services in 1983 Version 1 of the ssh protocol was designed in 1995 Until protocols for remote shells were developed, there was no other choice
  8. 8. Why Grid middlewares? gLite Adminis- tration Over time resources became affordable for research Workshop 2010 facilities → more resources and more locations S. Freitag, F. Feldhaus Site B Overview Grid Site A middleware Plan for Today Site D Services Site C As some scientists had/ still have no access to local resources a way for sharing resources in the research community was required.
  9. 9. Why Grid middlewares? gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Fosters checklist: Overview A Grid Grid middleware Plan for Today coordinates resources that are not subject to centralized Services control It integrates/ coordinates resources and users that exist within different control domains.
  10. 10. Why Grid middlewares? gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Fosters checklist: Overview A Grid Grid middleware uses standard, open, general-purpose protocols and Plan for Today interfaces Services delivers nontrivial qualities of service. → allows its constituent resources to be used in a coordinated fashion to deliver various qualities of service.
  11. 11. Grid middleware implementations gLite Adminis- tration Workshop 2010 gLite S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today NAREGI (National Research Grid Initiative), Japan Services
  12. 12. Grid middleware implementations gLite Adminis- tration Workshop 2010 ARC (Advanced Resource Connector) S. Freitag, F. Feldhaus Overview Grid middleware Globus Toolkit Plan for Today Services UNICORE (Uniform Interface to Compute Resources)
  13. 13. Grid middleware gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Most services implemented by Grid middlewares can be assigned to one or more of the following categories: Overview Grid Service categories middleware Plan for Today Execution management, Services Data management, Information services and Security
  14. 14. Globus Toolkit 5 gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today Services Figure: Globus Toolkit 5 Architecture
  15. 15. gLite gLite Adminis- tration Workshop 2010 S. Freitag, F. Execution Management Feldhaus Overview Workload Management System Grid CREAM Compute Element middleware Plan for Today Batch system Services Information services siteBDII TopLevelBDII
  16. 16. gLite gLite Adminis- tration Workshop 2010 S. Freitag, F. Data management Feldhaus Overview LFC (File Catalog) Grid dCache Storage Element middleware Plan for Today CASTOR (CERN Advanced Storage manager) Services DPM (Disk Pool Manager) Security GSI (Grid Security Infrastructure)
  17. 17. gLite Interaction gLite Adminis- tration is more complex than you can imagine. Workshop 2010 S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today Services Figure: EGEEgLiteJobSubmissionSchema Thanks to Maarten Litmaath
  18. 18. Plan for today gLite Adminis- tration Workshop 2010 Focus: Installation & Configuration S. Freitag, F. Feldhaus of gLite services required for a site offering access to compute resources Overview Execution Management Grid middleware CREAM Compute Element Plan for Today Batchsytem (Torque server and one worker node) Services Information Services siteBDII Additional services User Interface VO Box Accounting service (APEL node) LFC (File catalog)
  19. 19. Worker Node gLite Adminis- tration Workshop 2010 S. Freitag, F. eager beaver of the Grid site Feldhaus all jobs submitted to the site are executed on worker nodes Overview the worker nodes are linked to a batch system server Grid middleware Plan for Today Installed software Services Batch system software (Torque mom) CLI/ libraries for e.g. file catalog and storage element operations (MPI)
  20. 20. Batch System Server gLite Adminis- tration Workshop 2010 S. Freitag, F. consists of different queues Feldhaus may vary in wallclocktime, max. resource allocation,. . . Overview job management Grid middleware assigning jobs to worker nodes, start/ stop jobs Plan for Today workernode management Services Installed software Torque Batchsystem server Maui Scheduler
  21. 21. Compute Element gLite Adminis- tration Workshop 2010 Contact point for WMS and end users to submit jobs to S. Freitag, F. the Grid site Feldhaus Authorizes remote users for job submission Overview Grid Acts on behalf of the users and submits jobs via the batch middleware system client. Plan for Today Services Installed software Tomcat (CREAM CE is using this) Accounting service (APEL) Information provider (GIP) Batchsystem client
  22. 22. siteBDII gLite Adminis- tration Workshop 2010 S. Freitag, F. Contact point for TopLevelBDIIs Feldhaus yep, there is not only one! Overview Queries local gLite services for information Grid middleware In both cases LDAP is used Plan for Today Services Installed software openLDAP GridMap: http://gridmap.cern.ch GStat 2.0: http://gstat-prod.cern.ch/gstat/geo/openlayers
  23. 23. VO Box gLite Adminis- tration Workshop 2010 S. Freitag, F. allows virtual organizations to run their own specific Feldhaus services and directly access their local software area at a Overview Grid site. Grid middleware (usually) software managers are able to connect to the Plan for Today VoBox via gsissh Services Installed software gsissh client (Port 1975 is default) gLite CLI/ libraries
  24. 24. APEL node gLite Adminis- tration Workshop 2010 Publishes accounting information to the Grid via S. Freitag, F. ActiveMQ Feldhaus Information is taken from a local database Overview Compute Elements fill the database by Grid middleware parsing the batch system accounting logs Plan for Today MySQL inserts Services Installed software MySQL Java APEL RSS: Link Accounting Portal: http://www3.egee.cesga.es/
  25. 25. Plan for today gLite Adminis- tration Workshop 2010 S. Freitag, F. Group to small teams of 4 - 6 people Feldhaus Each team will act as a SysAdmin team of a grid site. Overview Open http://gkswiki.fzk.de/index.php5 in your Grid middleware browser Plan for Today Select gLite administration workshop with hands-on Services Now it is your turn! Support If you experience problems while setting up the services, Florian and I will join your team and assist.
  26. 26. Hints gLite Adminis- tration Workshop Hint 1 2010 Make an initial sketch of your site setup containing an S. Freitag, F. Feldhaus assignment of grid services to hosts (and administrators) Overview Grid Hint 2 middleware Plan for Today We suggest to install the basic services in the following order Services siteBDII Batchsytem Compute Element To anyone interested How to establish a storage resource at your grid site is shown tomorrow in the dCache administrations workshop.
  27. 27. gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Our experience Overview Do not expect that everything works ouf-of-the-box. Grid middleware Plan for Today For now Services Thanks for your attention! Questions !? Access to your machines: ssh -p24 root@gks-X-XYZ.fzk.de
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×