Your SlideShare is downloading. ×
alice-grid.ppt
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

alice-grid.ppt

704
views

Published on


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
704
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. CHEP 2000, 10.02.2000 Roberto Barbera Roberto Barbera GRID Activities at ALICE ROOT Workshop, 13-15.06.2001 T. Anticic (IRB), R.B. (CT), I.J. Bloodworth (B’ham), M. Botje (NIKHEF), P. Buncic (CERN), F. Carminati (CERN), P. Cerello (TO), G. Chabratova (DUBNA), J. G. Contreras (MERIDA), D. Di Bari (BA), J. Gosset (SACLAY), M.L. Luvisetto (BO), P. Malzacher (GSI), A. Masoni (CA), D. Mura (CA), L. Nellen (UNAM), B. Nilsen (OSU), F. Rademakers (CERN), C. Rocca (CT), Y. Schutz (SUBATECH), M. Sitta (TO), R. Turrisi (PD), D. Vicinanza (SA)
  • 2. Outline
    • Introduction
    • AliRoot and the GRID – Phase I
    • AliRoot and the GRID – Phase II
    • Possible Root developments
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001
  • 3. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ALICE, ATLAS, CMS, LHCb Higgs and new particles; Quark-Gluon Plasma; CP Violation
      • Data written to tape ~10 Petabytes/Year and UP (1 PB = 10 15 Bytes)
      • O(0.1) to O(1) Exabyte (1 EB = 10 18 Bytes) (~2010) (~2020 ?) Total for the 4 LHC experiments
    ROOT Workshop, 13-15.06.2001
  • 4. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Computing model Monarc Project 100 - 1000 Mb/s Tier 4 Tier2 Center 2.5/10 Gb/s Tier2 Center Tier2 Center Tier2 Center Tier2 Center Tier 2 Institute Institute Institute Institute Physics data cache 155/622 Mb/s Tier 3 UK Regional Center France Regional Center Italy Regional Center Germany Regional Center 622/2500 Mb/s Tier 1 Tier 0 ~1.25 GB/s Online System Online Farm CERN Computer Center
  • 5. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Typical work flow at a Tier-1 Tape Mass Storage & Disk Servers Database Servers Production Reconstruction Raw/Sim  ESD Scheduled, predictable experiment/ physics groups Production Analysis ESD  AOD AOD  DPD Scheduled Physics groups Tier 2 Local institutes CERN Tapes Data Export Physics Software Development R&D Systems and Testbeds Info servers Code servers Web Servers Telepresence Servers Training Consulting Help Desk Individual Analysis AOD  DPD and plots Chaotic Physicists Desktops Data Import Tapes Network from CERN Network from Tier 2 & simulation centers
  • 6. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 AliRoot and the GRID – Phase I: Production The “GRID”
  • 7. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 The ALICE testbed for Phase I Lyon Merida Mexico City OSU/C
  • 8. Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Roberto Barbera 1 week run ~ 200 events 300+ GB Production test lay-out for phase I I’m the local surveyor Disk Pool Batch surveyor Linux farm + MRTG monitor PPR site Globus I’m the PPR production manager Catania
  • 9. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Utilities Web interface to login on “The Grid ” Web interface for job submission ! CPU Load Disk space Network availability Book keeping system Only at Lyon LDAP server for ALICE (only in Italy)
  • 10. What did we learn ? (1)
    • Pros:
      • We are able to successfully manage certificates from different CA’s (INFN, CNRS, Globus).
      • The Root/AliRoot installation toolkit (Torino) works nicely at all sites (ALICE’s and WP6’s).
      • The web interface EnginFrame is interfaced not only with the Globus GRAM and GSI but also with the local monitoring systems and with the presently available information service.
      • A geographically distributed AliRoot production can be centrally managed.
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001
  • 11. What did we learn ? (2)
    • Cons:
      • The output and error files do not fly back to the submitting machine if a job manager different from fork is used by the Globus commands.
      • The absence of a centralized bookkeeping system which could also acts as job monitor was the most critical issue.
      • There was no direct interaction between Root and the GRID services.
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001
  • 12. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 AliRoot and the GRID – Phase II: Reconstruction and analysis The “GRID” The “GRID”
  • 13. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 The ALICE testbed for Phase II
  • 14. ALICE Collaboration Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy Roberto Barbera Production test lay-out for phase II I’m the local surveyor Disk Pool Run DB MySQL PHP4 Bypass Tape Pool (CASTOR/ HPSS) Linux farm + MRTG monitor PPR site WWW Globus I’m the PPR production manager Manager’s site I’m the impatient ALICE user checking the availability of events Anywhere Batch surveyor
  • 15. More integration: Grid services addressed from Root (analysis)
    • TAuthorization (P. Malzacher)
      • Interface between Root and the Globus GSI service.
    • TLDAP (P. Malzacher)
      • Interface between Root and the Globus GIS service based on LDAP directories.
    • TPServer, TPServerSocket, TFTP (Fons)
      • Parallel socket transfer over TCP/IP.
    • RootFTP (Fons)
      • File transfer utility which uses parallel sockets.
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001
  • 16. Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Preliminary RootFTP tests CERN  Catania (14 nodes, 28 CPUs, 4 Mb/s) 34 Mb/s soon ! http:// alicedb . cern . ch / mrtg / index . html Total router traffic Node traffic Node CPU load Global results Bandwidth limited
  • 17. Local Remote PROOF 2: Configure PROOF 1: Select input data 3: Run analysis macro 4: Collect output Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Roberto Barbera AliRoot + PROOF Selection Parameters DB1 DB4 DB5 CPU Procedure Proc.C Proc.C Proc.C Proc.C Proc.C CPU CPU CPU CPU TagDB RDB DB3 DB2 DB6 CPU
  • 18. AliRoot + PROOF + DataGRID Services 5: Collect output & analize it locally Local Remote PROOF 2: Contact GRID scheduler 1: Select input data (ALICE Data Catalogue) Retrieve LFNs 3: The GRID runs the job 4: Collect output LFN’s; update Data Catalogue Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001 Roberto Barbera Selection Parameters DB1 DB4 DB5 CPU Procedure Proc.C Proc.C Proc.C Proc.C Proc.C CPU CPU CPU CPU TagDB RDB DB3 DB2 DB6 CPU
  • 19. Internal milestones for Phase II
    • 6/2001
      • List of ALICE users (& Certificates) distributed to the test sites and to DataGRID WP6.
    • 7/2001
      • Distributed production/reconstruction test with a centralized bookkeeping system and Bypass. As many sites involved as possible.
    • 8/2001
      • Distributed analysis test with PROOF .
    • 9/2001
      • Test with/on DataGRID WP6 resources.
    • 12/2001
      • First results of tests of DataGRID PM9 middleware release.
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001
  • 20. Possible Root developments
    • Interface between Root and the DataGRID WP2 middleware (GDMP API’s).
    • Interface between PROOF and the GRID scheduler (possible use of TLDAP for resource discovery from the GRID information service(s)).
    • Interface between TFTP and the Globus GSI services via TAuthorization. Comparison with GridFTP.
    Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ROOT Workshop, 13-15.06.2001

×