Successfully reported this slideshow.
4th ILC Detector Workshop<br />2-4 December 2009 @ KEK, Tsukuba, Japan<br />Day2: Software (15min)<br />Updates related on...
Mt. Tsukuba (N)<br />Central Tsukuba (S)<br />KEK-2<br />KEK-1<br />Quoted from last meeting in December 2008<br />upgrade...
Major HEP projects:<br />Belle, J-PARC, ATLAS	ongoing projects<br />ILC, Belle2		future projects<br />Also covering <br />...
KEK’s Contribution in EGEE-III<br />TSA1.1: Grid Management<br />Interoperability and collaboration<br />TSA1.2: Grid oper...
SINET<br />Both for domestic & international institutes<br />Logical Network ConnectionFocused ONLY on Grid<br />Dec 3, 20...
Recent Changes in VOMS<br />VOMS.kek.jp has been shutdown on 2nd Oct 2009, end of validity of its host certificate.<br />M...
Recent Change in KEK-1<br />CE/RB based on gLite-3.0/SL3X has been decommissioned in Oct 2009.<br />Still not yet deployed...
Resource Scale (KEK-2)<br />Storage service (DPM)<br />~10TB with HPSS as backend storage<br />~30,000 JPY/TB<br />Except ...
Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />9<br />Recent W...
Snapshot<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />1...
252 MSI2K as of Oct 2009<br />Resource Scale – LCG Infrastructure<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates r...
252 MSI2K as of Oct 2009<br />Dec 2009 (Now)<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since ...
252 MSI2K as of Oct 2009<br />Mar 2010<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last m...
Summary Table of Resource Scale<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting ...
Upcoming Storage Service<br />To expose HSM to Grid<br />SRB-DSI to bridge SRB inside BCS<br />Just for GridFTP access, no...
Ops stats @ KEK in recent 6 months<br />More than 1K jobs have been processed forILC<br />~10% of CPU time<br />ILC is the...
Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />17<br />1,207 o...
Summary of Updates on Grid<br />Resource upgrade<br />+2.5MSI2K in Dec 2009<br />+2.5MSI2K in Mar 2010 (tentative)<br />St...
Many Thanks for Your Attention!<br />Go Iwai, KEK/CRC<br />go.iwai@kek.jp<br />
Upcoming SlideShare
Loading in …5
×

Updates related on Grid since last meeting in December 2008: Service, resource, and recent achievements to utilize distributed computing infrastructures

818 views

Published on

This talk has been given in the 4th ILC Detector Workshop held at KEK, Tsukuba, Japan, 2-4 Dec 2009. http://kds.kek.jp/conferenceDisplay.py?confId=3363

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Updates related on Grid since last meeting in December 2008: Service, resource, and recent achievements to utilize distributed computing infrastructures

  1. 1. 4th ILC Detector Workshop<br />2-4 December 2009 @ KEK, Tsukuba, Japan<br />Day2: Software (15min)<br />Updates related on Grid since last meeting in December 2008<br />http://kds.kek.jp/conferenceTimeTable.py?confId=3363<br />Service, resource, and recent achievements to utilize distributed computing infrastructures<br />Go Iwai, KEK/CRC<br />go.iwai@kek.jp<br />Agenda of last meeting can be found at http://kds.kek.jp/conferenceTimeTable.py?confId=2260<br />
  2. 2. Mt. Tsukuba (N)<br />Central Tsukuba (S)<br />KEK-2<br />KEK-1<br />Quoted from last meeting in December 2008<br />upgrade 2009<br />upgrade 2009<br />upgrade 2009<br />Belle Computing System (BCS)<br />Storage<br />Belle Computing System (BCS)<br />CPU<br />Super Computer System<br />Central Information System<br />(CIS)<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />
  3. 3. Major HEP projects:<br />Belle, J-PARC, ATLAS ongoing projects<br />ILC, Belle2 future projects<br />Also covering <br />Material science, bio-chemistry and so on using synchrotron light and neutron source<br />Radiotherapy as technology transfer<br />We have a role to support university groups in these fields.<br />including Grid deployment/operation.<br />Tohoku Univ.<br />Nagoya Univ.<br />Kobe Univ.<br />KEK<br />Hiroshima IT<br />Univ. of Tsukuba<br />Introduction<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />3<br />Hiroshima Univ. (Alice)<br />U of Tokyo (Atlas)<br />
  4. 4. KEK’s Contribution in EGEE-III<br />TSA1.1: Grid Management<br />Interoperability and collaboration<br />TSA1.2: Grid operations and support <br />1st line support for operations problems<br />Middleware deployment and support<br />Coordination of middleware deployment and support for problems.<br />Regional certification of middleware releases if needed (outside of PPS and SA3 involvement). This is anticipated to be very rare and will require specific justification.<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />4<br />
  5. 5. SINET<br />Both for domestic & international institutes<br />Logical Network ConnectionFocused ONLY on Grid<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />5<br />Univ.<br />Grid<br />Univ.<br />Grid<br />Facility<br />Site<br />Univ.<br />Grid<br />Univ.<br />Grid<br />Service<br />Univ.<br />Grid<br />Univ.<br />Grid<br />VO-Central Service<br />Generic Service at Grid Level<br />Upgraded<br />VOMS<br />VOMRS<br />Upgraded<br />Retired<br />CA<br />KEK-1<br />gLite<br />KEK-2<br />gLite<br />VOMS<br />Computing Facility<br />for Belle Exp.<br />LFC<br />SRB<br />SRB-DSI<br />CD-1<br />NAREGI<br />MCAT<br />HSM<br />CD-2<br />NAREGI<br />DMZ<br />Intranet<br />GRID-LAN<br />CC-GRID<br />VO-Specific Service<br />
  6. 6. Recent Changes in VOMS<br />VOMS.kek.jp has been shutdown on 2nd Oct 2009, end of validity of its host certificate.<br />Migrated to voms.cc.kek.jp<br />Validity of proxy cert is extended 7days, i.e. 168hours<br />MyProxy does not work properly without special settings<br />User enrollment<br />https://vomrs.cc.kek.jp:8443/vo/voname/vomrs<br />Should be kept up to date on CIC portal<br />https://cic.gridops.org/index.php?section=vo&vo=voname<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />6<br />People in ILC are not affected by this change!<br />VOMS<br />VOMRS<br />voms.kek.jp<br />VOMS<br />voms.cc.kek.jp<br />DMZ<br />GRID-LAN<br />
  7. 7. Recent Change in KEK-1<br />CE/RB based on gLite-3.0/SL3X has been decommissioned in Oct 2009.<br />Still not yet deployed news<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />7<br />KEK-1<br />gLite<br />KEK-2<br />gLite<br />No CE can be found at GStat<br />http://gstat.gridops.org/gstat/JP-KEK-CRC-01/<br />
  8. 8. Resource Scale (KEK-2)<br />Storage service (DPM)<br />~10TB with HPSS as backend storage<br />~30,000 JPY/TB<br />Except for HSM through SRB-DSI<br />Not published information by Glue<br />Computing service<br />System A: As a part of Central Information System (CIS)<br />System B: Recycle-use of old blades in Belle Computing System (BCS)<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />8<br />VOMS<br />VOMRS<br />Computing Facility<br />for Belle Exp.<br />SRB<br />KEK-2<br />gLite<br />LFC<br />MCAT<br />HSM<br />System B<br />System A<br />Reuse of old resources<br />Upgraded in March<br />Computational specification of system A & B as of Oct 2009<br />
  9. 9. Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />9<br />Recent WorksIntegration of BCS and CIS<br />Computing Facility<br />for Belle Exp.<br />SRB<br />MCAT<br />HSM<br />MT Ops Room @ South Bldg. of CRC<br />10G x 2<br />1st Machine Room @ North Bldg. of CRC<br />(1) Done: BW expansion is Oct 2009<br />(2) In deploying<br />SRM-SRB<br />1Gx12<br />Done<br />Pend.<br />Pend.<br />CE<br />CE<br />Done<br />CE<br />CE<br />SRB-DSI<br />(GridFTP)<br />(3) Done half, pending others<br />SRB<br />HSM<br />KEK-2<br />gLite<br />Existing computing resource<br />192 nodes ~ 1,536 cores ~ 4.6 MSI2K<br />
  10. 10. Snapshot<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />10<br />http://gstat.gridops.org/gstat/JP-KEK-CRC-02/<br />4 CEs will be available step-by-step<br />System B (Old blades in BCS) are once again re-used for NAREGI<br />First half of 4 CEs are now available<br />Second half is depend on works in Belle/Belle2<br />In Dec 2009<br />In Mar 2010?<br />System B: down in Dec 2009<br />System A<br />
  11. 11. 252 MSI2K as of Oct 2009<br />Resource Scale – LCG Infrastructure<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />11<br />http://gridmap.cern.ch<br />KEK<br />1MSI2K<br />
  12. 12. 252 MSI2K as of Oct 2009<br />Dec 2009 (Now)<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />12<br />KEK<br />2.8MSI2K<br />
  13. 13. 252 MSI2K as of Oct 2009<br />Mar 2010<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />13<br />KEK<br />5.0MSI2K<br />Half of Asia-Pacific & regional largest center<br />
  14. 14. Summary Table of Resource Scale<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />14<br />Sorry for confusion!<br />A bit revised: “System C is now available and D will be in operation in Next March” is incorrect.<br />It should be corrected that “Half of both System C and System D is now available and another half will be in operation in Next March”.<br />Up<br />Down<br />Legend<br />
  15. 15. Upcoming Storage Service<br />To expose HSM to Grid<br />SRB-DSI to bridge SRB inside BCS<br />Just for GridFTP access, not for SRM and LFC<br />To enable access with logical file name, e.g. lcg-xxx lfn://logical-file-name <br />SRM-SRB for Site URL, e.g. srm://srm.kek.jp/<br />SRB-DSI for Transfer URL, e.g. gridftp://disk.kek.jp/<br />A bit behind of schedule<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />15<br />
  16. 16. Ops stats @ KEK in recent 6 months<br />More than 1K jobs have been processed forILC<br />~10% of CPU time<br />ILC is the heaviest consumer!<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />16<br />1,439 of 34,462<br />
  17. 17. Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />17<br />1,207 of 1,285 GB<br />Read<br />2,837 of 3,830 GB<br />Write<br />
  18. 18. Summary of Updates on Grid<br />Resource upgrade<br />+2.5MSI2K in Dec 2009<br />+2.5MSI2K in Mar 2010 (tentative)<br />Storage service<br />In operation early next year hopefully<br />Ops Stats<br />Storage:<br />Read: 1,204 GB in 6 month<br />Write: 2,837 GB in 6 month<br />CPU:<br />1K jobs (~10% of CPU time) are submitted<br />(Many) pending works<br />FTS<br />Common requirement<br />KEK-1 re-construction<br />Dec 3, 2009<br />ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008<br />18<br />ILC is the heaviest consumer in previous 6 months at KEK! <br />
  19. 19. Many Thanks for Your Attention!<br />Go Iwai, KEK/CRC<br />go.iwai@kek.jp<br />

×