0
Fabric and Storage Management GridPP  24/24 May 2001
Overview <ul><li>GridPP Proposal </li></ul><ul><ul><li>Other UK Proposals </li></ul></ul><ul><li>EU-DataGrid </li></ul><ul...
Compute &  Mass Storage BlueChip HPC COTS “HPC” Clusters User Portal Storage No: Networks Brokerage Collective
GridPP  Proposal “Compute” <ul><li>Develop Project Plan (UKDG) </li></ul><ul><li>COTS system development (UKDG) </li></ul>...
GridPP Proposal “Mass Storage” <ul><li>Evaluation and API design(EU) </li></ul><ul><li>Prototype(EU) </li></ul><ul><li>Ref...
DataGrid <ul><li>Information </li></ul><ul><ul><li>Architecture Definition Documents </li></ul></ul><ul><ul><li>WP Milesto...
Other UK  Proposals <ul><li>GenGrid </li></ul><ul><li>EPSRC testbed  </li></ul><ul><ul><li>E-Commerce related </li></ul></...
DataGrid(WP4) <ul><li>Tasks </li></ul><ul><ul><li>Configuration management </li></ul></ul><ul><ul><li>Resource management ...
DataGrid(WP5) <ul><li>Originally </li></ul><ul><ul><li>Mass Storage part of  local  fabric </li></ul></ul><ul><ul><ul><li>...
US Activities <ul><li>GriPhyN </li></ul><ul><ul><li>Virtual Data Toolkits </li></ul></ul><ul><li>Particle Physics Data Gri...
Commercial Activities <ul><li>ICT companies monitoring Grid </li></ul><ul><ul><li>Strategically placing themselves </li></...
Commercial Activities <ul><li>E-commerce </li></ul><ul><ul><li>Testbeds are vital </li></ul></ul><ul><ul><li>Companies or ...
WG-D Tasks Definitions <ul><li>Integration of Existing Compute Fabric </li></ul><ul><li>COTS Compute System Development </...
Current Delivery Schedule
Commentary <ul><li>GridPP Fabric + Storage Management </li></ul><ul><ul><li>Priority : deploy effort to satisfy DataGrid c...
Commentary <ul><li>“ Building something, no matter how bad it is, is better than nothing at all …”(I disagree) </li></ul><...
GridPP WG-D Objectives <ul><li>System software for integration of existing Grid components </li></ul><ul><li>Develop syste...
Objectives Continued… <ul><li>Proof of concept for on thousand PC level of scaling to 10k level </li></ul><ul><li>Define a...
Upcoming SlideShare
Loading in...5
×

Fabric And Storage Management

463

Published on

Fashion, apparel, textile, merchandising, garments

Published in: Business, Lifestyle
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
463
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
31
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Fabric And Storage Management"

  1. 1. Fabric and Storage Management GridPP 24/24 May 2001
  2. 2. Overview <ul><li>GridPP Proposal </li></ul><ul><ul><li>Other UK Proposals </li></ul></ul><ul><li>EU-DataGrid </li></ul><ul><li>US Activities </li></ul><ul><li>Commercial Activities </li></ul><ul><li>Timescales </li></ul><ul><li>Commentary </li></ul>Lots of Activity Duplication? GridPP role
  3. 3. Compute & Mass Storage BlueChip HPC COTS “HPC” Clusters User Portal Storage No: Networks Brokerage Collective
  4. 4. GridPP Proposal “Compute” <ul><li>Develop Project Plan (UKDG) </li></ul><ul><li>COTS system development (UKDG) </li></ul><ul><li>Integration of existing Fabric(UKPP) </li></ul><ul><li>Fabric Benchmarking(UKPP) </li></ul><ul><li>User Portals(UKPP) </li></ul><ul><li>Fabric Demonstrator </li></ul>cf EU-WP4 API design? Clear Model?
  5. 5. GridPP Proposal “Mass Storage” <ul><li>Evaluation and API design(EU) </li></ul><ul><li>Prototype(EU) </li></ul><ul><li>Refinement of API(UKDG) </li></ul><ul><li>Definition of Metadata(UKDG) </li></ul><ul><li>Metadata(UKDG) </li></ul>
  6. 6. DataGrid <ul><li>Information </li></ul><ul><ul><li>Architecture Definition Documents </li></ul></ul><ul><ul><li>WP Milestones </li></ul></ul><ul><li>Month 9 Deliverables </li></ul>Note GridPP: ATF? reevaluate Deliverables
  7. 7. Other UK Proposals <ul><li>GenGrid </li></ul><ul><li>EPSRC testbed </li></ul><ul><ul><li>E-Commerce related </li></ul></ul><ul><li>Generic Grid Activities within Universities </li></ul>GridPP Are we really the “ leaders”?
  8. 8. DataGrid(WP4) <ul><li>Tasks </li></ul><ul><ul><li>Configuration management </li></ul></ul><ul><ul><li>Resource management </li></ul></ul><ul><ul><li>Gridification </li></ul></ul><ul><ul><li>Installation </li></ul></ul><ul><ul><li>Monitoring </li></ul></ul><ul><ul><li>Fault Tolerance </li></ul></ul>
  9. 9. DataGrid(WP5) <ul><li>Originally </li></ul><ul><ul><li>Mass Storage part of local fabric </li></ul></ul><ul><ul><ul><li>E.g. Part of a HSM at a large centre </li></ul></ul></ul><ul><li>Post Architecture Task Force (ATF) </li></ul><ul><ul><li>Storage Element Interfaces (SE’s) </li></ul></ul><ul><ul><ul><li>Applicable at MORE than Tier-1 centres!!!! </li></ul></ul></ul><ul><ul><ul><li>Directly accessible from the Grid </li></ul></ul></ul><ul><ul><li>Tape and Disk Pools </li></ul></ul><ul><ul><li>Publishing Metadata </li></ul></ul>UK Contribution Important: Edinburgh RAL
  10. 10. US Activities <ul><li>GriPhyN </li></ul><ul><ul><li>Virtual Data Toolkits </li></ul></ul><ul><li>Particle Physics Data Grid (to 2004) </li></ul><ul><ul><li>http://www.ppdg.net/ </li></ul></ul><ul><ul><li>Very WP4/WP5 based </li></ul></ul>
  11. 11. Commercial Activities <ul><li>ICT companies monitoring Grid </li></ul><ul><ul><li>Strategically placing themselves </li></ul></ul><ul><ul><ul><li>E.g. IBM </li></ul></ul></ul><ul><ul><li>Development </li></ul></ul><ul><ul><ul><li>CISCO… </li></ul></ul></ul><ul><li>We MUST not be blind to E-commerce relationships </li></ul><ul><ul><li>resources </li></ul></ul><ul><ul><li>manpower </li></ul></ul>
  12. 12. Commercial Activities <ul><li>E-commerce </li></ul><ul><ul><li>Testbeds are vital </li></ul></ul><ul><ul><li>Companies or Consortia see 10-20% savings </li></ul></ul><ul><ul><ul><li>Can invest MUCH more than GridPP ever can by at least 2 orders of magnitude </li></ul></ul></ul><ul><ul><ul><li>Have more access to trained software teams </li></ul></ul></ul>
  13. 13. WG-D Tasks Definitions <ul><li>Integration of Existing Compute Fabric </li></ul><ul><li>COTS Compute System Development </li></ul><ul><li>DataGrid Common API </li></ul><ul><li>DataGrid Meta-data for Mass Storage </li></ul><ul><li>DataGrid Tape Exchange Design (!) </li></ul><ul><li>DataGrid Tape Exchange Implementation (!) </li></ul>
  14. 14. Current Delivery Schedule
  15. 15. Commentary <ul><li>GridPP Fabric + Storage Management </li></ul><ul><ul><li>Priority : deploy effort to satisfy DataGrid contract for PPARC </li></ul></ul><ul><ul><li>Recommend 6 month report (Nov 2001?) </li></ul></ul><ul><ul><ul><li>Position GridPP relative to worldwide Grid activities and build NOT compete </li></ul></ul></ul><ul><ul><ul><li>Evaluate Fabric Development Strategy in light of products and needs of LHC and E-commerce </li></ul></ul></ul><ul><ul><ul><li>Time to engage Computer Scientists and commercial partners both as “stakeholders” and contractually </li></ul></ul></ul><ul><ul><ul><li>Time to find the right people (we don’t have enough) </li></ul></ul></ul><ul><ul><ul><ul><li>( If cannot need to readjust goals!) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>resources </li></ul></ul></ul></ul>
  16. 16. Commentary <ul><li>“ Building something, no matter how bad it is, is better than nothing at all …”(I disagree) </li></ul><ul><li>National, international academic and commercial collaboration is vital </li></ul><ul><li>Simplicity,robustness and useability are very important </li></ul><ul><ul><li>Our “lives” depend on it </li></ul></ul><ul><ul><li>Note tendency to overambitious plans </li></ul></ul><ul><li>Skilled programmer crisis will kill the project </li></ul><ul><ul><li>Must work with industry or subcontract deliverables </li></ul></ul>
  17. 17. GridPP WG-D Objectives <ul><li>System software for integration of existing Grid components </li></ul><ul><li>Develop system(s) for COTS integration </li></ul><ul><li>Work with HPC supplier towards Grid enabled proprietary systems </li></ul><ul><li>Build fabric management model allowing hot-swapping and hot-addition of new technologies </li></ul><ul><li>Provide on-going benchmarking and cost-performance analysis of Grid components </li></ul><ul><li>Produce 1 st level user portals to Grid fabric </li></ul>
  18. 18. Objectives Continued… <ul><li>Proof of concept for on thousand PC level of scaling to 10k level </li></ul><ul><li>Define and implement mass storage API </li></ul><ul><li>Devise method of moving physical tapes and associated meta-data between centres </li></ul><ul><li>Tools and schema for meta data and mass storage information services (not physical datasets) </li></ul><ul><li>Integrate with DataGrid WP4 and WP5 programmes </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×