OGF Standards Overview - Globus World 2013
Upcoming SlideShare
Loading in...5
×
 

OGF Standards Overview - Globus World 2013

on

  • 407 views

Assessing Success and Uptake for New Standards

Assessing Success and Uptake for New Standards
in Cloud and Grid Computing

Statistics

Views

Total Views
407
Views on SlideShare
407
Embed Views
0

Actions

Likes
0
Downloads
3
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

OGF Standards Overview - Globus World 2013 Presentation Transcript

  • 1. ©2013 Open Grid ForumAssessing Success and Uptakefor New Standardsin Cloud and Grid ComputingAlan SillVice President of Standards, OGFSenior Scientist, High Performance Computing Centerand Adjunct Professor of PhysicsTexas Tech University1Globus WorldApril 17-18, 2013
  • 2. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013About the Open Grid Forum:Open Grid Forum (OGF) is a leading global standardsdevelopment organization operating in the areas of cloud,grid and related forms of advanced distributed computing.The OGF community pursues these topics through an openprocess for development, creation and promotion ofrelevant specifications and use cases.OGF actively engages partners and participants throughoutthe international arena through an open forum with openprocesses to champion architectural blueprints related tocloud and grid computing.The resulting specifications and standards enablepervasive adoption of advanced distributed computingtechniques for business and research worldwide.2
  • 3. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013History and Background• OGF began in 2001 as an organization to promote theadvancement of distributed computing worldwide.• Grid Forum --> Global Grid Forum --> GGF + EnterpriseGrid Alliance --> formation of OGF in 2005.• Mandate is to take on all forms of distributed computingand to work to promote cooperation, information exchange,best practices in use and standardization.• OGF best known for a series of important computing,security and network standards that form the basis formajor science and business-based distributed computing(BES, GridFTP, DRMAA, JSDL, RNS, GLUE, UR, etc.).• Have also been working on cloud and Big Data standards(OCCI, WS-Agreement, DFDL, etc.) for several years.• Cooperative work agreements with other SDOs in place.3
  • 4. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Starting Point for OGF Documents:4http://ogf.org/documents
  • 5. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013OGF Standards• OGF has extensive set of applicable standards related tofederated community grid and cloud computing:- Federated Identity Management (FedSec-CG)- Managing the Trust Eco-System (CA operations, AuthN/AuthZ)- Virtual Organizations (VOMS)- Job Submission and Workflow Management (JSDL, BES)- Network Management (NSI, NML, NMC, NM)- Secure, fast multi--party data transfer (GridFTP, SRM)- Data Format Description (DFDL)- Service Agreements (WS-Agreement, WS-Agreement Negotiation)- Cloud Computing interfaces (OCCI)- Distributed resource management (DRMAA, SAGA, etc.)- Firewall Traversal (FiTP)- Others under development• Working to gather this information to form an organizeddescription of OGF work - an OGF “Cloud Portfolio”.5
  • 6. 61218242000 2008 2012GFD Publication History To Date2000 - Early 2013 ...2004
  • 7. GFD Publication History:Full Recommendations To DateFull REC status represents OGF’s highest level of output standard:Requires documentation of multiple implementations in the field anda separate review after at least 6 months of practical experience.
  • 8. GFD Publication History:Proposed Recommendations
  • 9. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013• DRMAA: Distributed Resource Management Application APIGrid Engine, Open Grid Scheduler: (open source); TORQUE and relatedproducts: Adaptive Computing; PBS Works: Altair Engineering; Gridway:DSA Research; Condor: U. of Wisconsin / Red Hat;• OGSA® Basic Execution Service Version 1.0 and BES HPC Profile:BES++ for LSF/SGE/PBS: Platform Computing; Windows HPC Server2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering;• JSDL: Job Submission Description Language (family of specifications):BES++ for LSF/SGE/PBS and Platform LSF: Platform Computing;Windows HPC Server 2008: Microsoft Corporation; PBS Works - (clientonly): Altair Engineering;• WS-Agreement (family of specifications):ElasticLM License-as-a-Service: ElasticLM; BEinGrid SLA Negotiator,LM-Architecture and Framework: (Multiple partners); BREIN SLAManagement Framework: (Multiple partners); WSAG4J, Web ServicesAgreement for Java (framework implementation): Fraunhofer SCAI.9OGF Standards In Use InIndustry:
  • 10. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Example: Worldwide LHCComputing Grid10~450,000 cpu cores~430 Pb storageTypical data transferrate: ~12 GByte/secTotal worldwide gridcapacity: ~2x WLCGacross all grids andVOs
  • 11. LSN-MAGIC MeetingFebruary 22, 2012The Role of Standards for Risk Reduction andInter-operation in XSEDEAndrew GrimshawXSEDE: The Next Generation ofUS Supercomputing InfrastructureOGF standardspower some ofthe largestsupercomputinginfrastructuresin the world!XSEDE cloudinfrastructure stillbeing written
  • 12. LSN-MAGIC MeetingFebruary 22, 2012XSEDE Services Layer:Simple services combined in many ways12–Resource  Namespace  Service  1.1–OGSA  Basic  Execu8on  Service–OGSA  WSRF  BP  –  metadata  and  no8fica8on–OGSA-­‐ByteIO–GridFTP–JSDL,  BES,  BES  HPC  Profile–WS  Trust  Secure  Token  Services–WSI  BSP  for  transport  of  creden8als–…  (more  than  we  have  room  to  cover  here)Examples – (nota complete list)Andrew GrimshawBasic message (AFS): XSEDE represents a phase change inthe engagement of OGF standards with US cyberinfrastructure.
  • 13. LSN-MAGIC MeetingFebruary 22, 2012Why Open Standards?• Risk  reduc5on• Best-­‐of-­‐breed  mix-­‐and-­‐match• Allows  innova5on/compe55on  at  more  interes5ng  layers• Facilitates  interopera5on  with  other  infrastructuresAndrew Grimshaw13Takeaway message• The  use  of  standards  permits  XSEDE  to  interoperate  with  other  infrastructures,  reduces  risks  including  vendor  lock-­‐in,  and  allows  us  to  focus  on  higher  level  capabili5es  and  less  on  the  mundane
  • 14. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013EGI Cloud Architecture:14www.egi.euEGI-InSPIRE RI-261323ArchitectureEGI Core Infrastructure PlatformFederatedAAICentralServiceRegistryMonitoring AccountingEGI Cloud Infrastructure PlatformCloud Management Stacks(OpenStack, OpenNebula,  …)VMMgmtDataMgmtInformationEGICollaborativePlatromImageMetadataMarketplaceImageRepositoryEnable an open ecosystem of services27/02/2013 CloudScape V 9(Credit: Steven Newhouse)
  • 15. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013EGI Services & Standards:15www.egi.euEGI-InSPIRE RI-261323Services [& Standards]Resource ProvidersOpenNebula, OpenStack, WNoDeS, StratusLab, OkeanosVM Mngmt[OCCI 1.1]Data[CDMI 1.0& OVF 1.1.0]InformationBDII/GOCDB[GLUE 2.0]MonitoringNagiosSAMAccountingAPEL[UR & StAR]Message BusActiveMQImage MgmtMarketplacevmcatcherAAIVOMS[X509 & EUGridPMA]ClientsBrokers27/02/2013 CloudScape V 10(Credit: Steven Newhouse)
  • 16. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Example of EGI Standards Use:EGI Federated Cloud16(Credit: Matteo Turilli, Oxford)EGI FedCloud Task Force DemoEGI Technical Forum 2012 – Prague 17/21 Sep
  • 17. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Example:CompatibleOneOpen SourceCloud Brokerproject startedby industryconsortiumbased in FranceProduct lineheavily basedon publishedOGF standards(OCCI, WS-Agreement, etc.)17Uptake of OGF CloudStandards In Industry:
  • 18. © 2011 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 18OGF Cooperative AgreementsIn Place as of Early 2013OGF and DMTF:• OGF published the the OCCI Core, Infrastructure and HTTPRendering specifications as GFD.183, 184 and 185, and isworking on a JSON rendering. We created a joint workregister with DMTF on OCCI and CIMI and continue to followtheir progress towards implementation and testing of the CIMIspecification.OGF and ISO:• OGF has a Category A liaison with ISO JTC1 SC38 on CloudComputing and is working with ISO on joint activities.OGF and SNIA (CDMI):• OGF has cooperative agreement w/SNIA with respect to CDMIand has co-hosted 8 Cloud Plugfests so far (series continues).
  • 19. © 2011 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 19OGF and OCEAN:• OCEAN has joined the Cloud Plugfest series as a co-sponsorand as one of the primary sponsors of the upcomingSeptember 2013 Cloud Interoperability Week.OGF and OW2:• OW2 is also co-sponsoring the 9/2013 Cloud InteroperabilityWeek & planning to join the Cloud Plugfest series as a formalco-sponsor & active supporter of Open-Source cloud projects.OGF and XSEDE:• Co-locating OGF 38 (most tracks) with XSEDE 2013 -networking to meet at TNC’13.OGF and EGI:• Co-locating OGF 39 + Cloud Interoperability Week at EGI TF.OGF Cooperative AgreementsIn Place as of Early 2013
  • 20. © 2011 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 20OGF and ETSI:• Cooperative MoU in place; contributing to ETSI CSC effort.ETSI has joined the Cloud Plugfest series as a co-sponsor.OGF and ITU-T:• OGF formal liaison with ITU-T JCA Cloud.OGF and TM Forum:• MoU in place; ongoing cross-SDO work on on End-to-EndManagement of Cloud Service Agreements, including SLAs.OGF and CSA:• Cooperative agreement between OGF and CSA in place.OGF and IEEE:• OGF co-sponsored IEEE Cloudcom conferences in 2011(Athens) and 2012 (Taipei); pursuing other engagements.OGF Cooperative AgreementsIn Place as of Early 2013
  • 21. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Cloud Plugfest Developer Series:21Continuing seriesco-sponsored byOGF, SNIA, ETSI,OCEAN and OW2!8 events held so far!Developer-orientedin-person standardsand software testingseries OPEN TO ALL!Easy to get involvedand join in events!
  • 22. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013ETSI Tools Used in Cloud Plugfests:22
  • 23. Extensive test tools -Detailed test results.
  • 24. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Upcoming Events - 2013• Terena Networking Conference June 3-6, 2013 inMaastricht, Netherlands (OGF 38 part A - Networking)• XSEDE 2013 July 22-25, 2013 in San Diego, California(OGF working group meetings track = OGF 38 part B)• Cloud Plugfest 9 as DMTF Alliance Partners TechnicalSymposium (APTS) July 22-26, 2013 in Portland, Oregon.• Autonomic Management of Grid & Cloud Computing(AMGCC’13) workshop - part of ACM Cloud & AutonomicComputing Conference August 5-9, 2013 in Miami, Florida.• Federative & Interoperable Cloud Infrastructures(FedICI13) workshop Aug. 26/27 2013, Aachen, Germanyorganized in conjunction with Euro-Par 2013.• OGF 39 co-located with EGI Technical Forum September16-20, 2013 in Madrid, Spain including Cloud Plugfest 10 &Cloud Interoperability Week (OGF/SNIA/ETSI/OCEAN/OW2)24
  • 25. © 2013 Open Grid Forum Globus World Chicago, Illinois USA April. 17-18, 2013Conclusions• OGF actively engages many partners and participantsthroughout the international arena through an openforum with open processes to promote best practicesand standards in advanced distributed computing.• OGF occupies an important role in standards andsoftware development with significant uptake in advanceddistributed computing, including cloud, grid, networkingand large-scale data processing, transfer and handling.• OGF standards support a wide variety of flexiblearchitectures for advanced scientific and business uses.• OGF’s extensive experience has enabled distributedcomputing built on these architectures to provide moreflexible, efficient and utility-like global infrastructures.25