• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
OGF Standards Overview - ITU-T JCA Cloud
 

OGF Standards Overview - ITU-T JCA Cloud

on

  • 801 views

 

Statistics

Views

Total Views
801
Views on SlideShare
653
Embed Views
148

Actions

Likes
0
Downloads
9
Comments
0

2 Embeds 148

http://www.scoop.it 145
https://twitter.com 3

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    OGF Standards Overview - ITU-T JCA Cloud OGF Standards Overview - ITU-T JCA Cloud Presentation Transcript

    • Open Grid Forum: Overview of OGF Standards Relevant to Cloud Computing Alan Sill Vice President of Standards ITU-T JCA-Cloud Meeting Feb. 26, 2013 ©2012 Open Grid Forum 1
    • About the Open Grid Forum:Open Grid Forum (OGF) is a leading global standardsdevelopment organization operating in the areas of cloud,grid and related forms of advanced distributed computing.The OGF community pursues these topics through an openprocess for development, creation and promotion ofrelevant specifications and use cases.OGF actively engages partners and participants throughoutthe international arena through an open forum with openprocesses to champion architectural blueprints related tocloud and grid computing.The resulting specifications and standards enablepervasive adoption of advanced distributed computingtechniques for business and research worldwide. © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 2
    • History and Background• OGF began in 2001 as an organization to promote the advancement of distributed computing worldwide.• Grid Forum --> Global Grid Forum --> GGF + Enterprise Grid Alliance --> formation of OGF in 2005.• Mandate is to take on all forms of distributed computing and to work to promote cooperation, information exchange, best practices use and standardization.• OGF best known for a series of important computing, security and network standards that form the basis for major science and business-based distributed computing (BES, GridFTP, DRMAA, JSDL, RNS, GLUE, UR, etc.).• Have also been working on cloud and Big Data standards (OCCI, WS-Agreement, DFDL, etc.) for several years.• Cooperative work agreements with other SDOs in place. © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 3
    • OGF Standards• OGF has extensive set of applicable standards related to federated community grid and cloud computing: - Federated Identity Management (FedSec-CG) - Managing the Trust Eco-System (CA operations, AuthN/AuthZ) - Virtual Organizations (VOMS) - Job Submission and Workflow Management (JSDL, BES) - Network Management (NSI, NML, NMC, NM) - Secure, fast multi--party data transfer (GridFTP, SRM) - Data Format Description (DFDL) - Service Agreements (WS-Agreement, WS-Agreement Negotiation) - Cloud Computing interfaces (OCCI) - Distributed resource management (DRMAA, SAGA, etc.) - Firewall Traversal (FiTP) - Others under development• Working to gather this information to form an organized description of OGF work - an OGF “Cloud Portfolio”. © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 4
    • GFD Publication History To Date 2000 2004 2008 2012241812 6 2000 - Early 2013 ...
    • Starting Point for OGF Documents:http://ogf.org/documents © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 6
    • GFD Publication History: Full Recommendations To Date Full REC status represents OGF’s highest level of output standard:Requires documentation of multiple implementations in the field and a separate review after at least 6 months of practical experience.
    • GFD Publication History:Proposed Recommendations
    • Example: Worldwide LHCComputing Grid~450,000 cpu cores Total worldwide grid ~430 Pb storage capacity: ~2x WLCGTypical data transfer across all grids andrate: ~12 GByte/sec VOs © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 9
    • LSN-MAGIC Meeting February 22, 2012 XSEDE: The Next Generation of US Supercomputing InfrastructureThe Role of Standards for Risk Reduction andInter-operation in XSEDE OGF standardsAndrew Grimshaw power the largest supercomputing infrastructures in the world!
    • UNICORE in XSEDE:Towards a large-scalescientific Environmentbased on Open StandardsEvolution from TeraGrid in establishing the key standards thatStarting in 2001, the National Science now define the interfaces of the XSEDEFoundation program TeraGrid has de- Enterprise Services. Within the Gridveloped into one of the world’s largest Interoperation Now (GIN) communityand most comprehensive Grid projects, group of the Open Grid Forum (OGF,offering resources and services to www.ogf.org), such key standards asmore than 10,000 scientists. It’s suc- BES/JSDL inSiDE • Vol. 9 remote compu- for running No.2 • Autumn 2011cessor, the Extreme Science and Engi- tations have demonstrated their impact Proneering Discovery Environment (XSEDE, on scientific applications. Based onwww.xsede.org), has started in July these standards, scientific workflows Innovatives Supercomputing2011 and is expected to excel the pre- can be executed today across different in Deutschlandvious program in terms of service quality infrastructures with no less than 8while lowering technological entry different Grid middleware technologies.barriers at the same time. These andother goals are to be achieved in the Jülich’s Role in XSEDEproject’s five year grant period with an The JSC not only contributes its exten-overall budget of $121 million. Among sive Grid know-how gained fromthe partnership of 17 institutions, the European research projects and its Figure 1: The current XSEDE architecture aims at providing XSEDE Enterprise Services at every major • Morris RiedelJülich Supercomputing Centre (JSC) is experience in standard-based software XSEDE site and optionally available Community Provided Services. The architecture will evolve over time • Bastian Demuth according to end-users needs.the only organization located outside engineering, but also a technologythe USA. called Uniform Interface to Computing Jülich Resources (UNICORE, www.unicore.eu). lightweight Genesis II services, UNICORE resulting infrastructure is expected to SupercomputingOpen Standards-based Being developed by partners all over meets all the security requirements of cover both high performance and high CentreArchitecture Europe, UNICORE is a Grid system that modern High Performance Computing throughput computing, thus enablingSince many scientific communities op- provides secure and seamless access centres and provides extensive support innovative research and discovery re-erate internationally, one key element mechanisms to a variety of different for their highly specialized hardware as quiring both types of parallel computa-of XSEDE is the use of open standards computer systems and platforms. well as their varying batch systems. tions. Moreover, collaboration betweenin order to promote interoperability It facilitates the remote execution of American and European scientists willwith other distributed computing infra- scientific applications as well as shar- Infrastructure Vision be easier than ever: UNICORE will alsostructures such as PRACE in Europe. ing software, resources and data. The XSEDE architecture envisions be deployed on the European Grid Infra-Figure 1 shows the extended reference UNICORE is fully based on Web ser- deploying UNICORE as part of the XSEDE structure (EGI) and is already installedarchitecture providing mandatory vices and open standards in order to Enterprise Services at major US high on many of the systems forming theXSEDE Enterprise Services at every allow seamless interoperation with performance centres whereas Genesis II infrastructure of the European super-major XSEDE site as well as optionally other standard compliant Grid sys- will be used for integrating smaller computing project PRACE.available Community Provided Services. tems such as Genesis II which is computer systems such as desktop PCsFor many years, the JSC and several developed at the University of Virginia. in order to provide interoperability withother XSEDE partners have been active Being complementary to the more campus Grids across the country. The 11
    • XSEDE Services Layer: LSN-MAGIC Meeting February 22, 2012 Simple services combined in many ways –Resource  Namespace  Service  1.1 –OGSA  Basic  Execu8on  Service –OGSA  WSRF  BP  –  metadata  and  no4fica4on –OGSA-­‐ByteIO –GridFTP Examples – (not a complete list) –JSDL,  BES,  BES  HPC  Profile –WS  Trust  Secure  Token  Services –WSI  BSP  for  transport  of  creden4als –…  (more  than  we  have  room  to  cover  here) XSEDE represents a the state of the art in the use of modern standards in international supercomputing cyberinfrastructure.Andrew Grimshaw 12
    • OGF Standards In PracticalUse For Cloud Federation: EGI FedCloud Task Force Demo EGI Technical Forum 2012 – Prague 17/21 Sep (Credit: Matteo Turilli, Oxford) © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 13
    • Example of OGF Standards Use: EGI FedCloud Task Force Demo EGI Technical Forum 2012 – Prague 17/21 Sep (Credit: Matteo Turilli, Oxford) © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 14
    • OGF Standards In Use In Industry:• DRMAA: Distributed Resource Management Application API Grid Engine, Open Grid Scheduler: (open source); TORQUE and related products: Adaptive Computing; PBS Works: Altair Engineering; Gridway: DSA Research; Condor: U. of Wisconsin / Red Hat;• OGSA® Basic Execution Service Version 1.0 and BES HPC Profile: BES++ for LSF/SGE/PBS: Platform Computing; Windows HPC Server 2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering;• JSDL: Job Submission Description Language (family of specifications): BES++ for LSF/SGE/PBS and Platform LSF: Platform Computing; Windows HPC Server 2008: Microsoft Corporation; PBS Works - (client only): Altair Engineering;• WS-Agreement (family of specifications): ElasticLM License-as-a-Service: ElasticLM; BEinGrid SLA Negotiator, LM-Architecture and Framework: (Multiple partners); BREIN SLA Management Framework: (Multiple partners); WSAG4J, Web Services Agreement for Java (framework implementation): Fraunhofer SCAI. © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 15
    • Uptake of OGF CloudStandards In Industry:Example:CompatibleOneOpen SourceCloud Brokerproject startedby industryconsortiumbased in FranceProduct lineheavily basedon publishedOGF standards(OCCI, WS-Agreement, etc.) © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 16
    • OGF Cooperative AgreementsIn Place as of Feb. 2013OCCI and DMTF: • OGF published the the OCCI Core, Infrastructure and HTTP Rendering specifications as GFD.183, 184 and 185 respectively, and is working on a JSON rendering. We created a joint work register with DMTF and continue to follow their progress towards implementation of the CIMI specification.OGF and ISO: • OGF has been accepted as a Category A liaison with ISO JTC1 SC38 on Cloud Computing.OCCI and SNIA (CDMI): • OGF has cooperative agreement w/SNIA and has held 7 jointly hosted Cloud Standards Plug-Fests so far; series continues. © 2011 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 17
    • OGF Cooperative AgreementsIn Place as of Feb. 2013OGF and ETSI: • Cooperative MoU in place; contributing to ETSI CSC effort.OGF and TM Forum: • Memorandum of Understanding in place; ongoing cross-SDO document on End-to-End Management of Cloud Service Agreements, including SLAs, in progress.OGF and CSA: • Cooperative agreement between OGF and CSA in place.OGF and IEEE: • OGF co-sponsored IEEE Cloudcom 2011 (Athens) and Cloudcom 2012 (Taipei), pursuing other engagements.OGF and SIENA, NIST, GICTF, etc.: • We contribute actively to to ongoing roadmapping efforts. © 2011 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 18
    • Cloud Plugfest Developer Series: Developer-oriented in-person standards and software testing Co-sponsored by OGF, SNIA and ETSI 7 events held so far! © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 19
    • ETSI Tools Used in Cloud Plugfests: © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 20
    • Conclusions• OGF occupies an important role in standards development for advanced distributed computing, including cloud, grid, networking and large-scale data processing, transfer and data handling standards.• OGF actively engages partners and participants throughout the international arena through an open forum with open processes.• OGF standards support a wide variety of flexible architectures for advanced scientific and business uses.• OGF’s extensive experience has enabled distributed computing built on these architectures to become a more flexible, efficient and utility-like global computing infrastructure. © 2012 Open Grid Forum ITU-T JCA-Cloud Geneva, Switzerland Feb. 26, 2013 21