• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
OGSAEvolution.ppt
 

OGSAEvolution.ppt

on

  • 1,294 views

 

Statistics

Views

Total Views
1,294
Views on SlideShare
1,294
Embed Views
0

Actions

Likes
1
Downloads
36
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • We’re focused on optimizing the operating environment along two very key fronts. The first is increasing business flexibility through software capabilities designed to simplify integration. The ability to connect people, processes and information in a way that allows companies to become more flexible to the dynamics of the markets, customers and competitors around you. Obviously, this is important within the bounds of any enterprise and will become increasingly important as companies extend their value nets – and more tightly integrate partners, suppliers and customers into their processes. Our second priority is IT simplification – creating an infrastructure that’s easier to provision and manage through automation and – now this is key – the creation of a single, consolidated, logical view of and access to all the available resources in a network. Now in some IT organizations, this may be heresy. Somehow, many organizations have become complacent about the practice of over-provisioning, buying excess capacity (a lot of it) in order to handle the occasional spikes that almost every system is forced to handle. Research has shown (source: independent research by Alinenan and cumulative result of interviews/surveys with more than 20,000 customers) that weaning an organization off the practice of over-provisioning – by moving to an infrastructure that accommodates dynamic resource provisioning – can reduce capital investments by between 15 and 35%. Now there’s a chunk of resource that could easily be applied to more strategic efforts around differentiation! One last point to make here before we move on – you can’t build an on demand operating environment without moving to open standards – a standards-based approach to delivering application functionality and the underlying infrastructure.
  • Grids create a virtualized data center: Grids tie together resources across geographical boundaries, organizational boundaries, and system types.
  • Lets build up a taxonomy of the components of OGSA. There are four main layers which comprise the OGSA architectural view. The lowest layer is comprised of the basic IT resources such as processors, storage systems, and network subsystems and the hardware specific support software in operating systems, subsystems and components that control them. For the most part these resources are made “visible” to the OGSA structure by adding function to that software to “virtualize or abstract” the hardware and system resources as “services”. Just above these is a layer of function like file systems, databases, messaging software, directories, etc. which are typically implemented as general purpose middleware. This middleware generally exploits the lower layer of physical resource and also provides function that can be “abstracted” and “virtualized” as services in OGSA. As a “Service Oriented Architecture” OGSA is fundamentally an extension of the existing Web Services infrastructure defined by standards like XML, WSDL, SOAP, etc. OGSA takes advantage of middleware application servers that provide programming support and hosting for web services implementations. OGSA Then “sits” on top of this support for web services. And Grid Applications in turn exploit the services that OGSA defines to manage and exploit the distributed resources of the grid.
  • From GT2 we moved to GT3 (june 2003) (where is the data, how to run jobs, how to move data) – (Desktop scavenging, Server grid, Data grid) – same objectives

OGSAEvolution.ppt OGSAEvolution.ppt Presentation Transcript

  • Open Grid Services Architecture Evolution Jean-Pierre Prost EMEA Design Center for ebusiness on demand PSSC, IBM Montpellier, France
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
  • On Demand Enterprise An enterprise whose business processes - integrated end-to-end across the company and with key partners, suppliers and customers - can respond with speed to any customer demand , market opportunity or external threat . business on demand
  • Flexible Financial & Delivery Options Becoming an On Demand Enterprise Innovative business designs that sharpen focus and accelerate growth Integrated, end-to-end business processes that are built to change An IT operating environment optimized for flexibility and resilience Business Transformation On Demand Operating Environment Business Processes Business Transformation
  • On Demand Operating Environment On Demand Operating Environment Open standards are table stakes for an on demand operating environment Business Flexibility IT Simplification Horizontal Process Business flexibility through integration of people, processes and information within and beyond the enterprise Integration Infrastructure Management IT simplification through automation and virtualization, enables access to and creates a consolidated, logical view of resources across a network
  • Grid Computing Defined Storage Applications Processing Operating System Data I/O Key Enablers Distributed computing based on open standards enabling heterogeneous operations Availability and Cost of Bandwidth
    • Industry Acceptance of Open Standards
    • OGSA
    • LINUX
    • WSDL
    • TCP/IP
    • Increased Software Sophistication
    • Workload Mgmt.
    • Provisioning
    • Scheduling
    • Billing and Metering
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
  • Service Oriented Architecture Separate interface from access and implementation Container
  • Open Grid Services Architecture Objectives
    • Manage resources across distributed heterogeneous platforms
    • Deliver seamless QoS
    • Provide a common base for autonomic management solutions
    • Define open, published interfaces
    • Exploit industry-standard integration technologies
      • Web Services, SOAP, XML,...
    • Integrate with existing IT resources
  • Web Services Business integration Secure and universal access Applications on demand Grid Protocols Vast resource scalability Global Accessibility Resources on demand access manage share The Best of Two Worlds Open Grid Services Architecture
  • Professional Services Open Grid Services Architecture Framework OGSA Architected Services Applications Autonomic Capabilities Network OGSA Enabled Storage OGSA Enabled Servers OGSA Enabled Messaging OGSA Enabled Directory OGSA Enabled File Systems OGSA Enabled Database OGSA Enabled Workflow OGSA Enabled Security OGSA Enabled Web Services OGSI – Open Grid Services Infrastructure
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
    • Exploits existing web services properties
      • Interface abstraction (WSDL)
      • Protocol, language, hosting platform independence
    • Enhancement to web services
      • Dynamic Creation
      • State Management
      • Event Notification
      • Referenceable Handles
      • Lifecycle Management
      • Service Groups
    Open Grid Services Infrastructure (OGSI) HandleMap Notification Factory Service Groups State Management. Lifecycle OGSI – Open Grid Services Infrastructure
  • Open Grid Services Architecture Framework HandleMap Notify Factory Service Groups State Mgt. Lifecycle Discovery OGSI – Open Grid Services Infrastructure OGSA Architected Services Web Services Hosting platform (Java) Other Possible Hosting Platforms (environments) Microsoft (.NET) Globus (C/C++) Berkley Lab (Python)
    • Open source
    • Reference implementation
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
  • Security
    • Registries and Discovery Services (SG)
      • Attribute Propagation and Query
      • Service Domain
    • Service Orchestration
    • Metering & Accounting
      • Installation & Deployment
    • Messaging and Queuing Services
    • Event Services
    • Distributed Secure Logging Service
    Open Grid Services Architecture Framework Policy Management Service Communication Service Management Grid Data Services Grid Core Services Grid Program Execution Services Domain Specific Services
    • Authentication
    • Authorization & Access Control
    • Credential Validation & Transformation
    • Trust Broker
    • Policy Service Manager
    • Policy Agent
    • Policy Transformation Service
    • Policy Resolution Service
    • Policy Validation Service
    • Policy Administration Services and Negotiation Framework
  • Open Grid Services Architecture Framework Grid Data Services Grid Program Execution Services Domain Specific Services
    • Job Scheduler & Queuing Services
    • Resource Reservation Services
    • Workload Managers and Micro-Scheduling Services
    • Data Access Services
    • Data Transformation & Federation Services
    • Data Replication Service
    • Data Caching Service
    • MetaData Catalog Services
    Grid Core Services
  • The Path to Standardization
    • IBM is working on OGSA with Globus at GGF
    • IBM is also working within other standards bodies to define new or extend existing standards to support required distributed services
    • IBM will accelerate delivery through partners
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
  • Grid and Web Services: Convergence? However, despite enthusiasm for OGSI, adoption within Web Services community turned out to be problematic Have been converging ? Started far apart in applications & technology Grid OGSI GT2 GT1 Web HTTP WSDL, WS-* WSDL 2, WSDM
    • A family of Web Services specification proposals
      • Introduces a design pattern to specify how to use Web Services to access “stateful” components (WS Resource Framework - IBM, Globus, HP)
      • Introduces message based publish-subscribe to Web Services (WS-Notification - IBM, Globus, Akamai, HP, SAP, Tibco, Sonic)
    January 20th Announcement Introduced First To be developed WS-Service Group WS-Renewable References WS-Notification Modeling Stateful Resources with Web Services WS-Base Faults WS-Resource Properties WS-Resource Lifetime
  • Evolution of the specifications This is an open process of evolution Notification Re-factored Still to be published WS-Base Faults WS-Renewable References WS-Resource Properties Modeling Stateful Resources with Web Services Publish-Subscribe Notification for Web services WS-Service Groups WS-Topics WS-Base Notification WS-Resource Lifetime WS-Brokered Notification
    • OGSA Services can be defined and implemented as Web Services
    • OSGA can take advantage of other Web Services standards
    • OGSA can be implemented using standard Web Services development tools
    • Grid applications will NOT require special Web Services infrastructure
    WS-Resource Framework & WS-Notification are an evolution of OGSI OGSI – Open Grid Services Infrastructure How These Proposals Relate to OGSA Web Services OGSA Architected Services Applications Network OGSA Enabled Storage OGSA Enabled Servers OGSA Enabled Messaging OGSA Enabled Directory OGSA Enabled File Systems OGSA Enabled Database OGSA Enabled Workflow OGSA Enabled Security OGSA Enabled Web Services WS-Base Faults WS-Renewable References WS-Resource Properties Modeling Stateful Resources with Web Services Publish-Subscribe Notification for Web services WS-Service Groups WS-Topics WS-Base Notification WS-Resource Lifetime WS-Brokered Notification
  • Grid and Web Services: Convergence The definition of WSRF means that Grid and Web Services communities can move forward on a common base Have been converging WSRF Grid OGSI GT2 GT1 Web HTTP WSDL, WS-* WSDL 2, WSDM Started far apart in applications & technology
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
    • WS-Resource framework exploits WS-Addressing
      • Web Services and WS-Resources are referenced using an “Endpoint Reference”
      • Web Services that create or locate WS-Resources return Endpoint References
    • Web Service and WS-Resource are separate
      • A Web Service is stateless
      • A WS-Resource provides a context for stateful execution
      • Different entities, different lifetimes, different capabilities
    The WS-Resource Framework Model
  • The WS-Resource Framework Model
    • Web Service
    Run-time environment Interface Web Service WSDL
    • Using a Web service to access a WS-Resource
    The WS-Resource Framework Model Run-time environment Interface Web Service message id message id address resource Endpoint Reference context
    • Using a Web service to access a WS-Resource
    The WS-Resource Framework Model Interface Web Service message id message id address resource resource Endpoint Reference Endpoint Reference Run-time environment context
    • Creating / Locating a WS-Resource
    The WS-Resource Framework Model Interface Web Service message message address Endpoint Reference resource Endpoint Reference Web Service either locates or creates a WS-Resource Run-time environment address id
    • Examples of WS-Resources :
      • Physical entities (e.g.. processor, communication link, disk drive)
      • or Logical construct (e.g.. agreement, running task, subscription)
      • Real or virtual
      • Static (long-lived, pre-existing) or Dynamic (created and destroyed as needed)
      • Simple (one), or Compound (collection)
    • Unique - Has a distinguishable identity and lifetime
    • Stateful - Maintains a specific state that can be materialized using XML
    • May be accessed through one or more Web Services
    What is a WS-Resource? resource
    • WS-Resource Properties
      • Resource state and metadata “Projected” as an XML document
      • Query and Set operations
    • WS-Resource LifeTime
      • Explicit destruction or “Soft state” time-to-live
      • Provides for cleanup of resource instances
    The WS-Resource Framework Model resource <ProcessorProperties> <ProcID>5A34C1DE03</ProcID> <ProcArchitecture>Power6.2</ProcArchitecture> <ProcSpeedMIPS>400</ProcSpeed> <ProcCacheMB>256<ProcCache> <ProcRunning>1</ProcRunning> </ProcessorProperties>
    • Subscriber indicates interest in a particular “Topic” by issuing a “subscribe” request
    • Broker (intermediary) permits decoupling Publisher and Subscriber
    • “ Subscriptions” are WS-Resources
      • Various subscriptions are possible
    • Publisher need NOT be a Web Service
    • Notification may be “triggered” by:
      • WS-Resource Property value changes
      • Other “situations”
    • Broker examines current subscriptions
    • Brokers may
      • “ Transform” or “interpret” topics
      • Federate to provide scalability
    WS-Notification Publisher subscribe subscribe S S S notify notify notify notify Broker Subscriber
  • OGSI to WSRF: Refactoring & Evolution WS-BaseFaults Base fault type WS-ServiceGroup ServiceGroup portTypes Treated as a pattern Factory portType WS-Notification Notification portTypes WS-ResourceLifetime GridService lifecycle mgmt WS-ResourceProperties Service data definition & access WS-RenewableReferences HandleResolver portType WS- Addressing Endpoint Reference Grid Service Handle WS- Addressing Endpoint Reference Grid Service Reference WS-Resource framework (WSRF) OGSI
  • Service Composition Transports Messaging Description Quality of Experience (QoX) HTTP/HTTPS SMTP RMI / IIOP XSD WSDL SOAP XML WS-Addressing WS-Renewable References WS-Metadata Exchange WS-Policy WS-Service Group WS-Resource Properties JMS WS-Security WS-Reliable Messaging WS-Transaction WS-Resource Lifetime WS-Base Faults WS-Notification BPEL4WS How these proposals relate to other Web Services standards
  • WS-Resource framework & WS-Notification
    • Scenario: Grid Resource Management & Scheduling
    WS-Resource used to “model” physical processor resources WS-Notification can be used to “inform” the scheduler when processor utilization changes Grid “Jobs” and “tasks” are also modeled using WS-Resources and Resource Properties Grid Scheduler is a Web Service Service Level Agreement is modeled as a WS-Resource Lifetime of SLA Resource tied to the duration of the agreement WS-Resource Properties project processor status (like utilization) Grid Scheduler A Service Level Cluster R R R Mainframe R R R Blades R R R Notification Local processor manager is “front-ended” with a Web Service interface Other kinds of processors are also “modeled” as same type of WS-Resources J J J
  • Outline
    • On Demand and Grid
    • Service Oriented Architecture
    • Open Grid Services Infrastructure (OGSI)
    • OGSA Architected Services
    • OGSA Evolution: Grid vs. Web Services
    • Web Services Resource Framework (WSRF)
    • Globus Toolkit
  • Globus Toolkit 2.0 Components Globus Security Infrastructure MDS client API calls to locate resources Query current status of resource Create RSL Library Parse Allocate & create processes Process Monitor & control Site boundary Client MDS: Grid Index Info Server Gatekeeper MDS: Grid Resource Info Server Local Resource Manager MDS client API calls to get resource info GRAM client API state change callbacks Process Process Job Manager         GRAM client API calls to request resource allocation and process creation. Request
  • From GT2 to GT3
  • Globus Toolkit ® and WS-Resource Framework 2004 2005 Note: Globus is not waiting for finalization of WSRF specs 3.2
    • Improved robustness, scalability, performance,
      • usability
    3.2 March 4.0  Q2 4.0 Q3 4.2 Q1 ‘05 4.2  Q4 Numerous new WSRF-based services 4.2 4.0
      • WSRF; some new functionality; further usability, performance enhancements
  • IBM Grid Toolbox V3 for Multiplatforms
    • A commercial release of the Globus Toolkit Version 3.0 with IBM Value Add
      • A platform for the Grid Developer to develop and test grid services and grid applications
      • A platform for the Grid Deployer/Administrator to host and manage grid services and grid applications
  • IBM Grid Toolbox V3 for Multiplatforms Features
    • Integrated Wizard Based Installation
    • A grid service runtime environment based on the GGF Grid Service (OGSI) specification for hosting grid services
    • A web-based management application used to manage services within the runtime environment
    • Complete set of configuration and administration commands
    • Development tools to build, package and use grid services
    • Common (base) grid services for:
      • GT3.0 Program Execution Service ( GT3.0 GRAM - MMJFS, MJS, UHE)
      • GT3.0 Information Services (GT3.0 MDS – Index Services)
      • GT3.0 Data Management Services (RFT, Multi-RFT)
      • Discovery via Service Group
      • Policy Management
      • Common Management Model (CMM)
    • Information Center including tutorials to assist with the education and understanding of the technologies and capabilities packaged within the product
      • Sample grid services and applications demonstrating key capabilities
  • Current Platforms Supported
    • Product Flyer: IBM Grid Toolbox V3 for Multiplatforms
      • http://www-1.ibm.com/grid/pdf/grid_toolbox.pdf
    • IBM Grid Toolbox V3 for Linux on xSeries
      • Order online:
        • US, UK:
          • http://www-132.ibm.com/content/home/store_IBMPublicUSA/en_US/ready2buy.html and specify part number 52P1214
        • France:
          • http://www-134.ibm.com/webapp/wcs/stores/servlet/CategoryDisplay? catalogId=-250&storeId=250&categoryId=3160611&langId=-2&dualCurrId=287290
    • IBM Grid Toolbox V3 for AIX on pSeries
      • Order through your local pSeries representative
        • Product number 5765-G22
  • IBM Virtualization Engine (recently announced) IBM Virtualization Systems Services IBM Virtualization Engine Enterprise Workload Manager Systems Provisioning IBM Director Multiplatform Grid Toolbox File Aggregation (SAN File System) Block Virtualization (SAN Volume Controller) Storage Infrastructure Management (Productivity Center) eServer and TotalStorage IBM Virtualization Systems Technologies z/OS AIX 5L Linux i5/OS Windows Hypervisors, Virtual IO, Virtual LAN Open Based Interfaces and Standards Open Based Interfaces and Standards
  • Summary
    • OGSA is a service oriented architecture framework, which is the foundation for the On Demand Operating Environment
    • At its core, there is the Open Grid Services Infrastructure, which specifies how to make a Web Service manageable
      • A Grid Service is today a manageable Web Service
    • Through the WS Resource Framework and WS-Notification specifications, Grid Services and Web Services will converge
    • OGSA architected services are being defined at the Global Grid Forum: core services, program execution services, and data services
    • The IBM Grid Toolbox V3 for Multiplatforms today offers a commercial release of the Globus Toolkit Version 3 (i.e. OGSI and higher level services) for Linux on xSeries and AIX on pSeries
  • Additional Links
    • OGSA and OGSI
      • https://forge.gridforum.org/projects/ogsa-wg
      • https://forge.gridforum.org/projects/ogsi-wg
    • WS-RF and WS-Notification
      • http://www.globus.org/wsrf/
      • 3.9.0 Java WSRF Core Preview now available (since 05/21/04)
    • Globus Toolkit
      • http://www-unix.globus.org/toolkit/
    • IBM Grid Toolbox
      • http://www-1.ibm.com/grid/solutions/grid_toolbox.shtml
    • IBM Grid Computing
      • http://www-1.ibm.com/grid/
    • [email_address]
    Thank You