• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
DataSynapse and Amazon EC2 Technical Overview

DataSynapse and Amazon EC2 Technical Overview






Total Views
Views on SlideShare
Embed Views



2 Embeds 159

http://www.datasynapse.com 146
http://www.slideshare.net 13



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.


11 of 1 previous next

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • Very interesting ppt. The research indicated PPT only contains 30% of information; therefore the 70% valuable information comes from the presenter himself/herself. soEZLecturing.com provides you a chance to record your voice with your PowerPoint presentation and upload to the website. It can share with more readers and also promote your presentation more effectively on soEZLecturing.com.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

DataSynapse and Amazon EC2 Technical Overview DataSynapse and Amazon EC2 Technical Overview Presentation Transcript

  • A Technical Overview Leveraging Amazon Web Services with DataSynapse GridServer
  • Overview
    • On Wednesday February 11th, DataSynapse announced support for Amazon EC2 and Amazon Web Services external cloud platform
      • Customers will be able to run unlimited number of DataSynapse engines in the EC2 cloud
    • As part of this announcement, DataSynapse is launching a beta program for Federator 1.5
      • This new release of the Federator grid management software makes integration with external clouds seamless
      • Beta program members can extend there current DataSynapse environment into the Amazon EC2 cloud, free for all of 2009
    • The objective of this strategy is to accelerate the adoption of external cloud computing models for mission critical business applications and lower the operating expenses for grid computing
  • GridServer and AWS Technical Overview
    • High performance service execution
    • Modern, open and extensible
    • Multi-platform, multi-language
    • Self-managing:
      • HA/Failover
      • Deployment and provisioning
      • Monitoring
    • Large platform ecosystem of premier ISVs
    GridServer – Service Execution Environment Grid Clients DataSynapse Manager
  • Federator – Grid Engine Management DataSynapse Federator Federator UI
    • Policy based re-distribution of resources between resource pools
    • Centralized resource management
    • Enables running additional engine pools in the Amazon EC2 cloud
    GridServer 4.2 (U16) GridServer 5 (SP2) EC2 Engines
  • Federator - Integrating with Amazon WS
    • Federator 1.5 extends GridServer seamlessly onto the Amazon cloud
      • Save all your Amazon configuration information
      • Create policies for starting / stopping cloud based engines
      • Create secure connections to cloud based engeines
    Grid Client Federator DataSynapse Manager On Premise In the Cloud
  • Activate Amazon EC2 Account
    • Create an Amazon AWS account
      • Web-based sign up, with credit card
    • Sign up for DataSynapse paid AMI
      • Retain your Activation Key
    • Gather your Amazon keys
      • Access Key ID
      • Generate public and private keys
  • Setting Up Federator
    • Install Federator software
    • Configure Federator for your GridServer Manager
    • Define a Virtual Resource Manager
      • Basic information necessary to interact with EC2 (e.g., AWS login information)
    • Define a Virtual Resource Group
      • More dynamic configuration data, information specified in VRG closely tied to how customers will actually use virtual nodes
    • Define Policy
      • Assign Virtual Resource Group to target Resource Manager
  • Starting Up the Proxy Service
    • Federator uses AWS interface to create a cloud-side proxy based on Virtual Resource Manager Settings
    On Premise On AWS
    • On premise proxy, installed as a service, will initiate secure cloud connections
    • AMI (Amazon Machine Image) for the Proxy is stored in S3, DataSynapse incurs the costs of this storage, not the client
    AWS EC2 Instance AWS Interfaces Federator DataSynapse Manager AWS S3 Storage Proxy Service AMI Proxy Service Proxy Service
  • Proxy Service
    • Once proxy is running, Federator instructs the GridServer Manager to establish an SSH tunnel connection to the proxy
    Federator On Premise On AWS DataSynapse Manager Secure SSH Tunnel Secure connection point between on premise and cloud based resources Proxy Service
    • Proxy model enables secure connectivity between GridServer Manager on premise and Amazon EC2 based DataSynapse resources
    Proxy Service
  • OpenVPN Alternative
    • Amazon recommended model for extending your network into the cloud
    • Ethernet bridging enables cloud resources to securely access on premise resources
    • DataSynapse proxy service is used for resource caching
    Federator On Premise On AWS DataSynapse Manager Secure VPN connection VPN Server VPN Bridge Client Caching Service
  • DataSynapse AMIs
    • Standardized machine images
      • Common engine configuration
      • Supporting services
    • Operating Systems
      • Windows 2003
      • Fedora
      • OpenSUSE
    • AMI sets stored in each Region
      • Windows 2003 unavailable in EMEA
    • Users may build customized AMIs:
      • Must be based on default AMIs
      • Storage and associated costs of custom AMIs are the responsibility of the client
    AWS S3 Storage AWS EC2 Instance Windows 2003 (64bit) Fedora (32bit) OpenSUSE (64bit) Fedora (64bit) OpenSUSE (32bit) DS Engine
  • Activating Engines on Amazon EC2 Cloud
    • When activation policy executes:
      • Federator launches specified # of engine AMI instances
      • Federator configures each engine to use the Proxy
    On Premise On AWS DS Manager Secure SSH Tunnel DS Base AMI DS S3 Account Custom AMI Client S3 Account Cloud based engines do not count against GridServer license counts DataSynapse Engines on EC2 Proxy Service Proxy Service Federator Activation Policy
  • Uploading Grid Libraries
    • Proxy synchronizes grid library resources with the Manager
    • Grid libraries are then cached on the Proxy side for distribution to EC2-based Engines
    Federator On Premise On AWS DataSynapse Manager Proxy Service Secure SSH Tunnel GridLibs GridLibs Proxy Service
  • Configuring Engines on Amazon EC2 Cloud
    • When an Engine comes online they will first check with the proxy for any GridLibs
    • Updates to engines are done within the EC2 environment, there are no additional costs associated with this
    Federator On Premise On AWS Secure SSH Tunnel GridLibs (cached) Engines Instances DataSynapse Manager Proxy Service Proxy Service
  • Submitting Work to Cloud Engines Instances Federator On Premise On AWS DataSynapse Manager Secure SSH Tunnel
    • Clients submit work to the GridServer Manager as before, no change required
    • Engines then request work from the GridServer Manager via the Proxy
    • Engines will receive start/stop service commands directly from the GridServer Manager
    Grid Client Proxy Service Proxy Service
  • Use Cases
    • Dev and Test Grids:
      • GridServer environments are large – some customers running 10k+ engines
      • Difficult to duplicate the scale of environment for testing
      • GridServer and EC2 provides a low cost solution
    • Disaster Recover Grids:
      • Again with large environments – it is difficult to duplicate for DR function
      • GridServer and EC2 provides a low-cost, pay only when needed option
    • “ Flex-Service”:
      • If workloads are not meeting desired SLAs – it is expensive and time consuming to add more compute capacity to crowded, expensive corporate datacenters
      • GridServer and EC2 provides a low-cost, solution for ad-hoc workload surges
  • Beta Program Overview
  • Federator 1.5 – Beta Program
    • Program runs from April ‘09 through November ’09
    • Registration will close on March 4
    • Space is limited
    • $25K registration fee
  • Program Benefits
    • Free use of DataSynapse Engines Running on Amazon EC2*
    • No limit on DataSynapse Engines Running on Amazon EC2
    • DataSynapse Engines Running on Amazon EC2 don’t count against existing license caps
    • Access to Federator 1.5 Beta, with periodic updates
    • Discounts on GA version of Federator 1.5
      • * Amazon Infrastructure Charges Still Apply
  • Pricing Post-Beta
    • No limit on DataSynapse Engines Running on Amazon EC2
    • DataSynapse Engines Running on Amazon EC2 don’t count against existing license caps
    • Engine charges are $0.10 per hour, plus Amazon infrastructure charges*
      • * Dependent on Amazon Instance Selected
  • Q & A