Scalable Memcached-as-a-Service


Memcached for Cloud Deployments featuring Amazon Ec2
8 Dec 2009
Gear6 at a Glance
     •  Focused on Web Scale Architectures
           »  Dynamic sites require DYNAMIC DATA SERVICES
           »  Memcached is the “linchpin”


     •  Gear6 Web Cache: Leading mission critical Memcached distribution
           »  Enables sites to reliably and efficiently scale, cut costs and increase transactions


     •  Company is serving a broadening market:
           »  More dynamic applications
           »  Geographically distributed
           »  Platform diverse: sites and users


     •  Expanding sales and customer base
           »  Sales talent from Rackable, Hyperic, Red Hat, and Akamai
           »  Strong customer growth: Glam, Bowker, Answers, myYearbook, etc.
           »  #1 commercial distro for Memcached




2: Copyright 2009 Gear6 Inc., 8 Dec 2009
Truism



                   “Everything runs from

                     Memory in Web 2.0”
           »  Evan Weaver, Twitter, March 2009




3: Copyright 2009 Gear6 Inc., 8 Dec 2009
The Shift to Dynamic Content
    Facts:
    ➜  Web 2.0 driving user traffic and growth
    ➜  Mobile, Broadband, Population and Content are web accelerators
    ➜  Shift to Dynamic Content puts strain on origin sites (CDN not the Answer)
    ➜  Most sites (over 65%) based on LAMP or JAVA
                          Web Stack                  Net
                                                                                                                        Interface
   Storage                                                                                                                                     Clients
                                                          PHP, Java, Rails, C,
                                              Database




                                                                                                                                    Internet
                                                                                            Apache, Nginx,
                                                                                 Servers



                                                                                                             Servers

                                                            Perl, Python
                               PostgreSQL 




                                                                                              Lighttpd
                                 MySQL,




                                                                                                              Web
                                                                                   App
                                                                                                                         Proxy
                                                                                                                                     CDN

                                                                                                                         Load                  client cache
Storage cache                                                                                                           Balancer

                                                     Cache Services
                                                          memcached

4: Copyright 2009 Gear6 Inc., 8 Dec 2009
Truism II



            “Everything in the Cloud
                runs in Memory”  




5: Copyright 2009 Gear6 Inc., 8 Dec 2009
How Do I Run More from Memory?




                                           Memcached




6: Copyright 2009 Gear6 Inc., 8 Dec 2009
Memcached Significance
     In General:
     •  Web 2.0 overwhelmingly depends on it
           »  Can’t use a CDN for Dynamic Apps & Personalized Content


     For the Cloud:
     •  Dynamic sites in the Cloud depend on it
           »  Speeds up “rendering time” by 50-200x
           »  Significant cost advantages over adding more application
              and data base cloud images
                   • Lower cost
                   • Lower complexity
                   • Better utility



7: Copyright 2009 Gear6 Inc., 8 Dec 2009
Today’s News
Gear6 Web Cache Server for the Cloud
     •  Gear6 Web Cache: Memcached-as-a-Service
           »  First commercial Memcached service for cloud platforms

           »  Free and paid image sizes available
                   •  32 bit free
                   •  64 bit paid


           »  Available on EC2:
                   •  First Memcached service to use High-Memory Instances on EC2


           »  First to leverage block storage interface
                   •  Benefit: More high performance cache capacity per AMI


           »  Community and commercial support for Memcached



9: Copyright 2009 Gear6 Inc., 8 Dec 2009
Benefits of Gear6 Web Cache Server
     Higher Utility; Ease-of-Use

     •  No code changes - 100% Memcapable
           »  Full Memcached protocol compliance


     •  Up to 50% more use of AMI RAM
           »  Memory optimization via Gear6 “Slab Manager”
           »  Fewer instances needed


     •  Cache depth amplification
           »  Unique to G6 offering: Transparent use of block storage
           »  Leverages Gear6 Media Allocator
           »  Balances DRAM and storage while maintaining high performance


     •  Easy to manage and monitor
           »  Memcached Web GUI Interface


     •  Memcached Commercial Support
           »  Clients and Gear6 Web Cache Server
           »  24x7 customer support for Commercial 


10: Copyright 2009 Gear6 Inc., 8 Dec 2009
Gear6 Web Cache Server for EC2
     Higher Utility; Ease-of-Use


                                            +            =


 Higher
                                            +            =   +
 Utility:


Ease-of-Use                                     server


»  Web interface for monitoring
        •  Graphical & Text
        •  24 hour historical data

»  Auto-configurator for EC2

»  REST API
        •  Support URL style queries
        •  Benefit : Easy integration for
           web deployments




11: Copyright 2009 Gear6 Inc., 8 Dec 2009
Gear6 Web Cache Server
     Increasing Cloud Utility: “2B or not 2B”

Deploy in Cloud                             Speed Apps                Scale with
 with AWS                                    with Memcached            Gear6 Web Cache
  »  On-demand
                             »  Offload apps and DB
   »  Increase efficiency of
  »  Low cost of entry
                     »  Decrease latency
         every image
  »  Scale by “replication”
                                          »  Consolidate images
  »  Image management                                                 »  Decrease costs
     becomes issue




12: Copyright 2009 Gear6 Inc., 8 Dec 2009
Education: Amazon EC2 Images
     Linux, USA
           Standard
         Memory
          High-




13: Copyright 2009 Gear6 Inc., 8 Dec 2009
Gear6 Web Cache Server Pricing
     EC2 (USA)


                                                              +

                             Standard
                           Memory
                            High-




                         * Note: AWS charges still apply for 32 bit offering




14: Copyright 2009 Gear6 Inc., 8 Dec 2009
DIY vs Gear6 Web Cache Server
     Linux, USA



Higher
Utility:                               +                              =      +




                      * Note: AWS charges still apply for 32 bit offering
                      ** Note: Gear6 priced offerings include 24x7 support


15: Copyright 2009 Gear6 Inc., 8 Dec 2009
Gear6 Web Cache Server AMI Support
     Linux, USA
               Standard
               High-Memory




16: Copyright 2009 Gear6 Inc., 8 Dec 2009
Internet




                                                                     AWS
                                                                                   EC2 – Web / Application Servers
                                                                                   -Auto Scaling to meet demand



                                                                     EC2 – Gear6 Web Cache
                                                                     -Auto Scaling to meet demand




                            S3 – Large object store 
   RDS – Dynamic data       SimpleDB– Static data
                            (eg video)
                 (profile information)
    (eg Credentials)




17: Copyright 2009 Gear6 Inc., 8 Dec 2009
Use Case 2 - Hybrid

                                            App / Web Tier
            Load Balancer
          MySQL
                                                              (Spike in traffic directs to AWS)
                        Gear6 Web Cache




                   Data Centre
                                                                                                   Internet
                                                              AWS
                                                               EC2 – Web / Application Servers
                                                               -Auto Scaling to meet demand


                                                       EC2 – Gear6 Web Cache Server
                                                       -Auto Scaling to meet demand



                                                      RDS – Dynamic data
                                                      (profile information)




18: Copyright 2009 Gear6 Inc., 8 Dec 2009
Web Cache Product Packaging
     Full Spectrum Deployment Options: Dedicated & On-Demand

              Q2 2009                                                         2H 2009

Gear6 Web Cache 2.2        Gear 6 Web Cache 2.3      Gear 6 Web Cache 2.3.5          Gear 6 Web Cache Server
 General Availability         MHP Services              Universal Distro             Cloud AMI & Framework




Key Innovations:            Key Innovations:            Key Innovations:             Key Innovations:
•  Flash support            •  Rich programmatic        •  Performance               •  Multi size offering
•  Memory optimization         interface/API for           Improvements: IO,         •  Efficient server
•  Failover                    platform management         threading, locking        •  Media Allocator
•  Replication              •  Multi-tenancy            •  Statistics Improvements   •  Web reporting
•  Non-disruptive           •  IP consolidation                                         mechanism
   upgrades                 •  Enhanced management                                   •  Free and paid versions
•  Advanced Memcached          interface
   reporting                •  Secure memcached
                               “zones”



     •  Gear6 Cloud Offering priced for standard and high-memory instances
     •  Gear6 offers free images on 32 bit platforms
     •  Gear6 offers all major deployment options (data centre, MHP and cloud)



19: Copyright 2009 Gear6 Inc., 8 Dec 2009
Summary
     •  Gear6 provides #1 commercial distro of Memcached
           »  Leading customers in social networking, ecommerce, gaming web
              segments
           »  Several top 10 fastest growing sites run on Gear6
           »  Seeing customers migrate from closed and niche distributed caching
              systems


     •  Gear6 go-to-market rapidly expanding
           »  Delivery to more geographies and more platforms
           »  Early lead in customer deployment (GA) is paying dividends in terms of
              sales process, use cases, customer requirements and roadmap


     •  Cloud is the next mass platform!
           »  Gear6 delivers advanced cloud-based memcached solutions to users
           »  Gear6 Web Cache Server provides cloud customers higher performance,
              better utility and ease-of-use



20: Copyright 2009 Gear6 Inc., 8 Dec 2009
21: Copyright 2009 Gear6 Inc., 8 Dec 2009

Introduction to First Commercial Memcached Service for Cloud

  • 1.
    Scalable Memcached-as-a-Service Memcached forCloud Deployments featuring Amazon Ec2 8 Dec 2009
  • 2.
    Gear6 at aGlance •  Focused on Web Scale Architectures »  Dynamic sites require DYNAMIC DATA SERVICES »  Memcached is the “linchpin” •  Gear6 Web Cache: Leading mission critical Memcached distribution »  Enables sites to reliably and efficiently scale, cut costs and increase transactions •  Company is serving a broadening market: »  More dynamic applications »  Geographically distributed »  Platform diverse: sites and users •  Expanding sales and customer base »  Sales talent from Rackable, Hyperic, Red Hat, and Akamai »  Strong customer growth: Glam, Bowker, Answers, myYearbook, etc. »  #1 commercial distro for Memcached 2: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 3.
    Truism “Everything runs from
 Memory in Web 2.0” »  Evan Weaver, Twitter, March 2009 3: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 4.
    The Shift toDynamic Content Facts: ➜  Web 2.0 driving user traffic and growth ➜  Mobile, Broadband, Population and Content are web accelerators ➜  Shift to Dynamic Content puts strain on origin sites (CDN not the Answer) ➜  Most sites (over 65%) based on LAMP or JAVA Web Stack Net Interface Storage Clients PHP, Java, Rails, C, Database Internet Apache, Nginx, Servers Servers
 Perl, Python PostgreSQL Lighttpd MySQL, Web App Proxy CDN Load client cache Storage cache Balancer Cache Services memcached 4: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 5.
    Truism II “Everything in the Cloud runs in Memory” 5: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 6.
    How Do IRun More from Memory? Memcached 6: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 7.
    Memcached Significance In General: •  Web 2.0 overwhelmingly depends on it »  Can’t use a CDN for Dynamic Apps & Personalized Content For the Cloud: •  Dynamic sites in the Cloud depend on it »  Speeds up “rendering time” by 50-200x »  Significant cost advantages over adding more application and data base cloud images • Lower cost • Lower complexity • Better utility 7: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 8.
  • 9.
    Gear6 Web CacheServer for the Cloud •  Gear6 Web Cache: Memcached-as-a-Service »  First commercial Memcached service for cloud platforms »  Free and paid image sizes available •  32 bit free •  64 bit paid »  Available on EC2: •  First Memcached service to use High-Memory Instances on EC2 »  First to leverage block storage interface •  Benefit: More high performance cache capacity per AMI »  Community and commercial support for Memcached 9: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 10.
    Benefits of Gear6Web Cache Server Higher Utility; Ease-of-Use •  No code changes - 100% Memcapable »  Full Memcached protocol compliance •  Up to 50% more use of AMI RAM »  Memory optimization via Gear6 “Slab Manager” »  Fewer instances needed •  Cache depth amplification »  Unique to G6 offering: Transparent use of block storage »  Leverages Gear6 Media Allocator »  Balances DRAM and storage while maintaining high performance •  Easy to manage and monitor »  Memcached Web GUI Interface •  Memcached Commercial Support »  Clients and Gear6 Web Cache Server »  24x7 customer support for Commercial 10: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 11.
    Gear6 Web CacheServer for EC2 Higher Utility; Ease-of-Use + = Higher + = + Utility: Ease-of-Use server »  Web interface for monitoring •  Graphical & Text •  24 hour historical data »  Auto-configurator for EC2 »  REST API •  Support URL style queries •  Benefit : Easy integration for web deployments 11: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 12.
    Gear6 Web CacheServer Increasing Cloud Utility: “2B or not 2B” Deploy in Cloud Speed Apps Scale with with AWS with Memcached Gear6 Web Cache »  On-demand »  Offload apps and DB »  Increase efficiency of »  Low cost of entry »  Decrease latency every image »  Scale by “replication” »  Consolidate images »  Image management »  Decrease costs becomes issue 12: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 13.
    Education: Amazon EC2Images Linux, USA Standard Memory High- 13: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 14.
    Gear6 Web CacheServer Pricing EC2 (USA) + Standard Memory High- * Note: AWS charges still apply for 32 bit offering 14: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 15.
    DIY vs Gear6Web Cache Server Linux, USA Higher Utility: + = + * Note: AWS charges still apply for 32 bit offering ** Note: Gear6 priced offerings include 24x7 support 15: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 16.
    Gear6 Web CacheServer AMI Support Linux, USA Standard High-Memory 16: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 17.
    Internet AWS EC2 – Web / Application Servers -Auto Scaling to meet demand EC2 – Gear6 Web Cache -Auto Scaling to meet demand S3 – Large object store RDS – Dynamic data SimpleDB– Static data (eg video) (profile information) (eg Credentials) 17: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 18.
    Use Case 2- Hybrid App / Web Tier Load Balancer MySQL (Spike in traffic directs to AWS) Gear6 Web Cache Data Centre Internet AWS EC2 – Web / Application Servers -Auto Scaling to meet demand EC2 – Gear6 Web Cache Server -Auto Scaling to meet demand RDS – Dynamic data (profile information) 18: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 19.
    Web Cache ProductPackaging Full Spectrum Deployment Options: Dedicated & On-Demand Q2 2009 2H 2009 Gear6 Web Cache 2.2 Gear 6 Web Cache 2.3 Gear 6 Web Cache 2.3.5 Gear 6 Web Cache Server General Availability MHP Services Universal Distro Cloud AMI & Framework Key Innovations: Key Innovations: Key Innovations: Key Innovations: •  Flash support •  Rich programmatic •  Performance •  Multi size offering •  Memory optimization interface/API for Improvements: IO, •  Efficient server •  Failover platform management threading, locking •  Media Allocator •  Replication •  Multi-tenancy •  Statistics Improvements •  Web reporting •  Non-disruptive •  IP consolidation mechanism upgrades •  Enhanced management •  Free and paid versions •  Advanced Memcached interface reporting •  Secure memcached “zones” •  Gear6 Cloud Offering priced for standard and high-memory instances •  Gear6 offers free images on 32 bit platforms •  Gear6 offers all major deployment options (data centre, MHP and cloud) 19: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 20.
    Summary •  Gear6 provides #1 commercial distro of Memcached »  Leading customers in social networking, ecommerce, gaming web segments »  Several top 10 fastest growing sites run on Gear6 »  Seeing customers migrate from closed and niche distributed caching systems •  Gear6 go-to-market rapidly expanding »  Delivery to more geographies and more platforms »  Early lead in customer deployment (GA) is paying dividends in terms of sales process, use cases, customer requirements and roadmap •  Cloud is the next mass platform! »  Gear6 delivers advanced cloud-based memcached solutions to users »  Gear6 Web Cache Server provides cloud customers higher performance, better utility and ease-of-use 20: Copyright 2009 Gear6 Inc., 8 Dec 2009
  • 21.
    21: Copyright 2009Gear6 Inc., 8 Dec 2009