• Save
Cloud@ebay
Upcoming SlideShare
Loading in...5
×
 

Cloud@ebay

on

  • 5,392 views

Over the past few years, eBay has been re-architecting its infrastructure, automation tools, applications and processes to move eBay.com from a traditional architecture to a cloud model. During this ...

Over the past few years, eBay has been re-architecting its infrastructure, automation tools, applications and processes to move eBay.com from a traditional architecture to a cloud model. During this journey, as we evaluated multiple infrastructure options, public cloud providers, tools and cloud automation solutions, we learned a lot in every domain. This presentation talks about our motivations, the technical options we evaluated, and our choices.

Statistics

Views

Total Views
5,392
Views on SlideShare
2,740
Embed Views
2,652

Actions

Likes
1
Downloads
0
Comments
0

10 Embeds 2,652

http://www.jcmartin.org 2212
http://localhost 159
http://wiki2.arch.ebay.com 135
http://jcmart.in 103
http://www.jcmart.in 15
http://jchmartin.github.io 15
https://wiki.vip.corp.ebay.com 7
http://translate.googleusercontent.com 3
http://webcache.googleusercontent.com 2
http://69.89.31.96 1
More...

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Cloud@ebay Cloud@ebay Presentation Transcript

  • Cloud @ eBayFrom ground level to clouds
    JC MartinCloud Architect, eBay Marketplace
    @jchmartin
  • Quiz
    Number of App Servers:
    More than 100,000
    10 big ones
    Around 6,000
    Number of active users
    Population of the Philippines (~94M)
    Population of China (~ 1.3B)
    Population of Mendocino, CA (800)
    1 second of downtime
    $5 lost
    $2,000 lost
    $2,000,000 lost
    Best Company to work for
    eBay
  • What is eBay.com
    9
    23
    2
    2Bpage views/day
    23MSLOC
    9Pbof data
    94
    200
    250
    $62
    94M active users
    200Mlive listings
    250Mqueries/day
    $62B2010 gross merchandise volume
    6,000
    75
    6,000 application servers
    75B database calls/day
    Data Analytics
    Search
    Front End
  • Data Analytics
    Search
    Front End
    What is eBay.com
    PCI
    Compliant
    Beta
    PCI
    Compliant
    Production
    Research
    QA
    Skunkworks
  • DR
    Burst toexternal
    Cloud ?
    Number of servers required based on utilization for 8 pools
  • Even at 4x the internal cost, public cloud would save money
    Cloud cost to
    Internal cost
    ratio
    Cost ratio
    Internal cost is dominant
    External cost is dominant
    Servers owned
  • ?
    Private
    Public
    Hybrid
    Build
    Buy
    Build + OSS
  • Hybrid Cloud options
    eBay DC
    Public Cloud
    eBayDC
    PublicCloud
    Ebay environment
    Ebay environment
    Ebay Infrastructure
    Ebay Infrastructure
    Virtual Data Center
    Public Shared Cloud
  • Application Architecture
    Future
    ‘Cloud ready’
    Ongoing
    “Cloud Friendly”
    Before
  • Internal Cloud Technology stack
    Service Catalog
    REST APIs
    Ticket driven run book automation
    Model driven close loop
    automation
    Configuration Management
    Database (CMDB)
    Distributed state Management
    Chargeback
    Pay as you go
    Server Virtualization
    Multitenant infrastructure with secure isolation
  • Infrastructure virtualization
    Virtual Environments
    Prod
    QA
    Exp.
    QA
    Exp.
    Prod
    Application
    App
    App
    App
    Application
    App
    App
    App
    Spare
    spare
    spare
    spare
    Global resource pool
    Infra
    Infra
    Infra
    Infra
    Shared infrastructure
    Silos with custom design
    Virtualized Infrastructure
  • Automate Everything
    Cannot be automated
    The task requires human involvement (e.g. racking and wiring)
    No support for
    automation
    Component lacks API or requires UI based actions (e.g. checkpoint)
    Limited rate ofchange
    Configuration requires restart, reload, file sync (e.g. Bind, ISC DHCP)
    No permission
    Configuration requires special credential/role (e.g. firewall, network)
  • Process Simplification
    request
    {nb servers,model, app }
    order
    receive &rack & wire
    Label (app)
    deliver
    “several”
    weeks
    1 w
    2-3 w
    repurpose
    request
    {nb servers,model }
    order
    Receive pre-racked
    Pre-wired
    deliver to
    cache
    request
    {nb servers,model, app }
    deliver
    quarterly
    45 min
    1 day
    2-3 w
    repurpose
  • Open Source Integration
    IaaS/PaaS API
    IaaS/PaaS API
    orchestration
    Resource
    Allocation
    Distributed
    State
    orchestration
    Resource
    Allocation
    Distributed
    State
    eBay
    Cloud
    Manager
    AuthN/AuthZ
    Application
    Controller
    Access Point
    Controller
    AuthN/AuthZ
    Application
    Controller
    Access Point
    Controller
    Compute
    Controller
    Cluster
    Controller
    Pool
    Controller
    Compute
    Controller
    Cluster
    Controller
    Pool
    Controller
    Adopt and
    Contribute
    Infrastructure
    Management
    Services
    Open Source
    Solution
    (openstack / Cloudstack)
    Compute Mgt.
    DNS Mgt.
    LB Mgt.
    Monitoring
    Network Prov
    Image/Pkg Repo
    Software Dist.