Open stack@ebay
Upcoming SlideShare
Loading in...5
×
 

Open stack@ebay

on

  • 2,794 views

 

Statistics

Views

Total Views
2,794
Views on SlideShare
2,688
Embed Views
106

Actions

Likes
8
Downloads
225
Comments
1

3 Embeds 106

https://twitter.com 103
http://irq.tumblr.com 2
http://moderation.local 1

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Thanks for sharing Subbu!
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Open stack@ebay Open stack@ebay Presentation Transcript

  • OpenStack  Private   Cloud  at  eBay   OpenStack  Design  Summit  –  Nov  2013   1  
  • Analyst Conference 2013 John Donahoe- CEO Marc Carges - CTO Bob Swan - CFO Devin Wenig – President eBay NA
  • Prod Prod QA PCI Secure QA DEV QA DEV DEV
  • Frictionless on- Multi-tenant, demand access isolated One cloud on shared infra billmelater.com brands4friends.de corp.ebay.com ebay-kleinanzeigen.de ebay.ca ebay.com ebay.de gumtree.com hunch.com marketplats.ne milo.com 5/1/2013 6/1/2013 7/1/2013 8/1/2013 Users 5/1/13 6/1/13 7/1/13 VMs Created 9/1/2013 10/1/2013 Projects 8/1/13 9/1/13 VMs Deleted 10/1/13 5/1/2013 6/1/2013 7/1/2013 8/1/2013 Cores 9/1/2013 10/1/2013 4
  • project project VPC … project project … VPC Availability Zone project … project VPC VPC Availability Zone Region … project … VPC AZ Region Globally Shared infra (Compute, Network, Storage) 5  
  • OpenStack APIs Project -> VPC Network -> VPC Dashboard VPC selection Capacity based Network selection Images -> VPC Dashboard AZ selection Class of Service (PCI, DEV, PROD, …) VPC Virtual Networks Block, Object Storage Flavors classes Managed images Large scale networks Multi tiers storage Commodity H/W Win/Linux 6  
  • OpenStack  is  not  cloud   hDp://www.subbu.org/blog/2013/07/openstack-­‐is-­‐not-­‐cloud   7  
  • Cloud  is  a   service!   Metering   and   chargeback   Monitoring   and  alerRng   High   availability   RemediaRon   Config   management   Log   processing   Infra   onboarding   Scale  out   OpenStack   APIs   Metrics   Cloud   monitoring   Autoscaling   Capacity   planning   CI   Network   design   Upgrades   Builds   Net/info  sec   SLA   AlerRng   Incident   resoluRon   User   experience   Customer   support  
  • Monitoring   9  
  • nova  boot        -­‐-­‐image  a4a3d552-­‐4f92-­‐4426-­‐82d9-­‐ff2226d72d08        -­‐-­‐flavor  medium  myvm   Is  the  cloud  broken?   User   ?   You   10  
  • RabbitMQ   Capacity  issues   Quantum  plugin  failures   vm_state=ACTIVE   does  not  really   mean  success   Glance  down   Didn’t  get  DHCP  in   Ame  for  cloud  init   Metadata   Aming  out   11  
  • Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   1   Grok  paDerns   ØMQ   logstash   ElasRcSearch   ØMQ   logstash   ElasRcSearch   kibana   ØMQ   logstash   ElasRcSearch   2   Low  latency   3   A  cluster  that  can   scale  horizontally   12  
  • Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   ØMQ   logstash   ElasRcSearch   ØMQ   logstash   ElasRcSearch   kibana   ØMQ   logstash   ElasRcSearch   Graphite   StatsD   Zabbix   Metrics   Monitoring   Alerts   13  
  • Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   ØMQ   logstash   ElasRcSearch   ØMQ   logstash   ElasRcSearch   kibana   ØMQ   logstash   ElasRcSearch   Graphite   StatsD   OpenStack  nodes,   processes,  network,   storage,  …   Is  the  cloud  broken?   Zabbix   May  be?   14  
  • Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   Log   source   logstash   ØMQ   ØMQ   logstash   ElasRcSearch   ØMQ   logstash   ElasRcSearch   kibana   ØMQ   logstash   ElasRcSearch   Graphite   StatsD   StackWatch   Simulate   KPIs   •  •  •  •  •  OpenStack  nodes,   processes,  network,   storage,  …   Zabbix   StackMetrics   Create,  delete   Volumes   Ping  success   Ping  latency   …   hDp://www.subbu.org/blog/2013/10/monitoring-­‐and-­‐alerRng-­‐for-­‐openstack   15  
  • Scale  out   16  
  • One  Cloud  User  Experience   Availability  for  Business   Availability   1.  Nova  “availability  zones”   2.  Keystone  “regions”   3.  Nova  “cells”   Capacity   17  
  • AWS   Region  A   Region  B   Availability   Zone   Availability   Zone   Availability   Zone   Availability   Zone   Availability   Zone   keystone glance Availability  Zone   nova API Hypervisors cinder API Block storage backend neutron API network driver + agents + infra swift API storage 18  
  • Region A Dashboard Nova Keystone Quantum Cinder Glance Swift region services az services infra Dashboard behind a global load balancer VIP user chosen replication of selected resources Region C Dashboard Keystone Glance Region B Dashboard Nova Keystone Quantum Cinder Glance Swift region services az services infra Region  ≈  A  fully  decoupled   OpenStack  deployment   Nova Quantum Cinder Swift region services az services infra Availability  Zone     ≈  Keystone  “region”   Nova  availability  zone?   Nova  cells  –  an  implementaRon  detail   19  
  • Build  and  Deployment   20  
  • Ubuntu,  apt,  fabric   Ubuntu,  apt,  puppet  and  foreman   Pet  test  clouds   1.  Bare-­‐metal  provisioning  for  hypervisors,   controllers,  NVP,  …   2.  Virt  env  tarballs,  puppet  and  foreman   3.  A  full  working  deployment!   CaDle  test  clouds   Patches     ParRal  upgrades   Rollbacks   1.  Change  orchestraRon   2.  Foreman  UI  “ClickOps”   21  
  • Our  Commitment  to  the  Community   •  Puppet  automaRon   •  Full  topology  with  virtual  environments   •  ProducRon  ready   •  Zabbix  templates     •  StackWatch  and  StackMetrics   •  Contribute  on  VPCs   •  Contribute  on  scale-­‐out  paDerns   22  
  • JC  MarRn   Subbu  Allamaraju       @jchmarRn   @sallamar   23