SlideShare a Scribd company logo
Neal Sample VP Architecture, Platform Products, Developers Program
eBay’s global commerce platform
eBay marketplace = economy of scale  9 23 2 2Bpage views/day 23Mlines of code 9Petabytesof data storage 94 200 $62 94M active users 200Mlive listings $62B2010 gross merchandise volume 6,000 75 6,000 application servers 75B database calls/day Commercial data warehouse 100x larger than Library of Congress
Cloud bursting: ↓ costs by ↑ efficiency 2000 1800 1600 1400 1200 1000 800 600 400 200 0 Fixed Cost Datacenter efficiency Cloud Burst Energy-proportional computing Excess Capacity Ideal Remove the peaks Request for Data Current Traffic text text text text text text text text Timeline
Datacenter efficiency TIER II 2(N+1) TIER IV N+1 Datacenter tier = level of redundancy Blend of Tier IV & Tier II Minimum 30% reduction in OpEx cost per MW enables cost effective operations/expansion. 50% reduction in CapEx for new lower-tier datacenters (Tier IV vs. Tier II) Burst Capacity (DC and Cloud)
Energy-proportional computing Traffic KWh cost / incentives / forecasts Meta  Scheduler BMS metrics SLA Models Utilization (headroom) Availability Cloud  Bursting SLC PHX (Tier 4) PHX (Tier2) Direct traffic to the most economical location / optimize placement within DC
Financial model structure Hourly demand(in average TPS) Hourly demand(in average TPS) Historical (from ODW) or predicted Historical (from ODW) or predicted Define a standard CU Define a standard CU Hourly computing units (CU) required Max TPS per CU Hourly computing units (CU) required Max TPS per CU Based on server inventoryand growth forecast Based on server inventoryand growth forecast Hourly CUs neededin external cloud Number of CU in internal cloud Hourly CUs neededin external cloud Number of CU in internal cloud Negotiated price with public cloud vendor Negotiated price with public cloud vendor Hourly cost of CUin external cloud Hourly total cost Hourly cost of CU in internal cloud Hourly cost of CUin external cloud Hourly total cost Hourly cost of CU in internal cloud HW/SW lease, networking, space, power, laborPredict future costs trends HW/SW lease, networking, space, power, laborPredict future costs trends Sum cost over period Sum cost over period Evaluate tradeoffs by varying size of internal cloud, and costs Evaluate tradeoffs by varying size of internal cloud, and costs
Cost components Datacenter People Total cost per CU/h : $1.07
TSP ↑ = more attractive options for cloud bursts All self operated CUs TPS and FE Compute Units (CU) 24-Month Projects Load served by external cloud Historical TPS hourly data from ODW CU decreasing by Lease expiration Load served by self operated CU
Cost-benefit analysis DC CUs Impact on Project Annual Cost 9/2010 – 8/2011 DC CU Hr Cost = 1.07, 30 TPS per CU 60,000,000 Cloud cost ($/hour) Total Cost ($) 0.5 0.8 1 40,000,000 1.1 1.2 1.5 2 3 4 20,000,000 0 DCs $20M 0 DCs $30M 3K DCs $40M 3.5K DCs $45M 4K DCs $47M 4.8K DCs $52M 5K DCs $55M 0 2000 4000 6000 8000 DC CUs
Focus for the future Business Intelligence ,[object Object]
Customer experience

More Related Content

What's hot

Optimizing joins in Map reduce jobs via Lookup Service
Optimizing joins in Map reduce jobs via Lookup ServiceOptimizing joins in Map reduce jobs via Lookup Service
Optimizing joins in Map reduce jobs via Lookup Service
Rohit kochar
 
More on my LinkedIn Summary
More on my LinkedIn SummaryMore on my LinkedIn Summary
More on my LinkedIn Summary
Mike Eghtebas
 
How to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR DataHow to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR Data
Safe Software
 
Efficient processing of Rank-aware queries in Map/Reduce
Efficient processing of Rank-aware queries in Map/ReduceEfficient processing of Rank-aware queries in Map/Reduce
Efficient processing of Rank-aware queries in Map/Reduce
Spiros Oikonomakis
 
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
Amazon Web Services
 
Tech Thursday - Beer & DevOps 24.11.
Tech Thursday - Beer & DevOps 24.11.Tech Thursday - Beer & DevOps 24.11.
Tech Thursday - Beer & DevOps 24.11.
Nebula Oy
 
Big Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the CloudBig Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the Cloud
George Ang
 
GCS' Private Cloud Analysis
GCS' Private Cloud AnalysisGCS' Private Cloud Analysis
GCS' Private Cloud Analysis
joegleinser
 
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
Florian Benz
 
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Amazon Web Services
 
DSD-INT 2018 Earth Science Through Datacubes - Merticariu
DSD-INT 2018 Earth Science Through Datacubes - MerticariuDSD-INT 2018 Earth Science Through Datacubes - Merticariu
DSD-INT 2018 Earth Science Through Datacubes - Merticariu
Deltares
 
Series Meetup #1: Speech 1: Computing
Series Meetup #1: Speech 1: Computing Series Meetup #1: Speech 1: Computing
Series Meetup #1: Speech 1: Computing
AWS Vietnam Community
 
GO and GCP: Introduction
GO and GCP: IntroductionGO and GCP: Introduction
GO and GCP: Introduction
Viktor Pakhuchyi
 
Cloud Modeling vs Internal vs Global Market using Burstorm Platform
Cloud Modeling vs Internal vs Global Market using Burstorm PlatformCloud Modeling vs Internal vs Global Market using Burstorm Platform
Cloud Modeling vs Internal vs Global Market using Burstorm Platform
Scott Goessling
 
CloudCamp Athens presentation: Introduction to cloud computing
CloudCamp Athens presentation: Introduction to cloud computingCloudCamp Athens presentation: Introduction to cloud computing
CloudCamp Athens presentation: Introduction to cloud computing
Fotis Stamatelopoulos
 
NoSQL and Cloud Services - Philip Balinow, Comfo
NoSQL and Cloud Services -  Philip Balinow, ComfoNoSQL and Cloud Services -  Philip Balinow, Comfo
NoSQL and Cloud Services - Philip Balinow, Comfo
beITconference
 
Scaling clusters to thousands of servers in the cloud
Scaling clusters to thousands of servers in the cloudScaling clusters to thousands of servers in the cloud
Scaling clusters to thousands of servers in the cloud
TechExeter
 
Transforming Rasters and Point Clouds
Transforming Rasters and Point CloudsTransforming Rasters and Point Clouds
Transforming Rasters and Point Clouds
Safe Software
 
Aws cloud big data trends
Aws cloud big data trendsAws cloud big data trends
Aws cloud big data trends
hubaym
 
Introduction to cloud computing
Introduction to cloud computingIntroduction to cloud computing
Introduction to cloud computing
Ahmad Sakhleh
 

What's hot (20)

Optimizing joins in Map reduce jobs via Lookup Service
Optimizing joins in Map reduce jobs via Lookup ServiceOptimizing joins in Map reduce jobs via Lookup Service
Optimizing joins in Map reduce jobs via Lookup Service
 
More on my LinkedIn Summary
More on my LinkedIn SummaryMore on my LinkedIn Summary
More on my LinkedIn Summary
 
How to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR DataHow to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR Data
 
Efficient processing of Rank-aware queries in Map/Reduce
Efficient processing of Rank-aware queries in Map/ReduceEfficient processing of Rank-aware queries in Map/Reduce
Efficient processing of Rank-aware queries in Map/Reduce
 
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
(BDT202) HPC Now Means 'High Personal Computing' | AWS re:Invent 2014
 
Tech Thursday - Beer & DevOps 24.11.
Tech Thursday - Beer & DevOps 24.11.Tech Thursday - Beer & DevOps 24.11.
Tech Thursday - Beer & DevOps 24.11.
 
Big Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the CloudBig Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the Cloud
 
GCS' Private Cloud Analysis
GCS' Private Cloud AnalysisGCS' Private Cloud Analysis
GCS' Private Cloud Analysis
 
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
Analyzing and processing FInancial Market Data on AWS with Kinesis - AWS Pop ...
 
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
 
DSD-INT 2018 Earth Science Through Datacubes - Merticariu
DSD-INT 2018 Earth Science Through Datacubes - MerticariuDSD-INT 2018 Earth Science Through Datacubes - Merticariu
DSD-INT 2018 Earth Science Through Datacubes - Merticariu
 
Series Meetup #1: Speech 1: Computing
Series Meetup #1: Speech 1: Computing Series Meetup #1: Speech 1: Computing
Series Meetup #1: Speech 1: Computing
 
GO and GCP: Introduction
GO and GCP: IntroductionGO and GCP: Introduction
GO and GCP: Introduction
 
Cloud Modeling vs Internal vs Global Market using Burstorm Platform
Cloud Modeling vs Internal vs Global Market using Burstorm PlatformCloud Modeling vs Internal vs Global Market using Burstorm Platform
Cloud Modeling vs Internal vs Global Market using Burstorm Platform
 
CloudCamp Athens presentation: Introduction to cloud computing
CloudCamp Athens presentation: Introduction to cloud computingCloudCamp Athens presentation: Introduction to cloud computing
CloudCamp Athens presentation: Introduction to cloud computing
 
NoSQL and Cloud Services - Philip Balinow, Comfo
NoSQL and Cloud Services -  Philip Balinow, ComfoNoSQL and Cloud Services -  Philip Balinow, Comfo
NoSQL and Cloud Services - Philip Balinow, Comfo
 
Scaling clusters to thousands of servers in the cloud
Scaling clusters to thousands of servers in the cloudScaling clusters to thousands of servers in the cloud
Scaling clusters to thousands of servers in the cloud
 
Transforming Rasters and Point Clouds
Transforming Rasters and Point CloudsTransforming Rasters and Point Clouds
Transforming Rasters and Point Clouds
 
Aws cloud big data trends
Aws cloud big data trendsAws cloud big data trends
Aws cloud big data trends
 
Introduction to cloud computing
Introduction to cloud computingIntroduction to cloud computing
Introduction to cloud computing
 

Similar to Openstack and eBay

Mr. Scott Manson's presentation at QITCOM 2011
Mr. Scott Manson's presentation at QITCOM 2011Mr. Scott Manson's presentation at QITCOM 2011
Mr. Scott Manson's presentation at QITCOM 2011
QITCOM
 
Notes
NotesNotes
Notes
Aball233
 
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open CloudCoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
Ata Turk
 
MS Cloudeconomics
MS CloudeconomicsMS Cloudeconomics
MS Cloudeconomics
Rateb Abu Hawieleh
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
Yinlin Chen
 
Why Isn't the Cloud Cheaper - John Merline, Milwaukee
 Why Isn't the Cloud Cheaper - John Merline, Milwaukee Why Isn't the Cloud Cheaper - John Merline, Milwaukee
Why Isn't the Cloud Cheaper - John Merline, Milwaukee
AWS Chicago
 
Private cloud with z enterprise
Private cloud with z enterprisePrivate cloud with z enterprise
Private cloud with z enterprise
Jim Porell
 
A viewof cloud computing
A viewof cloud computingA viewof cloud computing
A viewof cloud computing
purplesea
 
Summer Intern Report
Summer Intern ReportSummer Intern Report
Summer Intern Report
Shantanu Bharadwaj
 
VmWare - 14oct2010
VmWare - 14oct2010VmWare - 14oct2010
VmWare - 14oct2010
Agora Group
 
Government Applications of Cloud Computing
Government Applications of Cloud ComputingGovernment Applications of Cloud Computing
Government Applications of Cloud Computing
Roger Smith
 
Virtualization Business Case
Virtualization Business CaseVirtualization Business Case
Virtualization Business Case
TopLine Strategies
 
Accelerating Cloud Services - Intel
Accelerating Cloud Services - IntelAccelerating Cloud Services - Intel
Accelerating Cloud Services - Intel
Amazon Web Services
 
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
Amazon Web Services
 
AViewofCloudComputing.ppt
AViewofCloudComputing.pptAViewofCloudComputing.ppt
AViewofCloudComputing.ppt
MrGopirajanPV
 
AViewofCloudComputing.ppt
AViewofCloudComputing.pptAViewofCloudComputing.ppt
AViewofCloudComputing.ppt
ShashikanthBoorla1
 
A View of Cloud Computing.ppt
A View of Cloud Computing.pptA View of Cloud Computing.ppt
A View of Cloud Computing.ppt
AriaNasi
 
Cloud computing skepticism - But i'm sure
Cloud computing skepticism - But i'm sureCloud computing skepticism - But i'm sure
Cloud computing skepticism - But i'm sure
Nguyen Duong
 
Feasibility of cloud migration for large enterprises
Feasibility of cloud migration for large enterprisesFeasibility of cloud migration for large enterprises
Feasibility of cloud migration for large enterprises
Anant Damle
 
Green Cloud Computing :Emerging Technology
Green Cloud Computing :Emerging TechnologyGreen Cloud Computing :Emerging Technology
Green Cloud Computing :Emerging Technology
IRJET Journal
 

Similar to Openstack and eBay (20)

Mr. Scott Manson's presentation at QITCOM 2011
Mr. Scott Manson's presentation at QITCOM 2011Mr. Scott Manson's presentation at QITCOM 2011
Mr. Scott Manson's presentation at QITCOM 2011
 
Notes
NotesNotes
Notes
 
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open CloudCoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
 
MS Cloudeconomics
MS CloudeconomicsMS Cloudeconomics
MS Cloudeconomics
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Why Isn't the Cloud Cheaper - John Merline, Milwaukee
 Why Isn't the Cloud Cheaper - John Merline, Milwaukee Why Isn't the Cloud Cheaper - John Merline, Milwaukee
Why Isn't the Cloud Cheaper - John Merline, Milwaukee
 
Private cloud with z enterprise
Private cloud with z enterprisePrivate cloud with z enterprise
Private cloud with z enterprise
 
A viewof cloud computing
A viewof cloud computingA viewof cloud computing
A viewof cloud computing
 
Summer Intern Report
Summer Intern ReportSummer Intern Report
Summer Intern Report
 
VmWare - 14oct2010
VmWare - 14oct2010VmWare - 14oct2010
VmWare - 14oct2010
 
Government Applications of Cloud Computing
Government Applications of Cloud ComputingGovernment Applications of Cloud Computing
Government Applications of Cloud Computing
 
Virtualization Business Case
Virtualization Business CaseVirtualization Business Case
Virtualization Business Case
 
Accelerating Cloud Services - Intel
Accelerating Cloud Services - IntelAccelerating Cloud Services - Intel
Accelerating Cloud Services - Intel
 
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
Cloud Economics: Transform Businesses at Lower Costs - AWS Summit Bahrain 2017
 
AViewofCloudComputing.ppt
AViewofCloudComputing.pptAViewofCloudComputing.ppt
AViewofCloudComputing.ppt
 
AViewofCloudComputing.ppt
AViewofCloudComputing.pptAViewofCloudComputing.ppt
AViewofCloudComputing.ppt
 
A View of Cloud Computing.ppt
A View of Cloud Computing.pptA View of Cloud Computing.ppt
A View of Cloud Computing.ppt
 
Cloud computing skepticism - But i'm sure
Cloud computing skepticism - But i'm sureCloud computing skepticism - But i'm sure
Cloud computing skepticism - But i'm sure
 
Feasibility of cloud migration for large enterprises
Feasibility of cloud migration for large enterprisesFeasibility of cloud migration for large enterprises
Feasibility of cloud migration for large enterprises
 
Green Cloud Computing :Emerging Technology
Green Cloud Computing :Emerging TechnologyGreen Cloud Computing :Emerging Technology
Green Cloud Computing :Emerging Technology
 

More from Open Stack

OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overview
Open Stack
 
OpenStack Swift overview oscon2011
OpenStack Swift overview oscon2011OpenStack Swift overview oscon2011
OpenStack Swift overview oscon2011
Open Stack
 
Dell Crowbar and OpenStack at OSCON
Dell Crowbar and OpenStack at OSCONDell Crowbar and OpenStack at OSCON
Dell Crowbar and OpenStack at OSCONOpen Stack
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
Open Stack
 
OpenStack Technology Overview
OpenStack Technology OverviewOpenStack Technology Overview
OpenStack Technology Overview
Open Stack
 
JCO Conference OpenStack
JCO Conference OpenStackJCO Conference OpenStack
JCO Conference OpenStack
Open Stack
 
OpenStack 101 Technical Overview
OpenStack 101 Technical OverviewOpenStack 101 Technical Overview
OpenStack 101 Technical Overview
Open Stack
 
Nova HA
Nova HANova HA
Nova HA
Open Stack
 
Nebula james Williams
Nebula james WilliamsNebula james Williams
Nebula james Williams
Open Stack
 
Open stack dashboard diablo
Open stack dashboard   diabloOpen stack dashboard   diablo
Open stack dashboard diablo
Open Stack
 
Snapshot clone-boot-presentation-final
Snapshot clone-boot-presentation-finalSnapshot clone-boot-presentation-final
Snapshot clone-boot-presentation-final
Open Stack
 
Opening Presentation
Opening PresentationOpening Presentation
Opening Presentation
Open Stack
 
Gluster open stack dev summit 042011
Gluster open stack dev summit 042011Gluster open stack dev summit 042011
Gluster open stack dev summit 042011
Open Stack
 
Swift container sync
Swift container syncSwift container sync
Swift container sync
Open Stack
 
The site architecture you can edit
The site architecture you can editThe site architecture you can edit
The site architecture you can edit
Open Stack
 
Mach Technology
Mach Technology Mach Technology
Mach Technology
Open Stack
 
OpenStack on Intel
OpenStack on IntelOpenStack on Intel
OpenStack on Intel
Open Stack
 
Operating the Hyperscale Cloud
Operating the Hyperscale CloudOperating the Hyperscale Cloud
Operating the Hyperscale Cloud
Open Stack
 
OpenStack Opportunity - Citrix
OpenStack Opportunity - CitrixOpenStack Opportunity - Citrix
OpenStack Opportunity - Citrix
Open Stack
 
PaaS on Openstack
PaaS on OpenstackPaaS on Openstack
PaaS on Openstack
Open Stack
 

More from Open Stack (20)

OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overview
 
OpenStack Swift overview oscon2011
OpenStack Swift overview oscon2011OpenStack Swift overview oscon2011
OpenStack Swift overview oscon2011
 
Dell Crowbar and OpenStack at OSCON
Dell Crowbar and OpenStack at OSCONDell Crowbar and OpenStack at OSCON
Dell Crowbar and OpenStack at OSCON
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
 
OpenStack Technology Overview
OpenStack Technology OverviewOpenStack Technology Overview
OpenStack Technology Overview
 
JCO Conference OpenStack
JCO Conference OpenStackJCO Conference OpenStack
JCO Conference OpenStack
 
OpenStack 101 Technical Overview
OpenStack 101 Technical OverviewOpenStack 101 Technical Overview
OpenStack 101 Technical Overview
 
Nova HA
Nova HANova HA
Nova HA
 
Nebula james Williams
Nebula james WilliamsNebula james Williams
Nebula james Williams
 
Open stack dashboard diablo
Open stack dashboard   diabloOpen stack dashboard   diablo
Open stack dashboard diablo
 
Snapshot clone-boot-presentation-final
Snapshot clone-boot-presentation-finalSnapshot clone-boot-presentation-final
Snapshot clone-boot-presentation-final
 
Opening Presentation
Opening PresentationOpening Presentation
Opening Presentation
 
Gluster open stack dev summit 042011
Gluster open stack dev summit 042011Gluster open stack dev summit 042011
Gluster open stack dev summit 042011
 
Swift container sync
Swift container syncSwift container sync
Swift container sync
 
The site architecture you can edit
The site architecture you can editThe site architecture you can edit
The site architecture you can edit
 
Mach Technology
Mach Technology Mach Technology
Mach Technology
 
OpenStack on Intel
OpenStack on IntelOpenStack on Intel
OpenStack on Intel
 
Operating the Hyperscale Cloud
Operating the Hyperscale CloudOperating the Hyperscale Cloud
Operating the Hyperscale Cloud
 
OpenStack Opportunity - Citrix
OpenStack Opportunity - CitrixOpenStack Opportunity - Citrix
OpenStack Opportunity - Citrix
 
PaaS on Openstack
PaaS on OpenstackPaaS on Openstack
PaaS on Openstack
 

Recently uploaded

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
saastr
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
Shinana2
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Tatiana Kojar
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
Dinusha Kumarasiri
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 

Recently uploaded (20)

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 

Openstack and eBay

  • 1. Neal Sample VP Architecture, Platform Products, Developers Program
  • 3. eBay marketplace = economy of scale 9 23 2 2Bpage views/day 23Mlines of code 9Petabytesof data storage 94 200 $62 94M active users 200Mlive listings $62B2010 gross merchandise volume 6,000 75 6,000 application servers 75B database calls/day Commercial data warehouse 100x larger than Library of Congress
  • 4. Cloud bursting: ↓ costs by ↑ efficiency 2000 1800 1600 1400 1200 1000 800 600 400 200 0 Fixed Cost Datacenter efficiency Cloud Burst Energy-proportional computing Excess Capacity Ideal Remove the peaks Request for Data Current Traffic text text text text text text text text Timeline
  • 5. Datacenter efficiency TIER II 2(N+1) TIER IV N+1 Datacenter tier = level of redundancy Blend of Tier IV & Tier II Minimum 30% reduction in OpEx cost per MW enables cost effective operations/expansion. 50% reduction in CapEx for new lower-tier datacenters (Tier IV vs. Tier II) Burst Capacity (DC and Cloud)
  • 6. Energy-proportional computing Traffic KWh cost / incentives / forecasts Meta Scheduler BMS metrics SLA Models Utilization (headroom) Availability Cloud Bursting SLC PHX (Tier 4) PHX (Tier2) Direct traffic to the most economical location / optimize placement within DC
  • 7. Financial model structure Hourly demand(in average TPS) Hourly demand(in average TPS) Historical (from ODW) or predicted Historical (from ODW) or predicted Define a standard CU Define a standard CU Hourly computing units (CU) required Max TPS per CU Hourly computing units (CU) required Max TPS per CU Based on server inventoryand growth forecast Based on server inventoryand growth forecast Hourly CUs neededin external cloud Number of CU in internal cloud Hourly CUs neededin external cloud Number of CU in internal cloud Negotiated price with public cloud vendor Negotiated price with public cloud vendor Hourly cost of CUin external cloud Hourly total cost Hourly cost of CU in internal cloud Hourly cost of CUin external cloud Hourly total cost Hourly cost of CU in internal cloud HW/SW lease, networking, space, power, laborPredict future costs trends HW/SW lease, networking, space, power, laborPredict future costs trends Sum cost over period Sum cost over period Evaluate tradeoffs by varying size of internal cloud, and costs Evaluate tradeoffs by varying size of internal cloud, and costs
  • 8. Cost components Datacenter People Total cost per CU/h : $1.07
  • 9. TSP ↑ = more attractive options for cloud bursts All self operated CUs TPS and FE Compute Units (CU) 24-Month Projects Load served by external cloud Historical TPS hourly data from ODW CU decreasing by Lease expiration Load served by self operated CU
  • 10. Cost-benefit analysis DC CUs Impact on Project Annual Cost 9/2010 – 8/2011 DC CU Hr Cost = 1.07, 30 TPS per CU 60,000,000 Cloud cost ($/hour) Total Cost ($) 0.5 0.8 1 40,000,000 1.1 1.2 1.5 2 3 4 20,000,000 0 DCs $20M 0 DCs $30M 3K DCs $40M 3.5K DCs $45M 4K DCs $47M 4.8K DCs $52M 5K DCs $55M 0 2000 4000 6000 8000 DC CUs
  • 11.
  • 15. Etc.Business Intelligence Increased Focus Infrastructureas Commodity Infrastructureas Commodity LowerCost
  • 16. Financial Cost Model for the Hybrid Cloud

Editor's Notes

  1. eBay Inc. has two strong core businesses … that offer significant potential for growth and profitability. And we have a consistent track record of delivering on our commitments.We are a more customer-focused company.We are accelerating innovation across the board.And we have a unique combination of assets that position us well to capitalize aggressively on the inflection point we are seeing in the external environment.eBay/marketplaces around the world: North America: eBay.com and eBay.ca EU: eBay.co.uk eBay.de eBay.fr Etc. Asia: eBay.in eBay.au Korea: GMarketCore adjacency businesses: PayPalStubHub
  2. Top 8 pools represent 1900 machines (Nov 2009). By defining a cutoff at 800 machines , it means that we would need to cloud burst 36800 VM/hours to cover the peak.And using $1/h on Azure(excluding bandwidth) = $36,800 / month1900 – 800 = 1100 machines x $1000 = $1.1M /monthImprove power efficiencyServer Consolidation (Sharing)Reduce DR capacity by implementing pre-emptionClicks 1, 2, 3: Align costs to utilizationData center efficiencyEnergy-proportional computingClick 4: “Fill out the valleys”Reuse spare capacity for experimentation, …Offer Infrastructure as a serviceClick 5: Chop off peaksClick 6: Move the peaks into the valleys (smooth out)Cloudburst (borrow capacity to address peaks)
  3. Tiered approach more efficient, cost-effective, and reliable.Equate to flying airplane with 8 engines when 2 will do. Overcompensates, costs too much, reduces efficiency.Can allocate power/cost of other 6 engines to other applications at tiered levels, based on business need. Avoid spending the capital up front when you build lower-level tiers/Tier IIEvaluate systems based on level of business-critical applications/requirements.Place applications based on their resilience to failure. EXAMPLE: Search – a business-critical function – points immediately at another center if there is an issue, as opposed to a more time-consuming process to migrate a DB from one location to another. The search nodes can be in Tier II, the DB needs to stay in Tier IV (more sensitive to failures). We believe that 70%+ of our applications can reside in Tier II (half the capex, half the opex). Today, all of them live in Tier IV.  Assign top tier operations – redundancy, cost, reliability – to mission-critical applications.Assign lower-level operational structure to less-critical applications.
  4. Future state : based on utility cost, datacenter and infrastructure metrics, traffic will be directed to the most economical location while achieving SLA. consider utility companies incentives to shift traffic and power down or idle down infrastructure.
  5. VISUALLY CONSISTENT – UPDATE LABELS – ADD AXESBalance: all in-house; all outsourceInflection points to choose some distributionLines rep various choice; dots rep various modelseBay’s method: Adopt an hybrid cloud approach (part on premise, part off premise) Use the on premise infrastructure for core business critical applications and infrastructure. Convert site to a cloud infrastructure to enable agility and increase average utilization Use the off premise cloud to offload capacity for peak demand, and new/experimental projects. Reduce on premise footprint.Anticipating double-digit transaction per second (TPS) increases YoY.Clarify TPS definition: Combination of internal and external factors, including processing, analytics, as well as site traffic and commerce transactions.As TPS increases, need options for addressing cloud bursting:Advantage: Adjust computing power to applications’ varying demandEnables higher resource utilization due to statistical multiplexing of loadEnables short time to market for new app to capture opportunities when they are identifiedGreen line: Servers operated by eBay Estimated ~ 5228 servers / 13130 CU’s Variety of HW types and virtualization status (Nov 2010)Cost based on 2 yr leaseComplete control; tried and known environmentParameters: Server cost per hourChange in the number of servers over timeBlue line: Internal cloud: Resources dedicated to a single operator who incurs constant cost per server regardless of actual loadTan line: External cloud: use and pay for server only when neededUsually pay by hour of reserved operationLight blue line: Hybrid cloud: A combination of internal and external clouds (part on-premise; part off-premise)Use the on premise infrastructure for core business critical applications and infrastructure.Convert site to a cloud infrastructure to enable agility and increase average utilizationUse the off premise cloud to offload capacity for peak demand, and new/experimental projects. Reduce on premise footprint.Internal cloud “stamps” 2 yr lease. Fixed cost independent of utilizationQuickly deploy and change appsShare load dynamically with self-operated serversParameters: number of stamps and installation/operation datesExternal cloud Paid for by the hour.Quickly turned on to carry traffic when exceeds capacity of DC-based serversParameters: hourly cost of server unit
  6. As infrastructure is commoditized, eBay can decrease cloud costs as much as possible by working with external industry leaders.Allows eBay to focus on strengths of running world’s largest online marketplace: Business intelligence Commerce expertise Customer focus Reliability Security Global presence