SlideShare a Scribd company logo
北京迅达云成科技有限公司 www.speedycloud.cn
Beijing SpeedyCloud Technology Co., Ltd.,
www.speedycloud.cn 2015.8 @ Beijing
WELCOME
The Evolution of
SpeedyCloud Resources
Scheduling System
北京迅达云成科技有限公司 www.speedycloud.cn
What is a Scheduling System
北京迅达云成科技有限公司 www.speedycloud.cn
What does Scheduling System
of Cloud Platform usually do?
北京迅达云成科技有限公司 www.speedycloud.cn
Cloud
Server
Cloud
Storage
SDN
Network
Firewall
Other
Services
Load
Balancing
Cloud
CDN
北京迅达云成科技有限公司 www.speedycloud.cn
北京迅达云成科技有限公司 www.speedycloud.cn
How?
Roman wasn’t built in one day
Let’s find out how it evolves from scratch!
北京迅达云成科技有限公司 www.speedycloud.cn
Scenario 1:
Description:
Provision Cloud server for client
using Web
Context:
1. Have developers dedicated for
presentation layer
2. Only develop back-end
business logics
3. Parameters validation and
exceptions omitted
Web
DB Physical
Server
1
2
3
4
5
6
Python + Django + Shell
KVM
MySQL
北京迅达云成科技有限公司 www.speedycloud.cn
Scenario 2:
Description:
Long time waiting when
client provisions several
cloud servers
Solution:
Change sequential
allocation to multi-thread
北京迅达云成科技有限公司 www.speedycloud.cn
Scenario 3:
Description:
Multi datacenters deployed to
satisfy increasing customers; long
time waiting occurred till timeout,
but PDB can’t be used to debug
Solution:
Change to multi-process from
multi-thread
Web
DB Physical
Server
Web
DB
Datacenter A
Datacenter B
Datacenter C
Datacenter D
Datacenter E
北京迅达云成科技有限公司 www.speedycloud.cn
Scenario 4:
Description:
Failure occurred due to
network jittering from some
datacenters to control center,
and control center can’t be
notified even if cloud servers
successfully were provisioned.
Solution:
1. Change to BGP datacenter
2. Message Queue introduced to
solve the timeout
Web
DB
Datacenter A
Datacenter B
Datacenter C
Datacenter D
Datacenter E
Datacenter B
Datacenter C
Datacenter D
Datacenter E
Web
DB
Datacenter A
MQ
Worker
北京迅达云成科技有限公司 www.speedycloud.cn
Scenario 5:
Description:
1. More devices upgrades and
maintenances needed.
2. Client resource application
need to be handled even
when upgrading web front-
end.
Datacenter B
Datacenter C
Datacenter D
Datacenter E
Web
DB
Datacenter A
MQ
Worker
Solution:
1. Live migration of host and hot
patch for OS
2. Add System Halt Status
3. Add Node Halt Status
Datacenter B
Datacenter C
Datacenter D
Datacenter E
Web
DB
Datacenter A
MQ
Worker
Job
Tracker
1. Add System Halt Status
2. Add Node Halt Status
北京迅达云成科技有限公司 www.speedycloud.cn
Thanks!
Beijing SpeedyCloud Technology Co., Ltd.,
www.speedycloud.cn

More Related Content

What's hot

What's hot (10)

Docker
DockerDocker
Docker
 
stackconf 2021 | Fuzzing: Finding Your Own Bugs and 0days!
stackconf 2021 | Fuzzing: Finding Your Own Bugs and 0days!stackconf 2021 | Fuzzing: Finding Your Own Bugs and 0days!
stackconf 2021 | Fuzzing: Finding Your Own Bugs and 0days!
 
Deploy with confidence
Deploy with confidenceDeploy with confidence
Deploy with confidence
 
Andrea Di Persio
Andrea Di PersioAndrea Di Persio
Andrea Di Persio
 
Construindo uma esteira de build e deployment do zero com Azure DevOps
Construindo uma esteira de build e deployment do zero com Azure DevOpsConstruindo uma esteira de build e deployment do zero com Azure DevOps
Construindo uma esteira de build e deployment do zero com Azure DevOps
 
Vincenzo Chianese - REST, for real! - Codemotion Milan 2017
Vincenzo Chianese - REST, for real! - Codemotion Milan 2017Vincenzo Chianese - REST, for real! - Codemotion Milan 2017
Vincenzo Chianese - REST, for real! - Codemotion Milan 2017
 
What is Google Cloud Good For at DevFestInspire 2021
What is Google Cloud Good For at DevFestInspire 2021What is Google Cloud Good For at DevFestInspire 2021
What is Google Cloud Good For at DevFestInspire 2021
 
Kubecon 2019 Recap
Kubecon 2019 RecapKubecon 2019 Recap
Kubecon 2019 Recap
 
Hardening Kubernetes by Securing Pods
Hardening Kubernetes by Securing PodsHardening Kubernetes by Securing Pods
Hardening Kubernetes by Securing Pods
 
Whats new in brigade 2
Whats new in brigade 2Whats new in brigade 2
Whats new in brigade 2
 

Viewers also liked

Musica y bailes_de_los_afrodescendientes[1]
Musica y bailes_de_los_afrodescendientes[1]Musica y bailes_de_los_afrodescendientes[1]
Musica y bailes_de_los_afrodescendientes[1]
UNAD
 
Il web del comune di udine
Il web del comune di udineIl web del comune di udine
Il web del comune di udine
Comune Udine
 

Viewers also liked (15)

Musica y bailes_de_los_afrodescendientes[1]
Musica y bailes_de_los_afrodescendientes[1]Musica y bailes_de_los_afrodescendientes[1]
Musica y bailes_de_los_afrodescendientes[1]
 
SpeedyCloud 云计算平台资源调度系统要点解析
SpeedyCloud 云计算平台资源调度系统要点解析SpeedyCloud 云计算平台资源调度系统要点解析
SpeedyCloud 云计算平台资源调度系统要点解析
 
Personal Branding
Personal BrandingPersonal Branding
Personal Branding
 
نيَرطةلة
نيَرطةلةنيَرطةلة
نيَرطةلة
 
Il web del comune di udine
Il web del comune di udineIl web del comune di udine
Il web del comune di udine
 
Tiña negra
Tiña negraTiña negra
Tiña negra
 
Resulting Trust
Resulting TrustResulting Trust
Resulting Trust
 
4. Micosis sistemicas
4.  Micosis sistemicas4.  Micosis sistemicas
4. Micosis sistemicas
 
Fixed Mindset and Growth Mindset
Fixed Mindset and Growth Mindset Fixed Mindset and Growth Mindset
Fixed Mindset and Growth Mindset
 
Presentation of project on e auction with dotnet
Presentation of project on e auction with dotnetPresentation of project on e auction with dotnet
Presentation of project on e auction with dotnet
 
Procedure in syariah trail
Procedure in syariah trailProcedure in syariah trail
Procedure in syariah trail
 
E - Auction (Electronic Auction)
E - Auction (Electronic Auction)E - Auction (Electronic Auction)
E - Auction (Electronic Auction)
 
Petit Club - Zoom sur l'Influence
Petit Club - Zoom sur l'InfluencePetit Club - Zoom sur l'Influence
Petit Club - Zoom sur l'Influence
 
Modelo atómico demócrito
Modelo atómico demócritoModelo atómico demócrito
Modelo atómico demócrito
 
Modelo Funcional De Luria
Modelo Funcional De LuriaModelo Funcional De Luria
Modelo Funcional De Luria
 

Similar to The Evolution of SpeedyCloud Resources Scheduling System

Track2 -刘希斌----c ie-net-openstack-2012-apac
Track2 -刘希斌----c ie-net-openstack-2012-apacTrack2 -刘希斌----c ie-net-openstack-2012-apac
Track2 -刘希斌----c ie-net-openstack-2012-apac
OpenCity Community
 
Cloud Computing: Infraestrutura, Aplicações e Desafios
Cloud Computing: Infraestrutura, Aplicações e DesafiosCloud Computing: Infraestrutura, Aplicações e Desafios
Cloud Computing: Infraestrutura, Aplicações e Desafios
Marcos Ferreira
 

Similar to The Evolution of SpeedyCloud Resources Scheduling System (20)

CDN - Content Delivery Network
CDN - Content Delivery NetworkCDN - Content Delivery Network
CDN - Content Delivery Network
 
Track2 -刘希斌----c ie-net-openstack-2012-apac
Track2 -刘希斌----c ie-net-openstack-2012-apacTrack2 -刘希斌----c ie-net-openstack-2012-apac
Track2 -刘希斌----c ie-net-openstack-2012-apac
 
Cloud Computing: Infraestrutura, Aplicações e Desafios
Cloud Computing: Infraestrutura, Aplicações e DesafiosCloud Computing: Infraestrutura, Aplicações e Desafios
Cloud Computing: Infraestrutura, Aplicações e Desafios
 
GIDS_what does_cloud-native_mean_anyway?
GIDS_what does_cloud-native_mean_anyway?GIDS_what does_cloud-native_mean_anyway?
GIDS_what does_cloud-native_mean_anyway?
 
CloudWorld: What Does Cloud-Native Mean Anyway?
CloudWorld: What Does Cloud-Native Mean Anyway?CloudWorld: What Does Cloud-Native Mean Anyway?
CloudWorld: What Does Cloud-Native Mean Anyway?
 
Bbva bank on Open Stack
Bbva bank on Open StackBbva bank on Open Stack
Bbva bank on Open Stack
 
Bluemix 로 접근하는 DevOps - Cognitive Cloud Connect
Bluemix 로 접근하는 DevOps - Cognitive Cloud ConnectBluemix 로 접근하는 DevOps - Cognitive Cloud Connect
Bluemix 로 접근하는 DevOps - Cognitive Cloud Connect
 
Cloud Foundry 2015 LInuxCon Keynote
Cloud Foundry 2015 LInuxCon KeynoteCloud Foundry 2015 LInuxCon Keynote
Cloud Foundry 2015 LInuxCon Keynote
 
How to build DevSecOps Platform on Huawei Cloud
How to build DevSecOps Platform on Huawei CloudHow to build DevSecOps Platform on Huawei Cloud
How to build DevSecOps Platform on Huawei Cloud
 
Testing in the 21st Century (ExpoQA)
Testing in the 21st Century (ExpoQA)Testing in the 21st Century (ExpoQA)
Testing in the 21st Century (ExpoQA)
 
Azure Static Web App CDN Configuration Tutorial: Easy Steps for Beginners
Azure Static Web App CDN Configuration Tutorial: Easy Steps for BeginnersAzure Static Web App CDN Configuration Tutorial: Easy Steps for Beginners
Azure Static Web App CDN Configuration Tutorial: Easy Steps for Beginners
 
Implementing a Reliable, Auto-Healing Scalable Platform at VMware
Implementing a Reliable, Auto-Healing Scalable Platform at VMwareImplementing a Reliable, Auto-Healing Scalable Platform at VMware
Implementing a Reliable, Auto-Healing Scalable Platform at VMware
 
Open Stack China Trip Sz0922
Open Stack China Trip Sz0922Open Stack China Trip Sz0922
Open Stack China Trip Sz0922
 
Innovate bluemix and jazz vpc
Innovate bluemix and jazz vpc Innovate bluemix and jazz vpc
Innovate bluemix and jazz vpc
 
Head in the Clouds? Let’s get serious about how to benefit from Cloud platfor...
Head in the Clouds? Let’s get serious about how to benefit from Cloud platfor...Head in the Clouds? Let’s get serious about how to benefit from Cloud platfor...
Head in the Clouds? Let’s get serious about how to benefit from Cloud platfor...
 
Spring into the Cloud - JDC2012 Cairo, Egypt
Spring into the Cloud - JDC2012 Cairo, EgyptSpring into the Cloud - JDC2012 Cairo, Egypt
Spring into the Cloud - JDC2012 Cairo, Egypt
 
Isovalent-kloia Cilium Workshop
Isovalent-kloia Cilium WorkshopIsovalent-kloia Cilium Workshop
Isovalent-kloia Cilium Workshop
 
OpenNebulaConf 2013 - Best Practices to Create Infrastructure Services in Ope...
OpenNebulaConf 2013 - Best Practices to Create Infrastructure Services in Ope...OpenNebulaConf 2013 - Best Practices to Create Infrastructure Services in Ope...
OpenNebulaConf 2013 - Best Practices to Create Infrastructure Services in Ope...
 
Best Practices to Create Infrastructure Services in OpenNebula Using viApps
Best Practices to Create Infrastructure Services in OpenNebula Using viAppsBest Practices to Create Infrastructure Services in OpenNebula Using viApps
Best Practices to Create Infrastructure Services in OpenNebula Using viApps
 
Creating Polyglot Communication Between Kubernetes Clusters and Legacy System...
Creating Polyglot Communication Between Kubernetes Clusters and Legacy System...Creating Polyglot Communication Between Kubernetes Clusters and Legacy System...
Creating Polyglot Communication Between Kubernetes Clusters and Legacy System...
 

More from SpeedyCloud

More from SpeedyCloud (7)

教育交互直播的技术难点与架构探索 @ 见云沙龙
教育交互直播的技术难点与架构探索 @ 见云沙龙教育交互直播的技术难点与架构探索 @ 见云沙龙
教育交互直播的技术难点与架构探索 @ 见云沙龙
 
选型指南:Cdn系统中dns的设计与研发
选型指南:Cdn系统中dns的设计与研发选型指南:Cdn系统中dns的设计与研发
选型指南:Cdn系统中dns的设计与研发
 
浅析Python多线程与多进程的使用
浅析Python多线程与多进程的使用浅析Python多线程与多进程的使用
浅析Python多线程与多进程的使用
 
How to Use Multi-thread & Multi-process in Python
How to Use Multi-thread & Multi-process in PythonHow to Use Multi-thread & Multi-process in Python
How to Use Multi-thread & Multi-process in Python
 
运维?KVM & OpenVZ & Docker
运维?KVM & OpenVZ & Docker运维?KVM & OpenVZ & Docker
运维?KVM & OpenVZ & Docker
 
深入Docker的资源管理
深入Docker的资源管理深入Docker的资源管理
深入Docker的资源管理
 
Resource Management of Docker
Resource Management of DockerResource Management of Docker
Resource Management of Docker
 

Recently uploaded

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 

Recently uploaded (20)

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 

The Evolution of SpeedyCloud Resources Scheduling System

Editor's Notes

  1. 天然气净化厂生产输配调度系统解决方案 看起来很复杂 说简单一点:把任务分给谁干,怎么分,就是任务调度系统要干的事情 做起来很难 说起来容易,做起来难 站着说话不腰疼
  2. 天然气净化厂生产输配调度系统解决方案 看起来很复杂 说简单一点:把任务分给谁干,怎么分,就是任务调度系统要干的事情 做起来很难 说起来容易,做起来难 站着说话不腰疼
  3. 靠什么来支撑这么多业务? 自动化 Facebook 1位工程师管理2万台设备 复杂度? 谷歌工程师的智能学习系统