Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Henry Huang
Quick Solution
To Deploy One for Dev/QA
Problems
• Automation Efforts
• Service Learning
• Partial Setup
• Unique Resource
• Resource Cleanup
Automation Efforts
Current Status
• ? No bundle solution from Ops
Wish List
• Not to re-invent the wheel
• Configuration-d...
Service Learning
Description
• First have to know most service details
• Long Learning Curve
Wish List
• No detail but mor...
Partial Setup
Current Status
• Not fully support
• Most used in the deployment
Wish List
• De-couple the deployment soluti...
Unique Resource
Description
• Environment cannot be shared
• Avoid naming conflicts
Wish List
• Most resources can be uniq...
Example
Resource Cleanup
Cloud
Formation
It Brings
Problems Cloud Formation
Automation Efforts JSON
Service Learning Configuration Template
Partial Setup AutoGen-D...
Example
• AdminPortal
 Security Group
 ELB
 Launch Auto-Scaling Group
 R53
Template Anatomy
• Format Version Declaration
• Description Declaration
• Parameters Declaration
• Mappings Declaration
• ...
Recently
I finished a prototype
One Click
Service almost Ready
Inputs
 Cassandra, Mongo, RDS existing
• DNS
• Security Group Name
• Role AMI should be ready first
• Other pre-defined c...
Demo Time
Lessons
Case I
For Production, seamless upgrade requires
• Old version and new one co-existing
• Service data should keep ...
Lessons
Case II
Configuration Format need to refine
• Same value but with different format
• S3Cfg Tool need to support mo...
S3CFG Layers
 Layer1 Role
 Layer2 Machine
 Layer3 Auto-Scaling Group
 Layer4 Global
Layer 1: Role
Layer 2: Machine
Layer 3: Auto-scaling Group
 ASG Setting
• Region, Availability zones
• Instance Numbers: Min/Max/Desired
• ELB
• Instanc...
Lessons
Case III
Issues in Cloud Formation
• Cannot clean up the resources in some
special scenarios (submitted and fixing...
One day,
Drag and Drop
Service just Born!
Lessons
Case IV
Instance Bootstrap not scalable/common
• Too many restrictions
 Configuration downloaded from S3
 Bundle...
F A Q
Advanced Discussion on Cloud Formation
Advanced Discussion on Cloud Formation
Upcoming SlideShare
Loading in …5
×

Advanced Discussion on Cloud Formation

1,113 views

Published on

Cloud Formation

Published in: Education, Technology
  • How To Cure Acne For Good, Achieve lasting acne freedom Simple proven science of clear skin ◆◆◆ http://t.cn/AiWGkfA8
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Advanced Discussion on Cloud Formation

  1. 1. Henry Huang
  2. 2. Quick Solution To Deploy One for Dev/QA
  3. 3. Problems • Automation Efforts • Service Learning • Partial Setup • Unique Resource • Resource Cleanup
  4. 4. Automation Efforts Current Status • ? No bundle solution from Ops Wish List • Not to re-invent the wheel • Configuration-driven Platform
  5. 5. Service Learning Description • First have to know most service details • Long Learning Curve Wish List • No detail but more general
  6. 6. Partial Setup Current Status • Not fully support • Most used in the deployment Wish List • De-couple the deployment solution • Easy to setup a partial environment
  7. 7. Unique Resource Description • Environment cannot be shared • Avoid naming conflicts Wish List • Most resources can be unique for each deployment (special cases) • Dev provide the required resources and their relationship • Ops allocate and maintain the real resources
  8. 8. Example
  9. 9. Resource Cleanup
  10. 10. Cloud Formation
  11. 11. It Brings Problems Cloud Formation Automation Efforts JSON Service Learning Configuration Template Partial Setup AutoGen-Dependencies Unique Resource Prefix + Suffix Resource Cleanup Yes
  12. 12. Example • AdminPortal  Security Group  ELB  Launch Auto-Scaling Group  R53
  13. 13. Template Anatomy • Format Version Declaration • Description Declaration • Parameters Declaration • Mappings Declaration • Resource Declaration • Properties Declaration • Function Declaration • Outputs Declaration
  14. 14. Recently I finished a prototype
  15. 15. One Click Service almost Ready
  16. 16. Inputs  Cassandra, Mongo, RDS existing • DNS • Security Group Name • Role AMI should be ready first • Other pre-defined configuration
  17. 17. Demo Time
  18. 18. Lessons Case I For Production, seamless upgrade requires • Old version and new one co-existing • Service data should keep consistent  SQS, S3  Database: Cassandra, Mongo, RDS • Static network attribute should be smoothly switched  EIP, high-level DNS
  19. 19. Lessons Case II Configuration Format need to refine • Same value but with different format • S3Cfg Tool need to support more scalable scenarios  Partial setup  Different Layers
  20. 20. S3CFG Layers  Layer1 Role  Layer2 Machine  Layer3 Auto-Scaling Group  Layer4 Global
  21. 21. Layer 1: Role
  22. 22. Layer 2: Machine
  23. 23. Layer 3: Auto-scaling Group  ASG Setting • Region, Availability zones • Instance Numbers: Min/Max/Desired • ELB • Instance Tags • Scaling Policy  Launch Configuration • Spot or On-demand Instances • Image Id • Instance Type etc.
  24. 24. Lessons Case III Issues in Cloud Formation • Cannot clean up the resources in some special scenarios (submitted and fixing)  VPC  RDS Security Group update • S3 bucket cannot be cleaned due to the data existing • Configuration Too Large  More abstraction layers needed
  25. 25. One day, Drag and Drop Service just Born!
  26. 26. Lessons Case IV Instance Bootstrap not scalable/common • Too many restrictions  Configuration downloaded from S3  Bundled with Instance Tags • Not scalable enough  Not easy to modify commands to execute in instance booting  Should take the experiences from cloud-init
  27. 27. F A Q

×