More Related Content
Similar to Morphlabs open stack_capacity_planning_130829
Similar to Morphlabs open stack_capacity_planning_130829 (20)
Morphlabs open stack_capacity_planning_130829
- 1. © 2013 Morphlabs Inc. All Rights Reserved
PRESENTED BY : Christopher Aedo, CTO
CONFIDENTIAL & PROPRIE TARY
OpenStack Capacity
Planning
8-29-2013
1
- 2. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Who the hell am I?
•Christopher Aedo (caedo@morphlabs.com)
•Morphlabs CTO
•20+ year IT veteran (started at Arthur Andersen but NOT responsible for
ENRON debacle!)
•Familiar with this “OpenStacks” thing
•Work with many very very smart people at Morphlabs, and in the OpenStack
community
•Met Vint Cerf once!
•That’s what I look like in the Grand Canyon
2
- 3. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Morphlabs Profile
3
Headquartered in Los Angeles
• Venture Funded $22M
• 55 Employees
• Operations in Japan, Philippines and Singapore
• US Operations established in 2009
Successful Open Source Entrepreneurs
• Apache Geronimo > IBM Websphere
• Apache ActiveMQ > Progress Software
Deployments in the US and Asia
OpenStack Foundation Founding Member
- 4. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Agenda
Provide a useful structure and related information to help guide your
thinking when it comes to planning an OpenStack deployment.
Areas covered:
•Hypervisor choice
•Workload considerations
•Compute node capacity thoughts
•Storage (block and object)
•REVISIT THIS SLIDE WHEN OTHERS ARE COMPLETE!
4
- 5. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Thank You!
Tom Fifield
Diane Fleming
Anne Gentle
Lorin Hochstein
Adam Hyde
Jonathan Proulx
Everett Toews
Joe Topjian
5
- 6. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
oh crap!
6
- 7. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Want the easy answers?
7
- 8. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Unlimited budget
8
- 9. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Unlimited time
9
- 10. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Organized team of geniuses
10
- 11. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Total agreement on expectations
11
- 12. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Getting started
12
- 13. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Getting started
13
- 14. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Spare server
14
- 15. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Devstack!
15
- 16. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
First crossroad...
16
- 17. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Private cloud
17
Source: http://www.privatecloudandhosting.info/wp-content/uploads/2013/04/private-cloud1.png
- 18. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
You know your users and workload
18
- 19. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
19
Public Cloud!(I couldn’t find an image that screamed “Public Cloud” unfortunately.)
- 20. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Users and workload likely unknown
20
- 21. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Profile your workloads if possible
•Load test!
•Benchmark!
•Get a sense of IOPS with iostat!
•Quick, someone yell out their favorite profiling methodology!
21
- 22. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
22
Hypervisor
- 23. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
23
Hypervisor
- 24. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
24
Compute Density
- 25. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Compute Density
25
(overcommit fraction * physical cores)
---------------------------------
vcores per instance
ephemeral storage desired
vs.
physical storage available
- 26. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Major vectors
•Budget
•New/existing equipment
•Space/power, desired performance
•How much compute per node?
•How much RAM per node?
•How much storage per VM?
•How many IOPS will you need?
26
- 27. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Speaking of IOPS
FOR EXAMPLE:
• Model: Western Digital VelociRaptor 2.5" SATA hard drive
• Rotational speed: 10,000 RPM
• Average latency: 3 ms (0.003 seconds)
• Average seek time: 4.2 (r)/4.7 (w) = 4.45 ms (0.0045 seconds)
• Calculated IOPS for this disk: 1/(0.003 + 0.0045) = about 133 IOPS
27
Source: http://www.techrepublic.com/blog/the-enterprise-cloud/calculate-iops-in-a-storage-array/
- 28. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Factual Statistic
87% of the people viewing
this presentation would
appreciate a graph right
about now.
28
- 29. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Storage and IOPS dictate density possible
29
- 30. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Thinking about density
32 physical cores
96 virtual cores (3x overcommit)
1tb storage (@10gb/vcore)
192gb RAM needed (overcommit possible)
50 IOPS/VM (that’s on the low side)
5000 IOPS required
~125 IOPS per 10k SAS
12 100gb disks RAID10: ~1500 IOPS
30
- 31. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Thinking about density
~125 IOPS per 10k SAS
12 100gb disks RAID10: ~1500 IOPS
50 IOPS/VM (that’s on the low side)
30 VMs
12 physical cores (3x overcommit)
60 gb RAM (@2gb/vcore)
300 gb storage (@10gb/vcore)
31
- 32. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
32
Storage
- 33. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
33
Storage
- 34. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
34
Storage
NEED MORE
STORAGE!
- 35. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
35
Storage
I’LL GET
MORE TAPES
FAST!
- 36. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
36
Storage
DID YOU SEE
BREAKING BAD LAST
NIGHT?
- 37. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
37
Storage
OMFG YES!
- 38. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
38
Storage
- 39. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
STORAGE
39
Storage
SO... THOSE TAPES,
SOON? NOW?
- 40. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
NETWORKING
40
- 41. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
NETWORKING
41
- 42. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
NETWORKING
42
- 43. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
43
Cloud Controller
- 44. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
44
- 45. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
45
- 46. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
46
- 47. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
Outgrowing your cloud controller
47
- 48. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
MONITORING
48
- 49. © 2013 Morphlabs Inc. All Rights Reserved
T I T L E :
D A T E :
O p e n S t a c k C a p a c i t y P l a n n i n g
8 - 2 9 - 2 0 1 3
49
Contact: Christopher Aedo
caedo@morphlabs.com
Thank You!