This talk is an evolution of the one presented at FOSDEM'14, we talk about what are the common practices and methodologies for autoscaling, we also cover some best practices and the global scope of autoscaling inside your infrastructure.

1. Marc
Cluet
http://www.flickr.com/photos/gozalewis/3422530465/

2. Who am I?!
Marc
Cluet
(@lynxman)
Catalan
in
London
Head
of
Operations
at
<redacted>
17
years
of
experience
as
a
SysAdmin
Founding
member
of
Juju
and
MAAS
while
at
Canonical
Built
a
DevOps
Engineering
Team
at
Rackspace
Been
DevOps’in
for
the
last
5
years

3. Who am I?!
http://www.meetup.com/London-­‐DevOps/

4. What is Autoscaling?!

5. What is Autoscaling?!
WASTED! €€€!

6. What is Autoscaling?!

7. What is Autoscaling?!
The ability to automatically or semi-automatically
scale up and down a
group of servers based on
computing or traffic demand by
provisioning new services!

8. http://www.flickr.com/photos/fischerfotos/7419253200/

9. Traffic Patterns!

10. Traffic Patterns!
ON & OFF!
Analytics!
Banks/Tax Agencies!
Test environments!

11. Traffic Patterns!
FAST GROWTH!
Events!
Business Growth!
Slashdot Effect!

12. Traffic Patterns!
VARIABLE!
News & Media!
Event Registrations!
Rapid fire sales!

13. Traffic Patterns!
CONSISTENT!
HR Application!
Accounting/Finance!
E-mail!

15. Autoscaling Methodologies!
Time Based!
Reactive!
Predictive!

16. Time Based Autoscaling!
Load
Balancer
Server
Server

17. Time Based Autoscaling!
Load
Balancer
Server
Server
9:00am!

18. Time Based Autoscaling!
Load
Balancer
Server
Server
Nov 1st!

19. Time Based Autoscaling!
Load
Balancer
Server
Server
Server

20. Time Based Autoscaling!
GOOD FOR!
On & Off!
Consistent!

21. Reactive Autoscaling!
Load
Balancer
Server
60%
Server
60%

22. Reactive Autoscaling!
Load
Balancer
Server
80%
Server
80%

23. Reactive Autoscaling!
Load
Balancer
Server
60%
Server
60%
Server
40%

24. Reactive Autoscaling!
Load
Balancer
Server
30%
Server
30%
Server
30%

25. Reactive Autoscaling!
Load
Balancer
Server
45%
Server
45%

26. Reactive Autoscaling!
GOOD FOR!
Fast Growth!
Variable!

27. Predictive Autoscaling!
Load
Balancer
Server
Server

28. Predictive Autoscaling!
Load
Balancer
Server
Server
Forecasted!
Traffic!
+30%!

29. Predictive Autoscaling!
Load
Balancer
Server
Server
Server

30. Predictive Autoscaling!
GOOD FOR!
Fast Growth!
Variable!

31. Predictive Autoscaling!
Twitter
University
Improving
Resource
Efficiency
with
Apache
Mesos
Christina
Delimitriou
@chris_deli
http://goo.gl/AQmG8n

32. http://www.flickr.com/photos/samuraislice/3309481048/

33. Autoscaling Tools!

34. Autoscaling Tools!
Amazon Cloudformation!
Based on Scaling Groups!
High/Low Watermark!
Scheduled Events!
Uses base image + CF!

35. Autoscaling Tools!
Rackspace Autoscale!
Based on Scaling Groups!
High/Low Watermark!
Scheduled Events!
Uses Gold Image!

36. Autoscaling Tools!
Rightscale Autoscale!
Based on Scaling Groups!
High/Low Watermark Quorum!
Scheduled Events!
Uses Rightscale scripts!
$$$!

37. Autoscaling Tools!
Heat!
Based on Templates!
High/Low Watermark!
Scheduled Events!
Uses Heat Scripts!
DSL Compatible with CF!

38. Autoscaling Tools!
Scryer!
Based on AI!
Predictive Fidelity model!
Feeds AWS API!

39. Autoscaling Tools!
Your own!!
Collect your metrics!
!collectd, diamond, statsd!
Have a good metrics database!
!influxDB, whisper, rrd!

40. Autoscaling Tools!
Your own!!
Write your own autoscaling code!
!with message queues! :)!
!attached to your code!
!brain close to the centre of decision!

41. http://www.flickr.com/photos/68751915@N05/6355318323/

42. Taking the most of it!
Beware of the Kraken!!
Autoscaling can be dangerous!
Have min-max allocations!
http://www.flickr.com/photos/liquidnight/5992114196/

43. Taking the most of it!
Choose the right metrics!
Stay with basic metrics!
!CPU, mem, I/O disk/net!
Review autoscaling strategy with
metrics!

44. Taking the most of it!
Choose your strategy!
Scale up early!
Scale down slowly!
Don’t apply the same strategy to all
apps!

45. Taking the most of it!
Phasing in and Phasing Out!
Have in mind time to availability!
Have in mind also decommission time!
Golden Images can help speed!

46. https://www.flickr.com/photos/trojan_warrior/30419599/

47. The full chain!
Autoscaling
Event
Provisioning
Config
Mgmt
Deployment
Service
Discovery
Orchestration

48. Provisioning!
cloud-init

49. Configuration Mgmt!

50. Deployment!

51. Orchestration!
1. Autoscaling!
2. Self Healing!
3. Cost Forecast!
4. Predictive!
!

52. Service Discovery!
Service
Node
A
Service
Publication
Service
Node
B
Service
Node
C

53. Service Discovery!
Service
Node
A
Health
Check
Discovery
Agent
Discovery
Agent
Service
Node
B
Health
Check
Service
Publication

54. Service Discovery!

55. https://www.flickr.com/photos/mikko_luntiala/12691267935
https://www.flickr.com/photos/dullhunk/202872717
@lynxman!
http://slideshare.net/lynxmanuk/!
!