Scaling up and down using rackspace cloud. How to use Heat Templates, and do blue green deployments with autoscaling and jenkins.

1. FERNANDO
HONIG
Autoscaling
+Chef +New Relic
DevOps & Automation

2. ABOUT
ME
FERNANDO
HONIG
Senior Automation Engineer
More than 10 years of experience
Worked at Intel, IBM, HP
@fernandohonig
fernando.honig@rackspace.co.uk
http://github.com/fernandohonig

3. RACKSPACE & DevOps Automation
CONFIGURATION
MANAGEMENT
APPLICATION
SCALE
APPLICATION
INSIGHT
YOU CODE
THE APP
WE’LL DO
THE REST

4. PROBLEMS
Why to Autoscale?
How/When to Autoscale?
AUTOSCALING SCENARIOS
SELF-HEALING
New Relic Webhooks
Application Stressing
Load Balancer and Autoscaling
HEAT ORCHESTRATION
Full Deployment Stack
Horizontal Scale Up
BLUE/GREEN DEPLOYMENTS
Jenkins + Chef + Autoscale
Autoscaling
+Chef +New Relic

5. AUTOSCALING: What?
The act of changing the
pool of resources
able to serve requests
without manual intervention

6. PROBLEMS: Why?

7. PROBLEMS: Why?

8. AUTOSCALING: Strategy
 SEVERITY OF SPIKE:
Is this a Reddit spike or a casual increase?
 TIME TO PROVISION:
Benchmark and test the time it takes to create new infrastructure.
 EARLY WARNING:
What is the earliest observed anomaly in a monitoring system that predicts
this spike?
 PER NODE CAPACITY:
Load test individual nodes and your baseline platform to better understand
how much natural elasticity is in your platform.

9. PROBLEMS: How? When?
SCALE UP

10. PROBLEMS: How? When?
SCALE
DOWN
NEW RELIC

11. PROBLEMS: Scaling down?
SCALING DOWN,
SESSIONS, NEW
ARCHITECTURE
WWW
WEBSITE
LOADBALANCER
WWW
WEBSITE
LOADBALANCER

12. AUTOSCALING: Early warning!

13.  Monitor applications performance using NewRelic
 Use NewRelic APDEX score to monitor application
performance
 Scale up on demand based on NewRelic stats
(Self heal)
 When threshold breached fire alert to webhook
 Auto register node with application in NewRelic
 Scale down when compute no longer needed
AUTOSCALING:
EARLY
WARNING!

14. TOOLS!
CONFIG MGMT CODE MGMT MONITORING

15. LOADBALANCER
WEBSITE - SERVERS
STEP 1: START
WEBSITE STARTS HAVING MORE LOAD
VISITORS
WWW
WEBSITE
NEW RELIC

16. STEP 2: ALERT
NEW RELIC APP MONITORING TRIGGERS
A WEBHOOK FIRING AN AUTOSCALE EVENT
WWW
NEW RELIC AUTO SCALE SERVICE LOADBALANCER
WEBSITE - SERVERS

17. STEP 3: SCALE UP
AUTOSCALING GROUP LAUNCHES MORE
COMPUTE CAPACITY
WEBSITE – SERVERS ACTIVE
WEBSITE+
SERVERS BUILDING
WWW
NEW RELIC AUTO SCALE SERVICE LOADBALANCER

18. STEP 4: CONFIGURE
CHEF AUTOMATICALLY CONFIGURES
THE NEW SERVERS
WWW
chef LOADBALANCER
WEBSITE - SERVERS
WEBSITE - SERVERS
WEBSITE

19. STEP 5: COMPLETE
THE NEW SERVERS ARE FULLY
DEPLOYED & IN PRODUCTION
CUSTOMER NEW RELIC
NEW RELIC MONITORS THE
WEBSITE & PROVIDES
CUSTOMER WITH
PRO-ACTIVE INSIGHT
WWW
WEBSITE
LOADBALANCER
WEBSITE - SERVERS

20. WWW
WEBSITE
SERVERS REMOVED
STEP 6: DOWN
WHEN APPLICATION RECOVERED
OLD SERVERS ARE BEING REMOVED
LOADBALANCER
WEBSITE – SERVERS ACTIVE

21. DEMO

22. AUTOSCALING: Heat Orchestration

23.  Declare the infrastructure in one simple text
file (YAML)
 Create, update, connect and manage
groups of cloud resources and their
software components as a single unit
(stack)
 Automated, repeatable
HEAT
ORCHESTRATION

24. PROBLEM: Environments
 DEV = UAT = PRD:
Do we have the same architecture across all environments?
 TROUBLESHOOTING:
Is the problem related to the infrastructure or code?
 QUICK ENVIRONMENT TEST:
If we need an environment just for a few hours, or for a specific purpose?

25. TOOLS!
CONFIG MGMT CODE MGMT MONITORING

26. heat_template_version: 2013-05-23
description:
# a description of the template
parameters:
# declaration of input parameters
resources:
# declaration of template resources
outputs:
# declaration of output parameters
HEAT
ORCHESTRATION

27. HEAT ORCHESTRATION: Code!
http://goo.gl/xApJg1

28. ELK
LOADBALANCER
STEP 1: DEPLOY
THE TEMPLATE CONTAINS THE
AUTOSCALING GROUP, THE LB,
THE POLICIES AND WEBHOOKS
TEMPLATE CONTAINS ALL THE
CHEF INFORMATION TO
BOOTSTRAP THE NODE
WITHIN THE RIGHT
ENVIRONMENT AND ROLE.
CUSTOMER
STACK

29. ELK
LOADBALANCER
TEMPLATE CONTAINS ALL THE
CHEF INFORMATION TO
BOOTSTRAP THE NODE
WITHIN THE RIGHT
ENVIRONMENT AND ROLE.
CUSTOMER
STACK
STEP 2: SCALE
THE TEMPLATE CONTAINS THE
AUTOSCALING GROUP, THE LB,
THE POLICIES, AND WEBHOOKS
AUTO SCALE SERVICE

30. STEP 3: CONFIGURE
THE STACK WILL BE CONFIGURED
AND ADDED TO THE LB BASED ON
CHEF AUTOMATION
ELK
chef LOADBALANCER
TEMPLATE CONTAINS ALL THE
CHEF INFORMATION TO
BOOTSTRAP THE NODE
WITHIN THE RIGHT
ENVIRONMENT AND ROLE.
STACK

31. DEMO

32. AUTOSCALING: B/G Deployment

33. PROBLEM: Deployments
 TIME TO MARKET:
Why spend 8hs for doing a deployment? Can’t I just code my app?
 AUTOMATION:
I am human, I forgot to execute this step, rollback is needed.
 BRAND NEW ENVIRONMENT:
What if my old component is not compatible with the new one?

35.  Increase efficiency in the application release cycle
 Allow the customer to focus on their core business
 Fully automated one click deployment
 Faster delivery of code to production
 Easy roll back and in timely manner
BLUE-GREEN
DEPLOYMENTS

36. TOOLS!
CONFIG MGMT CODE MGMT WORKFLOW

37. WWW
LOADBALANCER
STEP 1: DESIGN
CUSTOMER DEVELOPS NEW VERSION
OF THEIR WEBSITE (WEBSITE 2.0)
CUSTOMER
WEBSITE 1.0
WEBSITE1.0 - SERVERS

38. STEP 2: DEPLOY
CUSTOMER DEPLOYS NEW VERSION
OF THEIR WEBSITE (WEBSITE 2.0)
JENKINS
NO FURTHER INTERACTION REQUIRED
FULLY AUTOMATED FROM HERE ON OUT
WWW
LOADBALANCER
CUSTOMER
WEBSITE 1.0
WEBSITE1.0 - SERVERS

39. STEP 3: SCALE UP
AUTO SCALE SPINS UP NEW SERVERS
JENKINS
WWW
WEBSITE 1.0
WEBSITE 1.0 - SERVERS
AUTO SCALE SERVICE
WEBSITE 2.0 - SERVERS
LOADBALANCER

40. STEP 4: CONFIGURE
CHEF AUTOMATICALLY CONFIGURES
THE NEW SERVERS
WWW
WEBSITE 1.0
chef LOADBALANCER
WEBSITE 2.0 - SERVERS WEBSITE 1.0 - SERVERS

41. STEP 5: SCALE DOWN
JENKINS INITITIATES THE AUTOMATIC
SPIN DOWN OF THE OLD SERVERS
JENKINS
WWW
WEBSITE 1.0
LOADBALANCER
WEBSITE 2.0 - SERVERS
AUTO SCALE SERVICE
WEBSITE 1.0 SERVERS

42. STEP 6: PRODUCTION
WWW
WEBSITE 2.0
WEBSITE 2.0 - SERVERS
THE NEW WEBSITE IS FULLY
DEPLOYED & IN PRODUCTION
CUSTOMER NEW RELIC
NEW RELIC MONITORS THE WEBSITE
& PROVIDES CUSTOMER WITH
PRO-ACTIVE INSIGHT
LOADBALANCER

43. DEMO

44. SUMMARY
 Autoscaling and Strategies behind
 Application Architecture and scaling
 Deployment enhancement using AS

45. Q&A

46. WHAT’S
NEXT?
www.rackspace.co.uk/devops

47. THANK YOU
www.rackspace.co.uk/devops
RACKSPACE® | 5 MILLINGTON ROAD | HAYES, UNITED KINGDOM UB3 4AZ
RACKSPACE® | 1 FANATICAL PLACE, CITY OF WINDCREST | SAN ANTONIO, TX 78218
US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 RACKSPACE.COM
UK SALES: +44 (0)20 8712 6507 | UK SUPPORT: 0800 988 0300 | WWW.RACKSPACE.CO.UK
© RACKSPACE LTD. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM