This document discusses cloud management and why it is important. It begins by stating that while cloud computing provides benefits like scalability and agility, managing resources in the cloud can be complex. Cloud management aims to reduce this complexity through tools, automation, and standardization. It then provides examples of key capabilities of cloud management solutions, such as server templates, scripting engines, deployment tools, automation/monitoring, backups and restores, and visibility into cloud resources and costs. The document argues that cloud management can help reduce the operations workload and introduce best practices for managing cloud infrastructure.

1. Cloud Management
Andreas Chatzakis
Follow me on twitter: @achatzakis
http://gr.linkedin.com/in/achatzakis
newvem.com community

2. Why Cloud Management
Unlocking the promises of Cloud Computing requires
the right key...
 Cloud Computing brings Elastic Scalability, Agility &
Reliability.
 Providers gave us APIs and endless possibilities.
 Yes! Cloud removes complexity.
 But gives us the power of choice!
 Taming this dynamic environment requires tooling,
organization & operational procedures.
Enter Cloud Management....
2

3. I thought cloud was easy?
True - The cloud removes several headaches...
 Manage hardware (we outsourced that years ago
anyway)
 Procure servers (cloud = on-demand)
 Patch multiple servers (thanks to virtualization)
 Capacity planning (actually that's sort of a lie)
3

4. Well it is...
But we still own several ITOPS responsibilities
 Architect & Implement
 Manage Configuration
 Monitor & Failover
 Backup and Restore
 Scale (automatically please) & Decommision
 Manage logs
 Deploy code
 Manage dev/test/prod environments
 Secure & Manage access
Remember: IaaS != PaaS / SaaS
4

5. How about an example?
In order to scale my DB I need to:
 Monitor usage & decide I need one more MySQL slave
 Launch new node
 Configure & run init scripts
 Attach storage and restore a recent DB snapshot
 Discover Master and start Replication
 Start logging and monitoring
 Manage access via SSH keys
 Secure & give access to currently running app servers
 Let application know I am here
5

6. Enter Cloud Management
Cloud Management promises to reduce
(admin effort) / (# of servers) ratio:
 An extra layer between you and your infrastructure
(hide complexity)
 Convention over configuration (Decrease the number
of decisions I need to make)
 Tools & Automation (Reduce operational costs & risks)
 Dashboards, monitors, logs (Visibility)
Not just a better GUI!
6

7. An analogy
Remember what an application framework is?
 Aim: Do more with less, don't reinvent the wheel and
enforce good practices (e.g. MVC pattern)
 Reduced degrees of freedom (better than it sounds...)
 Convention over configuration
 Set of reusable libraries for common functionality.
Cloud management = IaaS framework + tooling
7

8. So what does it do?
Cloud management solutions typically break down to
several capabilities:
 Server Templates (version control for servers!)
 A scripting engine (run script X on all my app servers)
 Deployment Tools (get latest & push to app servers )
 Automation & Monitoring (Autoscaling, Failover, Alerts)
 Backup and Restore (auto snapshot, DB dumps to S3)
 Visibility (Logs, Utilization, Costs)
 Security management (firewall rules, admin access)
Cloud Management != PaaS / SaaS
Why? You still maintain control & customizability
8

9. Server Templates
Configuration management for dynamic infrastructure
 Ready-to-use templates – embedded best practices
 Import your own or customize
 “Version control” for your server images
 Easy roll out of updates
 Attach Scripts, Chef recipes
 Standardized Behaviors – consistend & reproducible
 Auto-provision – in context
 Auto-configure – variable inputs
 Auto-discovery – Who am I? - Who else is here?
9

10. Scripting Engine
Easing the tedious task of running scripts on multiple
ephemeral servers
 Version control your infrastructure scripts
 Allow for dynamic parameters
 Run on demand on one, selected or all servers
 Run on server init or on server termination
 Run on this server or on other servers
 Schedule to run on specific time or intervals
 All through an admin friendly UI
10

11. Deployment tools
Agility is... automated code promotion to Production
 Push code from Source control system to your servers
 Pre/Post deployment scripts (Unit Tests, DB migration)
 Multiple sources, multiple destinations
11

12. Automation & Monitoring
Monitor and automatically react to change at 3:00 AM
 Monitor system usage metrics
 Autoscale up or down
 Keep your setup tidy – (e.g. no orphan EBS volumes)
 Replace failed nodes
 DB failover
 Alert
 APIs for deep integrations & automations
12

13. Backup & Disaster Recovery
Reuse robust, tried and tested DR procedures
 Disk Snapshots
 DB backups
 Alerts when backups fail
 Retention and cleanup
 Failover when Availability Zone fails
 Failover when whole Region goes down (costly)
 Multi cloud setups (Cold DR, Warm DR, Hot DR, HA)
13

14. Visibility
From top to bottom, track and report on what matters
 Cloud objects usage
 Metrics on load per server, role or farm
 Audit log
 Script execution log
 Analyze failures
14

15. Security Management
Being tidy matters in maintaining security control
 Organize security groups per role, farm etc
 Multiple admin users
 Seggregate access to different environments
 Scripts for security patches
 SSH key management
 Access terminal via the web
15

16. Meet the vendors
+ Netflix recently open sourced their own inhouse solution
16

17. Who uses cloud management?
Large & small setups rely on Cloud Management:
 (RightScale)
 (RightScale)
 (Scalr)
 (inhouse solution)
17

18. Do I need Cloud Management?
You need to manage your cloud infra. Which tool you
use is a business decision:
 Handcrafted scripts vs robust solution that scales
 Time it would take you to DIY & reinventing the wheel
 How complex and dynamic is your setup?
 Value of agility for your company
 Sysops capacity in your team
 Can you quantify ITOPS efficiencies?
 Risk of 'not getting it right' vs imposed good practices
Personal experience:
Digested cloud concepts top-bottom thanks to cloud management.
18

19. About newvem
Combine a Cloud Management solution with
Newvem's Analytics and make the most of the cloud:
 Powerful analytics of cloud usage data
 Reveal security & availability issues in your cloud infra
 Get actionable insights
 Identify opportunities for cost reductions
 Spot overloaded resources requiring vertical or
horizontal scaling
 Get visibility and confidence you are utilizing your cloud
management tool effectively
19