New Roles In The Cloud

NEW ROLES IN THE CLOUD Steve Loughran HP Laboratories March 2010

Cloud computing will change
how applications are delivered
how applications are designed
how teams work

CLASSIC SERVER-SIDE APPLICATIONS
Architect designs the application
Developers code and test on local machines
Operations buy and configure production machines
Developers get blame for things not working
Operations get blame for security & availability problems
Getting predictions of demand wrong can kill your project

CLOUD ELIMINATES
Buying hardware based on predicted load
2+ week lead time on new hardware, storage
High Availability
Homogeneity
Static machine names, addresses and capabilities
Stable machines
A fast private network
Someone in the datacentre who cares about you

IMPLICATIONS FOR HARDWARE VENDORS
(servers, routers, storage, ... )
No. of major accounts drops to? 5? 10? Less?
Power consumption becomes a key concern
Network: power, agile routing, bandwidth, throttling
Servers: power, VM-hosting, uniformity, no-extra features

AGILE APPLICATIONS

WHAT HAS GONE?
High Availability through hardware
Static hostnames, network addresses,
rDNS, multicast IP
Maybe: SQL databases

APPLICATIONS MUST BE AGILE
Directory, database or CM service to configure
Applications to rebind on loss of server connectivity
Use dynamic DNS services; don’t cache IPAddrs
Don’t expect HDD content to last on a single disk
Restart VMs on any app failure
Nothing is static. Nothing lasts .

HADOOP’S ASSUMPTIONS
Master nodes don’t move
Workers can spin for them
Failed workers get blacklisted
Single, static hostnames
Cache all DNS entries
Disks don't move between hosts
Different strategies are needed

AGILE TEAMS

CLASSIC TEAM ROLES Business Development Architecture Operations Development

THE OLD PROCESS Business Development Architecture Operations Development Design Code Test Staging Live

CLOUD-HOSTING BLURS THE ROLES Architecture Development Business Development Design Code Test Live Staging Operations

CLOUD ARCHITECT
Agile Application
Scale up under load
Scale down when quiet
No known SPOF
Deploys with VMs
Design an agile, HA application from cloud services and VMs

CLOUD OPERATIONS
Instrumentation
Reconfiguration
Monitoring
Reporting
Datamining
Create the VMs, manage and monitor staging and production

ROLES IN CLOUD APIS
Different Team roles need different rights and different service interfaces

ROLES IN THE CLOUD Role Task Tooling Cloud Architect Design App structure Text editor (?)) Powerpoint (? Cloud Operations Build VMs, set parameters Manage production Text under SCM Web & Command line Developers Request test VMs Web, IDE, build tools Biz Dev Worry about costs and revenue Web & Spreadsheet

CLOUDFARMER

Role Specification
machineRole extends HadoopVMRole {
description "A basic machine with SmartFrog installed";
vmPrefix "vm";
bootAutoVol "vol-0-1-47";
min 0;
recommendedMin 0;
links extends Compound {
"HTTP port 80" ["http", 80, "/"];
"HTTP port 8080" ["http", 8080, "/"];
}
}

WEBAPP LISTS AVAILABLE ROLES

HADOOP CLUSTER: MASTER + WORKER

REQUEST COMPLETED

LIST HOSTS IN A ROLE Actions: Add a worker, delete all in role “worker”

LIST ALL HOSTS

VIEW A HOST

Benefits over (VM type, disks+)
Infrastructure can do some late binding install/deploy
Feeds into the UI
Web, IDE, build tools, ...
“ Role” CPU/network history can aid placement
Other templates: network, aggregate clusters

http://www.1060.org	26
http://www.slideshare.net	9
http://1060.org	5

New Roles In The Cloud

by Steve Loughran

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 40

Statistics

New Roles In The Cloud Presentation Transcript