The Pragmatic Cloud: IT Consolidation in the age of Cloud Computing Scott Penberthy CTO Heavy & HuskyMedia

video plays and is wrapped by the husky video-skin.

The Problem (Variable revenue) – (High fixed cost) = Lower profits Lower return on assets Lower shareholder value Wasted natural resources

Lower profits

Lower return on assets

Lower shareholder value

Wasted natural resources

One approach (Variable revenue) – (High fixed cost) (Variable revenue) – (Lower, variable cost)

Value The business stack Attack root cause with greatest impact

M Core Metrics Risk v. Reward Projects Issues, tasks Management by objective Process metrics drive strategy, projects, tasks Process

Product Management Engineering Operations CEO Agile Development Start at the top, gain buy-in Process

The agile life Enable key processes to accept variable costs Product backlog Monthly sprint Burndown chart Daily scrum Velocity Process

Product backlog

Monthly sprint

Burndown chart

Daily scrum

Velocity

Small is better Achieve continuous, small wins. Don’t be a hero. MySQL on EBS EC2 Code Deployment Migrate video to S3 Process Information Applications Infrastructure

Requirements Goal is to serve all videos from S3 Videos must be migrated from SAN to S3 Migration takes time. We need a hybrid solution (S3 + SAN) in the interim. Videos must be on three tectonic plates Need the ability to fail over if one or both S3 buckets fail. Serving videos from S3 How can we migrate to S3 for our core data? Infrastructure

Requirements

Goal is to serve all videos from S3

Videos must be migrated from SAN to S3

Migration takes time. We need a hybrid solution (S3 + SAN) in the interim.

Videos must be on three tectonic plates

Need the ability to fail over if one or both S3 buckets fail.

Serving videos from S3 Dramatic results. Lots of drama. Infrastructure

Akamai Speed! Old Modem Speed. S3 as a CDN? Not so fast. Throughput is highly variable. Infrastructure

Rewrite Bloody Sunday 7/20/08 ? S3 went down for a few hours. One rewrite, we’re up! Infrastructure

Deliver results We cut 90% of our storage bill, 60% total of hosting Infrastructure

[email_address] Want to chat? We’d be delighted to share what we’ve learned

Before EBS Four database servers mysqldump snapshots to S3 With EBS Two database servers EBS snapshots EBS volumes use xfs to freeze the filesystem for snapshots Data survives if an instance crashes MySQL on EC2 How do we handle 50M sessions a month? Information

Before EBS

Four database servers

mysqldump snapshots to S3

With EBS

Two database servers

EBS snapshots

EBS volumes use xfs to freeze the filesystem for snapshots

Data survives if an instance crashes

pre-EBS S3 us-east-1a us-east-1b us-east-1c Master DB Master Candidate DB Slave Candidate DB Monitoring Server Snapshot Slave DB Information

post-EBS S3 us-east-1a us-east-1b us-east-1c Master DB Monitoring Server Master Candidate DB Information

Requirements Building and deploying a new AMI is too slow Need ability to roll back Solution Put code into a package. Store the package on S3. Trigger each web server to download and install Think WAR files for LAMP! EC2 Code Deployment If something fails, how do we bring a new server online? Applications

Requirements

Building and deploying a new AMI is too slow

Need ability to roll back

Solution

Put code into a package.

Store the package on S3.

Trigger each web server to download and install

Think WAR files for LAMP!

[email_address] Want to chat? We’d be delighted to share what we’ve learned