A presentation given at the 2011 Amazon AWS Genomics meeting held in Seattle, WA.
This is a 30 minute talk I gave focusing mainly on practical tools, tips and methods for bootstrapping and orchestration on the cloud.
Covers examples of:
Ubuntu Cloud Init
AWS Cloud Formation
Opscode Chef
MIT StarCluster
24. Automated provisioning
can shrink the time between
āI want to do some scienceā
āIām ready to do some scienceā.
image: shanelin via ļ¬ickr
26. If servers, storage and systems can be
deployed in minutes ā¦
image: shanelin via ļ¬ickr
27. ā¦ why does it still take days, several
helpdesk tickets a team of humans
to load software and conļ¬gure my
systems to actually do science?
image: shanelin via ļ¬ickr
32. āā¦ the quality that makes you go to great
effort to reduce overall energy expenditure. It
makes you write labor-saving programs that
other people will ļ¬nd useful, and document
what you wrote so you don't have to answer
so many questions about it.ā
65. Important to understand:
ā¢āÆ ami-8c1fece5 is Amazon Linux public AMI
ā¢āÆ No web server pre-installed
ā¢āÆ Never before been ātouchedā by me
ā¢āÆ Cloud Init does it all via the script I injected at
instance launch time
70. My live demo of CloudFormation
ā¢āÆ Using the example WordPress Blog template
ā¢āÆ It does a ton of cool stuff:
ā¢āÆ RDS backend for mySQL database, elastic
webserver cluster with auto-scaling, security
group setup, automatic scaling, automatic
alarm notices
ā¢āÆ It all sits behind an elastic load balancer
71. My CloudFormation blog demo:
ā¢āÆ Actual stack ļ¬le at http://biote.am/6d
ā¢āÆ Check it out ā¦
ā¢āÆ .JSON formatted but still quite readable
ā¢āÆ It lets me deļ¬ne and then control a ton of
different related AWS services all at once.
89. Chef lets you:
Manage conļ¬guration as idempotent Resources.
Group resources as idempotent Recipes.
Group recipes into Roles.
Track it all like Source Code.
Search your infrastructure like a ninja. Ohai!
Conļ¬gure your systems, software pipelines
90. http://www.opscode.com/chef/
ā¢āÆ Several ļ¬avors
ā¢āÆ Open source
ā¢āÆ Commercial / Managed
ā¢āÆ Commercial / āBehind your Firewallā
ā¢āÆ No time today for even a short description
of how it works. You should check it out.