Codebits talk about Amazon Web Services EC2 and S3, with hands-on and bonus track

1. Vitor Domingos
BOFH

2. vd
Vitor Domingos
http://vitordomingos.com

3. BOFH for 10 years
with telecom, bank & public
administration background
vd
Vitor Domingos
http://vitordomingos.com

4. Codebits
AWS ground zero: EC2 & S3 hands-on

7. 39º

8. What I'm not going to talk
> AWS account
> Install linux, xen or any other tool mentioned
> Generate ssh key pairs or manage ssh keys
> EC2 for torrents or pr0n
> S3 for infinite backups
> AWS Security *

9. What I'm going to talk
> Cloud Computing
> AWS advantages
> EC2; create, upload, manage, backup, assign
ip address, available tools
> S3; create, manage, put/get, sync, available
tools
> Bonus

10. Cloud Computing
> grid-utility 2.0
> software as a service 2.0
> clients (firefox)
> application (google apps)
> platform (google app engine, heroku)
> service (openid, mechanical turk, gmaps)
> infrastructure
> storage

11. from wikipedia

12. AWS advantages
> Full cloud stack
> Cost effective, pay for what you use
> Dependable, use it as your work horse
> Flexible, scale up or down, on demand
> Use the services Luke
> Perfect for your codebits projects

13. Why do you buy and manage
hardware ?
Why are spending your investor
money ?
Werner Vogels, Amazon CTO
http://www.allthingsdistributed.com/

14. Lease, don't buy

15. SLA ?

16. Yes! But things can fail ...

17. from 9to5

18. EC2
> hardware on demand
> small, large, extra large, high-cpu medium or
large
> billed by core hour use and bandwidth
> fixed ip address
> xen based system
> runs almost everything (linux, solaris, win)

19. from amazon docs

20. EC2
> http://aws.amazon.com
> http://sourceforge.net/projects/elasticfox/

21. EC2 Lingo
> AMI; Amazon Machine Image
(stored on S3)
> Instance; your machine running
> Instance Store; limbo
> Elastic IP: fixed ip address
> SWBF; shutdown without backup and you're
fucked
> MuKnO; mess up keys and you're out

23. EC2 command line
> ec2-add-keypair ec2-keypair
> ec2-describe-images -o self -o amazon
> ec2-run-instances <ami_id> -k <keypair-name>
> ec2-describe-instances <instance_id>
> ec2-authorize default -p {80,22}
> ssh -i <private-keyfile> root@<dns_location>

24. EC2 bundling
> install ruby & ami-tools
https://s3.amazonaws.com/ec2-downloads/ec2-ami-tools.noarch.rpm
> image
ec2-bundle-image -i <image_name>.img -k <private_keyfile>
-c <certificate_file> -u <user_id>
> snapshot
ec2-bundle-vol -k <private_keyfile> -c <certificate_file> -u <user_id>
> upload
ec2-upload-bundle -b <bucket> -m image.manifest.xml
-a <access_key> -s <secret_key>
> register
ec2-register mybucket/image.manifest.xml

25. EC2 extra stuff
> backup running instance
bundle-vol; upload-bundle
> assign ip address
ec2-associate-address -i <instance_id>
> reboot
ec2-reboot-instances <instance_id>
> terminate (remember SWBF)
ec2-terminate-instances <instance_id>
> register
ec2-register mybucket/image.manifest.xml

26. EC2 Tools
> Amazon AMI Tools
> Enomalism
> RightScale
> ElasticFox
> Your own ?

27. S3
> infinite storage
> free between EC2 instances
> billed by storage, data transfer & requests
> unique buckets
> up to 5GB per file
> metadata and serves itself

28. S3 lingo
> bucket; file containers
prtsc/photo.png -> http://prtsc.s3.aws.com/photo.png
> objects; fundamental entity, consists of
data and metadata
> keys; unique identifier for the object
> service endpoint; service host and port

29. S3 do & don'ts
> respect restrictions and limitations!!!
> don't fuckup access control list for the bucket
neither for the object
> don't delete unless you're sure
> sync; sync; sync
> export now & then

30. S3
> s3sync.net (ruby)
> S3 Firefox Organizer
> AWS S3
Key + ID

32. ruby used as curl interface ????

33. S3 command line
> s3cmd.rb listbuckets
> s3cmd.rb createbucket <name>
> s3cmd.rb list <bucket_name>
> s3cmd.rb delete <bucket_name>
> s3cmd.rb get|put <bucket:key> <file>
> s3sync.rb -r –progress <source> <destination>

34. S3 tools
> thousands, just google it
> s3bash FTW
> curl
> create your own ?

35. AWS is the starbucks of hardware

36. Bonus!!!!
> Xen how-to for freetards saying that AWS is
not opensource
> EC2 sandbox
> AWS UG

39. Xen
> CentOS (5.2) + xen 3.0.3
> libvirt, lvm, virt-manager
> AWS xen kernel
xvda vs sda
> persistence & time

44. EC2 sandbox
> OpenNebula
http://www.opennebula.org
> Nimbus
http://workspace.globus.org
> Haizea
http://haizea.cs.uchicago.edu
> DTC-Xen
http://www.gplhost.com

45. AWS Portuguese User Group
> Why not
> Share experiences
> Gather up
> Workshops
> Contact me: vd@7syntax.com
> I'll be around