Elastic Server On Demand: deploying using virtualization on the desktop, in the datacenter, and in the clouds

1. Virtualization with
Elastic Server On Demand
Yan Pritzker
yan.pritzker@cohesiveft.com
http://elasticserver.com

3. • What is Virtualization

4. • What is Virtualization
• Why should I care?

5. • What is Virtualization
• Why should I care?
• How can I get started?

6. Virtualization

7. Virtualization
• Run multiple virtual computers on one
physical box.

8. Virtualization
• Run multiple virtual computers on one
physical box.
• Desktop

9. Virtualization
• Run multiple virtual computers on one
physical box.
• Desktop
• Server

10. Virtualization
• Run multiple virtual computers on one
physical box.
• Desktop
• Server
• Data Center

11. Virtualization
• Run multiple virtual computers on one
physical box.
• Desktop
• Server
• Data Center
• Cloud

12. Lots of ways to do it
• Xen
• VMWare
• Parallels
• Amazon AMI
• Microsoft Hyper-V
• Clouds on the horizon

13. Desktop

15. Who Can Benefit?

16. Who Can Benefit?
Developers

17. Who Can Benefit?
Developers
Develop on a VM to
avoid fubaring your
environment.

18. Who Can Benefit?
Developers
Develop on a VM to
avoid fubaring your
environment.
Get new developers
started quickly.

19. Who Can Benefit?
Developers
Develop on a VM to
avoid fubaring your
environment.
Get new developers
started quickly.
Multi env. testing.

20. We're able to save time and money by having
'standard' VMs for windows dev, rails dev,
build machine, windows QA, etc. [...] It was
really great when the customer handed over
two VMs at the beginning of the project, and
we were able to just load up those VMs and
start our development.
John McCaffrey
Pathfinder (pathf.com)

21. Server

22. Who Can Benefit?

23. Who Can Benefit?
Software Vendors

24. Who Can Benefit?
Software Vendors
Everyone knows how
to run a Rails server
right?

25. Who Can Benefit?
Software Vendors
Everyone knows how
to run a Rails server
right?
Absolutely NOT.

26. Who Can Benefit?
Software Vendors
Everyone knows how
to run a Rails server
right?
Absolutely NOT.
Ship it virtualized!

27. Data Center

28. Server Virtualization

29. Server Virtualization

30. Server Virtualization

31. Server Virtualization

32. You quickly forget about the virtualization except
when you need it. When you need to migrate to
new hardware or increase RAM on a moment's
notice. Iʼll never [again] install a Linux instance that
doesn't start with Xen.
Tom Mornini, EngineYard
We provide you a product that is free from
traditional hosting constraints. An object that
becomes larger or smaller as needed, is
duplicated at will and free to move around.
Matt Tanase, SliceHost

33. VMWare has over 20,000
enterprise customers
90% are in production

34. Who Can Benefit?

35. Who Can Benefit?
Your Data Center

36. Who Can Benefit?
Your Data Center
Save $$$ through
increased utilization.

37. Who Can Benefit?
Your Data Center
Save $$$ through
increased utilization.
Decrease IT
overhead through
encapsulation.

38. Who Can Benefit?
Your Data Center
Save $$$ through
increased utilization.
Decrease IT
overhead through
encapsulation.
Migrate slices and
manage resources.

39. Who Can Benefit?
Your Data Center
Save $$$ through
increased utilization.
Decrease IT
overhead through
encapsulation.
Migrate slices and
manage resources.

40. Clouds

41. http://www.flickr.com/photos/psd

42. Joyent Mosso Google
AppEngine
FlexiScale
Slice
Host Engine
Amazon Yard
EC2
http://www.flickr.com/photos/psd

43. http://www.johnmwillis.com/groundwork/cloud-vendors-a-to-z/

44. http://www.johnmwillis.com/groundwork/cloud-vendors-a-to-z/

45. Cloud Approaches

46. Cloud Approaches
• EngineYard - Managed Rails stack

47. Cloud Approaches
• EngineYard - Managed Rails stack
• SliceHost - Choice of base OS images

48. Cloud Approaches
• EngineYard - Managed Rails stack
• SliceHost - Choice of base OS images
• Google AppEngine - Python stack (for now)

49. Cloud Approaches
• EngineYard - Managed Rails stack
• SliceHost - Choice of base OS images
• Google AppEngine - Python stack (for now)
• Amazon EC2 - self-service roll your own

50. Cloud Approaches
• EngineYard - Managed Rails stack
• SliceHost - Choice of base OS images
• Google AppEngine - Python stack (for now)
• Amazon EC2 - self-service roll your own
• Private enterprise clouds...

52. Animoto scales 50 slices to 3,500
over 3 days with Amazon EC2

53. Who Can Benefit?

54. Who Can Benefit?
Everyone

55. Who Can Benefit?
Everyone
Your boss is risk averse.

56. Who Can Benefit?
Everyone
Your boss is risk averse.
Your IT doesn’t know what
Mongrel is.

57. Who Can Benefit?
Everyone
Your boss is risk averse.
Your IT doesn’t know what
Mongrel is.
No money for hardware.

58. Who Can Benefit?
Everyone
Your boss is risk averse.
Your IT doesn’t know what
Mongrel is.
No money for hardware.
Cloudbursting.

59. Who Can Benefit?
Everyone
Your boss is risk averse.
Your IT doesn’t know what
Mongrel is.
No money for hardware.
Cloudbursting.
Virtual test labs.

60. Who Can Benefit?
Everyone
Your boss is risk averse.
Your IT doesn’t know what
Mongrel is.
No money for hardware.
Cloudbursting.
Virtual test labs.
Run it in the cloud!

61. Sweet! But...

62. Making EC2 Images
dd if=/dev/zero of=ubuntu.fs count=1024 bs=1M
mke2fs -F -j ubuntu.fs
sudo mount -o loop ubuntu.fs /mnt
sudo debootstrap dapper /mnt
sudo cp /etc/apt/sources.list /mnt/etc/apt/sources.list
sudo chroot /mnt
now in the image:
passwd
aptitude update
aptitude upgrade
aptitude install openssh-server
aptitude install [more packages ... ]
cat > /etc/network/interfaces
auto lo
iface lo inet loopback
[hit ctrl^D]
auto eth0
iface eth0 inet dhcp
sudo umount /mnt
ec2-bundle-image -i ubuntu.fs -k [MYKEYFILE] -u [MYUSERID]
ec2-upload-bundle -b my-ubuntu -m image.manifest -a [MYKEY] -s [MYSECRET]
ec2-register my-ubuntu/image.manifest

63. Making EC2 Images
dd if=/dev/zero of=ubuntu.fs count=1024 bs=1M This is Hard,
mke2fs -F -j ubuntu.fs
sudo mount -o loop ubuntu.fs /mnt
sudo debootstrap dapper /mnt
Annoying,
sudo cp /etc/apt/sources.list /mnt/etc/apt/sources.list
sudo chroot /mnt and not
Easily Reproducible
now in the image:
passwd
aptitude update
aptitude upgrade
aptitude install openssh-server
aptitude install [more packages ... ]
cat > /etc/network/interfaces
auto lo
iface lo inet loopback
[hit ctrl^D]
auto eth0
iface eth0 inet dhcp
sudo umount /mnt
ec2-bundle-image -i ubuntu.fs -k [MYKEYFILE] -u [MYUSERID]
ec2-upload-bundle -b my-ubuntu -m image.manifest -a [MYKEY] -s [MYSECRET]
ec2-register my-ubuntu/image.manifest

65. A Job Opening?

67. Making VMs Today

68. Making VMs Today
• Create new VM, install new OS or
start with a base image

69. Making VMs Today
• Create new VM, install new OS or
start with a base image
• Tweak, tweak, tweak, snapshot

70. Making VMs Today
• Create new VM, install new OS or
start with a base image
• Tweak, tweak, tweak, snapshot
• Hopefully write down what you did
and where it’s running

72. What We Need

73. What We Need
• Quick and reproducible VM provisioning

74. What We Need
• Quick and reproducible VM provisioning
• Tracking contents and patches

75. What We Need
• Quick and reproducible VM provisioning
• Tracking contents and patches
• Freedom of choice in hosting/cloud

76. What We Need
• Quick and reproducible VM provisioning
• Tracking contents and patches
• Freedom of choice in hosting/cloud
• Testing locally, deploying globally

77. What We Need
• Quick and reproducible VM provisioning
• Tracking contents and patches
• Freedom of choice in hosting/cloud
• Testing locally, deploying globally
• Manage running instances

78. Elastic Server
On Demand
http://elasticserver.com

79. Elastic Server On Demand

80. Elastic Server On Demand
• Virtualization manufacturing plant

81. Elastic Server On Demand
• Virtualization manufacturing plant
• Component repositories

82. Elastic Server On Demand
• Virtualization manufacturing plant
• Component repositories
• Agnostic about OS, virtualization, app stack

83. Elastic Server On Demand
• Virtualization manufacturing plant
• Component repositories
• Agnostic about OS, virtualization, app stack
• Track server assemblies and instances

84. Elastic Server On Demand
• Virtualization manufacturing plant
• Component repositories
• Agnostic about OS, virtualization, app stack
• Track server assemblies and instances
• Provisioning portals

85. Elastic Server On Demand
• Virtualization manufacturing plant
• Component repositories
• Agnostic about OS, virtualization, app stack
• Track server assemblies and instances
• Provisioning portals
• Management console and API

87. http://es.cohesiveft.com/site/rails2

92. Dev Tools
• VMWare Fusion/Player
• MacFUSE + MacFusion
• Elastic Server Capistrano Script
http://es.cohesiveft.com/whitelabel/rails2/images/deploy.rb

94. Adding Custom
Components

97. Into The Clouds

100. Summary

101. Summary
• Save money in IT operations by
consolidating resources

102. Summary
• Save money in IT operations by
consolidating resources
• Increase dev agility through self-
provisioning, reducing friction with ops

103. Summary
• Save money in IT operations by
consolidating resources
• Increase dev agility through self-
provisioning, reducing friction with ops
• Use cloud resources to supplement
internal resources for traffic spikes
(cloudbursting) and virtual test labs

104. elasticserver.com

105. Usage Data