This is my presentation from RailsConf 2008 introducing Vertebra, our new cloud computing application platform

2. Scaling Ruby from the
Inside Out
Ezra Zygmuntowicz

3. Does Rails Scale?

4. Does Rails Scale?
Of course it does...

5. Does Ruby Scale?

6. Does Ruby Scale?
Of course it does...

7. Should you use Rails or
Merb?

8. Should you use Rails or
Merb?
YES!

9. Are you sick and tired
of endlessly debating
this crap?

10. Are you sick and tired
of endlessly debating
this crap?
Of course you are...

11. Me too, let’s talk about
something more
interesting...

12. Scaling Ruby from the
Inside Out

13. What should we talk
about then?

14. What should we talk
about then?
The weather maybe?

15. Forecast calls for 100%
chance of clouds...

16. Cloud Computing

17. Cloud Computing
Platforms
Abstract/Virtual Resources
CPU
Memory
Storage
API Access

18. Cloudy Weather
• Amazon EC2 • 3terra
• Engine Yard • Google App Engine
• Joyent • Project Caroline
• Mosso • GoGrid
This is only the beginning...

19. There will be *many*
cloud computing
platforms in the near
future

20. Many virtual machines
to manage

21. SSH doesn’t scale...

22. SSH doesn’t scale...
Takes time to setup/teardown
connections

23. SSH doesn’t scale...
Takes time to setup/teardown
connections
Inherently push only technology

24. Capistrano is an awesome tool

25. Capistrano is an awesome tool
but running commands on
thousands of machines in
parallel is pushing it further
then it wants to go

26. How will we manage
the complexity?

27. How will we manage
the complexity?
It’s all about the
distribution...

28. We’ve got to think big now!
New York, Chicago, LA

29. Introducing Vertebra
Next Generation Cloud
Computing/Automation
Framework

30. Enter XMPP
Extensible Messaging and Presence Protocol

31. Enter XMPP
Extensible Messaging and Presence Protocol
Extensible
I like that

32. Enter XMPP
Extensible Messaging and Presence Protocol
Messaging
We want to send messages to our thousands of machines

33. Enter XMPP
Extensible Messaging and Presence Protocol
Presence
We want to know when our machines are online or not
and act accordingly

34. XMPP is a realtime
messaging protocol built for
IM/chat, great for
communication between
thousands of people, why
not machines?

35. Summoning Slices via XMPP

36. Ejabberd
Horizontally scalable/federated erlang XMPP/Jabber server
High performance even with tens of thousands of connections
Forms the backbone of the system

37. Ruby based agents run on
every slice/instance/node
in the cloud

38. Presence let's us know when
agents come online or go
offline

39. Security/Discovery/
Introduction Framework
Keeps Agents in Touch with
Each Other.

40. Distributed Hierarchal Key-
Value Storage System
Queried via XMPP

41. State Machine/Workflow
Engine Coordinates Multiple
Agents/Humans

42. Vertebra

43. CREST

44. CREST
Cloud-REST

45. CREST
Cloud-REST
Operations on Resources
in the cloud

46. operation:list
/cluster/ey05
/node/42
/xen

47. Resource Discovery

48. Resource Discovery
Who provides this set of resources?

49. Resource Discovery
Who provides this set of resources?

50. Map/Reduce
Scatter/Gather Dispatch

51. Map/Reduce
Scatter/Gather Dispatch
Discover

52. Map/Reduce
Scatter/Gather Dispatch
Discover Scatter

53. Map/Reduce
Scatter/Gather Dispatch
Discover Scatter Gather

54. quick demo

55. Not only server
automation

56. Ejabberd + Comet + Jsjac
==
Realtime Web Platform

57. Many Ideas to
Experiment With

58. XMPP > HTTP

59. Watch this space...

60. One more thing...

61. One more thing...
Introducing:
Engine Yard Express
http://express.engineyard.com/system/ey_express_v0.1.tar.bz2

62. Engine Yard Express
http://express.engineyard.com/system/ey_express_v0.1.tar.bz2

63. Questions?