Vertebra

  • 26,856 views
Uploaded on

This is my presentation from RailsConf 2008 introducing Vertebra, our new cloud computing application platform

This is my presentation from RailsConf 2008 introducing Vertebra, our new cloud computing application platform

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
26,856
On Slideshare
0
From Embeds
0
Number of Embeds
8

Actions

Shares
Downloads
361
Comments
0
Likes
37

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Scaling Ruby from the Inside Out Ezra Zygmuntowicz
  • 2. Does Rails Scale?
  • 3. Does Rails Scale? Of course it does...
  • 4. Does Ruby Scale?
  • 5. Does Ruby Scale? Of course it does...
  • 6. Should you use Rails or Merb?
  • 7. Should you use Rails or Merb? YES!
  • 8. Are you sick and tired of endlessly debating this crap?
  • 9. Are you sick and tired of endlessly debating this crap? Of course you are...
  • 10. Me too, let’s talk about something more interesting...
  • 11. Scaling Ruby from the Inside Out
  • 12. What should we talk about then?
  • 13. What should we talk about then? The weather maybe?
  • 14. Forecast calls for 100% chance of clouds...
  • 15. Cloud Computing
  • 16. Cloud Computing Platforms Abstract/Virtual Resources CPU Memory Storage API Access
  • 17. Cloudy Weather • Amazon EC2 • 3terra • Engine Yard • Google App Engine • Joyent • Project Caroline • Mosso • GoGrid This is only the beginning...
  • 18. There will be *many* cloud computing platforms in the near future
  • 19. Many virtual machines to manage
  • 20. SSH doesn’t scale...
  • 21. SSH doesn’t scale... Takes time to setup/teardown connections
  • 22. SSH doesn’t scale... Takes time to setup/teardown connections Inherently push only technology
  • 23. Capistrano is an awesome tool
  • 24. Capistrano is an awesome tool but running commands on thousands of machines in parallel is pushing it further then it wants to go
  • 25. How will we manage the complexity?
  • 26. How will we manage the complexity? It’s all about the distribution...
  • 27. We’ve got to think big now! New York, Chicago, LA
  • 28. Introducing Vertebra Next Generation Cloud Computing/Automation Framework
  • 29. Enter XMPP Extensible Messaging and Presence Protocol
  • 30. Enter XMPP Extensible Messaging and Presence Protocol Extensible I like that
  • 31. Enter XMPP Extensible Messaging and Presence Protocol Messaging We want to send messages to our thousands of machines
  • 32. Enter XMPP Extensible Messaging and Presence Protocol Presence We want to know when our machines are online or not and act accordingly
  • 33. XMPP is a realtime messaging protocol built for IM/chat, great for communication between thousands of people, why not machines?
  • 34. Summoning Slices via XMPP
  • 35. Ejabberd Horizontally scalable/federated erlang XMPP/Jabber server High performance even with tens of thousands of connections Forms the backbone of the system
  • 36. Ruby based agents run on every slice/instance/node in the cloud
  • 37. Presence let's us know when agents come online or go offline
  • 38. Security/Discovery/ Introduction Framework Keeps Agents in Touch with Each Other.
  • 39. Distributed Hierarchal Key- Value Storage System Queried via XMPP
  • 40. State Machine/Workflow Engine Coordinates Multiple Agents/Humans
  • 41. Vertebra
  • 42. CREST
  • 43. CREST Cloud-REST
  • 44. CREST Cloud-REST Operations on Resources in the cloud
  • 45. operation:list /cluster/ey05 /node/42 /xen
  • 46. Resource Discovery
  • 47. Resource Discovery Who provides this set of resources?
  • 48. Resource Discovery Who provides this set of resources?
  • 49. Map/Reduce Scatter/Gather Dispatch
  • 50. Map/Reduce Scatter/Gather Dispatch Discover
  • 51. Map/Reduce Scatter/Gather Dispatch Discover Scatter
  • 52. Map/Reduce Scatter/Gather Dispatch Discover Scatter Gather
  • 53. quick demo
  • 54. Not only server automation
  • 55. Ejabberd + Comet + Jsjac == Realtime Web Platform
  • 56. Many Ideas to Experiment With
  • 57. XMPP > HTTP
  • 58. Watch this space...
  • 59. One more thing...
  • 60. One more thing... Introducing: Engine Yard Express http://express.engineyard.com/system/ey_express_v0.1.tar.bz2
  • 61. Engine Yard Express http://express.engineyard.com/system/ey_express_v0.1.tar.bz2
  • 62. Questions?