Scaling Rails Applications In The Cloud

1. Scaling Rails Applications in the Cloud 100 new users in < 2 hours The hashtag for this talk is: #SX09-573

2. A Typical Case Study 32 The Inevitable Mass Adoption of Our Product Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Inexorable March of Time

3. I’m Mike Subelsky @subelsky / @otherinbox

4. What is Cloud Computing?

5. Solving problems across a ﬂexible grid of nodes

6. ...which you consume as a utility

7. The nodes are elastic

8. The nodes are loosely coupled Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage

9. The nodes are distributed

10. The nodes are ephemeral

11. The nodes are disposable

12. What are the beneﬁts?

13. Lower cost Greater eﬃciency Greater ﬂexibility

14. You want ﬂexibility

15. My Cloud Grows With Me! 32 Heady, Viral, Asymptomtotic Growth of Userbase Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Blink of an Eye

16. What are the costs?

17. Some loss of control Potential for lock-in Greater complexity

18. You chose a language that sublimates complexity

19. aws-S3 RightAWS Ruby/EventMachine Ruby Shines Here Hpricot memcache-client ActiveSupport

20. Capistrano Chef Rubber PoolParty Scalr Roll Your Own

21. What do you need to get started?

22. Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage Bonus: Non-RDBMS

23. Our Sky SMTP Sync Staging Staging Staging Staging Staging Staging Processing Master DB Staging Staging Staging Staging Staging Experiment Workers Web

24. Web Cloud Mongrels & Memcached JSON Mongrels & HTML Apache HAProxy Master DB Memcached Atom Mongrels & Memcached Message Bodies Mailbox Export Requests, Domain Registration SQS S3

25. Staging & Experiments

26. Sync Cloud

27. Autoscaling

28. SMTP Cloud o et Ta SQS m s na e kin e Fil ars g S3 P Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

29. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta e SQS am skin en e Fil ars g S3 P Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 US-EAST-1B to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

30. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X XX US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

31. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

34. Loose Coupling Is How I Sleep At Night

35. What It Looks Like

36. Processing Cloud MessageParser h s pu cks Tasks MessageParsing Queue a allb e MessageClassfier Queue MessageClassifier c rd nam o AnyFeatureWeWant Queue ec file R ive S3 ct A AnyFeatureWorker Message Created

37. Workers • MessageExporter • DailyUpdateSender • RegistrationWorker • BackupWorker

38. The Database Is a Single Point of Failure

39. How We Cope Hourly EBS Volume Snapshots Weekly Master DB Dumps Expensive Queries Memcached

40. A Dark But Illustrative Tale with QuickTime

41. Manual Stuﬀ mkdir /vol mount /vol /dev/sdj sudo god start mysqld

42. Manual Stuﬀ change database.yml by hand (yuck) queue mail to redeliver

43. (Wasted) Troubleshooting: 15 mins

44. Provisioning new database: 15 mins

45. If there was a next time...

46. (standard programmer optimism applies) < 10 minutes

47. Replication? Sharding?

48. Key-Value? Columns?

49. Logging gem Splunk Logging Good ol’ fashion tail

50. Zenoss Hoptoad Slow query log Dash Monitoring RightScale Alertra New Relic

51. Questions? mike@oib.com @subelsky @otherinbox

52. Join our team Upgrade your job Open Positions • Smart, fun people • Ruby on Rails Developer • Startup environment • Ruby on Rails Intern • Cutting edge tech • Product Manager • Competitive pay • Stock options We pay $1,000 for successful referrals!

53. rate.sxsw.com

54. Thank you!

Scaling Rails Applications In The Cloud

You are reading a preview.

Check these out next

Scaling Rails Applications In The Cloud

More Related Content

Similar to Scaling Rails Applications In The Cloud (20)

More from Mike Subelsky (12)

Recently uploaded (20)