Scaling Rails Applications In The Cloud

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    4 Favorites

    Scaling Rails Applications In The Cloud - Presentation Transcript

    1. Scaling Rails Applications in the Cloud 100 new users in < 2 hours The hashtag for this talk is: #SX09-573
    2. A Typical Case Study 32 The Inevitable Mass Adoption of Our Product Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Inexorable March of Time
    3. I’m Mike Subelsky @subelsky / @otherinbox
    4. What is Cloud Computing?
    5. Solving problems across a flexible grid of nodes
    6. ...which you consume as a utility
    7. The nodes are elastic
    8. The nodes are loosely coupled Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage
    9. The nodes are distributed
    10. The nodes are ephemeral
    11. The nodes are disposable
    12. What are the benefits?
    13. Lower cost Greater efficiency Greater flexibility
    14. You want flexibility
    15. My Cloud Grows With Me! 32 Heady, Viral, Asymptomtotic Growth of Userbase Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Blink of an Eye
    16. What are the costs?
    17. Some loss of control Potential for lock-in Greater complexity
    18. You chose a language that sublimates complexity
    19. aws-S3 RightAWS Ruby/EventMachine Ruby Shines Here Hpricot memcache-client ActiveSupport
    20. Capistrano Chef Rubber PoolParty Scalr Roll Your Own
    21. What do you need to get started?
    22. Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage Bonus: Non-RDBMS
    23. Our Sky SMTP Sync Staging Staging Staging Staging Staging Staging Processing Master DB Staging Staging Staging Staging Staging Experiment Workers Web
    24. Web Cloud Mongrels & Memcached JSON Mongrels & HTML Apache HAProxy Master DB Memcached Atom Mongrels & Memcached Message Bodies Mailbox Export Requests, Domain Registration SQS S3
    25. Staging & Experiments
    26. Sync Cloud
    27. Autoscaling
    28. SMTP Cloud o et Ta SQS m s na e kin e Fil ars g S3 P Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    29. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta e SQS am skin en e Fil ars g S3 P Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 US-EAST-1B to Ta me SQS s na e kin ile rs g 3 F Pa S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    30. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X XX US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    31. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    32. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    33. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postfix MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3
    34. Loose Coupling Is How I Sleep At Night
    35. What It Looks Like
    36. Processing Cloud MessageParser h s pu cks Tasks MessageParsing Queue a allb e MessageClassfier Queue MessageClassifier c rd nam o AnyFeatureWeWant Queue ec file R ive S3 ct A AnyFeatureWorker Message Created
    37. Workers • MessageExporter • DailyUpdateSender • RegistrationWorker • BackupWorker
    38. The Database Is a Single Point of Failure
    39. How We Cope Hourly EBS Volume Snapshots Weekly Master DB Dumps Expensive Queries Memcached
    40. A Dark But Illustrative Tale with QuickTime
    41. Manual Stuff mkdir /vol mount /vol /dev/sdj sudo god start mysqld
    42. Manual Stuff change database.yml by hand (yuck) queue mail to redeliver
    43. (Wasted) Troubleshooting: 15 mins
    44. Provisioning new database: 15 mins
    45. If there was a next time...
    46. (standard programmer optimism applies) < 10 minutes
    47. Replication? Sharding?
    48. Key-Value? Columns?
    49. Logging gem Splunk Logging Good ol’ fashion tail
    50. Zenoss Hoptoad Slow query log Dash Monitoring RightScale Alertra New Relic
    51. Questions? mike@oib.com @subelsky @otherinbox
    52. Join our team Upgrade your job Open Positions • Smart, fun people • Ruby on Rails Developer • Startup environment • Ruby on Rails Intern • Cutting edge tech • Product Manager • Competitive pay • Stock options We pay $1,000 for successful referrals!
    53. rate.sxsw.com
    54. Thank you!

    + subelskysubelsky, 7 months ago

    custom

    2678 views, 4 favs, 6 embeds more stats

    Mike Subelsky from OtherInbox.com describes how Oth more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 2678
      • 1984 on SlideShare
      • 694 from embeds
    • Comments 0
    • Favorites 4
    • Downloads 49
    Most viewed embeds
    • 672 views on http://www.subelsky.com
    • 13 views on http://subelsky.com
    • 5 views on http://blogs.inspions.net
    • 2 views on http://feeds.feedburner.com
    • 1 views on http://xss.yandex.net

    more

    All embeds
    • 672 views on http://www.subelsky.com
    • 13 views on http://subelsky.com
    • 5 views on http://blogs.inspions.net
    • 2 views on http://feeds.feedburner.com
    • 1 views on http://xss.yandex.net
    • 1 views on http://jakehofman.tumblr.com

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories