Scaling Rails Applications In The Cloud

•

7 likes•1,354 views

Mike Subelsky from OtherInbox.com describes how OtherInbox uses cloud computing to scale their Ruby on Rails application.

Scaling Rails Applications in the Cloud

100 new users
in < 2 hours

The hashtag for this talk is:
#SX09-573

A Typical Case Study
32
The Inevitable Mass Adoption of Our Product

Public
Beta

8
Techcrunch50
Me, Josh, Friends & Family
and a 4
Private Beta
few other
people
The Inexorable March of Time

I’m Mike Subelsky
@subelsky / @otherinbox

Solving problems
across a ﬂexible grid
of nodes

The nodes are
loosely coupled
Tasking System

Computing Computing Computing Computing
Instance Instance Instance Instance

Permanent Storage

Lower cost
Greater eﬃciency
Greater ﬂexibility

My Cloud Grows With Me!
32
Heady, Viral, Asymptomtotic Growth of Userbase

Public
Beta

8
Techcrunch50
Me, Josh, Friends & Family
and a 4
Private Beta
few other
people
The Blink of an Eye

Some loss of control
Potential for lock-in
Greater complexity

You chose a language
that sublimates
complexity

aws-S3
RightAWS

Ruby/EventMachine

Ruby Shines Here
Hpricot
memcache-client
ActiveSupport

Capistrano
Chef
Rubber
PoolParty
Scalr
Roll Your Own

Tasking System

Computing Computing Computing Computing
Instance Instance Instance Instance

Permanent Storage

Bonus: Non-RDBMS

Our Sky
SMTP Sync

Staging
Staging
Staging
Staging
Staging
Staging

Processing Master DB

Staging
Staging
Staging
Staging
Staging
Experiment

Workers Web

Web Cloud
Mongrels &
Memcached
JSON

Mongrels &
HTML Apache HAProxy Master DB
Memcached

Atom Mongrels &
Memcached
Message Bodies
Mailbox Export Requests,
Domain Registration

SQS

S3

SMTP Cloud
o
et Ta
SQS
m s
na e kin
e
Fil ars g
S3 P

Postﬁx MailSender MailReceiver MailParser Master DB

le
Ra

Fi
w
Mb

x
bo
ox

M
Fil

w
e

Ra
S3

Loose Coupling Is How I Sleep
At Night
US-EAST-1C
to Ta
e SQS
am skin
en e
Fil ars g
S3 P

Postﬁx MailSender MailReceiver MailParser Master DB

le
Ra

Fi
w
Mb

x
bo
ox

M
Fil

w
e

Ra
S3

US-EAST-1B
to Ta
me SQS s
na e kin
ile rs g
3 F Pa
S

Postﬁx MailSender MailReceiver MailParser Master DB
le

Ra
Fi

w
Mb
x
bo

ox
M

Fil
w

e
Ra

S3

Loose Coupling Is How I Sleep
At Night
US-EAST-1C
to Ta
me SQS s
na e kin
ile rs g
3 F Pa
S

Postﬁx MailSender MailReceiver MailParser Master DB

le
Ra

Fi
w
Mb

x
bo
ox

M
Fil

w
e

Ra
S3

X XX
US-EAST-1B
o
t Ta
me SQS s
a kin
en e
Fil ars g
3P
S

Postﬁx MailSender MailReceiver MailParser Master DB
le

Ra
Fi

w
Mb
x
bo

ox
M

Fil
w

e
Ra

S3

Loose Coupling Is How I Sleep
At Night

X
US-EAST-1C
to Ta
me SQS s
na e kin
ile rs g
3 F Pa
S

Postﬁx MailSender MailReceiver MailParser Master DB

le
Ra

Fi
w
Mb

x
bo
ox

M
Fil

w
e

Ra
S3

X
US-EAST-1B
o
t Ta
me SQS s
a kin
en e
Fil ars g
3P
S

Postﬁx MailSender MailReceiver MailParser Master DB
le

Ra
Fi

w
Mb
x
bo

ox
M

Fil
w

e
Ra

S3

Processing Cloud
MessageParser
h
s
pu
cks Tasks
MessageParsing Queue
a
allb e MessageClassﬁer Queue MessageClassiﬁer
c
rd nam
o AnyFeatureWeWant Queue
ec ﬁle
R
ive S3
ct
A
AnyFeatureWorker

Message Created

Workers
• MessageExporter

• DailyUpdateSender

• RegistrationWorker

• BackupWorker

The Database Is a
Single Point of
Failure

How We Cope
Hourly
EBS Volume
Snapshots

Weekly
Master DB
Dumps

Expensive Queries
Memcached

A Dark But
Illustrative Tale
with QuickTime

Manual Stuﬀ

mkdir /vol
mount /vol /dev/sdj

sudo god start mysqld

Manual Stuﬀ

change database.yml by hand (yuck)

queue mail to redeliver

(standard programmer
optimism applies)
< 10 minutes

Logging gem Splunk

Logging

Good ol’ fashion tail

Zenoss
Hoptoad

Slow query log
Dash

Monitoring
RightScale

Alertra New Relic

Questions?
mike@oib.com

@subelsky
@otherinbox

Join our team
Upgrade your job Open Positions
• Smart, fun people
• Ruby on Rails Developer
• Startup environment
• Ruby on Rails Intern
• Cutting edge tech
• Product Manager
• Competitive pay
• Stock options

We pay $1,000 for successful referrals!

This webinar in the course of the LOD2 webinar series will present the release 2.0 of the LOD2 stack, which contains updates to the components Ontowiki, Silk * the assisting sparql editor SPARQLED (DERI), * the LOD enabled Open Refine (previously Google Refine) (ZEMANTA), * the extended version of SILK with link suggestion management from LATC (DERI), * the rdfAuthor library which allows to manage structured information from RDFa-enhanced websites (ULEI), * the SPARQLPROXY which is a PHP based forward proxy for remote access to SPARQL end points (ULEI) Release 2.0 contains also a first contributed debian package for a component which is maintained by a group outside the LOD2 consortium. With the help of ULEI a package for the STANBOL engine (http://stanbol.apache.org/) has been contributed. If you are interested in Linked (Open) Data principles and mechanisms, LOD tools & services and concrete use cases that can be realised using LOD then join us in the free LOD2 webinar series! http://lod2.eu/BlogPost/webinar-series

Cim 20070701 jul_2007Carlos Alberto Bonatto

Coordination of Resource-Constrained Devices through a Distributed Semantic S...

Open University, KMi

Cim 20071101 nov_2007Carlos Alberto Bonatto

Vertically Challenged

Command Prompt., Inc

Aurynn Shaw In this talk, we will cover Vertically Challenged, a plugin for repoze.who which utilizes the Postgres system roles for web application authorization. We will be covering the underlying theory of Vertically Challenged, both in terms of benefits to your project, as well as the weaknesses of the concept, and how VC leverages database functionality to make your application easier to code and maintain. We will also be covering how to design your database roles tree, how Vertically Challenged makes your roles tree available in the application layer, and how to integrate Vertically Challenged with repoze.who.

Wilson presentationAlison Bell

2011 第二届全国小学方块精灵锦标赛游戏规则ckpeng

Barcamp 101708 V1nateabbott

This was a talk at O'Reilly UK's "Ignite" event in leeds. It tries in 20 slides/5 minutes to give an overview of what makes concurrency actually useable and fun in general purpose languages. Whilst Kamaelia is python based, a proof of concept for the core has been done in C++, Ruby & Java, and our "introduction" tutorial teaches anyone (even complete novices) how to build their own proof of concept in python.

Challenges in Maintaining a High Performance Search Engine Written in Java

lucenerevolution

Presented by Simon Willnauer | Apache Lucene - See conference video - http://www.lucidimagination.com/devzone/events/conferences/lucene-revolution-2012 During the last decade Apache Lucene became the de-facto standard in open source search technology. Thousands of applications from Twitter Scale Webservices to Computers playing Jeopardy rely on Lucene, a rock-solid, scaleable and fast information-retrieval library entirely written in Java. Maintaining and improving such a popular software library reveals tough challenges in testing, API design, data-structures, concurrency and optimizations. This talk presents the most demanding technical challenges the Lucene Development Team has solved in the past. It covers a number of areas of software development including concurrency & parallelism, testing infrastructure, data-structures, algorithms, API designs with respect to Garbage Collection, and Memory efficiency and efficient resource utilization. This talk doesn’t require any Apache Lucene or information-retrieval background in general. Knowledge about the Java programming language will certainly be helpful while the problems and techniques presented in this talk aren’t Java specific.

Future of WCM - CM Forum Belgium

David Nuescheler

Cms forum, future of Web Content Managementguest88136a

Creating Cloud Communities

Peter Coffee

Joyent Cloud Advantagesdmasciorini

OpenStack and OpenFlow Demos

Brent Salisbury

Automating Oracle Database deployment with Amazon Web Services, fabric, and boto

mjbommar

Have credit card, need database? In this talk, I'll show you how to deploy your own Oracle 11gR2 sandbox with a single keystroke (and I don't mean RDS). Along the way, we'll learn about Infrastructure-as-a-Service with boto, provisioning tools like fabric, and Oracle response files. When we're done, we'll have a repeatable, ten-minute process that can deliver a server as cheap as $5/day or as powerful as 40k IOPS and 2.6GB/s throughput. More importantly, we'll understand what the big deal about IaaS and automated provisioning really is, and how enterprise products like Oracle can still fit comfortably in the space.

Behind the Scenes at LiveJournal: Scaling Storytime

SergeyChernyshev

vBrownBag OpenStack Networking Talk

mestery

STAQ Development Manual (Redacted)

Mike Subelsky

This deck represents our current thinking about the best way to build enterprise SaaS software in 2015 - using a variety of techniques from several disciplines. Since I wrote this I have also become very interested in resilience engineering and the notion that web developers are primarily engaged in the construction of socio-technical systems. When I rewrite this I plan to talk about how we should try to minimize mean-time-to-recover (MTTR) instead of mean-time-between-failures (MTBF), and how continuous deployment grows a safety culture around your operations. I redacted most of the examples that illustrate these points because they use sensitive code examples or URLs. If you want to see the rest of slides, join us!

Coding for uncertainty

Mike Subelsky

Similar to Scaling Rails Applications In The Cloud

A Methodology for the Emulation of Boolean Logic that Paved the Way for the S...ricky_pi_tercios

Http Jaoo.Com.Au Sydney 2008 File Path= Jaoo Aus2008 Slides Dave Thomas Lif...

qedanne

近未来的並列 LL

Motohiro Takayama

SAM SIG: Hadoop architecture, MapReduce patterns, and best practices with Cas...

cwensel

雲端與Big data

Ya-hui Lin

Tom Krcha - Future of FlashDevGAMM Conference

Bangalore cloudstack user group

ShapeBlue

Learn OpenStack from trystack.cn ——Folsom in practice

OpenCity Community

Microsoft HPC User Group

sjwoodman

Delay Tolerant Streaming Services, Thomas Plagemann, UiO

The Research Council of Norway, IKTPLUSS

Embracing concurrency for fun utility and simpler code

kamaelian

Challenges in Maintaining a High Performance Search Engine Written in Java

lucenerevolution

Future of WCM - CM Forum Belgium

David Nuescheler

Cms forum, future of Web Content Managementguest88136a

Creating Cloud Communities

Peter Coffee

Joyent Cloud Advantagesdmasciorini

OpenStack and OpenFlow Demos

Brent Salisbury

Automating Oracle Database deployment with Amazon Web Services, fabric, and boto

mjbommar

Behind the Scenes at LiveJournal: Scaling Storytime

SergeyChernyshev

vBrownBag OpenStack Networking Talk

mestery

Similar to Scaling Rails Applications In The Cloud (20)

A Methodology for the Emulation of Boolean Logic that Paved the Way for the S...

Http Jaoo.Com.Au Sydney 2008 File Path= Jaoo Aus2008 Slides Dave Thomas Lif...

近未来的並列 LL

SAM SIG: Hadoop architecture, MapReduce patterns, and best practices with Cas...

雲端與Big data

Tom Krcha - Future of Flash

Bangalore cloudstack user group

Learn OpenStack from trystack.cn ——Folsom in practice

Microsoft HPC User Group

Delay Tolerant Streaming Services, Thomas Plagemann, UiO

Embracing concurrency for fun utility and simpler code

Challenges in Maintaining a High Performance Search Engine Written in Java

Future of WCM - CM Forum Belgium

Cms forum, future of Web Content Management

Creating Cloud Communities

Joyent Cloud Advantages

OpenStack and OpenFlow Demos

Automating Oracle Database deployment with Amazon Web Services, fabric, and boto

Behind the Scenes at LiveJournal: Scaling Storytime

vBrownBag OpenStack Networking Talk

Recently uploaded

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Product School

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Search and Society: Reimagining Information Access for Radical Futures

Bhaskar Mitra

The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx

Abida Shariff

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

Knowledge engineering: from people to machines and back

Elena Simperl

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

The Art of the Pitch: WordPress Relationships and Sales

Laura Byrne

Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes? All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.

Key Trends Shaping the Future of Infrastructure.pdf

Cheryl Hung

Recently uploaded (20)

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Connector Corner: Automate dynamic content and events by pushing a button

Leading Change strategies and insights for effective change management pdf 1.pdf

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance Osaka Seminar: Overview.pdf

Essentials of Automations: Optimizing FME Workflows with Parameters

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Search and Society: Reimagining Information Access for Radical Futures

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

JMeter webinar - integration with InfluxDB and Grafana

IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

Knowledge engineering: from people to machines and back

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

The Art of the Pitch: WordPress Relationships and Sales

Key Trends Shaping the Future of Infrastructure.pdf

Scaling Rails Applications In The Cloud

1. Scaling Rails Applications in the Cloud 100 new users in < 2 hours The hashtag for this talk is: #SX09-573

2. A Typical Case Study 32 The Inevitable Mass Adoption of Our Product Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Inexorable March of Time

3. I’m Mike Subelsky @subelsky / @otherinbox

4. What is Cloud Computing?

5. Solving problems across a ﬂexible grid of nodes

6. ...which you consume as a utility

7. The nodes are elastic

8. The nodes are loosely coupled Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage

9. The nodes are distributed

10. The nodes are ephemeral

11. The nodes are disposable

12. What are the beneﬁts?

13. Lower cost Greater eﬃciency Greater ﬂexibility

14. You want ﬂexibility

15. My Cloud Grows With Me! 32 Heady, Viral, Asymptomtotic Growth of Userbase Public Beta 8 Techcrunch50 Me, Josh, Friends & Family and a 4 Private Beta few other people The Blink of an Eye

16. What are the costs?

17. Some loss of control Potential for lock-in Greater complexity

18. You chose a language that sublimates complexity

19. aws-S3 RightAWS Ruby/EventMachine Ruby Shines Here Hpricot memcache-client ActiveSupport

20.

21. Capistrano Chef Rubber PoolParty Scalr Roll Your Own

22. What do you need to get started?

23. Tasking System Computing Computing Computing Computing Instance Instance Instance Instance Permanent Storage Bonus: Non-RDBMS

24. Our Sky SMTP Sync Staging Staging Staging Staging Staging Staging Processing Master DB Staging Staging Staging Staging Staging Experiment Workers Web

25. Web Cloud Mongrels & Memcached JSON Mongrels & HTML Apache HAProxy Master DB Memcached Atom Mongrels & Memcached Message Bodies Mailbox Export Requests, Domain Registration SQS S3

26. Staging & Experiments

27. Sync Cloud

28. Autoscaling

29. SMTP Cloud o et Ta SQS m s na e kin e Fil ars g S3 P Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

30. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta e SQS am skin en e Fil ars g S3 P Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 US-EAST-1B to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

31. Loose Coupling Is How I Sleep At Night US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X XX US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

32. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

33. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

34. Loose Coupling Is How I Sleep At Night X US-EAST-1C to Ta me SQS s na e kin ile rs g 3 F Pa S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3 X US-EAST-1B o t Ta me SQS s a kin en e Fil ars g 3P S Postﬁx MailSender MailReceiver MailParser Master DB le Ra Fi w Mb x bo ox M Fil w e Ra S3

35. Loose Coupling Is How I Sleep At Night

36. What It Looks Like

37. Processing Cloud MessageParser h s pu cks Tasks MessageParsing Queue a allb e MessageClassfier Queue MessageClassifier c rd nam o AnyFeatureWeWant Queue ec file R ive S3 ct A AnyFeatureWorker Message Created

38. Workers • MessageExporter • DailyUpdateSender • RegistrationWorker • BackupWorker

39. The Database Is a Single Point of Failure

40. How We Cope Hourly EBS Volume Snapshots Weekly Master DB Dumps Expensive Queries Memcached

41. A Dark But Illustrative Tale with QuickTime

42.

43.

44.

45.

46. Manual Stuﬀ mkdir /vol mount /vol /dev/sdj sudo god start mysqld

47. Manual Stuﬀ change database.yml by hand (yuck) queue mail to redeliver

48. (Wasted) Troubleshooting: 15 mins

49. Provisioning new database: 15 mins

50. If there was a next time...

51. (standard programmer optimism applies) < 10 minutes

52. Replication? Sharding?

53. Key-Value? Columns?

54. Logging gem Splunk Logging Good ol’ fashion tail

55. Zenoss Hoptoad Slow query log Dash Monitoring RightScale Alertra New Relic

56. Questions? mike@oib.com @subelsky @otherinbox

57. Join our team Upgrade your job Open Positions • Smart, fun people • Ruby on Rails Developer • Startup environment • Ruby on Rails Intern • Cutting edge tech • Product Manager • Competitive pay • Stock options We pay $1,000 for successful referrals!

58. rate.sxsw.com

59. Thank you!

Scaling Rails Applications In The Cloud

Recommended

Recommended

More Related Content

Similar to Scaling Rails Applications In The Cloud

Similar to Scaling Rails Applications In The Cloud (20)

More from Mike Subelsky

More from Mike Subelsky (12)

Recently uploaded

Recently uploaded (20)

Scaling Rails Applications In The Cloud