Scaling the Britain's Got Talent Buzzer

•

0 likes•1,046 views

Malcolm Box

How Live Talkback scaled the Britain's Got Talent buzzer to support 50,000 requests/second

Technology Entertainment & Humor

1

Powering the Britain’s Got Talent
buzzer*
*And Big Data

Big Data Meetup, London 25/5/2011

Thursday, 26 May 2011 1

3

Me

Malcolm Box, Co-founder & CTO

boxm@livetalkback.com

@malcolmbox

Thursday, 26 May 2011 3

4

The Buzzer

BIG DATA

Thursday, 26 May 2011 4

5

The challenge

10 Million+ viewers

Design goal of 50,000 requests/s, 10,000 buzzes/second

Equivalent to 130 Billion requests/month

But just on Saturday night

And four weeks to build

Thursday, 26 May 2011 5

6

The challenge

Where does 130
Billion requests ﬁt?

Source: http://www.google.com/adplanner/static/top1000/#

Thursday, 26 May 2011 6

7

Where we started....

app.livetalkback.com cdn.livetalkback.com

Control plane
ELB CloudFront

Zabbix
Webserver Webserver
Django Django
Ubuntu Ubuntu

MySQL S3

Thursday, 26 May 2011 7

8

Step 1: Testing

Started with a platform with a previous peak of 100 requests/s

No idea where it would break

Tsung! http://tsung.erlang-projects.org/

Thursday, 26 May 2011 8

9

Step 2: ELB

Amazon Elastic Load Balancer

“Inﬁnite capacity”

BUT very long impulse response and NO controls :(

HAProxy to the rescue

5K requests/s per node

Thursday, 26 May 2011 9

10

Step 3: Avoid the DB

MySQL was never going to be able to handle 10,000 writes/s, nor 50,000
reads

“Hey, Django does memcached. Problem solved”

Help, our memcached server I/O is maxed out :(

Two-layer cache: https://gist.github.com/953524

Write-behind data

Thursday, 26 May 2011 10

11

But we want analytics!

Now 10K things to write to disk every second

Logging? Database?

This is starting to look like BIG DATA

Thursday, 26 May 2011 11

12

Step 4: Baby

Thursday, 26 May 2011 12

13

Step 5: Cassandra

Deployed Cassandra cluster on EC2 to handle buzz records

Tested to > 10K writes/s

All good!

“So how many users did we have last night?”

Thursday, 26 May 2011 13

14

Where we ended...

app.livetalkback.com cdn.livetalkback.com
10
Control plane
HAProxy HAProxy CloudFront nodes

Chef

Webserver Webserver 100+
nodes
Django Django
Ubuntu Ubuntu
Zabbix

Memcached Cassandra
Memcached Cassandra RDS Master S3

Thursday, 26 May 2011 14

15

Scaling up - and down

Conﬁguring 100+ servers by
hand each week would have
been a pain

Used to Chef to automate

Also builds the test swarm

http://wiki.opscode.com/display/
chef/Home

Thursday, 26 May 2011 15

16

Now what?

Still challenges with analytics & ad-hoc queries

Looking at Brisk and Hadoop

We’re sucking the Twitter ﬁrehose for Tellybug

MySQL is coping so far, but only just

Thursday, 26 May 2011 16

17

Questions?
boxm@livetalkback.com

@malcolmbox

Thursday, 26 May 2011 17

Similar to Scaling the Britain's Got Talent Buzzer

Retrospective from a startup built in the cloud: top three big lessons learne...

Jeff Malek

Caridy patino - node-js

StarTech Conference

Conquistando el Servidor con Node.JS

Caridy Patino

http://wiki4.caucho.com/Java_EE_Tutorial_covering_JSP_2.2,_and_Servlets_3.0 This tutorial focuses on using Servlet's and JSP the right way. Servlet and JSP have evolved over the years, and now there is often more than one way to do things. For example, this tutorial uses EL and JSTL not JSP scriptlets, it uses JSPs in a Model 2/MVC style not in a model 1 style, etc. Consider it a tutorial that focuses only on the best practices and not the legacy ways to do things. There are other tutorials on this subject, but this tutorial is going to be different in that it is going to put all code into github, and you can follow along with Eclipse. Also instead of focusing on JSF, we are going to focus on JSP and Servlets as the main view technology. Java EE, JSP and Servlets have added a lot of features that are in other frameworks, making those other frameworks less relevant then they were before Java EE garnered these extra abilities. Even is you decide to use JSF, Struts, Stripes, Spring MVC, JSF, etc., this tutorial should help you have a better understanding of the JSP/Servlets core that they build on. We are going to start by building a simple bookstore. We will progressively add more features to the bookstore and as we do we will use more of Java EE/CDI, JSP and Servlets. For this tutorial, I am going to use Resin 4.0.x, but you could use any Java EE 6 Web Profile compliant application server.

Java EE Servlet JSP Tutorial- Cookbook 1

billdigman

Scaling Selenium

Noah Sussman

AppScale Talk at SBonRails

Chris Bunch

This was a talk given internally at BloomReach as well as a guest lecture to a grad level Data Structures and Algorithms class at the University of Texas at Arlington. A Deep dive on the history of containers, and how they work under the cover utilizing Linux Kernel features such as Process Namespaces and Control Groups. I also go over a bit of the history of Container technology, going from Chroot and Jails and Zones, to LXC and Docker

Corwin on Containers

Corwin Brown

What python can learn from java

jbellis

presentation-chaos-monkey

Matthew Campbell

2011 02-14-libre

Vu Hung Nguyen

WTF Is Messaging And Why You Should Use It?

James Russell

20110903 candycane

Yusuke Ando

Shake Hooves With BeEF - OWASP AppSec APAC 2012

Christian Frichot

Big Data Israel Meetup : Couchbase and Big Data

Tugdual Grall

We all feel alone sometimes. Akka got along well with the VM crew ever since it was born, but new friends and fresh ideas are always necessary. Which is why lately Akka loves spending time with Kubernetes! Maybe the reason why they like each other so much is their sharing of core values such as transparent scalability and resilience. How do these two technologies compare from a Reactive standpoint? Does one supersede the other? In fact, their powers can be combined to design distributed systems all the way from application code to cloud instance.

We all need friends and Akka just found Kubernetes

Fabio Tiriticco

Session presented at the 2nd IndicThreads.com Conference on Cloud Computing held in Pune, India on 3-4 June 2011. http://CloudComputing.IndicThreads.com Amazon Elastic Beanstalk provides developers an easy way to build and deploy highly scalable web applications. Elastic Beanstalk automatically handles the deployment details of capacity provisioning, load balancing, auto-scaling, and application health monitoring. Elastic Beanstalk leverages AWS services such as Amazon EC2, Amazon S3, Amazon Simple Notification Service, Elastic Load Balancing, and Auto-Scaling to deliver the same highly reliable, scalable, and cost-effective infrastructure that hundreds of thousands of businesses depend on today. This session will look at building and deploying application on Amazon’s Elastic Beanstalk. Speaker: Janakiram MSV is the Technology Evangelist at Amazon Web Services (AWS) in India. His responsibilities include enabling ISVs, SIs and enterprises with the skills to move their IT infrastructure and applications to the Cloud. In his previous role, he was the Technology Architect – Cloud at Microsoft Corporation where he was responsible for architecting enterprise solutions on the Microsoft Cloud Computing platform.

Amazon Elastic Beanstalk - Indicthreads.com cloud computing conference 2011

IndicThreads

HTTP cache @ PUG Rome 03-29-2011

Alessandro Nadalin

Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011...

Amazon Web Services

I will tell you war stories from Kubernetes implementations in two startups: a fashion ecommerce - Lykehq - and Fintech/Machine Learning - SMACC. Getting them to Continuous Deployment, mistakes I made, and how we solve them. Show why K8S is such a powerful tool and -- most important for me -- it gives you learn-as-you-go experience. The new linux, the new application server some say. Check: https://github.com/wojciech12/talk_cloudnative_and_kubernetes_waw

Effective Platform Building with Kubernetes. Is K8S new Linux?

Wojciech Barczyński

2 my sql overview technology etc[1]. etc

Prof. Erwin Globio

Similar to Scaling the Britain's Got Talent Buzzer (20)

Retrospective from a startup built in the cloud: top three big lessons learne...

Caridy patino - node-js

Conquistando el Servidor con Node.JS

Java EE Servlet JSP Tutorial- Cookbook 1

Scaling Selenium

AppScale Talk at SBonRails

Corwin on Containers

What python can learn from java

presentation-chaos-monkey

2011 02-14-libre

WTF Is Messaging And Why You Should Use It?

20110903 candycane

Shake Hooves With BeEF - OWASP AppSec APAC 2012

Big Data Israel Meetup : Couchbase and Big Data

We all need friends and Akka just found Kubernetes

Amazon Elastic Beanstalk - Indicthreads.com cloud computing conference 2011

HTTP cache @ PUG Rome 03-29-2011

Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011...

Effective Platform Building with Kubernetes. Is K8S new Linux?

2 my sql overview technology etc[1]. etc

Recently uploaded

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

DBX First Quarter 2024 Investor Presentation

Dropbox

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Recently uploaded (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Boost Fertility New Invention Ups Success Rates.pdf

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

WSO2's API Vision: Unifying Control, Empowering Developers

Elevate Developer Efficiency & build GenAI Application with Amazon Q

DBX First Quarter 2024 Investor Presentation

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Why Teams call analytics are critical to your entire business

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

AWS Community Day CPH - Three problems of Terraform

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Six Myths about Ontologies: The Basics of Formal Ontology

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Corporate and higher education May webinar.pptx

Strategies for Landing an Oracle DBA Job as a Fresher

Scaling the Britain's Got Talent Buzzer

1. 1 Powering the Britain’s Got Talent buzzer* *And Big Data Big Data Meetup, London 25/5/2011 Thursday, 26 May 2011 1

2. 2 What we do Thursday, 26 May 2011 2

3. 3 Me Malcolm Box, Co-founder & CTO boxm@livetalkback.com @malcolmbox Thursday, 26 May 2011 3

4. 4 The Buzzer BIG DATA Thursday, 26 May 2011 4

5. 5 The challenge 10 Million+ viewers Design goal of 50,000 requests/s, 10,000 buzzes/second Equivalent to 130 Billion requests/month But just on Saturday night And four weeks to build Thursday, 26 May 2011 5

6. 6 The challenge Where does 130 Billion requests ﬁt? Source: http://www.google.com/adplanner/static/top1000/# Thursday, 26 May 2011 6

7. 7 Where we started.... app.livetalkback.com cdn.livetalkback.com Control plane ELB CloudFront Zabbix Webserver Webserver Django Django Ubuntu Ubuntu MySQL S3 Thursday, 26 May 2011 7

8. 8 Step 1: Testing Started with a platform with a previous peak of 100 requests/s No idea where it would break Tsung! http://tsung.erlang-projects.org/ Thursday, 26 May 2011 8

9. 9 Step 2: ELB Amazon Elastic Load Balancer “Inﬁnite capacity” BUT very long impulse response and NO controls :( HAProxy to the rescue 5K requests/s per node Thursday, 26 May 2011 9

10. 10 Step 3: Avoid the DB MySQL was never going to be able to handle 10,000 writes/s, nor 50,000 reads “Hey, Django does memcached. Problem solved” Help, our memcached server I/O is maxed out :( Two-layer cache: https://gist.github.com/953524 Write-behind data Thursday, 26 May 2011 10

11. 11 But we want analytics! Now 10K things to write to disk every second Logging? Database? This is starting to look like BIG DATA Thursday, 26 May 2011 11

12. 12 Step 4: Baby Thursday, 26 May 2011 12

13. 13 Step 5: Cassandra Deployed Cassandra cluster on EC2 to handle buzz records Tested to > 10K writes/s All good! “So how many users did we have last night?” Thursday, 26 May 2011 13

14. 14 Where we ended... app.livetalkback.com cdn.livetalkback.com 10 Control plane HAProxy HAProxy CloudFront nodes Chef Webserver Webserver 100+ nodes Django Django Ubuntu Ubuntu Zabbix Memcached Cassandra Memcached Cassandra RDS Master S3 Thursday, 26 May 2011 14

15. 15 Scaling up - and down Conﬁguring 100+ servers by hand each week would have been a pain Used to Chef to automate Also builds the test swarm http://wiki.opscode.com/display/ chef/Home Thursday, 26 May 2011 15

16. 16 Now what? Still challenges with analytics & ad-hoc queries Looking at Brisk and Hadoop We’re sucking the Twitter ﬁrehose for Tellybug MySQL is coping so far, but only just Thursday, 26 May 2011 16

17. 17 Questions? boxm@livetalkback.com @malcolmbox Thursday, 26 May 2011 17

Scaling the Britain's Got Talent Buzzer

Recommended

Recommended

More Related Content

Similar to Scaling the Britain's Got Talent Buzzer

Similar to Scaling the Britain's Got Talent Buzzer (20)

Recently uploaded

Recently uploaded (20)

Scaling the Britain's Got Talent Buzzer