Scaling Hotstar.com for 10Mn concurrency

•Download as PPTX, PDF•

2 likes•386 views

AWS Community Day Oct 2018. Learn about how Hotstar prepares its infrastructure via massive scale testing and tips to push your infrastructure to Hotstar scale!

Engineering

Scaling Hotstar.com for
10Mn concurrency
CHALLENGES & LEARNINGS
Gaurav Kamboj
Cloud Architect at Hotstar

Let’s talk about Scale!
10Mn+
PEAK CONCURRENCY DURING
VIVO IPL FINAL
5.7 Tbps
PEAK BANDWIDTH CONSUMPTION
1Mn
PEAK REQUESTS PER SECOND
10Bn+
CLICKSTREAM MESSAGES
100+
HOURS OF LIVE TRANSCODING
EVERYDAY

Game Day
FACE THE REAL GAME BEFORE THE ACTUAL GAME
36,000
CPUs
80 Gbps
NETWORK OUT
72 TB
RAM
8 REGIONS
GEO DISTRIBUTED
Project HULK
● Load Generation
● Performance & Tsunami Tests
● Chaos Engineering
● Traffic Pattern using ML

Race against time!
+ 500K
GROWTH RATE PER MINUTE
(CONCURRENCY)
FULLY BAKED AMIs
4 mins
APPLICATION BOOT-UP TIME
90 SECONDS
REACTION TIME
PUSH NOTIFICATIONS

Why we don’t use autoscaling
INSUFFICIENT
CAPACITY
ERRORS
GAME OF (AVAILABILITY) ZONES
STEP SIZE
AUTOSCALING GROUPS

Others challenges..
SINGLE
INSTANCE TYPE
PER AUTO SCALING GROUP
API
THROTTLING
RETRIES &
EXPONENTIAL
BACKOFF

PREWARM INFRA
BEFORE MATCH TIME
PROACTIVE SCALE UP
WITH BUFFER FOR SPIKES
SECONDARY
AUTO SCALING GROUP
SPOT FLEET
DIVERSIFIED INSTANCE TYPES
Battle tested scaling strategy!

MACHINE LEARNING
BASED AUTO SCALING
Future.. IPL 2019 onwards
INTELLIGENT
SCALE UP DECISIONS
RUN IPL & WORLD CUP 2019 ON
AUTO PILOT MODE

Similar to Scaling Hotstar.com for 10Mn concurrency

Applying AI in Games (GDC2019)Jun Okumura

Scaling Deep LearningIntel® Software

Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...OdessaJS Conf

Mining crypto in browser as a bleeding edge performance challenge for the Web...Denis Radin

Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Maria Kuneva

BGF 2012 (Browsergames Forum)Christof Wegmann

GPU Technology Conference 2014 KeynoteNVIDIA

JITServerTalk-OSS-2023.pdfRichHagarty

GTC 2022 KeynoteAlison B. Lowndes

Rollup-as-a-service and why it matters to the next-gen of dAppsTinaBregovi

Gluecon 2013 netflix api crash courseBenjamin Schmaus

GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelUmbra Software

Advanced #4 GPU & AnimationsVitali Pekelis

Gömülü Sistemlerde Derin Öğrenme UygulamalarıFerhat Kurt

Getting The Most Out of VR | Sinjin BainJessica Tams

FGS 2011: Making A Game With Molehill: Zombie Tycoonmochimedia

Killzone Shadow Fall Demo PostmortemGuerrilla

High Performance Cloud ComputingAmazon Web Services

The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...Johan Andersson

Similar to Scaling Hotstar.com for 10Mn concurrency (20)

Applying AI in Games (GDC2019)

Scaling Deep Learning

Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...

Mining crypto in browser as a bleeding edge performance challenge for the Web...

Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...

BGF 2012 (Browsergames Forum)

GPU Technology Conference 2014 Keynote

JITServerTalk-OSS-2023.pdf

GTC 2022 Keynote

Rollup-as-a-service and why it matters to the next-gen of dApps

Gluecon 2013 netflix api crash course

GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel

Advanced #4 GPU & Animations

Gömülü Sistemlerde Derin Öğrenme Uygulamaları

Getting The Most Out of VR | Sinjin Bain

FGS 2011: Making A Game With Molehill: Zombie Tycoon

Killzone Shadow Fall Demo Postmortem

High Performance Cloud Computing

The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...

Recently uploaded

Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi

data_management_and _data_science_cheat_sheet.pdfJiananWang21

Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...9953056974 Low Rate Call Girls In Saket, Delhi NCR

Call for Papers - International Journal of Intelligent Systems and Applicatio...Christo Ananth

Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Bookingroncy bisnoi

(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7Call Girls in Nagpur High Profile Call Girls

NFPA 5000 2024 standard .DerechoLaboralIndivi

(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7Call Girls in Nagpur High Profile Call Girls

Intze Overhead Water Tank Design by Working Stress - IS Method.pdfSuman Jyoti

The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...ranjana rawat

The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...ranjana rawat

VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698

CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordAsst.prof M.Gokilavani

Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Standamitlee9823

(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7Call Girls in Nagpur High Profile Call Girls

PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELLManishPatel169454

UNIT - IV - Air Compressors and its Performancesivaprakash250

Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Christo Ananth

Unleashing the Power of the SORA AI lastest leapRishantSharmaFr

VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...SUHANI PANDEY

Recently uploaded (20)

Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking

data_management_and _data_science_cheat_sheet.pdf

Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...

Call for Papers - International Journal of Intelligent Systems and Applicatio...

Call Girls Walvekar Nagar Call Me 7737669865 Budget Friendly No Advance Booking

(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7

NFPA 5000 2024 standard .

(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7

Intze Overhead Water Tank Design by Working Stress - IS Method.pdf

The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...

The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...

VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking

CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record

Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand

(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7

PVC VS. FIBERGLASS (FRP) GRAVITY SEWER - UNI BELL

UNIT - IV - Air Compressors and its Performance

Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...

Unleashing the Power of the SORA AI lastest leap

VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...

Scaling Hotstar.com for 10Mn concurrency

1. Scaling Hotstar.com for 10Mn concurrency CHALLENGES & LEARNINGS Gaurav Kamboj Cloud Architect at Hotstar

2. Let’s talk about Scale! 10Mn+ PEAK CONCURRENCY DURING VIVO IPL FINAL 5.7 Tbps PEAK BANDWIDTH CONSUMPTION 1Mn PEAK REQUESTS PER SECOND 10Bn+ CLICKSTREAM MESSAGES 100+ HOURS OF LIVE TRANSCODING EVERYDAY

4. Game Day FACE THE REAL GAME BEFORE THE ACTUAL GAME 36,000 CPUs 80 Gbps NETWORK OUT 72 TB RAM 8 REGIONS GEO DISTRIBUTED Project HULK ● Load Generation ● Performance & Tsunami Tests ● Chaos Engineering ● Traffic Pattern using ML

5. Race against time! + 500K GROWTH RATE PER MINUTE (CONCURRENCY) FULLY BAKED AMIs 4 mins APPLICATION BOOT-UP TIME 90 SECONDS REACTION TIME PUSH NOTIFICATIONS

6. Why we don’t use autoscaling INSUFFICIENT CAPACITY ERRORS GAME OF (AVAILABILITY) ZONES STEP SIZE AUTOSCALING GROUPS

7. Others challenges.. SINGLE INSTANCE TYPE PER AUTO SCALING GROUP API THROTTLING RETRIES & EXPONENTIAL BACKOFF

8. PREWARM INFRA BEFORE MATCH TIME PROACTIVE SCALE UP WITH BUFFER FOR SPIKES SECONDARY AUTO SCALING GROUP SPOT FLEET DIVERSIFIED INSTANCE TYPES Battle tested scaling strategy!

9. MACHINE LEARNING BASED AUTO SCALING Future.. IPL 2019 onwards INTELLIGENT SCALE UP DECISIONS RUN IPL & WORLD CUP 2019 ON AUTO PILOT MODE

10. tech.hotstar.com

Scaling Hotstar.com for 10Mn concurrency

Recommended

Recommended

More Related Content

Similar to Scaling Hotstar.com for 10Mn concurrency

Similar to Scaling Hotstar.com for 10Mn concurrency (20)

More from Hotstar

More from Hotstar (8)

Recently uploaded

Recently uploaded (20)

Scaling Hotstar.com for 10Mn concurrency