How to scale to 100k users using Windows Azure

•

0 likes•751 views

Style Jukebox is a cloud music streaming service that stores over 4.5 million songs for 125,000+ users. It faces challenges with scalability, availability, and latency due to its large user base and song library. It addresses these by using Azure services like SQL databases, storage, caching, and content delivery networks distributed across data centers for high performance as the system scales.

Software

Ionut Antiu
www.get-jukebox.com
@johnnyantiu

1. What are we talking about
2. What is Style Jukebox
3. What were the challenges
4. Wrap up

Style Jukebox is a High Fidelity cloud-music streaming service
that helps you keep all your music – be it bought, self-produced,
or imported from CDs or other media, always backed up and
synced across all your devices.

TRACTION
125,000+ registered users
52,000+ MAU
Peak of 13,000 users DAU
4,5+ million songs stored in the Cloud
50,000 – 100,000 songs listened daily

Low latency
Scalability
High Availability
OBJECTIVES

“LE SERVER”
Database SQL
Storage
API
LE CLIENT APP LE CLIENT APP LE CLIENT APP

“LE SERVER”
API
LE CLIENT APP LE CLIENT APP LE CLIENT APP
STORAGE
Windows Azure Storage Blobs
DATABASE
SQL Azure

Scale Up
Scale Out
Database, API, Content bandwidth, Website

Scale Up
One operation that cannot
be divided requires more compute power
(Audio/Video encoding, Your own DB, etc.)
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*
G5, 32 cores
Intel Xeon
448 GB RAM
6 TB
EUR 4865/month*

Scale Out
Used for API, Website, etc.
Ex: Each machine can have a limited number of connected users
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*
4x
Basic A1
1 Core AMD CPU
1,75 GB RAM
EUR 41/month*

SYNC SERVICE
API (GetSongURL, Login)
LE CLIENT APP LE CLIENT APP LE CLIENT APP
STORAGE
Windows Azure Storage Blobs
DATABASE
SQL Azure
BLOCK SERVICE
API (DownloadSong, UploadSong)

The Memcache Worker
predicts and prepares the
results
Memcache Hit Ratio 86-91%
Reduced time of response with
80% to an average of 250ms

SYNC SERVICE
API (GetSongURL, Login)
LOAD BALANCER
LE CLIENT APP LE CLIENT APP LE CLIENT APP
STORAGE
Windows Azure Storage Blobs
DATABASE
SQL Azure
BLOCK SERVICE
API (DownloadSong, UploadSong)
LOAD BALANCER
MEMCACHE
Redis
Memcache Worker
CDN
Windows Azure CDN
CDN Worker
STORAGE
Upload Buffer
Upload Processing
Download Processing

Load Balancer
Integrated in the Azure Cloud Services
Makes sure all instances have the same load
Auto-Scale creates new instances or removes automatically

SYNC SERVICE – WEST US
API (GetSongURL, Login)
DATABASE - AMSTERDAM
SQL Azure

SYNC SERVICE – WEST US
API (GetSongURL, Login)
DATABASE - AMSTERDAM
SQL Azure
~ 9,000 km * 3 calls = ~ 30,000 km
30,000 km : 300,000km/s = 100 ms

LE CLIENT APP LE CLIENT APP LE CLIENT APP
TRAFFIC MANAGER
SYNC – WEST US
API x VMs
LOAD BALANCER
BLOCK – WEST US
API x VMs
LOAD BALANCER
SYNC – WEST EU
API x VMs
LOAD BALANCER
BLOCK – WEST EU
API x VMs
LOAD BALANCER
CDN
Windows Azure CDN
STORAGE
Windows Azure Storage Blobs
MAIN DATABASE – WEST EU
SQL Azure
MEMCACHE – WEST EU
Redis
SLAVE DATABASE – WEST US
SQL Azure
MEMCACHE 2 – WEST US
Redis
STORAGE
Upload Buffer

Traffic Manager
stylejukebox.trafficmanager.net
4 VM machines
in West Europe
4 VM machines
in West US
Closest location to the user
Load balancing
Fail-over
Works for Websites, Cloud Services

Test 1
1,000 concurrent users
1 core machine

Test 2
1,000 concurrent users
4 core machine
$ 0,4 more per hour

Autoscale applies to Cloud Services and Websites
1 core machine can handle 200
connections simultaneous
4 core machine can handle 1,000
connections simultaneous

Always prepare for things to go wrong
Ex: Routers on the Internet

What's hot

Secrets are any sensitive piece of information (like a password, API token, TLS private key) that must be kept safe. This presentation is a practical guide covering what we've done at Cloud Posse to lock down secrets in production. It includes our answer to avoid the same pitfalls that Shape Shift encountered when they were hacked. The techniques presented are compatible with automated cloud environments and even legacy systems.

Managing Secrets in Production

Erik Osterman

Amazon EC2 Container Service: Deep Dive

Amazon Web Services

Deep dive into AWS fargate

Amazon Web Services

(WEB203) Building a Website That Costs Pennies to Operate | AWS re:Invent 2014

Amazon Web Services

Mongoose OS is a modern open-source real-time operating system for variety of MCU architectures. It has the same look and feel on a broad spectrum of supported microcontrollers. It is also designed from the ground up for connected devices. In this session, we will teach you how to connect to AWS IoT from a device in under 3 minutes and then walk through how to use crypto-element for securing TLS communication and deploy fully functional thermostat with CloudFormation template, utilizing AWS IoT, Amazon DynamoDB, Amazon Cognito, and Amazon S3.

Rapid Prototyping with AWS IoT and Mongoose OS on ESP32 Platform

Amazon Web Services

The "Holy Grail" of Dev/Ops

Erik Osterman

Introduction to Amazon Elastic Transcoder

Amazon Web Services

Deploy and Scale your PHP App with AWS ElasticBeanstalk and Docker- PHPTour L...

Corley S.r.l.

Moving your website to AWS can provide you numerous advantages around the ability to grow, increasing physical security, and lowering the costs of running your website. In this session we'll focus on how you can move your existing website to AWS so you can take advantage of these benefits. You'll be hearing the about how BuzzFeed migrated to AWS when Hurricane Sandy impacted their operations. Director of Buzzfeed's Tech Ops, Eugene Ventimiglia, will walk through the timeline of the migration and describe how BuzzFeed was able to continue serving millions of users during hurricane Sandy. We'll discuss how to set up your site in AWS, strategies for managing the transition through deployment tools, load balancing trial deployments, and DNS cutover, as well as configuration settings necessary to ensure that your site will run well.

(WEB305) Migrating Your Website to AWS | AWS re:Invent 2014

Amazon Web Services

AWS elastic beanstalk

Jakub Krajcovic

Keeping consistent environments across your development, test, and production systems can be a complex task. Docker containers offer a way to develop and test your application in the same environment in which it runs in production. You can use tools such as Docker Compose for local testing of applications; Jenkins and AWS CodePipeline for building and workflow orchestration; and Amazon EC2 Container Service to manage and scale containers. In this session, you will learn how to build containers into your continuous deployment workflow and orchestrate container deployments using Amazon ECS. Learning Objectives: Learn to use the Amazon ECS CLI to test applications locally Orchestrate continuous delivery workflows using AWS CodePipeline Schedule containers on production clusters using Amazon ECS Who Should Attend: Developers, DevOps Engineers

AWS December 2015 Webinar Series - Continuous Delivery to Amazon EC2 Containe...

Amazon Web Services

Automating Azure VMs with PowerShell

Alexander Feschenko

Introduction to Elastic Beanstalk

Wolfgang Schell

Docker

Jo Ee Liew

Migrating from a hosted environment to AWS is a good opportunity to streamline deployment and site operations. This session shows how FillZ used AWS OpsWorks with other tools to automate site operations and deliver a highly available site that is used by large numbers of customers. Through code and examples, this session shows you how to automate deployments across an entire fleet, configure a patching strategy, use common tools to create useful alarms and monitor system performance, and employ security best-practices in AWS.

(WEB307) Scalable Site Management Using AWS OpsWorks | AWS re:Invent 2014

Amazon Web Services

Word press and containers

wcto2017

Docker on AWS with Amazon ECR & ECS - Pop-up Loft Tel Aviv

Amazon Web Services

MDP Group SAP PI & PO Azure Adapter

MDP Group

3등 :: Game Indie :: Gaming on AWS Hackathon 2016

Amazon Web Services Korea

Serverless WordPress using AWS Services - WordCamp Atlanta 2017

Carel Bekker

What's hot (20)

Managing Secrets in Production

Amazon EC2 Container Service: Deep Dive

Deep dive into AWS fargate

(WEB203) Building a Website That Costs Pennies to Operate | AWS re:Invent 2014

Rapid Prototyping with AWS IoT and Mongoose OS on ESP32 Platform

The "Holy Grail" of Dev/Ops

Introduction to Amazon Elastic Transcoder

Deploy and Scale your PHP App with AWS ElasticBeanstalk and Docker- PHPTour L...

(WEB305) Migrating Your Website to AWS | AWS re:Invent 2014

AWS elastic beanstalk

AWS December 2015 Webinar Series - Continuous Delivery to Amazon EC2 Containe...

Automating Azure VMs with PowerShell

Introduction to Elastic Beanstalk

Docker

(WEB307) Scalable Site Management Using AWS OpsWorks | AWS re:Invent 2014

Word press and containers

Docker on AWS with Amazon ECR & ECS - Pop-up Loft Tel Aviv

MDP Group SAP PI & PO Azure Adapter

3등 :: Game Indie :: Gaming on AWS Hackathon 2016

Serverless WordPress using AWS Services - WordCamp Atlanta 2017

Similar to How to scale to 100k users using Windows Azure

Application Deployment on AWS - Startup Talks June 2015

Amazon Web Services

Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power b...

Ionut Antiu

Overview of AWS Building Blocks

Satish Raghavan

AWS Summit Milan - Applicazioni Enterprise con AWS

Amazon Web Services

Current state of affairs cloud computing

Chirag Jog

AWS Summit Benelux 2013 - Enterprise Applications on AWS

Amazon Web Services

Immutable Infrastructure: the new App Deployment App deployment and server setup are complex, error-prone and time-consuming. They require OS installers, package managers, configuration recipes, install and deployment scripts, server tuning, hardening and more. But... Is this really necessary? Are we trapped in a mindset of doing things this way just because that's how they've always done? What if we could start over and radically simplify all this? What if, within seconds, and with a single command, we could wrap our application into the bare minimal machine required to run it? What if this machine could then be transported and run unchanged on our laptop and in the cloud? How do the various platforms and tools like AWS, Docker, Heroku and Boxfuse fit into this picture? What are their strengths and weaknesses? When should you use them? This talk is for developers and architects wishing to radically improve and simplify how they deploy their applications. It takes Continuous Delivery to a level far beyond what you've seen today. Welcome to Immutable Infrastructure generation. This is the new black.

Immutable Infrastructure: the new App Deployment

Axel Fontaine

DOs and DONTs on the way to 10M users

Yoav Avrahami

During the “Architecting for the Cloud” breakfast seminar where we discussed the requirements of modern cloud-based applications and how to overcome the confinement of traditional on-premises infrastructure. We heard from data management practitioners and cloud strategists from Amazon Web Services and NuoDB about how organizations are meeting the challenges associated with building new or migrating existing applications to the cloud. Finally, we discussed how the right cloud-based architecture can: - Handle rapid user growth by adding new servers on demand - Provide high performance even in the face of heavy application usage - Offer around-the-clock resiliency and uptime - Provide easy and fast access across multiple geographies - Deliver cloud-enabled apps in public, private, or hybrid cloud environments

Dallas Breakfast Seminar

NuoDB

Azure And Silverlight

choonngee

With AWS companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100% API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this session we'll talk about some key concepts and design patterns for Continuous Deployment and Continuous Integration, two elements of lean development of applications and infrastructures.

AWS Summit 2013 | Auckland - Continuous Deployment Practices, with Production...

Amazon Web Services

AWS 101, London - September 2014

Ian Massingham

Oracle on AWS partner webinar series

Tom Laszewski

AWS 101 December 2014

Ian Massingham

AWS offers a variety of methods to migrate your data into the cloud. You may want to begin performing regular backups, start collecting device streams, migrate a large datastore once, or just gain dedicated connectivity and then figure out what to do next. How do you know what option works best with your architecture(s)? This webinar will give you an overview of the six data migration tools we offer, including the strengths and weaknesses of each, as well as their complementary opportunities. Learning Objectives: Gain an overview of cloud data migration Learn the basics of the six transfer services (Direct Connect, Gateway, Snowball, Disk transfer, Firehose, 3rd party partners) Understand the strengths and weaknesses of each service, and opportunities to layer them together Who Should Attend: Developers, IT Professionals, Storage and Backup Administrators, who are familiar with the concept of cloud storage but concerned about how to move their data in effectively

AWS January 2016 Webinar Series - Cloud Data Migration: 6 Strategies for Gett...

Amazon Web Services

Oracle Solutions on AWS : May 2014

Tom Laszewski

view the deck as powerpoint

webhostingguy

view the deck as powerpoint

webhostingguy

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1WlpXHF. Axel Fontaine looks at what Immutable Infrastructure is and how it affects scaling, logging, sessions, configuration, service discovery and more. He also looks at how containers and machine images compare and why some things people took for granted may not be necessary anymore. Filmed at qconlondon.com. Axel Fontaine is the founder and CEO of Boxfuse. Axel is also the creator and project lead of Flyway, the open source tool that makes database migration easy. He is a Continuous Delivery and Immutable Infrastructure expert, a Java Champion, a JavaOne Rockstar and a regular speaker at various large international conferences.

Immutable Infrastructure: Rise of the Machine Images

C4Media

Cloud Computing Primer: Using cloud computing tools in your museum

Robert J. Stein

Similar to How to scale to 100k users using Windows Azure (20)

Application Deployment on AWS - Startup Talks June 2015

Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power b...

Overview of AWS Building Blocks

AWS Summit Milan - Applicazioni Enterprise con AWS

Current state of affairs cloud computing

AWS Summit Benelux 2013 - Enterprise Applications on AWS

Immutable Infrastructure: the new App Deployment

DOs and DONTs on the way to 10M users

Dallas Breakfast Seminar

Azure And Silverlight

AWS Summit 2013 | Auckland - Continuous Deployment Practices, with Production...

AWS 101, London - September 2014

Oracle on AWS partner webinar series

AWS 101 December 2014

AWS January 2016 Webinar Series - Cloud Data Migration: 6 Strategies for Gett...

Oracle Solutions on AWS : May 2014

view the deck as powerpoint

Immutable Infrastructure: Rise of the Machine Images

Cloud Computing Primer: Using cloud computing tools in your museum

Recently uploaded

Into the Box 2024 - Keynote Day 2 Slides.pdf

Ortus Solutions, Corp

OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam

takuyayamamoto1800

Breaking the Code : A Guide to WhatsApp Business API.pdf

Meon Technology

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Eric Wang (Software Engineer, @Uber) Uber has numerous deep learning models, most of which are highly complex with many layers and a vast number of features. Understanding how these models work is challenging and demands significant resources to experiment with various training algorithms and feature sets. With ML explainability, the ML team aims to bring transparency to these models, helping to clarify their predictions and behavior. This transparency also assists the operations and legal teams in explaining the reasons behind specific prediction outcomes. In this talk, Eric Wang will discuss the methods Uber used for explaining deep learning models and how we integrated these methods into the Uber AI Michelangelo ecosystem to support offline explaining.

AI/ML Infra Meetup | ML explainability in Michelangelo

Alluxio, Inc.

Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.

How Recreation Management Software Can Streamline Your Operations.pptx

wottaspaceseo

The U.S. Geological Survey (USGS) has made substantial investments in meeting evolving scientific, technical, and policy driven demands on storing, managing, and delivering data. As these demands continue to grow in complexity and scale, the USGS must continue to explore innovative solutions to improve its management, curation, sharing, delivering, and preservation approaches for large-scale research data. Supporting these needs, the USGS has partnered with the University of Chicago-Globus to research and develop advanced repository components and workflows leveraging its current investment in Globus. The primary outcome of this partnership includes the development of a prototype enterprise repository, driven by USGS Data Release requirements, through exploration and implementation of the entire suite of the Globus platform offerings, including Globus Flow, Globus Auth, Globus Transfer, and Globus Search. This presentation will provide insights into this research partnership, introduce the unique requirements and challenges being addressed and provide relevant project progress.

Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...

Globus

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

WSO2

A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf

kalichargn70th171

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...

informapgpstrackings

Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

Tier1 app

Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.

How to Position Your Globus Data Portal for Success Ten Good Practices

Globus

Globus Connect Server Deep Dive - GlobusWorld 2024

Globus

Globus Compute Introduction - GlobusWorld 2024

Globus

Vitthal Shirke Microservices Resume Montevideo

Vitthal Shirke

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Junchen Jiang (Assistant Professor of Computer Science, @University of Chicago) Prefill in LLM inference is known to be resource-intensive, especially for long LLM inputs. While better scheduling can mitigate prefill’s impact, it would be fundamentally better to avoid (most of) prefill. This talk introduces our preliminary effort towards drastically minimizing prefill delay for LLM inputs that naturally reuse text chunks, such as in retrieval-augmented generation. While keeping the KV cache of all text chunks in memory is difficult, we show that it is possible to store them on cheaper yet slower storage. By improving the loading process of the reused KV caches, we can still significantly speed up prefill delay while maintaining the same generation quality.

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

Alluxio, Inc.

Large Language Models and the End of Programming

Matt Welsh

How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?

XfilesPro

Petr Matuska, Sales & Sales Engineering Lead, GraphAware Western Australia Police Force’s adoption of Neo4j and the GraphAware Hume graph analytics platform marks a significant advancement in data-driven policing. Facing the challenges of growing volumes of valuable data scattered in disconnected silos, the organisation successfully implemented Neo4j database and Hume, consolidating data from various sources into a dynamic knowledge graph. The result was a connected view of intelligence, making it easier for analysts to solve crime faster. The partnership between Neo4j and GraphAware in this project demonstrates the transformative impact of graph technology on law enforcement’s ability to leverage growing volumes of valuable data to prevent crime and protect communities.

GraphAware - Transforming policing with graph-based intelligence analysis

Neo4j

As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.

Globus Compute wth IRI Workflows - GlobusWorld 2024

Globus

CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.

Cyaniclab : Software Development Agency Portfolio.pdf

Cyanic lab

Recently uploaded (20)

Into the Box 2024 - Keynote Day 2 Slides.pdf

OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam

Breaking the Code : A Guide to WhatsApp Business API.pdf

AI/ML Infra Meetup | ML explainability in Michelangelo

How Recreation Management Software Can Streamline Your Operations.pptx

Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

How to Position Your Globus Data Portal for Success Ten Good Practices

Globus Connect Server Deep Dive - GlobusWorld 2024

Globus Compute Introduction - GlobusWorld 2024

Vitthal Shirke Microservices Resume Montevideo

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

Large Language Models and the End of Programming

How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?

GraphAware - Transforming policing with graph-based intelligence analysis

Globus Compute wth IRI Workflows - GlobusWorld 2024

Cyaniclab : Software Development Agency Portfolio.pdf

How to scale to 100k users using Windows Azure

1. Ionut Antiu www.get-jukebox.com @johnnyantiu

2. 1. What are we talking about 2. What is Style Jukebox 3. What were the challenges 4. Wrap up

3. Style Jukebox is a High Fidelity cloud-music streaming service that helps you keep all your music – be it bought, self-produced, or imported from CDs or other media, always backed up and synced across all your devices.

4. TRACTION 125,000+ registered users 52,000+ MAU Peak of 13,000 users DAU 4,5+ million songs stored in the Cloud 50,000 – 100,000 songs listened daily

5. Low latency Scalability High Availability OBJECTIVES

6. What is the basic Cloud architecture?

7. “LE SERVER” Database SQL Storage API LE CLIENT APP LE CLIENT APP LE CLIENT APP

8. “LE SERVER” API LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure

9. Scale Up Scale Out Database, API, Content bandwidth, Website

10. Scale Up One operation that cannot be divided requires more compute power (Audio/Video encoding, Your own DB, etc.) Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month* G5, 32 cores Intel Xeon 448 GB RAM 6 TB EUR 4865/month*

11. Scale Out Used for API, Website, etc. Ex: Each machine can have a limited number of connected users Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month* 4x Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month*

12. SYNC SERVICE API (GetSongURL, Login) LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong)

13. SYNC SERVICE API (GetSongURL, Login) LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong) MEMCACHE Redis Memcache Worker

14. The Memcache Worker predicts and prepares the results Memcache Hit Ratio 86-91% Reduced time of response with 80% to an average of 250ms

15. SYNC SERVICE API (GetSongURL, Login) LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong) MEMCACHE Redis Memcache Worker CDN Windows Azure CDN CDN Worker

16. SYNC SERVICE API (GetSongURL, Login) LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong) MEMCACHE Redis Memcache Worker CDN Windows Azure CDN CDN Worker STORAGE Upload Buffer Upload Processing

17. SYNC SERVICE API (GetSongURL, Login) LOAD BALANCER LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong) LOAD BALANCER MEMCACHE Redis Memcache Worker CDN Windows Azure CDN CDN Worker STORAGE Upload Buffer Upload Processing Download Processing

18. Load Balancer Integrated in the Azure Cloud Services Makes sure all instances have the same load Auto-Scale creates new instances or removes automatically

19.

20. SYNC SERVICE API (GetSongURL, Login) LOAD BALANCER LE CLIENT APP LE CLIENT APP LE CLIENT APP STORAGE Windows Azure Storage Blobs DATABASE SQL Azure BLOCK SERVICE API (DownloadSong, UploadSong) LOAD BALANCER MEMCACHE Redis Memcache Worker CDN Windows Azure CDN CDN Worker STORAGE Upload Buffer Upload Processing Download Processing TRAFFIC MANAGER

21. SYNC SERVICE – WEST US API (GetSongURL, Login) DATABASE - AMSTERDAM SQL Azure

22. SYNC SERVICE – WEST US API (GetSongURL, Login) DATABASE - AMSTERDAM SQL Azure ~ 9,000 km * 3 calls = ~ 30,000 km 30,000 km : 300,000km/s = 100 ms

23. LE CLIENT APP LE CLIENT APP LE CLIENT APP TRAFFIC MANAGER SYNC – WEST US API x VMs LOAD BALANCER BLOCK – WEST US API x VMs LOAD BALANCER SYNC – WEST EU API x VMs LOAD BALANCER BLOCK – WEST EU API x VMs LOAD BALANCER CDN Windows Azure CDN STORAGE Windows Azure Storage Blobs MAIN DATABASE – WEST EU SQL Azure MEMCACHE – WEST EU Redis SLAVE DATABASE – WEST US SQL Azure MEMCACHE 2 – WEST US Redis STORAGE Upload Buffer

24. Traffic Manager stylejukebox.trafficmanager.net 4 VM machines in West Europe 4 VM machines in West US Closest location to the user Load balancing Fail-over Works for Websites, Cloud Services

25. Azure Datacenters

26. How to test?

27.

28.

29.

30. Test 1 1,000 concurrent users 1 core machine

31.

32.

33.

34. Test 2 1,000 concurrent users 4 core machine $ 0,4 more per hour

35.

36.

37. Autoscale applies to Cloud Services and Websites 1 core machine can handle 200 connections simultaneous 4 core machine can handle 1,000 connections simultaneous

38. Monitoring

39. NewRelic

40.

41.

42.

43. Always prepare for things to go wrong Ex: Routers on the Internet

44. Low latency Scalability High Availability OBJECTIVES

45. Ionut Antiu www.get-jukebox.com @johnnyantiu