Spotify services - Leetspeak 2014

•

1 like•1,479 views

Niklas Gustavsson

Slide deck from my presentation at Leetspeak 2014 on how Spotify builds backend services.

Engineering

Microservices1*in*anger
1"h$p://mar+nfowler.com/ar+cles/microservices.html

UNIX%philosophy
"Rule&of&Modularity:&Developers&should&build&a&program&out&of&
simple&parts&connected&by&well&defined&interfaces,&so&problems&are&
local,&and&parts&of&the&program&can&be&replaced&in&future&versions&to&
support&new&features.&This&rule&aims&to&save&@me&on&debugging&
complex&code&that&is&complex,&long,&and&unreadable"
—"Eric"S."Raymond,"The"Art"of"Unix"Programming

Embrace(Conway's(law2
2"h$ps://labs.spo.fy.com/2014/03/27/spo.fy8engineering8culture8part81/

$ dig _spotify-search._hm.lon3.spotify.net SRV +short
5000 5000 8181 lon3-search-a1.lon3.spotify.net.
5000 5000 8181 lon3-search-a2.lon3.spotify.net.
...

Geographical,distribu2on3
3"h$ps://www.youtube.com/watch?v=JEpsKnWZrJ8

Viewers also liked

Software Architecture Patterns

Assaf Gannon

Big Data At Spotify

Adam Kawa

A Spotify Presentation - Case studies

Emily Wilkinson

Algorithmic Music Recommendations at Spotify

Chris Johnson

Spotify uses a range of Machine Learning models to power its music recommendation features including the Discover page, Radio, and Related Artists. Due to the iterative nature of these models they are a natural fit to the Spark computation paradigm and suffer from the IO overhead incurred by Hadoop. In this talk, I review the ALS algorithm for Matrix Factorization with implicit feedback data and how we’ve scaled it up to handle 100s of Billions of data points using Scala, Breeze, and Spark.

Music Recommendations at Scale with Spark

Chris Johnson

Are you still building data pipelines with Java and Python? Are you curious about the current buzz in the Big Data community surrounding Scala as a data processing environment? In this talk I'll discuss how Spotify migrated its music recommendations pipeline from Python to Scala. I'll dive into the language specific features that make Scala the ideal candidate for big data processing as well as highlight the rich set of tools and APIs that we take advantage of to process music recommendations for our 50 Million active users including Scalding, Breeze, Kafka, Spark, Parquet, Driven and Zeppelin.

Scala Data Pipelines for Music Recommendations

Chris Johnson

Interactive recommender systems enable the user to steer the received recommendations in the desired direction through explicit interaction with the system. In the larger ecosystem of recommender systems used on a website, it is positioned between a lean-back recommendation experience and an active search for a specific piece of content. Besides this aspect, we will discuss several parts that are especially important for interactive recommender systems, including the following: design of the user interface and its tight integration with the algorithm in the back-end; computational efficiency of the recommender algorithm; as well as choosing the right balance between exploiting the feedback from the user as to provide relevant recommendations, and enabling the user to explore the catalog and steer the recommendations in the desired direction. In particular, we will explore the field of interactive video and music recommendations and their application at Netflix and Spotify. We outline some of the user-experiences built, and discuss the approaches followed to tackle the various aspects of interactive recommendations. We present our insights from user studies and A/B tests. The tutorial targets researchers and practitioners in the field of recommender systems, and will give the participants a unique opportunity to learn about the various aspects of interactive recommender systems in the video and music domain. The tutorial assumes familiarity with the common methods of recommender systems.

Interactive Recommender Systems with Netflix and Spotify

Chris Johnson

Discover Weekly is a personalized mixtape of 30 highly personalized songs that's curated and delivered to Spotify's 75M active users every Monday. It's received high acclaim in the press and reached 1B streams within its first 10 weeks. In this slide deck we dive into the narrative of how Discover Weekly came to be, highlighting technical challenges, data driven development, and the Machine Learning models used to power our recommendations engine.

From Idea to Execution: Spotify's Discover Weekly

Chris Johnson

Viewers also liked (8)

Software Architecture Patterns

Big Data At Spotify

A Spotify Presentation - Case studies

Algorithmic Music Recommendations at Spotify

Music Recommendations at Scale with Spark

Scala Data Pipelines for Music Recommendations

Interactive Recommender Systems with Netflix and Spotify

From Idea to Execution: Spotify's Discover Weekly

Similar to Spotify services - Leetspeak 2014

Our Brave Modular Future

Orchestrate

Let's talk about... Microservices

Alessandro Giorgetti

IoT Expo: 7 Steps to Business Success on the Internet of Things

LogMeIn

FEVR - Micro Frontend

Miki Lombardi

KITE Network Instrumentation: Advanced WebRTC Testing

Alexandre Gouaillard

Machine vision and device integration with the Ruby programming language (2008)

Jan Wedekind

Holistic Aggregate Resource Environment

Eric Van Hensbergen

Mohamed_Omar_Cv

Mohamed Elhamshary

The Mobile Question @ Big Design 2010

Jeremy Johnson

Marko Salonp

Slides for my architectural session at the event: Docker From Zero To Hero. We talked about what kind of expertises are need in order to build a true Microservices Solution; you'll need to understand some of the fundamentals on which Microservices is built upon: SOA, EDA and DDD just to name a few, then you can move to the container world. Original event link: https://www.eventbrite.it/e/biglietti-docker-from-zero-to-hero-83372825365#

Microservices Architecture

Alessandro Giorgetti

Microservice Pattern Launguage

Inho Kang

Finagle is an open-source, high-volume RPC client library, handling millions of QPS at companies like Twitter, Pinterest and Soundcloud. In this talk, we demonstrate how Finagle can be applied to Kubernetes applications via linkerd, an open-source, standalone Finagle proxy. By deploying linkerd as a sidecar container or with DaemonSets, we show how polyglot multi-service applications running in Kubernetes can be “wrapped” in Finagle’s operational model, adding connection pooling, load-balancing, failure detection, and failover mechanisms to existing applications with minimal code change. We demonstrate how linkerd communicates with the Kubernetes API and how the resulting systems perform under load and adverse conditions. Sched Link: http://sched.co/6BhW

KubeCon EU 2016: Kubernetes meets Finagle for Resilient Microservices

KubeAcademy

Integration & Microservices

Amr Salah

Career Domain 2022-23.pptx

Janani S

AngularJS today is one of the most powerful, user-friendly and popular JS frameworks to work on web applications. Surprisingly, one of the main weaknesses of this framework is poorly structured documentation and the lack of ready-made solutions. In this report, we will try to work out the best approach to the organization of large and very large applications. We will also speak about the tools that will be useful at every stage of the application development and tools and practicesthat will help you to work in the continuous delivery mode.

Building scalable applications with angular js

Andrew Alpert

Mohamed Said

Mohamed_Said2006

AkankshaSharma

Akanksha Sharma

The latest issue of Ericsson Technology Review includes articles that shed light on important topics including the evolution of LTE to fit the 5G future; an overview of the latest developments in microwave backhaul; and how DevOps can be used to satisfy demands for faster turnaround in feature development. It also contains our annual technology trends article, in which I present what I believe are the five trends to watch in our industry in the years ahead, namely: an adaptable technology base, the dawn of true machine intelligence, end-to-end security and identity for IoT, an extended-distributed IoT platform, and overlaying reality with knowledge. I hope you find the contents of this issue of the magazine as thought-provoking as I do. All of the articles included here are also available individually on our website. Please feel free to share them via e-mail or social media.

Ericsson Technology Review - issue 2, 2017

Ericsson

The Art of Tizen UI Theme Technology in Various Profiles (OSCON 2014)

Daniel Juyung Seo

Similar to Spotify services - Leetspeak 2014 (20)

Our Brave Modular Future

Let's talk about... Microservices

IoT Expo: 7 Steps to Business Success on the Internet of Things

FEVR - Micro Frontend

KITE Network Instrumentation: Advanced WebRTC Testing

Machine vision and device integration with the Ruby programming language (2008)

Holistic Aggregate Resource Environment

Mohamed_Omar_Cv

The Mobile Question @ Big Design 2010

Microservices Architecture

Microservice Pattern Launguage

KubeCon EU 2016: Kubernetes meets Finagle for Resilient Microservices

Integration & Microservices

Career Domain 2022-23.pptx

Building scalable applications with angular js

Mohamed Said

AkankshaSharma

Ericsson Technology Review - issue 2, 2017

The Art of Tizen UI Theme Technology in Various Profiles (OSCON 2014)

Recently uploaded

Unleashing the Power of the SORA AI lastest leap

RishantSharmaFr

LECTURE 01 Introduction to Computers Computers in Society Components of a Computer Types of Computers Definition: “A computer is an electronic device that manipulates information, or data. It has the ability to store, retrieve, and process data” The word "computer" is derived from the Latin word "computare," which means "to calculate" Computers are used for Businesses Communication Entertainment Education Medical Field

Computer Lecture 01.pptxIntroduction to Computers

MairaAshraf6

HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR

KOUSTAV SARKAR

data_management_and _data_science_cheat_sheet.pdf

JiananWang21

Saudi Arabia [ Abortion pills) Jeddah/riaydh/dammam/+918761049707☎️] cytotec tablets uses abortion pills 💊💊 How effective is the abortion pill? 💊💊 +918761049707) "Abortion pills in Jeddah" how to get cytotec tablets in Riyadh " Abortion pills in dammam*💊💊 The abortion pill is very effective. If you’re taking mifepristone and misoprostol, it depends on how far along the pregnancy is, and how many doses of medicine you take:💊💊 +918761049707) how to buy cytotec pills At 8 weeks pregnant or less, it works about 94-98% of the time. +918761049707[ 💊💊💊 At 8-9 weeks pregnant, it works about 94-96% of the time. +918761049707) At 9-10 weeks pregnant, it works about 91-93% of the time. +918761049707)💊💊 If you take an extra dose of misoprostol, it works about 99% of the time. At 10-11 weeks pregnant, it works about 87% of the time. +918761049707) If you take an extra dose of misoprostol, it works about 98% of the time. In general, taking both mifepristone and+918761049707 misoprostol works a bit better than taking misoprostol only. +918761049707 Taking misoprostol alone works to end the+918761049707 pregnancy about 85-95% of the time — depending on how far along the+918761049707 pregnancy is and how you take the medicine. +918761049707 The abortion pill usually works, but if it doesn’t, you can take more medicine or have an in-clinic abortion. +918761049707 When can I take the abortion pill?+918761049707 In general, you can have a medication abortion up to 77 days (11 weeks)+918761049707 after the first day of your last period. If it’s been 78 days or more since the first day of your last+918761049707period, you can have an in-clinic abortion to end your pregnancy.+918761049707 Why do people choose the abortion pill? Which kind of abortion you choose all depends on your personal+918761049707preference and situation. With+918761049707medication+918761049707 abortion, some people like that you don’t need to have a procedure in a doctor’s office. You can have your medication abortion on your own+918761049707schedule, at home or in another comfortable place that you choose.+918761049707 You get to decide who you want to be with during your abortion, or you can go it alone. Because+918761049707medication abortion is similar to a miscarriage, many people feel like it’s more “natural” and less invasive. And some+918761049707 people may not have an in-clinic abortion provider close by, so abortion pills are more available to+918761049707 them. +918761049707 Your doctor, nurse, or health center staff can help you decide which kind of abortion is best for you. More questions from patients: Saudi Arabia+918761049707 CYTOTEC Misoprostol Tablets. Misoprostol is a medication that can prevent stomach ulcers if you also take NSAID medications. It reduces the amount of acid in your stomach, which protects your stomach lining. The brand name of this medication is Cytotec®️.+918761049707) Unwanted Kit is a combination of two medicines, which is used for

Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait

jaanualu31

Thermal Engineering-R & A / C - unit - V

DineshKumar4165

+97470301568 Qatar THC Oil and weed in Qatar? Where can I get THC vape in Doha Qatar?WhatsApp +97470301568 Buy Weed, Cocaine, Heroin and Shrooms in France,Germany, Poland Serbia,Romania, Ukraine WhatsApp +97470301568 Buy Weed, Cocaine, Heroin and Shrooms in Dubai UAE Malaysia Oman Kuwait Bahrain Saudi Arabia Qatar Where can I get weed in Qatar? Where can I get THC vape in Doha Qatar?WhatsApp +97470301568 Buy Weed, Cocaine, Heroin and Shrooms in France,Germany, Poland Serbia,Romania, UkraineWhatsApp +97470301568 Buy Weed, Cocaine, Heroin and Shrooms in Dubai UAE Malaysia Oman Kuwait Bahrain Saudi Arabia Qatar WhatsApp+97470301568 WhatsApp +97470301568 Buy Weed, Cocaine, Heroin and Shrooms in Qatar Dubai UAE Malaysia Oman Kuwait Bahrain Saudi Arabia #Singapore #Jordan #Ireland, #Belgium, #United Kingdom, #Iceland, #*Portugal, Spain, China, Japan, Turkey, Canada United States, Morocco, France,Germany, Poland Serbia,Romania, Ukraine, and all countries United Arab Emirates . Our team has succesfully delivered in 26 different countries . All marijuana and Cocaine is double vacuum packed before shipping, making it completely odorless to ensure that it arrives safely to your door. Our distribution crew is expert at making packages that blend in with the rest of the mail. We have also put into place many other security measures to ensure the security of our customers. buy weed Dubai +97470301568buy Weed Qatar #Buy Weed Kuwait #Buy Weed Bahrain #Buy #Weed #Oman #Buy Weed UAE #Buy Weed Abu Dhabi @Buy Weed Doha Qatar #@Buy Weed Ajman #@Buy Weed Online #@Buy Weed UK #@Buy Weed Iceland #*@Buy Weed All Countries Below are the various strains of kush available ; buy hash and Weed in dubai,abu dhabi,sharjah where to buy weed in doha,where can i find weed in jeddah,Can I get weed delivered to Riyadh?,Buy weed Online Jeddah Saudi Arabia,Buy Weed and THC Cannabis Oil online ,QATAR , DOHA buy kush in DOHA , buy kush in DOHAWeed in QATAR # DOHA Buy Weed and THC Cannabis Oil online who delivers at your own location in Qatar Doha ,Kuwait ,Dubai including cannabis / weed,Where can I find weed in Dubai as a tourist?,Is marijuana allowed in Dubai ? How much is medical marijuana in Dubai ?Is weed legal in Dubai ?How to get marijuana in Saudi Arabia Do people in Saudi Arabia smoke weed ? Is Hash legal in Saudi Arabia ? Where is marijuana the most illegal?Can you get weed in Baku? Dubai, United Arab Emirates Canabis smokers - Dubai, Buy Marijuana Products Online in UAE Desertcart ships the Marijuana products in Dubai ,Abu Dhabi, Sharjah, Al Ain, Ajman and more cities in UAE. Get unlimited free shipping in 164+ countries Buy Weed Products Online in Saudi Arabia Order thc Weed in Saudi Arabia Order thc Weed in Saudi Arabia Order thc Weed in Saudi Arabia Order thc Weed in Saudi Arabia Buy Marijuana Saudi Arabia weed in jeddahis cbd legal in saudi arabia cali tins smoke in saudi arabia drug use saudi arabia Buy weed marijuana. White Widow OG #Kush Sensi Star x ak 47 Afghan

+97470301568>> buy weed in qatar,buy thc oil qatar,buy weed and vape oil in d...

Health

“HOSTEL MANAGEMENT SYSTEM” is a software developed for managing various activities in the hostel. For the past few years the number of educational institutions are increasing rapidly. Thereby the number of hostels are also increasing for the accommodation of the students studying in this institution. And hence there is a lot of strain on the person who are running the hostel and software’s are not usually used in this context. This particular project deals with the problems on managing a hostel and avoids the problems which occur when carried manually.

Hostel management system project report..pdf

Kamal Acharya

scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...

HenryBriggs2

DeepFakes presentation : brief idea of DeepFakes

MayuraD1

HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx

SCMS School of Architecture

From customer value engagements to hands-on production support, our Services span across every stage of our customers digital transformation journey, to help ensure that every customer is successful in their adoption of our solutions. • Implementation, Upgrade, Migration, and Maintenance Services • On-Premises and On-Cloud • COTS Training Services; On-Site and Virtual • Software Support Services; Legacy and 3DEXPERIENCE • Value Engagement & Blueprinting • Specialized Consulting and Support Services • Customized Training Services • Automation and Configuration Services • Technical Resource Augmentation Services • Project Management • Know-how Training (mentoring) and Resource Augmentation

Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...

Arindam Chakraborty, Ph.D., P.E. (CA, TX)

The purpose of Integrated Test Rig is to assess performance of Fuel Cooled Oil Cooler (FCOC), HP Pump & Oil Pump prior to fitment on Aero Engine. The design of rig is such that it can cater to individual testing of individual LRU or integrated testing of all the LRU’s installed together (in combination). The pumps under test shall be mounted directly on the high-speed electric motor flange through adapter quill shaft assembly. Variable speed drives shall be provided for all the pumps under testing. The rig shall cater for real time monitoring and recording of performance parameters. KEY FEATURES Key features of this Rig are as follows: - 1. It has separate power packs for both the fluids i.e. ATF Power pack for ATF Fluid, OX Power Pack for OX-27 Oil. 2. This Rig is designed for high temperature Application. It works on 200 deg. Celsius. 3. Two Dedicated heating systems have been integrated with this Rig to raise the temperature of OX-27 Oil. 4. In both Power Packs insulated tanks are being used, which is good for safe operation and safety of operator. 5. This rig is designed in such a way, that it’s OX power pack is in its left side, ATF Power pack is in right Side and test bed is in Centre. 6. A big Test bed have been provided for smooth testing of UUT’s. 7. All piping is being insulated for safe operation and maintenance. 8. It comprises with DAQ System. 9. This rig can test several components at a time, together or separately. Application All the UUT’s are mounted on HTFE-25 Engine after successful performance testing of those. Application of this Rig are as follows: - 1. One of its application is to test LP Pump of HTFE-25. It is designed for functional testing of LP Pump. a. Free Flow Test b. Load Test 2. It is used to test HP Pump of HTFE-25. It is designed for functional testing of HP Pump. a. Free Flow Test b. Load Test 3. It is used to test Oil Pump of HTFE-25. It is designed for functional testing of Oil Pump. 4. It is used to test FCOC of HTFE-25.

Integrated Test Rig For HTFE-25 - Neometrix

Neometrix_Engineering_Pvt_Ltd

Employee leave management system project.

Kamal Acharya

2016EF22_0 solar project report rooftop projects

smsksolar

S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx

SCMS School of Architecture

A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx

maisarahman1

Minimum and Maximum Modes of microprocessor 8086

anil_gaur

Learn the concepts of Thermodynamics on Magic Marks

Magic Marks

Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil

Cara Menggugurkan Kandungan 087776558899

Recently uploaded (20)

Unleashing the Power of the SORA AI lastest leap

Computer Lecture 01.pptxIntroduction to Computers

HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR

data_management_and _data_science_cheat_sheet.pdf

Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait

Thermal Engineering-R & A / C - unit - V

+97470301568>> buy weed in qatar,buy thc oil qatar,buy weed and vape oil in d...

Hostel management system project report..pdf

scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...

DeepFakes presentation : brief idea of DeepFakes

HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx

Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...

Integrated Test Rig For HTFE-25 - Neometrix

Employee leave management system project.

2016EF22_0 solar project report rooftop projects

S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx

A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx

Minimum and Maximum Modes of microprocessor 8086

Learn the concepts of Thermodynamics on Magic Marks

Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil

Spotify services - Leetspeak 2014

1. Spo$fy'services

2. ngn@spo'fy.com-@protocol7

3. Microservices1*in*anger 1"h$p://mar+nfowler.com/ar+cles/microservices.html

4. Why?

5. Monoliths

6. Simplicity Robustness

7. Scalability

8. UNIX%philosophy "Rule&of&Modularity:&Developers&should&build&a&program&out&of& simple&parts&connected&by&well&defined&interfaces,&so&problems&are& local,&and&parts&of&the&program&can&be&replaced&in&future&versions&to& support&new&features.&This&rule&aims&to&save&@me&on&debugging& complex&code&that&is&complex,&long,&and&unreadable" —"Eric"S."Raymond,"The"Art"of"Unix"Programming

9. Embrace(Conway's(law2 2"h$ps://labs.spo.fy.com/2014/03/27/spo.fy8engineering8culture8part81/

10. What's'a'service?

11. Let's&walk&a&request

12. Perimeter'services

13.

14. View%services

15. Service'discovery

16. $ dig _spotify-search._hm.lon3.spotify.net SRV +short 5000 5000 8181 lon3-search-a1.lon3.spotify.net. 5000 5000 8181 lon3-search-a2.lon3.spotify.net. ...

17. Data$services

18. Orchestra)on

19. Scaling(out

20. Geographical,distribu2on3 3"h$ps://www.youtube.com/watch?v=JEpsKnWZrJ8

21. Mul$site

22. Failure(modes

23. Failure(modes Cascading)failures

24. Failure(modes Build&for&failure

25. Failure(modes Drop%requests

26. Infrastructure+automa.on

27. Monitoring

28. Outro