SlideShare a Scribd company logo
Spotify @Conversion Hotel
Is it relevance, because we are both work with
Conversion Optimization?
So why did Ton ask me?
Or is it because we are both Dutch?
He thinks Spotify is cool
But Are we still cool……?
We do have gaming rooms
Slack channel for celebrity
creeping in the office
10 years anniversary
We are getting older but
But there also some signs
that we are not cool anymoreToo big to be a fun startup? Are we a frustrating big company these
days?
Quiz
Don’t let these Gift cards
show up here:
Or worse…..
And even worse…...
In how many countries
can you get Spotify?
How many employees
do we have?
Our new office location in NY
Legal…...
Ways of
Working @
Spotify
The problem with 2000 engineers
Squads=cross functional group
Squads are
responsible
for their own
testing
Tribes & Guilds
Tribe 1
Revenue Mission
R&D Missions, Alliances & Tribes
Data Mission
Growth
Opportunities
Mission
Consumer
Experience Mission
User Engagement
Mission
Creator Mission
Tribe 2
Tribe 3
Tribe 4
Technology Platform Mission
Tribe 1
Tribe 3Tribe 2
Tribe 2
Tribe 1
Developer Platform
Enterprise
Alliance
MissionTribe
Tribe 1
Tribe 1
Tribe 2
Tribe 1
Tribe 4
Tribe 3
Tribe 2
Design & Product Insights Mission
Product area 1
Product
Area
Product area 2
Product area 3
Product area 4
Product area 1
Product area 1
Product area 2
Product area 3
Product area 4
Tribe 1
Product area 1
Product area 2
Legend
How we align
Mission: everybody in the world should enjoy music at any time
Beliefs: Integrate with everybody will help the world become a better place
North star: Integrate with the top 10 apps in the world
Objective: Integrate with UBER
Bet: Integrate with UBER in London
An example
Spotify rhythm in practise
Alignment versus Autonomy
We actively promote people
to try things
The Fail Wall
Alignment versus Autonomy
R&D Organizational-Design Principles
Missions
R&D consists of 8 Missions that encompass all the work going on within the department. A Mission can
be a Tribe, an Alliance or many Alliances, depending on the size of the Mission.
Tribes
A Tribe is the most central organisation unit (together with a squad). Therefore we want to continue to
enforce a strict set of rules around Tribes. The most important rules are:
● The size of a tribe is 30 - 150 people
● The tribe is lead by an accountable leadership team (accountabilities as defined by the one Team,
One R&D doc). Most tribes have the T/P/D trio leadership but some infrastructure tribes might
have just T/P or just T.
● Tribe leaders are benchmarked against a standard R&D-bar and new candidates are interviewed
by people outside the mission to ensure benchmark. All tribe lead appointments must be
approved by the relevant Mission Lead.
● A tribe has a specific dedicated mission that unites all members
● A tribe has its constituents well articulated and we shall strive to ensure one constituent per tribe
● Any change to the tribe structure needs to be approved by Chief R&D Officer (i.e. creation of new
tribes, killing of tribes, merging/splitting of tribes or larger changes in missions scope)
Continues on next slide ->
R&D Organizational-Design Principles cont.
Alliances
We use this name for the highest order org-units only. A Mission becomes an Alliance when it expands to more than one Tribe. Chief
R&D Officer, together with the Mission Lead, decides when to create a new Alliance.
Smaller groups inside tribes
Some larger tribes decide to create units/groups inside the tribe. Some call it product areas or tribelets. We want to allow for a larger
degree of flexibility within the tribe and such solutions require only approval from relevant Mission Lead. Naming is also flexible.
What is a guild?
● A guild is a community of interest around a particular skillset, interest, or practice
● A guild is long term, but not necessarily permanent
● A guild may have rotating or shifting membership
● A guild may be sponsored, or purely organic
● A guild has a coordinator, which may be a rotating or permanent role
● A guild often uses slack, email, and meetings to stay connected in ways that make sense for their members
R&D Organizational-Design Principles cont.
What
Objectives and Key Results (OKRs) is a way for teams to state what they're working towards (the
objectives) and define a set of measurable results (the key results) indicating progress towards those
objectives. Spotify R&D only mandates OKRs on the Tribe level. Mission level objectives are defined
by the Mission Leads and serves as an input to Tribe level OKRs, but the Mission level objectives are
not accompanied by any key results.
Why
OKRs helps R&D create alignment and visibility of work across Tribes.
We’re delivering We’re innovating We’re organising
84% success rate on Q4 OKR’s and 75%
success rate on Q1 OKR’s at 74% of quarter.
Four company bets delivered on time since last
time.
Closed off XXX bet on track to hitting all revised
KPI’s.
XXXX MAU added in 2016, growing faster than
XXXXX at large.
High quality users: XXX more listening if you’re
a multi-client listener
A new squad focusing onXXX
XXX filters, XXX including offline soon in market.
explorations with XXXX ongoing.
New prototyping team to structure early funnel
innovation.
148 person strong team, with 32 hires in Q4+Q1
so far.
Four distinct focuses: Home CE, Car &
Wearables, Clients and App Integrations.
New Product Area set up will allow us to build
out new tribes quickly as needed by growth.
Dedicated and strong insights team.
Getting a deep bench of senior leaders and
potential future tribe leads.
Team
Conversion
Optimization
@Spotify
Tribe 1
Revenue Mission
R&D Missions, Alliances & Tribes
Data Mission
Growth
Opportunities
Mission
Consumer
Experience Mission
User Engagement
Mission
Creator Mission
Tribe 2
Tribe 3
Tribe 4
Technology Platform Mission
Tribe 1
Tribe 3Tribe 2
Tribe 2
Tribe 1
Developer Platform
Enterprise
Alliance
MissionTribe
Tribe 1
Tribe 1
Tribe 2
Tribe 1
Tribe 4
Tribe 3
Tribe 2
Design & Product Insights Mission
Product area 1
Product
Area
Product area 2
Product area 3
Product area 4
Product area 1
Product area 1
Product area 2
Product area 3
Product area 4
Tribe 1
Product area 1
Product area 2
Legend
Tribe 1
Revenue
Tribe 2
Tribe 3
Tribe 4
Product area 1
Product area 2
Product area 3
Product area 4
Revenue has a partner...
Business
Team
Conversion
Business vs R&D
B
R
&
D
Not enough testing
The challenge for us
R&D:
You are
stepping on
our domain
Business:
Is “Joost” the
name of a
squad in R&D?
The outcome - fairly well
established
● Being completely transparent
● Code reviews by R&D for our tests
● Being fairly well structured
● Delivering results
● Improved the data quality
Test initiators
Regional Conversion
LATAM
Japan
Europe
APEC
North America
Product strategy
Student
Family
Bundling
R&D
Payments
Campaign pages
Design
Team
Conversion
30% 15%
15%
40%
Our domain is the web
A very tricky page
3 test
examples
See more offers
Choice paralysis & Price anchoring
Payment method order (1/2)
+/-0%
Payment method order (2/2)
+38%
The results
Redeem Giftcard Flow - control
Variation
Other things we do
Joost @ spotify.com
https://nl.linkedin.com/in/joostdeschepper
Thanks!
Questions?
We are hiring
Team
Conversion

More Related Content

Similar to Joost de Schepper, Spotify (SWE) - Conversion Hotel 2017 - keynote

Driving Corporate Culture in Today’s Marketplace
Driving Corporate Culture in Today’s MarketplaceDriving Corporate Culture in Today’s Marketplace
Driving Corporate Culture in Today’s Marketplace
Human Capital Media
 
Spotify Engineering Culture
Spotify Engineering CultureSpotify Engineering Culture
Spotify Engineering Culture
Maisara Khedr
 
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
Communardo GmbH
 
Scaling like Spotify: What advertising agencies can learn from software-as-a-...
Scaling like Spotify: What advertising agencies can learn from software-as-a-...Scaling like Spotify: What advertising agencies can learn from software-as-a-...
Scaling like Spotify: What advertising agencies can learn from software-as-a-...
Ed Hammerton
 
State of agile transformation in india
State of agile transformation in indiaState of agile transformation in india
State of agile transformation in india
Deepti Jain
 
Agile at Spotify
Agile at SpotifyAgile at Spotify
Agile at Spotify
Joakim Sundén
 
NXTPLabs 2015 - #OpenCedex
NXTPLabs 2015 - #OpenCedexNXTPLabs 2015 - #OpenCedex
NXTPLabs 2015 - #OpenCedexPablo Ruiz
 
Local social overview
Local social overviewLocal social overview
Local social overviewEngage121
 
Addressing Cultural Anti-patterns in Enterprise transformations
Addressing Cultural Anti-patterns in Enterprise transformationsAddressing Cultural Anti-patterns in Enterprise transformations
Addressing Cultural Anti-patterns in Enterprise transformations
Gautham Pallapa
 
November 2015 ICF Colorado Newsletter
November 2015 ICF Colorado NewsletterNovember 2015 ICF Colorado Newsletter
November 2015 ICF Colorado Newsletter
ICF Colorado
 
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
BrittanyShear
 
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
Aggregage
 
How to Leverage Your Employment Brand and Beat The Great Recession
How to Leverage Your Employment Brand and Beat The Great RecessionHow to Leverage Your Employment Brand and Beat The Great Recession
How to Leverage Your Employment Brand and Beat The Great Recession
Aggregage
 
2021 TSS Overview Deck
2021 TSS Overview Deck2021 TSS Overview Deck
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million UsersMat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
Business of Software Conference
 
Creating actionable insights from competitive analysis for interactive design
Creating actionable insights from competitive analysis for interactive designCreating actionable insights from competitive analysis for interactive design
Creating actionable insights from competitive analysis for interactive design
Stuart Silverstein
 
ICF Colorado Newsletter: March 2015
ICF Colorado Newsletter: March 2015 ICF Colorado Newsletter: March 2015
ICF Colorado Newsletter: March 2015
ICF Colorado
 
Volunteer Webinar
Volunteer WebinarVolunteer Webinar
Volunteer Webinar
ASAPHQ
 

Similar to Joost de Schepper, Spotify (SWE) - Conversion Hotel 2017 - keynote (20)

Driving Corporate Culture in Today’s Marketplace
Driving Corporate Culture in Today’s MarketplaceDriving Corporate Culture in Today’s Marketplace
Driving Corporate Culture in Today’s Marketplace
 
Spotify Engineering Culture
Spotify Engineering CultureSpotify Engineering Culture
Spotify Engineering Culture
 
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
Keys to driving a collaborative culture - Feico Mol, Atlassian #CCD2014
 
Scaling like Spotify: What advertising agencies can learn from software-as-a-...
Scaling like Spotify: What advertising agencies can learn from software-as-a-...Scaling like Spotify: What advertising agencies can learn from software-as-a-...
Scaling like Spotify: What advertising agencies can learn from software-as-a-...
 
State of agile transformation in india
State of agile transformation in indiaState of agile transformation in india
State of agile transformation in india
 
Agile at Spotify
Agile at SpotifyAgile at Spotify
Agile at Spotify
 
NXTPLabs 2015 - #OpenCedex
NXTPLabs 2015 - #OpenCedexNXTPLabs 2015 - #OpenCedex
NXTPLabs 2015 - #OpenCedex
 
Local social overview
Local social overviewLocal social overview
Local social overview
 
Tell Me About TEC
Tell Me About TECTell Me About TEC
Tell Me About TEC
 
Addressing Cultural Anti-patterns in Enterprise transformations
Addressing Cultural Anti-patterns in Enterprise transformationsAddressing Cultural Anti-patterns in Enterprise transformations
Addressing Cultural Anti-patterns in Enterprise transformations
 
November 2015 ICF Colorado Newsletter
November 2015 ICF Colorado NewsletterNovember 2015 ICF Colorado Newsletter
November 2015 ICF Colorado Newsletter
 
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
 
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
People-Driven Engagement: Sustaining (or Boosting!) Engagement During Times o...
 
How to Leverage Your Employment Brand and Beat The Great Recession
How to Leverage Your Employment Brand and Beat The Great RecessionHow to Leverage Your Employment Brand and Beat The Great Recession
How to Leverage Your Employment Brand and Beat The Great Recession
 
2021 TSS Overview Deck
2021 TSS Overview Deck2021 TSS Overview Deck
2021 TSS Overview Deck
 
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million UsersMat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
Mat Clayton (CTO/Co-Founder, Mixcloud) - Bootstrapping To 20 Million Users
 
Creating actionable insights from competitive analysis for interactive design
Creating actionable insights from competitive analysis for interactive designCreating actionable insights from competitive analysis for interactive design
Creating actionable insights from competitive analysis for interactive design
 
ICF Colorado Newsletter: March 2015
ICF Colorado Newsletter: March 2015 ICF Colorado Newsletter: March 2015
ICF Colorado Newsletter: March 2015
 
Products training
Products trainingProducts training
Products training
 
Volunteer Webinar
Volunteer WebinarVolunteer Webinar
Volunteer Webinar
 

More from Online Dialogue

Introduction to BOOM! - Behavioral online optimization method
Introduction to BOOM! - Behavioral online optimization methodIntroduction to BOOM! - Behavioral online optimization method
Introduction to BOOM! - Behavioral online optimization method
Online Dialogue
 
CRO & scrum combineren
CRO & scrum combinerenCRO & scrum combineren
CRO & scrum combineren
Online Dialogue
 
GAUC 2020 - presentatie Hans en Reinier
GAUC 2020 - presentatie Hans en ReinierGAUC 2020 - presentatie Hans en Reinier
GAUC 2020 - presentatie Hans en Reinier
Online Dialogue
 
Online Dialogue Digital Analytics Congres 2019
Online Dialogue Digital Analytics Congres 2019Online Dialogue Digital Analytics Congres 2019
Online Dialogue Digital Analytics Congres 2019
Online Dialogue
 
Presentation Emerce Conversion_Bart Schutz_April 11th 2019
Presentation Emerce Conversion_Bart Schutz_April 11th 2019Presentation Emerce Conversion_Bart Schutz_April 11th 2019
Presentation Emerce Conversion_Bart Schutz_April 11th 2019
Online Dialogue
 
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
Online Dialogue
 
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
Online Dialogue
 
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van DamDialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
Online Dialogue
 
Dialogue Donderdag #28 Gerben Langendijk
Dialogue Donderdag #28 Gerben LangendijkDialogue Donderdag #28 Gerben Langendijk
Dialogue Donderdag #28 Gerben Langendijk
Online Dialogue
 
Joost Fromberg at the Global Digital Marketing Summit '18
Joost Fromberg at the Global Digital Marketing Summit '18Joost Fromberg at the Global Digital Marketing Summit '18
Joost Fromberg at the Global Digital Marketing Summit '18
Online Dialogue
 
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynoteAmy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
Online Dialogue
 
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynoteRonny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Online Dialogue
 
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Online Dialogue
 
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynoteMatthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
Online Dialogue
 
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynoteEls Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
Online Dialogue
 
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
Online Dialogue
 
Workshop congres verborgen psycholoog
Workshop congres  verborgen psycholoogWorkshop congres  verborgen psycholoog
Workshop congres verborgen psycholoog
Online Dialogue
 
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
Online Dialogue
 
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
Online Dialogue
 
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynoteEvidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
Online Dialogue
 

More from Online Dialogue (20)

Introduction to BOOM! - Behavioral online optimization method
Introduction to BOOM! - Behavioral online optimization methodIntroduction to BOOM! - Behavioral online optimization method
Introduction to BOOM! - Behavioral online optimization method
 
CRO & scrum combineren
CRO & scrum combinerenCRO & scrum combineren
CRO & scrum combineren
 
GAUC 2020 - presentatie Hans en Reinier
GAUC 2020 - presentatie Hans en ReinierGAUC 2020 - presentatie Hans en Reinier
GAUC 2020 - presentatie Hans en Reinier
 
Online Dialogue Digital Analytics Congres 2019
Online Dialogue Digital Analytics Congres 2019Online Dialogue Digital Analytics Congres 2019
Online Dialogue Digital Analytics Congres 2019
 
Presentation Emerce Conversion_Bart Schutz_April 11th 2019
Presentation Emerce Conversion_Bart Schutz_April 11th 2019Presentation Emerce Conversion_Bart Schutz_April 11th 2019
Presentation Emerce Conversion_Bart Schutz_April 11th 2019
 
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
Presentation Emerce Conversion_Tom vanden Berg_April 11th 2019
 
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
Validation in every Organisation - Ton Weseling - CRO Elite keynote London - ...
 
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van DamDialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
Dialogue Donderdag #28 Joost Baalbergen, Eline van Baal en Roos van Dam
 
Dialogue Donderdag #28 Gerben Langendijk
Dialogue Donderdag #28 Gerben LangendijkDialogue Donderdag #28 Gerben Langendijk
Dialogue Donderdag #28 Gerben Langendijk
 
Joost Fromberg at the Global Digital Marketing Summit '18
Joost Fromberg at the Global Digital Marketing Summit '18Joost Fromberg at the Global Digital Marketing Summit '18
Joost Fromberg at the Global Digital Marketing Summit '18
 
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynoteAmy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
Amy Cueva, Mad*Pow (USA) - Conversion Hotel 2017 - keynote
 
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynoteRonny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
 
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
 
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynoteMatthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
 
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynoteEls Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
Els Aerts, AGConsult (BE) - Conversion Hotel 2017 - keynote
 
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
Keynote #gconvert17 - Bart Schutz of Online Dialogue - Online Persuasion - Sy...
 
Workshop congres verborgen psycholoog
Workshop congres  verborgen psycholoogWorkshop congres  verborgen psycholoog
Workshop congres verborgen psycholoog
 
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
Keynote #DAC17 - Bart Schutz - Marshmallows and the psychology behind evidenc...
 
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
Keynote on Online Experiments by Ton Wesseling - Online Dialogue at the Web A...
 
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynoteEvidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
Evidence everything - Bart Schutz - Growth Marketing Summit 2017 keynote
 

Recently uploaded

哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
axoqas
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
slg6lamcq
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
v3tuleee
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
rwarrenll
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
74nqk8xf
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
TravisMalana
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
Roger Valdez
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
ewymefz
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
haila53
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
jerlynmaetalle
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
javier ramirez
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
g4dpvqap0
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Subhajit Sahu
 
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptxData_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
AnirbanRoy608946
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
balafet
 

Recently uploaded (20)

哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
 
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
一比一原版(UofM毕业证)明尼苏达大学毕业证成绩单
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
 
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptxData_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
 

Joost de Schepper, Spotify (SWE) - Conversion Hotel 2017 - keynote

  • 2.
  • 3. Is it relevance, because we are both work with Conversion Optimization? So why did Ton ask me? Or is it because we are both Dutch?
  • 4. He thinks Spotify is cool But Are we still cool……?
  • 5. We do have gaming rooms
  • 6. Slack channel for celebrity creeping in the office
  • 8. We are getting older but
  • 9. But there also some signs that we are not cool anymoreToo big to be a fun startup? Are we a frustrating big company these days?
  • 10. Quiz
  • 11. Don’t let these Gift cards show up here:
  • 14. In how many countries can you get Spotify?
  • 16. Our new office location in NY
  • 19. The problem with 2000 engineers
  • 20. Squads=cross functional group Squads are responsible for their own testing
  • 22. Tribe 1 Revenue Mission R&D Missions, Alliances & Tribes Data Mission Growth Opportunities Mission Consumer Experience Mission User Engagement Mission Creator Mission Tribe 2 Tribe 3 Tribe 4 Technology Platform Mission Tribe 1 Tribe 3Tribe 2 Tribe 2 Tribe 1 Developer Platform Enterprise Alliance MissionTribe Tribe 1 Tribe 1 Tribe 2 Tribe 1 Tribe 4 Tribe 3 Tribe 2 Design & Product Insights Mission Product area 1 Product Area Product area 2 Product area 3 Product area 4 Product area 1 Product area 1 Product area 2 Product area 3 Product area 4 Tribe 1 Product area 1 Product area 2 Legend
  • 24. Mission: everybody in the world should enjoy music at any time Beliefs: Integrate with everybody will help the world become a better place North star: Integrate with the top 10 apps in the world Objective: Integrate with UBER Bet: Integrate with UBER in London An example
  • 25. Spotify rhythm in practise
  • 27. We actively promote people to try things
  • 30.
  • 31. R&D Organizational-Design Principles Missions R&D consists of 8 Missions that encompass all the work going on within the department. A Mission can be a Tribe, an Alliance or many Alliances, depending on the size of the Mission. Tribes A Tribe is the most central organisation unit (together with a squad). Therefore we want to continue to enforce a strict set of rules around Tribes. The most important rules are: ● The size of a tribe is 30 - 150 people ● The tribe is lead by an accountable leadership team (accountabilities as defined by the one Team, One R&D doc). Most tribes have the T/P/D trio leadership but some infrastructure tribes might have just T/P or just T. ● Tribe leaders are benchmarked against a standard R&D-bar and new candidates are interviewed by people outside the mission to ensure benchmark. All tribe lead appointments must be approved by the relevant Mission Lead. ● A tribe has a specific dedicated mission that unites all members ● A tribe has its constituents well articulated and we shall strive to ensure one constituent per tribe ● Any change to the tribe structure needs to be approved by Chief R&D Officer (i.e. creation of new tribes, killing of tribes, merging/splitting of tribes or larger changes in missions scope) Continues on next slide ->
  • 32. R&D Organizational-Design Principles cont. Alliances We use this name for the highest order org-units only. A Mission becomes an Alliance when it expands to more than one Tribe. Chief R&D Officer, together with the Mission Lead, decides when to create a new Alliance. Smaller groups inside tribes Some larger tribes decide to create units/groups inside the tribe. Some call it product areas or tribelets. We want to allow for a larger degree of flexibility within the tribe and such solutions require only approval from relevant Mission Lead. Naming is also flexible. What is a guild? ● A guild is a community of interest around a particular skillset, interest, or practice ● A guild is long term, but not necessarily permanent ● A guild may have rotating or shifting membership ● A guild may be sponsored, or purely organic ● A guild has a coordinator, which may be a rotating or permanent role ● A guild often uses slack, email, and meetings to stay connected in ways that make sense for their members
  • 33. R&D Organizational-Design Principles cont. What Objectives and Key Results (OKRs) is a way for teams to state what they're working towards (the objectives) and define a set of measurable results (the key results) indicating progress towards those objectives. Spotify R&D only mandates OKRs on the Tribe level. Mission level objectives are defined by the Mission Leads and serves as an input to Tribe level OKRs, but the Mission level objectives are not accompanied by any key results. Why OKRs helps R&D create alignment and visibility of work across Tribes.
  • 34. We’re delivering We’re innovating We’re organising 84% success rate on Q4 OKR’s and 75% success rate on Q1 OKR’s at 74% of quarter. Four company bets delivered on time since last time. Closed off XXX bet on track to hitting all revised KPI’s. XXXX MAU added in 2016, growing faster than XXXXX at large. High quality users: XXX more listening if you’re a multi-client listener A new squad focusing onXXX XXX filters, XXX including offline soon in market. explorations with XXXX ongoing. New prototyping team to structure early funnel innovation. 148 person strong team, with 32 hires in Q4+Q1 so far. Four distinct focuses: Home CE, Car & Wearables, Clients and App Integrations. New Product Area set up will allow us to build out new tribes quickly as needed by growth. Dedicated and strong insights team. Getting a deep bench of senior leaders and potential future tribe leads.
  • 36. Tribe 1 Revenue Mission R&D Missions, Alliances & Tribes Data Mission Growth Opportunities Mission Consumer Experience Mission User Engagement Mission Creator Mission Tribe 2 Tribe 3 Tribe 4 Technology Platform Mission Tribe 1 Tribe 3Tribe 2 Tribe 2 Tribe 1 Developer Platform Enterprise Alliance MissionTribe Tribe 1 Tribe 1 Tribe 2 Tribe 1 Tribe 4 Tribe 3 Tribe 2 Design & Product Insights Mission Product area 1 Product Area Product area 2 Product area 3 Product area 4 Product area 1 Product area 1 Product area 2 Product area 3 Product area 4 Tribe 1 Product area 1 Product area 2 Legend
  • 37. Tribe 1 Revenue Tribe 2 Tribe 3 Tribe 4 Product area 1 Product area 2 Product area 3 Product area 4 Revenue has a partner... Business Team Conversion
  • 41. The challenge for us R&D: You are stepping on our domain Business: Is “Joost” the name of a squad in R&D?
  • 42. The outcome - fairly well established ● Being completely transparent ● Code reviews by R&D for our tests ● Being fairly well structured ● Delivering results ● Improved the data quality
  • 43. Test initiators Regional Conversion LATAM Japan Europe APEC North America Product strategy Student Family Bundling R&D Payments Campaign pages Design Team Conversion 30% 15% 15% 40%
  • 44. Our domain is the web
  • 48. Choice paralysis & Price anchoring
  • 49. Payment method order (1/2) +/-0%
  • 50. Payment method order (2/2) +38%
  • 52. Redeem Giftcard Flow - control