SlideShare a Scribd company logo
1 of 67
Experimentation
is
Håkan Forss, Agile Coach @ King, @hakanforss
© King.com Ltd 2015 – Commercially confidential
Håkan Forss
Agile Coach
@hakanforss
© King.com Ltd 2015 – Commercially confidential
We make great games
About King
Page 3
© King.com Ltd 2015 – Commercially confidential Page 4
Some stats and facts
1.000.000.000.000
474 million monthly active
users around the world
(Q3 2015)
Approximately 1.4 billion
average daily game plays across
our games (Q3 2015)
More than 1 trillion levels played!
3 games in the top 15 grossing games
on the Apple App Store and on Google Play in the US in Q3 2015
About King
© King.com Ltd 2015 – Commercially confidential
We make great games
About King
Page 5
1600Employees (approx. Q3 2015)
King has offices and studios in
Stockholm, London, Barcelona,
Bucharest, Malmo, Berlin,
Singapore, Seattle, San
Francisco, Malta, Tokyo, Seoul
and Shanghai.
© King.com Ltd 2015 – Commercially confidential
The evolution of King
About King
Page 6
• Founded in 2003
• Originally games were only
available through our site and
portals including AOL and
Yahoo!
Online skill Social Mobile
• Launched first game on
Facebook in Q2 2011
• Launched first game on mobile
H2 2012
Experimentation is
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
experiment
Verb /ɪkˈsper.ɪ.ment/
to try something in order
to discover what it is like
or find out more about it.
What is an Experiment?
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
experiment
Verb /ɪkˈsper.ɪ.ment/
to try something in order
to discover what it is like
or find out more about it.
What is an Experiment?
Good enough for now,
safe enough to try!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Thank you
© King.com Ltd 2015 – Commercially confidential
Puff
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Oh, I did NOT
expect that!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
The sound of learning
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
© King.com Ltd 2015 – Commercially confidential
Hypothesis
Prediction
Experiment
Observation
Learning
© King.com Ltd 2015 – Commercially confidential
Prediction
Observation
Observation
+
Δ
-
Δ
Hypothesis
© King.com Ltd 2015 – Commercially confidential
Expect at least 50% of the experiments
should not give the expected result
This is when we REALLY learn!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
#fail
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
#fail
First Attempt In Learning
© King.com Ltd 2015 – Commercially confidential Page 19
© King.com Ltd 2015 – Commercially confidential
It was a cold day in January…
Experimentation in CCSS
Page 21
Ideas
How can we make the game more fun?
How can we help players more to beat challenges?
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 22
Ideas
What is fun and helpful to players?
© King.com Ltd 2015 – Commercially confidential
The team came up with…
Experimentation in CCSS
Page 23
Hello there sir!
Ideas
© King.com Ltd 2015 – Commercially confidential
Build the MVP
Experimentation in CCSS
Page 24
Ideas
BUILD IT
Sprinkleshell
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 25
Ideas
BUILD IT
Release
it!
Release it! - Test it in the market!
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 26
Is it easy to understand how to use the sidekick?
Do players really use it once they understand how-to?
Ideas
BUILD IT!
Release
it!
MEASURE IT!
MEASURE IT! – does it work?
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 27
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
Analyze it! - Feedback from players
© King.com Ltd 2015 – Commercially confidential
Players do like and use it only if they understand how-to
What did we learn?
Experimentation in CCSS
Page 28
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
LEARN
It’s hard to understand how to use
The sidekick is not visually noticeable
© King.com Ltd 2015 – Commercially confidential
Tweek it with the learning
Experimentation in CCSS
Page 29
In-game step-by-step tutorial
More visual, more attention
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
LEARN
Thought bubble Charge reminder
© King.com Ltd 2015 – Commercially confidential
How is it doing now?
Experimentation in CCSS
Page 30
Ideas
BUILD IT
Release
it!
MEASURE IT!
Analyze
it!
LEARN
Constant growth in Sprinkleshell usage
More than 80% of players use Sprinkleshell on a given day and level
Players use Sprinkleshell more than just a few times
Average attempts for completing hard levels decreased
© King.com Ltd 2015 – Commercially confidential Page 31
© King.com Ltd 2015 – Commercially confidential
Idea
Design &
Build it!
Verify
it!
Typical process
Page 32
Think
it!
TWEEK
IT!
Release
it!
MEASURE
IT!
Analyze
it!
LEARN
Are we
happy?
© King.com Ltd 2015 – Commercially confidential
Idea
Design &
Build it!
Verify
it!
Typical process
Page 33
Think
it!
TWEEK
IT!
Release
it!
MEASURE
IT!
Analyze
it!
LEARN
Are we
happy?
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
A B
Usedwithpermission.CreatedbyHåkanForss@hakanforsshttp://hakanforss.wordpress.com
© King.com Ltd 2015 – Commercially confidential
Happy players
© King.com Ltd 2015 – Commercially confidential
Our main KPIs
Retention
Engagement
Monetization Conversion
Virality
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential
Level monitoring
• Cohort analysis important
• Listen to your data to inform design
Culture is
© King Digital Entertainment plc 2014
Culture = ∑ ( Behaviors )
© King.com Ltd 2015 – Commercially confidential
We listen, we
learn, we share. Free to be ourselves, we
treat people like a friend.
We don’t compromise on quality.
We put our heart and soul into
everything we do.
We stand up for creativity.
We’re agile and adaptable
problem solvers.
King Values
© King.com Ltd 2015 – Commercially confidential
Recruitment
Programming skills
Experience
Open & Humble
Care & Craft
Programming skills
Experience
Open & Humble
Care & Craft
© King.com Ltd 2015 – Commercially confidential
Introduction Training
© King.com Ltd 2015 – Commercially confidential
Bootcamp
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential Page 50
© King.com Ltd 2015 – Commercially confidential
Game Jams
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Solving problems through experimentation and
collaboration
Develop small, incremental releases and iterate
Focus on frequent delivery to maximize learning
Transparency and visualization
Agile @ King?
© King.com Ltd 2015 – Commercially confidential 55
Agile is not a Process, It Defines Culture
© King.com Ltd 2015 – Commercially confidential 56
Team decides…
…what to ship
…how to ship
…when to ship
…and after
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Alignment vs Autonomy
Page 57
AutonomyAlignment
DO AS I SAY! Do whatever you
want.
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Alignment vs Autonomy
Page 58
High autonomyLow autonomy
LowalignmentHighalignment
Authorative
organization
Micromanaging
organization
Organization?
I hope someone
is working on
that resort...
BUILD MY
PARADISE
ISLAND!!
We need to
build a nice
paradise
island where
our visitors
can relax and
enjoy
themselves.
Innovative
organization
Dig a hole!
Let’s find the
best way to
achieve this
together.
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 59
Photos © Balazs Gardi / Red Bull Sailing Newsroom
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 60
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 61
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 62
Cake Artist: Lee Sin
http://cakejournal.cakejournalllc.netdna-cdn.com/wp-content/uploads/2013/08/Candy-Crush-Cake.jpg
© King.com Ltd 2015 – Commercially confidential
Creative workplace
© King.com Ltd 2015 – Commercially confidential
Placeholder for Sveav. 44 video
Thank you
© King.com Ltd 2015 – Commercially confidential
Q & AHåkan Forss
Mail: hakan.forss@king.com
Twitter: @hakanforss
Blog: http://hakanforss.wordpress.com

More Related Content

What's hot

Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Håkan Forss
 
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Håkan Forss
 
Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Håkan Forss
 
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaMake strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaHåkan Forss
 
Retrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataRetrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataHåkan Forss
 
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Håkan Forss
 
How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014Håkan Forss
 
Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Håkan Forss
 
Stop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataStop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataHåkan Forss
 
Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Håkan Forss
 
The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014Håkan Forss
 
The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16Håkan Forss
 
The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19Håkan Forss
 
Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Will Anderson
 
Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Chris Riley ☁
 

What's hot (15)

Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
 
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
 
Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014
 
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaMake strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
 
Retrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataRetrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota Kata
 
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
 
How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014
 
Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16
 
Stop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataStop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota Kata
 
Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30
 
The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014
 
The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16
 
The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19
 
Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)
 
Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012
 

Similar to Experimentation and Agile at King

Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Agile Greece
 
Get Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessGet Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessFuel Lines Business Development
 
Hot ticket - Marketing Presentation
Hot ticket - Marketing PresentationHot ticket - Marketing Presentation
Hot ticket - Marketing Presentationpinkellie
 
About Simplus
About SimplusAbout Simplus
About SimplusAmy Cook
 
Survival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival To Thrival
 
Getting Client Buy-in
Getting Client Buy-inGetting Client Buy-in
Getting Client Buy-inLiam Hughes
 
Happy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaHappy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaTechWell
 
Epiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany
 
Effective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesEffective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesDigitasLBi Nordics
 
Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Skyword Inc.
 
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldMarketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldUpwork
 
pitch deck presentation template for startups
pitch deck presentation template for startupspitch deck presentation template for startups
pitch deck presentation template for startupsssuser7102d2
 
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelThink Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelCprime
 
How to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade SmithHow to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade Smithmultifamily-social-media
 
Building Brand Advocacy
Building Brand AdvocacyBuilding Brand Advocacy
Building Brand AdvocacyJade Smith
 

Similar to Experimentation and Agile at King (20)

Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
 
Get Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessGet Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New Business
 
Hot ticket - Marketing Presentation
Hot ticket - Marketing PresentationHot ticket - Marketing Presentation
Hot ticket - Marketing Presentation
 
About Simplus
About SimplusAbout Simplus
About Simplus
 
About Simplus
About SimplusAbout Simplus
About Simplus
 
Survival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet Up
 
Getting Client Buy-in
Getting Client Buy-inGetting Client Buy-in
Getting Client Buy-in
 
Your marketing dream team upwork
Your marketing dream team   upworkYour marketing dream team   upwork
Your marketing dream team upwork
 
Happy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaHappy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine Saga
 
Epiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 London
 
Effective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesEffective Social Media Measurement Strategies
Effective Social Media Measurement Strategies
 
Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7
 
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldMarketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
 
Workshop titles and samples
Workshop titles and samplesWorkshop titles and samples
Workshop titles and samples
 
pitch deck presentation template for startups
pitch deck presentation template for startupspitch deck presentation template for startups
pitch deck presentation template for startups
 
Conversion Mythbusting
Conversion MythbustingConversion Mythbusting
Conversion Mythbusting
 
Lessons from the i-Beam
Lessons from the i-BeamLessons from the i-Beam
Lessons from the i-Beam
 
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelThink Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
 
How to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade SmithHow to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade Smith
 
Building Brand Advocacy
Building Brand AdvocacyBuilding Brand Advocacy
Building Brand Advocacy
 

More from Håkan Forss

Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Håkan Forss
 
Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Håkan Forss
 
Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Håkan Forss
 
Reflection card to print on a4
Reflection card to print on a4Reflection card to print on a4
Reflection card to print on a4Håkan Forss
 
Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Håkan Forss
 
The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01Håkan Forss
 
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Håkan Forss
 
May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012Håkan Forss
 
Lean lego – the red brick cancer
Lean lego – the red brick cancerLean lego – the red brick cancer
Lean lego – the red brick cancerHåkan Forss
 

More from Håkan Forss (10)

Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
 
Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21
 
Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3
 
Reflection card to print on a4
Reflection card to print on a4Reflection card to print on a4
Reflection card to print on a4
 
Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15
 
The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01
 
The two paths
The two pathsThe two paths
The two paths
 
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
 
May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012
 
Lean lego – the red brick cancer
Lean lego – the red brick cancerLean lego – the red brick cancer
Lean lego – the red brick cancer
 

Recently uploaded

Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Roomdivyansh0kumar0
 
Best Basmati Rice Manufacturers in India
Best Basmati Rice Manufacturers in IndiaBest Basmati Rice Manufacturers in India
Best Basmati Rice Manufacturers in IndiaShree Krishna Exports
 
Progress Report - Oracle Database Analyst Summit
Progress  Report - Oracle Database Analyst SummitProgress  Report - Oracle Database Analyst Summit
Progress Report - Oracle Database Analyst SummitHolger Mueller
 
Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Serviceritikaroy0888
 
Event mailer assignment progress report .pdf
Event mailer assignment progress report .pdfEvent mailer assignment progress report .pdf
Event mailer assignment progress report .pdftbatkhuu1
 
7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...Paul Menig
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessAggregage
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLSeo
 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear RegressionRavindra Nath Shukla
 
GD Birla and his contribution in management
GD Birla and his contribution in managementGD Birla and his contribution in management
GD Birla and his contribution in managementchhavia330
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Servicediscovermytutordmt
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Roland Driesen
 
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A  SALESMAN / WOMANA DAY IN THE LIFE OF A  SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMANIlamathiKannappan
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsP&CO
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communicationskarancommunications
 
BEST ✨ Call Girls In Indirapuram Ghaziabad ✔️ 9871031762 ✔️ Escorts Service...
BEST ✨ Call Girls In  Indirapuram Ghaziabad  ✔️ 9871031762 ✔️ Escorts Service...BEST ✨ Call Girls In  Indirapuram Ghaziabad  ✔️ 9871031762 ✔️ Escorts Service...
BEST ✨ Call Girls In Indirapuram Ghaziabad ✔️ 9871031762 ✔️ Escorts Service...noida100girls
 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth MarketingShawn Pang
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Lviv Startup Club
 

Recently uploaded (20)

Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
 
Best Basmati Rice Manufacturers in India
Best Basmati Rice Manufacturers in IndiaBest Basmati Rice Manufacturers in India
Best Basmati Rice Manufacturers in India
 
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
 
Progress Report - Oracle Database Analyst Summit
Progress  Report - Oracle Database Analyst SummitProgress  Report - Oracle Database Analyst Summit
Progress Report - Oracle Database Analyst Summit
 
Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Service
 
Event mailer assignment progress report .pdf
Event mailer assignment progress report .pdfEvent mailer assignment progress report .pdf
Event mailer assignment progress report .pdf
 
7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for Success
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear Regression
 
GD Birla and his contribution in management
GD Birla and his contribution in managementGD Birla and his contribution in management
GD Birla and his contribution in management
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
 
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A  SALESMAN / WOMANA DAY IN THE LIFE OF A  SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMAN
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
 
BEST ✨ Call Girls In Indirapuram Ghaziabad ✔️ 9871031762 ✔️ Escorts Service...
BEST ✨ Call Girls In  Indirapuram Ghaziabad  ✔️ 9871031762 ✔️ Escorts Service...BEST ✨ Call Girls In  Indirapuram Ghaziabad  ✔️ 9871031762 ✔️ Escorts Service...
BEST ✨ Call Girls In Indirapuram Ghaziabad ✔️ 9871031762 ✔️ Escorts Service...
 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
 

Experimentation and Agile at King

  • 1. Experimentation is Håkan Forss, Agile Coach @ King, @hakanforss
  • 2. © King.com Ltd 2015 – Commercially confidential Håkan Forss Agile Coach @hakanforss
  • 3. © King.com Ltd 2015 – Commercially confidential We make great games About King Page 3
  • 4. © King.com Ltd 2015 – Commercially confidential Page 4 Some stats and facts 1.000.000.000.000 474 million monthly active users around the world (Q3 2015) Approximately 1.4 billion average daily game plays across our games (Q3 2015) More than 1 trillion levels played! 3 games in the top 15 grossing games on the Apple App Store and on Google Play in the US in Q3 2015 About King
  • 5. © King.com Ltd 2015 – Commercially confidential We make great games About King Page 5 1600Employees (approx. Q3 2015) King has offices and studios in Stockholm, London, Barcelona, Bucharest, Malmo, Berlin, Singapore, Seattle, San Francisco, Malta, Tokyo, Seoul and Shanghai.
  • 6. © King.com Ltd 2015 – Commercially confidential The evolution of King About King Page 6 • Founded in 2003 • Originally games were only available through our site and portals including AOL and Yahoo! Online skill Social Mobile • Launched first game on Facebook in Q2 2011 • Launched first game on mobile H2 2012
  • 7. Experimentation is Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 8. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com experiment Verb /ɪkˈsper.ɪ.ment/ to try something in order to discover what it is like or find out more about it. What is an Experiment?
  • 9. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com experiment Verb /ɪkˈsper.ɪ.ment/ to try something in order to discover what it is like or find out more about it. What is an Experiment? Good enough for now, safe enough to try!
  • 10. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 11. Thank you © King.com Ltd 2015 – Commercially confidential Puff Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 12. Oh, I did NOT expect that! Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 13. The sound of learning Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 14. © King.com Ltd 2015 – Commercially confidential Hypothesis Prediction Experiment Observation Learning
  • 15. © King.com Ltd 2015 – Commercially confidential Prediction Observation Observation + Δ - Δ Hypothesis
  • 16. © King.com Ltd 2015 – Commercially confidential Expect at least 50% of the experiments should not give the expected result This is when we REALLY learn!
  • 17. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com #fail
  • 18. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com #fail First Attempt In Learning
  • 19. © King.com Ltd 2015 – Commercially confidential Page 19
  • 20.
  • 21. © King.com Ltd 2015 – Commercially confidential It was a cold day in January… Experimentation in CCSS Page 21 Ideas How can we make the game more fun? How can we help players more to beat challenges?
  • 22. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 22 Ideas What is fun and helpful to players?
  • 23. © King.com Ltd 2015 – Commercially confidential The team came up with… Experimentation in CCSS Page 23 Hello there sir! Ideas
  • 24. © King.com Ltd 2015 – Commercially confidential Build the MVP Experimentation in CCSS Page 24 Ideas BUILD IT Sprinkleshell
  • 25. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 25 Ideas BUILD IT Release it! Release it! - Test it in the market!
  • 26. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 26 Is it easy to understand how to use the sidekick? Do players really use it once they understand how-to? Ideas BUILD IT! Release it! MEASURE IT! MEASURE IT! – does it work?
  • 27. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 27 Ideas BUILD IT! Release it! MEASURE IT! Analyze it! Analyze it! - Feedback from players
  • 28. © King.com Ltd 2015 – Commercially confidential Players do like and use it only if they understand how-to What did we learn? Experimentation in CCSS Page 28 Ideas BUILD IT! Release it! MEASURE IT! Analyze it! LEARN It’s hard to understand how to use The sidekick is not visually noticeable
  • 29. © King.com Ltd 2015 – Commercially confidential Tweek it with the learning Experimentation in CCSS Page 29 In-game step-by-step tutorial More visual, more attention Ideas BUILD IT! Release it! MEASURE IT! Analyze it! LEARN Thought bubble Charge reminder
  • 30. © King.com Ltd 2015 – Commercially confidential How is it doing now? Experimentation in CCSS Page 30 Ideas BUILD IT Release it! MEASURE IT! Analyze it! LEARN Constant growth in Sprinkleshell usage More than 80% of players use Sprinkleshell on a given day and level Players use Sprinkleshell more than just a few times Average attempts for completing hard levels decreased
  • 31. © King.com Ltd 2015 – Commercially confidential Page 31
  • 32. © King.com Ltd 2015 – Commercially confidential Idea Design & Build it! Verify it! Typical process Page 32 Think it! TWEEK IT! Release it! MEASURE IT! Analyze it! LEARN Are we happy?
  • 33. © King.com Ltd 2015 – Commercially confidential Idea Design & Build it! Verify it! Typical process Page 33 Think it! TWEEK IT! Release it! MEASURE IT! Analyze it! LEARN Are we happy?
  • 34. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 35.
  • 36. A B
  • 38. © King.com Ltd 2015 – Commercially confidential Happy players
  • 39. © King.com Ltd 2015 – Commercially confidential Our main KPIs Retention Engagement Monetization Conversion Virality
  • 40. © King.com Ltd 2015 – Commercially confidential
  • 41. © King.com Ltd 2015 – Commercially confidential Level monitoring • Cohort analysis important • Listen to your data to inform design
  • 43. © King Digital Entertainment plc 2014 Culture = ∑ ( Behaviors )
  • 44. © King.com Ltd 2015 – Commercially confidential We listen, we learn, we share. Free to be ourselves, we treat people like a friend. We don’t compromise on quality. We put our heart and soul into everything we do. We stand up for creativity. We’re agile and adaptable problem solvers. King Values
  • 45. © King.com Ltd 2015 – Commercially confidential Recruitment Programming skills Experience Open & Humble Care & Craft Programming skills Experience Open & Humble Care & Craft
  • 46. © King.com Ltd 2015 – Commercially confidential Introduction Training
  • 47. © King.com Ltd 2015 – Commercially confidential Bootcamp
  • 48. © King.com Ltd 2015 – Commercially confidential
  • 49. © King.com Ltd 2015 – Commercially confidential Page 50
  • 50. © King.com Ltd 2015 – Commercially confidential Game Jams
  • 51. © King.com Ltd 2015 – Commercially confidential
  • 52. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Solving problems through experimentation and collaboration Develop small, incremental releases and iterate Focus on frequent delivery to maximize learning Transparency and visualization Agile @ King?
  • 53. © King.com Ltd 2015 – Commercially confidential 55 Agile is not a Process, It Defines Culture
  • 54. © King.com Ltd 2015 – Commercially confidential 56 Team decides… …what to ship …how to ship …when to ship …and after
  • 55. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Alignment vs Autonomy Page 57 AutonomyAlignment DO AS I SAY! Do whatever you want.
  • 56. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Alignment vs Autonomy Page 58 High autonomyLow autonomy LowalignmentHighalignment Authorative organization Micromanaging organization Organization? I hope someone is working on that resort... BUILD MY PARADISE ISLAND!! We need to build a nice paradise island where our visitors can relax and enjoy themselves. Innovative organization Dig a hole! Let’s find the best way to achieve this together.
  • 57. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 59 Photos © Balazs Gardi / Red Bull Sailing Newsroom
  • 58. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 60
  • 59. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 61
  • 60. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 62
  • 61. Cake Artist: Lee Sin http://cakejournal.cakejournalllc.netdna-cdn.com/wp-content/uploads/2013/08/Candy-Crush-Cake.jpg
  • 62. © King.com Ltd 2015 – Commercially confidential Creative workplace
  • 63.
  • 64.
  • 65.
  • 66. © King.com Ltd 2015 – Commercially confidential Placeholder for Sveav. 44 video
  • 67. Thank you © King.com Ltd 2015 – Commercially confidential Q & AHåkan Forss Mail: hakan.forss@king.com Twitter: @hakanforss Blog: http://hakanforss.wordpress.com