SlideShare a Scribd company logo
Peaksel examples in A/B testing
When & why?
● Stable project
● Enough traffic
Retention
General Knowledge Quiz
Revenue
Soccer Quiz 2019 (Football Quiz)
Soccer Quiz 2019 (Football Quiz)
Decision
time
App 1
Our takeaway
● Don't test changes that are
too small
● Test significant changes
● Goal can be Total Revenue
● Higher retention doesn't
mean higher revenue
Thank you!

More Related Content

What's hot

Product managers and project managers
Product managers and project managersProduct managers and project managers
Product managers and project managers
Suhayb Mahmood
 
Finishing Open-Source Projects
Finishing Open-Source ProjectsFinishing Open-Source Projects
Finishing Open-Source Projects
Addy Dan
 
April 2015 Discount Coupon
April 2015 Discount CouponApril 2015 Discount Coupon
April 2015 Discount Coupon
OSP International LLC
 
How to Create the Sound Platform by Sonos' Global Product Lead
How to Create the Sound Platform by Sonos' Global Product LeadHow to Create the Sound Platform by Sonos' Global Product Lead
How to Create the Sound Platform by Sonos' Global Product Lead
Product School
 
Doing a GAP Analysis Before Choosing a New ERP
Doing a GAP Analysis Before Choosing a New ERPDoing a GAP Analysis Before Choosing a New ERP
Doing a GAP Analysis Before Choosing a New ERP
Odoo
 
Product owner and anti patterns
Product owner and anti patternsProduct owner and anti patterns
Product owner and anti patterns
Piyush Rahate
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
OSP International LLC
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation Methodology
Quang Ngoc
 
Implementation planning gcdp all tiers
Implementation planning gcdp all tiersImplementation planning gcdp all tiers
Implementation planning gcdp all tiersAIESEC
 
From dysfunction to cross function in 8,593 easy steps- team building at the cbc
From dysfunction to cross function in 8,593 easy steps- team building at the cbcFrom dysfunction to cross function in 8,593 easy steps- team building at the cbc
From dysfunction to cross function in 8,593 easy steps- team building at the cbc
Sam Lightowler
 
Odoo Experience 2018 - The Odoo Methodology
Odoo Experience 2018 - The Odoo MethodologyOdoo Experience 2018 - The Odoo Methodology
Odoo Experience 2018 - The Odoo Methodology
ElínAnna Jónasdóttir
 
Perfect Wedding: Lean Startup and Agile
Perfect Wedding: Lean Startup and AgilePerfect Wedding: Lean Startup and Agile
Perfect Wedding: Lean Startup and Agile
Hugo Messer
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
OSP International LLC
 
Product Goals in Scrum
Product Goals in ScrumProduct Goals in Scrum
Product Goals in Scrum
Roman Pichler
 
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
Amit Srivastava, PMP
 
Practical Project Collaboration for Product Owners and Scrum Teams
Practical Project Collaboration for Product Owners and Scrum TeamsPractical Project Collaboration for Product Owners and Scrum Teams
Practical Project Collaboration for Product Owners and Scrum Teams
Planview
 
Methodology: agile@scale what is a 'PI Zero'
Methodology: agile@scale what is a 'PI Zero'Methodology: agile@scale what is a 'PI Zero'
Methodology: agile@scale what is a 'PI Zero'
Jean-François Nguyen
 
The Engineer Webcast: Five Ways to Get More Engineering Time Out of Your Eng...
The Engineer Webcast:  Five Ways to Get More Engineering Time Out of Your Eng...The Engineer Webcast:  Five Ways to Get More Engineering Time Out of Your Eng...
The Engineer Webcast: Five Ways to Get More Engineering Time Out of Your Eng...
Planview
 
Week 02
Week 02Week 02
Project Management: from Stone Age to DevOps - High Load Strategy 2016
Project Management: from Stone Age to DevOps - High Load Strategy 2016Project Management: from Stone Age to DevOps - High Load Strategy 2016
Project Management: from Stone Age to DevOps - High Load Strategy 2016
Antonio COBO CUENCA
 

What's hot (20)

Product managers and project managers
Product managers and project managersProduct managers and project managers
Product managers and project managers
 
Finishing Open-Source Projects
Finishing Open-Source ProjectsFinishing Open-Source Projects
Finishing Open-Source Projects
 
April 2015 Discount Coupon
April 2015 Discount CouponApril 2015 Discount Coupon
April 2015 Discount Coupon
 
How to Create the Sound Platform by Sonos' Global Product Lead
How to Create the Sound Platform by Sonos' Global Product LeadHow to Create the Sound Platform by Sonos' Global Product Lead
How to Create the Sound Platform by Sonos' Global Product Lead
 
Doing a GAP Analysis Before Choosing a New ERP
Doing a GAP Analysis Before Choosing a New ERPDoing a GAP Analysis Before Choosing a New ERP
Doing a GAP Analysis Before Choosing a New ERP
 
Product owner and anti patterns
Product owner and anti patternsProduct owner and anti patterns
Product owner and anti patterns
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation Methodology
 
Implementation planning gcdp all tiers
Implementation planning gcdp all tiersImplementation planning gcdp all tiers
Implementation planning gcdp all tiers
 
From dysfunction to cross function in 8,593 easy steps- team building at the cbc
From dysfunction to cross function in 8,593 easy steps- team building at the cbcFrom dysfunction to cross function in 8,593 easy steps- team building at the cbc
From dysfunction to cross function in 8,593 easy steps- team building at the cbc
 
Odoo Experience 2018 - The Odoo Methodology
Odoo Experience 2018 - The Odoo MethodologyOdoo Experience 2018 - The Odoo Methodology
Odoo Experience 2018 - The Odoo Methodology
 
Perfect Wedding: Lean Startup and Agile
Perfect Wedding: Lean Startup and AgilePerfect Wedding: Lean Startup and Agile
Perfect Wedding: Lean Startup and Agile
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
 
Product Goals in Scrum
Product Goals in ScrumProduct Goals in Scrum
Product Goals in Scrum
 
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
Building Agility Brick by Brick : A report on how Agile imbibed successfully ...
 
Practical Project Collaboration for Product Owners and Scrum Teams
Practical Project Collaboration for Product Owners and Scrum TeamsPractical Project Collaboration for Product Owners and Scrum Teams
Practical Project Collaboration for Product Owners and Scrum Teams
 
Methodology: agile@scale what is a 'PI Zero'
Methodology: agile@scale what is a 'PI Zero'Methodology: agile@scale what is a 'PI Zero'
Methodology: agile@scale what is a 'PI Zero'
 
The Engineer Webcast: Five Ways to Get More Engineering Time Out of Your Eng...
The Engineer Webcast:  Five Ways to Get More Engineering Time Out of Your Eng...The Engineer Webcast:  Five Ways to Get More Engineering Time Out of Your Eng...
The Engineer Webcast: Five Ways to Get More Engineering Time Out of Your Eng...
 
Week 02
Week 02Week 02
Week 02
 
Project Management: from Stone Age to DevOps - High Load Strategy 2016
Project Management: from Stone Age to DevOps - High Load Strategy 2016Project Management: from Stone Age to DevOps - High Load Strategy 2016
Project Management: from Stone Age to DevOps - High Load Strategy 2016
 

More from GameCamp

Practical approach to creative testing and creative optimisation at Google UA...
Practical approach to creative testing and creative optimisation at Google UA...Practical approach to creative testing and creative optimisation at Google UA...
Practical approach to creative testing and creative optimisation at Google UA...
GameCamp
 
Creativity and science behind creative testing. creative testing framework an...
Creativity and science behind creative testing. creative testing framework an...Creativity and science behind creative testing. creative testing framework an...
Creativity and science behind creative testing. creative testing framework an...
GameCamp
 
How to boost your ASO with data analytics?
How to boost your ASO with data analytics?How to boost your ASO with data analytics?
How to boost your ASO with data analytics?
GameCamp
 
8 Types of mobile game and app creatives you should try
8 Types of mobile game and app creatives you should try8 Types of mobile game and app creatives you should try
8 Types of mobile game and app creatives you should try
GameCamp
 
Building the BI system and analytics capabilities at the company based on Rea...
Building the BI system and analytics capabilities at the company based on Rea...Building the BI system and analytics capabilities at the company based on Rea...
Building the BI system and analytics capabilities at the company based on Rea...
GameCamp
 
Developing an effective LTV model at the soft launch and keeping it valid fur...
Developing an effective LTV model at the soft launch and keeping it valid fur...Developing an effective LTV model at the soft launch and keeping it valid fur...
Developing an effective LTV model at the soft launch and keeping it valid fur...
GameCamp
 
Ad-hoc tasks in the Data Scientist team based on Outfit7 example
Ad-hoc tasks in the Data Scientist team based on Outfit7 exampleAd-hoc tasks in the Data Scientist team based on Outfit7 example
Ad-hoc tasks in the Data Scientist team based on Outfit7 example
GameCamp
 
Driving profitability of Google App Campaigns in scale. What is easy, what is...
Driving profitability of Google App Campaigns in scale. What is easy, what is...Driving profitability of Google App Campaigns in scale. What is easy, what is...
Driving profitability of Google App Campaigns in scale. What is easy, what is...
GameCamp
 
Scaling UA activity - the challenges of growth
 Scaling UA activity - the challenges of growth Scaling UA activity - the challenges of growth
Scaling UA activity - the challenges of growth
GameCamp
 
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
GameCamp
 
Growth trends in mobile gaming based on the data
Growth trends in mobile gaming based on the dataGrowth trends in mobile gaming based on the data
Growth trends in mobile gaming based on the data
GameCamp
 
Facebook's and Social Creative Best Practice that worked for Huuuge
Facebook's and Social Creative Best Practice that worked for HuuugeFacebook's and Social Creative Best Practice that worked for Huuuge
Facebook's and Social Creative Best Practice that worked for Huuuge
GameCamp
 
Using Data Science for Behavioural Game Design
Using Data Science for Behavioural Game DesignUsing Data Science for Behavioural Game Design
Using Data Science for Behavioural Game Design
GameCamp
 
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
GameCamp
 
In-app offers monetization from basics to advanced technics based on Crazy Pa...
In-app offers monetization from basics to advanced technics based on Crazy Pa...In-app offers monetization from basics to advanced technics based on Crazy Pa...
In-app offers monetization from basics to advanced technics based on Crazy Pa...
GameCamp
 
Building cost-effective mobile product & marketing app analytics based on GCP...
Building cost-effective mobile product & marketing app analytics based on GCP...Building cost-effective mobile product & marketing app analytics based on GCP...
Building cost-effective mobile product & marketing app analytics based on GCP...
GameCamp
 
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
GameCamp
 
Data behind UA
Data behind UA Data behind UA
Data behind UA
GameCamp
 
Enabling the growth of the game through performance marketing in 2020
Enabling the growth of the game through performance marketing in 2020Enabling the growth of the game through performance marketing in 2020
Enabling the growth of the game through performance marketing in 2020
GameCamp
 
User Acquisition focused on LTV on steroids
User Acquisition focused on LTV on steroidsUser Acquisition focused on LTV on steroids
User Acquisition focused on LTV on steroids
GameCamp
 

More from GameCamp (20)

Practical approach to creative testing and creative optimisation at Google UA...
Practical approach to creative testing and creative optimisation at Google UA...Practical approach to creative testing and creative optimisation at Google UA...
Practical approach to creative testing and creative optimisation at Google UA...
 
Creativity and science behind creative testing. creative testing framework an...
Creativity and science behind creative testing. creative testing framework an...Creativity and science behind creative testing. creative testing framework an...
Creativity and science behind creative testing. creative testing framework an...
 
How to boost your ASO with data analytics?
How to boost your ASO with data analytics?How to boost your ASO with data analytics?
How to boost your ASO with data analytics?
 
8 Types of mobile game and app creatives you should try
8 Types of mobile game and app creatives you should try8 Types of mobile game and app creatives you should try
8 Types of mobile game and app creatives you should try
 
Building the BI system and analytics capabilities at the company based on Rea...
Building the BI system and analytics capabilities at the company based on Rea...Building the BI system and analytics capabilities at the company based on Rea...
Building the BI system and analytics capabilities at the company based on Rea...
 
Developing an effective LTV model at the soft launch and keeping it valid fur...
Developing an effective LTV model at the soft launch and keeping it valid fur...Developing an effective LTV model at the soft launch and keeping it valid fur...
Developing an effective LTV model at the soft launch and keeping it valid fur...
 
Ad-hoc tasks in the Data Scientist team based on Outfit7 example
Ad-hoc tasks in the Data Scientist team based on Outfit7 exampleAd-hoc tasks in the Data Scientist team based on Outfit7 example
Ad-hoc tasks in the Data Scientist team based on Outfit7 example
 
Driving profitability of Google App Campaigns in scale. What is easy, what is...
Driving profitability of Google App Campaigns in scale. What is easy, what is...Driving profitability of Google App Campaigns in scale. What is easy, what is...
Driving profitability of Google App Campaigns in scale. What is easy, what is...
 
Scaling UA activity - the challenges of growth
 Scaling UA activity - the challenges of growth Scaling UA activity - the challenges of growth
Scaling UA activity - the challenges of growth
 
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
Growth Strategies: Lower Your CPI by Implementing ASO into UA Workflow.
 
Growth trends in mobile gaming based on the data
Growth trends in mobile gaming based on the dataGrowth trends in mobile gaming based on the data
Growth trends in mobile gaming based on the data
 
Facebook's and Social Creative Best Practice that worked for Huuuge
Facebook's and Social Creative Best Practice that worked for HuuugeFacebook's and Social Creative Best Practice that worked for Huuuge
Facebook's and Social Creative Best Practice that worked for Huuuge
 
Using Data Science for Behavioural Game Design
Using Data Science for Behavioural Game DesignUsing Data Science for Behavioural Game Design
Using Data Science for Behavioural Game Design
 
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
Learnings and insights from Benchmarks+. Performance Insights for 1.2bn Month...
 
In-app offers monetization from basics to advanced technics based on Crazy Pa...
In-app offers monetization from basics to advanced technics based on Crazy Pa...In-app offers monetization from basics to advanced technics based on Crazy Pa...
In-app offers monetization from basics to advanced technics based on Crazy Pa...
 
Building cost-effective mobile product & marketing app analytics based on GCP...
Building cost-effective mobile product & marketing app analytics based on GCP...Building cost-effective mobile product & marketing app analytics based on GCP...
Building cost-effective mobile product & marketing app analytics based on GCP...
 
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
How ASO Has Changed in 2019 and What’s Next. Our experience in creatives and ...
 
Data behind UA
Data behind UA Data behind UA
Data behind UA
 
Enabling the growth of the game through performance marketing in 2020
Enabling the growth of the game through performance marketing in 2020Enabling the growth of the game through performance marketing in 2020
Enabling the growth of the game through performance marketing in 2020
 
User Acquisition focused on LTV on steroids
User Acquisition focused on LTV on steroidsUser Acquisition focused on LTV on steroids
User Acquisition focused on LTV on steroids
 

A/B testing in Firebase based on Peaksel examples