SlideShare a Scribd company logo
Irrational Labs
Online Course
Experiment Template
What are the barriers preventing
people from doing the key behavior
that you want them to do?
Identify
Behavioral
Barriers
1. There is tailwind barrier: There is still not enough confidence in the
product to make a top-up of more than €50.
2. Headwind barrier. Going through the KYC process can sometimes be
tedious and can catch you at a bad time.
The reason people are not
currently partaking in
is because they
KEY
BEHAVIOR
BEHAVIORAL
BARRIER (OR LACK OF
BENEFIT)
Identify
Behavioral
Barriers
Doing their first top-up with 50€ so they have money to
spend
Still doesn't have enough confidence in our product.
Identify
BE
Principles
Using BE principles, what are some
ways that you can remove this
barrier and/or add benefits?
By showing what other clients are topping-up the account on their first time we can
encourage it. (Explicit Social Norm)
By choosing by default the option to top-up the account as the first activity we
could improve the confidence. (Default Bias)
By telling people that they need to top-up the account on the first 30 days of usage
or they will lose their personalised card (aversion loss)
By using
we can increase the number
of people who
B.E.
PRINCIPLE
KEY
BEHAVIOR
Explicit Social Norm
Makes their first top-up above 50€ after the on-boarding
Identify
BE
Principles
Create
Test
Conditions
Design your test below.
Start with two conditions:
CONTROL TEST
The control group will see a pop-up
asking to make a top-up right after the
onboarding with the following.
“Top-up your account now and start
using your new card
Button: Top-up your account now”
The test group will see a pop-up asking to
make a top-up right after the onboarding
with the following.
Top-up you account right now and join
more than 300K smart customers”
Button: Top-up your account now”
Select
Participants
How many participants in
each condition?
Each condition should have the same number of participants.*
*This assumes equal funnel rates
The pop-up message will be shown to 1000 recent registered users. Users to
be randomly selected into Control vs. Test conditions (500 per condition)
[So what, now what?
If you have results, what did you learn? Tip: even null results are a finding. What are
next steps?
If you were to run it again, what would you do differently?
If you haven’t run it yet - this is your closing opportunity to pitch this experiment/
get it approved by your company
Again, go light on text on this slide, just tell the story]
Discussion
Discussion

More Related Content

Similar to Experiment Deck.pdf

Designing work
Designing workDesigning work
Designing work
farzanashoma
 
Tlc compensation Plan 2014
Tlc compensation Plan 2014Tlc compensation Plan 2014
Tlc compensation Plan 2014
Sabrina Dix
 
Business Plan-Powerpoint Presentation
Business Plan-Powerpoint PresentationBusiness Plan-Powerpoint Presentation
Business Plan-Powerpoint Presentation
Himanshu Kumar
 
ENTREPRENEURSHIP_PRESENTATION[1].pdf
ENTREPRENEURSHIP_PRESENTATION[1].pdfENTREPRENEURSHIP_PRESENTATION[1].pdf
ENTREPRENEURSHIP_PRESENTATION[1].pdf
MUHUMUZAONAN1
 
WAFIC E-Marketing
WAFIC E-MarketingWAFIC E-Marketing
WAFIC E-Marketing
Justin Tamsett
 
Tlc compensation plan-2
Tlc compensation plan-2Tlc compensation plan-2
Tlc compensation plan-2
정오 이
 
Managing payment posting in eclinicalworks
Managing payment posting in eclinicalworksManaging payment posting in eclinicalworks
Managing payment posting in eclinicalworks
PracticeBridge
 
Acc 375 entire course
Acc 375 entire courseAcc 375 entire course
Acc 375 entire course
LeonaThomas54
 
Saas trial pricing playbook chargebee
Saas trial pricing playbook   chargebeeSaas trial pricing playbook   chargebee
Saas trial pricing playbook chargebee
Doron Dinovitzer
 
Idea to Success, a Guide for First Time Entrepreneurs
Idea to Success, a Guide for First Time EntrepreneursIdea to Success, a Guide for First Time Entrepreneurs
Idea to Success, a Guide for First Time Entrepreneurs
Gaurav Oberoi
 
Solid goldline compensation plan gold
Solid goldline compensation plan goldSolid goldline compensation plan gold
Solid goldline compensation plan goldKenneth Lim
 
Analytical Research Report (2)
Analytical Research Report (2)Analytical Research Report (2)
Analytical Research Report (2)Zachary Benoff
 
Collecting Accounts Receivable
Collecting Accounts ReceivableCollecting Accounts Receivable
Collecting Accounts Receivable
Lean Teams
 
Inbox Blueprint Member's Area Walkthrough and Review
Inbox Blueprint Member's Area Walkthrough and ReviewInbox Blueprint Member's Area Walkthrough and Review
Inbox Blueprint Member's Area Walkthrough and Review
Truly Rich Club Blog
 
How To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
How To Make Money Fast 2014 -How To Make $1,000 Fast And EasyHow To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
How To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
Adam Hung
 
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online  How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
Adam Hung
 
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
Bùi Hùng
 
How To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
How To Make A Lot Of Money Fast -Ways To Make $300,000 A MonthHow To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
How To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
Adam Hung
 
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A MonthBinary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
Bùi Hùng
 
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning StrategyBest Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
Bùi Hùng
 

Similar to Experiment Deck.pdf (20)

Designing work
Designing workDesigning work
Designing work
 
Tlc compensation Plan 2014
Tlc compensation Plan 2014Tlc compensation Plan 2014
Tlc compensation Plan 2014
 
Business Plan-Powerpoint Presentation
Business Plan-Powerpoint PresentationBusiness Plan-Powerpoint Presentation
Business Plan-Powerpoint Presentation
 
ENTREPRENEURSHIP_PRESENTATION[1].pdf
ENTREPRENEURSHIP_PRESENTATION[1].pdfENTREPRENEURSHIP_PRESENTATION[1].pdf
ENTREPRENEURSHIP_PRESENTATION[1].pdf
 
WAFIC E-Marketing
WAFIC E-MarketingWAFIC E-Marketing
WAFIC E-Marketing
 
Tlc compensation plan-2
Tlc compensation plan-2Tlc compensation plan-2
Tlc compensation plan-2
 
Managing payment posting in eclinicalworks
Managing payment posting in eclinicalworksManaging payment posting in eclinicalworks
Managing payment posting in eclinicalworks
 
Acc 375 entire course
Acc 375 entire courseAcc 375 entire course
Acc 375 entire course
 
Saas trial pricing playbook chargebee
Saas trial pricing playbook   chargebeeSaas trial pricing playbook   chargebee
Saas trial pricing playbook chargebee
 
Idea to Success, a Guide for First Time Entrepreneurs
Idea to Success, a Guide for First Time EntrepreneursIdea to Success, a Guide for First Time Entrepreneurs
Idea to Success, a Guide for First Time Entrepreneurs
 
Solid goldline compensation plan gold
Solid goldline compensation plan goldSolid goldline compensation plan gold
Solid goldline compensation plan gold
 
Analytical Research Report (2)
Analytical Research Report (2)Analytical Research Report (2)
Analytical Research Report (2)
 
Collecting Accounts Receivable
Collecting Accounts ReceivableCollecting Accounts Receivable
Collecting Accounts Receivable
 
Inbox Blueprint Member's Area Walkthrough and Review
Inbox Blueprint Member's Area Walkthrough and ReviewInbox Blueprint Member's Area Walkthrough and Review
Inbox Blueprint Member's Area Walkthrough and Review
 
How To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
How To Make Money Fast 2014 -How To Make $1,000 Fast And EasyHow To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
How To Make Money Fast 2014 -How To Make $1,000 Fast And Easy
 
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online  How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
How To Make Money Online 2014 - Best Ways To Make $300,000 Money Online
 
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
How To Make Money For Kids -Ways To Make $5,000 A Month For Kids 2014
 
How To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
How To Make A Lot Of Money Fast -Ways To Make $300,000 A MonthHow To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
How To Make A Lot Of Money Fast -Ways To Make $300,000 A Month
 
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A MonthBinary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
Binary Options Trading Signals Win 2014 - Look How I make Money $10,000 A Month
 
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning StrategyBest Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
Best Binary Options Trading 2014 - 15 Tips And Facts For A Winning Strategy
 

Recently uploaded

general properties of oerganologametal.ppt
general properties of oerganologametal.pptgeneral properties of oerganologametal.ppt
general properties of oerganologametal.ppt
IqrimaNabilatulhusni
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
Richard Gill
 
BLOOD AND BLOOD COMPONENT- introduction to blood physiology
BLOOD AND BLOOD COMPONENT- introduction to blood physiologyBLOOD AND BLOOD COMPONENT- introduction to blood physiology
BLOOD AND BLOOD COMPONENT- introduction to blood physiology
NoelManyise1
 
Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
muralinath2
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
sanjana502982
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
Nistarini College, Purulia (W.B) India
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
University of Rennes, INSA Rennes, Inria/IRISA, CNRS
 
S.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary levelS.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary level
ronaldlakony0
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
ChetanK57
 
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Studia Poinsotiana
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
University of Maribor
 
GBSN - Microbiology (Lab 4) Culture Media
GBSN - Microbiology (Lab 4) Culture MediaGBSN - Microbiology (Lab 4) Culture Media
GBSN - Microbiology (Lab 4) Culture Media
Areesha Ahmad
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
AlaminAfendy1
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
zeex60
 
GBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram StainingGBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram Staining
Areesha Ahmad
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
frank0071
 

Recently uploaded (20)

general properties of oerganologametal.ppt
general properties of oerganologametal.pptgeneral properties of oerganologametal.ppt
general properties of oerganologametal.ppt
 
Richard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlandsRichard's aventures in two entangled wonderlands
Richard's aventures in two entangled wonderlands
 
BLOOD AND BLOOD COMPONENT- introduction to blood physiology
BLOOD AND BLOOD COMPONENT- introduction to blood physiologyBLOOD AND BLOOD COMPONENT- introduction to blood physiology
BLOOD AND BLOOD COMPONENT- introduction to blood physiology
 
Hemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptxHemostasis_importance& clinical significance.pptx
Hemostasis_importance& clinical significance.pptx
 
Toxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and ArsenicToxic effects of heavy metals : Lead and Arsenic
Toxic effects of heavy metals : Lead and Arsenic
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
 
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
 
S.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary levelS.1 chemistry scheme term 2 for ordinary level
S.1 chemistry scheme term 2 for ordinary level
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
 
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...
 
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
 
GBSN - Microbiology (Lab 4) Culture Media
GBSN - Microbiology (Lab 4) Culture MediaGBSN - Microbiology (Lab 4) Culture Media
GBSN - Microbiology (Lab 4) Culture Media
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
 
GBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram StainingGBSN- Microbiology (Lab 3) Gram Staining
GBSN- Microbiology (Lab 3) Gram Staining
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
 

Experiment Deck.pdf

  • 2. What are the barriers preventing people from doing the key behavior that you want them to do? Identify Behavioral Barriers 1. There is tailwind barrier: There is still not enough confidence in the product to make a top-up of more than €50. 2. Headwind barrier. Going through the KYC process can sometimes be tedious and can catch you at a bad time.
  • 3. The reason people are not currently partaking in is because they KEY BEHAVIOR BEHAVIORAL BARRIER (OR LACK OF BENEFIT) Identify Behavioral Barriers Doing their first top-up with 50€ so they have money to spend Still doesn't have enough confidence in our product.
  • 4. Identify BE Principles Using BE principles, what are some ways that you can remove this barrier and/or add benefits? By showing what other clients are topping-up the account on their first time we can encourage it. (Explicit Social Norm) By choosing by default the option to top-up the account as the first activity we could improve the confidence. (Default Bias) By telling people that they need to top-up the account on the first 30 days of usage or they will lose their personalised card (aversion loss)
  • 5. By using we can increase the number of people who B.E. PRINCIPLE KEY BEHAVIOR Explicit Social Norm Makes their first top-up above 50€ after the on-boarding Identify BE Principles
  • 6. Create Test Conditions Design your test below. Start with two conditions: CONTROL TEST The control group will see a pop-up asking to make a top-up right after the onboarding with the following. “Top-up your account now and start using your new card Button: Top-up your account now” The test group will see a pop-up asking to make a top-up right after the onboarding with the following. Top-up you account right now and join more than 300K smart customers” Button: Top-up your account now”
  • 7. Select Participants How many participants in each condition? Each condition should have the same number of participants.* *This assumes equal funnel rates The pop-up message will be shown to 1000 recent registered users. Users to be randomly selected into Control vs. Test conditions (500 per condition)
  • 8. [So what, now what? If you have results, what did you learn? Tip: even null results are a finding. What are next steps? If you were to run it again, what would you do differently? If you haven’t run it yet - this is your closing opportunity to pitch this experiment/ get it approved by your company Again, go light on text on this slide, just tell the story] Discussion Discussion