Experiment design primer

2,281 views
2,221 views

Published on

A short primer on experiment design. It's need more elaboration and a concise connection with the build - measure - learn loop. Read more in my blogpost: http://blog.firmhouse.com/a-short-primer-on-experiment-design-for-lean-startups

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,281
On SlideShare
0
From Embeds
0
Number of Embeds
1,616
Actions
Shares
0
Downloads
23
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Experiment design primer

    1. 1. experiment designprimer on running experiments
    2. 2. experiments rock!why run experiments?how to design an experiment?types of experiments
    3. 3. why run experiments?stop wasting your time and moneytest your product and vision with real peopleenjoy people critizing your hard work
    4. 4. decide what to testwhat is the most riskiest assumption today?break down your riskiest assumptionset the minimum success criteria for the testdo this BEFORE the experiment
    5. 5. reverse the BML looplearn - measure - buildlearn: what do we want to learnmeasure: how are we going to measure thisbuild: what do we need to build to get data
    6. 6. run in small batchesfinding people to test might be harddon’t wait long with launching your experimentimprove after the first small batches
    7. 7. experiment tipsgo for big differences & variablestest only one thing per experimenthave multiple experiments running
    8. 8. stages of a startupproblem / solution fitproduct / market fitscale
    9. 9. problem / solution fityou are looking for signalsget out of the buildingmeet your customersexpose yourself
    10. 10. product / market fitprove your business modelwould customers be disappointed if you takethe MVP away?Set a treshold above 40% postive responses
    11. 11. scaleit’s about learning how to grow you startupyou have data to identify your starting pointloads of options on experimentinggrowth hacking

    ×