You have NO Ideawhat your users want         And how to learn   Evan Solomon | Automattic        @evansolomon
if( time() % 2 )! $title = ‘Split testing’;else! $title = ‘A/B testing’;setcookie( ‘title’, $title );echo $title;
A/B testing1.Try different things2.Measure their effects3.Profit!      Lots of good examples at blog.performable.com
What can it do?Determine how likely one version   is to be better than another. If you have enough data you can tell how m...
Why do it?It makes you  smart(er)! Also turns out to be good for getting clients
Start basic1.Talk to your customers2.Listen3.Profit!             Step 3 is always profit
DashboardCheck out geckoboard.com
Running testsWe use Optimizely because:1.Real time results (great for debugging)2.Tests are written entirely in jQuery3.Ea...
Version A
Version B
What happens?   B wins andcovers the spread     Signups increase ~25%
Handling data  Terms you should get used to:           “Confidence interval”            “Significance test”Check out isvalid...
isvalid.org
Keep in mind•   Question assumptions•   Unintended (or not) biases•   Test liberally, it’s nearly free•   Many (most) test...
Call for helpI’m working on a .org plugin     Based on the one we made for WordPress.com
@evansolomon
Upcoming SlideShare
Loading in...5
×

You have no idea what your users want - WordCamp PDX

3,760
-1

Published on

Slides from my talk at WordCamp Portland. It's been cleaned up to look nicer than than it did when I gave the talk.

Published in: Technology, Business
1 Comment
3 Likes
Statistics
Notes
No Downloads
Views
Total Views
3,760
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
32
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • You have no idea what your users want - WordCamp PDX

    1. You have NO Ideawhat your users want And how to learn Evan Solomon | Automattic @evansolomon
    2. if( time() % 2 )! $title = ‘Split testing’;else! $title = ‘A/B testing’;setcookie( ‘title’, $title );echo $title;
    3. A/B testing1.Try different things2.Measure their effects3.Profit! Lots of good examples at blog.performable.com
    4. What can it do?Determine how likely one version is to be better than another. If you have enough data you can tell how much better, but you need quite a bit
    5. Why do it?It makes you smart(er)! Also turns out to be good for getting clients
    6. Start basic1.Talk to your customers2.Listen3.Profit! Step 3 is always profit
    7. DashboardCheck out geckoboard.com
    8. Running testsWe use Optimizely because:1.Real time results (great for debugging)2.Tests are written entirely in jQuery3.Easy to target using WordPress logic
    9. Version A
    10. Version B
    11. What happens? B wins andcovers the spread Signups increase ~25%
    12. Handling data Terms you should get used to: “Confidence interval” “Significance test”Check out isvalid.org to calculate these stats I made isvalid for myself so it’s a little rough, but very useful
    13. isvalid.org
    14. Keep in mind• Question assumptions• Unintended (or not) biases• Test liberally, it’s nearly free• Many (most) tests “fail”
    15. Call for helpI’m working on a .org plugin Based on the one we made for WordPress.com
    16. @evansolomon
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×