You have no idea what your users want - WordCamp PDX

You have NO Ideawhat your users want And how to learn Evan Solomon | Automattic @evansolomon

if( time() % 2 )! $title = ‘Split testing’;else! $title = ‘A/B testing’;setcookie( ‘title’, $title );echo $title;

A/B testing1.Try different things2.Measure their effects3.Proﬁt! Lots of good examples at blog.performable.com

What can it do?Determine how likely one version is to be better than another. If you have enough data you can tell how much better, but you need quite a bit

Why do it?It makes you smart(er)! Also turns out to be good for getting clients

Start basic1.Talk to your customers2.Listen3.Proﬁt! Step 3 is always proﬁt

DashboardCheck out geckoboard.com

Running testsWe use Optimizely because:1.Real time results (great for debugging)2.Tests are written entirely in jQuery3.Easy to target using WordPress logic

Version A

Version B

What happens? B wins andcovers the spread Signups increase ~25%

Handling data Terms you should get used to: “Conﬁdence interval” “Signiﬁcance test”Check out isvalid.org to calculate these stats I made isvalid for myself so it’s a little rough, but very useful

isvalid.org

Keep in mind• Question assumptions• Unintended (or not) biases• Test liberally, it’s nearly free• Many (most) tests “fail”

Call for helpI’m working on a .org plugin Based on the one we made for WordPress.com

@evansolomon

http://paper.li	70
http://evanalyze.com	13
http://evan.local	12
http://lanyrd.com	4
http://us-w1.rockmelt.com	3
http://www.onlydoo.com	2
http://twitter.com	2

You have no idea what your users want - WordCamp PDX

by Evan Solomon on Sep 17, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

7 Embeds 106

Statistics

You have no idea what your users want - WordCamp PDX — Presentation Transcript