Presentation on user-focused testing and product development for the WordPress DC October 2011 meetup. Similar to my presentation from WordCamp Portland, but much better!

1. You don’t
know people
Evan Solomon | Automattic
@evansolomon

2. Try
Measure
Profit!

3. Pick one
At least until we have
lots of data

4. Rat pelts
& cobras

8. Previews
up 10%

9. http://theme.wordpress.com/themes/

10. Optimizely
Fast & Flexible

13. The (abridged) plugin
wp_enqueue_script('optimizely
', $this->url);
wp_localize_script(
'optimizely',
'wpcom_optimizely',
array( $experiment->slug =>
true )
);

14. gist.github
/1275892

15. The change
jQuery (".post-812")
.find("h2 > a")
.html("Nacin fights Koop");

16. The goal
jQuery(".post-812")
.find("h2 > a")
.live("mousedown",
function() {
window.optimizely.push(
["trackEvent", "a_click"]
);
});

17. The test
optimizely_experiment(
"nancin_coding_title',
array(
"action" => "init",
"logged_out_users" => true
) );

18. The browser
<script>
var wpcom_optimizely =
{"nacin_coding_title":true};
</script>
<script
src='http://
cdn.optimizely.com/js/
123.js?ver=1316379297'>
</script>

19. The target

20. isvalid.org
Confidence interval
Significance test

22. github
/evansolomon/isvalid.org

23. Question everything
&
Design for 0% failure

24. @evansolomon
http://slideshare.net/evansolomon/you-dont-know-people/