+ Follow

django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9

by Erik Wright

6,253 views

'django-lean' is an open source a/b split-test experimentation framework for Django. ...

'django-lean' is an open source a/b split-test experimentation framework for Django.

'django-lean' was created by Akoha, a Montreal-based startup building the world's first social reality game.

This presentation was delivered on September 30th, 2009 at Montreal Python 9, by Erik Wright, Director of Engineering for Akoha.

For further details visit:

http://bitbucket.org/akoha/django-lean/
http://akoha.com
http://twitter.com/erikwright

Accessibility

View text version

Upload Details

Uploaded via SlideShare as Microsoft PowerPoint

Usage Rights

File a copyright complaint

1 Embed 24

http://www.slideshare.net

Statistics

Likes: 7
Downloads: 0
Comments: 0
Embed Views: 24
Views on SlideShare: 6,229
Total Views: 6,253

django-lean, Akoha’s open-source a/b experimentation framework @ Montreal Python 9 Presentation Transcript

django-lean
An open-source framework for performing and analyzing a/b split-test experiments in Django

60 sec. intro to split testing

What is split testing?
A technique for comparing two alternative implementations
Done properly, allows you to eliminate other variables
For the gory details, seehttp://elem.com/~btilly/effective-ab-testing/

Why do people split test?
Improve conversion, ARPU, or other key metrics systematically
Eliminate guesswork and opinions
Determine, scientifically, which implementation is best
Test your hypotheses

Introducing django-lean

django-lean
Experiment
JavaScript
Django templates
Python
Measure
User-defined goals
User-defined metric
Analyze
Manage

Nightly reports
Statistical significance
Start, stop, and promote experiments via django-admin

Examples

Python

Django template

JavaScript
In your HTML template:
In your JavaScript:

Reports

future

Wishlist
Experimentation improvements
Multivariate testing
Arbitrary numbers of test cases
Tools for automated (integration, unit, ...) testing
Support more test scenarios
Conversion funnels
Decoupling from Django
More “Lean Startup” tools
Cohort analysis
In-site surveys (net promoter score, etc.)

Find out more:
http://bitbucket.org/akoha/django-lean/
http://akoha.com
erik@erikwright.com / @erikwright