django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9

by Erik Wright on Oct 01, 2009

5,159 views

'django-lean' is an open source a/b split-test experimentation framework for Django. ...

'django-lean' is an open source a/b split-test experimentation framework for Django.

'django-lean' was created by Akoha, a Montreal-based startup building the world's first social reality game.

This presentation was delivered on September 30th, 2009 at Montreal Python 9, by Erik Wright, Director of Engineering for Akoha.

For further details visit:

http://bitbucket.org/akoha/django-lean/
http://akoha.com
http://twitter.com/erikwright

Less

1 Embed 24

http://www.slideshare.net

Statistics

Favorites: 4
Downloads: 0
Comments: 0
Embed Views: 24
Views on SlideShare: 5,135
Total Views: 5,159

django-lean, Akoha’s open-source a/b experimentation framework @ Montreal Python 9 — Presentation Transcript

django-lean
An open-source framework for performing and analyzing a/b split-test experiments in Django

60 sec. intro to split testing

What is split testing?
A technique for comparing two alternative implementations
Done properly, allows you to eliminate other variables
For the gory details, seehttp://elem.com/~btilly/effective-ab-testing/

Why do people split test?
Improve conversion, ARPU, or other key metrics systematically
Eliminate guesswork and opinions
Determine, scientifically, which implementation is best
Test your hypotheses

Introducing django-lean

django-lean
Experiment
JavaScript
Django templates
Python
Measure
User-defined goals
User-defined metric
Analyze
Manage

Nightly reports
Statistical significance
Start, stop, and promote experiments via django-admin

Examples

Python

Django template

JavaScript
In your HTML template:
In your JavaScript:

Reports

future

Wishlist
Experimentation improvements
Multivariate testing
Arbitrary numbers of test cases
Tools for automated (integration, unit, ...) testing
Support more test scenarios
Conversion funnels
Decoupling from Django
More “Lean Startup” tools
Cohort analysis
In-site surveys (net promoter score, etc.)

Find out more:
http://bitbucket.org/akoha/django-lean/
http://akoha.com
erik@erikwright.com / @erikwright

django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9

by Erik Wright on Oct 01, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 24

Statistics

django-lean, Akoha’s open-source a/b experimentation framework @ Montreal Python 9 — Presentation Transcript