Your SlideShare is downloading. ×
0
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9

5,085

Published on

'django-lean' is an open source a/b split-test experimentation framework for Django. …

'django-lean' is an open source a/b split-test experimentation framework for Django.

'django-lean' was created by Akoha, a Montreal-based startup building the world's first social reality game.

This presentation was delivered on September 30th, 2009 at Montreal Python 9, by Erik Wright, Director of Engineering for Akoha.

For further details visit:

http://bitbucket.org/akoha/django-lean/
http://akoha.com
http://twitter.com/erikwright

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
5,085
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
7
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Erik Wright, Dir. Eng @ AkohaHere to present django-leanAkoha’s recently open-sourced split-testing framework for Django
  • A tool for measuring differences between alternative implementations* font sizes, texts, prices, images, and so on.Recently, use for measuring effectiveness of new features and enhancements is gainingSimultaneously run both implementations,randomly assign users to one or the other, compare performance
  • Rarely confident of the impact our changes will have on users / customersEven when confident, sometimes we are dead wrongSplit testing reduces the risk of wrong decisions / find, correct, and learn from mistakes quickly.
  • Trivially implement split-test experiments in Javascript, Django Templates, PythonMeasures user performance according to metrics you defineGenerates and publishes nightly reports of experiment resultsIncluding calculating statistical significance so that you know when you can stop testingThanks to django-admin, starting, stopping, and promoting tests is easy
  • Now that I’ve told you what django-lean can do, allow me to show you
  • Transcript

    • 1. django-lean
      An open-source framework for performing and analyzing a/b split-test experiments in Django
    • 2. 60 sec. intro to split testing
    • 3. What is split testing?
      A technique for comparing two alternative implementations
      Done properly, allows you to eliminate other variables
      For the gory details, seehttp://elem.com/~btilly/effective-ab-testing/
    • 4. Why do people split test?
      Improve conversion, ARPU, or other key metrics systematically
      Eliminate guesswork and opinions
      Determine, scientifically, which implementation is best
      Test your hypotheses
    • 5. Introducing django-lean
    • 6. django-lean
      Experiment
      JavaScript
      Django templates
      Python
      Measure
      User-defined goals
      User-defined metric
      Analyze
      Manage
      • Nightly reports
      • 7. Statistical significance
      • 8. Start, stop, and promote experiments via django-admin
    • Examples
    • 9. Python
    • 10. Django template
    • 11. JavaScript
      In your HTML template:
      In your JavaScript:
    • 12. Reports
    • 13. future
    • 14. Wishlist
      Experimentation improvements
      Multivariate testing
      Arbitrary numbers of test cases
      Tools for automated (integration, unit, ...) testing
      Support more test scenarios
      Conversion funnels
      Decoupling from Django
      More “Lean Startup” tools
      Cohort analysis
      In-site surveys (net promoter score, etc.)
    • 15. Find out more:
      http://bitbucket.org/akoha/django-lean/
      http://akoha.com
      erik@erikwright.com / @erikwright

    ×