A/B Testing
with

&
What is A/B Testing?
A/B testing allows you to test two or more versions of a webpage
to determine which changes produce the desired results.
The country's largest not-for-profit for
young people and social change.
“Dee” - DeeZone (288060) & Peter - pleher (2257350...
A/B in Action...
with

&
Original
A) Spotted (Sad)
B) Fence (Jail)
Golden (Super Cute)
Golden2 (Super Cute v2)
Puppy Results

Peak Results after “Tweek”
“Golden2”
“Golden”
Data
“Normalization”
Introduction of
alternative “Golden”
Base
v1
Cell (optional)
v2
Placeholder Text
+ Cell (optional)
v3
“Submit”
v4
“See the Pets”
The Results
Peak Results
“Cell Optional”
“Cell Optional
+ Text”
Data
“Normalization”
Sample Size? Confidence level?

Forget...
Under the Hood
optimizely.com
Projects
Experiment
Admin
Experiment
Project Code - “Snippet”
JS File Size
42.1kb

251425352

JS Call to
enable project
on web page.
“Project Code”
Optimizely 7.x-2.10 Module
Admin Settings
Account Info

251425352

The account Number and the
initial Project Code are the same
Project Listing

Ajax
Enable / Disable

Path conflict “ ”

*

Project Code
251425352
Add Project

/admin/config/system/optimizely/add_update

“Project Code”
number from
Optimizely website
251425352
Update Project

/admin/config/system/optimizely/add_update/2

Each path must be
- unique between
projects
- a valid path on...
Cache Refresh
CDN Call

CDN: content delivery network
Bang! for your Buck $$$

= Actions
Fake Doors / Smoke Sceens
Interest?
Project Page
drupal.org/project/opimizely
Experiment listing in Projects
Filter by User Roles for each Exeriment
Filter by user location - city, state, country
Buck...
Up next...

Drulenium - Testing made easy
Tech Nikh
A/B Testing and Optimizely Module
Upcoming SlideShare
Loading in …5
×

A/B Testing and Optimizely Module

1,773 views

Published on

Use A/B testing to monitor the impact of changes of web page elements that lead to more downloads, user contributed content, increased revenues, or whatever result you want to achieve. A/B testing involves testing two versions of a website - an A version (the control) and a B version (the variation) - with live traffic and measuring the effect each version has on your conversion rate.

Results of A/B tests are used to make informed decisions about how to structure and present content on a site. There is no longer a need to guess what the site's user response is to changes, simply test and look at the trends in the data.

The power and ease of use of the Optimizely framework is further enhanced using the Optimizely Drupal module. We will discuss the current and future integration of A/B testing with Drupal and Optimizely using the Optimizely Drupal module in detail. The presentation will end with a discussion of what future integration of Optimizely with Drupal is desired to further leverage the partnership.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

A/B Testing and Optimizely Module

  1. 1. A/B Testing with &
  2. 2. What is A/B Testing?
  3. 3. A/B testing allows you to test two or more versions of a webpage to determine which changes produce the desired results.
  4. 4. The country's largest not-for-profit for young people and social change. “Dee” - DeeZone (288060) & Peter - pleher (2257350)
  5. 5. A/B in Action... with &
  6. 6. Original
  7. 7. A) Spotted (Sad)
  8. 8. B) Fence (Jail)
  9. 9. Golden (Super Cute)
  10. 10. Golden2 (Super Cute v2)
  11. 11. Puppy Results Peak Results after “Tweek” “Golden2” “Golden” Data “Normalization” Introduction of alternative “Golden”
  12. 12. Base
  13. 13. v1 Cell (optional)
  14. 14. v2 Placeholder Text + Cell (optional)
  15. 15. v3 “Submit”
  16. 16. v4 “See the Pets”
  17. 17. The Results Peak Results “Cell Optional” “Cell Optional + Text” Data “Normalization” Sample Size? Confidence level? Forget: “See the Pets” “Submit”
  18. 18. Under the Hood
  19. 19. optimizely.com
  20. 20. Projects Experiment Admin Experiment
  21. 21. Project Code - “Snippet” JS File Size 42.1kb 251425352 JS Call to enable project on web page. “Project Code”
  22. 22. Optimizely 7.x-2.10 Module
  23. 23. Admin Settings Account Info 251425352 The account Number and the initial Project Code are the same
  24. 24. Project Listing Ajax Enable / Disable Path conflict “ ” * Project Code 251425352
  25. 25. Add Project /admin/config/system/optimizely/add_update “Project Code” number from Optimizely website 251425352
  26. 26. Update Project /admin/config/system/optimizely/add_update/2 Each path must be - unique between projects - a valid path on the site
  27. 27. Cache Refresh
  28. 28. CDN Call CDN: content delivery network
  29. 29. Bang! for your Buck $$$ = Actions
  30. 30. Fake Doors / Smoke Sceens
  31. 31. Interest?
  32. 32. Project Page drupal.org/project/opimizely
  33. 33. Experiment listing in Projects Filter by User Roles for each Exeriment Filter by user location - city, state, country Bucket user into different experiments on repeat visits to experiments (cookie) ???
  34. 34. Up next... Drulenium - Testing made easy Tech Nikh

×