Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
I WAS AN EXCITED A/B TESTER
TWEET ME ——> @digital_tonic 
#CH2014
Hypothesise Design Test BOOM! 
#CH2014
#CH2014
window.myInterval = setInterval(function() { 
if ($("ul> li.dates.rounded-tr.active").length > 0) { 
$('#dates-prices').cs...
WHERE DID IT GO?!!!! 
#CH2014
#CH2014
STOP SCREWING UP YOUR TESTS 
HOW TO QA AN A/B TEST 
#CH2014
WHAT IS QA ? 
Quality Assurance is a way of preventing mistakes or defects 
when delivering solutions or services to custo...
#CH2014
#CH2014
#CH2014
CROSS BROWSER TESTING
#CH2014
Set your test cookie 
http://bit.ly/testcookieoptly 
#CH2014
TARGET YOUR TEST WITH THE TEST COOKIE
#CH2014
Go through the test yourself 
#CH2014
Is it loading without any flashing? 
Are the images rendering correctly 
Is there issues with the CSS? 
Are the goals firi...
Don’t forget to remove reset the test criteria 
#CH2014
Have you seen any test screw ups yourself? 
LETS SHARE!! 
#CH2014
How to QA an A/B test - Conversion Hotel, Netherlands
How to QA an A/B test - Conversion Hotel, Netherlands
How to QA an A/B test - Conversion Hotel, Netherlands
How to QA an A/B test - Conversion Hotel, Netherlands
How to QA an A/B test - Conversion Hotel, Netherlands
Upcoming SlideShare
Loading in …5
×

How to QA an A/B test - Conversion Hotel, Netherlands

Don't mess up your A/B test. Your results can be corrupted if you don't check do the necessary QA checks before hand. This presentation was done at Conversion Hotel in the Netherlands in November 2014 #CH2014

  • Be the first to comment

  • Be the first to like this

How to QA an A/B test - Conversion Hotel, Netherlands

  1. 1. I WAS AN EXCITED A/B TESTER
  2. 2. TWEET ME ——> @digital_tonic #CH2014
  3. 3. Hypothesise Design Test BOOM! #CH2014
  4. 4. #CH2014
  5. 5. window.myInterval = setInterval(function() { if ($("ul> li.dates.rounded-tr.active").length > 0) { $('#dates-prices').css("display","none"); $('#dates-prices-new').css("display","block"); } }, 50); #CH2014
  6. 6. WHERE DID IT GO?!!!! #CH2014
  7. 7. #CH2014
  8. 8. STOP SCREWING UP YOUR TESTS HOW TO QA AN A/B TEST #CH2014
  9. 9. WHAT IS QA ? Quality Assurance is a way of preventing mistakes or defects when delivering solutions or services to customers #CH2014
  10. 10. #CH2014
  11. 11. #CH2014
  12. 12. #CH2014
  13. 13. CROSS BROWSER TESTING
  14. 14. #CH2014
  15. 15. Set your test cookie http://bit.ly/testcookieoptly #CH2014
  16. 16. TARGET YOUR TEST WITH THE TEST COOKIE
  17. 17. #CH2014
  18. 18. Go through the test yourself #CH2014
  19. 19. Is it loading without any flashing? Are the images rendering correctly Is there issues with the CSS? Are the goals firing? #CH2014
  20. 20. Don’t forget to remove reset the test criteria #CH2014
  21. 21. Have you seen any test screw ups yourself? LETS SHARE!! #CH2014

×