Multivariate DIY - Daigneault
Upcoming SlideShare
Loading in...5

Multivariate DIY - Daigneault



If you're not doing multivariate (MVT) optimization tests on your landing pages, you could be leaving hundreds of thousands of dollars on the table....

If you're not doing multivariate (MVT) optimization tests on your landing pages, you could be leaving hundreds of thousands of dollars on the table.

But for those that have checked out MVT, all those tools and consultants can get expensive pretty darn quick. No matter how great the return on investment, sometimes there just isn't any money.

Enter MVT DIY-style! or, multivariate optimization "do it yourself" style. This session will show you how to use Google's free tools so that you can setup your own tests.



Total Views
Views on SlideShare
Embed Views



1 Embed 3 3



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment
  • M+R Powerpoint Template
  • M+R Powerpoint Template
  • M+R Powerpoint Template
  • M+R Powerpoint Template
  • M+R Powerpoint Template

Multivariate DIY - Daigneault Multivariate DIY - Daigneault Presentation Transcript

  • Multivariate Optimization Do-It-Yourself Edition [150] April 9, 2010 Steve Daigneault
  • Goals
    • Solid understanding of multivariate optimization and why it’s so great
    • Overview of how Google’s free optimization tool works
    • Examples of recent tests and results
    • Resources and suggested next steps for you to run your own tests
  • What is multivariate optimization?
    • We all know A/B tests
    • Create two versions
    • Split traffic
    • Watch response rates
  • Your landing page submit Trust Mrs. Peacock. She knows how to light candlesticks without killing anyone. Give to the Library
  • Things you want to test submit
    • HEADLINE: 2 alternatives
      • Save the Conservatory
      • Colonel Mustard Needs You
    PICTURE: 2 alternatives
    • FIELDS: 1 alternative
      • Remove 1 field
    Donate now!
    • BUTTON: 1 alternative
      • Bigger and orange
  • How would you A/B test this?
    • Set-up different landing pages for:
      • Headline: 2 alternatives + 1 control = 3
      • Picture: 2 alternatives + 1 control = 3
      • Fields: 1 alternative + 1 control = 2
      • Button: 1 alternative + 1 control = 2
    • 3 x 3 x 2 x 2 = 36 pages
    • 36 – 1 control = 35 new pages to build
      • Test everything at once
        • Input all elements at once
        • Software creates many page variations
        • Traffic split among page variations
        • Takes into account interactions between all the elements
      • Fancy math tracks the effect each individual item has on conversions
    Multivariate > A/B testing
      • Actually builds all page variations
        • Some software will build fewer pages + use predictive modeling
        • Optimizer = free + great for basic tests
      • Statistically significant results using the same traffic but using it more wisely
      • Optimizes conversions (not average gift*)
    Google Optimizer
      • Add Google Optimizer code around elements you want to test.*
      • Upload variations of those elements into Google Optimizer.
      • Optimizer then builds page variations, splits traffic and calculates changes in behavior.
      • *requires you have direct access to page code
      • Choose the page you want to improve.* EX: donation page
      • Identify your conversion page.* EX: confirmation page
      • Identify page elements you want to test. EX: button and header image *these pages will get tracking code.
    7 Steps to Test
      • Create variations. EX: new graphic buttons and headers
      • Add Optimizer code around the elements you’re testing on your test page.
      • Upload the variations to those elements into Google Optimizer.
      • Review and launch.
    7 Steps to Test
  • Sample results: Page variations
    • Estimated conversion rate range
    • provides the most immediate insight into overall performance. This column shows you how well each combination is performing relative to your original content.
    • Chance to beat original
    • the probability that a particular combination will be more successful than your original content. Above 95% (or below 5%) is considered significant. Above 99% (or below 1%) is considered “high confidence”.
    • Chance to beat all
    • the probability that a combination will be more the successful than all the other combinations running in the experiment. Usually a lower number because it’s competing against many page variations vs. just the original.
    • Observed improvement
    • displays the percent improvement over the original combination.
    • Conversions/impressions
    • the raw data of how many conversions and page views a particular combination generated. (You want 200+)
  • Sample results: Page elements
    • Relevance rating
    • shows how much impact a particular section has on your experiment. 0 means it had little to no impact. 5 means it was a major distinguishing factor.
  • vs.
  • vs.
  • vs.
      • #6: new nav and new button
      • original gift string
      • #5: new nav and new gift string
      • original button
    • How much traffic do I need?
    • How many things can I test?
    Traffic Calculator
    • How much could improvements help?
    Value Calculator
  • Installation Guide
  • Optimizer Community
  • Optimizer Engineer Blog
    • Frequently Asked Questions
    • Technical overview gives you a deeper understanding of the tool
    • Comparisons of different tools to help you decide if Google Optimizer is right for you
      • /
  • How Was this Session? Call In Text Online Call 404.939.4909 Enter Code 150 Text 150 to 69866 Visit Enter Code 150 Tell Us and You Could Win a Free 2011 NTC Registration!