SlideShare a Scribd company logo
1 of 32
Download to read offline
Online Testing – the 
O li T i          h
 light in the tunnel
 light in the tunnel

 October, 2010
AGENDA

•   What is Online Testing?
    What is Online Testing?
•   How is it working?
•   Variables of Success
       i bl    fS
•   Case Studies
•   Conversion Optimization Consulting
What is Online Testing?

Online Testing (OL) Definition:
Online Testing (OL) Definition:
  In a nutshell, online testing 
  involves testing one or more 
                  g
  variable from a webpage to 
  identify which ones can create a 
  positive difference in the 
  conversion. 
  The winning variable then 
    h                bl h
  becomes the control, or bench 
  mark, which future ones are 
  mark which future ones are
  measured against.
Online Testing Steps

Scientific testing involves the following steps:
1) Determining which element(s) of a page you want to test. 
2) Creating the test / the test page
3) Setting up the tool use for the testing
3) Setting up the tool use for the testing
4) Keeping good, accurate test records.
5) Running the test campaign.
6) Tracking and comparing results to determine which test variable is the 
6)     ki      d         i        l    d      i   hi h        i bl i h
    winner. (100 conversions)
7) Repeating the cycle, constantly attempting to beat your existing control
Categories of Online Testing

• A/B test, Split test
   /      , p                     • MVT ‐Multivariable test
 Page 1: Control (the original)      Page 1: Control (the original)

                                                         SUBSCRIBE 
                                                         SUBSCRIBE
                                                           NOW
        SEND ME THE FREE 
           GUIDE NOW



 Page 2: Test page                   Page 2: Test page

                                                          SEND ME 
        SEND ME THE FREE                                  THE INFO
           GUIDE NOW
           GUIDE NOW
Time needed for testing?

                        LONGER Test Period    SHORTER Test Period
# of Alternatives /     More (MVT)            Less (A/B)
Variables
Difference in Results   Lesser                Greater
Traffic Volume          Less                  More
Confidence Level        Higher > 90%          Lower < 90%




                                        100 conversions
Case Study 1 – Relevancy 




ORIGINAL                 TEST
Partial results
Relevant? 



NOT YET !
NOT YET !
Risks? What Risks?

• All Test Types are not
  All Test Types are not 
  Equal

• Comparing & Contrasting 
  A/B and MVT
  A/B d MVT

• The Risk of the Endless 
  Test
KEY principles for online tests

Test Methodology
     – Is A Process !
     – Single Variable Test Formula
         • The most important tool for performing a useful experiment
           The most important tool for performing a useful experiment. 
     – The (relevant) Academic Vocabulary
         • There are Concepts, Terminology, Differences between Variable
         • Understand and Use them Properly
              d       d d        h            l
     – Test Protocol
         • Use proper tool organizes each stage of the test process and 
           automatically calculates all of the key equations.
KEY principles for online tests

Test Validity
            y
• Understanding of validity principles, so that you can be 
   confident in the results of your test.
    – The Threats to Test Validity
       • "history effect", 
       • "instrumentation error"
          "instrumentation error"
       • "sample distortion”
    – The Sample Size Validity
      The Sample Size Validity
       • The key mathematical equations for determining test 
          size.
    – The Validity Formula
KEY principles for online tests
Test Planning
• Which variables to test? 
     – Knowing what to test is as important as knowing how to test. 
     – The Optimization Formula
         • Prioritize your testing goals
           Prioritize your testing goals. 
         • More revenue = right order.
     – The Test ROI Calculation Tool
         • Calculates the compounding ROI on a given series of tests. 
         • Saves time and money as it helps you determine the impact of each 
           test on your marketing budget.
     – Radical Redesigns
         • How to capture multi‐variable test results with single variable testing 
           techniques
                  q
What’s the big deal about Online 
                                      Testing?

• Online Testing:
  Online Testing:
  – Motivation
  – Value proposition
    Value proposition
  – Incentive
  –A i t
    Anxiety
  – Friction 



        C = 4m + 3v + 2(i f) -2a ©
                      2(i-f) 2a
When?
• How would you Know WHEN need TO APPLY
  this strategy?
   hi          ?

• The right answer: 

    • ALL THE TIME there is an
      ALL THE TIME there is an 
            Opportunity
             pp       y
• Amazon – case study: 
    200 live online tests running every day
    200 li     li t t         i         d
Case Study 2‐ The Formula!




816% Growth in
New Subscribers

ORIGINAL                TEST
Case Study 3 – Prove It!
Case Study 3‐ Treatment
 100% Money BacK Guarantee – Eliminating anxietY




  Call to Actions highlighting the benefits
Let’s compare …




ORIGINAL      TREATMENT
Case Study 4: Is It Worth it?

Professional Photographer
                  g p
• Status:
   –   New site
   –   Artistic / flash
                /
   –   Minimum content
   –   No commercial aspect
• Goals:
   – To get New Clients
• Strategies:
   – They decided to do PPC
   – Adding some wedding pictures on the actual site
     Adding some wedding pictures on the actual site
Case Study 4 – cont.

• Our proposal:
  Our proposal:
  – Landing Page
           g g
• Reaction:
  – Fighting
• Agreement:
  – Online Testing 
Case Study 4 – cont.

• Results:
  – Our page performed better: 71.6% improvement 
    in conversion (contacts)
    in conversion (contacts)
• The client got 4 wedding contracts, with an 
  online marketing budget of 3.5% spent
  online marketing budget of 3 5% spent
Oak Photography LP




Differences
Oak Photography LP




       Differences
ATTENTION


• Controversy about Best Practices
  Controversy about Best Practices

• Example: Video on AutoStart or 
  Press Play
         l
Case Study 5 ‐ controversy

           Video Play Not Play
           Vid – Pl or N t Pl ?




           63% improvement
           in conversion with
           Video on autoplay
CONCLUSIONS
• Do not go Blind with 
  your marketing 
  your marketing

• Focus your money and 
  resources where it 
  counts

• Get confirmation you 
  are on the right track
               g
Conversion Optimization
            Eworks WSI Cyprus:
•   Consulting Services
    Consulting Services
•   Landing Page / Website / Email 
    Marketing
    M k ti
•   Report (14‐20 variables analyzed)
•   100% Money Back Guarantee 
    (certain conditions apply)
•   Our Clients Implement 95‐100 % 
    of our recommendations
    of our recommendations
EworksWSI Cyprus
SERVICES:
- Webdesign               - Interactive Content
                          ( g
                          (digital p
                                   publishing)
                                            g)
- Landing Pages Design
                          -Digital Marketing
- Website Conversion
Optimization
Optimi ation              - Flash Content

- Landing Pages           - Print Design
Conversion Optimization
             p
                          - Logo Design
- Email Marketing
Conversion Optimization                           CONTACT INFO: 
                                                  info@eworkswsi.com.cy
                                                  i f @    k i
                                                  +35799‐555747
                                                  www.EworksWSI.com.cy
                                                  www EworksWSI com cy
PROMO !

ONLY for our clients:
ONLY for our clients:
‐ Until Dec 31, 2010
‐ O li
  Online testing discounted f
             i di         d from €500 to €300
                                 € 00 €300




‐ A d hi i
  And this is not all ……
                   ll
PROMO !

Package 1:          Package 2:          Package 3:
1 sample design     2 sample design     2 sample design
Cost Package:       Cost Package:       1 Online Testing
€450 
€450                €600 
                    €600                Cost Package: 
                                        Cost Package:
(Information        (Information        €685
Architecture Doc 
Architecture Doc    Architecture Doc 
                    Architecture Doc    (Information 
                                        (Information
completed)          completed)          Architecture Doc 
                                        completed)
Contact  Eworks WSI Cyprus

Contact us for more info
Contact us for more info

   Eworks WSI Cyprus
       k S C

 info@eworkswsi.com.cy
 www.eworkswsi.com.cy
 www eworkswsi com cy
    Tel: +357‐99555747

More Related Content

Similar to Eworks WSI Cyprus online testing oct 2010

How to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangHow to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangProduct Anonymous
 
Cro webinar what you're doing wrong in your cro program (sharable version)
Cro webinar   what you're doing wrong in your cro program (sharable version)Cro webinar   what you're doing wrong in your cro program (sharable version)
Cro webinar what you're doing wrong in your cro program (sharable version)VWO
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
Can I Test More Than One Variable at a  Time? Statisticians answer some of th...Can I Test More Than One Variable at a  Time? Statisticians answer some of th...
Can I Test More Than One Variable at a Time? Statisticians answer some of th...MarketingExperiments
 
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersConversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersWeb Marketing ROI
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB testsCraig Sullivan
 
Materials And Information Flow Map
Materials And Information Flow MapMaterials And Information Flow Map
Materials And Information Flow MapMichael E. Parker
 
John Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellJohn Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellTEST Huddle
 
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Optimizely
 
Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsVWO
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMProduct School
 
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeBrighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
 
What is the true ROI on your technology investments?
What is the true ROI on your technology investments?What is the true ROI on your technology investments?
What is the true ROI on your technology investments?Qubit
 
4 ie 2015 rapid research
4   ie 2015 rapid research4   ie 2015 rapid research
4 ie 2015 rapid researchMaggie Nichols
 
Metrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLAMetrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLADarren Levy
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B TestingJanessa Lantz
 

Similar to Eworks WSI Cyprus online testing oct 2010 (20)

How to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangHow to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying Zhang
 
Cro webinar what you're doing wrong in your cro program (sharable version)
Cro webinar   what you're doing wrong in your cro program (sharable version)Cro webinar   what you're doing wrong in your cro program (sharable version)
Cro webinar what you're doing wrong in your cro program (sharable version)
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
Can I Test More Than One Variable at a  Time? Statisticians answer some of th...Can I Test More Than One Variable at a  Time? Statisticians answer some of th...
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
 
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersConversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
 
Materials And Information Flow Map
Materials And Information Flow MapMaterials And Information Flow Map
Materials And Information Flow Map
 
John Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellJohn Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test Well
 
See the Research in Action
See the Research in ActionSee the Research in Action
See the Research in Action
 
Pricing strategies 2017 nz
Pricing strategies 2017 nzPricing strategies 2017 nz
Pricing strategies 2017 nz
 
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
 
Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and Hows
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PM
 
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeBrighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
 
Brooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama PresentationBrooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama Presentation
 
What is the true ROI on your technology investments?
What is the true ROI on your technology investments?What is the true ROI on your technology investments?
What is the true ROI on your technology investments?
 
4 ie 2015 rapid research
4   ie 2015 rapid research4   ie 2015 rapid research
4 ie 2015 rapid research
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Metrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLAMetrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLA
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
 

More from EworksWSI Cyprus

EworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus
 
WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016EworksWSI Cyprus
 
Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016EworksWSI Cyprus
 
EworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Cyprus
 
Eworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworksWSI Cyprus
 
Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015EworksWSI Cyprus
 
2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical planEworksWSI Cyprus
 
Eworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworksWSI Cyprus
 
Eworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworksWSI Cyprus
 
Social media in travel & tourism best practices
Social media in travel & tourism  best practicesSocial media in travel & tourism  best practices
Social media in travel & tourism best practicesEworksWSI Cyprus
 
Eworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworksWSI Cyprus
 
Converting visitors into customers
Converting visitors into customersConverting visitors into customers
Converting visitors into customersEworksWSI Cyprus
 
3 fifty7 Music Agency Presentation by EworksWSI
3 fifty7   Music Agency Presentation by EworksWSI3 fifty7   Music Agency Presentation by EworksWSI
3 fifty7 Music Agency Presentation by EworksWSIEworksWSI Cyprus
 
Eworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworksWSI Cyprus
 

More from EworksWSI Cyprus (14)

EworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing Whitepaper
 
WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016
 
Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016
 
EworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet Mobilemarketing
 
Eworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email Marketing
 
Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015
 
2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan
 
Eworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User Guide
 
Eworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplified
 
Social media in travel & tourism best practices
Social media in travel & tourism  best practicesSocial media in travel & tourism  best practices
Social media in travel & tourism best practices
 
Eworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation Mangement
 
Converting visitors into customers
Converting visitors into customersConverting visitors into customers
Converting visitors into customers
 
3 fifty7 Music Agency Presentation by EworksWSI
3 fifty7   Music Agency Presentation by EworksWSI3 fifty7   Music Agency Presentation by EworksWSI
3 fifty7 Music Agency Presentation by EworksWSI
 
Eworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwords
 

Recently uploaded

rishikeshgirls.in- Rishikesh call girl.pdf
rishikeshgirls.in- Rishikesh call girl.pdfrishikeshgirls.in- Rishikesh call girl.pdf
rishikeshgirls.in- Rishikesh call girl.pdfmuskan1121w
 
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...lizamodels9
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsApsara Of India
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...lizamodels9
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Neil Kimberley
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...lizamodels9
 
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Dipal Arora
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneVIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneCall girls in Ahmedabad High profile
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdfRenandantas16
 
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts ServiceVip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Serviceankitnayak356677
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communicationskarancommunications
 
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...lizamodels9
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessAggregage
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Roomdivyansh0kumar0
 
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc.../:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...lizamodels9
 
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...anilsa9823
 
Non Text Magic Studio Magic Design for Presentations L&P.pptx
Non Text Magic Studio Magic Design for Presentations L&P.pptxNon Text Magic Studio Magic Design for Presentations L&P.pptx
Non Text Magic Studio Magic Design for Presentations L&P.pptxAbhayThakur200703
 

Recently uploaded (20)

rishikeshgirls.in- Rishikesh call girl.pdf
rishikeshgirls.in- Rishikesh call girl.pdfrishikeshgirls.in- Rishikesh call girl.pdf
rishikeshgirls.in- Rishikesh call girl.pdf
 
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
 
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
Call Girls In Radisson Blu Hotel New Delhi Paschim Vihar ❤️8860477959 Escorts...
 
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Mehrauli Delhi 💯Call Us 🔝8264348440🔝
 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
 
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service PuneVIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
VIP Call Girls Pune Kirti 8617697112 Independent Escort Service Pune
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts ServiceVip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
 
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...
Lowrate Call Girls In Laxmi Nagar Delhi ❤️8860477959 Escorts 100% Genuine Ser...
 
Best Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting PartnershipBest Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting Partnership
 
Sales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for SuccessSales & Marketing Alignment: How to Synergize for Success
Sales & Marketing Alignment: How to Synergize for Success
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
 
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc.../:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...
/:Call Girls In Jaypee Siddharth - 5 Star Hotel New Delhi ➥9990211544 Top Esc...
 
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow 💋 Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
 
Non Text Magic Studio Magic Design for Presentations L&P.pptx
Non Text Magic Studio Magic Design for Presentations L&P.pptxNon Text Magic Studio Magic Design for Presentations L&P.pptx
Non Text Magic Studio Magic Design for Presentations L&P.pptx
 

Eworks WSI Cyprus online testing oct 2010

  • 1. Online Testing – the  O li T i h light in the tunnel light in the tunnel October, 2010
  • 2. AGENDA • What is Online Testing? What is Online Testing? • How is it working? • Variables of Success i bl fS • Case Studies • Conversion Optimization Consulting
  • 3. What is Online Testing? Online Testing (OL) Definition: Online Testing (OL) Definition: In a nutshell, online testing  involves testing one or more  g variable from a webpage to  identify which ones can create a  positive difference in the  conversion.  The winning variable then  h bl h becomes the control, or bench  mark, which future ones are  mark which future ones are measured against.
  • 4. Online Testing Steps Scientific testing involves the following steps: 1) Determining which element(s) of a page you want to test.  2) Creating the test / the test page 3) Setting up the tool use for the testing 3) Setting up the tool use for the testing 4) Keeping good, accurate test records. 5) Running the test campaign. 6) Tracking and comparing results to determine which test variable is the  6) ki d i l d i hi h i bl i h winner. (100 conversions) 7) Repeating the cycle, constantly attempting to beat your existing control
  • 5. Categories of Online Testing • A/B test, Split test / , p • MVT ‐Multivariable test Page 1: Control (the original) Page 1: Control (the original) SUBSCRIBE  SUBSCRIBE NOW SEND ME THE FREE  GUIDE NOW Page 2: Test page Page 2: Test page SEND ME  SEND ME THE FREE  THE INFO GUIDE NOW GUIDE NOW
  • 6. Time needed for testing? LONGER Test Period SHORTER Test Period # of Alternatives /  More (MVT) Less (A/B) Variables Difference in Results Lesser Greater Traffic Volume Less More Confidence Level Higher > 90% Lower < 90% 100 conversions
  • 10. Risks? What Risks? • All Test Types are not All Test Types are not  Equal • Comparing & Contrasting  A/B and MVT A/B d MVT • The Risk of the Endless  Test
  • 11. KEY principles for online tests Test Methodology – Is A Process ! – Single Variable Test Formula • The most important tool for performing a useful experiment The most important tool for performing a useful experiment.  – The (relevant) Academic Vocabulary • There are Concepts, Terminology, Differences between Variable • Understand and Use them Properly d d d h l – Test Protocol • Use proper tool organizes each stage of the test process and  automatically calculates all of the key equations.
  • 12. KEY principles for online tests Test Validity y • Understanding of validity principles, so that you can be  confident in the results of your test. – The Threats to Test Validity • "history effect",  • "instrumentation error" "instrumentation error" • "sample distortion” – The Sample Size Validity The Sample Size Validity • The key mathematical equations for determining test  size. – The Validity Formula
  • 13. KEY principles for online tests Test Planning • Which variables to test?  – Knowing what to test is as important as knowing how to test.  – The Optimization Formula • Prioritize your testing goals Prioritize your testing goals.  • More revenue = right order. – The Test ROI Calculation Tool • Calculates the compounding ROI on a given series of tests.  • Saves time and money as it helps you determine the impact of each  test on your marketing budget. – Radical Redesigns • How to capture multi‐variable test results with single variable testing  techniques q
  • 14. What’s the big deal about Online  Testing? • Online Testing: Online Testing: – Motivation – Value proposition Value proposition – Incentive –A i t Anxiety – Friction  C = 4m + 3v + 2(i f) -2a © 2(i-f) 2a
  • 15. When? • How would you Know WHEN need TO APPLY this strategy? hi ? • The right answer:  • ALL THE TIME there is an ALL THE TIME there is an  Opportunity pp y • Amazon – case study:  200 live online tests running every day 200 li li t t i d
  • 16. Case Study 2‐ The Formula! 816% Growth in New Subscribers ORIGINAL TEST
  • 18. Case Study 3‐ Treatment 100% Money BacK Guarantee – Eliminating anxietY Call to Actions highlighting the benefits
  • 20. Case Study 4: Is It Worth it? Professional Photographer g p • Status: – New site – Artistic / flash / – Minimum content – No commercial aspect • Goals: – To get New Clients • Strategies: – They decided to do PPC – Adding some wedding pictures on the actual site Adding some wedding pictures on the actual site
  • 21. Case Study 4 – cont. • Our proposal: Our proposal: – Landing Page g g • Reaction: – Fighting • Agreement: – Online Testing 
  • 22. Case Study 4 – cont. • Results: – Our page performed better: 71.6% improvement  in conversion (contacts) in conversion (contacts) • The client got 4 wedding contracts, with an  online marketing budget of 3.5% spent online marketing budget of 3 5% spent
  • 24. Oak Photography LP Differences
  • 25. ATTENTION • Controversy about Best Practices Controversy about Best Practices • Example: Video on AutoStart or  Press Play l
  • 26. Case Study 5 ‐ controversy Video Play Not Play Vid – Pl or N t Pl ? 63% improvement in conversion with Video on autoplay
  • 27. CONCLUSIONS • Do not go Blind with  your marketing  your marketing • Focus your money and  resources where it  counts • Get confirmation you  are on the right track g
  • 28. Conversion Optimization Eworks WSI Cyprus: • Consulting Services Consulting Services • Landing Page / Website / Email  Marketing M k ti • Report (14‐20 variables analyzed) • 100% Money Back Guarantee  (certain conditions apply) • Our Clients Implement 95‐100 %  of our recommendations of our recommendations
  • 29. EworksWSI Cyprus SERVICES: - Webdesign - Interactive Content ( g (digital p publishing) g) - Landing Pages Design -Digital Marketing - Website Conversion Optimization Optimi ation - Flash Content - Landing Pages - Print Design Conversion Optimization p - Logo Design - Email Marketing Conversion Optimization CONTACT INFO:  info@eworkswsi.com.cy i f @ k i +35799‐555747 www.EworksWSI.com.cy www EworksWSI com cy
  • 30. PROMO ! ONLY for our clients: ONLY for our clients: ‐ Until Dec 31, 2010 ‐ O li Online testing discounted f i di d from €500 to €300 € 00 €300 ‐ A d hi i And this is not all …… ll
  • 31. PROMO ! Package 1: Package 2: Package 3: 1 sample design 2 sample design 2 sample design Cost Package: Cost Package: 1 Online Testing €450  €450 €600  €600 Cost Package:  Cost Package: (Information  (Information  €685 Architecture Doc  Architecture Doc Architecture Doc  Architecture Doc (Information  (Information completed) completed) Architecture Doc  completed)
  • 32. Contact  Eworks WSI Cyprus Contact us for more info Contact us for more info Eworks WSI Cyprus k S C info@eworkswsi.com.cy www.eworkswsi.com.cy www eworkswsi com cy Tel: +357‐99555747