Ad Testing: Research & Findings
What are the Keys to Successful Testing? <ul><li>Design your test around a single question </li></ul><ul><li>Have a large ...
Don’t Guess! - Ads for “loan” loan Great Rates. On Time Closing No lender fees. Bad Credit OK www.loans.brand.com brand lo...
Don’t Guess! - loan adgroup loan Great Rates. On Time Closing No lender fees. Bad Credit OK www.loans.brand.com brand loan...
<ul><ul><li>Impression </li></ul></ul><ul><ul><li>Interest </li></ul></ul><ul><ul><li>Expectation </li></ul></ul><ul><ul><...
Ads Persuade!
Ads  (the meat of the relevance sandwich)
Intention Enticement Goal Fulfillment
Test Ads  by  Match Type!
Test 1: Is Running Ads on Brand Queries a Waste of Money? Example SERP w/o Ad Example SERP w/ Ad
Test Design <ul><li>1 week ads on 1 week off </li></ul><ul><li>No issues of seasonality or promotion </li></ul><ul><li>30 ...
Did the Ads Drive Traffic? <ul><li>Google -1.3% </li></ul><ul><li>Yahoo -8.7% </li></ul><ul><li>Live -7.3% </li></ul>NO
Did the Ads Increase Conversion Rate? <ul><li>Google +17.9% </li></ul><ul><li>Yahoo +32.1% </li></ul><ul><li>Live +11.7% <...
Did the Ads Increase RPV? <ul><li>Google +15.4% </li></ul><ul><li>Yahoo +47.0% </li></ul><ul><li>Live +27.5% </li></ul>YES
New Questions <ul><li>Marketing to Intent? </li></ul><ul><li>Power of Persuasion? </li></ul><ul><li>Power of Brand in Sear...
Test 2: What is the Best Ad to Increase Conversion? Ad Testing Multivariate Testing Works Increase Conversion Rates ottodi...
Test Design <ul><li>9 Ads Created and Tagged w/ URL Parameter </li></ul><ul><li>Landing and Thank You Page Tagged </li></u...
What does an L9 Array Really Look Like? Recipe (9) Title (3) D1 (3) D2 (3) URL (3) A - Control {keyword} Search {AdGroup} ...
What Were the Results? Recipe Visitors Conversion Lift A - Control 11.80% 5.88% --- B 14.30% 4.29% -27.05% C 14.04% 6.08% ...
What Were the Results? Recipe Visitors Conversion Lift A - Control 11.80% 5.88% --- B 14.30% 4.29% -27.05% C 14.04% 6.08% ...
What is the breakdown? <ul><li>Other Ads the Used Winning Title </li></ul><ul><ul><li>-14% </li></ul></ul><ul><ul><li>-12%...
What Ad Elements Influenced Conversion? Element Winning Alternative Influence on Conversion Title {keyword} suppliers 13.5...
What’s Better? {keyword} catalog Find parts fast at (brand) {keyword} catalog search www.brand.com {keyword} suppliers Fin...
Jonathan Mendez, Chief Strategy Officer My Blog: <ul><li>optimizeandprophesize.com </li></ul>
Upcoming SlideShare
Loading in …5
×

SES San Jose Ad Testing Research & Findings

4,060 views
4,003 views

Published on

Published in: Business, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
4,060
On SlideShare
0
From Embeds
0
Number of Embeds
1,198
Actions
Shares
0
Downloads
51
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

SES San Jose Ad Testing Research & Findings

  1. 1. Ad Testing: Research & Findings
  2. 2. What are the Keys to Successful Testing? <ul><li>Design your test around a single question </li></ul><ul><li>Have a large differentiation b/w tested elements </li></ul><ul><li>Account for changes in temporal behavior </li></ul><ul><li>Collect enough data to reduce margin of error </li></ul><ul><li>Segment results to provide added insight </li></ul><ul><li>Act on the results! </li></ul>
  3. 3. Don’t Guess! - Ads for “loan” loan Great Rates. On Time Closing No lender fees. Bad Credit OK www.loans.brand.com brand loans apply now Low Rates. Approval in Minutes Personal Service. Apply Online Now! www.brand.com A B C low rate loans Low Rates. Approval in Minutes No lender fees. Bad Credit OK www.loans.brand.com
  4. 4. Don’t Guess! - loan adgroup loan Great Rates. On Time Closing No lender fees. Bad Credit OK www.loans.brand.com brand loans apply now Low Rates. Approval in Minutes Personal Service. Apply Online Now! www.brand.com A B C low rate loans Low Rates. Approval in Minutes No lender fees. Bad Credit OK www.loans.brand.com 3.79% Conversion 2.32% Conversion 0.95% Conversion
  5. 5. <ul><ul><li>Impression </li></ul></ul><ul><ul><li>Interest </li></ul></ul><ul><ul><li>Expectation </li></ul></ul><ul><ul><li>Persuasion </li></ul></ul>
  6. 6. Ads Persuade!
  7. 7. Ads (the meat of the relevance sandwich)
  8. 8. Intention Enticement Goal Fulfillment
  9. 9. Test Ads by Match Type!
  10. 10. Test 1: Is Running Ads on Brand Queries a Waste of Money? Example SERP w/o Ad Example SERP w/ Ad
  11. 11. Test Design <ul><li>1 week ads on 1 week off </li></ul><ul><li>No issues of seasonality or promotion </li></ul><ul><li>30 Branded Keywords </li></ul><ul><li>1 version of ad </li></ul>
  12. 12. Did the Ads Drive Traffic? <ul><li>Google -1.3% </li></ul><ul><li>Yahoo -8.7% </li></ul><ul><li>Live -7.3% </li></ul>NO
  13. 13. Did the Ads Increase Conversion Rate? <ul><li>Google +17.9% </li></ul><ul><li>Yahoo +32.1% </li></ul><ul><li>Live +11.7% </li></ul>YES
  14. 14. Did the Ads Increase RPV? <ul><li>Google +15.4% </li></ul><ul><li>Yahoo +47.0% </li></ul><ul><li>Live +27.5% </li></ul>YES
  15. 15. New Questions <ul><li>Marketing to Intent? </li></ul><ul><li>Power of Persuasion? </li></ul><ul><li>Power of Brand in Search? </li></ul>
  16. 16. Test 2: What is the Best Ad to Increase Conversion? Ad Testing Multivariate Testing Works Increase Conversion Rates ottodigital.com/ads Element 1 Element 2 Element 3 Element 4 4x3 L9 Orthogonal Array 4 Elements 3 Variations
  17. 17. Test Design <ul><li>9 Ads Created and Tagged w/ URL Parameter </li></ul><ul><li>Landing and Thank You Page Tagged </li></ul><ul><li>Ad Serving Optimization Turned OFF </li></ul>
  18. 18. What does an L9 Array Really Look Like? Recipe (9) Title (3) D1 (3) D2 (3) URL (3) A - Control {keyword} Search {AdGroup} suppliers Compare Products Today www.brand.com B {keyword} Find {keyword} suppliers Search Thousands of Products www.brand.com/{keyword} C {keyword} Find Parts fast at (brand) {keyword} catalog search www.brand.com/catalogs D {keyword} suppliers Search {AdGroup} suppliers Compare Products Today www.brand.com/catalogs E {keyword} suppliers Find {keyword} suppliers Search Thousands of Products www.brand.com F {keyword} suppliers Find Parts fast at (brand) {keyword} catalog search www.brand.com/{keyword} G {keyword} catalog Search {AdGroup} suppliers Compare Products Today www.brand.com/{keyword} H {keyword} catalog Find {keyword} suppliers Search Thousands of Products www.brand.com/catalogs I {keyword} catalog Find Parts fast at (brand) {keyword} catalog search www.brand.com
  19. 19. What Were the Results? Recipe Visitors Conversion Lift A - Control 11.80% 5.88% --- B 14.30% 4.29% -27.05% C 14.04% 6.08% 3.42% D 9.34% 2.57% -56.29% E 13.00% 6.16% 4.72% F 9.42% 5.38% -8.50% G 10.06% 5.04% -14.32% H 10.41% 5.13% -12.82% I 7.63% 8.04% 36.71%
  20. 20. What Were the Results? Recipe Visitors Conversion Lift A - Control 11.80% 5.88% --- B 14.30% 4.29% -27.05% C 14.04% 6.08% 3.42% D 9.34% 2.57% -56.29% E 13.00% 6.16% 4.72% F 9.42% 5.38% -8.50% G 10.06% 5.04% -14.32% H 10.41% 5.13% -12.82% I 7.63% 8.04% 36.71%
  21. 21. What is the breakdown? <ul><li>Other Ads the Used Winning Title </li></ul><ul><ul><li>-14% </li></ul></ul><ul><ul><li>-12% </li></ul></ul><ul><li>Other Ads the Used Winning D1 </li></ul><ul><ul><li>+3.42% </li></ul></ul><ul><ul><li>-8.5% </li></ul></ul><ul><li>Other Ads the Used Winning URL </li></ul><ul><ul><li>Control </li></ul></ul><ul><ul><li>+4.72% </li></ul></ul>www.brand.com Find Parts fast at (brand) {keyword} catalog
  22. 22. What Ad Elements Influenced Conversion? Element Winning Alternative Influence on Conversion Title {keyword} suppliers 13.54% D1 Find {keyword} suppliers 53.53% D2 Search Thousands of Products 23.56% URL www.brand.com/{keyword} 9.37%
  23. 23. What’s Better? {keyword} catalog Find parts fast at (brand) {keyword} catalog search www.brand.com {keyword} suppliers Find {keyword} suppliers Search Thousands of Products www.brand.com/{keyword} Winning Recipe Best Predicted Best Predicted +52% Lift in Conversion Rate
  24. 24. Jonathan Mendez, Chief Strategy Officer My Blog: <ul><li>optimizeandprophesize.com </li></ul>

×