Your SlideShare is downloading. ×
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
IBAT-ContentOptimisation-AbTest
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

IBAT-ContentOptimisation-AbTest

440

Published on

IBAT-Content Optimisation & Ab Testing

IBAT-Content Optimisation & Ab Testing

Published in: Business, Technology, Design
1 Comment
1 Like
Statistics
Notes
  • Pretty much long slideshare, but the point is: A/B testing is neccessary. A tool I suggest: http://www.coreminer.com/calculators/ab-test
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
440
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
11
Comments
1
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Content Optimisation
    Which Test Won
  • 2. HubSpot Tests Homepage Copy: Which Got More Free Trial Downloads – Goal-Focused vs. Role-Focused?
  • 3.
  • 4. Version B convinced 49.1% more first-time homepage visitors to download a free trial.
    Version A tailored copy to two target demographics (business owners and marketers) based on their goals.
    Version B addressed the demographics based on their identities or roles.
    If your homepage gets two or more types of visitors, you absolutely should copy this test!
  • 5. Nonprofit A/B Test: Which Page Got A 10.2% Lift In Average Donation Amounts for Haiti?
  • 6.
  • 7. Version A got a 10.2% lift in average donation amounts per page view, contributing a total of $1.02 million
    Traffic to the page came from a huge (one of the biggest we’ve seen) “Donate” button on the homepage
    Version A had a two-column layout with a large image vs. Version B’s single-column, no image layout.
    Neither version displayed the button above the fold, Version A had two less form fields and used “Support Haiti” for its button copy vs. “Submit” on Version B’s button.
  • 8. Wal-Mart’s UK Chain Tests Radical Homepage Redesign: Which Layout (not Content) Reduced Bounce Rates by Double Digits?
  • 9.
  • 10. The Version A layout, featuring non-traditional navigation elements, reduced homepage abandons by an average 19%.
    Shows that the tabs-across-the-top homepage may not be the best for all ecommerce sites.
    Sometimes a list of text-links in the center of the page work better.
    In fact, perhaps other types of sites (even content and B2B sites) should also test alternate navigational elements on their homepages
  • 11. Ecommerce A/B Test: Which Shoe Page Version Got 39.3% More Add-to-Cart Clicks?
  • 12.
  • 13. 39.3% more European 20- to 30-somethings interested in trendy street wear preferred Version A over Version B.
    The versions were identical except for the background color (black vs. white), copy (“Outstanding.” vs. “Out of the Box.”), and shoe color (rich vs. dull).
    Possibly, the black background made the product and the add-to-cart button stand out on the page.
    This is a much bigger product image than most American ecommerce sites use.
    Image size, alone, is worth testing
  • 14. Which Product Shots Got More Purchases: Just the Product vs. a Model Wearing the Product (in this case, shirts)?
  • 15.
  • 16. Version B’s product shots with human models not only boosted paid purchases 44%, but also gained a 67% rise in revenue per purchase. )
    Every time we’ve seen ecommerce sites test variations on their product shots — size, background color, and in this case the use of human models — the results have been noteworthy.
    This test is a fabulous example of why ecommerce sites can’t rely on “standard” images without leaving money on the table. You have to test product images!
  • 17. Avis UK Tests its PPC Landing Page: Which Got More Car Rental Bookings?
  • 18.
  • 19. Version B got a 74% lift in completed car rental bookings (sales)
    Good example of when a stripped-down, highly-focused landing page can sell a lot more than a standard home page
  • 20. Which Page Got More Lead Gen Form Submits?
  • 21.
  • 22. Version A convinced 66% more visitors to fill out and submit the lead gen form.
    For the two versions we showed you, the pages used an identical template, aside from the content in the center.
    Version A’s headline read “Your translation requirements:” whereas Version B had no headline at all.
    Version A separated the form into required and optional fields, and featured instructional copy in the right column instead of an oddly-colored woman’s face.
    Lastly, Version A did not have a “back” button (and neither should any form on the Internet we can think of.
  • 23. PPC Landing Page Test: Which Version Boosted Free Software Sign-Ups By 59%?
  • 24.
  • 25. Version A boosted free software sign-ups by 59%… even though visitors had to click through to an additional page to sign up
    Version B’s very prominent left-side form may have distracted visitors from reading copy that explained the offer
    Version A emphasized copy so that prospects understood what they were getting before they had to make a final sign-up decision.
  • 26. A/B Copy Test: Which PPC Landing Page Got 93% More ‘Add-to-Cart’ Clicks?
  • 27.
  • 28. Which LP got more “Add to Cart” clicks
    The more urgent, ‘take control’ tone of Version B’s copy lifted add-to-cart button clicks a whopping 93% over Version A’s comfort-focused tone.
    Shorter more focused bullet points
    All traffic came from the same keyword searches, but PPC ad serving was split to test which PPC ad copy and its matching landing page would do best.
    The 93% lift in data represents just the improvement on ‘add to cart’ button clicks on the landing page, irrespective of PPC ad clickthrough rates.
  • 29. Homepage Image A/B Test: “Sad” Young Woman vs. “Haggard” House Wife –
    Which Got More Clicks on the Big Yellow Button?
  • 30.
  • 31. Clear Debt – Varied Image – Click Test
    Version B got 33% more visitors to click the ‘Take the Debt Analyser’ button
    Most of traffic came from natural search and the results reached a 98.2% confidence level.
    Version B showed a “haggard house wife” looking towards the button.
    Version A showed a “sad” young woman looking away from the button
    Also age and context could have been a factor – users feel empathy with “Mother and Kids” as opposed to a young girl
    Setting of image – older woman shopping Vs youg woman sitting in “cinema”
    Interesting to know about “Target Audience” and source – ppc, email etc.
  • 32. Alpha Ecological Tests Homepage Copy, Images, and Layout: Which Got More Email Leads?
  • 33.
  • 34. Version B got a huge 114% lift in email leads from the homepage.
    Although the winner is obvious, this isn’t an easy test to sell to a HiPPO (highly paid person).
    The winning page had a lead capture form front and center, images of the actual pest control team, and more benefits copy.
    It also had images of the pests customers could be dealing with above the fold
  • 35. Email A/B Test: Which Customer Survey Invite Got 51% More Clickthroughs?
  • 36.
  • 37. Which Customer Survey Got More ClickThrus
    Version B got a whopping 51% more clicks than Version A.
    Version A read, “Give us your best Campaign Monitor ideas!” Version B read, “Tell us what we can do better.” The more direct wording won.
    Active language trumps passive language
    Easier to “Tell” opinionsrather than “Give” ideas away
  • 38. Fragrance Direct Tests the Layout of its Checkout Page: Which Got More Purchases?
  • 39.
  • 40. Version B, with images and info about the shoppers’ cart contents placed at the top of this third page in the checkout process, won a 22.5% boost in purchases
    Do customers deep into the checkout process still need to see prominent images and info on what they’re buying on each page?
    Turns out maintaining “scent” or buyer excitement by showing the product as prominently as possible won in this case
  • 41. Does Size Really Matter When It Comes to Email Opt-In
    Form Overlays? Please Vote For Which Got More Opt-Ins.
  • 42.
  • 43. FaveCrafts.com – Email Test
    Version A increased email subscriptions by 8.8%
    WhicTestWon professionals voted
    34% - Version A
    66% - Version B
    Part of A/B/N Test – versions A & B were identical – and out performed the control
    Form Headline was consistent with keyword search -
    Smaller More Focused Box possibly led the eye path and controlled user actions
    Test Carried Out by: WiderFunnel using GWO
    Site – Favecrafts.com ->> http://www.favecrafts.com/
  • 44. Which Navigation Bar Copy Boosted Webinar Attendees – “Webinars” vs. “Online Training”?
  • 45.
  • 46. Version B’s “Online Training” wording increased clickthroughs from the support page to the webinar page 10.4%.
    Webinar attendees doubled the first week the winning navigation link went live
    The team also ran A/B tests replacing “Webinars” with “Live Training” and “MailChimp Training.” In both cases, the word “Webinars” lost!
    Certain words resonated better with the audience
  • 47. Which Banner Ad Landing Page Got More Form Submissions … on Tuesday Afternoons?
  • 48.
  • 49. National University – Form Submits
    Version B won on Tuesday, Wed, Thurs PMs by converting 17% More Form Submits
    Version A won on all Weekday and Weekend AMs by 22%
    Shows the importance of dayparting
    Version B – had a Clear header – “Get on the Fast Track to your Degree” (possibly more relevant to a specific cohort – need to check)
    Version A – heading “Your Career..on your terms” – more relevant to work crowd = morning
    Colours – Typically Morning = Bright :: Afternoon = Soft
  • 50. DHL Express Tests Male vs. Female Image: Which Generated 108% More Norwegian Leads on this PPC Landing Page?
  • 51. DHL Test
  • 52. Version B, with the female model in the header, convinced 108% more visitors in Norway to fill out and submit the lead gen form.
  • 53. All PPC traffic was sent to one of these two landing pages. The test results reached a 95% confidence level
    The only difference between Version A and Version B was the photograph of the model in the page header
    Version A had a Caucasian male who looked like one of Norway’s local couriers. Version B had an Asian female.
    Results show the impact of testing people images in your online marketing.
    Eyetracking studies find that people love to look at human faces — so DHL was smart to highlight the 30% savings below the model’s faces.
  • 54. Westwood College Tests Adding a Privacy Policy Statement to its Landing Pages: Which Got More Leads?
  • 55.
  • 56. Version B, with the privacy policy statement in fine print under the button, convinced 19.1% more visitors to fill out and submit the lead gen form.
    Privacy reassurances can help raise response rates (but you have to test, because the wording and visibility can help or hurt you.)
    Gen Y kids really do care about privacy!
    Don’t assume that because you’re marketing to any particular demographic that privacy is not a concern
  • 57. The Official 2010 Vancouver Olympic Store Tests One-Page Checkout vs. Four-Page Checkout: Which Got More Purchases?
  • 58.
  • 59.
  • 60. Version A, the one-page checkout, gained a 21.8% lift in actual purchases.
    Should the checkout process be one page or multiple pages?
    Results of similar tests are significant but not predictable – so always test
  • 61. Highlight Step One or Step Two? Which Placement of a Blue Box Increased Google Gadget Installations 50.5%?
  • 62.
  • 63. Version B increased gadget installations by 50.5%.
    Version A featured the blue box around step one, the address box. Version B featured the blue box around step two, the call to action button.
    Likely that this test reiterates the importance of drawing attention to call to action buttons.
    Test copy, color, size, or any other way to make it stand out
    Version A’s blue box seemed to pull attention away from the CTA button, and toward the large example images below. Version B’s blue box balanced page.
  • 64. Which Landing Page Got More Form Completes? (Both Forms Ask the Same Questions)
  • 65.
  • 66. Which LP got more form completes?
    Version B racked up 16% more form completions, making it the solid winner
    Version B form is tightly grouped, green background with white field is visually appealing, Orange Button pops off bground.
    Version A – Button is below the fold. Version B above the fold
    Version B used a multi-column approach to form (makes seem shorter) than the single column Version A
    Possibly poor use of Left hand side with clip art image – readers read from LTR – make use of that space
    Good money image connected directly with big button
    Need to do MVT test to see which elements affected most
  • 67. Product Tour Page A/B Test: Which Version Boosted Free Trial Software Downloads by 85%?
  • 68.
  • 69. YNAB – Product Tour Page
    Version A – increased downloads by 87% (97% confidence rate)
    Authoritative Quote at the Top of Page – “If you need financial discipline – consider YNAB”
    Large Thumbnails – handwritten notes Vs Small Thumbs requiring click throughs
    Even though “Download Now” button way down below fold
    Shows users will scroll through a clear “story”
    Always consider the way a user “uses’ your page – as opposed to purely aesthetic rationale
  • 70. Which Product Page Got More Purchases?
  • 71.
  • 72. Version B got an 11% lift in paid purchases.
    Good example of why ecommerce marketers should not assume “standard” product page layout is going to give them the most possible sales
    Version B feels “calmer” in general won.
    Price is over button, button at bottom of page, smaller gold review stars, and no cross-sales.
  • 73. “Free” Offer vs. Statement – Which Call to Action Button Copy Got a 171% Lift in Clicks?
  • 74.
  • 75. Contrary to the notion that the word “Free” always wins, Version B convinced 171% more visitors to click the call to action button, which led visitors to a ‘contact us’ form.
    The test reached a 98.6% confidence level. Traffic to the page was mostly from organic search
    Everything about the homepage was identical except for the language on the call to action button.
    Version A’s button copy said “Free Consultation.” Version B’s said “Work With Us.”
  • 76. Subscription Site Homepage A/B Test: Which Design Got More Sign-Up Button Clicks?
  • 77.
  • 78. Version B got 21.3% more clicks on the sign up button than Version A
    Everything on the pages tested was identical except for removing the top horizontal navigation bar and decluttering the bottom by stripping out content and links
    The main lesson here is that simplicity often gets more responses, and fewer links can win
    For landing pages, try getting rid of your nav bar and anything distracting in your footer or extraneous columns.
  • 79. Which Email Newsletter Opt-In Form Boosted Sign-Ups by 52.8%?
  • 80.
  • 81. NYPL Email Subscription Form
    Version A boosted email newsletter sign-ups 52.8%
    The winning form’s headline said “Stay up-to-date” vs. “Subscribe” – more specific / better reason to submit
    Fewer form fields and a shorter privacy policy
    Featured a thumbnail graphic for the newsletter, a link to preview, and benefits copy
    Could do a MVT Test to figure out which specific elements caused the greatest uplift – another test…
  • 82. PPC Landing Page Test: Which Got 73.15% More
    Visitors to Download the Free Toolbar?
  • 83.
  • 84. Which Landing Page Performed Best
    Version B was the winner with 73.15% more toolbar downloads
    However, Version A won on an initial A/B test to determine the best page layoutresulting in a 21.13% lift in toolbar downloads
    Next, a MVT test was run with 16 different test elements – Version B won that with 73.15% increase in downloads
  • 85. Shopping Cart Page One A/B Test: Which Convinced
    More Shoppers to Click to the Next Checkout Step?
  • 86.
  • 87. Which Shopping Cart Performed Best
    Version A got 40.7% more page viewers to clickthrough to the next page in the checkout process
    About 18% of shopping cart views convert to purchase, a 40.7% lift contributed greatly to the bottom line
    Moving the 100% satisfaction guarantee icon to a more prominent location
    Adding site security copy and links to the guarantee and testimonials
    Making a big free shipping offer visible above the product box
    Changing the main call to action buttons from blend-in to highly contrasting colors

×