SlideShare a Scribd company logo
Session Title
MIKE LOVERIDGE
Head of Digital Test and Learn
Humana, Inc.
How Humana's Strategic Testing Drove a
60% Increase in Customer Engagement
Mike Loveridge
Head of Digital Test and Learn
Humana, Inc.
Humana is …
4
Month 1 Month 2 Month 3 Month 4 Month 5 Month 6
Low Funnel
Optimize/Convert
View All
Plans
Enrollment
Funnel
All funnel steps (1 step/test per week)
Usability
#2
Design #1
Integrate
Winners
Design #2
Super
Test Optimize (1 test/week)
The “Super Test”
Usability
#1
5
2014 2015
July
10
Banner navigation
13%
Oct
6
MVT
Title, copy, button
71%
Sep
3
Value prop
4%
Oct
16
Agency banner II
162%
Dec
7
Sam II
3%
Dec
1
Personalization
GEO
31%
Apr
2
Rotation speed
20%
Upper-funnel testing timeline
Nov
12
Sam
0%
Mar
17
Specific CTA
7%
Apr
13
Nav color
192%
Nov
25
Login expander
12%
Sep
30
Agency banner
33%
May
22
Simplify
433%
Oct
28
MVT
large button, font
Images
22%
6
Area tested
• Medicare banner
• In the rotating carousel on
Humana.com
• Three banner positions
• Rotation Speed: Six seconds
• Complex page with over 150
competing links
• Two years of iterative testing
7
Test #1: Radical redesign
433% Increase in
Medicare Traffic
More clicks into the Medicare
marketing funnel
Control
Treatment
May
22
Simplify
8
Test #7: GEO personalization
31% Increase in
Medicare Traffic
More clicks into the Medicare
marketing funnel
Control
Treatment
Dec
1
Personalization/
GEO
9
Test #10: Banner navigation
192% Increase in
Medicare Traffic
More clicks into the Medicare
marketing funnel
Control
Treatment
April
13
Banner Navigation
10
Deeper-funnel testing
1. Quoting | View-all-plans
2. Enrollment | Getting-started
3. Enrollment | Your Information
4. Enrollment | Cur – Prior – Cov
5. Quoting | Payment Details
6. Enrollment | Enrollment Review
7. Enrollment | Sign and Submit
8. Enrollment | Confirmation
3%
24%
38%
34%
3%
9%
91%
Fallout %
2.48% Conversion Rate
11
Control
Enrollment Test – View all plans
Treatment
11.1% Increase in
Completed Applications
12
Control Treatment
Enrollment Test – Getting started
5.9% Increase in Completed
Applications
13
14
Leadership
Department
Head
Analyst Analyst
Department
Head
Analyst
Communicate “top down” and “bottom up”
Top takeaway
Iterative testing has tremendous power to strengthen our customer theory and
provide the data necessary to break down internal resistance.
Thank You
Mike Loveridge

More Related Content

Similar to 2016 MarketingSherpa Summit - Mike Loveridge

Opticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOpticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum Impact
Optimizely
 
Hotel Digital Marketing Snapshot and Budgeting for 2016
Hotel Digital Marketing Snapshot and Budgeting for 2016Hotel Digital Marketing Snapshot and Budgeting for 2016
Hotel Digital Marketing Snapshot and Budgeting for 2016
Milestone Internet Marketing
 
Hotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
Hotel Digital Marketing Snapshot and How to Budget for 2016 WebinarHotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
Hotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
Milestone Internet Marketing
 
Social Media: Helping Customers Find the Farmer (part 3)
Social Media: Helping Customers Find the Farmer (part 3)Social Media: Helping Customers Find the Farmer (part 3)
Social Media: Helping Customers Find the Farmer (part 3)
Glenn Muske
 
Client analysis
Client analysisClient analysis
Client analysis
Ionut Danifeld
 
Milestone Webinar, Storytelling Websites That Convert
Milestone Webinar, Storytelling Websites That ConvertMilestone Webinar, Storytelling Websites That Convert
Milestone Webinar, Storytelling Websites That Convert
Milestone Internet Marketing
 
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
10 Louder
 
SplitMetrics answers burning questions on mobile A/B testing
SplitMetrics answers burning questions on mobile A/B testingSplitMetrics answers burning questions on mobile A/B testing
SplitMetrics answers burning questions on mobile A/B testing
SplitMetrics
 
Prove Marketing ROI with Campaign Tracking in #GoogleAnalytics
Prove Marketing ROI with Campaign Tracking in #GoogleAnalyticsProve Marketing ROI with Campaign Tracking in #GoogleAnalytics
Prove Marketing ROI with Campaign Tracking in #GoogleAnalytics
Converge Consulting
 
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
donordigital
 
Digital marketing trends for 2018
Digital marketing trends for 2018Digital marketing trends for 2018
Digital marketing trends for 2018
Smart Insights
 
The Content Selfie: What to Serve Your Customers to Make Them Want You
The Content Selfie: What to Serve Your Customers to Make Them Want YouThe Content Selfie: What to Serve Your Customers to Make Them Want You
The Content Selfie: What to Serve Your Customers to Make Them Want You
Social Media Today
 
Lean marketing master
Lean marketing masterLean marketing master
Lean marketing master
Brett Noyes
 
Excel with Enterprise SEO
Excel with Enterprise SEOExcel with Enterprise SEO
Excel with Enterprise SEO
Kirill Kronrod
 
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
Trustpilot
 
Optimizing Your Key Conversion Points: 5 Things You Might’ve Missed
Optimizing Your Key Conversion Points: 5 Things You Might’ve MissedOptimizing Your Key Conversion Points: 5 Things You Might’ve Missed
Optimizing Your Key Conversion Points: 5 Things You Might’ve Missed
Tinuiti
 
Content Marketing 101
Content Marketing 101Content Marketing 101
Content Marketing 101
Edric Ho
 
The Content Selfie - What To Serve Your Customers To Make Them Want You?
The Content Selfie - What To Serve Your Customers To Make Them Want You?The Content Selfie - What To Serve Your Customers To Make Them Want You?
The Content Selfie - What To Serve Your Customers To Make Them Want You?
Tangerine Lab
 
InsideLocal Webinar: Best Practices for Local Onsite Optimization
InsideLocal Webinar: Best Practices for Local Onsite OptimizationInsideLocal Webinar: Best Practices for Local Onsite Optimization
InsideLocal Webinar: Best Practices for Local Onsite Optimization
Myles Anderson
 
Campaign Operations: Tips to Scale your MOps in 2022
Campaign Operations: Tips to Scale your MOps in 2022Campaign Operations: Tips to Scale your MOps in 2022
Campaign Operations: Tips to Scale your MOps in 2022
Digital Pi - A Merkle Company
 

Similar to 2016 MarketingSherpa Summit - Mike Loveridge (20)

Opticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOpticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum Impact
 
Hotel Digital Marketing Snapshot and Budgeting for 2016
Hotel Digital Marketing Snapshot and Budgeting for 2016Hotel Digital Marketing Snapshot and Budgeting for 2016
Hotel Digital Marketing Snapshot and Budgeting for 2016
 
Hotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
Hotel Digital Marketing Snapshot and How to Budget for 2016 WebinarHotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
Hotel Digital Marketing Snapshot and How to Budget for 2016 Webinar
 
Social Media: Helping Customers Find the Farmer (part 3)
Social Media: Helping Customers Find the Farmer (part 3)Social Media: Helping Customers Find the Farmer (part 3)
Social Media: Helping Customers Find the Farmer (part 3)
 
Client analysis
Client analysisClient analysis
Client analysis
 
Milestone Webinar, Storytelling Websites That Convert
Milestone Webinar, Storytelling Websites That ConvertMilestone Webinar, Storytelling Websites That Convert
Milestone Webinar, Storytelling Websites That Convert
 
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
Getting Beyond Hype: Bridging the Gap Between Social Media Strategy and Execu...
 
SplitMetrics answers burning questions on mobile A/B testing
SplitMetrics answers burning questions on mobile A/B testingSplitMetrics answers burning questions on mobile A/B testing
SplitMetrics answers burning questions on mobile A/B testing
 
Prove Marketing ROI with Campaign Tracking in #GoogleAnalytics
Prove Marketing ROI with Campaign Tracking in #GoogleAnalyticsProve Marketing ROI with Campaign Tracking in #GoogleAnalytics
Prove Marketing ROI with Campaign Tracking in #GoogleAnalytics
 
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
What Has Your Donation Page Done for You Lately?: Testing, Optimization & Bes...
 
Digital marketing trends for 2018
Digital marketing trends for 2018Digital marketing trends for 2018
Digital marketing trends for 2018
 
The Content Selfie: What to Serve Your Customers to Make Them Want You
The Content Selfie: What to Serve Your Customers to Make Them Want YouThe Content Selfie: What to Serve Your Customers to Make Them Want You
The Content Selfie: What to Serve Your Customers to Make Them Want You
 
Lean marketing master
Lean marketing masterLean marketing master
Lean marketing master
 
Excel with Enterprise SEO
Excel with Enterprise SEOExcel with Enterprise SEO
Excel with Enterprise SEO
 
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
The 2017 eCommerce Marketer's Virtual Summit - Optimizing Your Key Conversion...
 
Optimizing Your Key Conversion Points: 5 Things You Might’ve Missed
Optimizing Your Key Conversion Points: 5 Things You Might’ve MissedOptimizing Your Key Conversion Points: 5 Things You Might’ve Missed
Optimizing Your Key Conversion Points: 5 Things You Might’ve Missed
 
Content Marketing 101
Content Marketing 101Content Marketing 101
Content Marketing 101
 
The Content Selfie - What To Serve Your Customers To Make Them Want You?
The Content Selfie - What To Serve Your Customers To Make Them Want You?The Content Selfie - What To Serve Your Customers To Make Them Want You?
The Content Selfie - What To Serve Your Customers To Make Them Want You?
 
InsideLocal Webinar: Best Practices for Local Onsite Optimization
InsideLocal Webinar: Best Practices for Local Onsite OptimizationInsideLocal Webinar: Best Practices for Local Onsite Optimization
InsideLocal Webinar: Best Practices for Local Onsite Optimization
 
Campaign Operations: Tips to Scale your MOps in 2022
Campaign Operations: Tips to Scale your MOps in 2022Campaign Operations: Tips to Scale your MOps in 2022
Campaign Operations: Tips to Scale your MOps in 2022
 

2016 MarketingSherpa Summit - Mike Loveridge

  • 1. Session Title MIKE LOVERIDGE Head of Digital Test and Learn Humana, Inc. How Humana's Strategic Testing Drove a 60% Increase in Customer Engagement
  • 2. Mike Loveridge Head of Digital Test and Learn Humana, Inc.
  • 4. 4 Month 1 Month 2 Month 3 Month 4 Month 5 Month 6 Low Funnel Optimize/Convert View All Plans Enrollment Funnel All funnel steps (1 step/test per week) Usability #2 Design #1 Integrate Winners Design #2 Super Test Optimize (1 test/week) The “Super Test” Usability #1
  • 5. 5 2014 2015 July 10 Banner navigation 13% Oct 6 MVT Title, copy, button 71% Sep 3 Value prop 4% Oct 16 Agency banner II 162% Dec 7 Sam II 3% Dec 1 Personalization GEO 31% Apr 2 Rotation speed 20% Upper-funnel testing timeline Nov 12 Sam 0% Mar 17 Specific CTA 7% Apr 13 Nav color 192% Nov 25 Login expander 12% Sep 30 Agency banner 33% May 22 Simplify 433% Oct 28 MVT large button, font Images 22%
  • 6. 6 Area tested • Medicare banner • In the rotating carousel on Humana.com • Three banner positions • Rotation Speed: Six seconds • Complex page with over 150 competing links • Two years of iterative testing
  • 7. 7 Test #1: Radical redesign 433% Increase in Medicare Traffic More clicks into the Medicare marketing funnel Control Treatment May 22 Simplify
  • 8. 8 Test #7: GEO personalization 31% Increase in Medicare Traffic More clicks into the Medicare marketing funnel Control Treatment Dec 1 Personalization/ GEO
  • 9. 9 Test #10: Banner navigation 192% Increase in Medicare Traffic More clicks into the Medicare marketing funnel Control Treatment April 13 Banner Navigation
  • 10. 10 Deeper-funnel testing 1. Quoting | View-all-plans 2. Enrollment | Getting-started 3. Enrollment | Your Information 4. Enrollment | Cur – Prior – Cov 5. Quoting | Payment Details 6. Enrollment | Enrollment Review 7. Enrollment | Sign and Submit 8. Enrollment | Confirmation 3% 24% 38% 34% 3% 9% 91% Fallout % 2.48% Conversion Rate
  • 11. 11 Control Enrollment Test – View all plans Treatment 11.1% Increase in Completed Applications
  • 12. 12 Control Treatment Enrollment Test – Getting started 5.9% Increase in Completed Applications
  • 13. 13
  • 15. Top takeaway Iterative testing has tremendous power to strengthen our customer theory and provide the data necessary to break down internal resistance.

Editor's Notes

  1. MODERATOR QUESTION: Tell us about your role in the company and how you and your company are trying to serve your customer.
  2. Shift in the insurance industry Humana corporate goal (+20% by 2020) Digital commitment WSJ Article QUE app Forrester + Responsive
  3. MODERATOR QUESTION: You did a big campaign and you got amazing results – for this session, we’re only focused on one aspect of that campaign – let’s talk about that MODERATOR QUESTION FOR VENDORS: What is one of the most surprising or interesting thing that you learned from working with marketers over this past year?
  4. MODERATOR QUESTION: You did a big campaign and you got amazing results – for this session, we’re only focused on one aspect of that campaign – let’s talk about that MODERATOR QUESTION FOR VENDORS: What is one of the most surprising or interesting thing that you learned from working with marketers over this past year?
  5. MODERATOR QUESTION: You did a big campaign and you got amazing results – for this session, we’re only focused on one aspect of that campaign – let’s talk about that MODERATOR QUESTION FOR VENDORS: What is one of the most surprising or interesting thing that you learned from working with marketers over this past year?
  6. \
  7. \