Co-Authored with Chad Hallert of Noble Studios Data drives decisions at Renown Health, but that didn’t happen overnight, or by accident. With the right strategy and a few tools of the trade, its digital teams now leverage measurement plans, customized Google Analytics reports and more to inform marketing strategies, improve the online patient experience and integrate company silos. This session will give you a five-step plan to establish your own measurement plan and act quickly and decisively on data. Go beyond “vanity metrics” like sessions and pageviews and learn how to identify what information matters, how to report it effectively and how to build a culture of continuous, measurable improvements.

1. Confidential. Intellectual property of Noble Studios.
Your 5 step plan to beat analysis paralysis, trump
opinions and make better decisions
Healthcare Internet Conference · 2016

2. Confidential. Intellectual property of Noble Studios.
About Your Speakers
2
Alex Schneider
Supervisor of Web
aschneider@renown.org
Chad Hallert
Director of Digital Strategy
chad.hallert@noblestudios.com
• 15 Years in Digital Marketing
• Direct Marketing News 40 under 40
• Instructor at the University of Nevada
• 9 years in healthcare web & IT
• Lead strategist for Renown Health Web
and Emerging media

3. Confidential. Intellectual property of Noble Studios.
• 6+ years working together
• Started with web development
• Currently partner on
• Development
• Content Strategy
• Digital Advertising
• Analytics
• SEM/SEO
• Conversion Rate Optimization
Renown / Noble Partnership
3

4. Confidential. Intellectual property of Noble Studios.
Objectives
• Review our 5 step plan
• Share strategies & techniques to better utilize analytics
• Review real life examples and lessons learned from Renown Health
Our Goals for Today
4

5. Confidential. Intellectual property of Noble Studios. 5

6. Confidential. Intellectual property of Noble Studios.
1. Establish a measurement plan
2. Go beyond vanity metrics
3. Make it actionable
4. Report effectively
5. Create a culture of optimization
The Plan
6

7. Confidential. Intellectual property of Noble Studios.
Establish a Measurement Plan
Step 1

8. Confidential. Intellectual property of Noble Studios. 8

9. Confidential. Intellectual property of Noble Studios.
Why does your website exist?
In healthcare:
• Increase Patient Acquisition
• Reduce Operational Costs
• Promote Health and Wellness
Define What Really Matters to You?
9

10. Confidential. Intellectual property of Noble Studios.
Goals should provide value to both the
business and the customer.
One-sided relationships rarely last.
What We
Want
What Our
Patients
Want
Don’t Forget You’re In a Relationship
10
Your Goals

11. Confidential. Intellectual property of Noble Studios.
Components of a Measurement Plan
11

12. Confidential. Intellectual property of Noble Studios.
Aligning Metrics, Goals and Objectives
12
Source: Avinash Kaushik

13. Confidential. Intellectual property of Noble Studios.
Renown Example
13

14. Confidential. Intellectual property of Noble Studios.
Idea Action Metric
Business
Goal
The End Result
14
Strategy

15. Confidential. Intellectual property of Noble Studios.
Go Beyond Vanity Metrics
Step 2

16. Confidential. Intellectual property of Noble Studios.
- Mark Twain
“There are three kinds of
lies: lies, damned lies
& statistics.”
16

17. Confidential. Intellectual property of Noble Studios.
“They are easily manipulated, and do
not necessarily correlate to the
numbers that really matter…”
- Tech Crunch
“A vanity metric is a metric that has no
direct link with the overarching aim of
your business goal to increase sales
and revenue.”
- Marketing Profs
What are Vanity Metrics?
17

18. Confidential. Intellectual property of Noble Studios.
• Make us “feel good”
• Are way easier to define and achieve
• Are a distraction
• Ultimately devalue the impact of digital
• Won’t pass the ‘non-web’ sniff test
But, remember… If a metric does correlate directly to a business objective, it’s not a vanity metric.
We would add, Vanity Metrics…
18

19. Confidential. Intellectual property of Noble Studios.
• Number of “likes”
• Number of “shares”
• Number of “followers”
• Number of “downloads”
• Number of “pageviews”
Standard Vanity Metrics
19

20. Confidential. Intellectual property of Noble Studios.
• Measures success at your core business
• Directly relates to revenue or cost
savings
• Tracks real customers and prospects
• Illustrates cause and effect
• Leads to a hypothesis
Actionable Metrics
20

21. Confidential. Intellectual property of Noble Studios.
Macro Conversions = Value
Micro Conversions = Context
Macro vs. Micro Conversions
21

22. Confidential. Intellectual property of Noble Studios. 22
Conversions over time
Virtual Check-in – Year over Year
Site Traffic Goal Completions
▴ 20.4% ▴ 41.6%
Past
• Paid media targeting was based on:
• Impressions
• Clicks to the site
Today
• Paid media targeting is based on:
• Engagement
• Conversions
• Repeat visitor rate Budget
↓ 3%
Renown Example

23. Confidential. Intellectual property of Noble Studios.
Make it Actionable
Step 3
23

24. Confidential. Intellectual property of Noble Studios.
Metric/Goal
Hypothesis
Experiment
Act
How to Approach Analytics
24
Source: Alistair Croll

25. Confidential. Intellectual property of Noble Studios.
Metric/Goal
Hypothesis
Experiment
Act
How to Approach Analytics
25
What do you want to
improve?
Make an educated guess on
how to improve and test
Source: Alistair Croll
Who? What? Why?
Review, implement change,
document, re-test

26. Confidential. Intellectual property of Noble Studios.
But, first…
26

27. Confidential. Intellectual property of Noble Studios. 27

28. Confidential. Intellectual property of Noble Studios. 28

29. Confidential. Intellectual property of Noble Studios. 29

30. Confidential. Intellectual property of Noble Studios.
How many changes did you see?
30

31. Confidential. Intellectual property of Noble Studios.
You can’t focus on everything
31
You may miss big changes, make sure you are looking at what matters to your business

32. Confidential. Intellectual property of Noble Studios.
You can’t focus on everything
32
You may miss big changes, make sure you are looking at what matters to your business
4 changes – background, eye color, tie color, missing arm

33. Confidential. Intellectual property of Noble Studios.
How do you eliminate noise and track what matters to your organization?
We use:
• Custom events
• Custom segments
• Custom dashboards
Too many inputs?
33

34. Confidential. Intellectual property of Noble Studios.
Custom Events
Label
Action
Category Request an
Appointment
Virtual Visit
$ value
Urgent Care
Check-in
Urgent Care
Location
Primary Care
Appointment
Lab
Appointment
New patient
Returning
Patient

35. Confidential. Intellectual property of Noble Studios.
Custom Segments
35
Audience
• Age Group
• Gender
• Device
• Location
Acquisition
• Organic Search
• Paid Search
• Banner Ads
• Adwords
• Email
• Referral
Behavior
• # of Sessions
• Content Viewed
• Actions Taken
• Page Depth
• Site Search
Users
Outcomes
• Macro Conv.
• Appt. request
• MyChart login
• Micro Conv.
• Subscribe
• Video play
• Custom event

36. Confidential. Intellectual property of Noble Studios.
Google Analytics Dashboards
36
• Create dashboards that match your
measurement plan
• Reduce time spent in Excel
• Combine goals, custom events, and
segments into a single view
• Automate via email
• Drive conversations about analytics

37. Confidential. Intellectual property of Noble Studios.
Why do these matter?
37
Custom
Events
•Focus on what matters
Custom
Segments
•Understand audiences and behaviors that
drive your objectives
Custom
Dashboards
•Improve reporting
efficiency, depth, and
frequency

38. Confidential. Intellectual property of Noble Studios.
0
100
200
300
400
500
600
700
800
900
Oct Nov Dec Jan Feb Mar
Description
• Goal: Optimize Business
Performance & Improve Patient
Care
• Idea: Can we increase the number
of appointments requested online?
• Action: Review appointment
workflows and identify user flows
• Metric: Appointment request count
Renown Example
38
Optimized based on
analytics review
▴ 164.5%
Appts. Requested

39. Confidential. Intellectual property of Noble Studios.
Report Effectively
Step 4
39

40. Confidential. Intellectual property of Noble Studios.
Effective Reporting:
• Increases understanding
• Improves engagement
• Gains buy-in
• Builds trust
• Includes a “so what” and “what’s next”
Standard Reporting:
• Can alienate the audience
• Can seem self serving
• Can create confusion
• Does not provide an opportunity for
action
Standard Reporting vs. Effective Reporting
40

41. Confidential. Intellectual property of Noble Studios.
Make it Visual: Tables vs. Charts
Medium Conversions
CPC 247
Direct 258
Organic search 1379
Referral 802
1,379
802
258 247
Organic
search
Referral Direct CPC
Organic
search
51%Referral
30%
Direct
10% CPC
9%
Conversions by Medium
VS.

42. Confidential. Intellectual property of Noble Studios.
• Understand that different audiences
need different levels of detail
• Anticipate their needs
• Don’t be afraid to ask what’s important to
them
• Know how much time you have and
respect that
• Start with what’s most important
• 1) Tell them what your going to tell them,
then 2) tell them, then 3) remind them what
you just told them
Know Your Audience What do I need to know
to help my team

43. Confidential. Intellectual property of Noble Studios.
• Data should support or dissuade an
idea
• Make sure to give context
• Eliminate noise & distractions
• Tell the whole story
• Not just what you hoped the data would say
• Define next steps and actions
Never present
anything you
cannot explain
Tell a Story
!

44. Don’t forget…

45. Confidential. Intellectual property of Noble Studios.
Create a Culture of Optimization
Step 5
45

46. Confidential. Intellectual property of Noble Studios.
How Do You View Your Website?
46

47. Confidential. Intellectual property of Noble Studios.
“Optimization is the ongoing, data driven process of continually discovering and
quantifying the most effective experience for your customers.”
- Adobe
Defining Optimization
47

48. Confidential. Intellectual property of Noble Studios.
Become More Data Driven
48

49. Confidential. Intellectual property of Noble Studios.
Let Everyone See They Can Be Wrong
49

50. Confidential. Intellectual property of Noble Studios.
Renown Example
50
Original
Variation Clicks
Original -
Variation +57%
The Test
• 60 days
• 77,000 sessions
• New users
• Desktop devices

51. Confidential. Intellectual property of Noble Studios.
What to AB test?
51
• Layout/Design
• Call to action text
• Ad content
• Email
• Subject Line
• Send date
• Advertising Strategy
• Lifestyle/Doctors/Technology

52. Confidential. Intellectual property of Noble Studios.
• Involve the whole organization
• Make it easy to submit ideas
• Make results highly visible
• Embrace both “winning” and “losing”
equally
Make it a Team Sport
52

53. Confidential. Intellectual property of Noble Studios.
• Starbucks card for any test ideas used
• Additional reward for any ideas that
result in a positive improvement
• Publically celebrate testing ideas that
improve the business
Add Some Rewards
53

54. Confidential. Intellectual property of Noble Studios.
Get a Statistics Champion or a GREAT Tool
54

55. Confidential. Intellectual property of Noble Studios.
Renown Example
55
Version A Version B
Can we increase engagement on our blog?

56. Confidential. Intellectual property of Noble Studios.
Renown Example
56
Version A
• Original Design
• Included
• Weather
• Polls
• Pinterest feature
• Submit a story form
• Submit a recognition for our
staff
Version B
• Based off hypothesis derived
from tracked metrics
• Included
• Popular stories
• Promotional feature
▴ 2.2%
Pages/sessions
▾ 6.5%
Bounce Rate
90 day test

57. Confidential. Intellectual property of Noble Studios.
“It doesn’t matter
how slowly you
go, as long as you
don’t stop”
- Confucius
57

58. Confidential. Intellectual property of Noble Studios.
Putting It All Together
58

59. Confidential. Intellectual property of Noble Studios.
5 Steps
1. Establish measurement plan
2. Go beyond vanity metrics
3. Make it actionable
4. Report effectively
5. Create a culture of optimization
Putting it all together
59

60. Confidential. Intellectual property of Noble Studios.
Visit NobleStudios.com/HCIC to download the
5 Step Plan
Thank you!
60