MEASURE WHAT MATTERSunderstanding measurement & roi for digital experiences
@FARRAHBOSTIC
4 THINGS:       WHY       WHAT       HOW(AND HOW TO SELL IT)
1. WHY YOU SHOULD MEASURE
BINGO                        TIME            SIGN- KPI         UPS                         ON        CPM       IMPRESSIONS...
A WORD OF CAUTIONI notice increasing reluctance onthe part of marketing executivesto use judgment; they are comingto rely ...
WHY DO METRICS MATTER?   1. Metrics reduce arguments based on opinion.   2. Metrics give you answers about what really wor...
WHAT ELSE CAN MEASUREMENT HELP YOU DO?                                                                                    ...
THERE ARE ONLY 3 RULES OF MEASUREMENTYour metrics will be as UNIQUE as your business.If metrics aren’t ACTIONABLE, they ar...
MEASURE WHAT MATTERS... TO WHOM? To your                      To your BUSINESS                   PROSPECT
IT’S EASY TO FOCUS ON VANITY METRICS                       “Numbers that make us                     look good but don’t r...
WHAT’S A VANITY METRIC?                                                          A lot of the time, we                    ...
WHAT MATTERS IS VALUE CREATION      To your                 To your      BUSINESS              PROSPECT           CONVERSI...
2. WHAT YOU SHOULD MEASURE
USE ‘PIRATE’ METRICSAcquisition: users from channels cometo site, landing page, widget, etcActivation: users enjoy 1st vis...
WHAT ARE SOME ‘VALUE’ METRICS?      To your                 To your      BUSINESS              PROSPECT           CONVERSI...
Acquisition - drawing people                  into the brand experienceTo yourBUSINESS          Revenue - converting visit...
BEWARE THE CTR...The starting metric for Acquisition isn’t CTR or “SiteVisits”...It’s CPA: Cost Per Acquisition(e.g., how ...
Activation - people enjoyed theexperience...                                        To yourRetention - enough to come     ...
HOW DO YOU MEASURE RETENTION & REFERRAL?      Returning      Visitors      Registered Users   Likes, +1s, RTs      Frequen...
VALUE CREATION =CREATING CUSTOMERS      To your                 To your      BUSINESS              PROSPECT           CONV...
SO WHAT’S MORE IMPORTANT?Brand growth comes from Acquisition.Contrary to popular belief, acquisition is actually cheaper,a...
BUT WHAT ABOUT THE OTHER STUFF?Brand attributes?Loyalty?Share of wallet?Media mix modeling?
THERE ARE MARKETING LAWSDouble Jeopardy Law: the lower market share brands in a markethave far fewer buyers in a time peri...
AND SOME INCONVENIENT TRUTHSUser bases seldom vary:Rival brands sell to very similar customer bases.Attitudes and brand be...
3. TOOLS YOU CAN USE FOR DIGITAL    EXPERIENCE MEASUREMENT
APPS & SITES HELP ANSWER QUESTIONS...                  I NEVER FELT LIKE I                     WAS LEARNING               ...
WHICH ONE IS MORE SUCCESSFUL?                                                           @37SIGNALShttp://www.slideshare.ne...
WHEN DOES SUCCESS HAPPEN?                                      EXTENDED SIGN-UP FUNNELhttp://www.slideshare.net/stueccles/...
WHERE IS SUCCESS COMING FROM?                                       COHORT METRICS - CREATED                              ...
DON’T HAVE ACCESS TO GOOGLE ANALYTICS?First -get access. :)Second -try QuantCast:Gives high-levelinsight into trafficsource...
OR THERE’S CHARTBEATFor $10/month, tryChartBeat. It providesreal-time tracking andengagement metrics likeuser paths, time ...
HACK THE METRICSUse unique links - through services like Bit.ly - totrack the behavior that a social mention or displayad ...
REMEMBER RULE 3 -    DON’T MEASURE EVERYTHING -[WE’RE LOOKING FOR WHAT MAKES MEANINGFUL DIFFERENCES]
TITLEMain Idea•Bullet•Bullet
TITLEMain Idea•Bullet•Bullet
TITLEMain Idea•Bullet•Bullet     GOOGLE BING
4. HOW DO YOU ‘SELL IT’
HOW TO TALK TO CLIENTS & COLLEAGUES ABOUT METRICS    Setting Goals   Accountability   Transparency      Assessing         ...
SETTING REASONABLE KPI’SWhat are the business objectives?What are the campaign objectives?What are the channels/touchpoint...
SUMMING UPMeasure what will teach you the most and help you make themost important decisions.Use bespoke, not off-the-shel...
THAT WAS FUN.
Measurement & ROI
Upcoming SlideShare
Loading in...5
×

Measurement & ROI

3,179

Published on

This is a revision to a presentation I gave at Hyper Island Master Class, and shared with a lunch & learn session hosted by Prudential Ad

Published in: Business, Technology

Transcript of "Measurement & ROI"

  1. 1. MEASURE WHAT MATTERSunderstanding measurement & roi for digital experiences
  2. 2. @FARRAHBOSTIC
  3. 3. 4 THINGS: WHY WHAT HOW(AND HOW TO SELL IT)
  4. 4. 1. WHY YOU SHOULD MEASURE
  5. 5. BINGO TIME SIGN- KPI UPS ON CPM IMPRESSIONS SITE CPA CPC REACH & FREQUENCY LIKES ENGAGEMENT PAGE LTV SENTIMENT ANALYSIS ROI VIEWS FOLLOWSMENTIONS CTR DOWNLOADS BRAND MEDIA MIX ATTRIBUTES MODELING SHARESALIENCE LIKEABILITY RECALL OF ?? WALLET
  6. 6. A WORD OF CAUTIONI notice increasing reluctance onthe part of marketing executivesto use judgment; they are comingto rely too much on research, andthey use it as a drunkard uses alamp post: for support, ratherthan for illumination.David Ogilvy
  7. 7. WHY DO METRICS MATTER? 1. Metrics reduce arguments based on opinion. 2. Metrics give you answers about what really works. 3. Metrics show you where you’re strong. 4. Metrics allow you to test anything you want. 5. Clients love metrics.http://bokardo.com/talks/metrics-driven-design-sxsw.pdf
  8. 8. WHAT ELSE CAN MEASUREMENT HELP YOU DO? UNDERSTAND CONTEXT OF BRAND & PRODUCT DETECT DEMAND EXPLORE CONSUMER SENTIMENT MENTIONS Now we can easily assess pre- Spontaneous product comments Digital makes it is easier toexisting demand among our target: and mentions reveal sentiment detect problems or possiblehow easy is user acquisition going around them, and help us areas for improvement related to be? overcome existing boundaries for products/service use. product adoption. DEFINE CONSUMERS’ OBSERVE SOCIAL GESTURES & CONTENT UNCOVER CONSUMER MOTIVATION MULTIPLE IDENTITIES INTERACTION Digital traces reveal important Understanding different Our targets’ gift-giving of content drivers of human behavior that identities our audience assumes gives us insights into where we we can use in shaping brand’s lets us help them in their role- can insert brand into their social online actions. playing and is also useful in exchanges. targeting.via @andjelicaaa
  9. 9. THERE ARE ONLY 3 RULES OF MEASUREMENTYour metrics will be as UNIQUE as your business.If metrics aren’t ACTIONABLE, they aren’t worth using.DON’T TRY TO MEASURE EVERYTHING.
  10. 10. MEASURE WHAT MATTERS... TO WHOM? To your To your BUSINESS PROSPECT
  11. 11. IT’S EASY TO FOCUS ON VANITY METRICS “Numbers that make us look good but don’t really help make decisions.” Eric Ries, The Lean Start-up
  12. 12. WHAT’S A VANITY METRIC? A lot of the time, we measure for a show reel, instead of for business results.http://bokardo.com/talks/metrics-driven-design-sxsw.pdf
  13. 13. WHAT MATTERS IS VALUE CREATION To your To your BUSINESS PROSPECT CONVERSION ENGAGEMENT
  14. 14. 2. WHAT YOU SHOULD MEASURE
  15. 15. USE ‘PIRATE’ METRICSAcquisition: users from channels cometo site, landing page, widget, etcActivation: users enjoy 1st visit, "happy"user experience *Retention: users re-visit multiple timesReferral: users like experience enough *to refer others via email, links, likes,blogs, widgets, word-of-mouth, etcRevenue: users buy, download, sign-uphttp://www.slideshare.net/dmc500hats/startup-metrics-for-pirates-long-version
  16. 16. WHAT ARE SOME ‘VALUE’ METRICS? To your To your BUSINESS PROSPECT CONVERSION ENGAGEMENT
  17. 17. Acquisition - drawing people into the brand experienceTo yourBUSINESS Revenue - converting visitors into customers Referral - converting customers into advocates CONVERSION
  18. 18. BEWARE THE CTR...The starting metric for Acquisition isn’t CTR or “SiteVisits”...It’s CPA: Cost Per Acquisition(e.g., how much did you spend to get a new user)But this by itself is irrelevantIf the CPA is higher than the lifetime value (LTV) of a newuser, you’re in trouble
  19. 19. Activation - people enjoyed theexperience... To yourRetention - enough to come PROSPECTback more than once...Referral - and recommendedthe experience to others ENGAGEMENT
  20. 20. HOW DO YOU MEASURE RETENTION & REFERRAL? Returning Visitors Registered Users Likes, +1s, RTs Frequency Mentions Time on Site Email referrals Daily Active Users
  21. 21. VALUE CREATION =CREATING CUSTOMERS To your To your BUSINESS PROSPECT CONVERSION ENGAGEMENT
  22. 22. SO WHAT’S MORE IMPORTANT?Brand growth comes from Acquisition.Contrary to popular belief, acquisition is actually cheaper,and more beneficial to the brand, than retention.Marketing should be geared toward Acquisition.Product & service design should be geared towardActivation & Retention.
  23. 23. BUT WHAT ABOUT THE OTHER STUFF?Brand attributes?Loyalty?Share of wallet?Media mix modeling?
  24. 24. THERE ARE MARKETING LAWSDouble Jeopardy Law: the lower market share brands in a markethave far fewer buyers in a time period and also lower brand loyalty.Retention Double Jeopardy: All brands lose some buyers; this loss isproportionate with market share.Pareto Law is 60/20 (not 80/20): Slightly more than half of a brand’ssales come from the top 20% of customers.Law of Buyer Moderation: Heavy buyers sometimes buy less often,light buyers sometimes buy more often, non-buyers sometimesbecome buyers.Law of Prototypicality: Image attributes that describe the productcategory score higher than less prototypical attributesDuplication of Purchase Law: A brand’s customer base overlaps withthe customer base of other brands, in line with their market share.
  25. 25. AND SOME INCONVENIENT TRUTHSUser bases seldom vary:Rival brands sell to very similar customer bases.Attitudes and brand beliefs reflect behavioral loyalty:Consumers know and say more about brands they use often,and they think and say little about brands they do not use.Usage drives attitude:Consumers like what they buy.
  26. 26. 3. TOOLS YOU CAN USE FOR DIGITAL EXPERIENCE MEASUREMENT
  27. 27. APPS & SITES HELP ANSWER QUESTIONS... I NEVER FELT LIKE I WAS LEARNING ANYTHING IMPORTANT
  28. 28. WHICH ONE IS MORE SUCCESSFUL? @37SIGNALShttp://www.slideshare.net/stueccles/lean-startup-metrics
  29. 29. WHEN DOES SUCCESS HAPPEN? EXTENDED SIGN-UP FUNNELhttp://www.slideshare.net/stueccles/lean-startup-metrics
  30. 30. WHERE IS SUCCESS COMING FROM? COHORT METRICS - CREATED PROJECThttp://www.slideshare.net/stueccles/lean-startup-metrics
  31. 31. DON’T HAVE ACCESS TO GOOGLE ANALYTICS?First -get access. :)Second -try QuantCast:Gives high-levelinsight into trafficsources, frequencyand volume to site,and basicdemographic andsocio-economic dataabout your visitors.And it’s free.
  32. 32. OR THERE’S CHARTBEATFor $10/month, tryChartBeat. It providesreal-time tracking andengagement metrics likeuser paths, time spentwith content, and micro-actions like clicks,downloads, and scrollsthat show whether peopleare actively engaging withthe site content.
  33. 33. HACK THE METRICSUse unique links - through services like Bit.ly - totrack the behavior that a social mention or displayad or site/page leads to.Stop paying for CPMs - pay for conversions (butdefine clearly what a ‘conversion’ is, and design adunits & digital experiences for conversionmoments).
  34. 34. REMEMBER RULE 3 - DON’T MEASURE EVERYTHING -[WE’RE LOOKING FOR WHAT MAKES MEANINGFUL DIFFERENCES]
  35. 35. TITLEMain Idea•Bullet•Bullet
  36. 36. TITLEMain Idea•Bullet•Bullet
  37. 37. TITLEMain Idea•Bullet•Bullet GOOGLE BING
  38. 38. 4. HOW DO YOU ‘SELL IT’
  39. 39. HOW TO TALK TO CLIENTS & COLLEAGUES ABOUT METRICS Setting Goals Accountability Transparency Assessing Optimizing Learning Effectiveness Good measurement practices improve: client-agency relationships insight design results
  40. 40. SETTING REASONABLE KPI’SWhat are the business objectives?What are the campaign objectives?What are the channels/touchpoints?What is the campaign experience & message?What do we expect people to do?
  41. 41. SUMMING UPMeasure what will teach you the most and help you make themost important decisions.Use bespoke, not off-the-shelf, metrics and measurementtools.Focus on ‘metrics’ that connect to value creation for thebusiness and drive brand growth.Don’t measure everything.
  42. 42. THAT WAS FUN.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×