SlideShare a Scribd company logo
1 of 17
A new approach to
the measurement of advertising effects
MODELING ADVERTISING EFFECTS
IN A MULTI-MEDIA ENVIRONMENT –
A LATENT CLASS LATENT MARKOV CHAIN APPROACH
Carsten Stig Poulsen, Professor, Ph.D., Copenhagen, Denmark
Pål Børresen, Schibsted Media Group, Schibsted ASA, Oslo, Norway
Presented at the AAA Annual Conference
Seattle, WA, March 17-20, 2016
1© Carsten Stig Poulsen & Schibsted Media Group
Plan of the presentation
• Short presentation of the illustrating case
• An overview of the modelling approach
• Focus on the underlying ideas and models –
no technical details
• Presentation of case results
• Future developments
• Q/A
2© Carsten Stig Poulsen & Schibsted Media Group
3
• During the summer 2011 Our Brand Chips ran a
campaign in Norway using TV, the Web, and outdoor
• Target groups were:
– Private households
• KPIs of the campaign
– (Ad recall)
– Awareness of the new potato chip with a rifled surface
– Perceived as more spicy
– Intention-to-buy
Presenting Our Brand Chips case
© Carsten Stig Poulsen & Schibsted Media Group
Presenting Our Brand Chips case
• The purpose of the project was to track the development
of these KPIs over time as a function of the campaign
• We wanted to track the effects of media, TV and the Web
• Examine if interactions between the media exist
• Propose a tool for predicting effects of changes in media
impact
• See whether the response to advertising is different
across various groups
4© Carsten Stig Poulsen & Schibsted Media Group
Media plan
5
GRPs according
to media
agency
© Carsten Stig Poulsen & Schibsted Media Group
Data collection
Panel design: same respondents across waves
6© Carsten Stig Poulsen & Schibsted Media Group
– Eating habits of chips
– Brands ever tasted
– Brand associations/attributes
• Well-spiced
• Has introduced a new type of rifled chip
• Tempting package design
• Crisp
• Best taste
– Purchase probability
– Bought last week
– Recall of ads in various media
– Media habits/usage
– Demographics (age, sex, geography)
7
Data collection
Questionnaire
© Carsten Stig Poulsen & Schibsted Media Group
dynamics
dynamics
©Carsten Stig Poulsen & Schibsted Media Group 8
Target groups
Goals of campaign (KPIs)
Budget
Media plan
Individual
media usage/habits
TV Print Web
Individual Exposures Model
(Imputed)
Exposures
TV
(Imputed)
Exposures
Print
(Imputed)
Exposures
Web
Individual Response Model
Segmentation
Simulation
model
What
-if
• Individual exposures (”OTS”) to advertising are the combined
result of
– Insertions from the media plan (under control at the aggregate level)
– Media usage/habits of the individual consumer (not under control)
• Individual exposures are modelled by a latent Markov model,
allowing for variation over individuals and time
• The states of the Markov chain are joint reading/viewing
probability for all media/media groups
• Individual exposures for each media group (TV, Print, Web, …)
are introduced into the Effect model as time-varying
covariates
• Individual exposures sum up to (aggregate) GRPs as a control
for the GRPs provided by the media bureau
9
The Exposure model
© Carsten Stig Poulsen & Schibsted Media Group
10
Distinction between
measured state and true
state
Correction for
response
uncertainty
True effect, i.e. the effect
when the variables have
been corrected for
measurement error
The point is that effects are more
easily uncovered when errors in
measurements are taken into account!
The Effects model
© Carsten Stig Poulsen & Schibsted Media Group
Current
panel wave
Previous
panel wave
Seen ad in TV
last week
Seen ad in TV
last week
ResponseResponse
GRP_TV(t)
GRP_Web(t)
GRP_TV(t)
GRP_Web(t)
11
Including the control
variables, GRPs, makes the
model suitable for ’what-if’
analyses, i.e. decision support
This can be done in two
ways:
• As aggregate GRPs that vary
over time
• As individual GRPs that vary
over time and respondents
However, they may give very
different information about
media effectiveness
© Carsten Stig Poulsen & Schibsted Media Group
The Effects model
Putting it all together
15
Extending the model
Hierarchy-of-effects hypotheses
0%
20%
40%
60%
80%
100%
7 8 9 10 11 12 13 14 15
Proportion
Week
Recall Association Purchase intent
© Carsten Stig Poulsen & Schibsted Media Group
• Each level in the hierarchy is seen as a separate process
• They work separately and interactively in creating the state of response
• Impacts of the media from the mediaplan work as individual, time-varying
covariates
Extending the model
Hierarcy-of-effects hypotheses & (unobserved) response heterogeneity
16
• (Latent) segments are formed by allowing people to have different preferences initially and
to react differently to TV advertising (different impact of GRP)
• We see very marked differences in the response to advertising
• The largest segment1 (73%) has barely noticed the campaign
• The preference segment 2 (27%) has seen the advertisement, understood the message, but
not received the new chip very well
• The two segments can be profiled in terms of standard criteria
0%
20%
40%
60%
80%
100%
7 8 9 10 11 12 13 14 15
Proportion
Week
Segment 1 - 73%
Recall Association Purchase intent
0%
20%
40%
60%
80%
100%
7 8 9 10 11 12 13 14 15
Proportion
Week
Segment 2 - 27%
Recall Association Purchase intent
© Carsten Stig Poulsen & Schibsted Media Group
©Carsten Stig Poulsen &
Schibsted Media Group
17
Extending the model
Short run and long run media effects
• Most advertising campaigns have effects that extend beyond the campaign
period
• Assuming underlying stationary processes these long run effects can be
projected
• Profitability of separate media and the entire campaign may change radically
when long run effects are accounted for
• With an individual, customer-centered model, predicting the
response to advertising, we are on the way to an optimization
model
• We will need
– The monitary value of the response, e.g. association of Our Brand
Chips to KPIs
– The costs of the elements in the media plan
– An objective function, e.g. maximizing the discounted stream of net
profits
• Currently, we are working on these and other extensions of
the model
18
Optimization
© Carsten Stig Poulsen & Schibsted Media Group
Thank you for your attention!
19© Carsten Stig Poulsen & Schibsted Media Group

More Related Content

What's hot

MarkHenning
MarkHenningMarkHenning
MarkHenningadtech
 
Social Application Development Strategy
Social Application Development StrategySocial Application Development Strategy
Social Application Development StrategyConvertiv
 
Globalpark Customer Success Briefs Summer09
Globalpark Customer Success Briefs Summer09Globalpark Customer Success Briefs Summer09
Globalpark Customer Success Briefs Summer09GLOBALPARK
 
Měření komunikačního efektu digitálních kampaní
Měření komunikačního efektu digitálních kampaní Měření komunikačního efektu digitálních kampaní
Měření komunikačního efektu digitálních kampaní SIMAR
 
Social Media in the marketing mix - Xm² 2013
Social Media in the marketing mix - Xm² 2013 Social Media in the marketing mix - Xm² 2013
Social Media in the marketing mix - Xm² 2013 Kris Decoodt
 
Patagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final PresentationPatagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final Presentationgitrerac
 
Patagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final PresentationPatagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final Presentationgitrerac
 
The Facebook Journey of Engagement
The Facebook Journey of EngagementThe Facebook Journey of Engagement
The Facebook Journey of EngagementVanina Leka
 
TV Sync: SearchSync Advertising
TV Sync: SearchSync AdvertisingTV Sync: SearchSync Advertising
TV Sync: SearchSync Advertisingwywy-com
 
Specific Media: Vitamin
Specific Media: VitaminSpecific Media: Vitamin
Specific Media: VitaminBrian Crotty
 
Vauxhall Retail: Case Study
Vauxhall Retail: Case StudyVauxhall Retail: Case Study
Vauxhall Retail: Case StudyNewsworks
 
Google Preferred Research Presentation
Google Preferred Research PresentationGoogle Preferred Research Presentation
Google Preferred Research PresentationModicum
 

What's hot (15)

MarkHenning
MarkHenningMarkHenning
MarkHenning
 
Social Application Development Strategy
Social Application Development StrategySocial Application Development Strategy
Social Application Development Strategy
 
COVID MARKETING IMPACT AND HOW MARKETERS ARE RESPONDING
COVID MARKETING IMPACT AND HOW MARKETERS ARE RESPONDINGCOVID MARKETING IMPACT AND HOW MARKETERS ARE RESPONDING
COVID MARKETING IMPACT AND HOW MARKETERS ARE RESPONDING
 
Globalpark Customer Success Briefs Summer09
Globalpark Customer Success Briefs Summer09Globalpark Customer Success Briefs Summer09
Globalpark Customer Success Briefs Summer09
 
Měření komunikačního efektu digitálních kampaní
Měření komunikačního efektu digitálních kampaní Měření komunikačního efektu digitálních kampaní
Měření komunikačního efektu digitálních kampaní
 
Social Media in the marketing mix - Xm² 2013
Social Media in the marketing mix - Xm² 2013 Social Media in the marketing mix - Xm² 2013
Social Media in the marketing mix - Xm² 2013
 
Patagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final PresentationPatagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final Presentation
 
Patagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final PresentationPatagonia Digital Strategy Final Presentation
Patagonia Digital Strategy Final Presentation
 
The Facebook Journey of Engagement
The Facebook Journey of EngagementThe Facebook Journey of Engagement
The Facebook Journey of Engagement
 
Measuring the Effectiveness of Cross Media Campaigns
Measuring the Effectiveness of Cross Media CampaignsMeasuring the Effectiveness of Cross Media Campaigns
Measuring the Effectiveness of Cross Media Campaigns
 
TV Sync: SearchSync Advertising
TV Sync: SearchSync AdvertisingTV Sync: SearchSync Advertising
TV Sync: SearchSync Advertising
 
Specific Media: Vitamin
Specific Media: VitaminSpecific Media: Vitamin
Specific Media: Vitamin
 
Megaimage case study
Megaimage case studyMegaimage case study
Megaimage case study
 
Vauxhall Retail: Case Study
Vauxhall Retail: Case StudyVauxhall Retail: Case Study
Vauxhall Retail: Case Study
 
Google Preferred Research Presentation
Google Preferred Research PresentationGoogle Preferred Research Presentation
Google Preferred Research Presentation
 

Similar to Presentation AAA 2016

Notes Version: Best Practices and New Practices in Insert Media
Notes Version: Best Practices and New Practices in Insert MediaNotes Version: Best Practices and New Practices in Insert Media
Notes Version: Best Practices and New Practices in Insert MediaVivastream
 
Notes Version: Take the Risk Out of Starting Over in Healthcare Marketing
Notes Version: Take the Risk Out of Starting Over in Healthcare MarketingNotes Version: Take the Risk Out of Starting Over in Healthcare Marketing
Notes Version: Take the Risk Out of Starting Over in Healthcare MarketingVivastream
 
Colin Gray strategic planning portfolio
Colin Gray strategic planning portfolioColin Gray strategic planning portfolio
Colin Gray strategic planning portfolioColin Gray
 
May Your Data be Measurable and Right
May Your Data be Measurable and Right May Your Data be Measurable and Right
May Your Data be Measurable and Right Tinuiti
 
Planning an Advertising Campaign
Planning an Advertising CampaignPlanning an Advertising Campaign
Planning an Advertising CampaignVirtu Institute
 
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...Richard Houghton
 
Best Practices and New Practices in Insert Media
Best Practices and New Practices in Insert MediaBest Practices and New Practices in Insert Media
Best Practices and New Practices in Insert MediaVivastream
 
Taking the path of excellence in media planning
Taking the path of excellence in media planningTaking the path of excellence in media planning
Taking the path of excellence in media planningRobert Stupak
 
Advertising galaxy-tab-campaign
Advertising galaxy-tab-campaignAdvertising galaxy-tab-campaign
Advertising galaxy-tab-campaignBruce Hnin
 
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...Demandbase
 
Mkt640 u4 ip_2011e.sonson
Mkt640 u4 ip_2011e.sonsonMkt640 u4 ip_2011e.sonson
Mkt640 u4 ip_2011e.sonsonelisha22
 
The Always-On Approach: How to Continually Improve Your Streaming Advertising...
The Always-On Approach: How to Continually Improve Your Streaming Advertising...The Always-On Approach: How to Continually Improve Your Streaming Advertising...
The Always-On Approach: How to Continually Improve Your Streaming Advertising...Tinuiti
 
Philips Andre Manning: Planning, research & accountability
Philips Andre Manning: Planning, research & accountabilityPhilips Andre Manning: Planning, research & accountability
Philips Andre Manning: Planning, research & accountabilityVPRA
 
AppForum Presentation: Not-for-Profit Campaign Implementation
AppForum Presentation: Not-for-Profit Campaign ImplementationAppForum Presentation: Not-for-Profit Campaign Implementation
AppForum Presentation: Not-for-Profit Campaign Implementationcamillemarti
 
Passport to Marketing - Media Agency - chị Linh Lê.pdf
Passport to Marketing - Media Agency - chị Linh Lê.pdfPassport to Marketing - Media Agency - chị Linh Lê.pdf
Passport to Marketing - Media Agency - chị Linh Lê.pdfssuser609133
 
TitleABC123 Version X1Marketing Plan Outline and Time.docx
TitleABC123 Version X1Marketing Plan Outline and Time.docxTitleABC123 Version X1Marketing Plan Outline and Time.docx
TitleABC123 Version X1Marketing Plan Outline and Time.docxjuliennehar
 

Similar to Presentation AAA 2016 (20)

Aamir abbasi IoBM
Aamir abbasi IoBMAamir abbasi IoBM
Aamir abbasi IoBM
 
Notes Version: Best Practices and New Practices in Insert Media
Notes Version: Best Practices and New Practices in Insert MediaNotes Version: Best Practices and New Practices in Insert Media
Notes Version: Best Practices and New Practices in Insert Media
 
Notes Version: Take the Risk Out of Starting Over in Healthcare Marketing
Notes Version: Take the Risk Out of Starting Over in Healthcare MarketingNotes Version: Take the Risk Out of Starting Over in Healthcare Marketing
Notes Version: Take the Risk Out of Starting Over in Healthcare Marketing
 
Colin Gray strategic planning portfolio
Colin Gray strategic planning portfolioColin Gray strategic planning portfolio
Colin Gray strategic planning portfolio
 
May Your Data be Measurable and Right
May Your Data be Measurable and Right May Your Data be Measurable and Right
May Your Data be Measurable and Right
 
Planning an Advertising Campaign
Planning an Advertising CampaignPlanning an Advertising Campaign
Planning an Advertising Campaign
 
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...
Corporate Communications Directors' Forum 2014: Evaluation & Corporate Commun...
 
Best Practices and New Practices in Insert Media
Best Practices and New Practices in Insert MediaBest Practices and New Practices in Insert Media
Best Practices and New Practices in Insert Media
 
Taking the path of excellence in media planning
Taking the path of excellence in media planningTaking the path of excellence in media planning
Taking the path of excellence in media planning
 
Mind Measure Planner
Mind Measure PlannerMind Measure Planner
Mind Measure Planner
 
Advertising galaxy-tab-campaign
Advertising galaxy-tab-campaignAdvertising galaxy-tab-campaign
Advertising galaxy-tab-campaign
 
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...
Forrester B2B Summit 2021 - Splunk Shares How to Operationalize Industry Init...
 
The ROI of content marketing
The ROI of content marketingThe ROI of content marketing
The ROI of content marketing
 
Mkt640 u4 ip_2011e.sonson
Mkt640 u4 ip_2011e.sonsonMkt640 u4 ip_2011e.sonson
Mkt640 u4 ip_2011e.sonson
 
The Always-On Approach: How to Continually Improve Your Streaming Advertising...
The Always-On Approach: How to Continually Improve Your Streaming Advertising...The Always-On Approach: How to Continually Improve Your Streaming Advertising...
The Always-On Approach: How to Continually Improve Your Streaming Advertising...
 
Philips Andre Manning: Planning, research & accountability
Philips Andre Manning: Planning, research & accountabilityPhilips Andre Manning: Planning, research & accountability
Philips Andre Manning: Planning, research & accountability
 
AppForum Presentation: Not-for-Profit Campaign Implementation
AppForum Presentation: Not-for-Profit Campaign ImplementationAppForum Presentation: Not-for-Profit Campaign Implementation
AppForum Presentation: Not-for-Profit Campaign Implementation
 
Passport to Marketing - Media Agency - chị Linh Lê.pdf
Passport to Marketing - Media Agency - chị Linh Lê.pdfPassport to Marketing - Media Agency - chị Linh Lê.pdf
Passport to Marketing - Media Agency - chị Linh Lê.pdf
 
Nielson Facebook Reach Study
Nielson Facebook Reach StudyNielson Facebook Reach Study
Nielson Facebook Reach Study
 
TitleABC123 Version X1Marketing Plan Outline and Time.docx
TitleABC123 Version X1Marketing Plan Outline and Time.docxTitleABC123 Version X1Marketing Plan Outline and Time.docx
TitleABC123 Version X1Marketing Plan Outline and Time.docx
 

Presentation AAA 2016

  • 1. A new approach to the measurement of advertising effects MODELING ADVERTISING EFFECTS IN A MULTI-MEDIA ENVIRONMENT – A LATENT CLASS LATENT MARKOV CHAIN APPROACH Carsten Stig Poulsen, Professor, Ph.D., Copenhagen, Denmark Pål Børresen, Schibsted Media Group, Schibsted ASA, Oslo, Norway Presented at the AAA Annual Conference Seattle, WA, March 17-20, 2016 1© Carsten Stig Poulsen & Schibsted Media Group
  • 2. Plan of the presentation • Short presentation of the illustrating case • An overview of the modelling approach • Focus on the underlying ideas and models – no technical details • Presentation of case results • Future developments • Q/A 2© Carsten Stig Poulsen & Schibsted Media Group
  • 3. 3 • During the summer 2011 Our Brand Chips ran a campaign in Norway using TV, the Web, and outdoor • Target groups were: – Private households • KPIs of the campaign – (Ad recall) – Awareness of the new potato chip with a rifled surface – Perceived as more spicy – Intention-to-buy Presenting Our Brand Chips case © Carsten Stig Poulsen & Schibsted Media Group
  • 4. Presenting Our Brand Chips case • The purpose of the project was to track the development of these KPIs over time as a function of the campaign • We wanted to track the effects of media, TV and the Web • Examine if interactions between the media exist • Propose a tool for predicting effects of changes in media impact • See whether the response to advertising is different across various groups 4© Carsten Stig Poulsen & Schibsted Media Group
  • 5. Media plan 5 GRPs according to media agency © Carsten Stig Poulsen & Schibsted Media Group
  • 6. Data collection Panel design: same respondents across waves 6© Carsten Stig Poulsen & Schibsted Media Group
  • 7. – Eating habits of chips – Brands ever tasted – Brand associations/attributes • Well-spiced • Has introduced a new type of rifled chip • Tempting package design • Crisp • Best taste – Purchase probability – Bought last week – Recall of ads in various media – Media habits/usage – Demographics (age, sex, geography) 7 Data collection Questionnaire © Carsten Stig Poulsen & Schibsted Media Group
  • 8. dynamics dynamics ©Carsten Stig Poulsen & Schibsted Media Group 8 Target groups Goals of campaign (KPIs) Budget Media plan Individual media usage/habits TV Print Web Individual Exposures Model (Imputed) Exposures TV (Imputed) Exposures Print (Imputed) Exposures Web Individual Response Model Segmentation Simulation model What -if
  • 9. • Individual exposures (”OTS”) to advertising are the combined result of – Insertions from the media plan (under control at the aggregate level) – Media usage/habits of the individual consumer (not under control) • Individual exposures are modelled by a latent Markov model, allowing for variation over individuals and time • The states of the Markov chain are joint reading/viewing probability for all media/media groups • Individual exposures for each media group (TV, Print, Web, …) are introduced into the Effect model as time-varying covariates • Individual exposures sum up to (aggregate) GRPs as a control for the GRPs provided by the media bureau 9 The Exposure model © Carsten Stig Poulsen & Schibsted Media Group
  • 10. 10 Distinction between measured state and true state Correction for response uncertainty True effect, i.e. the effect when the variables have been corrected for measurement error The point is that effects are more easily uncovered when errors in measurements are taken into account! The Effects model © Carsten Stig Poulsen & Schibsted Media Group
  • 11. Current panel wave Previous panel wave Seen ad in TV last week Seen ad in TV last week ResponseResponse GRP_TV(t) GRP_Web(t) GRP_TV(t) GRP_Web(t) 11 Including the control variables, GRPs, makes the model suitable for ’what-if’ analyses, i.e. decision support This can be done in two ways: • As aggregate GRPs that vary over time • As individual GRPs that vary over time and respondents However, they may give very different information about media effectiveness © Carsten Stig Poulsen & Schibsted Media Group The Effects model
  • 12. Putting it all together
  • 13. 15 Extending the model Hierarchy-of-effects hypotheses 0% 20% 40% 60% 80% 100% 7 8 9 10 11 12 13 14 15 Proportion Week Recall Association Purchase intent © Carsten Stig Poulsen & Schibsted Media Group • Each level in the hierarchy is seen as a separate process • They work separately and interactively in creating the state of response • Impacts of the media from the mediaplan work as individual, time-varying covariates
  • 14. Extending the model Hierarcy-of-effects hypotheses & (unobserved) response heterogeneity 16 • (Latent) segments are formed by allowing people to have different preferences initially and to react differently to TV advertising (different impact of GRP) • We see very marked differences in the response to advertising • The largest segment1 (73%) has barely noticed the campaign • The preference segment 2 (27%) has seen the advertisement, understood the message, but not received the new chip very well • The two segments can be profiled in terms of standard criteria 0% 20% 40% 60% 80% 100% 7 8 9 10 11 12 13 14 15 Proportion Week Segment 1 - 73% Recall Association Purchase intent 0% 20% 40% 60% 80% 100% 7 8 9 10 11 12 13 14 15 Proportion Week Segment 2 - 27% Recall Association Purchase intent © Carsten Stig Poulsen & Schibsted Media Group
  • 15. ©Carsten Stig Poulsen & Schibsted Media Group 17 Extending the model Short run and long run media effects • Most advertising campaigns have effects that extend beyond the campaign period • Assuming underlying stationary processes these long run effects can be projected • Profitability of separate media and the entire campaign may change radically when long run effects are accounted for
  • 16. • With an individual, customer-centered model, predicting the response to advertising, we are on the way to an optimization model • We will need – The monitary value of the response, e.g. association of Our Brand Chips to KPIs – The costs of the elements in the media plan – An objective function, e.g. maximizing the discounted stream of net profits • Currently, we are working on these and other extensions of the model 18 Optimization © Carsten Stig Poulsen & Schibsted Media Group
  • 17. Thank you for your attention! 19© Carsten Stig Poulsen & Schibsted Media Group