SlideShare a Scribd company logo
Understanding Attribution (<30 mins)
        Doug Conely | Senior Director, Global Data & Targeting

          Andrew Newman | Senior Director, Global Insights


                                                                 2011
Safe
                           Organisation
            Environments


    Insights                           Integrated
                                      Technology



Advanced                              Smart Supply
Targeting                             Acquisition


              Creative        Data
             Solutions        Network
Safe
                           Organisation
            Environments


    Insights                           Integrated
                                      Technology



Advanced                              Smart Supply
Targeting                             Acquisition


              Creative        Data
             Solutions        Network
Safe
                           Organisation
            Environments


    Insights                           Integrated
                                      Technology



Advanced                              Smart Supply
Targeting                             Acquisition


              Creative        Data
             Solutions        Network
Different ways to ask “is my advertising working?”




                          Attribution




              Audience                  Effectiveness
              Analytics                   Measures
Attribution

Attribution
                                                     Audience       Effectiveness
                                                     Analytics        Measures




                         “Half the money I spend on advertising
                          is wasted; the trouble is I don't know
                             which half.” - John Wanamaker

 “How do I know I’m paying the
 right people and allocating the
        right media mix?”


                           “If I ran a football team how do I
                              decide to pay each player?”
The perils of poor attribution    … and what you can do about it
control and analysis…

1 Paying more than once for the
   same conversion

2 Encourages bad practice
   among display participants                  ?
3 Spend optimised to the
   “wrong” media partners
Search only attribution


                                          +1
                          Brand keyword
                              click
Search only attribution


                                                                                         +1
                                                     Brand keyword
                                                         click


 100%
                                                                     Illustrative

  80%


  60%

                                                                                              Search
  40%
                                                                                              Display

  20%


  0%
          Last     Last -1   Last -2   Last -3   Last -4   Last -5   Last -6   Last -7
        exposure
Click to conversion measurement


                                               +1
                                  Display ad
                                     click




Conversion behaviours
Click to conversion measurement


                                                     +1
                                        Display ad
                                           click




Click behaviours




http://blog.tribalfusion.co.uk/?p=116
Search and display in combination


                                                                     +1
                              Display ad   Brand keyword
                              impression       click




                 Display ad                           Display ad
                 impression                           impression




                                                     Brand keyword
                                                         click


                   +1                                     >1?
Search and display in combination


                                                     +1
                        Display ad   Brand keyword
                        impression       click
Last view attribution


                                                                                                    +1
        Site visit         Display ad        Display ad        Display ad
                          impression 1      impression 2      impression 3




http://www.exchangewire.com/blog/2010/11/24/spray-and-pray-baby-the-insider-view-on-the-dysfunctional-state-of-display/
Last view attribution


                                                                                     +1
    Site visit        Display ad     Display ad     Display ad
                     impression 1   impression 2   impression 3




                 Wimbledon 1998 FA Cup                 Barcelona 2011 European Cup
Last view attribution


                                                              +1
    Site visit    Display ad     Display ad     Display ad
                 impression 1   impression 2   impression 3
With attribution you are never done…


                                                                   +1
   Display ad     Generic product    Display ad    Brand keyword
  impression 1   keyword searches   impression 2      searches
Remember that everyone has a vested interest here…


                      Move away from last ad view but still want a higher mix
                      for online display

                      Need to protect last click search business. Still >80% of
                      revenues



                      Convince you current tag management is not sufficient


                      You’re duplicating payments so they can save you
                      money and you need their models to improve ROI


                      You need to switch to a Havas or Group M agency
The perils of poor attribution    … and what you can do about it
control and analysis…

1 Paying more than once for the
   same conversion
                                  1 Attribution analysis framework

2 Encourages bad practice         2 Campaign data collection
   among display participants
                                  3 Tag management instrumentation
3 Spend optimised to the
   “wrong” media partners
1      Attribution analysis framework |Even attribution weighting


                    Attribution weighting


                        20%

                                            40%   Originator
                                                  Converter
                                                  Assist

                        40%




> This is a great starting place but not the end goal


Source: http://c3metrics.com/white-paper/
2   Campaign data collection



Social Media   SEM/ SEO         Display   Affiliates   Email
3   Tag management instrumentation
TF approach: dynamic regression attribution models


Attribution in the
                     Campaign    Attribution   Campaign
typical campaign
lifecycle
                      Delivery    Analysis      Planning




Attribution as
part of campaign
                     Campaign
optimisation          Delivery
The perils of poor attribution    … and what you can do about it
control and analysis…

1 Paying more than once for the
   same conversion
                                  1 Attribution analysis framework

2 Encourages bad practice         2 Campaign data collection
   among display participants
                                  3 Tag management instrumentation
3 Spend optimised to the
   “wrong” media partners
Further reading


• http://blog.comscore.com/2010/12/rid_meddlesome_click.html
• http://c3metrics.com/white-paper/
• http://www.atlassolutions.com/uploadedFiles/Atlas/Atlas_Institute/Published_Content/dmi-TheLongRoadtoConversion.pdf
• http://www.iab.net/media/file/IAB_WHITE_PAPER_FINAL_AUGUST-3-2010.pdf
• http://www.havasdigital.com/wp-content/uploads/2011/02/HD_Insight_AttributionDM.pdf
• http://www.ensighten.com/whitepapers
• http://www.exchangewire.com/blog/2010/11/24/spray-and-pray-baby-the-insider-view-on-the-dysfunctional-state-of-display/
• http://blog.tribalfusion.co.uk/?p=116
• http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=152611
• http://www.clearsaleing.com/archives/2011/06/14/clearsaleing%E2%80%99s-altitude-exposes-a-36-percent-flaw-in-last-
  %C2%ADad-attribution/
• http://www.omniture.com/offer/953?cms_site_lang=1&s_rtid=37079&&s_iid=31017&ct=email&cp=customer%20retention
• http://www.tagman.com/index.php/forrester-white-paper
Safe
                                                 Organisation
            Environments


    Insights                                                 Integrated
                                                            Technology



Advanced                                                    Smart Supply
Targeting                                                   Acquisition


              Creative                              Data
             Solutions                              Network


                           www.adnetworkv4.com

More Related Content

What's hot

KB Seminars: Working with Technology - Advertising; 10/13
KB Seminars: Working with Technology - Advertising; 10/13KB Seminars: Working with Technology - Advertising; 10/13
KB Seminars: Working with Technology - Advertising; 10/13
MDIF
 
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
Laurafries
 
MaxAxion Winter 2018 Sales Deck
MaxAxion Winter 2018 Sales DeckMaxAxion Winter 2018 Sales Deck
MaxAxion Winter 2018 Sales Deck
MaxAxion_Media
 
SpotXchange
SpotXchange SpotXchange
SpotXchange
AdverterenbijRTL
 
WEBINAR: How To Bring Native And Programmatic Advertising Together
WEBINAR: How To Bring Native And Programmatic Advertising TogetherWEBINAR: How To Bring Native And Programmatic Advertising Together
WEBINAR: How To Bring Native And Programmatic Advertising Together
InMobi
 
Thomvest Advertising Technology overview - Sept 2014
Thomvest Advertising Technology overview - Sept 2014Thomvest Advertising Technology overview - Sept 2014
Thomvest Advertising Technology overview - Sept 2014
andrewtweed1
 
Planning and measuring social media strategies
Planning and measuring social media strategiesPlanning and measuring social media strategies
Planning and measuring social media strategies
Lander Janssens
 
Navteq LocationPoint Presentation020110
Navteq LocationPoint Presentation020110Navteq LocationPoint Presentation020110
Navteq LocationPoint Presentation020110
Shawn Gunn
 
The 4 fundamentals of iDirect Marketing
The 4 fundamentals of iDirect MarketingThe 4 fundamentals of iDirect Marketing
The 4 fundamentals of iDirect Marketing
Tim Suther
 
845 spot xchange
845 spot xchange845 spot xchange
845 spot xchange
Digiday
 
AdJoin Africa Publisher Audience Marketplace
AdJoin Africa Publisher Audience MarketplaceAdJoin Africa Publisher Audience Marketplace
AdJoin Africa Publisher Audience Marketplace
Amanda Louw Bester
 
AdJoinAfricaPublisherAudienceMarketPlace-2016
AdJoinAfricaPublisherAudienceMarketPlace-2016AdJoinAfricaPublisherAudienceMarketPlace-2016
AdJoinAfricaPublisherAudienceMarketPlace-2016
Amanda Louw Bester
 
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
Scott Levine
 
MaxAxion Sales Deck Winter 2018
MaxAxion Sales Deck Winter 2018MaxAxion Sales Deck Winter 2018
MaxAxion Sales Deck Winter 2018
AdJoin_Media
 
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
Signal
 
Tanzil bukhari-adrian-mulryan
Tanzil bukhari-adrian-mulryanTanzil bukhari-adrian-mulryan
Tanzil bukhari-adrian-mulryan
Saatchi & Saatchi
 
TMK.edu Programmatic: September 2016
TMK.edu Programmatic: September 2016TMK.edu Programmatic: September 2016
TMK.edu Programmatic: September 2016
The Media Kitchen
 
Location Based Advertising 2015
Location Based Advertising 2015Location Based Advertising 2015
Location Based Advertising 2015
Nadia Z. Ismail
 
TMK.edu Site Direct, Video, & Social Presentation: July 2015
TMK.edu Site Direct, Video, & Social Presentation: July 2015 TMK.edu Site Direct, Video, & Social Presentation: July 2015
TMK.edu Site Direct, Video, & Social Presentation: July 2015
The Media Kitchen
 
Mobile Commons - PluggedIn NYC011210
Mobile Commons - PluggedIn NYC011210Mobile Commons - PluggedIn NYC011210
Mobile Commons - PluggedIn NYC011210
PluggedIn
 

What's hot (20)

KB Seminars: Working with Technology - Advertising; 10/13
KB Seminars: Working with Technology - Advertising; 10/13KB Seminars: Working with Technology - Advertising; 10/13
KB Seminars: Working with Technology - Advertising; 10/13
 
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
How to Sell Your Website to Advertisers: AAN Convention, Portland 2007
 
MaxAxion Winter 2018 Sales Deck
MaxAxion Winter 2018 Sales DeckMaxAxion Winter 2018 Sales Deck
MaxAxion Winter 2018 Sales Deck
 
SpotXchange
SpotXchange SpotXchange
SpotXchange
 
WEBINAR: How To Bring Native And Programmatic Advertising Together
WEBINAR: How To Bring Native And Programmatic Advertising TogetherWEBINAR: How To Bring Native And Programmatic Advertising Together
WEBINAR: How To Bring Native And Programmatic Advertising Together
 
Thomvest Advertising Technology overview - Sept 2014
Thomvest Advertising Technology overview - Sept 2014Thomvest Advertising Technology overview - Sept 2014
Thomvest Advertising Technology overview - Sept 2014
 
Planning and measuring social media strategies
Planning and measuring social media strategiesPlanning and measuring social media strategies
Planning and measuring social media strategies
 
Navteq LocationPoint Presentation020110
Navteq LocationPoint Presentation020110Navteq LocationPoint Presentation020110
Navteq LocationPoint Presentation020110
 
The 4 fundamentals of iDirect Marketing
The 4 fundamentals of iDirect MarketingThe 4 fundamentals of iDirect Marketing
The 4 fundamentals of iDirect Marketing
 
845 spot xchange
845 spot xchange845 spot xchange
845 spot xchange
 
AdJoin Africa Publisher Audience Marketplace
AdJoin Africa Publisher Audience MarketplaceAdJoin Africa Publisher Audience Marketplace
AdJoin Africa Publisher Audience Marketplace
 
AdJoinAfricaPublisherAudienceMarketPlace-2016
AdJoinAfricaPublisherAudienceMarketPlace-2016AdJoinAfricaPublisherAudienceMarketPlace-2016
AdJoinAfricaPublisherAudienceMarketPlace-2016
 
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
Digital Display Advertising For Medicare Marketing: The Comprehensive Medicar...
 
MaxAxion Sales Deck Winter 2018
MaxAxion Sales Deck Winter 2018MaxAxion Sales Deck Winter 2018
MaxAxion Sales Deck Winter 2018
 
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
People-Based Marketing: The Next Frontier for Harnessing the Power of First-P...
 
Tanzil bukhari-adrian-mulryan
Tanzil bukhari-adrian-mulryanTanzil bukhari-adrian-mulryan
Tanzil bukhari-adrian-mulryan
 
TMK.edu Programmatic: September 2016
TMK.edu Programmatic: September 2016TMK.edu Programmatic: September 2016
TMK.edu Programmatic: September 2016
 
Location Based Advertising 2015
Location Based Advertising 2015Location Based Advertising 2015
Location Based Advertising 2015
 
TMK.edu Site Direct, Video, & Social Presentation: July 2015
TMK.edu Site Direct, Video, & Social Presentation: July 2015 TMK.edu Site Direct, Video, & Social Presentation: July 2015
TMK.edu Site Direct, Video, & Social Presentation: July 2015
 
Mobile Commons - PluggedIn NYC011210
Mobile Commons - PluggedIn NYC011210Mobile Commons - PluggedIn NYC011210
Mobile Commons - PluggedIn NYC011210
 

Viewers also liked

The 3Ps of Mobile Advertising - Past, Present and Promise
The 3Ps of Mobile Advertising - Past, Present and PromiseThe 3Ps of Mobile Advertising - Past, Present and Promise
The 3Ps of Mobile Advertising - Past, Present and Promise
Exponential Interactive
 
Bali imedia april 2013 draft 2
Bali imedia april 2013 draft 2Bali imedia april 2013 draft 2
Bali imedia april 2013 draft 2
Exponential Interactive
 
Validate, Surprise, Challenge
Validate, Surprise, ChallengeValidate, Surprise, Challenge
Validate, Surprise, Challenge
Exponential Interactive
 
AdoTube_2012 Global Format Index
AdoTube_2012 Global Format IndexAdoTube_2012 Global Format Index
AdoTube_2012 Global Format Index
Exponential Interactive
 
You Can't Beat The Model
You Can't Beat The ModelYou Can't Beat The Model
You Can't Beat The Model
Exponential Interactive
 
Guess Who's Coming to London?
Guess Who's Coming to London?Guess Who's Coming to London?
Guess Who's Coming to London?
Exponential Interactive
 
AdChoices - Our Experience
AdChoices - Our ExperienceAdChoices - Our Experience
AdChoices - Our Experience
Exponential Interactive
 
Across Media and Device
Across Media and DeviceAcross Media and Device
Across Media and Device
Exponential Interactive
 
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
Exponential Interactive
 

Viewers also liked (9)

The 3Ps of Mobile Advertising - Past, Present and Promise
The 3Ps of Mobile Advertising - Past, Present and PromiseThe 3Ps of Mobile Advertising - Past, Present and Promise
The 3Ps of Mobile Advertising - Past, Present and Promise
 
Bali imedia april 2013 draft 2
Bali imedia april 2013 draft 2Bali imedia april 2013 draft 2
Bali imedia april 2013 draft 2
 
Validate, Surprise, Challenge
Validate, Surprise, ChallengeValidate, Surprise, Challenge
Validate, Surprise, Challenge
 
AdoTube_2012 Global Format Index
AdoTube_2012 Global Format IndexAdoTube_2012 Global Format Index
AdoTube_2012 Global Format Index
 
You Can't Beat The Model
You Can't Beat The ModelYou Can't Beat The Model
You Can't Beat The Model
 
Guess Who's Coming to London?
Guess Who's Coming to London?Guess Who's Coming to London?
Guess Who's Coming to London?
 
AdChoices - Our Experience
AdChoices - Our ExperienceAdChoices - Our Experience
AdChoices - Our Experience
 
Across Media and Device
Across Media and DeviceAcross Media and Device
Across Media and Device
 
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
Digital Leaders Dinner (Sydney, Australia) - 6 February, 2013
 

Similar to Attribution Roadshow October 2011

Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
Tribal Fusion
 
Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
Tribal Fusion
 
Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
Tribal Fusion
 
Scientific Attribution: Maximizing Digital ROI
Scientific Attribution: Maximizing Digital ROIScientific Attribution: Maximizing Digital ROI
Scientific Attribution: Maximizing Digital ROI
BKV
 
Digital Impact
Digital ImpactDigital Impact
Digital Impact
iMedia Connection
 
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
TFM&A
 
Media mind cc4s - latest
Media mind   cc4s - latestMedia mind   cc4s - latest
Media mind cc4s - latest
joeychee
 
Digital Media - Affiliate mkt & google adwords
Digital Media - Affiliate mkt & google adwordsDigital Media - Affiliate mkt & google adwords
Digital Media - Affiliate mkt & google adwords
21212com
 
JumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
JumpTime - Moneyball for Media: Unlocking ROI with Content Value ManagementJumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
JumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
Signal Chicago 2012
 
View-Through Technology: Gaining Insight into Data
View-Through Technology: Gaining Insight into DataView-Through Technology: Gaining Insight into Data
View-Through Technology: Gaining Insight into Data
BusinessOnline
 
Attribution and ROI Measurement
Attribution and ROI MeasurementAttribution and ROI Measurement
Attribution and ROI Measurement
Encore Media Metrics
 
Let the Data be your Guide - Marketing Analytics 1,2,3
Let the Data be your Guide - Marketing Analytics 1,2,3Let the Data be your Guide - Marketing Analytics 1,2,3
Let the Data be your Guide - Marketing Analytics 1,2,3
Concise Path
 
Yahoo!'s An Ad is Not Just an Ad Research
Yahoo!'s An Ad is Not Just an Ad ResearchYahoo!'s An Ad is Not Just an Ad Research
Yahoo!'s An Ad is Not Just an Ad Research
Nick Drew
 
Advanced Landing Pages for Higher Online Conversions
Advanced Landing Pages for Higher Online ConversionsAdvanced Landing Pages for Higher Online Conversions
Advanced Landing Pages for Higher Online Conversions
ion interactive
 
The New CMO - Mark Krebs, Covario
The New CMO - Mark Krebs, CovarioThe New CMO - Mark Krebs, Covario
The New CMO - Mark Krebs, Covario
Webtrends
 
DATA Targeting - Powering Display Advertising
DATA Targeting - Powering Display AdvertisingDATA Targeting - Powering Display Advertising
DATA Targeting - Powering Display Advertising
ijsid
 
Technofutur TIC - Interpreting web analytics - 13-Mar-12
Technofutur TIC - Interpreting web analytics - 13-Mar-12Technofutur TIC - Interpreting web analytics - 13-Mar-12
Technofutur TIC - Interpreting web analytics - 13-Mar-12
Semetis
 
Online Marketing
Online MarketingOnline Marketing
Online Marketing
clevermethod
 
Search Engine Marketing 101
Search Engine Marketing 101Search Engine Marketing 101
Search Engine Marketing 101
Empower MediaMarketing
 
Sem 101 presentation
Sem 101 presentationSem 101 presentation
Sem 101 presentation
Tim Metzner
 

Similar to Attribution Roadshow October 2011 (20)

Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
 
Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
 
Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011Attribution Roadshow Q3 2011
Attribution Roadshow Q3 2011
 
Scientific Attribution: Maximizing Digital ROI
Scientific Attribution: Maximizing Digital ROIScientific Attribution: Maximizing Digital ROI
Scientific Attribution: Maximizing Digital ROI
 
Digital Impact
Digital ImpactDigital Impact
Digital Impact
 
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
Online Advertising Theatre; New Levels of Consumer Engagement with Semantic A...
 
Media mind cc4s - latest
Media mind   cc4s - latestMedia mind   cc4s - latest
Media mind cc4s - latest
 
Digital Media - Affiliate mkt & google adwords
Digital Media - Affiliate mkt & google adwordsDigital Media - Affiliate mkt & google adwords
Digital Media - Affiliate mkt & google adwords
 
JumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
JumpTime - Moneyball for Media: Unlocking ROI with Content Value ManagementJumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
JumpTime - Moneyball for Media: Unlocking ROI with Content Value Management
 
View-Through Technology: Gaining Insight into Data
View-Through Technology: Gaining Insight into DataView-Through Technology: Gaining Insight into Data
View-Through Technology: Gaining Insight into Data
 
Attribution and ROI Measurement
Attribution and ROI MeasurementAttribution and ROI Measurement
Attribution and ROI Measurement
 
Let the Data be your Guide - Marketing Analytics 1,2,3
Let the Data be your Guide - Marketing Analytics 1,2,3Let the Data be your Guide - Marketing Analytics 1,2,3
Let the Data be your Guide - Marketing Analytics 1,2,3
 
Yahoo!'s An Ad is Not Just an Ad Research
Yahoo!'s An Ad is Not Just an Ad ResearchYahoo!'s An Ad is Not Just an Ad Research
Yahoo!'s An Ad is Not Just an Ad Research
 
Advanced Landing Pages for Higher Online Conversions
Advanced Landing Pages for Higher Online ConversionsAdvanced Landing Pages for Higher Online Conversions
Advanced Landing Pages for Higher Online Conversions
 
The New CMO - Mark Krebs, Covario
The New CMO - Mark Krebs, CovarioThe New CMO - Mark Krebs, Covario
The New CMO - Mark Krebs, Covario
 
DATA Targeting - Powering Display Advertising
DATA Targeting - Powering Display AdvertisingDATA Targeting - Powering Display Advertising
DATA Targeting - Powering Display Advertising
 
Technofutur TIC - Interpreting web analytics - 13-Mar-12
Technofutur TIC - Interpreting web analytics - 13-Mar-12Technofutur TIC - Interpreting web analytics - 13-Mar-12
Technofutur TIC - Interpreting web analytics - 13-Mar-12
 
Online Marketing
Online MarketingOnline Marketing
Online Marketing
 
Search Engine Marketing 101
Search Engine Marketing 101Search Engine Marketing 101
Search Engine Marketing 101
 
Sem 101 presentation
Sem 101 presentationSem 101 presentation
Sem 101 presentation
 

Recently uploaded

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Neo4j
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Neo4j
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 

Recently uploaded (20)

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 

Attribution Roadshow October 2011

  • 1. Understanding Attribution (<30 mins) Doug Conely | Senior Director, Global Data & Targeting Andrew Newman | Senior Director, Global Insights 2011
  • 2. Safe Organisation Environments Insights Integrated Technology Advanced Smart Supply Targeting Acquisition Creative Data Solutions Network
  • 3. Safe Organisation Environments Insights Integrated Technology Advanced Smart Supply Targeting Acquisition Creative Data Solutions Network
  • 4. Safe Organisation Environments Insights Integrated Technology Advanced Smart Supply Targeting Acquisition Creative Data Solutions Network
  • 5. Different ways to ask “is my advertising working?” Attribution Audience Effectiveness Analytics Measures
  • 6. Attribution Attribution Audience Effectiveness Analytics Measures “Half the money I spend on advertising is wasted; the trouble is I don't know which half.” - John Wanamaker “How do I know I’m paying the right people and allocating the right media mix?” “If I ran a football team how do I decide to pay each player?”
  • 7. The perils of poor attribution … and what you can do about it control and analysis… 1 Paying more than once for the same conversion 2 Encourages bad practice among display participants ? 3 Spend optimised to the “wrong” media partners
  • 8. Search only attribution +1 Brand keyword click
  • 9. Search only attribution +1 Brand keyword click 100% Illustrative 80% 60% Search 40% Display 20% 0% Last Last -1 Last -2 Last -3 Last -4 Last -5 Last -6 Last -7 exposure
  • 10. Click to conversion measurement +1 Display ad click Conversion behaviours
  • 11. Click to conversion measurement +1 Display ad click Click behaviours http://blog.tribalfusion.co.uk/?p=116
  • 12. Search and display in combination +1 Display ad Brand keyword impression click Display ad Display ad impression impression Brand keyword click +1 >1?
  • 13. Search and display in combination +1 Display ad Brand keyword impression click
  • 14. Last view attribution +1 Site visit Display ad Display ad Display ad impression 1 impression 2 impression 3 http://www.exchangewire.com/blog/2010/11/24/spray-and-pray-baby-the-insider-view-on-the-dysfunctional-state-of-display/
  • 15. Last view attribution +1 Site visit Display ad Display ad Display ad impression 1 impression 2 impression 3 Wimbledon 1998 FA Cup Barcelona 2011 European Cup
  • 16. Last view attribution +1 Site visit Display ad Display ad Display ad impression 1 impression 2 impression 3
  • 17. With attribution you are never done… +1 Display ad Generic product Display ad Brand keyword impression 1 keyword searches impression 2 searches
  • 18. Remember that everyone has a vested interest here… Move away from last ad view but still want a higher mix for online display Need to protect last click search business. Still >80% of revenues Convince you current tag management is not sufficient You’re duplicating payments so they can save you money and you need their models to improve ROI You need to switch to a Havas or Group M agency
  • 19. The perils of poor attribution … and what you can do about it control and analysis… 1 Paying more than once for the same conversion 1 Attribution analysis framework 2 Encourages bad practice 2 Campaign data collection among display participants 3 Tag management instrumentation 3 Spend optimised to the “wrong” media partners
  • 20. 1 Attribution analysis framework |Even attribution weighting Attribution weighting 20% 40% Originator Converter Assist 40% > This is a great starting place but not the end goal Source: http://c3metrics.com/white-paper/
  • 21. 2 Campaign data collection Social Media SEM/ SEO Display Affiliates Email
  • 22. 3 Tag management instrumentation
  • 23. TF approach: dynamic regression attribution models Attribution in the Campaign Attribution Campaign typical campaign lifecycle Delivery Analysis Planning Attribution as part of campaign Campaign optimisation Delivery
  • 24. The perils of poor attribution … and what you can do about it control and analysis… 1 Paying more than once for the same conversion 1 Attribution analysis framework 2 Encourages bad practice 2 Campaign data collection among display participants 3 Tag management instrumentation 3 Spend optimised to the “wrong” media partners
  • 25. Further reading • http://blog.comscore.com/2010/12/rid_meddlesome_click.html • http://c3metrics.com/white-paper/ • http://www.atlassolutions.com/uploadedFiles/Atlas/Atlas_Institute/Published_Content/dmi-TheLongRoadtoConversion.pdf • http://www.iab.net/media/file/IAB_WHITE_PAPER_FINAL_AUGUST-3-2010.pdf • http://www.havasdigital.com/wp-content/uploads/2011/02/HD_Insight_AttributionDM.pdf • http://www.ensighten.com/whitepapers • http://www.exchangewire.com/blog/2010/11/24/spray-and-pray-baby-the-insider-view-on-the-dysfunctional-state-of-display/ • http://blog.tribalfusion.co.uk/?p=116 • http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=152611 • http://www.clearsaleing.com/archives/2011/06/14/clearsaleing%E2%80%99s-altitude-exposes-a-36-percent-flaw-in-last- %C2%ADad-attribution/ • http://www.omniture.com/offer/953?cms_site_lang=1&s_rtid=37079&&s_iid=31017&ct=email&cp=customer%20retention • http://www.tagman.com/index.php/forrester-white-paper
  • 26. Safe Organisation Environments Insights Integrated Technology Advanced Smart Supply Targeting Acquisition Creative Data Solutions Network www.adnetworkv4.com

Editor's Notes

  1. Last year we talked about Ad Network V4 and the notion that successful networks would have to adopt this model to respond to the changing environment. We introduced the new business models and our views on them.
  2. With all the buzz around audience buying, later in the year we talked about the data assets and advanced targeting capabilities that good networks need to offer within the Ad Network v4 concept
  3. Now we want to focus on today’s hot topic, attribution, and why that matters to you. We’ve deliberately put attribution at the centre of the ad network v4 wheel because improving attribution throughout the industry has huge potential to improve client results and shift further spending from other media.
  4. Where does attribution fit in?For TF it is one of several separate but related issues within marketing analytics to answer the question: “is my advertising working”. You can look at this as effectiveness measures, audience analytics and attribution. When we talk about attribution we really mean just this piece.When we read around this subject we find that people can often confuse these issues, which just makes it harder to think through clearly.Effectiveness Measures: How you decide if a campaign is working or not and how you compare media ownersAudience Analytics: What audiences are most likely to meet your client’s marketing objectives
  5. So what is attribution?The standard quote everyone gives for marketing is from John Wanamker, a pioneer of the department store model.For today’s multi-channel - but far more measureable world - we could restate this as question around “is my advertising working” as “How do I know I’m paying the right people and allocating the right media mix?””OR“If I owned a football team, how do I decide how much to pay each player?”
  6. We’re going to walk through various attribution scenarios to examine the potential issues and build up a picture of how to think about attribution. Then we’ll look at what you can do about it today.
  7. Here’s an illustrative example of why this matters.If you have a shopping basket and you need to award your media partners for driving conversions to that shopping basket then you need to know how much to pay them.If you just have one search partner on the entire plan – one player on the team - and an organic or paid search click results in a conversion then you pay “1” to the search partner.Life would be simple. For many small business who use only SEM this is the case, though don’t ask how they know whether the ad in the local paper is working or not
  8. However, it turns out that as much as 75% of the last exposures to an ad before a conversion are search terms while display ads are more dominant in earlier stages of the funnel. Every team has more than one player.
  9. If, instead, you had only a ppc or click to conversion partner on the media plan your attribution model would be in danger of not only paying one player in your team but possibly paying for goals that hadn’t even crossed the line, or if it was possible, crossed the wrong line.Look at the conversion behaviours for this UK business banking client. In this example, the converting behaviours are predominantly executive careers and executive cars. This is the profile of a small business owner.
  10. Now compare the behaviours that convert to those that click. This is a classic “clicker” profile. Click to conversion measurement is forcing the media owner to look for conversions amongst a pool of users that looks very different to the target profiles, particularly in this example.This is measurement issue where audience analytics shows that you’re measuring the wrong thing. Therefore skewing attribution.
  11. So what if there was a display ad impression in the campaign before the search? The search term would still get the post click attribution but the display ad might get the last view attribution too if your instrumentation is not set up right. Meaning that you’re paying twice for the same conversion. This is like paying your strikers a goal bonus but then paying both strikers for the same goal rather than just the one that actually scored. Tagman and Clearsaleing, amongst others, have done studies to show that this is a real risk. However, within a buying strategy most ad servers do a good job of deduplicating conversions, i.e. Within DFA there are reports to strip out and allocate conversions to the “last view”. You don’t pay twice per channel.Conversely, this might result in not attributing anything at all to one of the participants on the plan. Over time, the implication is that you might end up optimising someone out of the plan through poor attribution.
  12. But we know that’s a bad idea because there have been plenty of studies to show that search and display work better together from an overall effectiveness perspective than separately. In this case, without good attribution, it’s like dropping your wingers because they’re not scoring goals but not noticing that they were helping to create goals.
  13. What if you are using last view attribution? i.e. the media partner showing the last ad before the user converts gets the full display ad conversion attribution. This is the prevalent model today for display and while we think it is the “least worst” option versus click through rate measurement and click to conversion attribution it does lead to bad practice. In our example here, a user has already visited the site. Now all the media partners in the plan with a retargeting pixel on the site are incentivised to show as many ads as possible to the use on the cheapest inventory they can find whether that ad was visible on the page or not. The infamous “spray and pray technique.This happens even though we often know the timelag between a visit and a conversion event. Which should tell you to dial down post-visit impressions after a certain time lapse and try to bring people to the site for that investigative visit.
  14. Last view attribution is like encouraging everyone to goal hang and hope someone else humps into the box for them to bang it in. It’s not wrong – after all “people do what you measure not what you expect” - but it’s not pretty and it doesn’t encourage best practice. Think Wimbledon 1988 versus Barcelona 2011.
  15. No good reason for this slide...
  16. What if it’s a lot more complicate than that with multiple ad impressions, generic product keyword search terms and brand keyword searches terms? What if there are rich media interactions, social interactions, affiliates and emails?In this case there is a major challenge in tracking the interactions on all the events, storing them and sorting them.Looking across the full spectrum of marketing activity, what do you do if the plans has offline components to the plan like tv, radio and outdoor?The point is, with attribution, you are never done.
  17. The first thing you need to do is to decide the framework you want to try and apply. This determines the tagging infrastructure you chose and how you collect and process information.
  18. This is an example of a methodology sometimes called even attribution. Originator: First source, makes the introductionConverter: Last source before the transactionAssist: 2nd to last source before the transactionThis is something you can implement immediately. You can run your in-house analytics to determine this, and we know that many digital agencies do this. And you can set up to award conversions in this way (you already deduplicate conversions on a last view basis)One thing you need to know though is what your cost per acquisition should be: that’s a whole other conversation.
  19. The second thing you need is a data collection strategy and data warehousing infrastructure.For data collection you need to in a position to collect data on as many touch points for your client as possible.For data warehousing it used to be that you couldn’t buy anything off the shelf. That’s not quite true any more and companies like Netezza and Greenplum can help now. Integration, though, as always, is challenging. However, they approach this as an IT systems and infrastructure problem to solve, which is why they were bought by IBM and EMC respectively. We think the market is moving too fast and expectations too customised to solve by throwing hardware at the problem. We also think they will struggle to stay flexible enough.We’ve seen attribution reporting based on internal infrastructure from Artemis via Havas and from ZAP via the Mig. I’m sure there are others. Agencies are making good progress here but, as ever, the question is whether they can maintain the in house tech investment required
  20. The final thing you can do about attribution is to make sure you have the right tag management infrastructure across your client sties. This isn’t always your choice, the client will often select the vendor, but we find that tag addition and removal is a key barrier to effective campaign management, timely audience analytics and even attribution itself.Add, edit or remove ANY online marketing tag/pixel instantly, direct from the web page and without changing the code of the siteLoad all page tags/pixels only when they are needed and not compromising page download speedsSee all the online marketing events – search, display, email, affiliates, social media - that appear in a customer&apos;s path to conversion, in order, in detail and in real-timeAward credit and commission across all online channels based on every channel&apos;s real role in the path to conversion and according to flexible attribution modelsThere are a number of new players in this space that can provide this along with the traditional vendors of container tags like DFA and Atlas
  21. The problem with even attribution models is that they tend to be static, take a long time to complete the original studies and then come back to the planning team in a format that may be difficult to interpret. They tell you what would have happened under constant conditions for different payouts. This is descriptive but not predictive.What Tribal Fusion is interested in is being predictive. We want to optimise campaigns based on live attribution inputs. Dynamic regression attribution models need you to collect all the campaign data then run regression models in real-time to understand which events are more predictive of driving conversions than others. As enough data is gathered those weightings will change over time as the campaign evolves and various components are added to or removed from the plan. From a TF perspective this is what we want to get to. We would love the conversion feed so we could work out which audiences are more or less likely to convert and the real-time attribution weighting feed so that we could add those variables to our optimisation. Limit the scope to what we can measure. i.e. If we know that last view ads are not being attributed a high score and we know that an impression is more likely to be a last ad (from time to convert analysis) then we can downweight the scoring for that impression and award it to another campaign. Equally, if we know that early session impressions are being awarded then we can optimise to find users early in the day with first impressions that we see on them.We have a research paper on this that we’re happy to share with your technical teams. Our first step is to develop this on our network so that we’re sure we are doing the right things. When we get there the idea is to be able to provide this as a solution for our clients.