SlideShare a Scribd company logo
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
Inflation is a disease, a dangerous and sometimes fatal disease, a disease that if not checked in time can
destroy a society. — Milton Friedman
Consider this scenario.
Six months ago, your company rolled out a completely new version of your web app. Product management
claims the rollout has been a great success, customer feedback has been positive, and they’re now pushing to
sunset the old version. As the analyst, you’ve been asked for a few reports including total visitor sessions for
the new version vs. the old version over the last month. You dutifully log in to your web analytics tool and pull
some reports, and start building the comparison.
Don’t stake your good reputation on bad data.
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
It seems that sessions for the old version aren’t as low as they ought to be in comparison to the new version.
Total visits are lower, but only slightly. And a few other key metrics are higher! You look at a few other reports,
and unfortunately, the numbers don’t support Product management’s recommendation.
You present your findings and recommend against sunsetting the old version for now because the metrics
show that user adoption needs work. Product management glares at you from across the table.
You are shocked by the numbers
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
In a recent omnibus audit including 200 top Internet Retail web sites, ObservePoint found that across the
board, data quality problems are rampant. Missing data, data inflation, and data leakage are experienced by
even the most sophisticated digital marketers.
One lesser-known data quality problem, data inflation, is exactly what it sounds like: digital data that is
reported inaccurately high. Inflation can affect web analytics data such as traffic counts, advertising data such
as clicks and impressions, sales attribution data, or a variety of important metrics. And as the data gets passed
up into other systems, the effects of the inflation are magnified. The cause of digital data inflation is the
instance of duplicate tags.
What’s going on?
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
When more than one instance of a tag fires on a page, data inflation happens. Each time a tag fires,
something gets counted, and when tag fires more than once, the thing is being counted more than once as
well.
Digital marketers have become much more disciplined about tag placement. In the past, tags might be placed
anywhere on the page – in the header, in the body, in the footer – in both, all three, just anywhere, or maybe
we were lucky if tags made it on the page at all.
But sometimes tags might be coded to multiple places on a page, transposed from other pages, or duplicated
in some other way. Regardless of the process that causes it, once the tag is duplicated, you’ve got data
inflation.
Duplicate tags inflate data
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
More common today – especially among the advanced digital teams – is the deployment of a Tag Management
System. But no TMS can prevent the old-fashioned deployment of tags directly to pages (either on
purpose or on accident), or control tags that aren’t inside the TMS.
Our omnibus audit uncovered web sites where a TMS was deployed yet duplicate tags existed for some digital
measurement tools. This is a problem, since there might be a temptation to mentally ignore the tags if they’re
not represented inside the TMS.
Due to the sheer number of non-stakeholder code modifications to digital properties all tag deployments erode,
decay, and fall out of compliance with the initial “clean” deployment over time.
Maintaining accurate tagging is ultimately your responsibility as a digital marketer.
Common causes of data inflation
Inflation: A hidden danger
ObservePoint ObservePoint DataAssurance
Around ObservePoint, we have a mantra: The only thing worse than no data is bad data. This is a shared
conviction between our founders and every ObservePoint employee.
I should note, the scenario at the beginning of this article is a true story. After the fact, we were asked to audit
the sites in question. We found that the old product pages had 300-500% data inflation caused by duplicate
tags, and the company came to the belief that the company’s new product release was probably a success.
Unfortunately, this knowledge wasn’t available at the moment the data was being used. Executives made a
revenue-impacting decision, based on bad data.
You Must Be Vigilant Against Inflation

More Related Content

Viewers also liked

CSS Dean's List Spring 2016 letter
CSS Dean's List Spring 2016 letter CSS Dean's List Spring 2016 letter
CSS Dean's List Spring 2016 letter
Mackenzie Flynn
 
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAFMainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
Zehra Aydin
 

Viewers also liked (12)

CSS Dean's List Spring 2016 letter
CSS Dean's List Spring 2016 letter CSS Dean's List Spring 2016 letter
CSS Dean's List Spring 2016 letter
 
Citations UCEM (Manuel 12.3.3)
Citations UCEM (Manuel 12.3.3)Citations UCEM (Manuel 12.3.3)
Citations UCEM (Manuel 12.3.3)
 
Snakpack promo in progress duffy
Snakpack promo in progress duffySnakpack promo in progress duffy
Snakpack promo in progress duffy
 
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAFMainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
Mainstreaming-Environmental-Sustainability-in-Country-Analysis-and-UNDAF
 
Ambientes virtuais de aprendizagem - Três Personalidades de Portugal - Texto
Ambientes virtuais de aprendizagem - Três Personalidades de Portugal - TextoAmbientes virtuais de aprendizagem - Três Personalidades de Portugal - Texto
Ambientes virtuais de aprendizagem - Três Personalidades de Portugal - Texto
 
Creating my vinyl
Creating my vinylCreating my vinyl
Creating my vinyl
 
Gingivitis
GingivitisGingivitis
Gingivitis
 
Sistema linfatico
Sistema linfaticoSistema linfatico
Sistema linfatico
 
올라이프 사업계획서
올라이프 사업계획서올라이프 사업계획서
올라이프 사업계획서
 
Slideshare
SlideshareSlideshare
Slideshare
 
Tub vapor
Tub vaporTub vapor
Tub vapor
 
How to create an animated infographic
How to create an animated infographicHow to create an animated infographic
How to create an animated infographic
 

More from ObservePoint

More from ObservePoint (18)

Connect Marketing to Revenue With Performance Measurement
Connect Marketing to Revenue With Performance MeasurementConnect Marketing to Revenue With Performance Measurement
Connect Marketing to Revenue With Performance Measurement
 
The Value of Data Governance & Performance Measurement
The Value of Data Governance & Performance MeasurementThe Value of Data Governance & Performance Measurement
The Value of Data Governance & Performance Measurement
 
8 campaign tracking limitations
8 campaign tracking limitations8 campaign tracking limitations
8 campaign tracking limitations
 
4 ways to improve your customer performance measurement
4 ways to improve your customer performance measurement4 ways to improve your customer performance measurement
4 ways to improve your customer performance measurement
 
Top 3 challenges of data governance & performance measurement in 2020
Top 3 challenges of data governance & performance measurement in 2020Top 3 challenges of data governance & performance measurement in 2020
Top 3 challenges of data governance & performance measurement in 2020
 
Order vs Chaos: Taming Digital Analytics Complexity With Automation
Order vs Chaos: Taming Digital Analytics Complexity With AutomationOrder vs Chaos: Taming Digital Analytics Complexity With Automation
Order vs Chaos: Taming Digital Analytics Complexity With Automation
 
4 ways to Align Marketing and IT Analytics Implementation Workflows
4 ways to Align Marketing and IT Analytics Implementation Workflows4 ways to Align Marketing and IT Analytics Implementation Workflows
4 ways to Align Marketing and IT Analytics Implementation Workflows
 
Master Your MarTech Migration: A Guide for Switching Web-Based Marketing and ...
Master Your MarTech Migration: A Guide for Switching Web-Based Marketing and ...Master Your MarTech Migration: A Guide for Switching Web-Based Marketing and ...
Master Your MarTech Migration: A Guide for Switching Web-Based Marketing and ...
 
Top Takeaways from Validate 2019
Top Takeaways from Validate 2019Top Takeaways from Validate 2019
Top Takeaways from Validate 2019
 
5 Tips to Bulletproof Your Analytics Implementation
5 Tips to Bulletproof Your Analytics Implementation5 Tips to Bulletproof Your Analytics Implementation
5 Tips to Bulletproof Your Analytics Implementation
 
7 Cases Where You Can't Afford to Skip Analytics Testing
7 Cases Where You Can't Afford to Skip Analytics Testing7 Cases Where You Can't Afford to Skip Analytics Testing
7 Cases Where You Can't Afford to Skip Analytics Testing
 
GDPR ASAP: A Seven-Step Guide to Prepare for the General Data Protection Regu...
GDPR ASAP: A Seven-Step Guide to Prepare for the General Data Protection Regu...GDPR ASAP: A Seven-Step Guide to Prepare for the General Data Protection Regu...
GDPR ASAP: A Seven-Step Guide to Prepare for the General Data Protection Regu...
 
The GDPR Most Wanted: The Marketer and Analyst's Role in Compliance
The GDPR Most Wanted: The Marketer and Analyst's Role in ComplianceThe GDPR Most Wanted: The Marketer and Analyst's Role in Compliance
The GDPR Most Wanted: The Marketer and Analyst's Role in Compliance
 
What's Wrong with Your SDR and How to Fix It (Pat Hillery)
What's Wrong with Your SDR and How to Fix It (Pat Hillery)What's Wrong with Your SDR and How to Fix It (Pat Hillery)
What's Wrong with Your SDR and How to Fix It (Pat Hillery)
 
What's Wrong with Your SDR and How to Fix It (Adam Greco)
What's Wrong with Your SDR and How to Fix It (Adam Greco)What's Wrong with Your SDR and How to Fix It (Adam Greco)
What's Wrong with Your SDR and How to Fix It (Adam Greco)
 
Observe point frequently asks questions
Observe point frequently asks questionsObserve point frequently asks questions
Observe point frequently asks questions
 
Our march madness bracket by audit score
Our march madness bracket by audit scoreOur march madness bracket by audit score
Our march madness bracket by audit score
 
OberservePoint - The Digital Data Quality Playbook
OberservePoint - The Digital Data Quality  PlaybookOberservePoint - The Digital Data Quality  Playbook
OberservePoint - The Digital Data Quality Playbook
 

Recently uploaded

Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
DilipVasan
 
Investigate & Recover / StarCompliance.io / Crypto_Crimes
Investigate & Recover / StarCompliance.io / Crypto_CrimesInvestigate & Recover / StarCompliance.io / Crypto_Crimes
Investigate & Recover / StarCompliance.io / Crypto_Crimes
StarCompliance.io
 
Machine Learning For Career Growth..pptx
Machine Learning For Career Growth..pptxMachine Learning For Career Growth..pptx
Machine Learning For Career Growth..pptx
benishzehra469
 

Recently uploaded (20)

2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting
 
Exploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptxExploratory Data Analysis - Dilip S.pptx
Exploratory Data Analysis - Dilip S.pptx
 
Business update Q1 2024 Lar España Real Estate SOCIMI
Business update Q1 2024 Lar España Real Estate SOCIMIBusiness update Q1 2024 Lar España Real Estate SOCIMI
Business update Q1 2024 Lar España Real Estate SOCIMI
 
Using PDB Relocation to Move a Single PDB to Another Existing CDB
Using PDB Relocation to Move a Single PDB to Another Existing CDBUsing PDB Relocation to Move a Single PDB to Another Existing CDB
Using PDB Relocation to Move a Single PDB to Another Existing CDB
 
Tabula.io Cheatsheet: automate your data workflows
Tabula.io Cheatsheet: automate your data workflowsTabula.io Cheatsheet: automate your data workflows
Tabula.io Cheatsheet: automate your data workflows
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
 
Investigate & Recover / StarCompliance.io / Crypto_Crimes
Investigate & Recover / StarCompliance.io / Crypto_CrimesInvestigate & Recover / StarCompliance.io / Crypto_Crimes
Investigate & Recover / StarCompliance.io / Crypto_Crimes
 
How can I successfully sell my pi coins in Philippines?
How can I successfully sell my pi coins in Philippines?How can I successfully sell my pi coins in Philippines?
How can I successfully sell my pi coins in Philippines?
 
Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdf
 
2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...
2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...
2024-05-14 - Tableau User Group - TC24 Hot Topics - Tableau Pulse and Einstei...
 
Machine Learning For Career Growth..pptx
Machine Learning For Career Growth..pptxMachine Learning For Career Growth..pptx
Machine Learning For Career Growth..pptx
 
how can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like Bitcoinhow can i exchange pi coins for others currency like Bitcoin
how can i exchange pi coins for others currency like Bitcoin
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdf
 
Innovative Methods in Media and Communication Research by Sebastian Kubitschk...
Innovative Methods in Media and Communication Research by Sebastian Kubitschk...Innovative Methods in Media and Communication Research by Sebastian Kubitschk...
Innovative Methods in Media and Communication Research by Sebastian Kubitschk...
 
Jpolillo Amazon PPC - Bid Optimization Sample
Jpolillo Amazon PPC - Bid Optimization SampleJpolillo Amazon PPC - Bid Optimization Sample
Jpolillo Amazon PPC - Bid Optimization Sample
 
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPsWebinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
Webinar One View, Multiple Systems No-Code Integration of Salesforce and ERPs
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdf
 
Pre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxPre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptx
 

Inflation: A hidden danger

  • 1. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance Inflation is a disease, a dangerous and sometimes fatal disease, a disease that if not checked in time can destroy a society. — Milton Friedman Consider this scenario. Six months ago, your company rolled out a completely new version of your web app. Product management claims the rollout has been a great success, customer feedback has been positive, and they’re now pushing to sunset the old version. As the analyst, you’ve been asked for a few reports including total visitor sessions for the new version vs. the old version over the last month. You dutifully log in to your web analytics tool and pull some reports, and start building the comparison. Don’t stake your good reputation on bad data.
  • 2. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance It seems that sessions for the old version aren’t as low as they ought to be in comparison to the new version. Total visits are lower, but only slightly. And a few other key metrics are higher! You look at a few other reports, and unfortunately, the numbers don’t support Product management’s recommendation. You present your findings and recommend against sunsetting the old version for now because the metrics show that user adoption needs work. Product management glares at you from across the table. You are shocked by the numbers
  • 3. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance In a recent omnibus audit including 200 top Internet Retail web sites, ObservePoint found that across the board, data quality problems are rampant. Missing data, data inflation, and data leakage are experienced by even the most sophisticated digital marketers. One lesser-known data quality problem, data inflation, is exactly what it sounds like: digital data that is reported inaccurately high. Inflation can affect web analytics data such as traffic counts, advertising data such as clicks and impressions, sales attribution data, or a variety of important metrics. And as the data gets passed up into other systems, the effects of the inflation are magnified. The cause of digital data inflation is the instance of duplicate tags. What’s going on?
  • 4. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance When more than one instance of a tag fires on a page, data inflation happens. Each time a tag fires, something gets counted, and when tag fires more than once, the thing is being counted more than once as well. Digital marketers have become much more disciplined about tag placement. In the past, tags might be placed anywhere on the page – in the header, in the body, in the footer – in both, all three, just anywhere, or maybe we were lucky if tags made it on the page at all. But sometimes tags might be coded to multiple places on a page, transposed from other pages, or duplicated in some other way. Regardless of the process that causes it, once the tag is duplicated, you’ve got data inflation. Duplicate tags inflate data
  • 5. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance More common today – especially among the advanced digital teams – is the deployment of a Tag Management System. But no TMS can prevent the old-fashioned deployment of tags directly to pages (either on purpose or on accident), or control tags that aren’t inside the TMS. Our omnibus audit uncovered web sites where a TMS was deployed yet duplicate tags existed for some digital measurement tools. This is a problem, since there might be a temptation to mentally ignore the tags if they’re not represented inside the TMS. Due to the sheer number of non-stakeholder code modifications to digital properties all tag deployments erode, decay, and fall out of compliance with the initial “clean” deployment over time. Maintaining accurate tagging is ultimately your responsibility as a digital marketer. Common causes of data inflation
  • 6. Inflation: A hidden danger ObservePoint ObservePoint DataAssurance Around ObservePoint, we have a mantra: The only thing worse than no data is bad data. This is a shared conviction between our founders and every ObservePoint employee. I should note, the scenario at the beginning of this article is a true story. After the fact, we were asked to audit the sites in question. We found that the old product pages had 300-500% data inflation caused by duplicate tags, and the company came to the belief that the company’s new product release was probably a success. Unfortunately, this knowledge wasn’t available at the moment the data was being used. Executives made a revenue-impacting decision, based on bad data. You Must Be Vigilant Against Inflation