Marketers Take Control Run Experiments

Dr. Augustine Fou - Independent Ad Fraud Researcher
Dr. Augustine Fou - Independent Ad Fraud ResearcherProfessor; Speaker; Author at Marketing Science Consulting Group, Inc.
Marketers take control
September 2017
Augustine Fou, PhD.
acfou [at] mktsci.com
212. 203 .7239
September 2017 / Page 1marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Chase: 99% reach had no impact
“JPMorgan had already decided
last year to oversee its own
programmatic buying operation.
Advertisements for JPMorgan
Chase were appearing on about
400,000 websites a month. [But]
only 12,000, or 3 percent, led to
activity beyond an impression.
[Then, Chase] limited its display
ads to about 5,000 websites. We
haven’t seen any deterioration on
our performance metrics,” Ms.
Lemkau said.”
“99% reduction in ‘reach’ … Same Results.”
Source: NYTimes, March 29, 2017
(because it wasn’t real, human reach)
September 2017 / Page 2marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
P&G: $140M in digital, no impact
“Procter & Gamble's concerns
about where its ads were
showing up online contributed
to a $140 million cutback in
the company's digital ad
spending last quarter, the
company said Thursday. That
helped the world's biggest
advertiser beat earnings
expectations. Perhaps even
more noteworthy, however,
organic sales outperformed
both analyst forecasts and key
rivals at 2% growth despite
the drop in ad support.
Source: AdAge, July 2017
September 2017 / Page 3marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Restoration Hardware: cut all keywords
“[W]e’ve found out that 98%
of our business was coming
from 22 words. So, wait, we’re
buying 3,200 words and 98%
of the business is coming from
22 words. What are the 22
words? And they said, well, it’s
the word Restoration
Hardware and the 21 ways to
spell it wrong, okay?
Immediately the next day, we
cancelled all the words,
including our own name.”
Source: BusinessInsider, Sept 2017
September 2017 / Page 4marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Uber Sues Mobile Agency for Ad Fraud
“Between 2015 and the first quarter of 2017,
Uber paid more than $82.5 million for the ad
effort coordinated by Fetch, court documents
show.
Uber alleges to have found… a Fetch
transparency report that showed the number of
weekly reported clicks on Uber ads on one
website was nearly equal to the site’s monthly
active users.
Uber was spending millions of dollars a week on
mobile ad inventory that was “purportedly
attributable to hundreds of thousands (even
millions) of Uber App installs per week,”
according to the complaint. However, when the
mobile ad effort was suspended, Uber said it
saw “no material drop in total installations.”
Source: WSJ, Sept 2017
If you don’t have 100%
measurement or very detailed
reports… you’re NOT
getting what you paid for.
September 2017 / Page 6marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought ESPN? Nope
publisherA.com
ALL fake inventory because, PublisherA
does NOT sell any ads on any exchanges!
“Fake sites must pretend to be mainstream
ones in order to sell inventory.”
September 2017 / Page 7marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought reach? Nope
$1 CPM
Top 10 sites = 66% of imps
$5 CPM
Top 10 sites = 74% of imps
$0.50 CPM
Top 5 sites = 100% of imps
$10 CPM
Top 10 sites = 71% of imps
Majority of your ads ran on 5-10 sites/apps
September 2017 / Page 8marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
98% impressions blown out in 1 hr
Most of budget wasted
between 12a – 4a; to bots
98% impressions blown
in 1st hour (12a-1a)
HOURLY CHART
September 2017 / Page 9marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Fraud filters don’t work. At. All.
1. Fraud filters are no better
than manual blacklists
2. In some cases it’s worse
when filter is on
3. Using fraud filters adds 20
– 24% to costs; manual
blacklists are free
September 2017 / Page 10marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for geotargeting; 100% faked
Not Normal – in both campaigns
1. 100% mobile apps; 100% Android; same top 15 apps in both markets
2. 100% of impressions generated between 4a – 5a local time
3. 100% fake devices; 15 unique devices generated top 95% impressions
4. 100% data center traffic, randomized through residential proxies
September 2017 / Page 11marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for targeting, no effect
“Verified Bots” “Verified Humans”
“Fraud-free Apps”Control: No Targeting
+$0.25 data CPM
+$0.25 data CPM+$0.25 data CPM
September 2017 / Page 12marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Targeting recent purchasers, didn’t work
“Frequent Buyers” “Heavy Buyers”
“Recent Purchaser - Books”Control: No Targeting
+$1.00 data CPM
+$1.00 data CPM+$1.75 data CPM
September 2017 / Page 13marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
90-99% of geolocation bad or faked
Source: Placed
Source: SafeGraph
September 2017 / Page 14marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
9% of apps caused 80% of fake impressions
1 (52% of impressions) 2 (48% of impr)
66% avg fraud
18% avg fraud
1. 9% of the apps caused 52% of impressions; 66% outright fraud
2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
September 2017 / Page 15marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
3 bad apps eat 75% of mobile budget
com.jiubang com.flashlight com.latininput
75% of the
dark red
September 2017 / Page 16marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
34 Mobile Networks >50% Fraud
Source: June 2017, Tune
average 20% fraud
100% fraud
> 50% fraud
September 2017 / Page 17marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Some ads are called without webpages
“Naked ad calls” are ad impressions
served without webpages
September 2017 / Page 18marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
About the Author
September 2017
Augustine Fou, PhD.
acfou [@] mktsci.com
212. 203 .7239
September 2017 / Page 19marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Dr. Augustine Fou – Independent Ad Fraud Researcher
2013
2014
Follow me on LinkedIn (click) and on Twitter
@acfou (click)
Further reading:
http://www.slideshare.net/augustinefou/presentations
https://www.linkedin.com/today/author/augustinefou
2016
2015
1 of 20

More Related Content

What's hot(20)

Similar to Marketers Take Control Run Experiments

State of digital ad fraud 2017 by augustine fou by
State of digital ad fraud 2017 by augustine fouState of digital ad fraud 2017 by augustine fou
State of digital ad fraud 2017 by augustine fouDr. Augustine Fou - Independent Ad Fraud Researcher
17.9K views53 slides
Mobile display fraud is rampant beyond belief by
Mobile display fraud is rampant beyond beliefMobile display fraud is rampant beyond belief
Mobile display fraud is rampant beyond beliefDr. Augustine Fou - Independent Ad Fraud Researcher
12.1K views30 slides
Digital ad fraud impact on class action notice industry by
Digital ad fraud impact on class action notice industryDigital ad fraud impact on class action notice industry
Digital ad fraud impact on class action notice industryDr. Augustine Fou - Independent Ad Fraud Researcher
739 views50 slides

Similar to Marketers Take Control Run Experiments(20)

Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin... by Adjust
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Adjust444 views

More from Dr. Augustine Fou - Independent Ad Fraud Researcher

Still nothing but ad fraud 2021 dr augustine fou by
Still nothing but ad fraud 2021 dr augustine fouStill nothing but ad fraud 2021 dr augustine fou
Still nothing but ad fraud 2021 dr augustine fouDr. Augustine Fou - Independent Ad Fraud Researcher
1.8K views25 slides

More from Dr. Augustine Fou - Independent Ad Fraud Researcher(20)

Recently uploaded

B2B & GTM Trends and Predictions for 2024.pdf by
B2B & GTM Trends and Predictions for 2024.pdfB2B & GTM Trends and Predictions for 2024.pdf
B2B & GTM Trends and Predictions for 2024.pdfDemandbase
33 views12 slides
service marketing ppt.pdf by
service marketing ppt.pdfservice marketing ppt.pdf
service marketing ppt.pdfAbhishek Shahane
7 views24 slides
Digital Marketing Overview by
Digital Marketing OverviewDigital Marketing Overview
Digital Marketing OverviewRohit Kittur
8 views5 slides
AI + Marketing Trends 2024 by
AI + Marketing Trends 2024  AI + Marketing Trends 2024
AI + Marketing Trends 2024 Antony Mayfield
17 views9 slides
Matthew-case-study-v2.pdf by
Matthew-case-study-v2.pdfMatthew-case-study-v2.pdf
Matthew-case-study-v2.pdfkowsikpirabhusr1
24 views23 slides
November 2023 - Partners meeting group by
November 2023 - Partners meeting groupNovember 2023 - Partners meeting group
November 2023 - Partners meeting groupVbout.com
35 views20 slides

Recently uploaded(20)

B2B & GTM Trends and Predictions for 2024.pdf by Demandbase
B2B & GTM Trends and Predictions for 2024.pdfB2B & GTM Trends and Predictions for 2024.pdf
B2B & GTM Trends and Predictions for 2024.pdf
Demandbase33 views
Digital Marketing Overview by Rohit Kittur
Digital Marketing OverviewDigital Marketing Overview
Digital Marketing Overview
Rohit Kittur8 views
November 2023 - Partners meeting group by Vbout.com
November 2023 - Partners meeting groupNovember 2023 - Partners meeting group
November 2023 - Partners meeting group
Vbout.com35 views
DI and Indian Advertising 2023 by Social Samosa
DI and Indian Advertising 2023DI and Indian Advertising 2023
DI and Indian Advertising 2023
Social Samosa151 views
Unlocking Growth in the Digital Age - A Digital Marketing Plan for SMEs in 2024 by Partha Dutta
Unlocking Growth in the Digital Age - A Digital Marketing Plan for SMEs in 2024Unlocking Growth in the Digital Age - A Digital Marketing Plan for SMEs in 2024
Unlocking Growth in the Digital Age - A Digital Marketing Plan for SMEs in 2024
Partha Dutta8 views
7 Benefits of Child Welfare Management Software by jeremyray18
7 Benefits of Child Welfare Management Software7 Benefits of Child Welfare Management Software
7 Benefits of Child Welfare Management Software
jeremyray189 views
Digital Marketing Tips to Survive the Global Inflation by Jomer Gregorio
Digital Marketing Tips to Survive the Global InflationDigital Marketing Tips to Survive the Global Inflation
Digital Marketing Tips to Survive the Global Inflation
Jomer Gregorio9 views
SaaS Marketing: Expert Paid Media Tips Backed By $150M In Ad Spend by Search Engine Journal
SaaS Marketing: Expert Paid Media Tips Backed By $150M In Ad SpendSaaS Marketing: Expert Paid Media Tips Backed By $150M In Ad Spend
SaaS Marketing: Expert Paid Media Tips Backed By $150M In Ad Spend
BLOOM_November2023.pdf by BalmerLawrie
BLOOM_November2023.pdfBLOOM_November2023.pdf
BLOOM_November2023.pdf
BalmerLawrie107 views
"SEO Keyword Checklist: Supercharge Your Website's Ranking Strategy" by Beacon Coders
"SEO Keyword Checklist: Supercharge Your Website's Ranking Strategy""SEO Keyword Checklist: Supercharge Your Website's Ranking Strategy"
"SEO Keyword Checklist: Supercharge Your Website's Ranking Strategy"
Beacon Coders11 views
SaaS growth strategies that generate MRR, not just traffic (TheBootstrappedWa... by Daniel Pirciu
SaaS growth strategies that generate MRR, not just traffic (TheBootstrappedWa...SaaS growth strategies that generate MRR, not just traffic (TheBootstrappedWa...
SaaS growth strategies that generate MRR, not just traffic (TheBootstrappedWa...
Daniel Pirciu8 views
Email Marketing KPI Report by Anna Sharma
Email Marketing KPI ReportEmail Marketing KPI Report
Email Marketing KPI Report
Anna Sharma6 views
Digityum Digital Marketing Agency by Digityum
Digityum Digital Marketing AgencyDigityum Digital Marketing Agency
Digityum Digital Marketing Agency
Digityum8 views

Marketers Take Control Run Experiments

  • 1. Marketers take control September 2017 Augustine Fou, PhD. acfou [at] mktsci.com 212. 203 .7239
  • 2. September 2017 / Page 1marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Chase: 99% reach had no impact “JPMorgan had already decided last year to oversee its own programmatic buying operation. Advertisements for JPMorgan Chase were appearing on about 400,000 websites a month. [But] only 12,000, or 3 percent, led to activity beyond an impression. [Then, Chase] limited its display ads to about 5,000 websites. We haven’t seen any deterioration on our performance metrics,” Ms. Lemkau said.” “99% reduction in ‘reach’ … Same Results.” Source: NYTimes, March 29, 2017 (because it wasn’t real, human reach)
  • 3. September 2017 / Page 2marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou P&G: $140M in digital, no impact “Procter & Gamble's concerns about where its ads were showing up online contributed to a $140 million cutback in the company's digital ad spending last quarter, the company said Thursday. That helped the world's biggest advertiser beat earnings expectations. Perhaps even more noteworthy, however, organic sales outperformed both analyst forecasts and key rivals at 2% growth despite the drop in ad support. Source: AdAge, July 2017
  • 4. September 2017 / Page 3marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Restoration Hardware: cut all keywords “[W]e’ve found out that 98% of our business was coming from 22 words. So, wait, we’re buying 3,200 words and 98% of the business is coming from 22 words. What are the 22 words? And they said, well, it’s the word Restoration Hardware and the 21 ways to spell it wrong, okay? Immediately the next day, we cancelled all the words, including our own name.” Source: BusinessInsider, Sept 2017
  • 5. September 2017 / Page 4marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Uber Sues Mobile Agency for Ad Fraud “Between 2015 and the first quarter of 2017, Uber paid more than $82.5 million for the ad effort coordinated by Fetch, court documents show. Uber alleges to have found… a Fetch transparency report that showed the number of weekly reported clicks on Uber ads on one website was nearly equal to the site’s monthly active users. Uber was spending millions of dollars a week on mobile ad inventory that was “purportedly attributable to hundreds of thousands (even millions) of Uber App installs per week,” according to the complaint. However, when the mobile ad effort was suspended, Uber said it saw “no material drop in total installations.” Source: WSJ, Sept 2017
  • 6. If you don’t have 100% measurement or very detailed reports… you’re NOT getting what you paid for.
  • 7. September 2017 / Page 6marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought ESPN? Nope publisherA.com ALL fake inventory because, PublisherA does NOT sell any ads on any exchanges! “Fake sites must pretend to be mainstream ones in order to sell inventory.”
  • 8. September 2017 / Page 7marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought reach? Nope $1 CPM Top 10 sites = 66% of imps $5 CPM Top 10 sites = 74% of imps $0.50 CPM Top 5 sites = 100% of imps $10 CPM Top 10 sites = 71% of imps Majority of your ads ran on 5-10 sites/apps
  • 9. September 2017 / Page 8marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 98% impressions blown out in 1 hr Most of budget wasted between 12a – 4a; to bots 98% impressions blown in 1st hour (12a-1a) HOURLY CHART
  • 10. September 2017 / Page 9marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Fraud filters don’t work. At. All. 1. Fraud filters are no better than manual blacklists 2. In some cases it’s worse when filter is on 3. Using fraud filters adds 20 – 24% to costs; manual blacklists are free
  • 11. September 2017 / Page 10marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for geotargeting; 100% faked Not Normal – in both campaigns 1. 100% mobile apps; 100% Android; same top 15 apps in both markets 2. 100% of impressions generated between 4a – 5a local time 3. 100% fake devices; 15 unique devices generated top 95% impressions 4. 100% data center traffic, randomized through residential proxies
  • 12. September 2017 / Page 11marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for targeting, no effect “Verified Bots” “Verified Humans” “Fraud-free Apps”Control: No Targeting +$0.25 data CPM +$0.25 data CPM+$0.25 data CPM
  • 13. September 2017 / Page 12marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Targeting recent purchasers, didn’t work “Frequent Buyers” “Heavy Buyers” “Recent Purchaser - Books”Control: No Targeting +$1.00 data CPM +$1.00 data CPM+$1.75 data CPM
  • 14. September 2017 / Page 13marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 90-99% of geolocation bad or faked Source: Placed Source: SafeGraph
  • 15. September 2017 / Page 14marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 9% of apps caused 80% of fake impressions 1 (52% of impressions) 2 (48% of impr) 66% avg fraud 18% avg fraud 1. 9% of the apps caused 52% of impressions; 66% outright fraud 2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
  • 16. September 2017 / Page 15marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 3 bad apps eat 75% of mobile budget com.jiubang com.flashlight com.latininput 75% of the dark red
  • 17. September 2017 / Page 16marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 34 Mobile Networks >50% Fraud Source: June 2017, Tune average 20% fraud 100% fraud > 50% fraud
  • 18. September 2017 / Page 17marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Some ads are called without webpages “Naked ad calls” are ad impressions served without webpages
  • 19. September 2017 / Page 18marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou About the Author September 2017 Augustine Fou, PhD. acfou [@] mktsci.com 212. 203 .7239
  • 20. September 2017 / Page 19marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Dr. Augustine Fou – Independent Ad Fraud Researcher 2013 2014 Follow me on LinkedIn (click) and on Twitter @acfou (click) Further reading: http://www.slideshare.net/augustinefou/presentations https://www.linkedin.com/today/author/augustinefou 2016 2015