SlideShare a Scribd company logo
Screening and data mining tools to detect cartels:
Brazilian experience
Workshop on cartel screening in the digital era
OECD, Paris – 30 January 2018
Diogo Thomson de Andrade
Deputy Superintendence of CADE
Felipe Leitão Valadares Roquete
Head of the Intelligence Unity of CADE
Disclaimer
The views expressed here are solely those of the author and do not in any way represent the views of the
CADE, or any other entity of the Brazilian Government.
Summary
• How (and why) we create a Screening Unit? (1/?)
• Projeto Cérebro1
: state of the art (?/?)
• Projeto Cérebro: findings and (or?) challenges (?/?)
• Simulations: a few actual examples (?/?)
1
Aka “The Brain Project"
How (and why) we create a Screening Unit
How (and why) we create a Screening Unit
How (and why) we create a Screening Unit
Origins and reason for primary focus on bid-rigging:
• Authority priority in fighting bid-rigging since 2007;
• Large amount of public data;
• Large number of sources of data;
• High difficult of data mining and multiplicity of databases;
• Context of “big data” initiatives;
• Economic theory and literature of screening;
• Behaviour and pattern analysis of suspicion of collusion in public
procurement (“red flags”).
Phase 1: Benchmarking
Phase 2: Data collection
- formal agreements and webscraping
Phase 3: External consultants
- IT (data mining techniques)
- Econometrics (screening methods)
During all phases: internal expert “consultants” (senior investigators and
case handlers) to “guide" external consultants based on the actual cartel
detection experience from the brazilian authority
How (and why) we create a Screening Unit
Projeto Cérebro: state of the art
Dump Oracle Comprasnet
200GB
CSV ANP Georef
2GB
TXT Petronect
90GB
CSV Tribunal SP
170GB
WebScraping DF
1GB
Federal Revenue
217GB
XLS CEMED ANVISA
0,2GB
All the data...
>2TB
~40 databases
BAK Tribunal PE
1,5GB
• Set of public databases or private databases of public
data (via cooperation agreements);
• One, searchable, IT “language”.
Data
Warehouse
• Patterns and similarities in competitors behaviour;
• Suspicious/rare facts;
• Signs of simulation of competition;
• Plots and trails of analysis of bid-rigging (CADE/others);
• Automation of the analysis made by the case-handlers.
Data Mining
• Screenings literature: test of hypothesys;
• Generalizations based on past concrete cases;
• Microeconomic theory.
Statistical
Tests
Projeto Cérebro: state of the art
Interface (web and Qlickview)
Projeto Cérebro: state of the art
Projeto Cérebro: state of the art
Applications:
• Ex officio investigations (enough for a dawn raid at least);
• Support and enhance ongoing investigations;
• General support of data for all units of CADE (collateral effect)
Architecture
Software: open source (“R”, Python and neo4j) and proprietary (SQL Server and Qlikview)
Projeto Cérebro: findings and (/or?) challenges
Challenge #0
Institutional differences: impact on public procurement design and private market
exchanges
- public procurement regulations and bid rigging strategies
- different comprehensiveness in scope of provisions to access public and private data
- data mining techniques and screening methods are replicable?
Projeto Cérebro: findings and (/or?) challenges
Challenge #0
Example: Rebid (Kawai & Nakabayashi)
Detecting Large-Scale Collusion in Procurement Auctions
Projeto Cérebro: findings and (/or?) challenges
Projeto Cérebro: findings and (/or?) challenges
Challenge #1
Data: access, comprehensiveness, quality and cost
- how much resources
- public procurement and private markets: availability
- completeness and quality
Projeto Cérebro: findings and (/or?) challenges
Challenge #1
Example: Swiss Competition Authority
Bid Rigging Flagging
Challenge #2
Sreening actual : intelligence or prosecution?
- prioritization tool?
- to enhance formal cases?
- cost benefit analysis?
Projeto Cérebro: findings and (/or?) challenges
Projeto Cérebro: findings and (/or?) challenges
Challenge #2
Example: CADE’s Fuel Retail Market Screen
Challenge #3
Translation: IT and econometrics technicalities and non-experts
- Jucidiary Power, lawyers, public servers, etc.
- risk to weaken the case?
- strategy: incremental or stationary?
Projeto Cérebro: findings and (/or?) challenges
• Federal government e-
procurement system:
Comprasnet
• On average 60.000 public
tenders / year.
• Patterns being looked for:
• Bid suppression
• Cover bidding
• Bid rotation
• Superfluous losing bidders
• Stable market share
• Pricing patterns
• Text similarities
• Submitted files metadata
Simulations: a few actual examples
Brazil: public procurement data’s overview
Benford
Simulations: a few actual examples
Simulations: a few actual examples
Cérebro: on line simulations
Thank you very much!
Merci beaucoup!
Diogo Thomson de Andrade
diogo.andrade@cade.gov.br
Felipe Leitão Valadares Roquete
felipe.roquete@cade.gov.br

More Related Content

Similar to Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop

Big data in Private Banking
Big data in Private BankingBig data in Private Banking
Big data in Private Banking
Jérôme Kehrli
 
Data Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk ManagementData Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk Management
Data Science Thailand
 
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted ReviewLearning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Daegis
 
21st Century Licensing Strategies
21st Century Licensing Strategies21st Century Licensing Strategies
21st Century Licensing Strategies
James C. Roberts III
 
Data mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid languageData mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid language
q-Maxim
 
8 minute intro to data science
8 minute intro to data science 8 minute intro to data science
8 minute intro to data science
Mahesh Kumar CV
 
Machine Learning for Finance Master Class
Machine Learning for Finance Master Class Machine Learning for Finance Master Class
Machine Learning for Finance Master Class
QuantUniversity
 
The Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessThe Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for Success
Cartegraph
 
Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"
Lviv Startup Club
 
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Cloudera, Inc.
 
Why am I doing this???
Why am I doing this???Why am I doing this???
Why am I doing this???
Anne-Marie Tousch
 
Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with Oracle
Sai Janakiram Penumuru
 
Rabobank - There is something about Data
Rabobank - There is something about DataRabobank - There is something about Data
Rabobank - There is something about Data
BigDataExpo
 
The GFCC Competitiveness Decoder
The GFCC Competitiveness DecoderThe GFCC Competitiveness Decoder
The GFCC Competitiveness Decoder
Dr. Amit Kapoor
 
Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez
Betacowork
 
Log Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisLog Mining: Beyond Log Analysis
Log Mining: Beyond Log Analysis
Anton Chuvakin
 
2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya
José Carlos Ramalho
 
S fahey
S faheyS fahey
S fahey
tri nguyen
 
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
OECD Directorate for Financial and Enterprise Affairs
 
How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?
Noam Cohen
 

Similar to Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop (20)

Big data in Private Banking
Big data in Private BankingBig data in Private Banking
Big data in Private Banking
 
Data Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk ManagementData Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk Management
 
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted ReviewLearning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
 
21st Century Licensing Strategies
21st Century Licensing Strategies21st Century Licensing Strategies
21st Century Licensing Strategies
 
Data mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid languageData mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid language
 
8 minute intro to data science
8 minute intro to data science 8 minute intro to data science
8 minute intro to data science
 
Machine Learning for Finance Master Class
Machine Learning for Finance Master Class Machine Learning for Finance Master Class
Machine Learning for Finance Master Class
 
The Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessThe Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for Success
 
Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"
 
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
 
Why am I doing this???
Why am I doing this???Why am I doing this???
Why am I doing this???
 
Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with Oracle
 
Rabobank - There is something about Data
Rabobank - There is something about DataRabobank - There is something about Data
Rabobank - There is something about Data
 
The GFCC Competitiveness Decoder
The GFCC Competitiveness DecoderThe GFCC Competitiveness Decoder
The GFCC Competitiveness Decoder
 
Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez
 
Log Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisLog Mining: Beyond Log Analysis
Log Mining: Beyond Log Analysis
 
2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya
 
S fahey
S faheyS fahey
S fahey
 
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
Cartel screening in the digital era – UK Competition & Markets Authority – Ja...
 
How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?
 

More from OECD Directorate for Financial and Enterprise Affairs

The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
OECD Directorate for Financial and Enterprise Affairs
 
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
OECD Directorate for Financial and Enterprise Affairs
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
OECD Directorate for Financial and Enterprise Affairs
 
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
OECD Directorate for Financial and Enterprise Affairs
 
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussion
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussionPro-competitive Industrial Policy – LANE – June 2024 OECD discussion
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussionPro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussionArtificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussionArtificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
OECD Directorate for Financial and Enterprise Affairs
 
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
OECD Directorate for Financial and Enterprise Affairs
 
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
OECD Directorate for Financial and Enterprise Affairs
 
OECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - HighlightsOECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - Highlights
OECD Directorate for Financial and Enterprise Affairs
 
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
OECD Directorate for Financial and Enterprise Affairs
 
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussionEx-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussionEx-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
OECD Directorate for Financial and Enterprise Affairs
 
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
OECD Directorate for Financial and Enterprise Affairs
 

More from OECD Directorate for Financial and Enterprise Affairs (20)

The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
The Intersection between Competition and Data Privacy – KEMP – June 2024 OECD...
 
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
The Intersection between Competition and Data Privacy – COLANGELO – June 2024...
 
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
The Intersection between Competition and Data Privacy – CAPEL – June 2024 OEC...
 
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
The Intersection between Competition and Data Privacy – OECD – June 2024 OECD...
 
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussion
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussionPro-competitive Industrial Policy – LANE – June 2024 OECD discussion
Pro-competitive Industrial Policy – LANE – June 2024 OECD discussion
 
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussionPro-competitive Industrial Policy – OECD – June 2024 OECD discussion
Pro-competitive Industrial Policy – OECD – June 2024 OECD discussion
 
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
Artificial Intelligence, Data and Competition – ČORBA – June 2024 OECD discus...
 
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussionArtificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – OECD – June 2024 OECD discussion
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
 
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussionArtificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
Artificial Intelligence, Data and Competition – LIM – June 2024 OECD discussion
 
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
Competition and Regulation in Professions and Occupations – OECD – June 2024 ...
 
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...Competition and Regulation in Professions and Occupations – ROBSON – June 202...
Competition and Regulation in Professions and Occupations – ROBSON – June 202...
 
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
Competition and Regulation in Professional Services – KLEINER – June 2024 OEC...
 
OECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - HighlightsOECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - Highlights
 
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
 
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussionEx-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussionEx-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
 
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
 

Recently uploaded

Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Dutch Power
 
Tom tresser burning issue.pptx My Burning issue
Tom tresser burning issue.pptx My Burning issueTom tresser burning issue.pptx My Burning issue
Tom tresser burning issue.pptx My Burning issue
amekonnen
 
Carrer goals.pptx and their importance in real life
Carrer goals.pptx  and their importance in real lifeCarrer goals.pptx  and their importance in real life
Carrer goals.pptx and their importance in real life
artemacademy2
 
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie WellsCollapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Rosie Wells
 
XP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to LeadershipXP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to Leadership
samililja
 
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
gpww3sf4
 
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Dutch Power
 
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPointMẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
1990 Media
 
Gregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics PresentationGregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics Presentation
gharris9
 
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij
 
Gregory Harris' Civics Presentation.pptx
Gregory Harris' Civics Presentation.pptxGregory Harris' Civics Presentation.pptx
Gregory Harris' Civics Presentation.pptx
gharris9
 
Updated diagnosis. Cause and treatment of hypothyroidism
Updated diagnosis. Cause and treatment of hypothyroidismUpdated diagnosis. Cause and treatment of hypothyroidism
Updated diagnosis. Cause and treatment of hypothyroidism
Faculty of Medicine And Health Sciences
 
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
SkillCertProExams
 
Burning Issue Presentation By Kenmaryon.pdf
Burning Issue Presentation By Kenmaryon.pdfBurning Issue Presentation By Kenmaryon.pdf
Burning Issue Presentation By Kenmaryon.pdf
kkirkland2
 
2024-05-30_meetup_devops_aix-marseille.pdf
2024-05-30_meetup_devops_aix-marseille.pdf2024-05-30_meetup_devops_aix-marseille.pdf
2024-05-30_meetup_devops_aix-marseille.pdf
Frederic Leger
 
ASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdfASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdf
ToshihiroIto4
 

Recently uploaded (16)

Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
Presentatie 4. Jochen Cremer - TU Delft 28 mei 2024
 
Tom tresser burning issue.pptx My Burning issue
Tom tresser burning issue.pptx My Burning issueTom tresser burning issue.pptx My Burning issue
Tom tresser burning issue.pptx My Burning issue
 
Carrer goals.pptx and their importance in real life
Carrer goals.pptx  and their importance in real lifeCarrer goals.pptx  and their importance in real life
Carrer goals.pptx and their importance in real life
 
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie WellsCollapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
Collapsing Narratives: Exploring Non-Linearity • a micro report by Rosie Wells
 
XP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to LeadershipXP 2024 presentation: A New Look to Leadership
XP 2024 presentation: A New Look to Leadership
 
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
原版制作贝德福特大学毕业证(bedfordhire毕业证)硕士文凭原版一模一样
 
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
Presentatie 8. Joost van der Linde & Daniel Anderton - Eliq 28 mei 2024
 
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPointMẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
Mẫu PPT kế hoạch làm việc sáng tạo cho nửa cuối năm PowerPoint
 
Gregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics PresentationGregory Harris - Cycle 2 - Civics Presentation
Gregory Harris - Cycle 2 - Civics Presentation
 
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...
 
Gregory Harris' Civics Presentation.pptx
Gregory Harris' Civics Presentation.pptxGregory Harris' Civics Presentation.pptx
Gregory Harris' Civics Presentation.pptx
 
Updated diagnosis. Cause and treatment of hypothyroidism
Updated diagnosis. Cause and treatment of hypothyroidismUpdated diagnosis. Cause and treatment of hypothyroidism
Updated diagnosis. Cause and treatment of hypothyroidism
 
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
Mastering the Concepts Tested in the Databricks Certified Data Engineer Assoc...
 
Burning Issue Presentation By Kenmaryon.pdf
Burning Issue Presentation By Kenmaryon.pdfBurning Issue Presentation By Kenmaryon.pdf
Burning Issue Presentation By Kenmaryon.pdf
 
2024-05-30_meetup_devops_aix-marseille.pdf
2024-05-30_meetup_devops_aix-marseille.pdf2024-05-30_meetup_devops_aix-marseille.pdf
2024-05-30_meetup_devops_aix-marseille.pdf
 
ASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdfASONAM2023_presection_slide_track-recommendation.pdf
ASONAM2023_presection_slide_track-recommendation.pdf
 

Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop

  • 1. Screening and data mining tools to detect cartels: Brazilian experience Workshop on cartel screening in the digital era OECD, Paris – 30 January 2018 Diogo Thomson de Andrade Deputy Superintendence of CADE Felipe Leitão Valadares Roquete Head of the Intelligence Unity of CADE
  • 2. Disclaimer The views expressed here are solely those of the author and do not in any way represent the views of the CADE, or any other entity of the Brazilian Government.
  • 3. Summary • How (and why) we create a Screening Unit? (1/?) • Projeto Cérebro1 : state of the art (?/?) • Projeto Cérebro: findings and (or?) challenges (?/?) • Simulations: a few actual examples (?/?) 1 Aka “The Brain Project"
  • 4. How (and why) we create a Screening Unit
  • 5. How (and why) we create a Screening Unit
  • 6. How (and why) we create a Screening Unit Origins and reason for primary focus on bid-rigging: • Authority priority in fighting bid-rigging since 2007; • Large amount of public data; • Large number of sources of data; • High difficult of data mining and multiplicity of databases; • Context of “big data” initiatives; • Economic theory and literature of screening; • Behaviour and pattern analysis of suspicion of collusion in public procurement (“red flags”).
  • 7. Phase 1: Benchmarking Phase 2: Data collection - formal agreements and webscraping Phase 3: External consultants - IT (data mining techniques) - Econometrics (screening methods) During all phases: internal expert “consultants” (senior investigators and case handlers) to “guide" external consultants based on the actual cartel detection experience from the brazilian authority How (and why) we create a Screening Unit
  • 8. Projeto Cérebro: state of the art Dump Oracle Comprasnet 200GB CSV ANP Georef 2GB TXT Petronect 90GB CSV Tribunal SP 170GB WebScraping DF 1GB Federal Revenue 217GB XLS CEMED ANVISA 0,2GB All the data... >2TB ~40 databases BAK Tribunal PE 1,5GB
  • 9. • Set of public databases or private databases of public data (via cooperation agreements); • One, searchable, IT “language”. Data Warehouse • Patterns and similarities in competitors behaviour; • Suspicious/rare facts; • Signs of simulation of competition; • Plots and trails of analysis of bid-rigging (CADE/others); • Automation of the analysis made by the case-handlers. Data Mining • Screenings literature: test of hypothesys; • Generalizations based on past concrete cases; • Microeconomic theory. Statistical Tests Projeto Cérebro: state of the art
  • 10. Interface (web and Qlickview) Projeto Cérebro: state of the art
  • 11. Projeto Cérebro: state of the art Applications: • Ex officio investigations (enough for a dawn raid at least); • Support and enhance ongoing investigations; • General support of data for all units of CADE (collateral effect)
  • 12. Architecture Software: open source (“R”, Python and neo4j) and proprietary (SQL Server and Qlikview) Projeto Cérebro: findings and (/or?) challenges
  • 13. Challenge #0 Institutional differences: impact on public procurement design and private market exchanges - public procurement regulations and bid rigging strategies - different comprehensiveness in scope of provisions to access public and private data - data mining techniques and screening methods are replicable? Projeto Cérebro: findings and (/or?) challenges
  • 14. Challenge #0 Example: Rebid (Kawai & Nakabayashi) Detecting Large-Scale Collusion in Procurement Auctions Projeto Cérebro: findings and (/or?) challenges
  • 15. Projeto Cérebro: findings and (/or?) challenges Challenge #1 Data: access, comprehensiveness, quality and cost - how much resources - public procurement and private markets: availability - completeness and quality
  • 16. Projeto Cérebro: findings and (/or?) challenges Challenge #1 Example: Swiss Competition Authority Bid Rigging Flagging
  • 17. Challenge #2 Sreening actual : intelligence or prosecution? - prioritization tool? - to enhance formal cases? - cost benefit analysis? Projeto Cérebro: findings and (/or?) challenges
  • 18. Projeto Cérebro: findings and (/or?) challenges Challenge #2 Example: CADE’s Fuel Retail Market Screen
  • 19. Challenge #3 Translation: IT and econometrics technicalities and non-experts - Jucidiary Power, lawyers, public servers, etc. - risk to weaken the case? - strategy: incremental or stationary? Projeto Cérebro: findings and (/or?) challenges
  • 20. • Federal government e- procurement system: Comprasnet • On average 60.000 public tenders / year. • Patterns being looked for: • Bid suppression • Cover bidding • Bid rotation • Superfluous losing bidders • Stable market share • Pricing patterns • Text similarities • Submitted files metadata Simulations: a few actual examples Brazil: public procurement data’s overview
  • 21. Benford Simulations: a few actual examples
  • 22. Simulations: a few actual examples Cérebro: on line simulations
  • 23. Thank you very much! Merci beaucoup! Diogo Thomson de Andrade diogo.andrade@cade.gov.br Felipe Leitão Valadares Roquete felipe.roquete@cade.gov.br