SlideShare a Scribd company logo
1 of 23
Download to read offline
Screening and data mining tools to detect cartels:
Brazilian experience
Workshop on cartel screening in the digital era
OECD, Paris – 30 January 2018
Diogo Thomson de Andrade
Deputy Superintendence of CADE
Felipe Leitão Valadares Roquete
Head of the Intelligence Unity of CADE
Disclaimer
The views expressed here are solely those of the author and do not in any way represent the views of the
CADE, or any other entity of the Brazilian Government.
Summary
• How (and why) we create a Screening Unit? (1/?)
• Projeto Cérebro1
: state of the art (?/?)
• Projeto Cérebro: findings and (or?) challenges (?/?)
• Simulations: a few actual examples (?/?)
1
Aka “The Brain Project"
How (and why) we create a Screening Unit
How (and why) we create a Screening Unit
How (and why) we create a Screening Unit
Origins and reason for primary focus on bid-rigging:
• Authority priority in fighting bid-rigging since 2007;
• Large amount of public data;
• Large number of sources of data;
• High difficult of data mining and multiplicity of databases;
• Context of “big data” initiatives;
• Economic theory and literature of screening;
• Behaviour and pattern analysis of suspicion of collusion in public
procurement (“red flags”).
Phase 1: Benchmarking
Phase 2: Data collection
- formal agreements and webscraping
Phase 3: External consultants
- IT (data mining techniques)
- Econometrics (screening methods)
During all phases: internal expert “consultants” (senior investigators and
case handlers) to “guide" external consultants based on the actual cartel
detection experience from the brazilian authority
How (and why) we create a Screening Unit
Projeto Cérebro: state of the art
Dump Oracle Comprasnet
200GB
CSV ANP Georef
2GB
TXT Petronect
90GB
CSV Tribunal SP
170GB
WebScraping DF
1GB
Federal Revenue
217GB
XLS CEMED ANVISA
0,2GB
All the data...
>2TB
~40 databases
BAK Tribunal PE
1,5GB
• Set of public databases or private databases of public
data (via cooperation agreements);
• One, searchable, IT “language”.
Data
Warehouse
• Patterns and similarities in competitors behaviour;
• Suspicious/rare facts;
• Signs of simulation of competition;
• Plots and trails of analysis of bid-rigging (CADE/others);
• Automation of the analysis made by the case-handlers.
Data Mining
• Screenings literature: test of hypothesys;
• Generalizations based on past concrete cases;
• Microeconomic theory.
Statistical
Tests
Projeto Cérebro: state of the art
Interface (web and Qlickview)
Projeto Cérebro: state of the art
Projeto Cérebro: state of the art
Applications:
• Ex officio investigations (enough for a dawn raid at least);
• Support and enhance ongoing investigations;
• General support of data for all units of CADE (collateral effect)
Architecture
Software: open source (“R”, Python and neo4j) and proprietary (SQL Server and Qlikview)
Projeto Cérebro: findings and (/or?) challenges
Challenge #0
Institutional differences: impact on public procurement design and private market
exchanges
- public procurement regulations and bid rigging strategies
- different comprehensiveness in scope of provisions to access public and private data
- data mining techniques and screening methods are replicable?
Projeto Cérebro: findings and (/or?) challenges
Challenge #0
Example: Rebid (Kawai & Nakabayashi)
Detecting Large-Scale Collusion in Procurement Auctions
Projeto Cérebro: findings and (/or?) challenges
Projeto Cérebro: findings and (/or?) challenges
Challenge #1
Data: access, comprehensiveness, quality and cost
- how much resources
- public procurement and private markets: availability
- completeness and quality
Projeto Cérebro: findings and (/or?) challenges
Challenge #1
Example: Swiss Competition Authority
Bid Rigging Flagging
Challenge #2
Sreening actual : intelligence or prosecution?
- prioritization tool?
- to enhance formal cases?
- cost benefit analysis?
Projeto Cérebro: findings and (/or?) challenges
Projeto Cérebro: findings and (/or?) challenges
Challenge #2
Example: CADE’s Fuel Retail Market Screen
Challenge #3
Translation: IT and econometrics technicalities and non-experts
- Jucidiary Power, lawyers, public servers, etc.
- risk to weaken the case?
- strategy: incremental or stationary?
Projeto Cérebro: findings and (/or?) challenges
• Federal government e-
procurement system:
Comprasnet
• On average 60.000 public
tenders / year.
• Patterns being looked for:
• Bid suppression
• Cover bidding
• Bid rotation
• Superfluous losing bidders
• Stable market share
• Pricing patterns
• Text similarities
• Submitted files metadata
Simulations: a few actual examples
Brazil: public procurement data’s overview
Benford
Simulations: a few actual examples
Simulations: a few actual examples
Cérebro: on line simulations
Thank you very much!
Merci beaucoup!
Diogo Thomson de Andrade
diogo.andrade@cade.gov.br
Felipe Leitão Valadares Roquete
felipe.roquete@cade.gov.br

More Related Content

What's hot

Machine Learning for Survival Analysis
Machine Learning for Survival AnalysisMachine Learning for Survival Analysis
Machine Learning for Survival Analysis
Chandan Reddy
 
Uplift Modeling Workshop
Uplift Modeling WorkshopUplift Modeling Workshop
Uplift Modeling Workshop
odsc
 

What's hot (6)

FY18 NIKE, Inc. Impact Report
FY18 NIKE, Inc. Impact ReportFY18 NIKE, Inc. Impact Report
FY18 NIKE, Inc. Impact Report
 
Prediction of customer propensity to churn - Telecom Industry
Prediction of customer propensity to churn - Telecom IndustryPrediction of customer propensity to churn - Telecom Industry
Prediction of customer propensity to churn - Telecom Industry
 
Churn prediction data modeling
Churn prediction data modelingChurn prediction data modeling
Churn prediction data modeling
 
Machine Learning for Survival Analysis
Machine Learning for Survival AnalysisMachine Learning for Survival Analysis
Machine Learning for Survival Analysis
 
Uplift Modeling Workshop
Uplift Modeling WorkshopUplift Modeling Workshop
Uplift Modeling Workshop
 
Lect6 Association rule & Apriori algorithm
Lect6 Association rule & Apriori algorithmLect6 Association rule & Apriori algorithm
Lect6 Association rule & Apriori algorithm
 

Similar to Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop

Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with Oracle
Sai Janakiram Penumuru
 

Similar to Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop (20)

Big data in Private Banking
Big data in Private BankingBig data in Private Banking
Big data in Private Banking
 
Data Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk ManagementData Science Application in Business Portfolio & Risk Management
Data Science Application in Business Portfolio & Risk Management
 
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted ReviewLearning from Big Data – Simplify Your Workflow Using Technology Assisted Review
Learning from Big Data – Simplify Your Workflow Using Technology Assisted Review
 
21st Century Licensing Strategies
21st Century Licensing Strategies21st Century Licensing Strategies
21st Century Licensing Strategies
 
Data mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid languageData mining and Machine learning expained in jargon free & lucid language
Data mining and Machine learning expained in jargon free & lucid language
 
8 minute intro to data science
8 minute intro to data science 8 minute intro to data science
8 minute intro to data science
 
Machine Learning for Finance Master Class
Machine Learning for Finance Master Class Machine Learning for Finance Master Class
Machine Learning for Finance Master Class
 
The Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessThe Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for Success
 
Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"Borys Pratsiuk "How to be NVidia partner"
Borys Pratsiuk "How to be NVidia partner"
 
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
Hadoop World 2011: The Hadoop Award for Government Excellence - Bob Gourley -...
 
Why am I doing this???
Why am I doing this???Why am I doing this???
Why am I doing this???
 
Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with Oracle
 
Rabobank - There is something about Data
Rabobank - There is something about DataRabobank - There is something about Data
Rabobank - There is something about Data
 
The GFCC Competitiveness Decoder
The GFCC Competitiveness DecoderThe GFCC Competitiveness Decoder
The GFCC Competitiveness Decoder
 
Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez Course 8 : How to start your big data project by Eric Rodriguez
Course 8 : How to start your big data project by Eric Rodriguez
 
Log Mining: Beyond Log Analysis
Log Mining: Beyond Log AnalysisLog Mining: Beyond Log Analysis
Log Mining: Beyond Log Analysis
 
2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya2015 05-27-congrés archivoscatalunya
2015 05-27-congrés archivoscatalunya
 
S fahey
S faheyS fahey
S fahey
 
How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?How Data Science Can Grow Your Business?
How Data Science Can Grow Your Business?
 
Covid19 smart screening tool presentation
Covid19 smart screening tool presentationCovid19 smart screening tool presentation
Covid19 smart screening tool presentation
 

More from OECD Directorate for Financial and Enterprise Affairs

More from OECD Directorate for Financial and Enterprise Affairs (20)

OECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - HighlightsOECD Competition Trends 2024 - Highlights
OECD Competition Trends 2024 - Highlights
 
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – CAMACHO – December 2023 OECD discu...
 
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KOVACIC – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussionEx-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – KWOKA – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussionEx-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – FLETCHER – December 2023 OECD discussion
 
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussionEx-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
Ex-post Assessment of Merger Remedies – OECD – December 2023 OECD discussion
 
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
Use of Economic Evidence in Cartel Cases – DAVIES – December 2023 OECD discus...
 
Use of Economic Evidence in Cartel Cases – ROBERTS – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – ROBERTS – December 2023 OECD discu...Use of Economic Evidence in Cartel Cases – ROBERTS – December 2023 OECD discu...
Use of Economic Evidence in Cartel Cases – ROBERTS – December 2023 OECD discu...
 
Alternatives to Leniency Programmes – SERBIA – December 2023 OECD discussion
Alternatives to Leniency Programmes – SERBIA – December 2023 OECD discussionAlternatives to Leniency Programmes – SERBIA – December 2023 OECD discussion
Alternatives to Leniency Programmes – SERBIA – December 2023 OECD discussion
 
Alternatives to Leniency Programmes – ITALY – December 2023 OECD discussion
Alternatives to Leniency Programmes – ITALY – December 2023 OECD discussionAlternatives to Leniency Programmes – ITALY – December 2023 OECD discussion
Alternatives to Leniency Programmes – ITALY – December 2023 OECD discussion
 
Out-of-Market Efficiencies in Competition Enforcement – CRANE – December 2023...
Out-of-Market Efficiencies in Competition Enforcement – CRANE – December 2023...Out-of-Market Efficiencies in Competition Enforcement – CRANE – December 2023...
Out-of-Market Efficiencies in Competition Enforcement – CRANE – December 2023...
 
Out-of-Market Efficiencies in Competition Enforcement – DAVIES – December 202...
Out-of-Market Efficiencies in Competition Enforcement – DAVIES – December 202...Out-of-Market Efficiencies in Competition Enforcement – DAVIES – December 202...
Out-of-Market Efficiencies in Competition Enforcement – DAVIES – December 202...
 
Out-of-Market Efficiencies in Competition Enforcement – ROSE – December 2023 ...
Out-of-Market Efficiencies in Competition Enforcement – ROSE – December 2023 ...Out-of-Market Efficiencies in Competition Enforcement – ROSE – December 2023 ...
Out-of-Market Efficiencies in Competition Enforcement – ROSE – December 2023 ...
 
Out-of-Market Efficiencies in Competition Enforcement – ROSENBOOM – December ...
Out-of-Market Efficiencies in Competition Enforcement – ROSENBOOM – December ...Out-of-Market Efficiencies in Competition Enforcement – ROSENBOOM – December ...
Out-of-Market Efficiencies in Competition Enforcement – ROSENBOOM – December ...
 
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...
 
Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussionSerial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussion
 
Serial Acquisitions and Industry Roll-ups – KOKKORIS – December 2023 OECD dis...
Serial Acquisitions and Industry Roll-ups – KOKKORIS – December 2023 OECD dis...Serial Acquisitions and Industry Roll-ups – KOKKORIS – December 2023 OECD dis...
Serial Acquisitions and Industry Roll-ups – KOKKORIS – December 2023 OECD dis...
 
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussionSerial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussion
 
Competition and Innovation - The Role of Innovation in Enforcement Cases – VE...
Competition and Innovation - The Role of Innovation in Enforcement Cases – VE...Competition and Innovation - The Role of Innovation in Enforcement Cases – VE...
Competition and Innovation - The Role of Innovation in Enforcement Cases – VE...
 
Competition and Innovation - The Role of Innovation in Enforcement Cases – OE...
Competition and Innovation - The Role of Innovation in Enforcement Cases – OE...Competition and Innovation - The Role of Innovation in Enforcement Cases – OE...
Competition and Innovation - The Role of Innovation in Enforcement Cases – OE...
 

Recently uploaded

Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
raffaeleoman
 
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
amilabibi1
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
Kayode Fayemi
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
Kayode Fayemi
 

Recently uploaded (18)

AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdfAWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
 
Report Writing Webinar Training
Report Writing Webinar TrainingReport Writing Webinar Training
Report Writing Webinar Training
 
Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verifiedSector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
 
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
 
ICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdfICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdf
 
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
 
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
 
My Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle BaileyMy Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle Bailey
 
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
 
Dreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio IIIDreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio III
 
Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510
 
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdfThe workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
 
Causes of poverty in France presentation.pptx
Causes of poverty in France presentation.pptxCauses of poverty in France presentation.pptx
Causes of poverty in France presentation.pptx
 
lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
 
Dreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video TreatmentDreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video Treatment
 
Digital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of DrupalDigital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of Drupal
 

Cartel screening in the digital era – CADE Brazil – January 2018 OECD Workshop

  • 1. Screening and data mining tools to detect cartels: Brazilian experience Workshop on cartel screening in the digital era OECD, Paris – 30 January 2018 Diogo Thomson de Andrade Deputy Superintendence of CADE Felipe Leitão Valadares Roquete Head of the Intelligence Unity of CADE
  • 2. Disclaimer The views expressed here are solely those of the author and do not in any way represent the views of the CADE, or any other entity of the Brazilian Government.
  • 3. Summary • How (and why) we create a Screening Unit? (1/?) • Projeto Cérebro1 : state of the art (?/?) • Projeto Cérebro: findings and (or?) challenges (?/?) • Simulations: a few actual examples (?/?) 1 Aka “The Brain Project"
  • 4. How (and why) we create a Screening Unit
  • 5. How (and why) we create a Screening Unit
  • 6. How (and why) we create a Screening Unit Origins and reason for primary focus on bid-rigging: • Authority priority in fighting bid-rigging since 2007; • Large amount of public data; • Large number of sources of data; • High difficult of data mining and multiplicity of databases; • Context of “big data” initiatives; • Economic theory and literature of screening; • Behaviour and pattern analysis of suspicion of collusion in public procurement (“red flags”).
  • 7. Phase 1: Benchmarking Phase 2: Data collection - formal agreements and webscraping Phase 3: External consultants - IT (data mining techniques) - Econometrics (screening methods) During all phases: internal expert “consultants” (senior investigators and case handlers) to “guide" external consultants based on the actual cartel detection experience from the brazilian authority How (and why) we create a Screening Unit
  • 8. Projeto Cérebro: state of the art Dump Oracle Comprasnet 200GB CSV ANP Georef 2GB TXT Petronect 90GB CSV Tribunal SP 170GB WebScraping DF 1GB Federal Revenue 217GB XLS CEMED ANVISA 0,2GB All the data... >2TB ~40 databases BAK Tribunal PE 1,5GB
  • 9. • Set of public databases or private databases of public data (via cooperation agreements); • One, searchable, IT “language”. Data Warehouse • Patterns and similarities in competitors behaviour; • Suspicious/rare facts; • Signs of simulation of competition; • Plots and trails of analysis of bid-rigging (CADE/others); • Automation of the analysis made by the case-handlers. Data Mining • Screenings literature: test of hypothesys; • Generalizations based on past concrete cases; • Microeconomic theory. Statistical Tests Projeto Cérebro: state of the art
  • 10. Interface (web and Qlickview) Projeto Cérebro: state of the art
  • 11. Projeto Cérebro: state of the art Applications: • Ex officio investigations (enough for a dawn raid at least); • Support and enhance ongoing investigations; • General support of data for all units of CADE (collateral effect)
  • 12. Architecture Software: open source (“R”, Python and neo4j) and proprietary (SQL Server and Qlikview) Projeto Cérebro: findings and (/or?) challenges
  • 13. Challenge #0 Institutional differences: impact on public procurement design and private market exchanges - public procurement regulations and bid rigging strategies - different comprehensiveness in scope of provisions to access public and private data - data mining techniques and screening methods are replicable? Projeto Cérebro: findings and (/or?) challenges
  • 14. Challenge #0 Example: Rebid (Kawai & Nakabayashi) Detecting Large-Scale Collusion in Procurement Auctions Projeto Cérebro: findings and (/or?) challenges
  • 15. Projeto Cérebro: findings and (/or?) challenges Challenge #1 Data: access, comprehensiveness, quality and cost - how much resources - public procurement and private markets: availability - completeness and quality
  • 16. Projeto Cérebro: findings and (/or?) challenges Challenge #1 Example: Swiss Competition Authority Bid Rigging Flagging
  • 17. Challenge #2 Sreening actual : intelligence or prosecution? - prioritization tool? - to enhance formal cases? - cost benefit analysis? Projeto Cérebro: findings and (/or?) challenges
  • 18. Projeto Cérebro: findings and (/or?) challenges Challenge #2 Example: CADE’s Fuel Retail Market Screen
  • 19. Challenge #3 Translation: IT and econometrics technicalities and non-experts - Jucidiary Power, lawyers, public servers, etc. - risk to weaken the case? - strategy: incremental or stationary? Projeto Cérebro: findings and (/or?) challenges
  • 20. • Federal government e- procurement system: Comprasnet • On average 60.000 public tenders / year. • Patterns being looked for: • Bid suppression • Cover bidding • Bid rotation • Superfluous losing bidders • Stable market share • Pricing patterns • Text similarities • Submitted files metadata Simulations: a few actual examples Brazil: public procurement data’s overview
  • 21. Benford Simulations: a few actual examples
  • 22. Simulations: a few actual examples Cérebro: on line simulations
  • 23. Thank you very much! Merci beaucoup! Diogo Thomson de Andrade diogo.andrade@cade.gov.br Felipe Leitão Valadares Roquete felipe.roquete@cade.gov.br