Submit Search
Upload
Machine learning framework for competitions and neural network optimization
•
17 likes
•
6,475 views
AI-enhanced title
Abhishek Thakur
Follow
Talk at pydata paris
Read less
Read more
Data & Analytics
Report
Share
Report
Share
1 of 42
Download now
Download to read offline
Recommended
Python's slippy path and Tao of thick Pandas: give my data, Rrrrr...
Python's slippy path and Tao of thick Pandas: give my data, Rrrrr...
Alexey Zinoviev
Automate Machine Learning Pipeline Using MLBox
Automate Machine Learning Pipeline Using MLBox
Axel de Romblay
Video Analysis in Autonomous Systems: Data Analytics Challenges
Video Analysis in Autonomous Systems: Data Analytics Challenges
krishna_dubba
Introduction to Machine Learning with SciKit-Learn
Introduction to Machine Learning with SciKit-Learn
Benjamin Bengfort
Automatic Machine Learning, AutoML
Automatic Machine Learning, AutoML
Himadri Mishra
51st solution of Avito demand prediction competition on Kaggle
51st solution of Avito demand prediction competition on Kaggle
Nasuka Sumino
CIKM Cup 2016: Cross-Device Linking
CIKM Cup 2016: Cross-Device Linking
Alexey Grigorev
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Preferred Networks
Recommended
Python's slippy path and Tao of thick Pandas: give my data, Rrrrr...
Python's slippy path and Tao of thick Pandas: give my data, Rrrrr...
Alexey Zinoviev
Automate Machine Learning Pipeline Using MLBox
Automate Machine Learning Pipeline Using MLBox
Axel de Romblay
Video Analysis in Autonomous Systems: Data Analytics Challenges
Video Analysis in Autonomous Systems: Data Analytics Challenges
krishna_dubba
Introduction to Machine Learning with SciKit-Learn
Introduction to Machine Learning with SciKit-Learn
Benjamin Bengfort
Automatic Machine Learning, AutoML
Automatic Machine Learning, AutoML
Himadri Mishra
51st solution of Avito demand prediction competition on Kaggle
51st solution of Avito demand prediction competition on Kaggle
Nasuka Sumino
CIKM Cup 2016: Cross-Device Linking
CIKM Cup 2016: Cross-Device Linking
Alexey Grigorev
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Preferred Networks
[Paper Reading] QAGen: Generating query-aware test databases
[Paper Reading] QAGen: Generating query-aware test databases
PingCAP
DC02. Interpretation of predictions
DC02. Interpretation of predictions
Anton Kulesh
Data engineering in 10 years.pdf
Data engineering in 10 years.pdf
Lars Albertsson
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
Berker Kozan
Ad Placement Challenge
Ad Placement Challenge
Alexey Grigorev
Dimensionality Reduction
Dimensionality Reduction
Knoldus Inc.
Botnet detection in SDN by DL techniques
Botnet detection in SDN by DL techniques
Ivan Letteri
Bimbo Final Project Presentation
Bimbo Final Project Presentation
Can Köklü
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
Kanwal Prakash Singh
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
Kanwal Prakash Singh
Feature Selection Strategies for HTTP Botnet Traffic Detection
Feature Selection Strategies for HTTP Botnet Traffic Detection
Ivan Letteri
Data processing qgis3_foss4g-eu_2017
Data processing qgis3_foss4g-eu_2017
Camptocamp
Presto Bangalore Meetup1 Repertoire@Myntra
Presto Bangalore Meetup1 Repertoire@Myntra
Shubham Tagra
Click prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real life
Alexey Grigorev
A domain specific language for configurable traceability analysis
A domain specific language for configurable traceability analysis
Hendrik Bünder
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
LogeekNightUkraine
Introduction to competitive machine learning
Introduction to competitive machine learning
Hawaii Machine Learning Meetup
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Manjunath Sindagi
Secure software supply chain on a shoestring budget
Secure software supply chain on a shoestring budget
Lars Albertsson
CatBoost intro
CatBoost intro
Rodion Kiryukhin
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Jack DiGiovanna
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
Sonatrach
More Related Content
Similar to Machine learning framework for competitions and neural network optimization
[Paper Reading] QAGen: Generating query-aware test databases
[Paper Reading] QAGen: Generating query-aware test databases
PingCAP
DC02. Interpretation of predictions
DC02. Interpretation of predictions
Anton Kulesh
Data engineering in 10 years.pdf
Data engineering in 10 years.pdf
Lars Albertsson
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
Berker Kozan
Ad Placement Challenge
Ad Placement Challenge
Alexey Grigorev
Dimensionality Reduction
Dimensionality Reduction
Knoldus Inc.
Botnet detection in SDN by DL techniques
Botnet detection in SDN by DL techniques
Ivan Letteri
Bimbo Final Project Presentation
Bimbo Final Project Presentation
Can Köklü
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
Kanwal Prakash Singh
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
Kanwal Prakash Singh
Feature Selection Strategies for HTTP Botnet Traffic Detection
Feature Selection Strategies for HTTP Botnet Traffic Detection
Ivan Letteri
Data processing qgis3_foss4g-eu_2017
Data processing qgis3_foss4g-eu_2017
Camptocamp
Presto Bangalore Meetup1 Repertoire@Myntra
Presto Bangalore Meetup1 Repertoire@Myntra
Shubham Tagra
Click prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real life
Alexey Grigorev
A domain specific language for configurable traceability analysis
A domain specific language for configurable traceability analysis
Hendrik Bünder
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
LogeekNightUkraine
Introduction to competitive machine learning
Introduction to competitive machine learning
Hawaii Machine Learning Meetup
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Manjunath Sindagi
Secure software supply chain on a shoestring budget
Secure software supply chain on a shoestring budget
Lars Albertsson
CatBoost intro
CatBoost intro
Rodion Kiryukhin
Similar to Machine learning framework for competitions and neural network optimization
(20)
[Paper Reading] QAGen: Generating query-aware test databases
[Paper Reading] QAGen: Generating query-aware test databases
DC02. Interpretation of predictions
DC02. Interpretation of predictions
Data engineering in 10 years.pdf
Data engineering in 10 years.pdf
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
DA 592 - Term Project Presentation - Berker Kozan Can Koklu - Kaggle Contest
Ad Placement Challenge
Ad Placement Challenge
Dimensionality Reduction
Dimensionality Reduction
Botnet detection in SDN by DL techniques
Botnet detection in SDN by DL techniques
Bimbo Final Project Presentation
Bimbo Final Project Presentation
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
India Analytics and Big Data Summit 2015
Feature Selection Strategies for HTTP Botnet Traffic Detection
Feature Selection Strategies for HTTP Botnet Traffic Detection
Data processing qgis3_foss4g-eu_2017
Data processing qgis3_foss4g-eu_2017
Presto Bangalore Meetup1 Repertoire@Myntra
Presto Bangalore Meetup1 Repertoire@Myntra
Click prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real life
A domain specific language for configurable traceability analysis
A domain specific language for configurable traceability analysis
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
Artem Melnytskyi "Friendly Сo-pilot as a Practical AI Application"
Introduction to competitive machine learning
Introduction to competitive machine learning
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
Secure software supply chain on a shoestring budget
Secure software supply chain on a shoestring budget
CatBoost intro
CatBoost intro
Recently uploaded
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Jack DiGiovanna
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
Sonatrach
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
Stephen266013
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
sapnasaifi408
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
voginip
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
thyngster
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
dataanalyticsqueen03
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
thyngster
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
Boston Institute of Analytics
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
soniya singh
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
jennyeacort
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
ccctableauusergroup
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Sapana Sha
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
soniya singh
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
Sapana Sha
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
F La
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Universitat Politècnica de Catalunya
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
e4aez8ss
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Boston Institute of Analytics
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
jennyeacort
Recently uploaded
(20)
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Machine learning framework for competitions and neural network optimization
1.
2.
3.
○ ○ ○ ○ ○ ○
4.
https://competitions.codalab.org/competitions/2321Image Source: http://www.causality.inf.ethz.ch/AutoML/spiral.png
5.
6.
○ ○ ○ ○ ○
7.
AutoCompete: A Framework
for Machine Learning Competitions, A.Thakur and A Krohn-Grimberghe, ICML AutoML Workshop, 2015
8.
9.
10.
11.
12.
● Numerical Data: ○
Do nothing
13.
● Numerical Data: ○
Do nothing ● Categorical Data: ○ Label encoding ○ One-hot encoding
14.
● Numerical Data: ○
Do nothing ● Categorical Data: ○ Label encoding ○ One-hot encoding
15.
● Numerical Data: ○
Do nothing ● Categorical Data: ○ Label encoding ○ One-hot encoding
16.
● Numerical Data: ○
Do nothing ● Text Data: ○ Counts ○ TF-IDF
17.
● Numerical Data: ○
Do nothing ● Text Data: ○ Counts ○ TF-IDF
18.
19.
20.
21.
22.
23.
24.
25.
● Multiple ways
of feature selection ● Random forest based feature importances ● Feature importances from GBM ● Chi2 feature selection ● Greedy feature selection
26.
● Multiple ways
of feature selection ● Random forest based feature importances ● Feature importances from GBM ● Chi2 feature selection ● Greedy feature selection
27.
● Multiple ways
of feature selection ● Random forest based feature importances ● Feature importances from GBM ● Chi2 feature selection ● Greedy feature selection
28.
● Multiple ways
of feature selection ● Random forest based feature importances ● Feature importances from GBM ● Chi2 feature selection ● Greedy feature selection
29.
● Multiple ways
of feature selection ● Random forest based feature importances ● Feature importances from GBM ● Chi2 feature selection ● Greedy feature selection
30.
31.
● Grid Search ●
Random Search
32.
● Classification: ○ Random
Forest ○ GBM ○ Logistic Regression ○ Naive Bayes ○ Support Vector Machines ○ k-Nearest Neighbors ● Grid Search ● Random Search
33.
● Classification: ○ Random
Forest ○ GBM ○ Logistic Regression ○ Naive Bayes ○ Support Vector Machines ○ k-Nearest Neighbors ● Regression ○ Random Forest ○ GBM ○ Linear Regression ○ Ridge ○ Lasso ○ SVR ● Grid Search ● Random Search
34.
To Appear: AutoCompete
2.0: A Framework for Optimizing Parameters of Neural Networks, A.Thakur, ICML AutoML Workshop, System Desc Track, 2016
35.
○ ○ ○ ○ ○ ○ ○
36.
37.
Results on Newsgroups-20
dataset
38.
AutoML Final1 Results
39.
AutoML Final4 Results
40.
AutoML GPU Track Results
41.
42.
● @abhi1thakur ● bit.ly/thakurabhishek ●
kaggle.com/abhishek
Download now