Abhishek Thakur, searchmetrics @ PyData Paris 2016

3. ○
○
○
○
○
○

4. https://competitions.codalab.org/competitions/2321Image Source: http://www.causality.inf.ethz.ch/AutoML/spiral.png

6. ○
○
○
○
○

7. AutoCompete: A Framework for Machine Learning Competitions, A.Thakur and A Krohn-Grimberghe, ICML AutoML Workshop, 2015

12. ● Numerical Data:
○ Do nothing

13. ● Numerical Data:
○ Do nothing
● Categorical Data:
○ Label encoding
○ One-hot encoding

14. ● Numerical Data:
○ Do nothing
● Categorical Data:
○ Label encoding
○ One-hot encoding

15. ● Numerical Data:
○ Do nothing
● Categorical Data:
○ Label encoding
○ One-hot encoding

16. ● Numerical Data:
○ Do nothing
● Text Data:
○ Counts
○ TF-IDF

17. ● Numerical Data:
○ Do nothing
● Text Data:
○ Counts
○ TF-IDF

25. ● Multiple ways of feature selection
● Random forest based feature importances
● Feature importances from GBM
● Chi2 feature selection
● Greedy feature selection

26. ● Multiple ways of feature selection
● Random forest based feature importances
● Feature importances from GBM
● Chi2 feature selection
● Greedy feature selection

27. ● Multiple ways of feature selection
● Random forest based feature importances
● Feature importances from GBM
● Chi2 feature selection
● Greedy feature selection

28. ● Multiple ways of feature selection
● Random forest based feature importances
● Feature importances from GBM
● Chi2 feature selection
● Greedy feature selection

29. ● Multiple ways of feature selection
● Random forest based feature importances
● Feature importances from GBM
● Chi2 feature selection
● Greedy feature selection

31. ● Grid Search
● Random Search

32. ● Classification:
○ Random Forest
○ GBM
○ Logistic Regression
○ Naive Bayes
○ Support Vector Machines
○ k-Nearest Neighbors ● Grid Search
● Random Search

33. ● Classification:
○ Random Forest
○ GBM
○ Logistic Regression
○ Naive Bayes
○ Support Vector Machines
○ k-Nearest Neighbors
● Regression
○ Random Forest
○ GBM
○ Linear Regression
○ Ridge
○ Lasso
○ SVR
● Grid Search
● Random Search

34. To Appear: AutoCompete 2.0: A Framework for Optimizing Parameters of Neural Networks, A.Thakur, ICML AutoML Workshop, System Desc Track, 2016

35. ○
○
○
○
○
○
○

37. Results on Newsgroups-20 dataset

38. AutoML Final1 Results

39. AutoML Final4 Results

40. AutoML GPU Track
Results

42. ● @abhi1thakur
● bit.ly/thakurabhishek
● kaggle.com/abhishek