Download as PDF, PPTX
Uploaded byQingkai Kong
Machine learning with scikit-learn
This document provides an overview of machine learning concepts and techniques using the scikit-learn library in Python. It begins with introductions to different types of machine learning problems including supervised learning tasks like classification and regression as well as unsupervised learning problems like clustering and dimensionality reduction. It then discusses common machine learning algorithms such as support vector machines, k-means clustering, random forests, and principal component analysis. The document also covers best practices for developing machine learning models including data preprocessing, evaluating model performance, and tuning hyperparameters.
More Related Content
Similar to Machine learning with scikit-learn
![[DSC Europe 25] Uros Pesic - The Reality of AI in Marketing.pdf](https://cdn.slidesharecdn.com/ss_thumbnails/rtkodnmtycovsllvzsyn-9-251215095918-b0c6bfe3-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Jovan Bogicevic - Legacy to AI-Driven Defense: Transforming D...](https://cdn.slidesharecdn.com/ss_thumbnails/rsarluadt563hntyfc8q-3-251211083849-3e7bc4c0-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Vladimir Jelic - The AI-Driven Security Shift From Reactive D...](https://cdn.slidesharecdn.com/ss_thumbnails/6g5gj25mtjwayniqem1t-6-251209104645-7a5a5fc6-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Miodrag Pesovic & Vladislav Radonjic - Federated Data Archite...](https://cdn.slidesharecdn.com/ss_thumbnails/gsbe3y5it5uhndi4e08e-1-251212103249-f1008e0c-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Branko Urosevic -Rethinking Financial Talent: Integrating Cod...](https://cdn.slidesharecdn.com/ss_thumbnails/8jjrus8ttko6qj64f58f-3-251212103250-642c6374-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Milan Sekuloski - Data, Defence, and Development: Cybersecuri...](https://cdn.slidesharecdn.com/ss_thumbnails/dfrkwwx4qly6atqpbl4z-4-251209104645-c3d4b0ca-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Dunja Adzic Jovanovic - AI and Cybersecurity: Defending Data ...](https://cdn.slidesharecdn.com/ss_thumbnails/o1zylpbhrtwnixxq2xj8-7-251211083048-185086f6-thumbnail.jpg?width=640&height=640&fit=bounds)
Machine learning with scikit-learn
- 1. Machine Learning From xkcd
- 2. Machine learning - usingscikit-learn Qingkai Kong 2017-06-28 h+p://seismo.berkeley.edu/qingkaikong/
- 3.
- 4. Workshop time Learningcurve Gentle Introduction • What’s ML • Types of ML ML tours • Classification • Regression • Clsutering • Dim. reduction Common Practices h+ps://github.com/qingkaikong/20170628_ML_sklearn
- 5. What is machinelearning? h+ps://github.com/qingkaikong/20170628_ML_sklearn
- 6. Data examples Tunable Model Optimization algorithm Trained Model Pipeline of traininga machine learning model.
- 7. Self-driving car Voice recognition … h+ps://github.com/qingkaikong/20170628_ML_sklearn
- 8.
- 9. Common types ofmachine learning Supervised learning Unsupervised learning
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20. Dimensionality reduction Figure from h+ps://stats.stackexchange.com/quesIons/183236/what-‐is-‐the-‐relaIon-‐between-‐k-‐means-‐clustering-‐and-‐pca
- 21. Data examples Tunable Model Optimization algorithm Trained Model Pipeline of traininga machine learning model.
- 22. Representation of data Documents Images Numbers Sounds Raw data
- 23. Representation of data Documents Images Numbers Sounds Raw data n_features n_samples Feature matrix (X) Target (y) n_samples
- 24.
- 25. How we optimize? X Y Asimple example
- 26.
- 27.
- 28. Measuring error X Y Parameter Error ω1 e1 ω2 e2 ω3 e3
- 29. Measuring error X Y Parameter Error ω1 e1 ω2 e2 ω3 e3
- 30.
- 31. ω Error e Optimization Initial start Target Of course,there are many different types of cost functions and optimization algorithms, but the general idea is very similar.
- 32.
- 33.
- 34. Support Vector Machine Artificial Neural Network K-means Naïve Bayes Decision Tree Random Forest Ridge Regression Self-Organizing Map Logistic Regression Linear Regression Stepwise Regression Nearest Neighbor Hierarchical clustering Principal Component Analysis Gaussian Mixture Model AdaBoost Boosting Linear Discriminant Analysis Quadratic Discriminant Analysis Convolutional Neural Network Bayesian Network LASSO Ordinary Least Squares Regression Recurrent Neural Network Generative Adversarial Networks Radial Basis Function Network
- 35. Support Vector Machine Artificial Neural Network Naïve Bayes Decision Tree Ridge Regression Self-Organizing Map Logistic Regression Linear Regression Stepwise Regression Nearest Neighbor Hierarchical clustering Principal Component Analysis Gaussian Mixture Model AdaBoost Boosting Linear Discriminant Analysis Quadratic Discriminant Analysis Convolutional Neural Network Bayesian Network Ordinary Least Squares Regression Recurrent Neural Network Generative Adversarial Networks Radial Basis Function Network K-means Random Forest LASSO
- 36.
- 38.
- 39. Classification Support VectorMachine Artificial Neural Network Supervised learning
- 41.
- 42. A new datapoint
- 43.
- 44.
- 45.
- 46.
- 48. X Σ y g Input Output feature2 feature3 ω0 ω2 ω3 X –input data y – output target ωi – weights Σ – summation g – activation function Blue circle – bias feature1 ω1 1 Z = Σ = ω0x0+ω1x1+ω2x2+ω3x3+…+ωnxn y = g(ω0x0+ω1x1+ω2x2+ω3x3+…+ωnxn)
- 49. X Σ y g Input Output 1 feature2 feature3 X –input data y – output target Σ – summation g – activation function blue circle - bias feature1 Hidden1 Σ | g Hidden3 Σ | g Hidden4 Σ | g Hidden2 Σ | g 1
- 51. . . . w1 w2 wn F(eye×w1+nose×w2+…+mouth×wn) Sheldon Cooper? Intuitive Artificial Neural Network Output Input
- 52. . . . w1 w2 wn F(eye×w1+nose×w2+…+mouth×wn) Sheldon Cooper? feedback error Intuitive Artificial Neural Network Output Input
- 53. . . . w1 w2 wn F(eye×w1+nose×w2+…+mouth×wn) Sheldon Cooper? feedback error Intuitive Artificial Neural Network Output Input
- 54. . . . w1 w2 wn F(eye×w1+nose×w2+…+mouth×wn) Intuitive Artificial Neural Network Output Input
- 55.
- 56.
- 57. Simple linear regression X Y y2 line:y = a + bx ŷ2 y2-ŷ2 x1 y1 Σ (yi-ŷi)2 i = 1 n Minimize:
- 58.
- 59.
- 61.
- 62.
- 63. Unsupervised Principal componentanalysis K-means
- 64.
- 65.
- 66.
- 67.
- 68. More on commonpractices
- 69. Machine learning is all about GeneralizaIon
- 70. Which one is better? ? ? ?
- 71. Clearly, black isbetter Underfitting Just right Overfitting
- 72.
- 73. Test Train Train/test datasetsplit 20% 80%
- 74.
- 75.
- 76.
- 77. Age Salary 24 $110,000 36 $130,000 38 $80,000 44 $420,000 27 $420,000 43 $12,000,000 … … Why do we need?
- 78. Check out: h+p://scikit-‐learn.org/stable/modules/preprocessing.html • Standardization o Zero mean and unit variance • Scale to a range o i.e. (0, 1) • Normalization o Unit norm • … Many ways
- 79.
- 80.
- 81.
- 82.