Deep Learning for Sales Professionals

1. Dr. Miguel Fierro Data Scientist at Microsoft @miguelgfierro https://miguelgfierro.com Intelligent Cloud GBB Ready | Lisbon Sept 2017

2. Deep learning solutions Deep learning tecniques

3. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: wikipedia “Our strategy is to build best-in-class platforms and services for an intelligent cloud and an intelligent edge infused with artificial intelligence” source: annual report 2017

4. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: PwC AI analysis 2017 BIGGEST OPPORTUNITY$15.7Trillion by 2030 ~ 14% GPD Productivity gains ($6.6T) Automation Increased demand ($9.1T) Augmentation Higher quality products

5. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: PwC AI analysis 2017

6. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro DNNs (learn complex patterns on HUGE amounts of data) Intelligent applications … such as…. Cloud (flexibility, scalability, efficiency)

7. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro

8. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Speech recognition Natural Language Processing Computer Vision

9. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro “The more data, The better it works*” * always read the small print source: https://xkcd.com/1838/

10. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Best bet to solve intelligence

11. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro wait, wait, wait… What makes deep learning deep? input hidden output

12. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden hidden hidden hidden output … … …

13. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: http://www.iro.umontreal.ca/~bengioy/yoshua_en/ “Learning multiple levels of representation to help a learner accomplish a task of interest, with higher levels capturing more abstract concepts through a deeper composition of computations” Yoshua Bengio

14. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro low level features high level featuresmedium level features Interesting paper about representations: https://arxiv.org/abs/1411.1792

15. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Convolutional Neural Networks (CNN) Recurrent Neural Networks (RNN)

16. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro MNIST with CNNs (source here)

17. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://www.cs.toronto.edu/~kriz/cifar.html CIFAR with ResNet CNN (source here)

18. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Object detection with FasterRCNN (source here) dog

19. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Transfer Learning with CNNs (source here)

20. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Video classification with 3D CNNs (source here)

21. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Text classification with CNNs (source here) Input text: “It was a breeze to configure and worked straight away” Books Electronics Home & Kitchen Clothing Movies Health Sports

22. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Speech recognition with LSTMs (source here)

23. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Time series forecasting with LSTMs (source here)

24. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Autoencoders (source here) Original Learned Encoder Decoder Low dimensional representation

25. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Reinforcement Learning tutorial (basic & advanced) source: wikipedia

26. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Generative Adversarial Networks (GANs) tutorial (source here)

27. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Diagnosis augmentation for lung cancer detection 3D CNN for nodule segmentation + CNN for nodule classification (info1, info2) CT scan: horizontal section of lung Patient health monitoring with sensors (IoT): Autoencoder on normal class + reconstruction error abnormal class (info)

28. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Predictive maintenance with sensors: LSTM for classification Visual fault detection in components: Transfer learning with CNNs

29. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Generative Asset wealth management and prediction: Reinforcement Learning for optimal action policy Bots for insurance policy management: LSTM&CNN for speech recognition+ CNN for recommendation system

30. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Route optimization: Reinforcement Learning Inventory optimization: LSTM

31. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Content recommendation: CNNs featurization + clustering Personalized marketing: CNN featurization + clustering

32. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Personalized fashion design and production: CNNs for image classification + GANs for image generation Customer demand forecasting: LSTM

33. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Demand forecasting: LSTM Predictive maintenance: LSTM

34. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Supply chain defect reduction based on images: Transfer learning with CNNs On-demand production: LSTM

35. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://github.com/Azure/fast_retraining Degradation of accuracy with new data Airline delay prediction You need to retrain!!!

36. Deep learning solutions Deep learning tecniques

37. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Learning can be viewed as finding a and b in: y = a.x + b y (outputs) x (inputs) a,b (parameters)

38. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro y = a.x + b 1 = a.1 + b 5 = a.5 + b = a. + b a=1 b=0 e = ytrue – ypred ytrue=1 ypred depends on a,b optimize a,b so e is minimum

39. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: R. Rojas: Neural Networks, Springer-Verlag, Berlin, 1996

40. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Sharpening filter Laplacian filter Sobel x-axis filter

41. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Convolution Pooling PoolingConvolution Fully connected Fully connected Input image Output predictions "tabby cat"

42. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Max pooling with 2x2 kernel and stride of 2x2 1 5 3 2 2 6 0 9 1 5 0 1 5 7 2 4 6 9 7 4

43. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden output

44. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro SoftmaxReLUtanh

45. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: Introduction to Natural Language Processing with FastText Mappings of discrete objects to a high dimensional space bird: (1.072, 4.245, …) dove: (1.134, 4.079, …) woman: (-1.385, -2.104, …) man: (-2.207, 2.118, …)

46. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden output hidden hidden ti ti+1 ti+2 ti+3 … … …

47. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro number of layers

48. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://en.wikipedia.org/wiki/Long_short-term_memory

49. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro CNTK TensorFlow https://github.com/ilkarman/DeepLearningFrameworks: 5 frameworks, same problem

74. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro GIVE ME DATA!!!! CONCEPT DRIFT IS YOUR FRIEND MASTER THE CORE PRINCIPLES KNOW THE FRAMEWORKS&TOOLS

75. Dr. Miguel Fierro Data Scientist at Microsoft @miguelgfierro https://miguelgfierro.com Intelligent Cloud GBB Ready | Lisbon Sept 2017

76. Intelligent Cloud GBB Ready Lisbon 2017 The code from these slides is published at: https://github.com/ilkarman/DeepLearningFrameworks Attribution of some images: • http://morguefile.com • https://unsplash.com • Ana Corrales Photography • http://wikipedia.org Dataset citation: • CIFAR-10. Learning Multiple Layers of Features from Tiny Images, Alex Krizhevsky, 2009. https://www.cs.toronto.edu/~kriz/cifar.html • IMDB. https://s3.amazonaws.com/text-datasets/imdb.npz

Deep Learning for Sales Professionals

Miguel González-Fierro

Deep Learning for Sales Professionals