Slides for the SF Python Meetup Project Night, Feb 20, 2019 at Optimizely.

1. Catalit LLC
INTROTO DEEP LEARNING
WITH PYTHON AND KERAS
Optimizely / Feb 2019

2. Catalit LLC
NEURAL NETWORKS

3. Catalit LLC
Caption generation
Object recognition
http://www.image-net.org/challenges/LSVRC/

4. Catalit LLC
APPLICATIONS
Speech recognition and synthesis
http://venturebeat.com/2015

5. Catalit LLC
APPLICATIONS
Neural MachineTranslation
https://devblogs.nvidia.com/parallelforall/ https://smallbiztrends.com/2017/

6. Catalit LLC

7. Catalit LLC
https://deepmind.com www.nervanasys.com

8. Catalit LLC
https://www.pcper.com/category/tags/deep-neural-network

9. Catalit LLC
REASONS
Deep Learning
Traditional
Machine Learning
# training data
Performance

10. Catalit LLC
REASONS
Traditional
Machine Learning
# training data
Performance
Feature
extract
OutputFeatures
Shallow
ML algo
Input Deep Learning Output
Input
Deep Learning

11. Catalit LLC
NEURAL NETWORKS
• Many inputs
• One output

12. Catalit LLC
NEURAL NETWORKS
• Many inputs
• One output

13. Catalit LLC
LINEAR REGRESSION

14. Catalit LLC
MULTIVARIATE

15. Catalit LLC
LOGISTIC REGRESSION

16. Catalit LLC
FULLY CONNECTED
…
xN
x1
b
Input Output
b
b
…
b
b
Layer 1 Layer L
b
b
b
…
b
Layer 2
y
…

17. Catalit LLC
ACTIVATION FUNCTIONS

18. Catalit LLC
LOSS FUNCTION
Cost 0
4
8
12
16
Value of parameter β
0 2 4 5 7
J(β)
Define Hypothesis
Define Loss Function
Minimize Loss Function
Hypothesis is more complicated
…
x
x
b
In Oub
b
…
b
b
La La
b
b
b
…
b
La
y
…

19. Catalit LLC
MULTIVALUE CLASSIFICATION
Non exclusive classes
A B C
1 0 0
1 0 0
0 1 0
0 0 1
Mutually exclusive classes
Pers Work Doc Photo
1 0 1 0
0 1 1 0
0 1 0 1
0 0 0 1

20. Catalit LLC
NON EXCLUSIVE
…
xN
x1
b
Input
Output
b
b
…
b
Layer 1 Last layer
b
b
b
…
b
Layer 2
…
b
b
b
…
b
y1
y2
y3
yJ
sigmoid
Per
s
Wo
rk
Doc Pho
to
1 0 1 0
0 1 1 0
0 1 0 1
0 0 0 1
sigmoid
sigmoid
sigmoid

21. Catalit LLC
MUTUALLY EXCLUSIVE
…
xN
x1
b
Input
Output
b
b
…
b
Layer 1 Last layer
b
b
b
…
b
Layer 2
…
b
b
b
…
b
A B C
1 0 0
1 0 0
0 1 0
0 0 1
Mutuall
y1
y2
y3
yJ
softmax

22. Catalit LLC
MASTER FORMULA
model = data + structure + loss + optimizer

23. Catalit LLC
github.com/zerotodeeplearning
• first_deep_learning_model
• ztdl-5-day-bootcamp

24. Catalit LLC
ZTDL BOOTCAMP
bootcamp.zerotodeeplearning.com
Code: PYTHONSF10 for 10% OFF