This document discusses techniques used in neural networks including activation functions like TanH and ReLU, max pooling to reduce dimensions, dropout to prevent overfitting, and fully connected layers. It also provides a link to a GitHub project for hacking captchas using these techniques.

3. !
!

5. !
!
complete in https://github.com/Yvictor/Captcha_hacking

6. https://en.wikipedia.org/wiki/Activation_function
Activation function
TanH( -1, 1) Rectified Linear Unit (0, ∞)

7. Max Pooling
5 1 7 2
3 2 6 0
3 1 2 0
5 8 4 3
5 7
8 4
2x2 filters
Dropout

8. fully connected

11. !
!
!