The document discusses the history and recent developments in deep learning. It outlines several important events in the field including early neural networks in the 1940s-50s, the introduction of backpropagation in the 1960s-80s, and recent advances that have enabled deep learning to be applied successfully to complex real-world problems in areas like computer vision, natural language processing, and game playing. These recent applications and advances are enabling deep learning to be applied to an increasingly wide range of domains.

1. Deep Learning revolution
Vitaly Bondar
johngull@gmail.com

2. ML and DL

4. Basic element

5. Different connections

7. Real world models

8. Gradient descent

9. Back propagation

10. Modern frameworks

12. Events
● Simple neural network with electrical circuits - McCulloch
● Stochastic gradient descent - Robbins and Monro
● Perceptron - Rosenblatt
● Back propagation - Kelley
● Back propagation with hidden layers - Hinton et al.
● Convolution neural network - LeCun
● Successful optimization of very deep networks - Hinton et al.

13. Events
● Simple neural network with electrical circuits - McCulloch - 1943
● Stochastic gradient descent - Robbins and Monro - 1951
● Perceptron - Rosenblatt - 1957
● Back propagation - Kelley - 1960
● Back propagation with hidden layers - Hinton et al. - 1986
● Convolution neural network - LeCun - 1998
● Successful optimization of very deep networks - Hinton et al. - 2006

14. Events

15. So, why now?

16. So, why now?

18. Speech recognition

19. Translations

20. Translation
English PROMT Google Translate
soccer ball шар футбола футбольный мяч
These electric cars can take
power
Эти электрические
автомобили могут прийти
к власти
Эти электромобили могут
принимать энергию
Broadway actress актриса Шоссе Бродвейская актриса
Just execute the installer Только казните
монтажника
Просто выполните
установщик

21. Translation

22. Sound generation

23. Sound generation

24. Lip reading

25. Synchronization of the lip movement from audio

26. Computer vision

27. Computer vision

28. Mask RCNN

29. Image Caption Generation

30. Colorization

31. Health images

32. UNet

33. Visual reasoning

34. Generative Adversarial Networks

35. Generative Adversarial Networks

36. Generative Adversarial Networks

37. Generative Adversarial Networks

38. Generative Adversarial Networks

39. Generative Adversarial Networks

40. Super resolution

41. AlphaGo and AlphaZero

42. OpenAI Five

47. Thank you