Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Google voice transcriptions demystified: Introduction to recurrent neural networks & LSTM

82 views

Published on

Introduction to LSTM, the deep learning algorithm behind Google Voice Transcriptions, explained without any mathematics equation. Mostly for non-technical audience without any data-science background.

Published in: Science
  • Be the first to comment

  • Be the first to like this

Google voice transcriptions demystified: Introduction to recurrent neural networks & LSTM

  1. 1. Google voice transcriptions demystified: Introduction to recurrent neural networks & LSTM Lieva Anastasia @lievAnastazia Human Talks Montpellier
  2. 2. Human Talks Montpellier @lievAnastazia Google voice transcriptions
  3. 3. Human Talks Montpellier @lievAnastazia Long Short-Term Memory LSTM
  4. 4. Human Talks Montpellier @lievAnastazia Long Short-Term Memory LSTM - Neural networks - Recurrent neural networks (RNN) - LSTM
  5. 5. Human Talks Montpellier @lievAnastazia Neural networks
  6. 6. Human Talks Montpellier @lievAnastazia Category Neural networks
  7. 7. Human Talks Montpellier @lievAnastazia Neural networks
  8. 8. Human Talks Montpellier @lievAnastazia Neural networks
  9. 9. Human Talks Montpellier @lievAnastazia L A Y E R 1 L A Y E R 2 L A Y E R 3 L A Y E R 4 L A Y E R 5 Input Data Expected Learning by Backpropagation Ground truth
  10. 10. Human Talks Montpellier @lievAnastazia L A Y E R 1 L A Y E R 2 L A Y E R 3 L A Y E R 4 L A Y E R 5 Input Data Prediction Learning by Backpropagation First iteration truth
  11. 11. Human Talks Montpellier @lievAnastazia L A Y E R 1 L A Y E R 2 L A Y E R 3 L A Y E R 4 L A Y E R 5 Input Data Prediction Error Learning by Backpropagation
  12. 12. Human Talks Montpellier @lievAnastazia L A Y E R 1 L A Y E R 2 L A Y E R 3 L A Y E R 4 L A Y E R 5 Input Data Prediction Error Update weights in every layer w/ an optimization algorithm Learning by Backpropagation
  13. 13. Human Talks Montpellier @lievAnastazia L A Y E R 1 L A Y E R 2 L A Y E R 3 L A Y E R 4 L A Y E R 5 Input Data Prediction Error Update weights in every layer w/ an optimization algorithm Retry prediction with updated weights LeaLearning by Backpropagation ning by Backpropagation
  14. 14. Human Talks Montpellier @lievAnastazia Recurrent neural networks
  15. 15. Human Talks Montpellier @lievAnastazia “Découvrez Montpellier une belle ville en Occitanie”
  16. 16. Human Talks Montpellier @lievAnastazia Recurrent neural networks
  17. 17. Human Talks Montpellier @lievAnastazia Je vais passer les vacances en Occitanie. Je veux bien apprendre à parler Occitan
  18. 18. Human Talks Montpellier @lievAnastazia Je vais passer les vacances en Occitanie Je veux bien apprendre à parler ????
  19. 19. Human Talks Montpellier @lievAnastazia - Long Short-Term Memory networks
  20. 20. Human Talks Montpellier @lievAnastazia
  21. 21. Human Talks Montpellier @lievAnastazia Je vais passer les vacances en Occitanie. Je veux bien apprendre à parler Occitan
  22. 22. Human Talks Montpellier @lievAnastazia Use cases - Time series - Video processing - Natural language processing - Audio processing - Sequence data in bio-informatics - Automatic cars - ...
  23. 23. Human Talks Montpellier @lievAnastazia Variations of RNN & LSTM - Bi-directional RNNs - Hierarchical RNNS - Depth Gated RNN - GRU - LSTM with peephole connections - ...
  24. 24. Human Talks Montpellier @lievAnastazia To go further ( or deeper :P ) - Andrej Karpathy blog http://karpathy.github.io/2015/05/21/rnn-effectiveness/ - Colah blog http://colah.github.io/posts/2015-08-Understanding-LSTMs/ - Books and courses on stanford.edu - Articles of Jürgen Schmidhuber - Recent Advances in Recurrent Neural Networks https://arxiv.org/abs/1801.01078
  25. 25. Google voice transcriptions demystified: Introduction to recurrent neural networks & LSTM Lieva Anastasia @lievAnastazia Human Talks Montpellier

×