SlideShare a Scribd company logo

a tour of several popular tensorflow models

jtoy
jtoy
jtoysomatic

we walk through several popular tensorflow models more info at: http://somatic.io/

a tour of several popular tensorflow models

1 of 26
Download to read offline
A TOUR OF SEVERAL
POPULAR TENSORFLOW
MODELS
by Jason Toy
CHAR-RNN
“I'm not going anywhere. I will bring the poorly educated
back bigger and better. It's an incredible movement. ”
“We're losing companies, the economy. We are going to
save it. We're going to bring the party. Let's Make America
Great Again”
“I want to thank the volunteers. They've been unbelievable,
they work like endlessly, you know, they don't want to die.
My leadership is good”
CHAR-RNN
character level language modeling W-O-R-D, not WORD
good for NLP
original implementation from karpathy in python:
https://github.com/karpathy/char-rnn
dozens of implementations, including several in tensorflow
CHAR-RNN
1vanilla (image classification) 2 sequence output (image ->
text) 3 sequence input ( sentiment analysis)
4 seq2seq (machine translation) 5 synced seq2seq (video
classification)
CHAR-RNN
RNN - recurrent because they perform the same task for
every element of a sequence; typically 2-3 layers
LSTM - long short term memory
similar, state is calculated differently
CHAR-RNN DATA
input is raw, large bodies of text. 1 MB+ minimum.
modeling any kind of sequential data
people have tried: linux source code,shakespeare, trump
speeches, obama speeches,MIDI music, chinese, and more
easy to find data to test with
ideas for data you would like to try it on?

Recommended

Attention mechanisms with tensorflow
Attention mechanisms with tensorflowAttention mechanisms with tensorflow
Attention mechanisms with tensorflowKeon Kim
 
RNN, LSTM and Seq-2-Seq Models
RNN, LSTM and Seq-2-Seq ModelsRNN, LSTM and Seq-2-Seq Models
RNN, LSTM and Seq-2-Seq ModelsEmory NLP
 
Introduction to Neural Networks in Tensorflow
Introduction to Neural Networks in TensorflowIntroduction to Neural Networks in Tensorflow
Introduction to Neural Networks in TensorflowNicholas McClure
 
Synthetic dialogue generation with Deep Learning
Synthetic dialogue generation with Deep LearningSynthetic dialogue generation with Deep Learning
Synthetic dialogue generation with Deep LearningS N
 
Attention-based Models (DLAI D8L 2017 UPC Deep Learning for Artificial Intell...
Attention-based Models (DLAI D8L 2017 UPC Deep Learning for Artificial Intell...Attention-based Models (DLAI D8L 2017 UPC Deep Learning for Artificial Intell...
Attention-based Models (DLAI D8L 2017 UPC Deep Learning for Artificial Intell...Universitat Politècnica de Catalunya
 
Introduction to Deep Learning, Keras, and TensorFlow
Introduction to Deep Learning, Keras, and TensorFlowIntroduction to Deep Learning, Keras, and TensorFlow
Introduction to Deep Learning, Keras, and TensorFlowSri Ambati
 
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習台灣資料科學年會
 
Hack Like It's 2013 (The Workshop)
Hack Like It's 2013 (The Workshop)Hack Like It's 2013 (The Workshop)
Hack Like It's 2013 (The Workshop)Itzik Kotler
 

More Related Content

What's hot

Introduction to Machine Learning with TensorFlow
Introduction to Machine Learning with TensorFlowIntroduction to Machine Learning with TensorFlow
Introduction to Machine Learning with TensorFlowPaolo Tomeo
 
Deep Learning and TensorFlow
Deep Learning and TensorFlowDeep Learning and TensorFlow
Deep Learning and TensorFlowOswald Campesato
 
Recurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text AnalysisRecurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text Analysisodsc
 
Language translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowLanguage translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowS N
 
Modeling Electronic Health Records with Recurrent Neural Networks
Modeling Electronic Health Records with Recurrent Neural NetworksModeling Electronic Health Records with Recurrent Neural Networks
Modeling Electronic Health Records with Recurrent Neural NetworksJosh Patterson
 
Sequence learning and modern RNNs
Sequence learning and modern RNNsSequence learning and modern RNNs
Sequence learning and modern RNNsGrigory Sapunov
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Simplilearn
 
Python for Image Understanding: Deep Learning with Convolutional Neural Nets
Python for Image Understanding: Deep Learning with Convolutional Neural NetsPython for Image Understanding: Deep Learning with Convolutional Neural Nets
Python for Image Understanding: Deep Learning with Convolutional Neural NetsRoelof Pieters
 
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...Jeongkyu Shin
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term MemoryYan Xu
 
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Altoros
 
Intel Nervana Artificial Intelligence Meetup 11/30/16
Intel Nervana Artificial Intelligence Meetup 11/30/16Intel Nervana Artificial Intelligence Meetup 11/30/16
Intel Nervana Artificial Intelligence Meetup 11/30/16Intel Nervana
 
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015Turi, Inc.
 
Introduction to deep learning @ Startup.ML by Andres Rodriguez
Introduction to deep learning @ Startup.ML by Andres RodriguezIntroduction to deep learning @ Startup.ML by Andres Rodriguez
Introduction to deep learning @ Startup.ML by Andres RodriguezIntel Nervana
 
Deep-learning based Language Understanding and Emotion extractions
Deep-learning based Language Understanding and Emotion extractionsDeep-learning based Language Understanding and Emotion extractions
Deep-learning based Language Understanding and Emotion extractionsJeongkyu Shin
 
Anil Thomas - Object recognition
Anil Thomas - Object recognitionAnil Thomas - Object recognition
Anil Thomas - Object recognitionIntel Nervana
 
Deep learning in Computer Vision
Deep learning in Computer VisionDeep learning in Computer Vision
Deep learning in Computer VisionDavid Dao
 
Introduction to Deep Learning with Python
Introduction to Deep Learning with PythonIntroduction to Deep Learning with Python
Introduction to Deep Learning with Pythonindico data
 

What's hot (20)

Introduction to Machine Learning with TensorFlow
Introduction to Machine Learning with TensorFlowIntroduction to Machine Learning with TensorFlow
Introduction to Machine Learning with TensorFlow
 
Deep Learning and TensorFlow
Deep Learning and TensorFlowDeep Learning and TensorFlow
Deep Learning and TensorFlow
 
Recurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text AnalysisRecurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text Analysis
 
Language translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowLanguage translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlow
 
Modeling Electronic Health Records with Recurrent Neural Networks
Modeling Electronic Health Records with Recurrent Neural NetworksModeling Electronic Health Records with Recurrent Neural Networks
Modeling Electronic Health Records with Recurrent Neural Networks
 
Sequence learning and modern RNNs
Sequence learning and modern RNNsSequence learning and modern RNNs
Sequence learning and modern RNNs
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
 
Python for Image Understanding: Deep Learning with Convolutional Neural Nets
Python for Image Understanding: Deep Learning with Convolutional Neural NetsPython for Image Understanding: Deep Learning with Convolutional Neural Nets
Python for Image Understanding: Deep Learning with Convolutional Neural Nets
 
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...
Let Android dream electric sheep: Making emotion model for chat-bot with Pyth...
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term Memory
 
Introduction to Deep learning
Introduction to Deep learningIntroduction to Deep learning
Introduction to Deep learning
 
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
 
LSTM Tutorial
LSTM TutorialLSTM Tutorial
LSTM Tutorial
 
Intel Nervana Artificial Intelligence Meetup 11/30/16
Intel Nervana Artificial Intelligence Meetup 11/30/16Intel Nervana Artificial Intelligence Meetup 11/30/16
Intel Nervana Artificial Intelligence Meetup 11/30/16
 
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015
Introduction to Deep Learning for Image Analysis at Strata NYC, Sep 2015
 
Introduction to deep learning @ Startup.ML by Andres Rodriguez
Introduction to deep learning @ Startup.ML by Andres RodriguezIntroduction to deep learning @ Startup.ML by Andres Rodriguez
Introduction to deep learning @ Startup.ML by Andres Rodriguez
 
Deep-learning based Language Understanding and Emotion extractions
Deep-learning based Language Understanding and Emotion extractionsDeep-learning based Language Understanding and Emotion extractions
Deep-learning based Language Understanding and Emotion extractions
 
Anil Thomas - Object recognition
Anil Thomas - Object recognitionAnil Thomas - Object recognition
Anil Thomas - Object recognition
 
Deep learning in Computer Vision
Deep learning in Computer VisionDeep learning in Computer Vision
Deep learning in Computer Vision
 
Introduction to Deep Learning with Python
Introduction to Deep Learning with PythonIntroduction to Deep Learning with Python
Introduction to Deep Learning with Python
 

Viewers also liked

Predictive Analytics with Numenta Machine Intelligence
Predictive Analytics with Numenta Machine IntelligencePredictive Analytics with Numenta Machine Intelligence
Predictive Analytics with Numenta Machine IntelligenceNumenta
 
Getting Started with Numenta Technology
Getting Started with Numenta Technology Getting Started with Numenta Technology
Getting Started with Numenta Technology Numenta
 
Applications of Hierarchical Temporal Memory (HTM)
Applications of Hierarchical Temporal Memory (HTM)Applications of Hierarchical Temporal Memory (HTM)
Applications of Hierarchical Temporal Memory (HTM)Numenta
 
Numenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins
Numenta Brain Theory Discoveries of 2016/2017 by Jeff HawkinsNumenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins
Numenta Brain Theory Discoveries of 2016/2017 by Jeff HawkinsNumenta
 
The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
The Biological Path Towards Strong AI Strange Loop 2017, St. LouisThe Biological Path Towards Strong AI Strange Loop 2017, St. Louis
The Biological Path Towards Strong AI Strange Loop 2017, St. LouisNumenta
 
Recognizing Locations on Objects by Marcus Lewis
Recognizing Locations on Objects by Marcus LewisRecognizing Locations on Objects by Marcus Lewis
Recognizing Locations on Objects by Marcus LewisNumenta
 
What the Brain says about Machine Intelligence
What the Brain says about Machine Intelligence What the Brain says about Machine Intelligence
What the Brain says about Machine Intelligence Numenta
 
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...Numenta
 
Sparse Distributed Representations: Our Brain's Data Structure
Sparse Distributed Representations: Our Brain's Data Structure Sparse Distributed Representations: Our Brain's Data Structure
Sparse Distributed Representations: Our Brain's Data Structure Numenta
 
Beginner's Guide to NuPIC
Beginner's Guide to NuPICBeginner's Guide to NuPIC
Beginner's Guide to NuPICNumenta
 
HTM Spatial Pooler
HTM Spatial PoolerHTM Spatial Pooler
HTM Spatial PoolerNumenta
 
TouchNet preview at Numenta
TouchNet preview at NumentaTouchNet preview at Numenta
TouchNet preview at Numentajtoy
 

Viewers also liked (12)

Predictive Analytics with Numenta Machine Intelligence
Predictive Analytics with Numenta Machine IntelligencePredictive Analytics with Numenta Machine Intelligence
Predictive Analytics with Numenta Machine Intelligence
 
Getting Started with Numenta Technology
Getting Started with Numenta Technology Getting Started with Numenta Technology
Getting Started with Numenta Technology
 
Applications of Hierarchical Temporal Memory (HTM)
Applications of Hierarchical Temporal Memory (HTM)Applications of Hierarchical Temporal Memory (HTM)
Applications of Hierarchical Temporal Memory (HTM)
 
Numenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins
Numenta Brain Theory Discoveries of 2016/2017 by Jeff HawkinsNumenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins
Numenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins
 
The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
The Biological Path Towards Strong AI Strange Loop 2017, St. LouisThe Biological Path Towards Strong AI Strange Loop 2017, St. Louis
The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
 
Recognizing Locations on Objects by Marcus Lewis
Recognizing Locations on Objects by Marcus LewisRecognizing Locations on Objects by Marcus Lewis
Recognizing Locations on Objects by Marcus Lewis
 
What the Brain says about Machine Intelligence
What the Brain says about Machine Intelligence What the Brain says about Machine Intelligence
What the Brain says about Machine Intelligence
 
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...
ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...
 
Sparse Distributed Representations: Our Brain's Data Structure
Sparse Distributed Representations: Our Brain's Data Structure Sparse Distributed Representations: Our Brain's Data Structure
Sparse Distributed Representations: Our Brain's Data Structure
 
Beginner's Guide to NuPIC
Beginner's Guide to NuPICBeginner's Guide to NuPIC
Beginner's Guide to NuPIC
 
HTM Spatial Pooler
HTM Spatial PoolerHTM Spatial Pooler
HTM Spatial Pooler
 
TouchNet preview at Numenta
TouchNet preview at NumentaTouchNet preview at Numenta
TouchNet preview at Numenta
 

Similar to a tour of several popular tensorflow models

Alberto Massidda - Images and words: mechanics of automated captioning with n...
Alberto Massidda - Images and words: mechanics of automated captioning with n...Alberto Massidda - Images and words: mechanics of automated captioning with n...
Alberto Massidda - Images and words: mechanics of automated captioning with n...Codemotion
 
Using neon for pattern recognition in audio data
Using neon for pattern recognition in audio dataUsing neon for pattern recognition in audio data
Using neon for pattern recognition in audio dataIntel Nervana
 
Generating super resolution images using transformers
Generating super resolution images using transformersGenerating super resolution images using transformers
Generating super resolution images using transformersNEERAJ BAGHEL
 
Review on cs231 part-2
Review on cs231 part-2Review on cs231 part-2
Review on cs231 part-2Jeong Choi
 
Deep Learning Cases: Text and Image Processing
Deep Learning Cases: Text and Image ProcessingDeep Learning Cases: Text and Image Processing
Deep Learning Cases: Text and Image ProcessingGrigory Sapunov
 
machine learning and art hack day
machine learning and art hack daymachine learning and art hack day
machine learning and art hack dayjtoy
 
SeRanet introduction
SeRanet introductionSeRanet introduction
SeRanet introductionKosuke Nakago
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learningJunaid Bhat
 
Evolving Comprehensible Neural Network Trees
Evolving Comprehensible Neural Network TreesEvolving Comprehensible Neural Network Trees
Evolving Comprehensible Neural Network TreesAmr Kamel Deklel
 
Deep Learning: Application & Opportunity
Deep Learning: Application & OpportunityDeep Learning: Application & Opportunity
Deep Learning: Application & OpportunityiTrain
 
Java and Deep Learning (Introduction)
Java and Deep Learning (Introduction)Java and Deep Learning (Introduction)
Java and Deep Learning (Introduction)Oswald Campesato
 
Automatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face RecognitionAutomatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face Recognitionvatsal199567
 
Separating Hype from Reality in Deep Learning with Sameer Farooqui
 Separating Hype from Reality in Deep Learning with Sameer Farooqui Separating Hype from Reality in Deep Learning with Sameer Farooqui
Separating Hype from Reality in Deep Learning with Sameer FarooquiDatabricks
 
A Neural Network that Understands Handwriting
A Neural Network that Understands HandwritingA Neural Network that Understands Handwriting
A Neural Network that Understands HandwritingShivam Sawhney
 
Machine learning for document analysis and understanding
Machine learning for document analysis and understandingMachine learning for document analysis and understanding
Machine learning for document analysis and understandingSeiichi Uchida
 
Deep Learning in your Browser: powered by WebGL
Deep Learning in your Browser: powered by WebGLDeep Learning in your Browser: powered by WebGL
Deep Learning in your Browser: powered by WebGLOswald Campesato
 
Deep Dive on Deep Learning (June 2018)
Deep Dive on Deep Learning (June 2018)Deep Dive on Deep Learning (June 2018)
Deep Dive on Deep Learning (June 2018)Julien SIMON
 
Lecture 06 marco aurelio ranzato - deep learning
Lecture 06   marco aurelio ranzato - deep learningLecture 06   marco aurelio ranzato - deep learning
Lecture 06 marco aurelio ranzato - deep learningmustafa sarac
 

Similar to a tour of several popular tensorflow models (20)

Alberto Massidda - Images and words: mechanics of automated captioning with n...
Alberto Massidda - Images and words: mechanics of automated captioning with n...Alberto Massidda - Images and words: mechanics of automated captioning with n...
Alberto Massidda - Images and words: mechanics of automated captioning with n...
 
Using neon for pattern recognition in audio data
Using neon for pattern recognition in audio dataUsing neon for pattern recognition in audio data
Using neon for pattern recognition in audio data
 
Generating super resolution images using transformers
Generating super resolution images using transformersGenerating super resolution images using transformers
Generating super resolution images using transformers
 
Review on cs231 part-2
Review on cs231 part-2Review on cs231 part-2
Review on cs231 part-2
 
Deep Learning Cases: Text and Image Processing
Deep Learning Cases: Text and Image ProcessingDeep Learning Cases: Text and Image Processing
Deep Learning Cases: Text and Image Processing
 
machine learning and art hack day
machine learning and art hack daymachine learning and art hack day
machine learning and art hack day
 
SeRanet introduction
SeRanet introductionSeRanet introduction
SeRanet introduction
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
 
Evolving Comprehensible Neural Network Trees
Evolving Comprehensible Neural Network TreesEvolving Comprehensible Neural Network Trees
Evolving Comprehensible Neural Network Trees
 
Deep Learning: Application & Opportunity
Deep Learning: Application & OpportunityDeep Learning: Application & Opportunity
Deep Learning: Application & Opportunity
 
Java and Deep Learning (Introduction)
Java and Deep Learning (Introduction)Java and Deep Learning (Introduction)
Java and Deep Learning (Introduction)
 
Automatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face RecognitionAutomatic Attendace using convolutional neural network Face Recognition
Automatic Attendace using convolutional neural network Face Recognition
 
Cnn
CnnCnn
Cnn
 
Separating Hype from Reality in Deep Learning with Sameer Farooqui
 Separating Hype from Reality in Deep Learning with Sameer Farooqui Separating Hype from Reality in Deep Learning with Sameer Farooqui
Separating Hype from Reality in Deep Learning with Sameer Farooqui
 
A Neural Network that Understands Handwriting
A Neural Network that Understands HandwritingA Neural Network that Understands Handwriting
A Neural Network that Understands Handwriting
 
Machine learning for document analysis and understanding
Machine learning for document analysis and understandingMachine learning for document analysis and understanding
Machine learning for document analysis and understanding
 
Deep Learning in your Browser: powered by WebGL
Deep Learning in your Browser: powered by WebGLDeep Learning in your Browser: powered by WebGL
Deep Learning in your Browser: powered by WebGL
 
Angular and Deep Learning
Angular and Deep LearningAngular and Deep Learning
Angular and Deep Learning
 
Deep Dive on Deep Learning (June 2018)
Deep Dive on Deep Learning (June 2018)Deep Dive on Deep Learning (June 2018)
Deep Dive on Deep Learning (June 2018)
 
Lecture 06 marco aurelio ranzato - deep learning
Lecture 06   marco aurelio ranzato - deep learningLecture 06   marco aurelio ranzato - deep learning
Lecture 06 marco aurelio ranzato - deep learning
 

More from jtoy

Closing the gap between neuroscience and machine learning
Closing the gap between neuroscience and machine learningClosing the gap between neuroscience and machine learning
Closing the gap between neuroscience and machine learningjtoy
 
Rga somatic hackday
Rga somatic hackdayRga somatic hackday
Rga somatic hackdayjtoy
 
Experiential Marketing and Deep Learning
Experiential Marketing and Deep LearningExperiential Marketing and Deep Learning
Experiential Marketing and Deep Learningjtoy
 
Intro to myself and SFPC
Intro to myself and SFPCIntro to myself and SFPC
Intro to myself and SFPCjtoy
 
Tensorflow ruby
Tensorflow rubyTensorflow ruby
Tensorflow rubyjtoy
 
Bm packing list
Bm packing listBm packing list
Bm packing listjtoy
 

More from jtoy (6)

Closing the gap between neuroscience and machine learning
Closing the gap between neuroscience and machine learningClosing the gap between neuroscience and machine learning
Closing the gap between neuroscience and machine learning
 
Rga somatic hackday
Rga somatic hackdayRga somatic hackday
Rga somatic hackday
 
Experiential Marketing and Deep Learning
Experiential Marketing and Deep LearningExperiential Marketing and Deep Learning
Experiential Marketing and Deep Learning
 
Intro to myself and SFPC
Intro to myself and SFPCIntro to myself and SFPC
Intro to myself and SFPC
 
Tensorflow ruby
Tensorflow rubyTensorflow ruby
Tensorflow ruby
 
Bm packing list
Bm packing listBm packing list
Bm packing list
 

Recently uploaded

Metrology Measurements and All units PPT
Metrology Measurements and  All units PPTMetrology Measurements and  All units PPT
Metrology Measurements and All units PPTdinesh babu
 
sahana sri D AD21046 SELF INTRODUCTION.pdf
sahana sri D AD21046 SELF INTRODUCTION.pdfsahana sri D AD21046 SELF INTRODUCTION.pdf
sahana sri D AD21046 SELF INTRODUCTION.pdfsahanaaids46
 
Burapetco I Kuwait Energy Egypt Training Certificate I 2017
Burapetco I Kuwait Energy Egypt Training Certificate I 2017Burapetco I Kuwait Energy Egypt Training Certificate I 2017
Burapetco I Kuwait Energy Egypt Training Certificate I 2017Abdelrahman Al-Gammal
 
BRINDHA G AD21012 SELF INTRODUCTION.pdf
BRINDHA G  AD21012 SELF INTRODUCTION.pdfBRINDHA G  AD21012 SELF INTRODUCTION.pdf
BRINDHA G AD21012 SELF INTRODUCTION.pdfbrindhaaids12
 
WEPCO Summer Training Certificate I 2017
WEPCO Summer Training Certificate I 2017WEPCO Summer Training Certificate I 2017
WEPCO Summer Training Certificate I 2017Abdelrahman Al-Gammal
 
my goal is place in mnc's companies and got good salary
my goal is place in mnc's companies and got good salarymy goal is place in mnc's companies and got good salary
my goal is place in mnc's companies and got good salarymonoarul2004
 
Critical Literature Review Final -MW.pdf
Critical Literature Review Final -MW.pdfCritical Literature Review Final -MW.pdf
Critical Literature Review Final -MW.pdfMollyWinterbottom
 
Bresenham line-drawing-algorithm By S L Sonawane.pdf
Bresenham line-drawing-algorithm By S L Sonawane.pdfBresenham line-drawing-algorithm By S L Sonawane.pdf
Bresenham line-drawing-algorithm By S L Sonawane.pdfSujataSonawane11
 
Presentation of Helmet Detection Using Machine Learning.pptx
Presentation of Helmet Detection Using Machine Learning.pptxPresentation of Helmet Detection Using Machine Learning.pptx
Presentation of Helmet Detection Using Machine Learning.pptxasmitaTele2
 
Ai Catalyst 2024 ggggggggggggggggggggggggggggggggggggg
Ai Catalyst 2024 gggggggggggggggggggggggggggggggggggggAi Catalyst 2024 ggggggggggggggggggggggggggggggggggggg
Ai Catalyst 2024 gggggggggggggggggggggggggggggggggggggGoogleDSCDibrugarhUn
 
Eshpetco I LUKOIL Training Certificate I 2017
Eshpetco I LUKOIL Training Certificate I 2017Eshpetco I LUKOIL Training Certificate I 2017
Eshpetco I LUKOIL Training Certificate I 2017Abdelrahman Al-Gammal
 
Eversendai - HSE Performance Management Systems-R1.pptx
Eversendai - HSE Performance Management Systems-R1.pptxEversendai - HSE Performance Management Systems-R1.pptx
Eversendai - HSE Performance Management Systems-R1.pptxADILRASHID54
 
Petrogulf Misr I PICO International Training Certificate I 2016
Petrogulf Misr I PICO International Training Certificate I 2016Petrogulf Misr I PICO International Training Certificate I 2016
Petrogulf Misr I PICO International Training Certificate I 2016Abdelrahman Al-Gammal
 
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...IRJET Journal
 
Introduction to WordPress Custom Gutenberg Blocks
Introduction to WordPress Custom Gutenberg BlocksIntroduction to WordPress Custom Gutenberg Blocks
Introduction to WordPress Custom Gutenberg Blockskarthickmurugan02
 
General Petroleum Company (GPC) Training Certificate I 2016
General Petroleum Company (GPC) Training Certificate I 2016General Petroleum Company (GPC) Training Certificate I 2016
General Petroleum Company (GPC) Training Certificate I 2016Abdelrahman Al-Gammal
 
Into the World of AI GDSC YCCE PPTX.pptx
Into the World of AI GDSC YCCE PPTX.pptxInto the World of AI GDSC YCCE PPTX.pptx
Into the World of AI GDSC YCCE PPTX.pptxGDSCYCCE
 
Python Workshop Day - 03.pptx
Python Workshop Day - 03.pptxPython Workshop Day - 03.pptx
Python Workshop Day - 03.pptxShivanshSeth6
 
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’s
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’sELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’s
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’sKuvempu University
 

Recently uploaded (20)

Metrology Measurements and All units PPT
Metrology Measurements and  All units PPTMetrology Measurements and  All units PPT
Metrology Measurements and All units PPT
 
sahana sri D AD21046 SELF INTRODUCTION.pdf
sahana sri D AD21046 SELF INTRODUCTION.pdfsahana sri D AD21046 SELF INTRODUCTION.pdf
sahana sri D AD21046 SELF INTRODUCTION.pdf
 
Power System - Types of Power Plants overview
Power System - Types of Power Plants  overviewPower System - Types of Power Plants  overview
Power System - Types of Power Plants overview
 
Burapetco I Kuwait Energy Egypt Training Certificate I 2017
Burapetco I Kuwait Energy Egypt Training Certificate I 2017Burapetco I Kuwait Energy Egypt Training Certificate I 2017
Burapetco I Kuwait Energy Egypt Training Certificate I 2017
 
BRINDHA G AD21012 SELF INTRODUCTION.pdf
BRINDHA G  AD21012 SELF INTRODUCTION.pdfBRINDHA G  AD21012 SELF INTRODUCTION.pdf
BRINDHA G AD21012 SELF INTRODUCTION.pdf
 
WEPCO Summer Training Certificate I 2017
WEPCO Summer Training Certificate I 2017WEPCO Summer Training Certificate I 2017
WEPCO Summer Training Certificate I 2017
 
my goal is place in mnc's companies and got good salary
my goal is place in mnc's companies and got good salarymy goal is place in mnc's companies and got good salary
my goal is place in mnc's companies and got good salary
 
Critical Literature Review Final -MW.pdf
Critical Literature Review Final -MW.pdfCritical Literature Review Final -MW.pdf
Critical Literature Review Final -MW.pdf
 
Bresenham line-drawing-algorithm By S L Sonawane.pdf
Bresenham line-drawing-algorithm By S L Sonawane.pdfBresenham line-drawing-algorithm By S L Sonawane.pdf
Bresenham line-drawing-algorithm By S L Sonawane.pdf
 
Presentation of Helmet Detection Using Machine Learning.pptx
Presentation of Helmet Detection Using Machine Learning.pptxPresentation of Helmet Detection Using Machine Learning.pptx
Presentation of Helmet Detection Using Machine Learning.pptx
 
Ai Catalyst 2024 ggggggggggggggggggggggggggggggggggggg
Ai Catalyst 2024 gggggggggggggggggggggggggggggggggggggAi Catalyst 2024 ggggggggggggggggggggggggggggggggggggg
Ai Catalyst 2024 ggggggggggggggggggggggggggggggggggggg
 
Eshpetco I LUKOIL Training Certificate I 2017
Eshpetco I LUKOIL Training Certificate I 2017Eshpetco I LUKOIL Training Certificate I 2017
Eshpetco I LUKOIL Training Certificate I 2017
 
Eversendai - HSE Performance Management Systems-R1.pptx
Eversendai - HSE Performance Management Systems-R1.pptxEversendai - HSE Performance Management Systems-R1.pptx
Eversendai - HSE Performance Management Systems-R1.pptx
 
Petrogulf Misr I PICO International Training Certificate I 2016
Petrogulf Misr I PICO International Training Certificate I 2016Petrogulf Misr I PICO International Training Certificate I 2016
Petrogulf Misr I PICO International Training Certificate I 2016
 
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
 
Introduction to WordPress Custom Gutenberg Blocks
Introduction to WordPress Custom Gutenberg BlocksIntroduction to WordPress Custom Gutenberg Blocks
Introduction to WordPress Custom Gutenberg Blocks
 
General Petroleum Company (GPC) Training Certificate I 2016
General Petroleum Company (GPC) Training Certificate I 2016General Petroleum Company (GPC) Training Certificate I 2016
General Petroleum Company (GPC) Training Certificate I 2016
 
Into the World of AI GDSC YCCE PPTX.pptx
Into the World of AI GDSC YCCE PPTX.pptxInto the World of AI GDSC YCCE PPTX.pptx
Into the World of AI GDSC YCCE PPTX.pptx
 
Python Workshop Day - 03.pptx
Python Workshop Day - 03.pptxPython Workshop Day - 03.pptx
Python Workshop Day - 03.pptx
 
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’s
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’sELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’s
ELH-1.3 PIC & ARM MICROCONTROLLER UNIT I Microcontroller’s
 

a tour of several popular tensorflow models

  • 1. A TOUR OF SEVERAL POPULAR TENSORFLOW MODELS by Jason Toy
  • 2. CHAR-RNN “I'm not going anywhere. I will bring the poorly educated back bigger and better. It's an incredible movement. ” “We're losing companies, the economy. We are going to save it. We're going to bring the party. Let's Make America Great Again” “I want to thank the volunteers. They've been unbelievable, they work like endlessly, you know, they don't want to die. My leadership is good”
  • 3. CHAR-RNN character level language modeling W-O-R-D, not WORD good for NLP original implementation from karpathy in python: https://github.com/karpathy/char-rnn dozens of implementations, including several in tensorflow
  • 4. CHAR-RNN 1vanilla (image classification) 2 sequence output (image -> text) 3 sequence input ( sentiment analysis) 4 seq2seq (machine translation) 5 synced seq2seq (video classification)
  • 5. CHAR-RNN RNN - recurrent because they perform the same task for every element of a sequence; typically 2-3 layers LSTM - long short term memory similar, state is calculated differently
  • 6. CHAR-RNN DATA input is raw, large bodies of text. 1 MB+ minimum. modeling any kind of sequential data people have tried: linux source code,shakespeare, trump speeches, obama speeches,MIDI music, chinese, and more easy to find data to test with ideas for data you would like to try it on?
  • 7. CHAR-RNN APPLICATIONS chat bots new “works of arts” music generation foundation for many other networks that involve text or images
  • 8. CHAR-RNN MORE INFO TF version: https://github.com/somaticio/char-rnn-tensorflow awesome explanation: http://karpathy.github.io/2015/05/21/rnn- effectiveness/ seq2seq: arbitrary length input sequences that output arbitrary length outputs live version to play with: http://www.somatic.io/models/WZmmBjZ9 tensorflow tutorial: https://www.tensorflow.org/versions/master/tutorials/recurrent/ind ex.html
  • 9. NEURALSTYLE Paint images in the style of any painting
  • 11. A NEURAL ALGORITHM OF ARTISTIC STYLE paper: http://arxiv.org/abs/1508.06576 The key finding of this paper is that the representations of content and style in the CNNs are separable. CNNs - convolutional Neural Network
  • 12. high layers in the network act as the content of the image style computed from multiple layers’ filter responses
  • 13. NEURALSTYLE - OVERVIEW original version written in torch/lua: https://github.com/jcjohnson/neural-style tensorflow version: https://github.com/anishathalye/neural- style online test model: http://www.somatic.io/models/5BkaqkMR
  • 14. NEURAL STYLE DATA VGG - 16 convolutional and 5 pooling layers of the 19 layer VGGNetwork. it won imagenet in 2014 older network for object classification, not considered state of the art transfer learning computation time
  • 17. FUTURE REVISIONS style transfer while retaining color image analogies
  • 22. SHOW AND TELL DATA flickr30k ~150k captions on ~30k images: http://web.engr.illinois.edu/~bplumme2/Flickr30kEntities/ after1 year, a baby has taken in approximately 260 million images.
  • 23. SHOW AND TELL many versions,popular one by Andrew Karpathy written in python/lua: https://github.com/karpathy/neuraltalk2 https://github.com/kelvinxu/arctic-captions tensorflow version: https://github.com/jazzsaxmafia/show_and_tell.tensorflow online model to test: http://www.somatic.io/models/qoEGanRe paper: http://arxiv.org/abs/1411.4555
  • 24. SHOW AND TELL APPLICATIONS facebook has deployed this as image captioning software for the blind search engine indexing systems for movies “storytelling” art: http://somatic.io/models/2n6g7RZQ
  • 25. LINKS char-rnn: https://github.com/somaticio/char-rnn-tensorflow live version: http://somatic.io/models/WZmmBjZ9 tensorflow char-rnn tutorial: https://www.tensorflow.org/versions/r0.9/tutorials/seq2seq/index.html#recurre nt-neural-networks neuralstyle: https://github.com/anishathalye/neural-style live version: http://somatic.io/models/qoEGanRe show and tell: https://github.com/jazzsaxmafia/show_and_tell.tensorflow live version: http://somatic.io/models/2n6g7RZQ
  • 26. –John Dewey “Every great advance in science has issued from a new audacity of imagination.” Jason Toy jason@somatic.io test and use models: http://somatic.io @jtoy QUESTIONS?