Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
CONFIDENTIAL
Fabrizio Milo
Deep Learning Architect and Engineer H20.ai
July 19th, 2016
Products using Machine Learning
CONFIDENTIAL
Whydid Google open sourced it ?
“By sharing what we believe to be
one of the best machine learning
toolboxes in the world, we hope to
create an open stand...
CONFIDENTIAL
Architecture
Jeff Dean (Google)
Spanner - a scalable, multi-version, globally distributed,
and synchronously replicated database
Some o...
Cor e
Pyt hon C++ …
Pl at f or m
st r eam_execut or
Fr amewor k
CONFIDENTIAL
The Data Flow Graph
A = 1
C = 2
D = 3
E =4
result = C * D
result = A – result
result = result + E
Operations are the
nodes
Tensors are the edges
Tensorflow
Session
Pyt hon API
t f . get _var i abl e( )
sessi on = t f . Sessi on( )
t f . pl acehol der ( . .
t f . t r u...
CONFIDENTIAL
Tensorflow Library
Tensorflow Operation Libraries:
1.Tensor manipulation (join, split, …)
2.Deep learning ops (ReLU, Sigmoid, BatchNorm..)
3....
CONFIDENTIAL
Tensorboard
Tensorboard Interactive
Demo
https://www.tensorflow.org/versions/r0.9/how_tos/graph_viz/index.html
CONFIDENTIAL
Distributed Graph Execution
Node Node Node
Parameter Server
Variable Variable Variable Variable VariableVariable
Asynchronous Gradient Descent Training
Replicate the Whole Graph
Replicate only Part of the Graph
http://www.grpc.io/
CONFIDENTIAL
Tensor Serving
http://gitbhub.com/tensorflow/serving
Tensorflow Serving
Execute Model
Training Server
Serialized
Graph
Model
Serialized
Graph
Batch Request
CONFIDENTIAL
Open Source Models
github.com/tensorflow/models
https://research.googleblog.com/2016/05/announcing-syntaxnet-worlds-most.html
Syntaxnet
https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html
Inception
https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html
Inception
CONFIDENTIAL
H2O & Tensorflow
H20 & Tensorflow
AI everywhere
architecture
tools
serving
models
H20
@fabmilo
fabrizio@h2o.ai
Thank you
(Come talk to me)
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
H2O & Tensorflow - Fabrizio
Upcoming SlideShare
Loading in …5
×

H2O & Tensorflow - Fabrizio

4,514 views

Published on

An overview of Tensorflow, and then we'll walk through how to utilize this library within the H2O platform. Tensorflow is an open source, deep learning framework utilized by Google and Deepmind. #h2ony

- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata

Published in: Data & Analytics

H2O & Tensorflow - Fabrizio

  1. 1. CONFIDENTIAL Fabrizio Milo Deep Learning Architect and Engineer H20.ai July 19th, 2016
  2. 2. Products using Machine Learning
  3. 3. CONFIDENTIAL Whydid Google open sourced it ?
  4. 4. “By sharing what we believe to be one of the best machine learning toolboxes in the world, we hope to create an open standard for exchanging research ideas and putting machine learning in products.”
  5. 5. CONFIDENTIAL Architecture
  6. 6. Jeff Dean (Google) Spanner - a scalable, multi-version, globally distributed, and synchronously replicated database Some of the production system design and statistical machine translation system for Google Translate. BigTable, a large-scale semi-structured storage system. MapReduce a system for large-scale data processing applications. Google Brain a system for large-scale artificial neural networks LevelDB an open source on-disk key-value store. TensorFlow an open source machine learning software library.
  7. 7. Cor e Pyt hon C++ … Pl at f or m st r eam_execut or Fr amewor k
  8. 8. CONFIDENTIAL The Data Flow Graph
  9. 9. A = 1 C = 2 D = 3 E =4 result = C * D result = A – result result = result + E
  10. 10. Operations are the nodes
  11. 11. Tensors are the edges
  12. 12. Tensorflow Session Pyt hon API t f . get _var i abl e( ) sessi on = t f . Sessi on( ) t f . pl acehol der ( . . t f . t r uncat ed_var i abl e( . . t f . Var i abl e( . . t f . r el u( … Memory Management GPU CPU stream executor
  13. 13. CONFIDENTIAL Tensorflow Library
  14. 14. Tensorflow Operation Libraries: 1.Tensor manipulation (join, split, …) 2.Deep learning ops (ReLU, Sigmoid, BatchNorm..) 3.Optimizer (RMSProp AdaGrad, AdaDelta, ..) 4.Automatic Differentiation 5.Image Manipulation (Crop, resize, rotate ..) 6.Mp3 Audio exctraction And many more …
  15. 15. CONFIDENTIAL Tensorboard
  16. 16. Tensorboard Interactive Demo
  17. 17. https://www.tensorflow.org/versions/r0.9/how_tos/graph_viz/index.html
  18. 18. CONFIDENTIAL Distributed Graph Execution
  19. 19. Node Node Node Parameter Server Variable Variable Variable Variable VariableVariable Asynchronous Gradient Descent Training
  20. 20. Replicate the Whole Graph
  21. 21. Replicate only Part of the Graph
  22. 22. http://www.grpc.io/
  23. 23. CONFIDENTIAL Tensor Serving http://gitbhub.com/tensorflow/serving
  24. 24. Tensorflow Serving Execute Model Training Server Serialized Graph Model Serialized Graph Batch Request
  25. 25. CONFIDENTIAL Open Source Models
  26. 26. github.com/tensorflow/models
  27. 27. https://research.googleblog.com/2016/05/announcing-syntaxnet-worlds-most.html Syntaxnet
  28. 28. https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html Inception
  29. 29. https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html Inception
  30. 30. CONFIDENTIAL H2O & Tensorflow
  31. 31. H20 & Tensorflow AI everywhere architecture tools serving models H20
  32. 32. @fabmilo fabrizio@h2o.ai Thank you (Come talk to me)

×