5/4/2017 - New York Event: https://www.meetup.com/deep-learning-in-production/events/239634483/ N.B. Video Demos and Sources linked in slides. Get Sam Putnam's essays and talk schedule in your inbox: https://upscri.be/2611dd/

1. TensorFlow Serving, Deep
Learning on Mobile, and
Deeplearning4j on the JVM
Sam Putnam, Enterprise Deep Learning, LLC
www.EnterpriseDeepLearning.com
5/4/2017
Want to learn more?
I am teaching the Deploying Deep
Learning Track at Deep Learning Conf®
Tickets are available now:
www.DeepLearningConf.com

2. Topics
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who is Using TensorFlow Serving
What Architecture Integrates with
TensorFlow Serving
What is TensorFlow Serving
5/4/2017

3. Topics
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Handwriting Recognition
Facial Recognition
Speech Recognition
5/4/2017

4. Topics
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who is Using Deeplearning4j
What JVM-Based Architecture Integrates
with Deeplearning4j
What is Deeplearning4j
Deeplearning4j on the JVM
5/4/2017

5. Part 1 of 3
TensorFlow Serving
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
5/4/2017

6. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
TensorFlow Serving Deploys Serves Google’s TensorFlow Models in Production
5/4/2017
https://www.tensorflow.org/deploy/tfserve

7. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who Is Using or Not Using TensorFlow Serving
5/4/2017
https://news.ycombinator.com/item?id=13821217

8. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who Is Using or Not Using TensorFlow Serving
5/4/2017
https://news.ycombinator.com/item?id=13821217

9. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who Is Using or Not Using TensorFlow Serving
5/4/2017
https://news.ycombinator.com/item?id=13821217

10. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Training to Production
5/4/2017
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b

11. Google Has Machine Learning Best Practices
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
5/4/2017
http://martin.zinkevich.org/rules_of_ml/rules_of_ml.pdf

12. Part 2 of 3
Deep Learning on Mobile
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
5/4/2017

13. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Facial Recognition is a Solved Problem
5/4/2017
https://github.com/oggata/FacialRecognitionhttps://www.youtube.com/watch?v=ngd2p_uQhvo&feature=youtu.be

14. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Handwriting Recognition is a Solved Problem
5/4/2017
https://github.com/FlexMonkey/Scribehttps://www.youtube.com/watch?v=_OMN4dsJhGg&feature=youtu.be

15. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Speech Recognition is Very Good
5/4/2017https://github.com/marcdown/SayWhat
https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be

16. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Symbolic Artificial Intelligence using Speech Recognition Already Works
5/4/2017
https://www.youtube.com/watch?v=nPV66HmgbNo&feature=youtu.be
https://github.com/darjeelingsteve/speech-recognition

17. Part 3 of 3
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j on the JVM
5/4/2017

18. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j is a Deep Learning
Framework that runs on the JVM
Deeplearning4j on the JVM
5/4/2017
https://deeplearning4j.org/

19. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j has a thriving community
Deeplearning4j on the JVM
5/4/2017
https://gitter.im/deeplearning4j/deeplearning4j

20. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j Integrates with Spark for Distributed Deep Learning
Deeplearning4j on the JVM
5/4/2017

21. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
From S3 to DL4j to Spark
Deeplearning4j on the JVM
5/4/2017
https://dzone.com/articles/deep-learning-on-the-jvm

22. 2. Listen
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
1. Search
‘Deep Learning’
5/4/2017

23. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who is Using or Not Using Deeplearning4j
Deeplearning4j on the JVM
5/4/2017
https://youtu.be/R3lzuXPbybY?t=5m41s

24. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Who is Using or Not Using Deeplearning4j
Deeplearning4j on the JVM
5/4/2017
https://youtu.be/olJjvuPqsR4?t=6s

25. Thank you
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Sam@EDeepLearning.com
Thank you to Google, Amazon, Facebook, YC, Others who have
published diagrams and photos. Slides are for today only. 5/4/2017
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
Always looking for new members & new locations in Cambridge, US or
NYC & new speakers to present on Deep Learning in Production topics