Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

From Python to smartphones: neural nets @ Saint-Gobain, François Sausset

221 views

Published on

PyParis 2017
http://pyparis.org

Published in: Technology
  • Be the first to comment

  • Be the first to like this

From Python to smartphones: neural nets @ Saint-Gobain, François Sausset

  1. 1. From Python to smartphones : neural nets @ SAINT-GOBAIN F. SAUSSET PyParis 2017
  2. 2. WORKING @ SAINT-GOBAIN MAIN R&D CENTER DATA SCIENCE TEAM ~ 15 people Area of applications: Marketing & sales Industry Building sciences MORE & MORE PROJECTS FOR END-USERS → Development of smartphone applications Low–level parts developped in the team PYTHON: A SECOND CLASS CITIZEN ON MOBILE PLATFORMS → Write pure C/C++ code (to run on iOS & Android) What about machine learning on mobiles ? PYTHON FOR (ALMOST) EVERYTHING
  3. 3. NEURAL NETS @ SAINT-GOBAIN FIRST ATTEMPTS 2 YEARS AGO COULD BE APPLIED IN A LOT OF PLACES Product recommendation (like on Netflix, Amazon, etc) Natural language processing Acoustics (classification, source separation, etc) Façade semantization Product design … AS PYTHONISTAS WE MAINLY PLAYED WITH KERAS + TENSORFLOW NOW, FIRST PROTOTYPES IN THE PIPES THAT SHOULD RUN ON SMARTPHONES…
  4. 4. FACEBOOK Caffe2Go Announced @Web Summit 11/2016 Not yet released Not very Python friendly (pytorch in the meantime) GOOGLE Tensorflow Lite Announced @Google I/O 5/2017 Not yet released, but… Keras friendly APPLE Core ML Announced @WWDC 2017 (last week) Public release in september Scikit-learn, Keras, caffe friendly ! ML FRAMEWORKS ON MOBILE
  5. 5. TENSORFLOW ON MOBILES ANDROID (GPU) & IOS (CPU) ON GITHUB SINCE 7/11/2015 (WITH ONE EXAMPLE) NO DOCUMENTATION NO EASY WAY TO EXTRACT THE TENSORFLOW LIB TO REUSE IN A PROJECT SPECIFIC WAY TO SAVE THE MODEL Any Tensorflow model could be used But the protobuf file should include model structure + weights No official documentation … AFTER SOME TINKERING, WE MANAGE TO EXPORT ANY KERAS MODEL TO A SUITABLE PROTOBUF FILE https://gist.github.com/fsausset/57b99a3db5e1a05569845894ec385eef
  6. 6. PROTOTYPE APPLICATION ANDROID (GPU) ABLE TO LOAD ANY MODEL TRANSLATED FROM KERAS SPECIFIC TEST OF ONE HOME-MADE ACOUSTIC CLASSIFICATION MODEL ALLOWS TO Test if it works on mobiles Test its speed: is it real time ? Test model in the playground Demo it easily Put it in the hands of non-techies Iterate fast to correct weaknesses not seen with the testing set IT’S SO FUN TO CARRY IT WITH YOU EVERYWHERE AND PLAY WITH IT !
  7. 7. A FEW TAKEAWAYS AS ML & DL GOES OUT LABS, PYTHON BECOMES THE DE FACTO STANDARD FOR IT MOBILE ML & DL FRAMEWORKS ARE (REALLY) COMING !!! EXPORT PYTHON BAKED MODELS TO MOBILE PLATFORMS IS NOW EASY LOWER ENTRY TICKET → EXPLOSION OF ML/DL BASED MOBILE APPS OPEN SOURCE IS AWESOME: DIVE INTO GITHUB CODE, YOU COULD FIND GEMS ! & THEN CONTRIBUTE !

×