Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow)

491 views

Published on

I introduced Google's AIY Vision Kit at the Google Developers Group Boston Taking the Temperature of Tensorflow meetup. Google’s “AI Yourself” Vision Kit, now available at Target Stores, is a low-cost ($90), developer friendly development kit designed to make machine learning tangible for makers and STEM students. It includes pre-trained models for detecting mood, pets, meals, with the ability to load your own custom model.

Published in: Technology
  • Be the first to comment

AIY Vision Kit - Embedded ML for STEM and Makers (GDG Boston Tensorflow)

  1. 1. AIY VISION KIT EMBEDDED ML FOR STEM AND MAKERS Chad Hart cwh.consulting
  2. 2. Product Consultant cwh.consulting chad@cwh.consulting A blog for WebRTC developers webrtcHacks.com @webrtcHacks WebRTC events & videos www.krankygeek.com @webrtclive AboutMe cwh.consulting @chadwallacehart chad@chadwallacehart.com
  3. 3. WhatistheAIY VisionKit? 5/1/2018 cwh.consulting A tiny box that let’s you do “AI Yourself” from Google. This kit is focused on Computer Vision based on Tensorflow. No internet connection is required.
  4. 4. WhatistheAIY VisionKit? 5/1/2018 cwh.consulting You need to assemble the kit yourself. It takes 30 to 60 minutes.
  5. 5. JoyDetection Demo 5/1/2018 cwh.consulting The joy detection demo loads by default. It does face detection and estimates your “Joy” score if you are smiling or frowning. The default demo will illuminate the LED button according to the average score it sees across all faces.
  6. 6. How doyouget one? 5/1/2018 cwh.consulting The new, 1.1 version is available for sale at Target stores.
  7. 7. The Kit AIY Voice Kit
  8. 8. What’sinthe box? 5/1/2018 cwh.consulting The new, 1.1 contains everything needed for operation except a USB power supply.
  9. 9. RaspberryPiZeroWH 5/1/2018 cwh.consulting It runs on a tiny Raspberry Pi Zero. GPIO headers are required and WiFi is handy, so the kit ships with the WH version of the Pi Zero.
  10. 10. PiCamera 5/1/2018 cwh.consulting And it includes the latest Pi Camera.
  11. 11. VisionBonnet 5/1/2018 cwh.consulting All of the kit’s magic is performed on the Vision Bonnet – an add on board.
  12. 12. IntelMovidius MA2450 Vision Processing Unit 5/1/2018 cwh.consulting The most important piece of hardware is the intel Movidius VPU chip. This is a specialized chip designed for running machine learning graphs at low power. You can also buy this check as part of a USB dongle from Intel (Intel NCS) for use with Intel’s SDK. The AIY Kit team built their own SDK and optimized it to work with Tensorflow.
  13. 13. Othergoodies wewon’ttalk abouttoday  Button with multi-color LED  Privacy LED  Buzzer  Micro controller chip on Bonnet with extra GPIO pins, LEDs, and button 5/1/2018 cwh.consulting The kit comes with lots of other interfaces and hardware options
  14. 14. Development AIY Voice Kit
  15. 15. Models Face / Joy detector Bounding box Joy score Dog / Cat / Human Detector Object class Confidence score Bounding box Dish Classifier Food object Confidence score Image Classifier / Google Image Classifier Image classifier (1000 classes?) Confidence score Nature Explorer Image classification of 4,080 different species 5/1/2018 cwh.consultingGoogle maintains several computer vision (CV) models that can be loaded on to the kit. Several of these were recently added and hopefully more will come soon.
  16. 16. Process 1. Develop the model 2. Train 3. Freeze graph & compile 4. Deploy 5/1/2018 cwh.consultingModels need to be trained outside of the kit. Then they can be compiled for the AIY Vision Kit and deployed there.
  17. 17. Custommodels  Tensorflow Model Compiler  Only works on x86 64 Ubuntu  Lots of limitations on the model – specific operators and configuration require Build your own Retrain an existing model 5/1/2018 cwh.consulting ./bonnet_model_compiler.par -- frozen_graph_path=cat_detector_interference_graph_aiy/frozen_inference_graph.p b --output_graph_path=cat_detector.binaryproto --input_tensor_name="input" --output_tensor_names="concat,concat_1" --input_tensor_size=160 --debug There are caveats compiling to the AIY Vision Kit. I have not been able to get this to work (or seen someone else do this), but I think we are very close – see https://github.com/google/aiyprojects-raspbian/issues/314
  18. 18. Demos AIY Vision Kit 5/1/2018 cwh.consulting Cat detection using the built in cat/dog/human detector: https://youtu.be/NguWj9K1MJs Face detection: https://webrtchacks.com/wp-content/uploads/2018/02/face_detection_camera.py-preview.mp4?_=1
  19. 19. What does it all mean? 2 things… 5/1/2018 cwh.consulting
  20. 20. 5/1/2018 cwh.consulting Cloud Edge 1. Applying Machine Learning at the edge – not just the cloud
  21. 21. Cloudvs.Edge Privacy Latency Power Costs considerations 5/1/2018 cwh.consultingThere are several reasons why you might not want to push your machine learning to the cloud
  22. 22. EdgeML Examples of Computer Vision on the Movidius 5/1/2018 cwh.consulting Here are some real products that use the Movidius chip for running machine learning on-device
  23. 23. STEM 5/1/2018 cwh.consulting
  24. 24. STEM 5/1/2018 cwh.consulting 2. The kit is designed to expose high-schoolers to using AI technologies, not for PhD’s Google is trying to make ML tangible for a large audience.
  25. 25. AIYLinks  https://aiyprojects.withgoogle.com/vision  https://github.com/google/aiyprojects-raspbian  https://webrtchacks.com/aiy-vision-kit-uv4l-web-server/ 5/1/2018 cwh.consulting
  26. 26. Contact chadwhart@gmail.com @chadwallacehart cwh.consulting webrtcHacks.com github.com/chadwallacehart 5/1/2018 cwh.consulting

×