Downloaded 13 times
Uploaded byRamon Ribeiro Rabello
Making your app see with Mobile Vision API
The document discusses Visyo's Mobile Vision API, which allows mobile apps to integrate computer vision capabilities. It introduces Ramon Rabello, CEO of Visyo, and provides an overview of computer vision and how the Mobile Vision API works. The API allows detecting faces, barcodes, and text from images using common functionality like detectors in an event-driven pipeline. It demonstrates how to use the API in an Android app and links to additional resources.
Making your app see with Mobile Vision API
- 1. RAMON RABELLO CEO @VISYO MAKING YOUR APP SEE WITH MOBILE VISION API
- 2. RAMON RABELLO about.me/ramonrabello Agile Community ActiveMember GDG Brasília Organizer Senior Developer ~10 years
- 3. HOW DO WESEE?
- 5.
- 7.
- 8. HOW MACHINES UNDERSTANDTHE WORLD
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17. AND ALSO ONMOBILE.
- 18.
- 19. OVERVIEW COMMON FUNCTIONALITY FACE API BARCODEAPI TEXT API (OCR)
- 20. COMMON FUNCTIONALITY EVENT-DRIVEN PIPELINE FACEDETECTOR BARCODE DETECTOR TEXT DETECTOR
- 21. FACE API WHAT CANWE DO WITH FACES?
- 22.
- 23.
- 24.
- 25.
- 26. FACE ORIENTATION POSE ANGLEESTIMATION Y Z X
- 27. BARCODE API WHAT TODO WITH BARCODES?
- 28.
- 29. TEXT API READING TEXTFROM IMAGES
- 30. READING TEXT FROMIMAGES 18+ LANGUAGES SUPPORTED
- 31.
- 32. MOBILE VISION APIUSAGE 1. ADD DEPENDENCIES 2. ADD META-DATA ON MANIFEST 3. CREATE DETECTOR 4. CHECK IF DETECTOR IS OPERATIONAL 5. CREATE FRAME 6. DETECT FACES
- 33. ADD DEPENDENCIES build.gradle dependencies { … compile'com.google.android.gms:play-services-vision:{version}' … }
- 34. ADD META-DATA ONMANIFEST AndroidManifest.xml <application…> <meta-data android:name="com.google.android.gms.vision.DEPENDENCIES" android:value="face" /> </application>
- 35. CREATE DETECTOR onCreate() FaceDetector faceDetector= new FaceDetector.Builder(context) .setTrackingEnabled(false) .setProminentFaceOnly(false) .setMode(FaceDetector.FAST_MODE) .setClassificationType(FaceDetector.ALL_CLASSIFICATIONS) .setLandmarkType(FaceDetector.NO_LANDMARKS) .build();
- 36. CHECK IF DETECTORIS OPERATIONAL onCreate() faceDetector.isOperational(){ // code to detect faces here } downloads a native library, when run for the first time.
- 37. CREATE FRAME Bitmap bitmap= …; // read Bitmap Frame frame = new Frame.Builder() .setBitmap(bitmap) .build(); onCreate()
- 38. DETECT FACES SparseArray<Face> faces =detector.detect(frame); // face(s) detected if (faces.size() > 0){ } onCreate()
- 39.
- 40. WHAT’S NEXT? MOBILE VISIONGUIDE https://developers.google.com/vision/
- 41.
- 42.
- 43.