Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2019 OpenCV.org OpenCV: Current Status & Future Plans Satya Mallick, Ph.D. OpenCV.org May 2019
© 2019 OpenCV.org Overview • Stats and Survey • OpenCV 4 • OpenCV Graph API • OpenCV DNN Module • OpenCV DNN on CPU is fas...
© 2019 OpenCV.org Stats and Survey 3
© 2019 OpenCV.org OpenCV : 2M+ installs per week! • 19M Downloads on SourceForge • Git • pip opencv-python : 1.1M+ install...
© 2019 OpenCV.org Who uses OpenCV? 5
© 2019 OpenCV.org 6 Operating Systems
© 2019 OpenCV.org 7 Programming Languages Note: The entries are not mutually exclusive.
© 2019 OpenCV.org OpenCV 4 is here! 8
© 2019 OpenCV.org OpenCV is now a C++11 library ● C API removed for a lot of functions ○ photo, video, imgcodecs, videoio ...
© 2019 OpenCV.org OpenCV Graph API An engine for efficient graph based image processing pipelines
© 2019 OpenCV.org 11 Function FetchBread() FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home
© 2019 OpenCV.org 12 Function FetchMilk() FetchMilk() 1.Go to supermarket 2.Get milk 3.Come back home
© 2019 OpenCV.org 13 No Computational Graph FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home FetchMilk() 1.Go...
© 2019 OpenCV.org 14 With Computational Graph FetchBread() FetchMilk() 1.Go to supermarket 2.Get bread 3.Get milk 4.Come b...
© 2019 OpenCV.org 15 API Layer Platform Agnostic
© 2019 OpenCV.org 16 Graph Compiler Layer Unrolls user computations into a graph
© 2019 OpenCV.org 17 Backends Layer Low Level Implementation
© 2019 OpenCV.org Deep Neural Network Module
© 2019 OpenCV.org 19 OpenCV DNN Module Train using 1. Caffe 2. Tensorflow 3. Torch 4. Darknet 5. ONNX model Use OpenCV for...
© 2019 OpenCV.org OpenCV Model Zoo: Classification 20 AlexNet GoogleNet CaffeNet RCNN_ILSVRC13 ZFNet512 VGG16, VGG16_bn Re...
© 2019 OpenCV.org Object Detection Semantic Segmentation 21 YOLOv3 SSD VGG MobileNet-SSD Faster-RCNN R-FCN OpenCV face det...
© 2019 OpenCV.org Mask R-CNN with OpenCV https://youtu.be/hzR-wHuM0dE 22
© 2019 OpenCV.org OpenPose with OpenCV https://youtu.be/xt91NWcaO4s 23
© 2019 OpenCV.org OpenCV DNN on CPU is fast
© 2019 OpenCV.org Testing Machine Configuration • Machine : AWS t2.large instance. This instance has 2 vCPUs and 8 GB of R...
© 2019 OpenCV.org 26 Image Classification
© 2019 OpenCV.org Object Detection (YOLOv3) 27
© 2019 OpenCV.org 28 Object Tracking (GOTURN)
© 2019 OpenCV.org Pose Estimation 29
© 2019 OpenCV.org OpenCV + OpenVINO Even faster speeds with Intel’s Inference Engine
© 2019 OpenCV.org 31 OpenCV with Intel’s Inference Engine IE: Intel OpenVINO Inference Engine IR: Intermediate Representat...
© 2019 OpenCV.org Google Summer of Code 2019
© 2019 OpenCV.org Selected Projects • NVIDIA GPU support for DNN module • Data augmentation module • Richer model zoo • Al...
© 2019 OpenCV.org
© 2019 OpenCV.org 35 Open Source Vision Foundation
© 2019 OpenCV.org Carla: Open Source Car Simulator https://youtu.be/ChmF8IFagpo 36
© 2019 OpenCV.org Open3D: Open Source 3D Processing Library https://youtu.be/I3UjXlA4IsU 37
© 2019 OpenCV.org OpenCV: Current Funding Intel • 4 core team members (Intel employees) + 3 interns + open source contribu...
© 2019 OpenCV.org OpenCV: Future Funding Courseware [ Kickstarter Campaign May 2019] • Computer Vision I: Introduction • C...
© 2019 OpenCV.org OpenCV.org New Website!
© 2019 OpenCV.org 41
© 2019 OpenCV.org Conclusion • OpenCV's DNN module is fast. • Google Scholar 2019: GPU support coming soon. • AI courses b...
© 2019 OpenCV.org Thank You!
© 2019 OpenCV.org Resource Slide 44 Open Source Vision Foundation OSVF http://www.osvf.org CARLA http://carla.org OPEN3D h...
Upcoming SlideShare
Loading in …5
×

"OpenCV: Current Status and Future Plans," a Presentation from OpenCV.org

300 views

Published on

For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/may-2019-embedded-vision-summit-mallick

For more information about embedded vision, please visit:
http://www.embedded-vision.com

Satya Mallick, Interim CEO of OpenCV.org, presents the "OpenCV: Current Status and Future Plans" tutorial at the May 2019 Embedded Vision Summit.

With over two million downloads per week, OpenCV is the most popular open source computer vision library in the world. It implements over 2500 opt- imized algorithms, works on all major operating systems, is available in multiple languages and is free for commercial use.

This talk primarily provides a technical update on OpenCV: What’s new in OpenCV 4.0? What is the Graph API? Why are we so excited about the Deep Neural Network (DNN) module in OpenCV? (Short answer: It is one of the fastest inference engines on the CPU.)

Mallick also shares plans for the future of OpenCV, including new algorithms that the organization plans to add through the Google Summer of Code this year. And he briefly shares information on the new Open Source Vision Foundation (OSVF), on OpenCV’s sister organizations, CARLA and Open3D, and on some of the initiatives planned by these organizations.

Published in: Technology
no profile picture user

  • Login to see the comments

"OpenCV: Current Status and Future Plans," a Presentation from OpenCV.org

  1. 1. © 2019 OpenCV.org OpenCV: Current Status & Future Plans Satya Mallick, Ph.D. OpenCV.org May 2019
  2. 2. © 2019 OpenCV.org Overview • Stats and Survey • OpenCV 4 • OpenCV Graph API • OpenCV DNN Module • OpenCV DNN on CPU is fast • OpenCV + OpenVINO • Google Summer of Code 2019 • Open Source Vision Foundation 2
  3. 3. © 2019 OpenCV.org Stats and Survey 3
  4. 4. © 2019 OpenCV.org OpenCV : 2M+ installs per week! • 19M Downloads on SourceForge • Git • pip opencv-python : 1.1M+ installs per week ( Tensorflow is at 750k / week ) • Guestimate : OpenCV gets 2M+ downloads per week! 4
  5. 5. © 2019 OpenCV.org Who uses OpenCV? 5
  6. 6. © 2019 OpenCV.org 6 Operating Systems
  7. 7. © 2019 OpenCV.org 7 Programming Languages Note: The entries are not mutually exclusive.
  8. 8. © 2019 OpenCV.org OpenCV 4 is here! 8
  9. 9. © 2019 OpenCV.org OpenCV is now a C++11 library ● C API removed for a lot of functions ○ photo, video, imgcodecs, videoio ● C++11 compliant compiler needed ● Persistent data storage re-implemented in C++ ○ Data read/write for XML, YAML and JSON re-implemented in C++ ○ C API no longer available for data read/write. 9
  10. 10. © 2019 OpenCV.org OpenCV Graph API An engine for efficient graph based image processing pipelines
  11. 11. © 2019 OpenCV.org 11 Function FetchBread() FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home
  12. 12. © 2019 OpenCV.org 12 Function FetchMilk() FetchMilk() 1.Go to supermarket 2.Get milk 3.Come back home
  13. 13. © 2019 OpenCV.org 13 No Computational Graph FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home FetchMilk() 1.Go to supermarket 2.Get milk 3.Come back home
  14. 14. © 2019 OpenCV.org 14 With Computational Graph FetchBread() FetchMilk() 1.Go to supermarket 2.Get bread 3.Get milk 4.Come back home
  15. 15. © 2019 OpenCV.org 15 API Layer Platform Agnostic
  16. 16. © 2019 OpenCV.org 16 Graph Compiler Layer Unrolls user computations into a graph
  17. 17. © 2019 OpenCV.org 17 Backends Layer Low Level Implementation
  18. 18. © 2019 OpenCV.org Deep Neural Network Module
  19. 19. © 2019 OpenCV.org 19 OpenCV DNN Module Train using 1. Caffe 2. Tensorflow 3. Torch 4. Darknet 5. ONNX model Use OpenCV for Inference
  20. 20. © 2019 OpenCV.org OpenCV Model Zoo: Classification 20 AlexNet GoogleNet CaffeNet RCNN_ILSVRC13 ZFNet512 VGG16, VGG16_bn ResNet-18v1, ResNet-50v1 CNN Mnist MobileNetv2 LResNet100E-IR Emotion FERPlus Squeezenet DenseNet121 Inception v1, v2 Shufflenet
  21. 21. © 2019 OpenCV.org Object Detection Semantic Segmentation 21 YOLOv3 SSD VGG MobileNet-SSD Faster-RCNN R-FCN OpenCV face detector TinyYolov2 FCN ENet ResNet101_DUC_HDC
  22. 22. © 2019 OpenCV.org Mask R-CNN with OpenCV https://youtu.be/hzR-wHuM0dE 22
  23. 23. © 2019 OpenCV.org OpenPose with OpenCV https://youtu.be/xt91NWcaO4s 23
  24. 24. © 2019 OpenCV.org OpenCV DNN on CPU is fast
  25. 25. © 2019 OpenCV.org Testing Machine Configuration • Machine : AWS t2.large instance. This instance has 2 vCPUs and 8 GB of RAM, but no GPU. • Operating System : Ubuntu 16.04 LTS. OpenCV version : 3.4.3 • Testing methodology : 100 cycles of the same test were performed and average time is reported. 25
  26. 26. © 2019 OpenCV.org 26 Image Classification
  27. 27. © 2019 OpenCV.org Object Detection (YOLOv3) 27
  28. 28. © 2019 OpenCV.org 28 Object Tracking (GOTURN)
  29. 29. © 2019 OpenCV.org Pose Estimation 29
  30. 30. © 2019 OpenCV.org OpenCV + OpenVINO Even faster speeds with Intel’s Inference Engine
  31. 31. © 2019 OpenCV.org 31 OpenCV with Intel’s Inference Engine IE: Intel OpenVINO Inference Engine IR: Intermediate Representation
  32. 32. © 2019 OpenCV.org Google Summer of Code 2019
  33. 33. © 2019 OpenCV.org Selected Projects • NVIDIA GPU support for DNN module • Data augmentation module • Richer model zoo • Alpha matting • Super-resolution • Facial landmark detection • DynamicFusion : 3D reconstruction using RGBD images • Performance optimization for opencv.js 33
  34. 34. © 2019 OpenCV.org
  35. 35. © 2019 OpenCV.org 35 Open Source Vision Foundation
  36. 36. © 2019 OpenCV.org Carla: Open Source Car Simulator https://youtu.be/ChmF8IFagpo 36
  37. 37. © 2019 OpenCV.org Open3D: Open Source 3D Processing Library https://youtu.be/I3UjXlA4IsU 37
  38. 38. © 2019 OpenCV.org OpenCV: Current Funding Intel • 4 core team members (Intel employees) + 3 interns + open source contributors. Google • Google Summer of Code (GSOC 2019) Individual donations 38
  39. 39. © 2019 OpenCV.org OpenCV: Future Funding Courseware [ Kickstarter Campaign May 2019] • Computer Vision I: Introduction • Computer Vision II: Applications • Deep Learning with PyTorch Certifications Consulting services Corporate funding Developer conference 39
  40. 40. © 2019 OpenCV.org OpenCV.org New Website!
  41. 41. © 2019 OpenCV.org 41
  42. 42. © 2019 OpenCV.org Conclusion • OpenCV's DNN module is fast. • Google Scholar 2019: GPU support coming soon. • AI courses by OpenCV coming up this summer. 42
  43. 43. © 2019 OpenCV.org Thank You!
  44. 44. © 2019 OpenCV.org Resource Slide 44 Open Source Vision Foundation OSVF http://www.osvf.org CARLA http://carla.org OPEN3D http://www.open3d.org OpenCV Releases https://opencv.org/releases/ Courses https://opencv.org/courses/ Embedded Vision Summit “OpenCV: Current Status & Future Plans” Wednesday, May 22, 1:00 PM - 1:30 PM

×