Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
What to Upload to SlideShare
What to Upload to SlideShare
Loading in …3
×
1 of 44

"OpenCV: Current Status and Future Plans," a Presentation from OpenCV.org

Sep. 19, 2019
• 2 likes • 440 views

2

Share

Download to read offline

Technology

For the full video of this presentation, please visit:
https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-vision-training/videos/pages/may-2019-embedded-vision-summit-mallick

For more information about embedded vision, please visit:
http://www.embedded-vision.com

Satya Mallick, Interim CEO of OpenCV.org, presents the "OpenCV: Current Status and Future Plans" tutorial at the May 2019 Embedded Vision Summit.

With over two million downloads per week, OpenCV is the most popular open source computer vision library in the world. It implements over 2500 opt- imized algorithms, works on all major operating systems, is available in multiple languages and is free for commercial use.

This talk primarily provides a technical update on OpenCV: What’s new in OpenCV 4.0? What is the Graph API? Why are we so excited about the Deep Neural Network (DNN) module in OpenCV? (Short answer: It is one of the fastest inference engines on the CPU.)

Mallick also shares plans for the future of OpenCV, including new algorithms that the organization plans to add through the Google Summer of Code this year. And he briefly shares information on the new Open Source Vision Foundation (OSVF), on OpenCV’s sister organizations, CARLA and Open3D, and on some of the initiatives planned by these organizations.

Recommended

Related Books

Free with a 30 day trial from Scribd

See all
So You Want to Start a Podcast: Finding Your Voice, Telling Your Story, and Building a Community That Will Listen Kristen Meinzer
(3/5)
Free
Bezonomics: How Amazon Is Changing Our Lives and What the World's Best Companies Are Learning from It Brian Dumaine
(4.5/5)
Free
From Gutenberg to Google: The History of Our Future Tom Wheeler
(3.5/5)
Free
SAM: One Robot, a Dozen Engineers, and the Race to Revolutionize the Way We Build Jonathan Waldman
(5/5)
Free
Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think James Vlahos
(3.5/5)
Free
The Future Is Faster Than You Think: How Converging Technologies Are Transforming Business, Industries, and Our Lives Peter H. Diamandis
(4.5/5)
Free
Live Work Work Work Die: A Journey into the Savage Heart of Silicon Valley Corey Pein
(4.5/5)
Free
No Filter: The Inside Story of Instagram Sarah Frier
(4.5/5)
Free
Autonomy: The Quest to Build the Driverless Car—And How It Will Reshape Our World Lawrence D. Burns
(5/5)
Free
Future Presence: How Virtual Reality Is Changing Human Connection, Intimacy, and the Limits of Ordinary Life Peter Rubin
(4.5/5)
Free
Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are Seth Stephens-Davidowitz
(4/5)
Free
Life After Google: The Fall of Big Data and the Rise of the Blockchain Economy George Gilder
(4/5)
Free
System Identification: Tutorials Presented at the 5th IFAC Symposium on Identification and System Parameter Estimation, F.R. Germany, September 1979 Elsevier Books Reference
(4/5)
Free
Longitude: The True Story of a Lone Genius Who Solved the Greatest Scientific Problem of His Time Dava Sobel
(4/5)
Free
Young Men and Fire: Twenty-fifth Anniversary Edition Norman MacLean
(4.5/5)
Free
Energy Conservation in Buildings: The Achievement of 50% Energy Saving: An Environmental Challenge? Elsevier Books Reference
(4/5)
Free

Related Audiobooks

Free with a 30 day trial from Scribd

See all
Liftoff: Elon Musk and the Desperate Early Days That Launched SpaceX Eric Berger
(5/5)
Free
A Brief History of Motion: From the Wheel, to the Car, to What Comes Next Tom Standage
(4.5/5)
Free
An Ugly Truth: Inside Facebook’s Battle for Domination Sheera Frenkel
(4.5/5)
Free
Second Nature: Scenes from a World Remade Nathaniel Rich
(5/5)
Free
Spooked: The Trump Dossier, Black Cube, and the Rise of Private Spies Barry Meier
(4/5)
Free
Test Gods: Virgin Galactic and the Making of a Modern Astronaut Nicholas Schmidle
(5/5)
Free
Driven: The Race to Create the Autonomous Car Alex Davies
(4.5/5)
Free
Einstein's Fridge: How the Difference Between Hot and Cold Explains the Universe Paul Sen
(4.5/5)
Free
User Friendly: How the Hidden Rules of Design Are Changing the Way We Live, Work, and Play Cliff Kuang
(4/5)
Free
Digital Renaissance: What Data and Economics Tell Us about the Future of Popular Culture Joel Waldfogel
(3.5/5)
Free
Lean Out: The Truth About Women, Power, and the Workplace Marissa Orr
(4.5/5)
Free
Uncanny Valley: A Memoir Anna Wiener
(4/5)
Free
Blockchain: The Next Everything Stephen P. Williams
(4/5)
Free
A World Without Work: Technology, Automation, and How We Should Respond Daniel Susskind
(4.5/5)
Free
Bitcoin Billionaires: A True Story of Genius, Betrayal, and Redemption Ben Mezrich
(4.5/5)
Free
The Players Ball: A Genius, a Con Man, and the Secret History of the Internet's Rise David Kushner
(4.5/5)
Free

"OpenCV: Current Status and Future Plans," a Presentation from OpenCV.org

  1. 1. © 2019 OpenCV.org OpenCV: Current Status & Future Plans Satya Mallick, Ph.D. OpenCV.org May 2019
  2. 2. © 2019 OpenCV.org Overview • Stats and Survey • OpenCV 4 • OpenCV Graph API • OpenCV DNN Module • OpenCV DNN on CPU is fast • OpenCV + OpenVINO • Google Summer of Code 2019 • Open Source Vision Foundation 2
  3. 3. © 2019 OpenCV.org Stats and Survey 3
  4. 4. © 2019 OpenCV.org OpenCV : 2M+ installs per week! • 19M Downloads on SourceForge • Git • pip opencv-python : 1.1M+ installs per week ( Tensorflow is at 750k / week ) • Guestimate : OpenCV gets 2M+ downloads per week! 4
  5. 5. © 2019 OpenCV.org Who uses OpenCV? 5
  6. 6. © 2019 OpenCV.org 6 Operating Systems
  7. 7. © 2019 OpenCV.org 7 Programming Languages Note: The entries are not mutually exclusive.
  8. 8. © 2019 OpenCV.org OpenCV 4 is here! 8
  9. 9. © 2019 OpenCV.org OpenCV is now a C++11 library ● C API removed for a lot of functions ○ photo, video, imgcodecs, videoio ● C++11 compliant compiler needed ● Persistent data storage re-implemented in C++ ○ Data read/write for XML, YAML and JSON re-implemented in C++ ○ C API no longer available for data read/write. 9
  10. 10. © 2019 OpenCV.org OpenCV Graph API An engine for efficient graph based image processing pipelines
  11. 11. © 2019 OpenCV.org 11 Function FetchBread() FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home
  12. 12. © 2019 OpenCV.org 12 Function FetchMilk() FetchMilk() 1.Go to supermarket 2.Get milk 3.Come back home
  13. 13. © 2019 OpenCV.org 13 No Computational Graph FetchBread() 1.Go to supermarket 2.Get bread 3.Come back home FetchMilk() 1.Go to supermarket 2.Get milk 3.Come back home
  14. 14. © 2019 OpenCV.org 14 With Computational Graph FetchBread() FetchMilk() 1.Go to supermarket 2.Get bread 3.Get milk 4.Come back home
  15. 15. © 2019 OpenCV.org 15 API Layer Platform Agnostic
  16. 16. © 2019 OpenCV.org 16 Graph Compiler Layer Unrolls user computations into a graph
  17. 17. © 2019 OpenCV.org 17 Backends Layer Low Level Implementation
  18. 18. © 2019 OpenCV.org Deep Neural Network Module
  19. 19. © 2019 OpenCV.org 19 OpenCV DNN Module Train using 1. Caffe 2. Tensorflow 3. Torch 4. Darknet 5. ONNX model Use OpenCV for Inference
  20. 20. © 2019 OpenCV.org OpenCV Model Zoo: Classification 20 AlexNet GoogleNet CaffeNet RCNN_ILSVRC13 ZFNet512 VGG16, VGG16_bn ResNet-18v1, ResNet-50v1 CNN Mnist MobileNetv2 LResNet100E-IR Emotion FERPlus Squeezenet DenseNet121 Inception v1, v2 Shufflenet
  21. 21. © 2019 OpenCV.org Object Detection Semantic Segmentation 21 YOLOv3 SSD VGG MobileNet-SSD Faster-RCNN R-FCN OpenCV face detector TinyYolov2 FCN ENet ResNet101_DUC_HDC
  22. 22. © 2019 OpenCV.org Mask R-CNN with OpenCV https://youtu.be/hzR-wHuM0dE 22
  23. 23. © 2019 OpenCV.org OpenPose with OpenCV https://youtu.be/xt91NWcaO4s 23
  24. 24. © 2019 OpenCV.org OpenCV DNN on CPU is fast
  25. 25. © 2019 OpenCV.org Testing Machine Configuration • Machine : AWS t2.large instance. This instance has 2 vCPUs and 8 GB of RAM, but no GPU. • Operating System : Ubuntu 16.04 LTS. OpenCV version : 3.4.3 • Testing methodology : 100 cycles of the same test were performed and average time is reported. 25
  26. 26. © 2019 OpenCV.org 26 Image Classification
  27. 27. © 2019 OpenCV.org Object Detection (YOLOv3) 27
  28. 28. © 2019 OpenCV.org 28 Object Tracking (GOTURN)
  29. 29. © 2019 OpenCV.org Pose Estimation 29
  30. 30. © 2019 OpenCV.org OpenCV + OpenVINO Even faster speeds with Intel’s Inference Engine
  31. 31. © 2019 OpenCV.org 31 OpenCV with Intel’s Inference Engine IE: Intel OpenVINO Inference Engine IR: Intermediate Representation
  32. 32. © 2019 OpenCV.org Google Summer of Code 2019
  33. 33. © 2019 OpenCV.org Selected Projects • NVIDIA GPU support for DNN module • Data augmentation module • Richer model zoo • Alpha matting • Super-resolution • Facial landmark detection • DynamicFusion : 3D reconstruction using RGBD images • Performance optimization for opencv.js 33
  34. 34. © 2019 OpenCV.org
  35. 35. © 2019 OpenCV.org 35 Open Source Vision Foundation
  36. 36. © 2019 OpenCV.org Carla: Open Source Car Simulator https://youtu.be/ChmF8IFagpo 36
  37. 37. © 2019 OpenCV.org Open3D: Open Source 3D Processing Library https://youtu.be/I3UjXlA4IsU 37
  38. 38. © 2019 OpenCV.org OpenCV: Current Funding Intel • 4 core team members (Intel employees) + 3 interns + open source contributors. Google • Google Summer of Code (GSOC 2019) Individual donations 38
  39. 39. © 2019 OpenCV.org OpenCV: Future Funding Courseware [ Kickstarter Campaign May 2019] • Computer Vision I: Introduction • Computer Vision II: Applications • Deep Learning with PyTorch Certifications Consulting services Corporate funding Developer conference 39
  40. 40. © 2019 OpenCV.org OpenCV.org New Website!
  41. 41. © 2019 OpenCV.org 41
  42. 42. © 2019 OpenCV.org Conclusion • OpenCV's DNN module is fast. • Google Scholar 2019: GPU support coming soon. • AI courses by OpenCV coming up this summer. 42
  43. 43. © 2019 OpenCV.org Thank You!
  44. 44. © 2019 OpenCV.org Resource Slide 44 Open Source Vision Foundation OSVF http://www.osvf.org CARLA http://carla.org OPEN3D http://www.open3d.org OpenCV Releases https://opencv.org/releases/ Courses https://opencv.org/courses/ Embedded Vision Summit “OpenCV: Current Status & Future Plans” Wednesday, May 22, 1:00 PM - 1:30 PM

×