Computer Vision:
Extracting Data from the
Visual World
A Brief Example...
!
Steven Mitchell, Ph.D.
Componica, LLC
About us.
Componica, LLC (http://www.componica.com/)

Strong Background in Computer Vision
Copyright 2011 - Componica, LLC...
About us.
Componica seamlessly combines the worlds of
machine learning, computer visioning & mobile
development & applying...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Why is computer vision relevant?
How do these things work?

Sh...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
In this slideshow:
Facial Detection - Find me a face.

Facial ...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Face Detection
This is NOT facial recognition.

Developed by V...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
BTW, It’s how the Kinect sees people.
Copyright 2011 - Componica, LLC (http://www.componica.com/)
BTW, It’s how the Kinect sees people.
"Real-Time Human Pose Re...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Facial Recognition
Remove effects caused by lighting and
perspe...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Facial Recognition
Let’s mix some paint...

Comparing numbers ...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
The most common way to register images. Find the most
interest...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Augmented Reality
FAST interest point detection 0.55ms
Buildin...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
QR Codes
http://en.wikipedia.org/wiki/QR_Code
!
"Quick Respons...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Optical Character Recognition
iPhone 4th Gen
iPod Touch 4th Gen
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Optical Character Recognition
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Commentary
Ubiquitous Surveillance...extreme dislike.

Birthda...
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Commentary
Video Cameras may fit the criteria of legally blind.
Copyright 2011 - Componica, LLC (http://www.componica.com/)
Computer visioning technology and society:
opportunities, poss...
Upcoming SlideShare
Loading in …5
×

Computer Vision: Extracting Data from the Visual World

311 views
239 views

Published on

Introduction to Computer Visioning Technology.
Exploring the science behind "making computers see stuff", the future of facial tracking, optical recognition, and surveillance .

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
311
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
7
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Computer Vision: Extracting Data from the Visual World

  1. 1. Computer Vision: Extracting Data from the Visual World A Brief Example... ! Steven Mitchell, Ph.D. Componica, LLC
  2. 2. About us. Componica, LLC (http://www.componica.com/) Strong Background in Computer Vision Copyright 2011 - Componica, LLC (http://www.componica.com/)
  3. 3. About us. Componica seamlessly combines the worlds of machine learning, computer visioning & mobile development & applying the latest in visionary technology to the world of mobile media. Words for Spanish / Russian / French Copyright 2011 - Componica, LLC (http://www.componica.com/)
  4. 4. Copyright 2011 - Componica, LLC (http://www.componica.com/) Why is computer vision relevant? How do these things work? Should I be concernd?
  5. 5. Copyright 2011 - Componica, LLC (http://www.componica.com/) In this slideshow: Facial Detection - Find me a face. Facial Recognition - Who’s face is it? Image Registration - Aligning pictures together. ...which leads to augmented reality. QR Codes - They’re everywhere. Optical Character Recognition - Reading Stuff.
  6. 6. Copyright 2011 - Componica, LLC (http://www.componica.com/) Face Detection This is NOT facial recognition. Developed by Viola / Jones in 2000. Major break-thru in image recognition...this was not possible prior.
 How much does a cow weigh? An army of simple face detectors.
 "Robust Real-time Object Detection"! Paul Viola and Michael Jones
  7. 7. Copyright 2011 - Componica, LLC (http://www.componica.com/) BTW, It’s how the Kinect sees people.
  8. 8. Copyright 2011 - Componica, LLC (http://www.componica.com/) BTW, It’s how the Kinect sees people. "Real-Time Human Pose Recognition in Parts from Single Depth Images"! Shotton, Fitzgibbon, Cook, Sharp, Finocchio, Moore, Kipman, Blake! Microsoft Research Cambridge & Xbox Incubation
  9. 9. Copyright 2011 - Componica, LLC (http://www.componica.com/) Facial Recognition Remove effects caused by lighting and perspective. After you find a face, reduce it to numbers. "Statistical Models of Appearance for Computer Vision"! T.F. Cootes and C.J.Taylor
  10. 10. Copyright 2011 - Componica, LLC (http://www.componica.com/) Facial Recognition Let’s mix some paint... Comparing numbers in hyperspace k-Nearest Neighbor, Wikipedia
  11. 11. Copyright 2011 - Componica, LLC (http://www.componica.com/) The most common way to register images. Find the most interesting points on the two images. Compare all the interesting points from one image to the other forming matching pairs of points between images. Image Registration - Interesting Points
  12. 12. Copyright 2011 - Componica, LLC (http://www.componica.com/) Augmented Reality FAST interest point detection 0.55ms Building query bit masks 0.12ms Matching into database 0.35ms Robust pose estimation 0.1ms Total frame time 1.12ms Table 1. Timings for the stages of our approach on a dataset with images taken from within the range of trained viewpoints. Figure 5. Increasing the range of viewpoint bins in the training set allows more viewpoint invariance to be added in a straightforward manner. gests that the bit count dissimilarity score provides a reason- able way of scoring matches. To confirm this we computed the average number of inlier and outlier matches over all of the frames in the two sequences, and plotted these against the dissimilarity score obtained for the match in Figure 4. For the sequence on the left where the viewpoints are in- cluded in the training set many good matches are found in Once you have correspondence, you can compute 3D geometry. http://mi.eng.cam.ac.uk/~er258/work/fast.html http://nghiaho.com
  13. 13. Copyright 2011 - Componica, LLC (http://www.componica.com/) QR Codes http://en.wikipedia.org/wiki/QR_Code ! "Quick Response code" invented by Toyota subsidiary Denso Wave in 1994. Open License Up to 2.5K of data Error Correction Easy to read and generate: ZXing library
  14. 14. Copyright 2011 - Componica, LLC (http://www.componica.com/) Optical Character Recognition iPhone 4th Gen iPod Touch 4th Gen
  15. 15. Copyright 2011 - Componica, LLC (http://www.componica.com/) Optical Character Recognition
  16. 16. Copyright 2011 - Componica, LLC (http://www.componica.com/) Commentary Ubiquitous Surveillance...extreme dislike. Birthday Paradox...The probability that, in a set of n randomly chosen people, some pair of them will have the same birthday.
  17. 17. Copyright 2011 - Componica, LLC (http://www.componica.com/) Commentary Video Cameras may fit the criteria of legally blind.
  18. 18. Copyright 2011 - Componica, LLC (http://www.componica.com/) Computer visioning technology and society: opportunities, possibilities: Smartphones that ID diseases, plants, insects. Robotic lawnmowers that don’t run over the neighbor’s cat. Computers that judge emotions by reading your face. Keyless entry based on face, iris. Automated inspection of manufactured parts. Conclusion

×