Image Processing

1,176 views

Published on

Published in: Technology, News & Politics
1 Comment
0 Likes
Statistics
Notes
  • thank you so much
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Views
Total views
1,176
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
48
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide

Image Processing

  1. 1. PISA Production, Indexing and Search of Audio-visual Material Image Processing Tinne Tuytelaars, IBBT – PSI – K.U.Leuven
  2. 2. Computer Assisted Analysis ! Intelligent analysis = reverse engineering ! Shot cut detection demo ! Scene segmentation demo ! Video reuse detection demo ! Face detection ! Face recognition demo ! Audio classification demo 61
  3. 3. Shot cut detection = Split the video stream in atomic units, corresponding to a continuously moving camera ! Distinguish between abrupt and smooth shotcuts ! Experimented with different methods ! Using color histograms ! Using affine motion compensation ! Using motion estimation within the compressed domain 62
  4. 4. Scene segmentation 68
  5. 5. Video reuse detection The same video material is often reused ! can be detected automatically ! Robust to post-processing ! Efficiency ! Based on spatio-temporal local features and locality sensitive hashing 69
  6. 6. Face Detection • Face candidates selection: quot; Candidate regions have skin color # region-based skin segmentation quot; Personalized chrominance skin boundary • Verification based on cues: quot; Shape of ellipse quot; Ellipse-filling percentage quot; Gray-tone smoothness quot; Corners of the facial features 70
  7. 7. Face detection results • 92% good face detections quot;Comparable to state-of-the-art face learning of ‘Viola & Jones’ obtains 93% quot;adaptation to lighting conditions and personal face looks 71
  8. 8. Face recognition ! Based on a 3D morphable model ! 3D model is fitted to 2D image ! Shape and texture parameters used as face descriptor ! Robust to ! viewpoint changes, ! illumination changes, ! partial occlusions. 72
  9. 9. Face recognition 73
  10. 10. Face recognition 74
  11. 11. Face recognition 75
  12. 12. Face recognition 76
  13. 13. Face recognition 77
  14. 14. Future work ! Include facial expressions in face recognition ! Multi-modal scene segmentation ! Feedback loop from Trouvaille ! Object or scene recognition ! Thesaurus-based speech recognition 79

×