Sofou - VIRaL @EUscreen Mykonos

661 views
625 views

Published on

Published in: Travel, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
661
On SlideShare
0
From Embeds
0
Number of Embeds
52
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sofou - VIRaL @EUscreen Mykonos

  1. 1. Visual Image Retrieval & Localization http://viral.image.ntua.gr/ Natasa Sofou National Technical University of Athens EUScreen Workshop, Mykonos, 24 June 2010
  2. 2. A brief introduction <ul><li>There is a continuously growing volume of publicly available photos and videos. </li></ul><ul><li>This results to a growing need for automatic metadata generation, concept detection, search, retrieval and analysis of large-scale diverse and heterogeneous visual content. </li></ul><ul><li>Towards this direction the tool presented here is a web based system that aims to retrieve visually similar images and to determine their location by exploiting the available socially created metadata. </li></ul>
  3. 3. The basic idea <ul><li>Let’s collect photos </li></ul><ul><li>And build a tool </li></ul><ul><li>That uses visual similarity </li></ul><ul><li>Under any viewpoint </li></ul><ul><li>To localize any user photo </li></ul><ul><li>To identify landmarks </li></ul><ul><li>& link them to wikipedia </li></ul><ul><li>In (almost) real time </li></ul>
  4. 4. Let’s collect photos… <ul><li>~1.100.000 photos from </li></ul><ul><li>all geo-tagged during a recent period </li></ul><ul><li>depicting urban landscapes (city centers) </li></ul><ul><li>download all photos & metadata </li></ul>
  5. 5. e.g. from London… <ul><li>W 0°9’25” </li></ul>W 0°5’31” N51°31’12” N51°29’35” ~25km 2
  6. 6. and build a tool...
  7. 7. that uses visual similarity...
  8. 8. under any viewpoint...
  9. 9. ... to localize any user photo
  10. 10. ... to identify landmarks
  11. 11. ... & link them to Wikipedia
  12. 12. in (almost) real-time!!! <ul><li>query image analysis: <1.0 second </li></ul><ul><li>average response time: <4.0 seconds per query </li></ul>
  13. 13. VIRaL http:// viral.image.ntua.gr
  14. 14. <ul><li>Natasa </li></ul>Now: a stroll around Thames… Phivos ... and their photos!!!
  15. 15. 1. Localize Phivos’s photos on the map
  16. 16. 2. Align with Natasa’s photostream
  17. 17. 3. Group wrt time, location & similarity
  18. 18. <ul><li>london </li></ul><ul><li>big ben </li></ul>london eye thames london bus tate gallery millenium bridge st pauls cathedral thames river tower bridge 4. Add tags & arrange like a photo album
  19. 19. <ul><li>big ben </li></ul>london eye thames phivos tower bridge natasa natasa 5. Add tags to regions & names to faces
  20. 20. <ul><li>me </li></ul>my friends my network Phivos June 08 Yiannis May 03 Kostas May 05 Maria Jan 01 albums i can access Now, when I go to London…
  21. 21. Thank you !!!

×