0
Callisto – A Content-based Tag
Recommendation Tool
    M. Lux, A. Pitman, and O. Marques
What does Callisto do?
• Given an image and one or more start tags
• Callisto finds ranked tag recommendations

1. Based o...
What are the benefits of NCP & Callisto?

• Different tags are suggested.
• Tags are re-ranked based on visual content.
  ...
The Application

  Image to be tagged




                       Start tag(s)

Low-level
features used



Suggestions
Ranked suggested tags

Suggestions by our content-based model (NCP)




Suggestions based on tag co-occurrence (baseline)
Use Case: Beach

 Start tag: beach




• Suggestions by both models
are almost the same
• Both feature good quality
sugges...
Use Case: Beach

   Same start tag, different photo




• Suggestions differ
• NCP has different tags to offer
Use Case: Ocean

 Start tag: ocean




• NCP suggests clouds
Use Case: Juggling

 Start tag: juggling




• NCP ranks fire first
• NCP doesn‘t include balls in
the list, which is good...
Use Case: Juggling

 Start tag: juggling




• NCP suggests portrait
and people
• NCP doesn‘t suggest fire
Use Case: Juggling girl

 Start tags: juggling girl




• NCP suggests woman
• NCP ranks people higher
Performance issues
• Callisto has to download images and tags for
  suggestions, which is slow.
• Callisto caches download...
Live demo
• Keep your fingers crossed…
Upcoming SlideShare
Loading in...5
×

Callisto: Content Based Tag Recommendation for Images

1,041

Published on

Published in: Technology, Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,041
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "Callisto: Content Based Tag Recommendation for Images"

  1. 1. Callisto – A Content-based Tag Recommendation Tool M. Lux, A. Pitman, and O. Marques
  2. 2. What does Callisto do? • Given an image and one or more start tags • Callisto finds ranked tag recommendations 1. Based on our model (NCP) 2. Based on statistical analysis (Stat)
  3. 3. What are the benefits of NCP & Callisto? • Different tags are suggested. • Tags are re-ranked based on visual content. – Consequently: • With the NCP model, it is common to see tags that are highly related to visual features being suggested if such features are there, and not suggested if those features are missing. – E.g.: sunset is not suggested if typical colors of sunsets are missing in the image.
  4. 4. The Application Image to be tagged Start tag(s) Low-level features used Suggestions
  5. 5. Ranked suggested tags Suggestions by our content-based model (NCP) Suggestions based on tag co-occurrence (baseline)
  6. 6. Use Case: Beach Start tag: beach • Suggestions by both models are almost the same • Both feature good quality suggestions
  7. 7. Use Case: Beach Same start tag, different photo • Suggestions differ • NCP has different tags to offer
  8. 8. Use Case: Ocean Start tag: ocean • NCP suggests clouds
  9. 9. Use Case: Juggling Start tag: juggling • NCP ranks fire first • NCP doesn‘t include balls in the list, which is good, since there are no balls involved
  10. 10. Use Case: Juggling Start tag: juggling • NCP suggests portrait and people • NCP doesn‘t suggest fire
  11. 11. Use Case: Juggling girl Start tags: juggling girl • NCP suggests woman • NCP ranks people higher
  12. 12. Performance issues • Callisto has to download images and tags for suggestions, which is slow. • Callisto caches downloads, so next time (with the same start tag) it is much faster. • The number of downloaded photos is critical. – 28 works fine and is not too slow – 100 is much better, but downloading takes forever
  13. 13. Live demo • Keep your fingers crossed…
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×