The ImageNotion Beta version


Published on

The ImageNotion application is the outcome of the EU funded project IMAGINATION.

This presentation shows the innovative approach for the combination of semantic technologies and automated processes for image annotation

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

The ImageNotion Beta version

  1. 1. Juris Zubkans, RIDEMO Andreas Walter, FZI Gabor Nagypal. disy 19.03.2009 – final review meeting ImageNotion beta
  2. 2. From prototype version to beta version ImageNotion: IMAGINATION : <ul><li>ImageNotion prototype </li></ul><ul><li>Released: October 2007 </li></ul><ul><li>Main goal: development of a prototype to show potential of ImageNotion </li></ul><ul><li>Prototype used for evaluations </li></ul><ul><ul><li>Online evaluation Nov/Dec 2007, > 100 participants </li></ul></ul><ul><ul><li>Formative evaluation workshop </li></ul></ul>
  3. 3. Features of the prototype ImageNotion: IMAGINATION : <ul><li>Automated processes </li></ul><ul><li>First version of person detection (NTUA) </li></ul><ul><li>Simple approach for text mining (JSI) </li></ul><ul><li>Face detection (IIS) </li></ul><ul><li>Face recognition with static training (IIS) </li></ul><ul><li>No combination of services so far </li></ul><ul><li>ImageNotion methodology </li></ul><ul><li>Visual representation of semantic elements </li></ul><ul><li>Only basic relations like in thesauri (broader, narrower, is-a) </li></ul><ul><li>Web based frontend </li></ul><ul><li>using many new Web 2.0 features (Autocomplete, refresh of site parts) using AJAX </li></ul>
  4. 4. Feedback for prototype (in a brief) <ul><li>General approach very promising for </li></ul><ul><ul><li>Semantic image annotation , e.g. in image agencies </li></ul></ul><ul><ul><li>Semantic image search, e.g. editors, students </li></ul></ul><ul><li>Visual approach for showing semantic elements </li></ul><ul><ul><li>ImageNotion methodology easily understandable </li></ul></ul><ul><ul><li>Allows collaborative and work integrated ontology development </li></ul></ul><ul><li>Combination of services </li></ul><ul><ul><li>Saves time (and so money) for creating annotations on images </li></ul></ul><ul><li>Frontend </li></ul><ul><ul><li>„ Desktop application feeling“ </li></ul></ul><ul><ul><li>=> High motivation for making prototype a beta version… </li></ul></ul>ImageNotion: IMAGINATION :
  5. 5. The new ImageNotion version (1) <ul><li>Automated processes (short overview) </li></ul><ul><ul><li>Improved person detection, NTUA also developed similarity search </li></ul></ul><ul><ul><li>Improved version of text mining from JSI, also text recognition (FZI), Integration of SearchPoint (visual search refinment) </li></ul></ul><ul><ul><li>Improved version of IIS for face detection, also gender and mood detection </li></ul></ul><ul><ul><li>Dynamic training of face recognition based on imagenotions developed by IIS together with FZI </li></ul></ul><ul><ul><li>Combination of services, e.g. higher score of face if person is nearby, automatic mapping of names recognized in text recognition with newly detected faces </li></ul></ul>ImageNotion: IMAGINATION :
  6. 6. The new ImageNotion version (2) <ul><li>ImageNotion methodology (short overview) </li></ul><ul><ul><li>Extension with named relations, e.g. „has gender“, „works as“ </li></ul></ul><ul><ul><li>Implemented own reasoning functions with named relations (e.g. isImageNotionAPerson true, if has relations is-a person or has-gender male / female) </li></ul></ul><ul><ul><li>Import of ontologies, Export of ontologies to OWL </li></ul></ul><ul><ul><li>Merging of imagenotions describing the same semantic element </li></ul></ul><ul><li>Backend </li></ul><ul><ul><li>Creation of service based architecture to make complete application more flexible and extensible </li></ul></ul><ul><li>Frontend </li></ul><ul><ul><li>Integration of feedback from evaluations, now it is even more „desktop application“ </li></ul></ul>ImageNotion: IMAGINATION :
  7. 7. ImageNotion webpage ImageNotion: IMAGINATION :
  8. 8. ImageNotion webpage <ul><li>References </li></ul><ul><ul><li> as main page of the ImageNotion company </li></ul></ul><ul><ul><li>References shows customizable ImageNotion installation, currently </li></ul></ul><ul><ul><ul><li>Photo12: photo agency </li></ul></ul></ul><ul><ul><ul><li>Deniz Saylan: German photographer </li></ul></ul></ul><ul><ul><ul><li>BSMC: library </li></ul></ul></ul><ul><li>Try ImageNotion </li></ul><ul><ul><li>Public installation, everyone may upload images </li></ul></ul><ul><ul><li>Initial images delivered by photo12 (cinema) </li></ul></ul><ul><ul><li>Version will be used for second online evaluation in April </li></ul></ul><ul><li>Publications </li></ul><ul><ul><li>Shows the (in the meantime) big list of publications </li></ul></ul><ul><ul><li>Gabor and I am proud about the publication of two journal paper publications and also indepently from us a four page article published by the ix magazine </li></ul></ul>ImageNotion: IMAGINATION :
  9. 9. ImageNotion beta ImageNotion: IMAGINATION :
  10. 10. ImageNotion beta <ul><li>Customizable… </li></ul><ul><li>Demo (images from photo12) </li></ul>ImageNotion: IMAGINATION :
  11. 11. Thank you! <ul><li>Do you have questions </li></ul><ul><li>Please visit </li></ul>ImageNotion: IMAGINATION :