ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond

Ralf Klamma , Marc Spaniol Mathias Lux RWTH Aachen University University of Klagenfurt http://www.multimedia-metadata.info I-Media 2007 Graz, September 7, 2007 ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Flickr.com ,[object Object],[object Object],Tags: gardenia, green Very dífferent results

Caliph & Emir ,[object Object],[object Object],Visualization of low-level features Not very similar

Web 2.0 Image Mining: ImageSemantics ,[object Object]

Problem Definition (Image Mining) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Multimedia semantics as rule-based system }

Requirements ,[object Object],[object Object],[object Object],[object Object]

State-of-the-Art ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Rule Component Data Management Maschine Learning OWL Representation XML Database Reasoner Testing

MPEG-7 Feature Descriptors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Rule Extraction Algorithm Clustering for low-level features Training data Sub rule extraction for low-level features Clustering for tags in the low-level cluster Sub rule extraction for tags Complete rule extraction

OWL Rule Representation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],0 100

OWL Representation of Rules ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],centroid Low-level Cluster max. Distance min. Distance

OWL Representation of Rules ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Lowlevel_A_TagContent_Cluster

Representation of Rules in First Order Logic ,[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusions & Outlook ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond

Recommended

Recommended

More Related Content

Similar to ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond

Similar to ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond (20)

More from Ralf Klamma

More from Ralf Klamma (20)

Recently uploaded

Recently uploaded (20)

ImageSemantics : User-Generated Metadata, Content-Based Retrieval & Beyond

Editor's Notes