Icme2011 industrial poster

453 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
453
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Icme2011 industrial poster

  1. 1. A web system for ontology-based multimedia annotation, browsing and search M. Bertini, G. Becchi, A. Del Bimbo, A. Ferracani, D. Pezzatini University of Florence - MICC System architecture The system provides a service-oriented architecture Interface layer Authoring layer (SOA) that allows for multiple viewpoints of multimedia data Corporate CMS Authoring environment inside repositories, providing better ways to reuse, repurpose End-user interfaces and share rich media. SOA Architecture layer The analysis layer is responsible for extracting low level System repository features and semantic annotations from media files, System SOA through a series of processing pipelines that can be executed File storage in a cloud of servers, orchestrated by apposite services. Annotation of visual content is performed using the Video/Image analysis pipeline Bag-of-Visual-Words paradigm, based on a fusion of MSER, Local SOA architecture SURF and SIFT features and the Pyramid Matching Kernel. Database Analysis Audio analysis pipeline Audio annotation is based on a fusion of features like ZCR, Semantic search / browse Syntactic search / browse user-defined MFCCs, chroma and spectral features and SVM classifiers. Media storage pipeline CBIR retrieval is performed using rhythm and pitch features Analysis layer for audio and MPEG-7 features for visual data. Semantinc annotation, browsing and search tools All the web applications of the system have been developed according to the RIA paradigm. In particular the applications of the Interface and Authoring layers are developed in AJAX and Flash/Flex, while data is exchanged using SOAP, RSS and JSON for metadata and RTMP for video streaming. Interfaces allow to perform manual annotation (to check automatic annotations, add metadata or create ground truth annotations to train new automatic concept detectors), browse , search (semantic and content based) and tagging. Usability evaluationThe goal of the field trials was to assess the usability of the system, in particular letting the users to interact withthe search engine and its interfaces, to pose semantic and syntactic-level queries, but also to annotate, automaticallyand manually, some videos.http://www.micc.unifi.it/ This work was partially supported by the EU IST IM3I project (contract FP7-222267). http://www.im3i.eu

×