The document summarizes an interactive video search and browsing system called Orione. It uses an ontology created from a lexicon and WordNet to provide automatic video annotations using visual features. The system has a web-based interface for simple or advanced searches and browsing video archives by concepts. It also allows manual annotations. The multitouch interface lets users browse the ontology to select concepts and search/organize results with gestures. Usability tests were conducted on the system.

1. Interactive Video Search and Browsing Systems
Marco Bertini, Alberto Del Bimbo, Andrea Ferracani, Daniele Pezzatini
Universit` degli Studi di Firenze - MICC
a
The search engine
The Orione search engine has different query modalities and visualizations, resulting in an advanced tool for
retrieval and exploration of video archives.
It uses an ontology created semi-automatically from a flat lexicon, using WordNet to create concept relations.
Automatic video annotations are provided by a system based on the bag-of-words approach, that exploits SIFT,
SURF and MSER visual features and the Pyramid Match Kernel.
The web-based user interface
• Simple or advanced search interface to
build composite queries that may include
Boolean and temporal operators, metadata and
geo tag.
• Integrated tool that allows to browse video
archives navigating through the relations
between the concepts of the ontology.
• Manual annotation tool to provide
free-text, ontology-based and geographical
annotations that can be used for correcting and
integrating automatic annotations.
The multitouch user interface
• Users can browse the ontology structure
in order to select concepts and start the video
retrieval process.
• Users can inspect the results returned by
the search engine and organize them according
to their specific purposes by performing simple
gestures.
• The user interface adopts some visualization
principles derived from the discipline of
interaction design and is equipped with a set
of interaction functionalities to improve the
usability of the system.
Usability test
http://www.micc.unifi.it/ This work was partially supported by the EU IST IM3I project (contract FP7-222267). http://www.im3i.eu