A Platform for Object-Action Semantic Web Interaction Roberto García, Juan Manuel Gimeno, Ferran Perdrix*, Rosa Gil, Marta Oliva HCI and Data Integration Research Group Universitat de Lleida, Spain *Segre Media, Spain

Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

Introduction

The Rhizomer Platform

Use Case: S5T Project

Conclusions & Future Work

Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

Introduction

The Rhizomer Platform

Use Case: S5T Project

Conclusions & Future Work

Introduction The Semantic Web is here... ...but difficult take off in the “real world” Problem : “it is complicated to use it” [1] Even for researchers/advanced users [2] No just browsing, also edition ( Wiki -like) [1] Shadbolt, Hall, Berners-Lee. The Semantic Web Revisited . Intelligent Systems 21(3), 2006 [2] Heath, Domingue, Shabajee. User interaction and uptake challenges to successfully deploying Semantic Web technologies . 3rd Semantic Web User Interaction Workshop, 2006 Rhizomer Semantic Content Management System

The Semantic Web is here...

...but difficult take off in the “real world”

Problem : “it is complicated to use it” [1]

Even for researchers/advanced users [2]

No just browsing, also edition ( Wiki -like)

[1] Shadbolt, Hall, Berners-Lee. The Semantic Web Revisited . Intelligent Systems 21(3), 2006

[2] Heath, Domingue, Shabajee. User interaction and uptake challenges to successfully deploying Semantic Web technologies . 3rd Semantic Web User Interaction Workshop, 2006

Introducción Human-Computer Interaction  ↑ Usability User tasks analysis: Web: reduced set and clearly defined Web 2.0, 3.0: wider set, still to define Action-Object Paradigm Hierarchical actions menus Select action (e.g. “Open”) and the object (e.g. “File”) Reduced usability in heterogeneous object domains Rhizomer Semantic Content Management System

Human-Computer Interaction  ↑ Usability

User tasks analysis:

Web: reduced set and clearly defined

Web 2.0, 3.0: wider set, still to define

Action-Object Paradigm

Hierarchical actions menus

Select action (e.g. “Open”) and the object (e.g. “File”)

Reduced usability in heterogeneous object domains

Introduction Semantic Web Facilitates data integration Heterogeneous objects Look for a more appropriate interaction paradigm… Object-Action Paradigm Appropriate for heterogeneous domains Select object, then from available object actions Cognitively, easier to organise/identify objects Semantic Web : Ontologies organise objects, restrict available actions Rhizomer Semantic Content Management System

Semantic Web

Facilitates data integration

Heterogeneous objects

Look for a more appropriate interaction paradigm…

Object-Action Paradigm

Appropriate for heterogeneous domains

Select object, then from available object actions

Cognitively, easier to organise/identify objects

Semantic Web :

Ontologies organise objects, restrict available actions

Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

Introduction

The Rhizomer Platform

Use Case: S5T Project

Conclusions & Future Work

Rhizomer Platform for Semantic Content Management and Human-Semantic Web Interaction Based on Web 2.0 technologies Client (AJAX) / Server (REST) Web 3.0 data model Semantic metadata store: RDF(OWL) / SPARQL Generic metadata browsing HTML + Javascript Object-Action Interaction Paradigm Semantic Web Services Rhizomer Semantic Content Management System

Platform for Semantic Content Management and Human-Semantic Web Interaction

Based on Web 2.0 technologies

Client (AJAX) / Server (REST)

Web 3.0 data model

Semantic metadata store: RDF(OWL) / SPARQL

Generic metadata browsing

HTML + Javascript

Object-Action Interaction Paradigm

Semantic Web Services

Rhizomer Server part: REST interface over repository Jena, Sesame,… GET : SPARQL end-point PUT/POST/DELETE : RDF metadata management Semantic Web Services OWL-S descriptions Service Profile: Process, hasInput, hasOutput REST adapters for Javascript APIs (e.g. Google Maps), SOAP,… Rhizomer Semantic Content Management System Metadata Store Rhizomer GET PUT POST DEL search new edit delete

Server part:

REST interface over repository

Jena, Sesame,…

GET : SPARQL end-point

PUT/POST/DELETE : RDF metadata management

Semantic Web Services

OWL-S descriptions

Service Profile: Process, hasInput, hasOutput

REST adapters for

Javascript APIs (e.g. Google Maps), SOAP,…

Rhizomer Client part: AJAX (asynchronously send queries and metadata) RDF/XML ─ XSLT  HTML (browsing) “ Semantic” forms (edition) RDF/XML ─ XSLT  FORM ─ Javascript  RDF Rhizomer Semantic Content Management System RDF <HTML/> <HTML/> SemFORMS JavaScript

Client part:

AJAX (asynchronously send queries and metadata)

RDF/XML ─ XSLT  HTML (browsing)

“ Semantic” forms (edition)

RDF/XML ─ XSLT  FORM ─ Javascript  RDF

Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

Introduction

The Rhizomer Platform

Use Case: S5T Project

Conclusions & Future Work

S5T Project S5T Spanish research project ( TIN2005-06885 ) Scaleable Semantic personalised Search of Spoken and written contents on the Semantic Web Application in the Segre media group Newspaper, TV, radio and web site Internal use (media house): facilitate content production, history tracking, contextualisation,… External use (web users): advanced services (e.g. news personalisation, semantic podcasts,…) Rhizomer Semantic Content Management System

S5T Spanish research project ( TIN2005-06885 )

Scaleable Semantic personalised Search of Spoken and written contents on the Semantic Web

Application in the Segre media group

Newspaper, TV, radio and web site

Internal use (media house): facilitate content production, history tracking, contextualisation,…

External use (web users): advanced services (e.g. news personalisation, semantic podcasts,…)

S5T Project Semantic annotation of audiovisual content voice  text (keywords)  semantic annotations Rhizomer : user interface for browsing/interacting with content and associated knowledge Rhizomer Semantic Content Management System

Semantic annotation of audiovisual content

voice  text (keywords)  semantic annotations

Rhizomer : user interface for browsing/interacting with content and associated knowledge

S5T Project: query Rhizomer Semantic Content Management System Queries: Metadata Content (transcript) Words Concepts GET s5t:Audio specific properties P rdfs:domain s5t:Audio or s5t:Audio owl:Restriction on P (or superclass) ?query= DESCRIBE ?s WHERE { ?s dc:title ?y0; s5t:genre ?y1. FILTER regex(?y0, &quot;…&quot;) && ?y1=<…./SubjectsOnto# 11000000> } <form method=“GET” onSumbit=“formToSPARQL”> <input type=“text” name= “ http://purl.org/dc/elements/1.1/title”/> <input type=“text” name= “ http://purl.org/dc/elements/1.1/date”/> … </form>

Queries:

Metadata

Content (transcript)

Words

Concepts

S5T Project: store GET  SPARQL endpoint Metadata store Jena, Sesame,… DESCRIBE queries by default. Facilitate: Browse heterogeneous metadata Without a priori knowledge DESCRIBE implementation Concise Bounded Description + rdfs:labels for all selected resources Result: RDF/XML Rhizomer Semantic Content Management System

GET  SPARQL endpoint

Metadata store

Jena, Sesame,…

DESCRIBE queries by default. Facilitate:

Browse heterogeneous metadata

Without a priori knowledge

DESCRIBE implementation

Concise Bounded Description + rdfs:labels for all selected resources

Result: RDF/XML

S5T Project: store DESCRIBE http://rhizomik.net/~rosa : CBD( … ~rosa ) = Fragment A U rdfs:labels Rhizomer Semantic Content Management System Fragment A

DESCRIBE http://rhizomik.net/~rosa : CBD( … ~rosa ) = Fragment A U rdfs:labels

S5T Project: browse Rhizomer Semantic Content Management System RDF2HTML GET  RDF2HTML <s5t:Audio rdf:about=&quot; http://www.segre.com/audio/20070323-bm.mp3 &quot;> <dc:title>Butlletí Migdia</dc:title> <dc:date>2007-03-23</dc:date> <s5t:genre rdf:resource=&quot;&srs;11000000&quot;/> <s5t:transcriptResource> http://www.segre.com/audio/20070323-bm.xml </s5t:transcriptResource> </srt:Audio> http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio title Butlletí Migdia date 2007-03-23 genre politics transcript http://www.segre.com/audio/20070323-bm.xml Referrers http://rhizomik.net/.../NewsCodes-SubjectsOnto#11000000 a Subject label politics description Local, regional, national and international exercise of power, or struggle for power, and the relationships between governing bodies and states. Referrers

S5T Project: edition Rhizomer Semantic Content Management System edit – del – new http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio title Butlletí Migdia date 2007-03-23 genre politics transcript http://www.segre.com/audio/20070323-bm.xml Referrers

S5T Project: edition Semantic form: <form method=“ PUT/POST ” onSumbit=“formToNTriples”> <input type=“text” name=“ http:// ...w3.org/.../rdf-syntax-ns# ID ” value=“ http://www.segre.com/audio/20070323-bm.mp3 ”/> <input type=“text” name=“http:// ...w3.org/.../rdf-syntax-ns# type ” value=“ http:// rhizomik.net/.../s5t.owl# Audio ” /> <input type=“text” name=“http:// rhizomik.net/.../s5t.owl# genre ”/ value=“ http://.../NewsCodes-SubjectsOnto#11000000 ”/ > … </form> PUT : description for new resource POST : replace resource description Rhizomer Semantic Content Management System <Subject,… Predicate,Object> Predicate,Object>

Semantic form:

<form method=“ PUT/POST ” onSumbit=“formToNTriples”> <input type=“text” name=“ http:// ...w3.org/.../rdf-syntax-ns# ID ” value=“ http://www.segre.com/audio/20070323-bm.mp3 ”/>

<input type=“text” name=“http:// ...w3.org/.../rdf-syntax-ns# type ” value=“ http:// rhizomik.net/.../s5t.owl# Audio ” />

<input type=“text” name=“http:// rhizomik.net/.../s5t.owl# genre ”/ value=“ http://.../NewsCodes-SubjectsOnto#11000000 ”/ > …

</form>

PUT : description for new resource

POST : replace resource description

S5T Project: uploading Semantically annotate uploaded content (facilitate metadata creation) Content-type specific metadata extraction plugins Audio: text -to-speech Text: keyword detection, disambiguation OpenCalais, Freeling,…: named entities Photo: EXIFtoRDF,… … Rhizomer Semantic Content Management System

Semantically annotate uploaded content (facilitate metadata creation)

Content-type specific metadata extraction plugins

Audio: text -to-speech

Text: keyword detection, disambiguation

OpenCalais, Freeling,…: named entities

Photo: EXIFtoRDF,…

…

S5T Project: interaction Given a resource (object)… determine available services (actions) Resource description: type, properties, values,… Rhizomer Semantic Content Management System http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio title Butlletí Migdia date 2007-03-23 genre politics transcript http://www.segre.com/audio/20070323-bm.xml Referrers

Given a resource (object)… determine available services (actions)

Resource description: type, properties, values,…

S5T Project: interaction Services descriptions: ID : Service Adapter URL hasInput : an OWL Class Service applicable to any resource classified in this class hasOutput : output content type text/html, application/rdf+xml,… Rhizomer Semantic Content Management System http://rhizomik.net/services/play a Process label Play hasInput http://rhizomik.net/.../s5t.owl#Audio hasOutput text/html Referrers

Services descriptions:

ID : Service Adapter URL

hasInput : an OWL Class

Service applicable to any resource classified in this class

hasOutput : output content type

text/html, application/rdf+xml,…

S5T Project: interaction For each resource: Processes s.t. resource rdf:type hasInput Class Call : REST PUT/POST RDF resource Adapter: service invocation (Javascript, SOAP,…) Rhizomer Semantic Content Management System http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio title Butlletí Migdia date 2007-03-23 genre politics transcript http://www.segre.com/audio/20070323-bm.xml Play Referrers

For each resource:

Processes s.t. resource rdf:type hasInput Class

Call : REST PUT/POST RDF resource

Adapter: service invocation (Javascript, SOAP,…)

S5T Project: interaction Rhizomer Semantic Content Management System Butlletí Migdia (23/03/2007) La mobilització en contra dels transgènics i en favor de Josep Pàmies també ha servit per introduir altres reclamacions. En aquest cas, alguns dels col·lectius de la lluita contra aquests cultius demanen que la Universitat de Lleida rebi una especialització en Agricultura Ecològica . Asseguren que serien uns estudis pioners que servirien al centre per recuperar prestigi. Search Keyword Browse Term Search Keyword : describe resources whose transcript contains keyword… Browse Term : describe the concept annotating the keyword http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio title Butlletí Migdia date 2007-03-23 genre politics transcript http://www.segre.com/audio/20070323-bm.xml Play Referrers http://www.udl.cat a University label Universitat de Lleida lat 41.37 long 0.37 Map Referrers

S5T Project: interaction Map any resource with lat/long: <process:Process rdf:about=&quot; http://rhizomik.net/services/map &quot;> <rdfs:label> map </rdfs:label> <process:hasInput> <owl:Class rdf:ID=&quot; GeolocatedEntity &quot;> <owl:intersectionOf rdf:parseType=&quot;Collection&quot;> <owl: Restriction > <owl: onProperty rdf:resource=&quot;&pos; lat &quot;/> <owl: minCardinality > 1 </owl:minCardinality> </owl:Restriction> <owl: Restriction > <owl: onProperty rdf:resource=&quot;&pos; long &quot;/> <owl: minCardinality > 1 </owl:minCardinality> </owl:Restriction> </owl:intersectionOf> </owl:Class> </process:hasInput> <process:hasOutput>text/html</process:hasOutput> </process:Process> Service Adapter includes GoogleMap Javascript The same for events (Timeline, Calendar,…), etc. Rhizomer Semantic Content Management System

Map any resource with lat/long:

<process:Process rdf:about=&quot; http://rhizomik.net/services/map &quot;> <rdfs:label> map </rdfs:label> <process:hasInput> <owl:Class rdf:ID=&quot; GeolocatedEntity &quot;> <owl:intersectionOf rdf:parseType=&quot;Collection&quot;> <owl: Restriction > <owl: onProperty rdf:resource=&quot;&pos; lat &quot;/> <owl: minCardinality > 1 </owl:minCardinality> </owl:Restriction> <owl: Restriction > <owl: onProperty rdf:resource=&quot;&pos; long &quot;/> <owl: minCardinality > 1 </owl:minCardinality> </owl:Restriction> </owl:intersectionOf> </owl:Class> </process:hasInput> <process:hasOutput>text/html</process:hasOutput> </process:Process>

Service Adapter includes GoogleMap Javascript

The same for events (Timeline, Calendar,…), etc.

Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

Introduction

The Rhizomer Platform

Use Case: S5T Project

Conclusions & Future Work

Conclusions Content Management System based on semantic metadata Framework for Human-Semantic Web Interaction Flexible Projects: S5T, Rhizomik,… Extensible Plugins for visualisation, interaction and metadata extraction Usable Preliminary usability tests Rhizomer Semantic Content Management System

Content Management System based on semantic metadata

Framework for Human-Semantic Web Interaction

Flexible

Projects: S5T, Rhizomik,…

Extensible

Plugins for visualisation, interaction and metadata extraction

Usable

Preliminary usability tests

Future Work Assisted metadata edition Properties and values recommended based on available ontologies Create basic services set Map Time line Calendar Plot… Complete usability test Rhizomer Semantic Content Management System

Assisted metadata edition

Properties and values recommended based on available ontologies

Create basic services set

Map

Time line

Calendar

Plot…

Complete usability test

Thank you for your attention More: http:// rhizomik.net Roberto García http://rhizomik.net/~roberto