sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub

sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub Alexandre Passant (1) and Pablo Mendes (2) (1) DERI, NUI Galway (2) Kno.e.sis, WSU, Dayton OH SFSW2010 @ ESWC2010 31 st of May 2010, Heraklion, Crete

Motivation
Real-time Semantic Web
LOD wrappers for Social Data
Sensor data and Semantics
Ubiquitous computing and the Semantic Web
What’s new in a RDF store ? From “Pull” to “Push”
From regularly querying the store to identify and retrieve new data
To having RDF store notifying interested parties that new content is available, in real-time
of XYZ

Motivation
Use-case
Select user-generated content mentioning companies that compete with mine
of XYZ

sparqlPuSH
sparqlPuSH
Combining SPARQL, SPARQL Update and PubSubHubbub for proactive notifications of changes in RDF stores
An interface that can be plugged on the top of any RDF store - http://code.google.com/p/sparqlpush/
Based on existing standards
SPARQL and SPARQL Update to register feeds and launch actions when content of the RDF store changes
Atom and RSS to get feeds of related changes
PubSubHubbub for broadcasting changes (beneficing from public hubs such as Google’s one)
of XYZ

sparqlPuSH
An approach in two steps
Query registration
Change notification
Both are independent of the RDF store implementation
Registration can be done remotely, simply sending an HTTP request to a sparqlPuSH interface
Notification is triggered as soon as new data in loaded in the store, using SPARQL Update through sparqlPuSH
Clients should be compliant with the PuSH protocol and be able to interpret the rel=“hub” link in the feed header
of XYZ

Query registration of XYZ

Registering new user-generated content of XYZ

Registering changes about resource X of XYZ

Conventions in query registration
Using conventions to get a well-formatted Atom / RSS feed
Easier to read in standard news aggregators
Mandatory elements
?uri - their URI of the element(s) to be retrieved;
?date - their creation / modification date;
Optional elements
?label - their label
?author - their author
of XYZ

Browsing available feeds
sprqlPuSH interface lists available feeds
Including timestamp of last update
Plus ability to create feeds from the interface
of XYZ

Notification of XYZ

Notification
SPARQL Update support
Data is pushed to sparqlPuSH (HTTP POST) and relayed to the underlying RDF store
Identification of relevant changes
Applying all registered queries to the updated dataset
Changes broadcast
Using PubSubHubbub for real-time and scalable notification
of XYZ

Implementation
Source code (PHP)
http://code.google.com/p/sparqlpush/ (BSD license)
Server
Connection to any SPARQL endpoint
Additional connector for ARC2 using the ARC2 API
Generating RSS or Atom feeds
Demo client
Registering / unregistering queries to remote sparqlPuSH interfaces
Receiving updates from registered feeds
of XYZ

Demo
Live demo @ SFSW2010
http://vimeo.com/11023983
Introduction to sparqlPuSH
http://vimeo.com/12166777
Advanced querying including DBpedia data
of XYZ

Future Work
Registering queries over stream data
E.g. C-SPARQL
Combination with other approaches for real-time semantic data management
E.g. dady, Semantic pingback, etc.
Implementation
Implemented as a default feature of RDF stores ?
TWARQL
http://wiki.knoesis.org/index.php/Twarql
Check upcoming WI paper “Linked Open Social Signals”
of XYZ

Thank you !
Source code
http://code.google.com/p/sparqlpush/ (BSD license)
Videos
http://vimeo.com/11023983 (introduction)
http://vimeo.com/12166777 (advanced querying)
Contacts
[email_address] / @terraces
[email_address] / @pablomendes
of XYZ

http://apassant.net	118
http://www.slideshare.net	74
http://blog.apassant.net	26
http://planetrdf.com	14
http://www.tumblr.com	2
http://static.slidesharecdn.com	1
http://feeds.feedburner.com	1
http://translate.googleusercontent.com	1
http://apassant.tumblr.com	1

sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub

by Alexandre Passant on May 31, 2010

Accessibility

Categories

Upload Details

Usage Rights

9 Embeds 238

Statistics

sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub Presentation Transcript