sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub
Upcoming SlideShare
Loading in...5
×
 

sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub

on

  • 4,197 views

Presentation @ SFSW2010 (ESWC2010 Workshop). Paper available at semanticscripting.org/SFSW2010/papers/sfsw2010_submission_6.pdf + video at ...

Presentation @ SFSW2010 (ESWC2010 Workshop). Paper available at semanticscripting.org/SFSW2010/papers/sfsw2010_submission_6.pdf + video at http://apassant.net/blog/2010/04/18/sparql-pubsubhubbub-sparqlpush#comments

Statistics

Views

Total Views
4,197
Views on SlideShare
3,922
Embed Views
275

Actions

Likes
5
Downloads
36
Comments
0

11 Embeds 275

http://apassant.net 118
http://www.slideshare.net 74
http://assets.txmblr.com 28
http://blog.apassant.net 26
http://planetrdf.com 14
http://apassant.tumblr.com 9
http://www.tumblr.com 2
http://translate.googleusercontent.com 1
http://feeds.feedburner.com 1
http://static.slidesharecdn.com 1
https://www.linkedin.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub Presentation Transcript

  • sparqlPuSH: Proactive notification of data updates in RDF stores using PubSubHubbub Alexandre Passant (1) and Pablo Mendes (2) (1) DERI, NUI Galway (2) Kno.e.sis, WSU, Dayton OH SFSW2010 @ ESWC2010 31 st of May 2010, Heraklion, Crete
  • Motivation
    • Real-time Semantic Web
      • LOD wrappers for Social Data
      • Sensor data and Semantics
      • Ubiquitous computing and the Semantic Web
    • What’s new in a RDF store ? From “Pull” to “Push”
      • From regularly querying the store to identify and retrieve new data
      • To having RDF store notifying interested parties that new content is available, in real-time
    of XYZ
  • Motivation
    • Use-case
      • Select user-generated content mentioning companies that compete with mine
    of XYZ
  • sparqlPuSH
    • sparqlPuSH
      • Combining SPARQL, SPARQL Update and PubSubHubbub for proactive notifications of changes in RDF stores
      • An interface that can be plugged on the top of any RDF store - http://code.google.com/p/sparqlpush/
    • Based on existing standards
      • SPARQL and SPARQL Update to register feeds and launch actions when content of the RDF store changes
      • Atom and RSS to get feeds of related changes
      • PubSubHubbub for broadcasting changes (beneficing from public hubs such as Google’s one)
    of XYZ
  • sparqlPuSH
    • An approach in two steps
      • Query registration
      • Change notification
    • Both are independent of the RDF store implementation
      • Registration can be done remotely, simply sending an HTTP request to a sparqlPuSH interface
      • Notification is triggered as soon as new data in loaded in the store, using SPARQL Update through sparqlPuSH
      • Clients should be compliant with the PuSH protocol and be able to interpret the rel=“hub” link in the feed header
    of XYZ
  • Query registration of XYZ
  • Query registration of XYZ
  • Registering new user-generated content of XYZ
  • Registering changes about resource X of XYZ
  • Conventions in query registration
    • Using conventions to get a well-formatted Atom / RSS feed
      • Easier to read in standard news aggregators
    • Mandatory elements
      • ?uri - their URI of the element(s) to be retrieved;
      • ?date - their creation / modification date;
    • Optional elements
      • ?label - their label
      • ?author - their author
    of XYZ
  • Browsing available feeds
    • sprqlPuSH interface lists available feeds
      • Including timestamp of last update
      • Plus ability to create feeds from the interface
    of XYZ
  • Notification of XYZ
  • Notification
    • SPARQL Update support
      • Data is pushed to sparqlPuSH (HTTP POST) and relayed to the underlying RDF store
    • Identification of relevant changes
      • Applying all registered queries to the updated dataset
    • Changes broadcast
      • Using PubSubHubbub for real-time and scalable notification
    of XYZ
  • Implementation
    • Source code (PHP)
      • http://code.google.com/p/sparqlpush/ (BSD license)
    • Server
      • Connection to any SPARQL endpoint
      • Additional connector for ARC2 using the ARC2 API
      • Generating RSS or Atom feeds
    • Demo client
      • Registering / unregistering queries to remote sparqlPuSH interfaces
      • Receiving updates from registered feeds
    of XYZ
  • Demo
    • Live demo @ SFSW2010
    • http://vimeo.com/11023983
      • Introduction to sparqlPuSH
    • http://vimeo.com/12166777
      • Advanced querying including DBpedia data
    of XYZ
  • Future Work
    • Registering queries over stream data
      • E.g. C-SPARQL
    • Combination with other approaches for real-time semantic data management
      • E.g. dady, Semantic pingback, etc.
    • Implementation
      • Implemented as a default feature of RDF stores ?
    • TWARQL
      • http://wiki.knoesis.org/index.php/Twarql
      • Check upcoming WI paper “Linked Open Social Signals”
    of XYZ
  • Thank you !
    • Source code
      • http://code.google.com/p/sparqlpush/ (BSD license)
    • Videos
      • http://vimeo.com/11023983 (introduction)
      • http://vimeo.com/12166777 (advanced querying)
    • Contacts
      • [email_address] / @terraces
      • [email_address] / @pablomendes
    of XYZ