Talis Platform: A Linked Data Engine
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Talis Platform: A Linked Data Engine

on

  • 2,986 views

Talk given at SemTech 2010 conference

Talk given at SemTech 2010 conference

Statistics

Views

Total Views
2,986
Views on SlideShare
2,985
Embed Views
1

Actions

Likes
4
Downloads
31
Comments
0

1 Embed 1

http://www.slideshare.net 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Multiple users Zero install SaaS model: instant access to features We worry about the data management, but leave you in control All new (versions) Talis applications now built on same Platform, e.g. Engage. So can not only build new apps on the service, can also access data underlying existing services
  • i.e. similar to Amazon S3. Can upload and store any kinds of data. May be web site assets, e.g. images, CSS, javascript, etc. May be other documents or collateral.
  • i.e. similar to Amazon S3. Can upload and store any kinds of data. May be web site assets, e.g. images, CSS, javascript, etc. May be other documents or collateral.
  • Main set of features are around the structured data storage. Management of RDF metadata. Resource Description Framework More later but basically a means to capture in a highly structured and flexible way, metadata about anything.
  • As you remain in control of your data, you obviously want to control who has access to it. By default on the platform we allow public read access, but this can be changed. Each store can has its own set of access control options, i.e. which platform users can access which features. There are a useful set of defaults, i.e. public read, admin to add, update or modify configuration
  • Roy Fielding’s thesis, responsible for many of the Internet RFCs. Describes a formal basis for the web architecture. Growing agreement that following these architectural principles is the best way to build internet-scale applications, whether that means web sites or web APIs. Anything else means you’re working against the web architecture meaning that you’re using a sub-optimal solution. This is why the Talis Platform follows these principles rather than using, say, SOAP or some other web services APIs. REST, essentially, involves using HTTP correctly. About understanding and using the HTTP protocol to its fullest extent, because in doing so you allow web browsers, proxy servers, search engines, etc to all interact with you application correctly and in a way that has massive scalability.
  • And al of this is made available through a standards compliant framework. With essentially one exception (which I’ll point out later) everything that we’ll look at is based on open internet standards. The technologies like HTTP, RDF, SPARQL, all of the data formats we generate are open standards. This is part of the Talis ethos. We don’t believe in proprietary software. We use and create a lot of open source software ourselves and believe this is the only viable way for internet services to develop.
  • As well as following the REST architectural guidelines, within the Platform team we have our own set of best practices that apply to the design of new services. The service checklist is online as part of the API documentation, but includes things like ensuring we have a consistent url structure, that there’s a human interface to every API, to make it easy to play with the system. That error messages are human-readable, etc
  • E.g. public data, but also private authentication data.
  • E.g. public data, but also private authentication data.
  • E.g. public data, but also private authentication data.
  • Want to review some basic concepts and technologies that underpin the design and implementation of the Platform. How many people already understand the terms REST, Content Negotation, RDF.
  • E.g. public data, but also private authentication data.

Talis Platform: A Linked Data Engine Presentation Transcript

  • 1. The Talis Platform A Linked Data Engine Leigh Dodds Platform Programme Manager SemTech June 2010 http://creativecommons.org/licenses/by/2.0/uk/
  • 2. Agenda
    • Platform Overview
    • Managing RDF in the Platform
    • Data Extraction Features
    • Current & Recent Projects
  • 3.  
  • 4. Platform Overview
  • 5. Multi-Tenant Data Storage Service Software as a Service
  • 6. Self-contained data stores with services that operate on their contents Platform Stores
  • 7. Store any binary content Unstructured Data Storage
  • 8. RDF triple store Structured Data Storage
  • 9. Stores are world-readable by default Configurable access options HTTP Digest Authentication Access Control
  • 10. Trigger or schedule store management jobs Reset, Snapshot, Restore, Reindex (Future feature: Bulk Load) Job Control
  • 11. Generic services that operate on any kind of data Aim for design consistency via service checklist RESTful APIs
  • 12. RDF, SPARQL, HTTP Where there are no standards we create open specifications Standards Compliance
  • 13. Branded Linked Data Hosting Domain hosting Surfacing of platform services
  • 14. The Meta Box Managing structured metadata
  • 15. Create, read, update, delete RDF resources Web-accessible RDF triplestore
  • 16. Public/Private application data Separate access control options Future Feature: API for managing graphs Partition data into sub-graphs
  • 17. Support RDF/XML, Turtle, N-Triples Store data with HTTP POST
  • 18. Vocabulary and protocol for describing changes to RDF triple stores Updates using Changesets
  • 19. Maintain audit trail of changes to Metabox Support for Versioned Updates
  • 20. Combine several changesets into single request Applied atomically Batch Update Mechanism
  • 21. Searching SPARQL Augmentation Data Extraction Features
  • 22. Full-text index over RDF literals in the Metabox Configurable indexing options Every Store has a Search Index
  • 23. Paging, Sorting, Relevance Ranking Flexible query syntax (fielded and boolean searches) Standard Search Engine features
  • 24. /items?query=[query] &max=[10] &offset=[0] &sort=[comma-separated fieldnames] &xsl=[XSLT stylesheet] &content-type=[mimetype for XSLT results]
  • 25. Includes Open Search extensions: paging, relevance ranking Includes full description of each RDF resource Search Results are RSS 1.0
  • 26. Group search results by specific fields Simple XML response format Facetted Search
  • 27. /services/facet ?query=[query] &fields=[comma-separated fieldnames] &top=[10] &format=[xml|html]
  • 28. Automatic data annotation Pipe an RSS 1.0 feed through a Store and enrich it with available data Augmentation
  • 29. RSS 1.0 RSS 1.0 Augmenter MetaBox
  • 30. /services/augment ?data-uri=[url-of-RSS-feed] &xsl=[XSLT stylesheet] &content-type=[mimetype for XSLT results]
  • 31. Standards compliant SPARQL 1.0 service Early access to draft SPARQL 1.1 features SPARQL Query API
  • 32. /services/sparql ?query=[query] &output=[syntax (xml, rdf, json)]
  • 33. Current Projects Quick tour of current & recent projects
  • 34. Crawling and hosting Linked Data from bbc.co.uk Public SPARQL Endpoint BBC
  • 35. Community annotation of Linked Data using Twitter Based on BBC Linked Data fanhu.bz
  • 36. Linked Data from UK Government Domain hosting Public SPARQL and Search APIs data.gov.uk
  • 37. Explore UK research project funding http://bis.clients.talis.com BIS Research Explorer
  • 38. Linked Data UK Geography and Gazetteer Domain hosting Public SPARQL and Search APIs Ordnance Survey
  • 39. Linked Data from EU Government and UK cultural heritage UK & EU Research Projects
  • 40. Free use of the Platform for Public Domain data http://www.talis.com/cc Talis Connected Commons
  • 41. Help explore potential of Linked Data Developer workshops, training, data conversions Your Organisation?
  • 42. Summing Up Summary, Additional Resources
  • 43. The Talis Platform provides…
    • Cloud based data storage
    • Simple API for managing data
    • Flexible data extraction features
    • Linked Data publishing platform
  • 44. Additional Resources
    • API Reference
    • http://n2.talis.com/wiki/Platform_API
    • Mailing List
    • http://groups.google.com/group/n2-dev
    • Blog
    • http://blogs.talis.com/n2/
    • Support Desk
    • http://talisplatform.zendesk.com
  • 45.  
  • 46.