Linked Data Under the Hood

2,069 views

Published on

Presented at the Talis Linked Data Open Day in San Francisco on 1st June 2011 by Richard Wallis

Published in: Technology, Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,069
On SlideShare
0
From Embeds
0
Number of Embeds
65
Actions
Shares
0
Downloads
10
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • Buzz words: SPARQL, RDF, triples, URIs, Ontologies, foaf, graph,\ndescribe, dereference, content-negotiation\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • build up the URI from an identifier and make it [globally] unique\nApollo 11?\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • Literal attributes - name, mass, creation date\nother thing attributes - web page, launch vehicle, launch site\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • thing - prop - thing\n - prop - thing\n - prop - name\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • easy to create\neasy to massage/process \n\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • BIS project:\nspreadsheet - shared understanding of attributes - merge data - link out\nCSV scripting -> ntriples - > import and [auto]merge\n
  • BIS project:\nspreadsheet - shared understanding of attributes - merge data - link out\nCSV scripting -> ntriples - > import and [auto]merge\n
  • BIS project:\nspreadsheet - shared understanding of attributes - merge data - link out\nCSV scripting -> ntriples - > import and [auto]merge\n
  • BIS project:\nspreadsheet - shared understanding of attributes - merge data - link out\nCSV scripting -> ntriples - > import and [auto]merge\n
  • BIS project:\nspreadsheet - shared understanding of attributes - merge data - link out\nCSV scripting -> ntriples - > import and [auto]merge\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Linked Data Under the Hood

    1. 1. Linked Data Under the hood Richard Wallis Talis @rjw#talisldod
    2. 2. Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    3. 3. Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    4. 4. Identifying things
    5. 5. Identifying things
    6. 6. Identifying things 1969-059A
    7. 7. Identifying things 1969-059A spacecraft/1969-059A
    8. 8. Identifying things 1969-059A spacecraft/1969-059Anasa.dataincubator.org/spacecraft/1969-059A
    9. 9. Identifying things 1969-059A spacecraft/1969-059A nasa.dataincubator.org/spacecraft/1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A
    10. 10. Identifying things with URIs 1969-059A spacecraft/1969-059A nasa.dataincubator.org/spacecraft/1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A
    11. 11. Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A
    12. 12. Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A28801.0kg
    13. 13. Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A28801.0kgColumbia
    14. 14. Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A28801.0kgColumbiaApollo 11 CSMCSM-107United StatesCape CanaveralSaturn 5
    15. 15. http://nasa.dataincubator.org/spacecraft/1969-059A
    16. 16. http://nasa.dataincubator.org/spacecraft/1969-059A .../1969-059A
    17. 17. http://nasa.dataincubator.org/spacecraft/1969-059A .../1969-059A
    18. 18. 28801.0 mass .../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A
    19. 19. Apollo 11 CSM 28801.0 name mass .../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A
    20. 20. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A
    21. 21. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A launch ../launch: 1969-059
    22. 22. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch: 1969-059
    23. 23. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch: 1969-059 site Cape Canaveral
    24. 24. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch: 1969-059 site Cape Canaveral lat N 28° 27 31
    25. 25. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch: 1969-059 site Cape Canaveral lat N 28° 27 31 long W 80° 31 59
    26. 26. Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch:<../1969-059A> mass 28801.0 . 1969-059 site<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” . Cape<../1969-059A> launch <../launch/1969-059> . Canaveral lat<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> . N 28° 27 31 long<..site/capecanaveral> lat “N 28° 27 31” .<..site/capecanaveral> long “W 80° 31 59” . W 80° 31 59
    27. 27. RDF Apollo 11 CSM Columbia name 28801.0 name mass .../1969-059A 16 July 1969http://nasa.dataincubator.org/spacecraft/1969-059A launch date ../launch:<../1969-059A> mass 28801.0 . 1969-059 site<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” . Cape<../1969-059A> launch <../launch/1969-059> . Canaveral lat<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> . N 28° 27 31 long<..site/capecanaveral> lat “N 28° 27 31” .<..site/capecanaveral> long “W 80° 31 59” . W 80° 31 59
    28. 28. RDF Triple
    29. 29. RDF TripleThing attribute value
    30. 30. RDF TripleThing property value
    31. 31. RDF TripleThing property valueThing property Thing
    32. 32. RDF Triple Thing property value Thing property Thing../person/A
    33. 33. RDF Triple Thing property value Thing property Thing../person/A hasParent
    34. 34. RDF Triple Thing property value Thing property Thing../person/A hasParent ../person/B
    35. 35. RDF Triple Thing property value Thing property Thing../person/A hasParent ../person/B../person/B
    36. 36. RDF Triple Thing property value Thing property Thing../person/A hasParent ../person/B../person/B name
    37. 37. RDF Triple Thing property value Thing property Thing../person/A hasParent ../person/B../person/B name “Eric”
    38. 38. RDF Triple Merging Thing property value Thing property Thing../person/A hasParent ../person/B ../person/B name “Eric”
    39. 39. RDF Triple Merging Thing property value Thing property Thing../person/A hasParent ../person/B name “Eric”
    40. 40. RDF Triple Merging
    41. 41. RDF Triple MergingThe same identifier in a different place is still the same thing
    42. 42. A Property is a Thing too!
    43. 43. A Property is a Thing too! name
    44. 44. A Property is a Thing too! namehttp://xmlns.com/foaf/0.1/name
    45. 45. A Property is a Thing too! namehttp://xmlns.com/foaf/0.1/name foaf:name
    46. 46. A Property is a Thing too! namehttp://xmlns.com/foaf/0.1/name foaf:name../person/B foaf:name “Eric”
    47. 47. http://www.flickr.com/photos/jwilde/3499946512
    48. 48. Opening up access to data http://www.flickr.com/photos/jwilde/3499946512
    49. 49. Opening up access to data Data API http://www.flickr.com/photos/jwilde/3499946512
    50. 50. Opening up access to data}All have APIs Data API http://www.flickr.com/photos/jwilde/3499946512
    51. 51. Opening up access to data}All have APIs All different! Data API http://www.flickr.com/photos/jwilde/3499946512
    52. 52. Opening up access to data}All have APIs All different! Data API The key to access Linked Data http://www.flickr.com/photos/jwilde/3499946512
    53. 53. Opening up access to data}All have APIs All different! Data API Web Standards The key to access Linked Data http://www.flickr.com/photos/jwilde/3499946512
    54. 54. Web Standards
    55. 55. The power of the link
    56. 56. The power of the link
    57. 57. The power of the link
    58. 58. The power of the link
    59. 59. The power of the link
    60. 60. The power of the link
    61. 61. The power of the link
    62. 62. The power of the link
    63. 63. RDF in many forms
    64. 64. RDF in many forms• RDF/XML
    65. 65. RDF in many forms• RDF/XML Machine to machine
    66. 66. RDF in many forms• RDF/XML Machine to machine• N-Triples
    67. 67. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing
    68. 68. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing• Turtle
    69. 69. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing• Turtle Human readable
    70. 70. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing• Turtle Human readable• RDFa
    71. 71. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing• Turtle Human readable• RDFa Html embedded
    72. 72. RDF in many forms• RDF/XML Machine to machine• N-Triples Processing• Turtle Human readable• RDFa Html embedded 16 July 1969 date All valid RDF ../launch:1969-059 site Cape Canaveral
    73. 73. RDF creation
    74. 74. RDF creation• Database / spreadsheet export
    75. 75. RDF creation• Database / spreadsheet export - Script/program convert
    76. 76. RDF creation• Database / spreadsheet export - Script/program convert• Pull content from sites
    77. 77. RDF creation• Database / spreadsheet export - Script/program convert• Pull content from sites - Content-negotiation to RDF/XML
    78. 78. RDF creation• Database / spreadsheet export - Script/program convert• Pull content from sites - Content-negotiation to RDF/XML• Google Refine
    79. 79. RDF creation• Database / spreadsheet export - Script/program convert• Pull content from sites - Content-negotiation to RDF/XML• Google Refine - Facet analysis
    80. 80. RDF creation• Database / spreadsheet export - Script/program convert• Pull content from sites - Content-negotiation to RDF/XML• Google Refine - Facet analysis - Reconciliation API
    81. 81. Modelling aids
    82. 82. Modelling aids• prefix.cc
    83. 83. Modelling aids• prefix.cc - namespace lookup
    84. 84. Modelling aids• prefix.cc - namespace lookup• schemapedia.com
    85. 85. Modelling aids• prefix.cc - namespace lookup• schemapedia.com - vocabulary search
    86. 86. Modelling aids• prefix.cc - namespace lookup• schemapedia.com - vocabulary search• sindice.com ckan.net LOD Diagram
    87. 87. Modelling aids• prefix.cc - namespace lookup• schemapedia.com - vocabulary search• sindice.com ckan.net LOD Diagram - identify data sets to link with
    88. 88. Modelling aids• prefix.cc - namespace lookup• schemapedia.com - vocabulary search• sindice.com ckan.net LOD Diagram - identify data sets to link with• Kasabi
    89. 89. Modelling aids• prefix.cc - namespace lookup• schemapedia.com - vocabulary search• sindice.com ckan.net LOD Diagram - identify data sets to link with• Kasabi - Linked Data Marketplace
    90. 90. The process
    91. 91. The processModel
    92. 92. The processModel Name
    93. 93. The processModel Name Describe
    94. 94. The processModel Name Describe Convert
    95. 95. The processModel Name Describe Convert Publish
    96. 96. SPARQL
    97. 97. SPARQLRDF Query Language
    98. 98. SPARQL RDF Query Language• Triple pattern matching
    99. 99. SPARQL RDF Query Language• Triple pattern matching - uses Turtle
    100. 100. SPARQL RDF Query Language• Triple pattern matching - uses Turtle• Requires a SPARQL-endpoint
    101. 101. SPARQL RDF Query Language• Triple pattern matching - uses Turtle• Requires a SPARQL-endpoint• Backed by a Triple Store
    102. 102. SPARQL RDF Query Language• Triple pattern matching - uses Turtle• Requires a SPARQL-endpoint• Backed by a Triple Store - Local hosted
    103. 103. SPARQL RDF Query Language• Triple pattern matching - uses Turtle• Requires a SPARQL-endpoint• Backed by a Triple Store - Local hosted - Hosted
    104. 104. SPARQL RDF Query Language• Triple pattern matching - uses Turtle• Requires a SPARQL-endpoint• Backed by a Triple Store - Local hosted - Hosted - Managed Service - Talis
    105. 105. Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    106. 106. Identifying Things with URIsLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    107. 107. Identifying Things with URIs• Things have attributes/propertiesLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    108. 108. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    109. 109. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - whereverLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    110. 110. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the APILinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    111. 111. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the API - Web Standards - http, RDF, ...Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    112. 112. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the API - Web Standards - http, RDF, ...• Many open data/toolsLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    113. 113. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the API - Web Standards - http, RDF, ...• Many open data/tools• Model➞Name➞Describe➞Convert➞PublishLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    114. 114. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the API - Web Standards - http, RDF, ...• Many open data/tools• Model➞Name➞Describe➞Convert➞Publish• SPARQL endpoints for queryLinked Data http://www.flickr.com/photos/ferretsunlimited/499495786
    115. 115. Identifying Things with URIs• Things have attributes/properties - Properties are Things too!• URIs Merge - wherever• Linked Data is the API - Web Standards - http, RDF, ...• Many open data/tools• Model➞Name➞Describe➞Convert➞Publish• SPARQL endpoints for query• Managed Hosting Linked Data http://www.flickr.com/photos/ferretsunlimited/499495786

    ×