Where Big Data meets Linked Data:
Applying standarddata models to
environmental data streams
Adam Leadbetter, Damian Smyth, Robert Fuller, Eoin O’Grady
Marine Institute, Ireland
Adam Shepherd
Woods Hole Oceanographic Institution, US
adam.leadbetter@marine.ie
http://whatis.techtarget.com/definition/3Vs
HTTP://XKCD.COM/927/
https://s-media-cache-ak0.pinimg.com/564x/e7/c2/6b/e7c26b7963b2628d10fe649008b02d23.jpg
https://upload.wikimedia.org/wikipedia/commons/thumb/9/9d/Sir_Tim_Berners-Lee.jpg/640px-Sir_Tim_Berners-Lee.jpg/
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
http://iode.org/index.php?option=com_oe&task=viewDocumentRecord&docID=875
http://smartbay.marine.ie
http://github.com/IrishMarineInstitute/uwobs
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
%{NUMBER:pressure:float}
%{SPACE}
%{NUMBER:temperature:float}
%{SPACE}
%{NUMBER:conductivity:float}
%{SPACE}
%{NUMBER:salinity:float}
%{SPACE}
%{NUMBER:sound_velocity:float}
%{SPACE}%{TIME:raw_time}
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
%{NUMBER:pressure:float}
%{SPACE}
%{NUMBER:temperature:float}
%{SPACE}
%{NUMBER:conductivity:float}
%{SPACE}
%{NUMBER:salinity:float}
%{SPACE}
%{NUMBER:sound_velocity:float}
%{SPACE}%{TIME:raw_time}
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
property
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
Feature property
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
Feature property
procedure
{
"id":"foo",
"phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"},
"featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"},
"member":[{
"id":"#temperature",
"type":"Measurement",
"result": {
"value":16.118,
"uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/"
},
"observedProperty": {
"href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/"
},
"procedure":{
"href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/"
},
"resultTime":"2016-08-18T11:42:59.782Z“
}]}
{
"@context": "http://example.org/om-context",
"id":"foo",
"phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"},
"featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"},
"member":[{
"id":"#temperature",
"type":"Measurement",
"result": {
"value":16.118,
"uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/"
},
"observedProperty": {
"href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/"
},
"procedure":{
"href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/"
},
"resultTime":"2016-08-18T11:42:59.782Z“
}]}
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
“There are emergent technologies throughout the
fields around oceanography which we will
incorporate into oceanography, and through
that convergence we will make oceanography
into something even more magical”
John Delaney
Adam Leadbetter
adam.leadbetter@marine.ie
@AdamLeadbetter

Where Linked Data meets Big Data: Applying standard data models to environmental data streams

  • 1.
    Where Big Datameets Linked Data: Applying standarddata models to environmental data streams Adam Leadbetter, Damian Smyth, Robert Fuller, Eoin O’Grady Marine Institute, Ireland Adam Shepherd Woods Hole Oceanographic Institution, US adam.leadbetter@marine.ie
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
    @prefix mi-feature: <http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 7.
    @prefix mi-feature: <http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 8.
    @prefix mi-feature: <http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 9.
    @prefix mi-feature: <http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 12.
  • 16.
  • 17.
  • 18.
  • 19.
    2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.83737.002 29.784 1500.4781 00:15:13.86M %{NUMBER:pressure:float} %{SPACE} %{NUMBER:temperature:float} %{SPACE} %{NUMBER:conductivity:float} %{SPACE} %{NUMBER:salinity:float} %{SPACE} %{NUMBER:sound_velocity:float} %{SPACE}%{TIME:raw_time}
  • 20.
    2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.83737.002 29.784 1500.4781 00:15:13.86M %{NUMBER:pressure:float} %{SPACE} %{NUMBER:temperature:float} %{SPACE} %{NUMBER:conductivity:float} %{SPACE} %{NUMBER:salinity:float} %{SPACE} %{NUMBER:sound_velocity:float} %{SPACE}%{TIME:raw_time}
  • 21.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure
  • 22.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation
  • 23.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result
  • 24.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result property
  • 25.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result Feature property
  • 26.
    An observation isan action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result Feature property procedure
  • 27.
  • 28.
    { "@context": "http://example.org/om-context", "id":"foo", "phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"}, "featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"}, "member":[{ "id":"#temperature", "type":"Measurement", "result":{ "value":16.118, "uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/" }, "observedProperty": { "href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/" }, "procedure":{ "href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/" }, "resultTime":"2016-08-18T11:42:59.782Z“ }]}
  • 29.
    @prefix mi-feature: <http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 35.
    “There are emergenttechnologies throughout the fields around oceanography which we will incorporate into oceanography, and through that convergence we will make oceanography into something even more magical” John Delaney
  • 36.