Recommended
More Related Content
Similar to It's a dynamic world! Ubiquitous streams and the Linked Data Web
Similar to It's a dynamic world! Ubiquitous streams and the Linked Data Web (20)
Recently uploaded
Recently uploaded (20)
It's a dynamic world! Ubiquitous streams and the Linked Data Web
- 8. Over 200 open data sets with more than 25 billion facts, interlinked by 400 million typed links, doubling every 10 month! http://lod-cloud.net/ Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. Media Government Geo Publications User-generated Life sciences Cross-domain US government UK government BBC New York Times LinkedGeoData BestBuy Overstock.com Facebook
- 22. • • • • • •
- 23. • • • •
- 27. • • • • •
- 31. •DUL: DOLCE+DnS Ultralite •EventF: Event-Model F •SSN: SSN-XG •CC: Contextualised-Cognitive Concepts on sensor network topology and devices Concepts on sensor role, events, sensor project Event Datasets Sensor Datasets LOD Cloud
- 32. coalesenses
- 33. • •
- 38. •
- 42. :dublinAirport :aHumidity :aTemperature :weatherStation :latestWeather :readings :humidValue:tempValue “18”^xsd:float “Celcius” “60”^xsd:float “%” ssn:featureOfInterest ssn:observedBy ssn:observes ssn:observes ssn:isPropertyOf ssn:isPropertyOf ssm:observedPropery ssm:observedPropery ssm:value ssm:value ssm:unitssm:unit ssn:hasValue ssn:hasValue ssn:observationResult Sensor metadata Stream data snapshot at 2011-07-08T21:32:52
- 44. • • • • •
- 45. Query rewriter Orchestrator Data transformation SPARQL-like Optimizer Operator implementations Access methods Executor Query Execution Overhead
- 46. Physical Operators Physical Access (data structures) Logical Query Plan “SPARQL” Query Optimal Plan based on operator impl. cost > max_cost re-optimize Optimizer Operator implementations Native Access methods Executor Query Execution RDF dataset Linked datastream ∑ ƒ(x) nested loop or hash joins aggregation, sliding windows B+Tree hash table triple-based indices
- 52. EC2 nodes 2 4 8 16 32 Binary join 2897 4420 9638 11696 23881 Match(100k) 2011 6003 17899 31996 43117 Match(10k) 48143 81000 98132 163111 339978 5-way join 16978 19982 21997 40193 60197 Aggregation 52381 76132 125314 149978 220165
- 55. Rate:100 inputs/sec Rate : 1000 inputs/sec CQELS C-SPARQL JTALIS CQELS C-SPARQL JTALIS Q1 68 604 68 68 662 68 Q2 68 124 68 68 123 68 Q3 533 1065 533 533 1605 533 Q4 11984 125910 1442 11945 127026 4462 Q10 28021 205986 28021 209916 209916 28021
- 63. • • • •
- 72. Linked Data Continuous Query Engine (CQUELS) Stream ASP Engine (oClingo) Data Streams Stream ASP Logic Program Facts from query results Answer Sets
- 78. Líon-2