SlideShare a Scribd company logo
Politecnico di Milano, DEIB
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Marco Balduini, Riccardo Tommasini, Emanuele Della Valle
A Cheaper, Faster yet more Accurate 

Streaming Linked Data Framework
1
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
RSP is Great!
2
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Why RSP?
3
- offers a generic overview over streams and static data
- enables query answering across heterogeneous sources
- consents to create/publish new streams or graphs
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
The RSP Idea
4
in short
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
CQL Model
5
Streams
Relations
Streams-to-Relations
Relations-to-Streams
Relationsto-Relations
The CQL continuous query language 

- Arvind Arasu · Shivnath Babu · Jennifer Widom, 2006, VLDBJ
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
RSP-QL Model
6
RDF Streams Solution
Mappings
S2R operators
R2S operators
R2R operators
The CQL continuous query language 

- E. Della Valle, S. Ceri, D. Barbieri, D. Braga, A. Campi, 2008, FIS
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
RSP in a Nutshell
7
RDF Stream-to-RDF
RDF-to-RDF (solution mappings)
RDF-to-RDF Stream
on RDF Streams
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
RSP in Practice
8
With SLD
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
An Social Media Example
9
How many micro-posts do occur over time?
How often does a hashtag appears in the micro-post
stream?
Two Information Needs
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Streaming Linked Data Server
Sources
Raw Stream
10
Adapter RDF Stream Bus Publisher
Visualizer
Recorder Re-player Analiser Decorator
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
11
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
An Important
Optimisation
REGISTER STREAM sstr AS
CONSTRUCT {
?id sma:twitterCount ?tc }
FROM STREAM <social> [RANGE 1m STEP 1m]
WHERE {
SELECT (uuid() AS ?id) ?tc
WHERE {
SELECT
(COUNT (DISTINCT ?mp) AS ?tc)
WHERE {
?mp a sma:Tweet } } }
12
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
13
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
14
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Using
C-SPARQL
REGISTER STREAM countT AS
CONSTRUCT {
?uid sma:twitterCount ?tot .}
FROM STREAM <sstr> [RANGE 15m
STEP 1m]
WHERE {
SELECT
(uuid() AS ?uid)
(SUM(?tc) AS ?tot)
WHERE {
?id sma:twitterCount ?tc }}
15
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Is RSP always great?
16
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Observations
17
It is flexible. :)
It forces RDF when query results are often relational :(
It is not optimal, i.e. RSP-QL vs SQL vs Path Queries
on SLD
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Revolutionising SLD
18
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
A “Lazy” Processing Model
19
Stream operators can be applied on generic data items.
QL-specific operators requires a particular data type.
Postpone the data transformation as late as possible.
on streams
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Generic Programming
20
Generic programming is a style of computer
programming in which algorithms are written in terms of
types to-be-specified-later that are then instantiated
when needed for specific types provided as parameters.
an old idea
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
A new Processing Model
21
Generic

Streams<T>
Generic

Instantaneous<T>
S2I<T>
I2S<T>
I2I<T>
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Lazy Transformation by Generic Programming
22
stream-to-instantaneous<T>
instantaneous-to-instantaneous<T>
instantaneous-to-stream<T>
on streams<T>
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
RSP in Practice
23
with SLD Revolution
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Sources
Stream
Sink
Streaming Linked Data Revolution Server
24
Receiver Generic Stream Bus Translator
Stream
Recorder Re-player Processor Decorator
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
25
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
SLD vs SLD Revolution
26
Let’s be quantitative
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
It is faster, cheaper yet more accurate than SLD.
27
R²	=	0,96413R²	=	0,99891
30
300
3000
1 10 100
Median	Engine	Memory	(MB)
Median	CPU	Load	(%)	
SLD
SLD	Revolution
Expon.		(SLD)
Linear		(SLD	Revolution)
ESWC
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Discussion & Conclusion
28
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Observations
29
It is faster, cheaper yet more accurate than SLD. :)
It requires to know EPL, SPARQL, JSON path queries. :(
It is optimised and, thus, not flexible. :(
on SLD Revolution
EyE
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
ESWC
Open Problems
30
RSP-QL is not always the best solution in terms of cost/performance
Can we identify an optimum?
Can we define a cost model for RSP-QL ?
Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano
Questions?
Email: riccardo.tommasini@polimi.it

Twitter: @rictomm
31
Email: marco.balduini@polimi.it

Twitter: @ balducci85
Pablo Picasso, Les Demoiselles d'Avignon, 1907. 

Museum of Modern Art (MoMA), New York City, NY, US

More Related Content

Similar to SLD Revolution: A Cheaper, Faster yet more Accurate Streaming Linked Data Framework

Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
Roy Derks
 
Open-sourcing JavaScript at the City of Amsterdam
Open-sourcing JavaScript at the City of AmsterdamOpen-sourcing JavaScript at the City of Amsterdam
Open-sourcing JavaScript at the City of Amsterdam
All Things Open
 
Stream Reasoning: a summary of ten years of research and a vision for the nex...
Stream Reasoning: a summary of ten years of research and a vision for the nex...Stream Reasoning: a summary of ten years of research and a vision for the nex...
Stream Reasoning: a summary of ten years of research and a vision for the nex...
Emanuele Della Valle
 
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
OW2
 
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
recsysfr
 
HPC in the cloud comes of age - Red Oak HPC Seminar
HPC in the cloud comes of age - Red Oak HPC SeminarHPC in the cloud comes of age - Red Oak HPC Seminar
HPC in the cloud comes of age - Red Oak HPC Seminar
Martin Hamilton
 
FORMAT Final Conference - brief
FORMAT Final Conference - briefFORMAT Final Conference - brief
FORMAT Final Conference - brief
FORMAT Project
 
From AirBox to Smart City: where are we and what's next?
From AirBox to Smart City: where are we and what's next?From AirBox to Smart City: where are we and what's next?
From AirBox to Smart City: where are we and what's next?
Ling-Jyh Chen
 
Smart cities thinking outside the box
Smart cities thinking outside the boxSmart cities thinking outside the box
Smart cities thinking outside the box
MassTLC
 
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
Comsof
 
Data Integration in a Big Data Context
Data Integration in a Big Data ContextData Integration in a Big Data Context
Data Integration in a Big Data Context
Alasdair Gray
 
From programming languages to network protocols: lessons on API design
From programming languages to network protocols: lessons on API designFrom programming languages to network protocols: lessons on API design
From programming languages to network protocols: lessons on API design
flpvsk
 
Apache Storm Tutorial
Apache Storm TutorialApache Storm Tutorial
Apache Storm Tutorial
Davide Mazza
 
Stream Reasoning: Where we got so far. Oxford 2010.1.18
Stream Reasoning: Where we got so far. Oxford 2010.1.18Stream Reasoning: Where we got so far. Oxford 2010.1.18
Stream Reasoning: Where we got so far. Oxford 2010.1.18Emanuele Della Valle
 
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day BerlinReal Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
Guido Schmutz
 
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
SAP Ariba
 
Bristlecone Innovation by Sweeni Ponoth VP & GM, Bristlecone Labs
Bristlecone Innovation by Sweeni Ponoth  VP & GM, Bristlecone LabsBristlecone Innovation by Sweeni Ponoth  VP & GM, Bristlecone Labs
Bristlecone Innovation by Sweeni Ponoth VP & GM, Bristlecone Labs
Bristlecone SCC
 
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
Rasmus Petersen
 
Personal Research Overview presented at the KU-NAIST Research Meeting
Personal Research Overview presented at the KU-NAIST Research MeetingPersonal Research Overview presented at the KU-NAIST Research Meeting
Personal Research Overview presented at the KU-NAIST Research Meeting
Chawanat Nakasan
 

Similar to SLD Revolution: A Cheaper, Faster yet more Accurate Streaming Linked Data Framework (20)

Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
Open-sourcing JavaScript at the City of Amsterdam - All Things Open 2019
 
Open-sourcing JavaScript at the City of Amsterdam
Open-sourcing JavaScript at the City of AmsterdamOpen-sourcing JavaScript at the City of Amsterdam
Open-sourcing JavaScript at the City of Amsterdam
 
Stream Reasoning: a summary of ten years of research and a vision for the nex...
Stream Reasoning: a summary of ten years of research and a vision for the nex...Stream Reasoning: a summary of ten years of research and a vision for the nex...
Stream Reasoning: a summary of ten years of research and a vision for the nex...
 
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
From TRL to MRL: Assessing Open Source Project Market Readiness, Cédric Thoma...
 
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
 
HPC in the cloud comes of age - Red Oak HPC Seminar
HPC in the cloud comes of age - Red Oak HPC SeminarHPC in the cloud comes of age - Red Oak HPC Seminar
HPC in the cloud comes of age - Red Oak HPC Seminar
 
FORMAT Final Conference - brief
FORMAT Final Conference - briefFORMAT Final Conference - brief
FORMAT Final Conference - brief
 
From AirBox to Smart City: where are we and what's next?
From AirBox to Smart City: where are we and what's next?From AirBox to Smart City: where are we and what's next?
From AirBox to Smart City: where are we and what's next?
 
Smart cities thinking outside the box
Smart cities thinking outside the boxSmart cities thinking outside the box
Smart cities thinking outside the box
 
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
 
Data Integration in a Big Data Context
Data Integration in a Big Data ContextData Integration in a Big Data Context
Data Integration in a Big Data Context
 
From programming languages to network protocols: lessons on API design
From programming languages to network protocols: lessons on API designFrom programming languages to network protocols: lessons on API design
From programming languages to network protocols: lessons on API design
 
Apache Storm Tutorial
Apache Storm TutorialApache Storm Tutorial
Apache Storm Tutorial
 
Stream Reasoning: Where we got so far. Oxford 2010.1.18
Stream Reasoning: Where we got so far. Oxford 2010.1.18Stream Reasoning: Where we got so far. Oxford 2010.1.18
Stream Reasoning: Where we got so far. Oxford 2010.1.18
 
IPLOCA_NEWS_63w
IPLOCA_NEWS_63wIPLOCA_NEWS_63w
IPLOCA_NEWS_63w
 
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day BerlinReal Time Analytics with Apache Cassandra - Cassandra Day Berlin
Real Time Analytics with Apache Cassandra - Cassandra Day Berlin
 
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
ThyssenKrupp's Procurement Transformation: Minimizing Direct Materials Contra...
 
Bristlecone Innovation by Sweeni Ponoth VP & GM, Bristlecone Labs
Bristlecone Innovation by Sweeni Ponoth  VP & GM, Bristlecone LabsBristlecone Innovation by Sweeni Ponoth  VP & GM, Bristlecone Labs
Bristlecone Innovation by Sweeni Ponoth VP & GM, Bristlecone Labs
 
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
Project management strategies at Netcompany 2 (ITU guest lecture 31-03-2017)
 
Personal Research Overview presented at the KU-NAIST Research Meeting
Personal Research Overview presented at the KU-NAIST Research MeetingPersonal Research Overview presented at the KU-NAIST Research Meeting
Personal Research Overview presented at the KU-NAIST Research Meeting
 

Recently uploaded

Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 

Recently uploaded (20)

Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 

SLD Revolution: A Cheaper, Faster yet more Accurate Streaming Linked Data Framework

  • 1. Politecnico di Milano, DEIB Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Marco Balduini, Riccardo Tommasini, Emanuele Della Valle A Cheaper, Faster yet more Accurate 
 Streaming Linked Data Framework 1
  • 2. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano RSP is Great! 2
  • 3. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Why RSP? 3 - offers a generic overview over streams and static data - enables query answering across heterogeneous sources - consents to create/publish new streams or graphs
  • 4. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano The RSP Idea 4 in short
  • 5. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC CQL Model 5 Streams Relations Streams-to-Relations Relations-to-Streams Relationsto-Relations The CQL continuous query language 
 - Arvind Arasu · Shivnath Babu · Jennifer Widom, 2006, VLDBJ
  • 6. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC RSP-QL Model 6 RDF Streams Solution Mappings S2R operators R2S operators R2R operators The CQL continuous query language 
 - E. Della Valle, S. Ceri, D. Barbieri, D. Braga, A. Campi, 2008, FIS
  • 7. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC RSP in a Nutshell 7 RDF Stream-to-RDF RDF-to-RDF (solution mappings) RDF-to-RDF Stream on RDF Streams
  • 8. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano RSP in Practice 8 With SLD
  • 9. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC An Social Media Example 9 How many micro-posts do occur over time? How often does a hashtag appears in the micro-post stream? Two Information Needs
  • 10. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Streaming Linked Data Server Sources Raw Stream 10 Adapter RDF Stream Bus Publisher Visualizer Recorder Re-player Analiser Decorator
  • 11. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC 11
  • 12. Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano An Important Optimisation REGISTER STREAM sstr AS CONSTRUCT { ?id sma:twitterCount ?tc } FROM STREAM <social> [RANGE 1m STEP 1m] WHERE { SELECT (uuid() AS ?id) ?tc WHERE { SELECT (COUNT (DISTINCT ?mp) AS ?tc) WHERE { ?mp a sma:Tweet } } } 12
  • 13. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC 13
  • 14. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC 14
  • 15. Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Using C-SPARQL REGISTER STREAM countT AS CONSTRUCT { ?uid sma:twitterCount ?tot .} FROM STREAM <sstr> [RANGE 15m STEP 1m] WHERE { SELECT (uuid() AS ?uid) (SUM(?tc) AS ?tot) WHERE { ?id sma:twitterCount ?tc }} 15
  • 16. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Is RSP always great? 16
  • 17. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Observations 17 It is flexible. :) It forces RDF when query results are often relational :( It is not optimal, i.e. RSP-QL vs SQL vs Path Queries on SLD
  • 18. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Revolutionising SLD 18
  • 19. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC A “Lazy” Processing Model 19 Stream operators can be applied on generic data items. QL-specific operators requires a particular data type. Postpone the data transformation as late as possible. on streams
  • 20. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Generic Programming 20 Generic programming is a style of computer programming in which algorithms are written in terms of types to-be-specified-later that are then instantiated when needed for specific types provided as parameters. an old idea
  • 21. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC A new Processing Model 21 Generic
 Streams<T> Generic
 Instantaneous<T> S2I<T> I2S<T> I2I<T>
  • 22. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Lazy Transformation by Generic Programming 22 stream-to-instantaneous<T> instantaneous-to-instantaneous<T> instantaneous-to-stream<T> on streams<T>
  • 23. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano RSP in Practice 23 with SLD Revolution
  • 24. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Sources Stream Sink Streaming Linked Data Revolution Server 24 Receiver Generic Stream Bus Translator Stream Recorder Re-player Processor Decorator
  • 25. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC 25
  • 26. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano SLD vs SLD Revolution 26 Let’s be quantitative
  • 27. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC It is faster, cheaper yet more accurate than SLD. 27 R² = 0,96413R² = 0,99891 30 300 3000 1 10 100 Median Engine Memory (MB) Median CPU Load (%) SLD SLD Revolution Expon. (SLD) Linear (SLD Revolution)
  • 28. ESWC Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Discussion & Conclusion 28
  • 29. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Observations 29 It is faster, cheaper yet more accurate than SLD. :) It requires to know EPL, SPARQL, JSON path queries. :( It is optimised and, thus, not flexible. :( on SLD Revolution
  • 30. EyE Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano ESWC Open Problems 30 RSP-QL is not always the best solution in terms of cost/performance Can we identify an optimum? Can we define a cost model for RSP-QL ?
  • 31. Portoroz - 2017 - Riccardo Tommasini - @rictomm - Politecnico di Milano Questions? Email: riccardo.tommasini@polimi.it
 Twitter: @rictomm 31 Email: marco.balduini@polimi.it
 Twitter: @ balducci85 Pablo Picasso, Les Demoiselles d'Avignon, 1907. 
 Museum of Modern Art (MoMA), New York City, NY, US