Sparql querying of-property-graphs-harsh thakkar-graph day 2017 sf

SPARQL querying of Graph Databases
using Gremlin: Gremlinator
Harsh Thakkar
University of Bonn
Graph Day 2017 - San Francisco - USA - June 17

2Graph Day 2017 - San Francisco - USA - June 17 Gremlinator - Harsh Thakkar - University of Bonn
WDAqua ITN - http://wdaqua.eu/
● Answering Questions using Web Data (WDAqua) is a EU H2020 -
Marie Skłodowska Curie Actions - Innovative Training
Networks (ITN)
● 15 PhD students across Europe
● Advancing SotA in data-driven Question Answering
● Reusable and extensible components for QA

Outline
● #Motivation 1 - LITMUS Benchmark Suite
● #Motivation 2 - RDF graphs vs. Property graphs
● Gremlinator

Outline
● Gremlinator

RDF-3X
Ocean of Data
Sea of Tools+
K-V stores
Graph stores
Doc-oriented
stores
RDF stores
Wide column
stores
Real
Synthetic
http://lod-cloud.net/versions/2017-02-20/lod.pn
g
LOD Cloud 2017
Motivation #1 - Benchmarking
2

http://mattturck.com/big-data-landscape-2016-v18-final/

Contd…
• Domain specific
applications:
i.e. perspectives
https://steemit.com/philosophy/@l0k1/subjectivity-and-truth-how-blockchains-model-consensus-building

Benchmark… Manually?
Phewww.. that’s Tedious!
Fairness?
Standardization?Reusability?
Extensibility?

LITMUS Benchmark Suite
https://kerniebemp.files.wordpress.com/2013/03/rubegoldberg.jpg

Dataset 1 Dataset 2 Dataset 3 Dataset N
Data integration module
Benchmarking Core
Controller & Tester
System configuration & integration
module
Queryset 1
Queryset 3
Queryset M
Analyzer
RDF stores Graph
stores
Relational
DBs
Wide Column
stores
Profiler
Queryset 2
Key value
stores
Queryconversion
module
Query Facet (F2)
Data Facet (F1)
System Facet (F3)
User Interface
(F4)
User
The LITMUS architecture
Thakkar, Harsh. "Towards an Open Extensible Framework for
Empirical Benchmarking of Data Management Solutions: LITMUS."
European Semantic Web Conference. Springer,, 2017.

Challenges
• Core challenges in developing such an
open, extensible FAIR framework?
• Data Representation
• Query Conversion
• Key Performance Indicators (KPIs)
http://media.thinkadvisor.com/lifehealthpro/article/2015/02/24/challenge.jp
g

Query Translation
• Yes we are linguistically
diverse and so are DMSs!
• That too with different
dialects:
• SPARQL, CYPHER, Gremlin,
etc
• Many many Graph-based
DMSs!
• Is there one GQL to cover
all Graph DMSs*?
http://cdn2.wpbeginner.com/wp-content/uploads/2015/02/multilingual-wordpress.jpg

Gremlin
http://www.datastax.com/wp-content/uploads/2015/09/many-to-many-mapping.png
http://www.datastax.com/wp-content/uploads/2015/09/gtm-dataflow.png
Gremlin’s Multi-Graph Query Language (GQL) support

Contd…
Multi-DMS & platform support
https://tinkerpop.apache.org/images/oltp-and-olap.png
# Motivation 1

https://opinionessoftheworld.files.wordpress.com/2013/04/game-of-thrones-daenerys-dragon.j
pg
Gremlinator
Me

Outline
● WDAqua ITN
● Gremlinator

Do I need a Graph
Database? If so, what
kind? (Juan Sequeda)
Earlier today

Motivation #2 - Graph Data Models
● Graphs are intuitive formalisms
● Represent complex natural and man-made networks (Genes, SNs)
● Data is increasingly connected (highly)
● Relationships within the data are an integral it
● Index-free, schema-free
● Mathematical foundation
● RDF and Property Graph two most popular graph data models

RDF Data Model
● RDF = Resource Description Framework
● W3C Recommendation for data modeling and encoding machine readable
content on the Web
● Data Model:
○ encodes structured information
○ universal, machine-readable interchange format (Serializations - .nt, .xml, .ttl, etc)
○ data is structured in the form of graphs (RDF graphs)

RDF Data Model
● RDF is a triple based graph model, where :
○ Subject: URI, Blank node
○ Predicate: URIs -> property
○ Object: URI, Literal, Blank node
“2017”
“Harsh”
ex:Eventex:Person
ex:SF
“27” ex:age
ex:name
ex:Bonn
“Graph Day”
ex:year
ex:name
ex:place
ex:Speaker
ex:place
URI = Universal Resource identifier, analogous
to ISBN for books
Literals = data values
Blank nodes = Desc. of entities that don’t need
to be named.
IRIs*
ex:stim
e
“40”
@prefix ex: <http://example.org>
ex:Person ex:Speaker ex:Event
ex:Person ex:name “Harsh”
ex:Person ex:place ex:Bonn
ex:Person ex:age “27”
ex:Event ex:name “Graph Day”
ex:Event ex:Year “2017”
interpretation
representation

RDF Graphs (RDFGs)
● Edge-labelled, directed, multi-graphs (w. Ent. URIs, Blank nodes, Literals)
● Going from information to Knowledge using OWL (DLs) and Ontologies
(RDFS, RDFa, etc)
● Bulky
○ Everything is a node-edge-node (edges dont have properties)
○ More relationships per node -> More total number of triples!

Example - Modern Graph feat. RDFG

SPARQL - The RDF Query Language
● SPARQL Protocol And RDF Query Language
● Graph Pattern Matching (GPM) QL for RDF graphs (declarative)
● Defacto QL of RDF stores, W3C standard since Jan 2008.
● High importance in semantic web - querying knowledge graphs - QA
○ SPARQL : Semantic Web (web in general) what SQL : Rel.DBs
● Main components:
○ Graph patterns (WHERE) [BGPs {s p o .}, GGPs {...}, CGPs{ops}]
○ Prefixes - encode URIs
○ Query result from range of variables (SELECT)
More info: 1,2,

Ex:SPARQL query
PREFIX a: <http://abc.com/prty>
SELECT DISTINCT ?x
WHERE { ?x a:Created ?y .}
?x
<http://abc.com/node/4>
Output
BGP
Matching patterns

Property Graph Data Model
● Edge-labelled, directed, attributed, multi-graph
● Vertices and edges both have properties
● Main components:
○ Vertices, edges (Src,Dsc), properties (key-value pairs), labels (strings)
● Super neat (compact), super cute
● Easier to add weighted, reified edges
● Query Languages - CYPHER, Gremlin, PGQL, etc
Name: Graph Day
Year: 2017
Place: SF, USA
Name: Harsh
Age: 27
From: Bonn, DE
Role: speaker
Time: 40
Person Event

Example - PG viz
RDF
PG

Gremlin - a PG Query Language
● A Graph Traversal Language and Machine (like Java - JVM)
● Offers both declarative (GPM) and imperative (traversal)
constructs
● Supports both OLTP: Graph DBs and OLAP: Graph processors
● Popular for querying Property graphs.
More InfoRef. Slides #13, #14

Ex:Gremlin query
1. g.V().in(“Created”).dedup()
//imperative
2. g.V().match(
__.as(‘x’).out(‘Created’).as(‘y’
)).select(‘x’).dedup()
// declarative - GPM
PREFIX a: <http://abc.com/prty>
SELECT DISTINCT ?x
WHERE { ?x a:Created ?y .}
==>x:v[4]
==>x:v[2]
==>x:v[5]
Output SPARQL

SPARQL vs. Gremlin Queries
● Linear, standard, graph
pattern queries (exact
match)
● Less joins - less complexity -
better performance
● Benefit from macro indices
○ SPO, POS, etc
● Multi-hop, neighbourhood,
star/snowflake, traversal
queries (fuzzy match)
● Everything is a path - better
performance
● Benefit from micro-indices
Motivation #2 - So why not benefit from Gremlin for complex/
multi-hop/ path queries?

SPARQL vs. Gremlin Queries
● Lacks looping and branching
and Graph analytical queries
(OLAP)
● Supports federated querying
● Supports looping, branching
and Graph Analytical queries
(OLAP)
● No federated querying
Motivation #2 - So why not benefit from Gremlin for complex/
multi-hop/ path queries?

Ex:Star-shape query
PREFIX bsbm: <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/vocabulary/>
PREFIX bsbm-inst: <http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/>
SELECT ?label ?comment ?p ?f ?productFeature ?producer ?propertyText1
?propertyText2 ?propertyText3 ?propertyNum1 ?propertyNum1
WHERE {
bsbm-inst:Product343 rdfs:comment ?comment .
bsbm-inst:Product343 bsbm:producer ?p .
?p rdfs:label ?producer .
bsbm-inst:Product343 dc:publisher ?p .
bsbm-inst:Product343 bsbm:productFeature ?f .
?f rdfs:label ?productFeature .
bsbm-inst:Product343 bsbm:productPropertyTextual1 ?propertyText1 .
bsbm-inst:Product343 bsbm:productPropertyNumeric1 ?propertyNum1 .
bsbm-inst:Product343 bsbm:productPropertyNumeric2 ?propertyNum2 . }
g.V().match(__.as('a').has("productID",343).as('b').valueMap().as('c')).select('c')
0.0247 sec
0.0013 sec

Outline
● WDAqua ITN
● Gremlinator

SPARQL ➞ Gremlin analogy
● Query based on Graph
pattern [declarative]
● Provides GPM construct via
.match() steps [declarative]
Name: SPARQL-Gremlin 0.1
Lang: Java
Name: Daniel
Kupitz
….
Implements
Person Software
Name: Harsh Thakker
….
Extends
Year: 2015 Year: 2016
Person
Inception Result

Contd…
SPARQL and Gremlin language constructs and corresponding operators

Gremlinator architecture

BGP (q) ➞ SST* ( )
Subject Predicate Object Operation
URI URI [rdfs:label] “literal” Lv
/Le
⇒ .hasLabel(“x”)
URI URI “literal” Pv
/Pe
⇒ .has(P, ”val”)
URI URI URI E ⇒ .in(“x”)/.out(“x”)
Traversals ⇒ Property value, Label value, vertex
Name: Graph Day
Year: 2017
Place: SF, USA
Name: Harsh
Age: 27
From: Bonn, DE
Role: speaker
Time: 40
Person Event
* Rodriguez, Marko A., and Peter Neubauer.
"The graph traversal pattern." arXiv preprint
arXiv:1004.1001 (2010).

CGP (Q) ➞ Traversal ( )
Mapping corresponding Gremlin operators

Ex:1 Tinker Modern Graph
Select only those persons who are younger or equal
than 30 and created a soft. collectively.
SELECT ?a ?b ?c WHERE {
?a v:label "person" .
?a e:knows ?b .
?a e:created ?c .
?b e:created ?c .
?a v:age ?d .
FILTER (?d <= 30)
}

Contd…
?a e:knows ?b .
?a e:created ?c .
?b e:created ?c .
?a v:age ?d .
FILTER (?d <= 30)
}
[MatchStartStep@[a], HasStep([~label.eq(person)]), MatchEndStep]
[MatchStartStep@[a], VertexStep(OUT,[knows],vertex)@[b], MatchEndStep]
[MatchStartStep@[a], VertexStep(OUT,[created],vertex)@[c], MatchEndStep]
[MatchStartStep@[b], VertexStep(OUT,[created],vertex)@[c], MatchEndStep]
[MatchStartStep@[a], PropertiesStep([age],value)@[d], MatchEndStep]
[WhereTraversalStep([WhereStartStep(d), IsStep(leq(30))]), MatchEndStep]
s
BGPs
BGP (q) ➞ SST* ( )

[GraphStep(vertex,[]), MatchStep(AND,[
[MatchStartStep(a), HasStep([~label.eq(person)]), MatchEndStep],
[MatchStartStep(a), VertexStep(OUT,[knows],vertex), MatchEndStep(b)],
[MatchStartStep(a), VertexStep(OUT,[created],vertex), MatchEndStep(c)],
[MatchStartStep(b), VertexStep(OUT,[created],vertex), MatchEndStep(c)],
[MatchStartStep(a), PropertiesStep([age],value), MatchEndStep(d)],
[MatchStartStep(d), WhereTraversalStep([WhereStartStep, IsStep(leq(30))]), MatchEndStep] ] ),
SelectStep([a, b, c])]
?a e:knows ?b .
?a e:created ?c .
?b e:created ?c .
?a v:age ?d .
FILTER (?d <= 30)
}
Contd…
sSPARQL Query
CGP (Q) ➞ Traversal ( )

Select only those persons who are younger or equal
than 30 and created a soft. collectively.
?a e:knows ?b .
?a e:created ?c .
?b e:created ?c .
?a v:age ?d .
FILTER (?d <= 30)
}
Output
{a=v[2], b=v[4], c=v[3]}
Contd…

Experiments*
Northwind dataset
● PG - Vertices: 3209, Edges: 6177
● RDF - Triples: 33033
BSBM 1M dataset
● PG - Vertices: 92737, Edges: 238309
● RDF - Triples: 1000313
* Detailed work submitted to CIKM 2017
CPU: Intel® Xeon® CPU E5-2660 v3 (20 cores @2.60GHz),
RAM: 128 GB DDR3, HDD: 512 GB SSD, OS: Linux 4.2-generic (x86_64)
Openlink Virtuoso v7.2.4, Apache TinkerGraph-Gremlin v3.2.3

Contd…
● Queries

First Results
Comparison of executing SPARQL queries on Virtuoso and corresponding translated Gremlin pattern matching
traversals on TinkerGraph against BSBM 1M dataset (in secs, warm cache,10Qs).
13x - 17x fold faster* wrt SPARQL

Limitation
● SPARQL queries with:
○ Nested Union(s)
○ Optional(s) - v3.3 [fixed]

Next Step(s)
● Address the limitations
● Robustness (any PG)
● Deploy @Apache TinkerPop :)

Acknowledgements
Funding: Supervisors & Mentors:
Prof. Dr.
Soeren Auer
Prof. Dr. Jens
Lehmann
Prof. Dr.
Maria-Esther
Vidal
H2020 WDAqua ITN (GA: 642795)
Dr. Marko Rodriguez

48PhD Symposium - ESWC 2017 - Slovenia - Portoroz - May 29 LITMUS Benchmark Suite - Harsh Thakkar - University of Bonn
Resources
http://wdaqua.eu/
https://github.com/LITMUS-Benchmark-Suite/sparql-to-gremlin
Code: https://github.com/LITMUS-Benchmark-Suite/
Web: https://litmus-benchmark-suite.github.io
Docker: https://hub.docker.com/r/litmusbenchmarksuite/litmus/
LITMUS Benchmark Suite

THANK YOU GRAPH DAY ‘17 SF!!!
Harsh Thakkar
University of Bonn
Twitter: @harsh9t
LinkedIn: thakkarharsh
E-mail: harsh9t@gmail.com
Questions? Comments?
Insults? Injuries?

Sparql querying of-property-graphs-harsh thakkar-graph day 2017 sf

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Sparql querying of-property-graphs-harsh thakkar-graph day 2017 sf

Similar to Sparql querying of-property-graphs-harsh thakkar-graph day 2017 sf (20)

Recently uploaded

Recently uploaded (20)

Sparql querying of-property-graphs-harsh thakkar-graph day 2017 sf