Graph databases in PHP @ PHPCon Poland 10-22-2011

GraphDB in PHPAlessandro Nadalin David Funaro 1

Agenda•Theory•When to use a graph?•Why graphDB?•The graphDB community•OrientDB•OrientDB in PHP•Demo 2

Essential (Theory) 3

Essential (Theory)G=Graph 3

Essential (Theory)G = (V, VertexGraph 3

Essential (Theory)G = (V, VertexGraph A 3

Essential (Theory)G = (V, E) VertexGraph Edge A 3

Binary Relation Hates A BItchy Scratchy 4

Binary Relation Edge A BVertex Vertex 4

Graph B E FA D G 5

Undirected Graph B E A D FExample: Friendship 6

Directed Edge A BVertex Vertex 7

Directed Edge Edge A BVertex Vertex 7

Directed Graph A B A F DExample: Followee 8

Path B E FA D G 9

PathA B D G E F 10

Graph -> GraphDBGraphDB is a database that use the Graph as its primary data structure 11

... when to use a graph ?

Web in ’99 13

Web in 2005 14

The social web 15

Your data is a graph 16

a tree is a graph 17

parent_id is a graph 18

Recommendations lives inJohn type shows Mr Fun Cinema B Bean loca tion lik Rome es shows Cinema A location type Thriller Se7en s ho ws location Milan Cinema C 19

Recommendations lives inJohn type shows Mr Fun Cinema B Bean loca tion lik Rome es type shows Cinema A location ✓ x x Thriller Se7en s ho ws location Milan Cinema C 20

Recommendations lives inJohn type shows Mr Fun Cinema B Bean ✓ loca tion lik Rome es type shows Cinema A location ✓ x x Thriller Se7en s ho ws location Milan Cinema C 21

Recommendations lives inJohn type shows Mr Fun Cinema B ✓ Bean ✓ loca tion lik Rome es type shows Cinema A location ✓ x x Thriller Se7en s ho ws location Milan Cinema C 22

Recommendations lives inJohn xFun type Mr ✓ Bean shows Cinema B ✓ loca tion lik Rome es type shows Cinema A location ✓ x x Thriller Se7en s ho ws location Milan Cinema C 23

Recommendations lives inJohn x x x Fun type Mr Bean shows Cinema B loca tion lik Rome es type shows ✓ Cinema A location ✓ x x Thriller Se7en s ho ws location Milan Cinema C 24

Recommendations lives inJohn x x x Fun type Mr Bean shows Cinema B loca tion lik Rome es type shows ✓ Cinema A location ✓ ✓ shows x x Thriller Se7en location Milan Cinema C 25

Recommendations lives inJohn x x x Fun type Mr Bean shows Cinema B loca tion lik Rome es type shows ✓ Cinema A location ✓ ✓ shows x x ✓ Thriller Se7en location Milan Cinema C 26

Recommendations lives inJohn x x x Fun type Mr Bean shows Cinema B loca tion lik ✓ Rome es type shows ✓ Cinema A location ✓ ✓ shows x x ✓ Thriller Se7en location Milan Cinema C 27

Solve decision problems

Maximum flow

Given a dataset, calculate how to best organize it maximum flow

travelling salesman problem

The pizza guy needs to deliver on A, B,C.

Decision base on distance, traffic, time and so on.

Shortest path

Identify "special" nodes of the graph

Given your dataset, organize some clusters Are there some nodes which cannot belong to a cluster?They probably have some properties different from the average

Given your dataset, organize some clusters Are there some nodes which cannot belong to a cluster?They probably have some properties different from the average ACHTUNG! TERRORISTEN!

but ... why graphDB? 38

Representing a Graph in: http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching- scoring-ranking-and-recommendation# 39

Representing a Graph in: http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching- scoring-ranking-and-recommendation#✓ Relational Database (mysql, oracle)✓ Document Oriented DB (mongodb, couchdb)✓ XML Database (MarkLogic, eXist-db) 39

where is the difference ? 40

GraphDB A graph database is any storage system that provides index-free adjacency.http://www.slideshare.net/slidarko/problemsolving-using-graph-traversals-searching-scoring-ranking-and-recommendation

Step by step exampleGiven a list of people, find their homepages 42

Tree-based DB WAY 1 43

Tree-based DB WAY David Funaro put in the Search Engine 2 1 43

Tree-based DB WAY David Funaro put in the Search Engine 2 find 3 1 http://davidfunaro.com 43

Tree-based DB WAY David Funaro The cost to find Search Engine friend HP put in the a single 2grows as the friends HP tables grows find 3 1 http://davidfunaro.com 43

GraphDB WAYit’s like that the GraphDB has an additional information (the ancor <a>) 44

GraphDB WAY 1 get the embedded information(index) www.odino.orgit’s like that the GraphDB has an additional information (the ancor <a>) 44

GraphDB WAY The Anchor work as a local index to reach the document = index-free adjacency <a href=”http://odino.org”> Alessandro Nadalin </a> 45

Local costThe local cost is O(k) = Constant 46

Local costThe local cost is O(k) = Constant 47

Local cost 48

Local cost Thus, as the graph grows in size,the cost of a local step remain the same 48

any database can implicity represent a graph BUTonly a graph database make the graph structure explicit 49

BenchmarkDeph RDBMS Graph 1 100ms 30ms • 1 Million Vertex • 4 Million Edge 2 1000ms 500ms • Scale Free Tolopogy 3 10000ms 3000ms • Postgres VS Neo4J 4 100000m 50000ms s • Both Hash and BTree 5 N/A 100000m s 50 http://markorodriguez.com/2011/02/18/mysql-vs-neo4j-on-a-large-scale-graph-traversal/

community that is building and feeding the GraphDB ecosystem GraphDB community ThinkerPop Stack Databases

data model and their implementation Blueprints is a collection of interfaces, implementations,ouplementations, and test suites for the property graph data model. Blueprints is analogous to the JDBC, but for graph databases. https://github.com/tinkerpop/blueprints/wiki/

a data flow Framework using Process Graph provide a collection of "pipes" that are connected togheter to from processing pipelines

a graph-based programming language.a Turing-Complete graph-base programming language that compiles Gremlin syntax down to Pipes

a REST-full graph shell.Allow blueprints graph to be exposed through a RESTful API (HTTP)

Whats hot

OrientDB

Glossary RID <10:05>Cluster Position 58

Glossary RID <10:05>Cluster Position CLASS 58

Main features

Inheritance

class Vehicle class Carclass Bike

class Vehicle class Car class BikeSELECT FROM Vehicle WHERE owner = 1:1

class Vehicle class Car class Bikecan return records of class Bike or Car

Traversal

SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] ) 66

SELECT FROM fellas WHERE any() traverse(0,-1) ( @rid = [Michelle @rid] ) 67

SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = = [Michelle @rid] )) SELECT FROM fellas WHERE any() traverse(0,2) ( @rid [Michelle @rid]

SELECT FROM fellas WHERE any() traverse(0,2) ( @rid = [Michelle @rid] )

SQL synthax

beyond SQL

SELECT FROM authors WHERE book.title = ...

speaks JSON

{ "schema": { "name": "Address" }, "result": [{ "@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address", "type": "Residence", "street": "Piazza Navona, 1", "city": "#14:0", "nick": "Luca2" }, { ... ...

Double Protocol

HTTPUniversal

HTTPEasy to interact with

binary

binary Blazing fast

on-record SELECTs

SELECT FROM cats

SELECT FROM 11:0

SELECT FROM [11:0,11:1]

SELECT FROM [11:0,12:0]

stress-free setup

./orient/bin/server.sh 93

in-memory DB

or disk-persisted

Supports standards Supports standards 96

•Inheritance •Traversal •Sql syntax like •ACIDOrientDB •Speak JSON •Double protocol •on-record Select •ThinkerPop Compliant

Oh, its Java. 98

somebody started writing the binary-protocol bindinghttps://github.com/AntonTerekhov/OrientDB-PHP ( beta0.4.1, 28 April 2010 )

$db = new OrientDB($host, $port);$record = $db->recordLoad(1:1, *:-1);// $record instance of OrientDBRecord

and others

Orient Library... are writing a complete library https://github.com/congow/Orient 104

Orient = PHP Library to work with OrientDB 105

Data MapperQuery Builder HTTP Binding

HTTP Binding

use CongowOrient;use CongowOrientFoundationBinding;$driver = new OrientHttpClientCurl();$orient = new Binding($driver, 127.0.0.1, 2480, admin, admin, demo);$response = $orient->query("SELECT FROM Address");$output = json_decode($response->getBody());foreach ($output->result as $address){ var_dump($address->street);}

use CongowOrient;use CongowOrientFoundationBinding;$driver = new OrientHttpClientCurl();$orient = new Binding($driver, 127.0.0.1, 2480, admin, admin, demo);$response = $orient->query("SELECT FROM Address");$output = json_decode($response->getBody());foreach ($output->result as $address){ var_dump($address->street); { "schema": { "name": "Address"} }, "result": [{ "@type": "d", "@rid": "#13:0", "@version": 6, "@class": "Address", "type": "Residence", "street": "Piazza Navona, 1", "city": "#14:0", "nick": "Luca2" }, { ... ...

apart from ->query($SQL)

->get|delete|postClass($class)

->post|delete|put|getDocument($rid)

...and much more!(connect, disconnect, ...)

Query Builder

use CongowOrientQuery;$query = new Query();$query->from(array(users))->where(username = ?, "admin");echo $query->getRaw(); // SELECT FROM users WHERE username = "admin"

$query->select(array(name, username, email), false) ->from(array(12:0, 12:1), false) ->where(any() traverse ( any() like "%danger%" )) ->orWhere("1 = ?", 1) ->andWhere("links = ?", 1) ->limit(20) ->orderBy(username) ->orderBy(name, true, true) ->range("12:0", "12:1"); SELECT name, username, email FROM [12:0, 12:1] WHERE any() traverse ( any() like "%danger%" ) OR 1 = "1" AND links = "1" ORDER BY name, username LIMIT 20 RANGE 12:0 12:1

Data Mapper

A Doctrine2 strange ODM

namespace PolandPHPConEntity;use CongowOrientODMMapperAnnotations as ODM;/*** @ODMDocument(class="Person")*/class Speaker{ /** * @ODMProperty( type="string") */ protected $name; public function setName($name) { $this->name = $name; }

namespace PolandPHPConEntity;use CongowOrientODMMapperAnnotations as ODM;/*** @ODMDocument(class="Person")*/class Speaker{ /** * @ODMProperty(type="string") */ protected $name; public function setName($name) { $this->name = $name; }

Domain Driven Design

{ "schema": { "name": "Speaker" }, "result": [{ "@type": "d", "@rid": "#1:0", "@version": 6, "@class": "Speaker", "name": "David Coallier" }, { ... ...

{ "schema": { "name": "Speaker" }, "result": [{ "@type": "d", "@rid": "#1:0", "@version": 6, "@class": "Speaker", "name": "David Coallier" }, { ... ... $david = $mapper->hydrate(json_decode($speaker));

{ "schema": { "name": "Speaker" }, "result": [{ "@type": "d", "@rid": "#1:0", "@version": 6, "@class": "Speaker", "name": "David Coallier" }, { ... ... $david instanceOf PolandPHPConEntitySpeaker

Repository Pattern$repo = $manager->getRepository(Speaker)

$speakers = $repo->findAll();

$speaker = $repo->find($rid);

$criteria = array(Name => Lorna); $lornas = $repo->findBy($criteria);

$criteria = array( Name => Lorna, last_name => Jane);$lornaJ = $repo->findOneBy($criteria);

Know your boundaries 138

https://github.com/doctrine/common/tree/master/lib/Doctrine/Common/Persistence 139

Theory sucks. 140

Demo Menu items in RDBMSid type page url1 external NULL http://www.google.com2 page 1 NULL 142

Demo Menu items in OrientDB Link PageLinkrid title {page ExternalLink rid title url9:1 home 1 8:2 google google.com 143

That’s all, folks! 144

That’s all, folks!David Funaro@ingdavidinohttp://davidfunaro.com 144

That’s all, folks!David Funaro Alessandro Nadalin@ingdavidino @_odino_http://davidfunaro.com http://odino.org 144

Creditshttp://www.flickr.com/photos/sayamindu/5677281218/sizes/l/in/photostream/ http://farm1.static.flickr.com/182/471383865_79d04aec36_o.png http://farm1.static.flickr.com/134/318947873_12028f1b66_b.jpg http://www.flickr.com/photos/atomdocs/3275758118/sizes/o/in/photostream/ http://www.flickr.com/photos/pattipics/5229478393/sizes/o/in/photostream/ http://www.flickr.com/photos/kongharald/366597251/sizes/o/in/photostream/ http://www.everaldo.com/ http://www.flickr.com/photos/tusnelda/6140792529/sizes/l/in/photostream/ http://www.flickr.com/photos/mondi/5368644355/sizes/l/in/photostream/ http://www.flickr.com/photos/jayneandd/4191106566/sizes/l/in/photostream/ http://www.flickr.com/photos/jooon/2093253534/sizes/l/in/photostream/ http://www.flickr.com/photos/bluedharma/89186151/sizes/o/in/photostream/ http://www.flickr.com/photos/exfordy/2747089295/sizes/l/in/photostream/ http://www.flickr.com/photos/nostri-imago/3137422976/sizes/o/in/photostream/ http://www.flickr.com/photos/fionasjournal/379587818/sizes/z/in/photostream/ http://www.flickr.com/photos/nperlapro/1297392267/ http://www.flickr.com/photos/fastphive/28428808/sizes/m/in/photostream/ http://www.flickr.com/photos/rnugraha/2003147365/sizes/o/in/photostream/ http://www.flickr.com/photos/zigazou76/4412946911/sizes/l/in/photostream/ http://www.flickr.com/photos/greatnet/4667555436/sizes/l/in/photostream/ http://www.flickr.com/photos/mnsc/2768391365/sizes/l/in/photostream/http://www.flickr.com/photos/christmaswithak/4675962453/sizes/l/in/photostream/ http://www.amazon.com/Trainspotting-Irvine-Welsh/dp/0393314804http://www.flickr.com/photos/franconadalin59/5778176872/sizes/l/in/photostream/ http://farm6.static.flickr.com/5176/5474445627_875d621689_b.jpg http://farm3.static.flickr.com/2243/2189435082_a16d3c89ae_b.jpg http://farm3.static.flickr.com/2647/3816311930_ac52cff491_o.jpg http://i130.photobucket.com/albums/p266/feike1977/PES6-4-3-3defencesettings.jpg http://images.usatoday.com/life/_photos/2006/11/30/numb3rs-topper.jpg http://www.flickr.com/photos/jakecaptive/3205277810/sizes/l/in/photostream/

http://www.graph-database.org	9423
http://www.odino.org	430
http://blog.amt.in	171
http://odino.org	88
http://posterous.com	17
http://odino.github.com	15
http://graph-databases.org	12
http://translate.googleusercontent.com	11
http://a0.twimg.com	10
http://paper.li	9
http://94.141.20.55	4
http://127.0.0.1	3
http://www.graph-databases.org	2
http://jiby.posterous.com	1
http://demo.apostrophenow.org	1
http://www.slideshare.net	1

Graph databases in PHP @ PHPCon Poland 10-22-2011

by Alessandro Nadalin on Oct 22, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

16 Embeds 10,198

Statistics

Graph databases in PHP @ PHPCon Poland 10-22-2011 — Presentation Transcript