CMF: a pain in the F @ PHPDay 05-14-2011

Long story short, a true tale about an hopeless DevTeamCMF: a pain in the F David Funaro & Alessandro Nadalin May, 14 2011

let us introduceThe Problem™

There comes the boss < theres a new project

There comes the boss < seems easy, lets use Joomla!

Dont open that door!

CMSThe 80/20 dilemma

80% is cool at all

but asthe requirements grows

(you always knew that)

the project becomes a mess

There comes the boss < can I haz fotonic menthal scanner in the website

There comes the boss < cant do boss Joomla! is not meant...

There comes the boss < STFU NOOB DO THAT OR BLA BLA BLA

what if

There comes the boss < seems complex, no Joomla this time, lets use a framework!

There comes the boss < STFU NOOB WE SHOULD GO LIVE NEXT WEEK BLA BLA

FrameworkThe 20/80 dilemma

20% is cool at all

the 80%is really funny

but has a cost Time To Market

again, what if

There comes the boss < seems complex, no Joomla this time, when should it go live?

There comes the boss < salesguy just told the client tomorrow

There comes the boss < ok, lets use a CMF

unfortunately, there is no stable CMF in the PHP ecosystem

so it has a cost initial development

investment = know how (team) + quality (framework) +velocity (that customers pretend) = CMF

"Our" CMF

Target: End User/Site adminshould be able to manage a site editing pages with different elements. Easily, like a CMS.

Target: Developer should be able to plug the CMF with NO PAIN,using the kick-ass framework at the bottom of the CMF.

2things

Pages main structure of a web site organized as a tree a way to express our contents usually composed by a series of containers ( that well refer to as boxes )

BoxesThe way to separatesingle elements of a pageLoosely coupled HMVCstructures

Boxes {Bridge}Entities Pages Boxes let entities be shown inside webpages

BoxesWe dispose of different types ofboxes: Common DSL

Common BoxSimple Input field Textarea Video Image File RichtextComposite Input field + image input field + image + richetex textarea + video

what about the DSL?

Domain Specific LanguageDSL = ! (Website 1 Website 2 )

Example: Identify DSL Event Page Event PageBooks Cars Users Review News Users News Contract Widget Widget

Web Elements = CMF Entities Page CarsBooks NewsReview Widget Contract DSL

back to the CMF

CMF StackFramework: symfony, for exampleCMF entities: Site, Pages, Menus, Users ...DSL entities: cars, contracts (for Hertz)Common Boxes : Textarea, image, video, ...Dsl boxes: Cars image gallery

Common Boxes + DSL Boxes =The main tool for the developer to build a page with the CMF

Example : page & box composition

The Page-Box Binding StorageData can change its structure fastly, according to the domain model. We need a technology supporting this fast change. Since we have N box type, to compose a page we should look for a few tables. We need a technology supporting this kind of lookups.

so, How will wemanage the data?

RDBMS , of course

because differentdata always have the same need

one size fits all

We tend to think at the way we should store data not how were gonna use it

and we think that theshit-it-always-happens migration will be easy

also if that column is useful for one and one only row

among milions

so we know were gonna facea few well-known problems...

Data Mapping Data Structure RDBMS id 10 name tom parent_id 19we have to find a way to re-organize the data-structre to insert ourtree inside a table.But is really different! Tree find a node in O(nlogn)

Data MappingData Structure RDBMS is better than before, but isnt the best way

Data MappingData Structure RDBMS ? ... and NOW??????

The Alienspend more time to normalizeyour models BUT you always find something that as a different Behaviour

Unpredictable TomorrowUser Story evolve continous Worse than the Alien

EAV formerly known as: normalization WTF?!?!?! or:how to do 70k joins to retrieve an entity of you model

Overnormalizeduser_id | mail_id LEFT JOINuser_id | phone_id LEFT JOIN...............user_id | address_id LEFT JOIN

Overnormalized Users ListLEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOINLEFT JOIN LEFT JOIN

OvernormalizedLEFT JOIN LEFT JOIN LEFT JOIN LEFT JOINList Users LEFT JOINLEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN What if you need to show only a single primary address?

back to the CMF

Bind Page with BoxesForeing Key -> TextareaBox

Bind Page with BoxesForeing Key -> ? AND NOW AND NOW ???

#1 Mantain the RI

#2 Not Mantain the RI

Maintain or not Maintain the RI; that is the question

we have to choose

have you ever thought"there should be another way!" ?

Can someone help us?

lets tryNoSQL world

Written in: C/C++ Main point: Blazing fast Protocol: Telnet-like Disk-backed in-memory database, but since 2.0, it can swap to disk. Master-slave replication Simple keys and values, but complex operations like ZREVRANGEBYSCORE INCR Values can be set to expire (as in a cache)$ redis-cli set mykey "my binary safe value" => OK$ redis-cli get mykey => my binary safe value

Best used: rapidly changing data with a foreseeable database size (should fit mostly in memory) For example: analytics real-time data collection caching MQ loghttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis

very fast

very fastObject != key -> value

very fast Object != key -> value Not reliableCan I haz otha nozql?

Written in: C++ Main point: Retains some friendly properties of SQL Protocol: Custom, binary (BSON) Master/slave replication speaks JavaScript Built-in sharding Performance over features After crash, it needs to repair tables> j = { name : david, surname : funaro };{ "name" : "david", "surname" : "funaro" }> db.things.save(t);> db.things.find();{ "_id" : ObjectId("4c2209f9f3924d31102bd84a"), "name" : "mongo" }

Best used: you need dynamic queries you prefer to define indexes, not map/reduce functions you need good performance on a big DB For example: all things that you would do with MySQL or PostgreSQL, but having predefined columns really holds you backhttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis

Document Oriented

Document OrientedSchema Free

Document Oriented Schema Free Navigate ObjectCan I haz otha nozql?

Written in: Erlang Main point: DB consistency, ease of use Protocol: HTTP, some say REST Bi-directional replication => master-master conflict detection ( 409 Conflict ) MVCC: write operations do not block reads Previous versions of documents are available Crash-only (reliable) design Needs compacting from time to time Views: embedded map/reduce jQuery library includedcurl -d {"keys":["bar"]} -X POST http://host:port/foo/_all_docs?include_docs=true

Best used: accumulating occasionally- changing data pre-defined queries versioning is king For example: CRM/CMS systems APIhttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis

Reliable

ReliableDocument Oriented

ReliableDocument OrientedSchema Free

Reliable Document Oriented Schema Free Navigate ObjectCan I haz otha nozql?

Why do we so hardly need a GraphDB like OrientDB?

"GraphDBs dont avoid relations but they embrace them ina way that they are not a computational problemanymore, by making them explicit instead of implicitthrough joins." Claudio Martella ( http://blog.acaro.org/entry/somebody-is-going-to-hate-me-nosparql )

Easy joinsselect from users where city.country.continent = Oceania

Same link semantics, different objects select links from menu >> 28:1, 17:5

Same link semantics, different objects select from [28:1, 17:5] 28:1 17:5 ExternalLink ProductLinkurl: http://www.google.com id: 4

28:1 17:5 ExternalLink ProductLinkurl: http://www.google.com id: 4 $link->render()

Written in: Java Main point: Graph Protocol: Binary or HTTP ACID Disk-persisted or in-memory, Cluster 150k inserts per second Schema-less, *-full, *-mixed Speaks JSON Integrated GUI Documental SQL commandscurl -X PUT 127.0.0.1:2480/document/demo/1:2 --data "{@rid: 1:2}"

Reliable

ReliableGraph - Documental

ReliableGraph - DocumentalSchema-*

ReliableGraph - DocumentalSchema-*Easy traversal

ReliableGraph - DocumentalSchema-*Easy traversalSQL-friendly

ReliableGraph - DocumentalSchema-*Easy traversalSQL-friendlyUberFast ( binary protocol )

ReliableGraph - DocumentalSchema-*Easy traversalSQL-friendlyUberFast ( binary protocol )Universal ( HTTP protocol )

is so cool

but has a problem...

ver 1.0

but has a couple problems...

but somebody

started writing the binary-protocol binding https://github.com/AntonTerekhov/OrientDB-PHP ( beta, 28 April 2010 )

and others

wrote the HTTP onehttps://github.com/odino/Orient

$driver = new OrientHttpClientCurl();$orient = new OrientFoundationBinding( $driver, 127.0.0.1, 2480, admin, admin, demo);$response = $orient->query("select from fellas where any() traverse(0,-1) ( @rid = 1:1 )");$output = json_decode($response->getBody());foreach ($output->result as $friend){ echo $friend->name; // other fun...}

you can start playing with a pure GraphDB now

High-level PHP Component?

but we know that ;)

thats why in DNSEE we will build a basicObject Graph Mapper for OrientDB

...because...

hey, you remember about our CMF?

codename: ConGoW

codename: ConGoWcontents gone wild ( dont ask why )

ConGoW soon the real kickstart

ConGoW soon the real kickstart 10 devs at the starting point

ConGoW soon the real kickstart 10 devs at the starting point OSS on GitHub

ConGoW soon the real kickstart 10 devs at the starting point OSS on GitHub Stack Symfony2

ConGoW soon the real kickstart 10 devs at the starting point OSS on GitHub Stack Symfony2 Orient

ConGoW soon the real kickstart 10 devs at the starting point OSS on GitHub Stack Symfony2 Orient Doctrine2

"My only friend, the end"

"My only friend, the end"David Funaro@ingdavidinodavidfunaro.com

"My only friend, the end"David Funaro Alessandro Nadalin@ingdavidino @_odino_davidfunaro.com odino.org

"My only friend, the end"David Funaro Alessandro Nadalin@ingdavidino @_odino_http://davidfunaro.com http://odino.org http://joind.in/talk/view/3008

Creditshttp://www.flickr.com/photos/pagedooley/5313217918/sizes/l/in/photostream/ http://www.flickr.com/photos/zoetnet/5520594473/sizes/l/in/photostream/ http://www.flickr.com/photos/mhxbhd/3962410821/sizes/o/in/photostream/http://www.flickr.com/photos/labyrinthx/1955594336/sizes/z/in/photostream/ http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis http://www.flickr.com/photos/salim/19426192/sizes/o/in/photostream/http://www.flickr.com/photos/mybluevan/3780363712/sizes/l/in/photostream/ http://farm4.static.flickr.com/3064/3086258014_f1925639e0.jpg

http://www.graph-database.org	2458
http://www.odino.org	216
url_unknown	30
http://translate.googleusercontent.com	5
http://www.graph-databases.org	4
http://www.techgig.com	3
http://www.old.odino.org	2
http://www.slideshare.net	2
http://twitter.com	1
http://graph-databases.org	1
http://wwww.odino.org	1
http://webcache.googleusercontent.com	1

CMF: a pain in the F @ PHPDay 05-14-2011

by Alessandro Nadalin

Accessibility

Categories

Upload Details

Usage Rights

12 Embeds 2,724

Statistics

CMF: a pain in the F @ PHPDay 05-14-2011 Presentation Transcript