CMF: a pain in the F @ PHPDay 05-14-2011

Long story short, a true tale about an hopeless DevTeam CMF: a pain in the F David Funaro & Alessandro Nadalin May, 14 2011domenica 15 maggio 2011

let us introduce The Problem™domenica 15 maggio 2011

There comes the boss < theres a new projectdomenica 15 maggio 2011

There comes the boss < seems easy, lets use Joomla!domenica 15 maggio 2011

Dont open that door!domenica 15 maggio 2011

CMS The 80/20 dilemmadomenica 15 maggio 2011

80% is cool at alldomenica 15 maggio 2011

but as the requirements growsdomenica 15 maggio 2011

(you always knew that)domenica 15 maggio 2011

the project becomes a messdomenica 15 maggio 2011

There comes the boss < can I haz fotonic menthal scanner in the websitedomenica 15 maggio 2011

There comes the boss < cant do boss Joomla! is not meant...domenica 15 maggio 2011

There comes the boss < STFU NOOB DO THA OR BLA BLA BLAdomenica 15 maggio 2011

what ifdomenica 15 maggio 2011

There comes the boss < seems complex, no Joomla this time, lets use a framework!domenica 15 maggio 2011

There comes the boss < STFU NOOB WE SHOULD GO LIVE NEXT WEEK BLA BLAdomenica 15 maggio 2011

Framework The 20/80 dilemmadomenica 15 maggio 2011

20% is cool at alldomenica 15 maggio 2011

the 80% is really funnydomenica 15 maggio 2011

but has a cost Time To Marketdomenica 15 maggio 2011

again, what ifdomenica 15 maggio 2011

There comes the boss < seems complex, no Joomla this time, when should it go live?domenica 15 maggio 2011

There comes the boss < salesguy just told the client tomorrowdomenica 15 maggio 2011

There comes the boss < ok, lets use a CMFdomenica 15 maggio 2011

unfortunately, there is no stable CMF in the PHP ecosystemdomenica 15 maggio 2011

so it has a cost initial developmentdomenica 15 maggio 2011

investment = know how (team) + quality (framework) + velocity (that customers pretend) = CMFdomenica 15 maggio 2011

"Our" CMFdomenica 15 maggio 2011

Target: End User/Site admin Should be able to manage a site editing pages with different elements. Easily, like a CMS.domenica 15 maggio 2011

Target: Developer should be able to plug the CMF with NO PAIN, using the kick-ass framework at the bottom of the CMF.domenica 15 maggio 2011

domenica 15 maggio 2011

2 thingsdomenica 15 maggio 2011

Pages • main structure of a web site • organized as a tree • a way to express our contents • usually composed by a series of containers ( that well refer to as boxes )domenica 15 maggio 2011

Boxesdomenica 15 maggio 2011

Boxes The way to separate single elements of a page Loosely coupled HMVC structuresdomenica 15 maggio 2011

Entities Pagesdomenica 15 maggio 2011

Boxes {Bridge} Entities Pages Boxes let entities be shown inside webpagesdomenica 15 maggio 2011

Boxes We dispose of different types of boxes: • Common • DSLdomenica 15 maggio 2011

Common Box • Simple o Input field o Textarea o Video o Image o File o Richtext • Composite o Input field + image o input field + image + richetex o textarea + videodomenica 15 maggio 2011

what about the DSL?domenica 15 maggio 2011

Domain Specific Language DSL = ! (Website 1 Website 2 )domenica 15 maggio 2011

Example: Identify DSL Event Page Event Page Books Cars Users Review News Users News Contract Widget Widgetdomenica 15 maggio 2011

News Page Widgetdomenica 15 maggio 2011

Web Elements = CMF Entities News Page Widgetdomenica 15 maggio 2011

Web Elements = CMF Entities Books News Cars Page Review Contract Widgetdomenica 15 maggio 2011

Web Elements = CMF Entities Books News Cars Page Review Contract Widget DSLdomenica 15 maggio 2011

back to the CMFdomenica 15 maggio 2011

CMF Stack • Framework: symfony, for example • CMF entities: Site, Pages, Menus, Users ... • DSL entities: cars, contracts (for Hertz) • Common Boxes : Textarea, image, video, ... • Dsl boxes: Cars image gallerydomenica 15 maggio 2011

Common Boxes + DSL Boxes =The main tool for the developer to build a page with the CMFdomenica 15 maggio 2011

Example : page & box composition Main Image most sold product product Richtextdomenica 15 maggio 2011

Example : page & box composition Main Image most sold product product Richtext Dsl Boxesdomenica 15 maggio 2011

Example : page & box composition Main Image most sold product product Common Boxes Richtext Dsl Boxesdomenica 15 maggio 2011

The Page-Box Binding Storage Data can change its structure fastly, according to the domain model. We need a technology supporting this fast change. Since we have N box type, to compose a page we should look for a few tables. We need a technology supporting this kind of lookups.domenica 15 maggio 2011

so, How will we manage the data?domenica 15 maggio 2011

RDBMS , of coursedomenica 15 maggio 2011

because different data always have the same needdomenica 15 maggio 2011

one size fits alldomenica 15 maggio 2011

We tend to think at the way we should store data not how were gonna use itdomenica 15 maggio 2011

and we think that the shit-it-always-happens migration will be easydomenica 15 maggio 2011

also if that column is useful for one and one only rowdomenica 15 maggio 2011

among milionsdomenica 15 maggio 2011

so we know were gonna face a few well-known problems...domenica 15 maggio 2011

Data Mapping Data Structure RDBMS id name parent_id we have to find a way to re-organize the data-structre to insert our tree inside a table. But is really different! Tree find a node in O(nlogn)domenica 15 maggio 2011

Data Mapping Data Structure RDBMS is better than before, but isnt the best waydomenica 15 maggio 2011

Data Mapping Data Structure RDBMS ? ... and NOW??????domenica 15 maggio 2011

The Alien spend more time to normalize your models BUT you always find something that as a different Behaviourdomenica 15 maggio 2011

Unpredictable Tomorrow User Story evolve continous Worse than the Aliendomenica 15 maggio 2011

EAV formerly known as: normalization WTF?!?!?! or: how to do 70k joins to retrieve an entity of you modeldomenica 15 maggio 2011

Overnormalizeduser_id | mail_id LEFT JOINuser_id | phone_id LEFT JOIN ... ... ... ... ...user_id | address_id LEFT JOINdomenica 15 maggio 2011

Overnormalized Users ListLEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOINLEFT JOIN LEFT JOINdomenica 15 maggio 2011

OvernormalizedLEFT JOIN LEFT JOIN JOIN LEFT JOIN LEFTUsers List LEFT JOINLEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN LEFT JOIN What if you need to show only a single primary address?domenica 15 maggio 2011

back to the CMFdomenica 15 maggio 2011

Bind Page with Boxes Foreing Key -> TextareaBoxdomenica 15 maggio 2011

Bind Page with Boxes Foreing Key -> ? AND NOW ???domenica 15 maggio 2011

#1 Mantain the RIdomenica 15 maggio 2011

#2 Not Mantain the RIdomenica 15 maggio 2011

Maintain or not Maintain the RI; that is the questiondomenica 15 maggio 2011

we have to choosedomenica 15 maggio 2011

have you ever thought "there should be another way!" ?domenica 15 maggio 2011

Can someone help us ?domenica 15 maggio 2011

lets try NoSQL worlddomenica 15 maggio 2011

• Written in: C/C++ • Main point: Blazing fast • Protocol: Telnet-like • Disk-backed in-memory database, • but since 2.0, it can swap to disk. • Master-slave replication • Simple keys and values, • but complex operations like ZREVRANGEBYSCORE • INCR • Values can be set to expire (as in a cache) $ redis-cli set mykey "my binary safe value" => OK $ redis-cli get mykey => my binary safe valuedomenica 15 maggio 2011

Best used: • rapidly changing data with a foreseeable database size (should fit mostly in memory) For example: • analytics • real-time data collection • caching • MQ • loghttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redisdomenica 15 maggio 2011

very fastdomenica 15 maggio 2011

very fast Object != key->valuedomenica 15 maggio 2011

very fast Object != key->value Not reliabledomenica 15 maggio 2011

very fast Object != key->value Not reliable Can I haz otha nozql?domenica 15 maggio 2011

• Written in: C++ • Main point: Retains some friendly properties of SQL • Protocol: Custom, binary (BSON) • Master/slave replication • speaks JavaScript • Built-in sharding • Performance over features • After crash, it needs to repair tables> j = { name : david, surname : funaro };{ "name" : "david", "surname" : "funaro" }> db.things.save(t);> db.things.find();{ "_id" : ObjectId("4c2209f9f3924d31102bd84a"), "name" : "mongo" }domenica 15 maggio 2011

Best used: • you need dynamic queries • you prefer to define indexes, not map/reduce functions • you need good performance on a big DB For example: • all things that you would do with MySQL or PostgreSQL, but having predefined columns really holds you backhttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redisdomenica 15 maggio 2011

Document Orienteddomenica 15 maggio 2011

Document Oriented Schema Freedomenica 15 maggio 2011

Document Oriented Schema Free Navigate Objectdomenica 15 maggio 2011

Document Oriented Schema Free Navigate Object Can I haz otha nozql?domenica 15 maggio 2011

• Written in: Erlang • Main point: DB consistency, ease of use • Protocol: HTTP, some say REST • Bi-directional replication => master-master • conflict detection ( 409 Conflict ) • MVCC: write operations do not block reads • Previous versions of documents are available • Crash-only (reliable) design • Needs compacting from time to time • Views: embedded map/reduce • jQuery library included curl -d {"keys":["bar"]} -X POST http://host:port/foo/_all_docs?include_docs=truedomenica 15 maggio 2011

Best used: • accumulating occasionally- changing data • pre-defined queries • versioning is king For example: • CRM/CMS systems • APIhttp://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redisdomenica 15 maggio 2011

Reliabledomenica 15 maggio 2011

Reliable Document Orienteddomenica 15 maggio 2011

Reliable Document Oriented Schema Freedomenica 15 maggio 2011

Reliable Document Oriented Schema Free Navigate Objectdomenica 15 maggio 2011

Reliable Document Oriented Schema Free Navigate Object Can I haz otha nozql?domenica 15 maggio 2011

Why do we so hardly need a GraphDB like OrientDB?domenica 15 maggio 2011

"GraphDBs dont avoid relations but they embrace them in a way that they are not a computational problem anymore, by making them explicit instead of implicit through joins." Claudio Martella ( http://blog.acaro.org/entry/somebody-is-going-to-hate-me-nosparql )domenica 15 maggio 2011

Easy joins select from users where city.country.continent = Oceaniadomenica 15 maggio 2011

Same link semantics, different objects select links from menu >> 28:1, 17:5domenica 15 maggio 2011

Same link semantics, different objects select from [28:1, 17:5] 28:1 17:5 ExternalLink ProductLink url: http://www.google.com id: 4domenica 15 maggio 2011

28:1 17:5 ExternalLink ProductLink url: http://www.google.com id: 4 $link->render()domenica 15 maggio 2011

• Written in: Java • Main point: Graph • Protocol: Binary or HTTP • ACID • Disk-persisted or in-memory, • Cluster • 150k inserts per second • Schema-less, *-full, *-mixed • Speaks JSON • Integrated GUI • Documental • SQL commandscurl -X PUT 127.0.0.1:2480/document/demo/1:2 --data "{@rid: 1:2}"domenica 15 maggio 2011

Reliabledomenica 15 maggio 2011

Reliable Graph - Documentaldomenica 15 maggio 2011

Reliable Graph - Documental Schema-*domenica 15 maggio 2011

Reliable Graph - Documental Schema-* Easy traversaldomenica 15 maggio 2011

Reliable Graph - Documental Schema-* Easy traversal SQL-friendlydomenica 15 maggio 2011

Reliable Graph - Documental Schema-* Easy traversal SQL-friendly UberFast ( binary protocol )domenica 15 maggio 2011

Reliable Graph - Documental Schema-* Easy traversal SQL-friendly UberFast ( binary protocol ) Universal ( HTTP protocol )domenica 15 maggio 2011

is so cooldomenica 15 maggio 2011

but has a problem...domenica 15 maggio 2011

ver 1.0domenica 15 maggio 2011

rc1domenica 15 maggio 2011

but has a couple problems...domenica 15 maggio 2011

JAVAdomenica 15 maggio 2011

but somebodydomenica 15 maggio 2011

started writing the binary-protocol binding https://github.com/AntonTerekhov/OrientDB-PHP ( beta, 28 April 2010 )domenica 15 maggio 2011

and othersdomenica 15 maggio 2011

wrote the HTTP one https://github.com/odino/Orientdomenica 15 maggio 2011

$driver = new OrientHttpClientCurl();$orient = new OrientFoundationBinding( $driver, 127.0.0.1, 2480, admin, admin, demo);$response = $orient->query("select from fellas whereany() traverse(0,-1) ( @rid = 1:1 )");$output = json_decode($response->getBody());foreach ($output->result as $friend){ echo $friend->name; // other fun...}domenica 15 maggio 2011

you can start playing with a pure GraphDB nowdomenica 15 maggio 2011

High-level PHP Component?domenica 15 maggio 2011

Nodomenica 15 maggio 2011

but we know that ;)domenica 15 maggio 2011

thats why in DNSEE we will build a basic Object Graph Mapper for OrientDBdomenica 15 maggio 2011

...because...domenica 15 maggio 2011

hey, you remember about our CMF?domenica 15 maggio 2011

codename:domenica 15 maggio 2011

codename: ConGoWdomenica 15 maggio 2011

codename: ConGoW contents gone wild ( dont ask why )domenica 15 maggio 2011

ConGoWdomenica 15 maggio 2011

ConGoW • soon the real kickstartdomenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting pointdomenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting point • OSS on GitHubdomenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting point • OSS on GitHub • Stackdomenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting point • OSS on GitHub • Stack o Symfony2domenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting point • OSS on GitHub • Stack o Symfony2 o Orientdomenica 15 maggio 2011

ConGoW • soon the real kickstart • 10 devs at the starting point • OSS on GitHub • Stack o Symfony2 o Orient o Doctrine2domenica 15 maggio 2011

"My only friend, the end"domenica 15 maggio 2011

"My only friend, the end" David Funaro @ingdavidino http://davidfunaro.comdomenica 15 maggio 2011

"My only friend, the end" David Funaro Alessandro Nadalin @ingdavidino @_odino_ http://davidfunaro.com http://odino.orgdomenica 15 maggio 2011

"My only friend, the end" David Funaro Alessandro Nadalin @ingdavidino @_odino_ http://davidfunaro.com http://odino.org http://joind.in/talk/view/3008domenica 15 maggio 2011

Credits http://www.flickr.com/photos/pagedooley/5313217918/sizes/l/in/photostream/ http://www.flickr.com/photos/zoetnet/5520594473/sizes/l/in/photostream/ http://www.flickr.com/photos/mhxbhd/3962410821/sizes/o/in/photostream/ http://www.flickr.com/photos/labyrinthx/1955594336/sizes/z/in/photostream/ http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis http://www.flickr.com/photos/salim/19426192/sizes/o/in/photostream/ http://www.flickr.com/photos/mybluevan/3780363712/sizes/l/in/photostream/ http://farm4.static.flickr.com/3064/3086258014_f1925639e0.jpgdomenica 15 maggio 2011

http://davidfunaro.com	100
http://lilly-dev	4
url_unknown	1
http://translate.googleusercontent.com	1

CMF: a pain in the F @ PHPDay 05-14-2011

by David Funaro on May 15, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

4 Embeds 106

Statistics

CMF: a pain in the F @ PHPDay 05-14-2011 — Presentation Transcript