Doctrine 1.2 Optimization

Doctrine Optimizationphp|tek, May 25, 2011

Anna FilinaPHP Quebec - user group, organizerConFoo - non for proﬁt Web conference, organizerFooLab Inc. - IT solutions for businesses, founderI write code

Content Doctrine 1.2 optimization Proﬁling tools Find bad DQL Fix bad DQL Doctrine 2.0 Share your DQL concerns

Tools Used Doctrine 1.2 MySQL 5.1 PHP 5.3 Xdebug eZ Components (now Zeta Components)

Database SchemaInvoice (2000 rows) Items (7000 rows) Tags (1-2 per item)

Let’s make it explode!

Two queries$query1 = Doctrine::getTable(Invoice) ->createQuery(inv) ->leftJoin(inv.Items.Tags) ->where(inv.number LIKE "%10") ->orderBy(inv.subtotal DESC);$query2 = Doctrine::getTable(Invoice) ->createQuery(inv) ->leftJoin(inv.Items.Tags);

Execution Time AverageezcDebug timed each query 3xQuery 1: 0.20 secQuery 2: 16.26 secWhat’s taking so long?

MySQL or PHP?Query took 0.002 sec in MySQL~18,000 objects in PHPDoctrine hydrates results

Hydration ProcessCreate objectsCopy propertiesReindex resultsConvert results to multi-dimensional arrays/collectionsAnd lots of other good (and slow) things

Query VariationsNo tags: 9.21 sec->leftJoin(inv.Items);No relations: 2.39 sec (~4x faster);Limit results: 0.21 sec (~77x faster)->leftJoin(inv.Items.Tags);->limit(25);

Doctrine_Pager$pager = new Doctrine_Pager( $query, $page, $pageSize);$results = $pager->execute();

More Bad DQL Examples

Count$inv = Doctrine::getTable(Invoice) ->createQuery(inv) ->leftJoin(inv.Items) ->execute();$inv[0]->Items->count();

CountUsing left join: 8.91 sec->leftJoin(inv.Items);Using subquery: 2.39 sec->addSelect((SELECT COUNT(*) FROM InvoiceItem item WHERE item.invoice_id = inv.id ) AS num_items)$inv[0]->num_items;

MemoryUsing default hydration: 10.24 MB->execute();Using HYDRATE_ARRAY: 0.64 MB, ~16x less->execute(Doctrine_Core::HYDRATE_ARRAY);

Lazy LoadingRelations without leftJoin: 0.10 sec$invoice->Items[0]->Tags[0];Relations with leftJoin: 0.02 sec, 5x faster->leftJoin(inv.Items.Tags tag)Lazy loading especially bad when iterating

Lazy LoadingUsing relation: 0.03 sec$inv->Items[] = $item;Using associative entity: 0.00065 sec (~46x faster)$invoiceItem = new InvoiceItem();$invoiceItem->invoice_id = $inv->id;$invoiceItem->item_id = $item->id;

Lessons LearnedLimit resultsSelect only what neededUse COUNT subqueries where appropriateUse ARRAY hydration when possibleAvoid lazy-loading in most casesAlso look into database optimization(index columns, de-normalization, storage engine, etc.)This also applies to Doctrine 2.0

Doctrine 2.0

Lighter and Faster1 year of planning, 98% rewriteIndependent modelFaster hydration (3x)New lazy loading techniquesBatch processing

ExamplesHydrate the results on-demand in an iteration$iteratable = $query->iterate();foreach ($iteratable as $item) {}COUNT relationsCOUNT(inv.Items) ... GROUP BY inv.ItemsSmart batch saving$item1->persist();$item2->persist();$entityManager->flush();

Caching LayersAnnotations to ClassMetadataDQL to SQLSQL to Collection

ResourcesCode used in this talk:http://annaﬁlina.com/blog/wp-content/uploads/doctrine-opt.zipTips from the Doctrine team:http://www.doctrine-project.org/projects/orm/1.2/docs/manual/improving-performance/enDerick Rethan’s “Proﬁling PHP Applications”Ligaya Turmelle’s “Optimizing MySQL Essentials”

Special thanks toGuilherme Blanco & Raphael Dohms

Doctrine 1.2 Optimization

by Anna Filina on May 25, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

Doctrine 1.2 Optimization — Presentation Transcript