Your SlideShare is downloading. ×
0
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Maksym Pronko
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Maksym Pronko

277

Published on

Do you ask yourself about ways to speed up solution you have already had which helps customers get information faster and easier? The answers are very important for consumers who work with Magento …

Do you ask yourself about ways to speed up solution you have already had which helps customers get information faster and easier? The answers are very important for consumers who work with Magento product. In this presentation I am going to highlight the new mechanism which helped to optimize index operations. You will understand indexer architecture and how Magento uses database triggers, background operations and business events in order to achieve great results on indexing with big amount of data.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
277
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. New Mechanism of MagentoIndexers
  • 2. MagentoMagentoTrainingCenterIntroduction• Max PronkoMax PronkoEbay Inc.Technical LeadUkraine, KyivFan of this book
  • 3. MagentoMagentoTrainingCenterIndexingWhat is index? Mage_Index Module
  • 4. MagentoMagentoTrainingCenterAgenda: IndexersHow it was before How it is now
  • 5. MagentoMagentoTrainingCenterComplaints about existing indexers•Slow execution (~6 hours for full re-index)•Database locks in the system•No partial re-index•Indexers code is difficult to maintain
  • 6. MagentoMagentoTrainingCenterNot friendly for community extensionsSystem loses control
  • 7. MagentoMagentoTrainingCenterNew code in the system!!!Index Module Index ModuleIndex ModuleCatalog IndexModule• Entity changes tracking• Indexing• System changes tracking• UI changes• Linear control• Cron schedulerExtendsEnterprise level
  • 8. MagentoMagentoTrainingCenterHow do we control our systemDatabase TriggerSystem Trigger Changelog TriggerData ChangesEAV Directory Catalog
  • 9. MagentoMagentoTrainingCenterHow do we control our system – System Trigger•Each data change causes to index invalidationWebsiteStoreStore GroupConfigurationEAV AttributeMetadata index table Index tableIndex ModuleRefresh Action ScriptSystem TriggerCron
  • 10. MagentoMagentoTrainingCenterHow do we control our system – System TriggerEvent Name Operation Options IndexerEAV Attribute Insert, update, delete is_searchableis_visible_in_advanced_searchis_filterableis_filterable_in_searchused_for_sort_byis_used_for_promo_rulesis_used_for_promo_rulescatalog_product_flatcatalog_category_flatCatalog, inventoryconfigurationInsert, update, delete catalog_price_scopeshow_out_of_stockmanage_stockflat_catalog_productflat_catalog_categorycatalog_product_index_pricecatalog_category_flatcatalog_product_flatStore Insert, update, delete catalog_category_product_indexStore Group Insert, update, delete catalog_category_product_indexcatalog_category_flatWebsite Delete catalog_category_product_index
  • 11. MagentoMagentoTrainingCenterHow do we control our system – Changelog Trigger•Changelog triggers track entity changesEntityTableChangelog tablesRefresh by Changelog ActionChangelog TriggersIndex ModuleCronIndex TableMetadata Index Table
  • 12. MagentoMagentoTrainingCenterBefore and after – index declarationBeforeAfter
  • 13. MagentoMagentoTrainingCenterBefore and after – matching and register the eventBeforeAfter
  • 14. MagentoMagentoTrainingCenterBefore and after – processing the eventBeforeAfter
  • 15. MagentoMagentoTrainingCenterBefore and afterFile locking Database locking
  • 16. MagentoMagentoTrainingCenterSystem Configuration
  • 17. MagentoMagentoTrainingCenterSpecific optimizations•Full re-index performance has improved•Full re-index is required in limited cases of system changes•Most of re-index operations are processed on the fly (cron)•Only changed entities are being processed•Ensure Frontend availability•Indexers run in background
  • 18. MagentoMagentoTrainingCenterKnown issues•Statement base replication does not supported–For more info: http://tinyurl.com/no3znzj•Overhead with information
  • 19. MagentoMagentoTrainingCenterThank youemail: mpronko@ebay.com skype: mcspronko twitter: @max_pronko

×