Andreas von Studnitz - MM14NL

1,333 views

Published on

Importing Products into Magento – Comparison of the different methods

Importing data is one of the challenges with Magento development. There are several ways to do it, and every solution has its pros and cons. Andreas von Studnitz will compare the possible approaches regarding features and usability. Last but not least, he will present the results of his performance analysis comparing the time needed to import up to 50,000 products with and without indexing for several different import methods.

Published in: Software, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,333
On SlideShare
0
From Embeds
0
Number of Embeds
429
Actions
Shares
0
Downloads
12
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Andreas von Studnitz - MM14NL

  1. 1. 22/05/2014 Importing Products into Magento A Comparison of Import Methods Andreas von Studnitz - Importing Products into Magento 1
  2. 2. 22/05/201422/05/2014 Overview Andreas von Studnitz - Importing Products into Magento 2 • Introduction • Import Methods: Features, Pros and Cons – Built-In Methods – Third Party Modules • Performance Comparison • Discussion
  3. 3. 22/05/201422/05/2014 About me • Andreas von Studnitz • Living and working in Aachen (Aken), Germany • Magento developer since 2008 • Freelancer since 2009 • Co-founder of integer_net GmbH in 2012 • Active member of the German Magento Community • Magento Frontend/Backend Development, Magento Training, Magento Consulting Andreas von Studnitz - Importing Products into Magento 3
  4. 4. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 4 Task: - Import products into Magento - Arbitrary data source (Probably transformation of the data is needed before the import) - Once or on a regular basis
  5. 5. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 5 Nice to Have: - Import different product types - Import other entity types (categories, customers, …) - Indexing on the fly - Access through a webservice
  6. 6. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 6 Mage::getModel • Reliable • Supports all data entities • Customizable to any kind of input data • Indexing integrated  Slow
  7. 7. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 7 $product = Mage::getModel(‘catalog/product’) ->load($productId); $product ->addData(array( ‘sku’ => ‘12345’, ‘name’ => ‘Product 1’, ... )) ->save(); Mage::getModel
  8. 8. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 8
  9. 9. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 9 SOAP / XmlRpc - Call from any external system - Standardized - Supports many data entities - Hard to extend - Really slow
  10. 10. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 10 1 Free module available
  11. 11. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 11 REST - Call from any external system - Introduced in Magento CE 1.7 - Authorization via Oauth - Few data entities supported - Very slow
  12. 12. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 12 1 Free module available
  13. 13. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 13 Dataflow - Import text files - Specific format - Few data entities supported - Hard to integrate into your own workflow - Outdated - Slow
  14. 14. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 14 1 Free module available 2 Commercial module available
  15. 15. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 15 ImportExport  Introduced in Magento CE 1.5  Fast  Standardized  Imports from CSV files only  Few data entities supported  Complicated data format (http://www.integer-net.com/2012/04/04/importing-products-with-the-import-export-interface/)
  16. 16. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 16 1 Free module available 2 Commercial module available
  17. 17. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 17 FastSimpleImport • Based on Mage_ImportExport • Array Adapter, to be used in your own module • Adds more data entities, better error messages, indexing on the fly, … • Fast  Complicated (but improved) data format https://github.com/avstudnitz/AvS_FastSimpleImport
  18. 18. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 18 FastSimpleImport $data = array( array( ‘sku’ => ‘12345’, ‘name’ => ‘Product 1’, ... ), ... ); Mage::getModel(‘fastsimpleimport/import’) ->processProductImport($data);
  19. 19. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 19 1 Free module available 2 Commercial module available
  20. 20. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 20 ApiImport  Based on Mage_ImportExport  Array Adapter, to be used in your own module  Can be called via Magento SOAP/XmlRpc  Adds more data entities, indexing on the fly, …  Fast  Complicated data format https://github.com/danslo/ApiImport
  21. 21. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 21 1 Free module available 2 Commercial module available
  22. 22. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 22 CustomImportExport  Based on Mage_ImportExport  Imports CSV files via shell commands  Fast  Complicated data format  No longer actively developed http://www.magentocommerce.com/magento-connect/amartinez-customimportexport.html
  23. 23. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 23
  24. 24. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 24 Magmi  External PHP Tool  Import from CSV files or PHP array (Dataflow format)  Plugin system  Considerably fast  Accesses the Magento database directly
  25. 25. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 253 Not all indices are supported
  26. 26. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 26 uRapidFlow (Pro)  Commercial Magento module  Pro version adds more data entities  Import from CSV files in specific format  Very flexible, configurable profiles  Considerably Fast  Encoded with IonCube
  27. 27. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 27
  28. 28. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 28 Performance Testing • Test all methods on the same server • Same configuration, same products • Test up to 50,000 products with and without indexing
  29. 29. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 29 Results (no Indexing)
  30. 30. 22/05/201422/05/2014Andreas von Studnitz - Importing Products into Magento 30 Results (with Indexing) 1 Not all indices are supported
  31. 31. 22/05/201422/05/2014 5,5 0,2 0,6 4 135 135 76 22 116 25 13 0,8 115 76 22 14 5 0 20 40 60 80 100 120 140 160 without Indexing with Indexing Andreas von Studnitz - Importing Products into Magento 31 Products/second
  32. 32. 22/05/201422/05/2014 Personal Recommendation Andreas von Studnitz - Importing Products into Magento 32 • Importing products / customer / categories? – FastSimpleImport • In need of a webservice? – ApiImport • Importing other entities? – Mage::getModel
  33. 33. 22/05/201422/05/2014 Thank you! Andreas von Studnitz - Importing Products into Magento 33 Contact me: – http://www.integer-net.com – http://www.integer-net.de – avs@integer-net.de – twitter/GitHub/IRC: @avstudnitz

×