Performance of Magento 2 has been a hot topic for a while, with many controversial opinions and figures around the community. This talk is intended to guide a developer from configuring the website for maximum performance to measuring the results of such tuning using the Magento Performance Toolkit, profiling the problematic areas and measuring once again, all using the same approaches as the core engineering team.

1. © 2018 Magento, Inc. Page | 1

2. © 2018 Magento, Inc. Page | 2
How would you like your Magento?
In our case it would be slightly different:
• Fast
• Easy to work with
• Extensible & Customizable
• “Free” is still an option

3. © 2018 Magento, Inc. Page | 3
Performance refers to the speed and effectiveness of a system
under a given workload within a given time frame

4. © 2018 Magento, Inc. Page | 4
Scalability is the ability of software to handle
an increase in workload by scaling horizontally

5. © 2018 Magento, Inc. Page | 5
Is Performance === Scalability?

6. © 2018 Magento, Inc. Page | 6
Reactions when Magento 2.0 released…

7. © 2018 Magento, Inc. Page | 7
Agenda
• New and Upcoming Features Overview
– Scalability Modules
– Queues
– Bulk API
• Performance Evaluation
– Test data generation
– Server Side Tests
– Client Side Tests
– Profiling
– How we make use of all this?

8. © 2018 Magento, Inc. Page | 8
Queues support in Magento Open Source
• Migrating from EE to CE in the upcoming 2.3 release
• Includes Amqp support and AsynchronousOperations module
• Already available to explore in 2.3-develop branch on magento2
Github

9. © 2018 Magento, Inc. Page | 9
Bulk API in Magento Open Source
• Introduced in upcoming 2.3
• Developed by the Community and Contributing Solution Partners
• Allows to perform API request with multiple entities and defer
processing leveraging RabbitMQ
• Partially built on top of queues framework and
AsynchronousOperations migrated to CE

10. © 2018 Magento, Inc. Page | 10
Parallel indexation
• Available 2.2.5 onwards
• For 2.3 it is planned to make use of queues instead of pcctl_fork
• Available for category product and catalog fulltext indexes
• Price indexer paralleling is scheduled for upcoming releases
• Number of processes is configurable with environment variable
• Indexing is Scoped per store
• May not be applicable for all merchants and use cases

11. © 2018 Magento, Inc. Page | 11
Indexer batching
• Available 2.2.0 onwards
• Allows to manage and fine tune indexer batch size
• Must be optimized per each individual merchant and catalog, as
may degrade performance otherwise

12. © 2018 Magento, Inc. Page | 12
Popular search terms caching
• Available in 2.2.5+
• Allow merchant to select number of top search terms to be cached
• Allows merchant to select caching depth
• Enabled by default however number should be fine tuned per store
needs

13. © 2018 Magento, Inc. Page | 13
Scalability Modules
• Currently available only in Magento Commerce Edition (former EE)
• Allows merchant to configure and use up to 3 master databases
• Checkout and Order Management may have a dedicated database
master each

14. © 2018 Magento, Inc. Page | 14
Magento Performance Toolkit

15. © 2018 Magento, Inc. Page | 15
Performance Toolkit
• Evaluate performance and scalability
• Simulate high load and detect bottlenecks
• Extensibility planning (which direction and how?)
• Verify assumptions
• Reproduce ”incorrect” behavior
• Differential testing
– Different Software
– Different Hardware

16. © 2018 Magento, Inc. Page | 16
Profile Generator
• Implemented with PHP and Magento Framework (/setup/src/Magento/Setup/Fixtures/*Fixture.php)
• XML configuration
<?xml version="1.0"?>
<config xmlns:xi="http://www.w3.org/2001/XInclude">
<profile>
<websites>1</websites> <!-- Number of websites to generate -->
<store_groups>1</store_groups> <!--Number of stores-->
<store_views>1</store_views> <!-- Number of store views -->
<assign_entities_to_all_websites>0</assign_entities_to_all_websites>
<simple_products>800</simple_products> <!-- Simple products count -->
<product-images>
<images-count>100</images-count>
<images-per-product>3</images-per-product>
</product-images>
<categories>30</categories> <!-- Number of categories to generate -->
<categories_nesting_level>3</categories_nesting_level
<customers>200</customers> <!-- Number of customers to generate -->
</profile>
</config>

17. © 2018 Magento, Inc. Page | 17
Structure of Magento Performance Toolkit
Profile Generator
CLI: bin/magento setup:performance:generate-fixtures
Profiles: /setup/performance-toolkit/profiles/*/*.xml
Scenarios:
Apache JMeter™
/setup/performance-toolkit/benchmark.jmx

18. © 2018 Magento, Inc. Page | 18
Which entities can be generated?
Bundle Products
Admin Users
Categories
Configurable Products
Product Images
Swatches
Attribute sets
Cart price rules
Catalog Price Rules
Customers
Websites & Stores Views
Tax Rates
Orders Shared Catalog
Negotiable Quotes
Companies
Target Rules
Simple products

19. © 2018 Magento, Inc. Page | 19
Small Medium Large X-Large
Website/Store Views
1/1 3/3 5/5 5/5
Total Sku 1000 39k 500k 1M
Simple Product 800 24k 300k 600k
Configurable with 24 variations
16/24 640/24 8k/24 16k/24
Attribute Sets 10 100 200 200
Attributes per Set 10 50 50 50
Categories 30 300 3k 6k
Customers 200 2k 5k 10k
Orders 80 50k 100k 150k
Bundled Profiles

20. © 2018 Magento, Inc. Page | 20
Profile Generator CLI

21. © 2018 Magento, Inc. Page | 21
What You See

22. © 2018 Magento, Inc. Page | 22
Is What You Get

23. © 2018 Magento, Inc. Page | 23
User Behavior Emulation

24. © 2018 Magento, Inc. Page | 24
Profiling
How hard can it be?

25. © 2018 Magento, Inc. Page | 25
Popular Tools
Pros:
• Free & Open Source
• Easy to Set Up
• Profile only what you need
Cons:
• XHGUI
• MongoDB
Pros:
• User-Friendly UI
• Multitude of Integrations
• Well documented
• Feature rich
Cons:
• Proprietary

26. © 2018 Magento, Inc. Page | 26
Tideways + XHGui

27. © 2018 Magento, Inc. Page | 27
Client Side Tests
With SiteSpeed.io

28. © 2018 Magento, Inc. Page | 28
SiteSpeed.io
• Sitespeed.io Browser performance evaluation and reporting
• Report generation easy as 1-2-3:
docker run --shm-size=1g --rm -v "$(pwd)":/sitespeed.io
sitespeedio/sitespeed.io
http://your.magento.site/homepage.html

29. © 2018 Magento, Inc. Page | 29
Sitespeed.io Metrics

30. © 2018 Magento, Inc. Page | 30
Sitespeed.io – Page Load Details

31. © 2018 Magento, Inc. Page | 31
How we make use of all this?

32. © 2018 Magento, Inc. Page | 32
Performance focused CICD jobs
• On each Pull Request
• Nightly
• Monthly
• On-demand
• For every version

33. © 2018 Magento, Inc. Page | 33
Continuous reporting and trend monitoring
This Pull Request seems to be pretty safe to merge

34. © 2018 Magento, Inc. Page | 34
Great Day for the Performance Team

35. © 2018 Magento, Inc. Page | 35
Resources
• https://devdocs.magento.com/guides/v2.2/config-guide/cli/config-cli-
subcommands-perf-data.html
• https://jmeter.apache.org
• https://tideways.io
– https://github.com/kandy/xhgui (fork)
• https://blackfire.io
• https://www.sitespeed.io

36. © 2018 Magento, Inc. Page | 36
Grazie!