This document summarizes Magento's Extension Quality Program (EQP) process and findings. It reports that 50% of submitted extensions fail to compile in production mode, and of those that do compile, only 25% pass manual quality assurance testing. The top 5 issues found are extensions not compiling in production mode, compiling but not working properly in production mode, incompatibility with claimed Magento versions, poor error handling, and lack of adherence to coding standards. The document outlines planned improvements to the EQP including increased automation of testing and integration with Magento Marketplace.

1. Page | 1© 2017 Magento, Inc.
Extension Quality Program
(EQP)
Technical Deep Dive

2. Page | 2© 2017 Magento, Inc.
Ben Marks
Magento Evangelist

3. Technical Deep Dive
EQP Process

4. Page | 4© 2017 Magento, Inc.
Extension Quality Program
Magento’s commitment to ensure secure & high quality extensions & themes

5. Page | 5© 2017 Magento, Inc.
How Does the Extension Quality Program Work?

6. Key Takeaway &
Improvements

7. Page | 7© 2017 Magento, Inc.
What Have We Learned?
50%
Of extensions
submitted fail to
compile in
production mode
Fail to Compile
EQP process is slow
Need for additional communication
Manual QA for ALL extensions
700+ manual tests executed Averaging 70 tests per week
Of extensions that
compile successfully
pass manual QA
Pass Manual QA
50% 25%
Of extensions
submitted meet
minimal technical
requirements
Meet Technical
Requirements

8. Page | 8© 2017 Magento, Inc.
Top 5 Issues
Extension does not compile in
production mode
1
Extension compiles but doesn’t
work in production mode
2
Extension does not work with the
versions of Magento specified in
the compatibility claims
3
Poor error handling4
Extension does not adhere to
coding standards
5

9. Page | 9© 2017 Magento, Inc.
Improvements in Q1
Install/Compile Test
Manual QA for ALL extensions
Tests to Detect Varnish and Caching Issues
Malware Testing
Extension > Magento > PHP Version
Alignment Verification
Prioritized Tech Review and Manual QA for
Extensions on Marketplace

10. Page | 10© 2017 Magento, Inc.
Anti-plagiarism
optimization
Increased
support for
manual QA
EQP 2.0
development
begins
Marketplace 2.0
launch
EQP 2.0 launch:
Improved test automation
architecture & dev portal
enhancements
Marketplace
integration with
EQP 2.0
EQP 2.0:
Automated
functional tests
What’s Coming in 2017
April 2017 June 2017 July 2017 August 2017 September 2017 October 2017May 2017 November 2017 December 2017

11. Investing in
Your Extension

12. Page | 12© 2017 Magento, Inc.
Star Performers
17 submissions
without failures
https://www.aheadworks.com/
6 submissions
without failures
http://www.fooman.co.nz
5 submissions
without failures
https://www.apptrian.com/

13. Q & A

14. Page | 14© 2017 Magento, Inc.
Resources
EQP Guide
User Guide: Getting Started
Coding Standards
http://docs.magento.com/marketplace/user_guide/
getting-started-seller.html
https://github.com/magento/marketplace-eqp
Email us at marketplace@magento.com
Validation Package Tool
https://github.com/magento/marketplace-tools
http://docs.magento.com/marketplace/user_guide/Res
ources/pdf/Extension_Quality_Program_Overview.pdf

15. Page | 15© 2017 Magento, Inc.
Thank you