Rock-solid Magento Deployments (and Development)
•
65 likes•21,599 views
In this session we show how to organize Magento projects using Version control and how to have a full development and deployment process in place to assure highest quality with many developers involved and teams spread over different continents. This talk covers how to run a continuous integration pipeline that takes care of testing various aspects of the webshop (unit tests, acceptance tests, performance test,…). Covers: Continuous integration, automation, Vagrant/Chef, Testing pipeline, unit/acceptance/performance tests, monitoring, deployment workflows, development best practices
![Magento Deployments
Rock-Solid
…and Development
php[world] 2014 – Washington D.C.](https://image.slidesharecdn.com/rock-solidmagento-141115164436-conversion-gate02/85/rocksolid-magento-deployments-and-development-1-320.jpg)
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Rock-solid Magento Deployments (and Development)
Similar to Rock-solid Magento Deployments (and Development) (20)
More from AOE
More from AOE (20)
Recently uploaded
Recently uploaded (20)
Rock-solid Magento Deployments (and Development)
- 1. Magento Deployments Rock-Solid …and Development php[world] 2014 – Washington D.C.
- 3. fbrnc fbrnc
- 5. E-Commerce: Magento CMS: TYPO3 Portals: ZF, FLOW,… Mobile Searchperience: SOLR >120 people world-wide High Performance /Scale Global Enterprise Projects
- 6. San Francisco, CA Janine Fiona that’s me Leo
- 8. Who’s a Magento developer? Who spends a significant amount of his/her time dealing with development/deployment processes? Who thinks he/she’s got it figured out? YOU...?
- 11. time complexity This is when we “deployed” using a FTP client
- 12. Keep it simple!
- 16. code
- 17. Vocabulary
- 22. Build Package Application System Storage User Data media directory (sometimes minified) Database dump Magento core Modules Scripts Settings Tools
- 24. project web root root!= This is the complete project This is where your webserver points to.
- 27. htdocs <Name> <theme> layout template code design etc locale <area> core community local <area> <language> modules <package> <Namespace> <package> *.xml *.csv <theme> app skin lib Module2 default layout template code design etc locale frontend local frontend de_DE modules base My base My_Module2.xml My_Module2.csv default app skin etc, Block, … js, css, img, … my_module2 my_module2 Magento My_Module My_Module2 Module default layout template code design etc locale frontend local frontend de_DE modules base My base My_Module.xml My_Module.csv default app skin etc, Block, … js, css, img, … my_module my_module
- 28. htdocs Module default layout template code design etc locale local frontend de_DE modules My base *.xml app My_Module2.xml My_Module2.csv my_module2 My_Module.xml My_Module.csv etc, Block, … my_module Module2 etc, Block, … my_module2 my_module
- 31. Vanilla Magento absolutely no core hacks! …and core bugs you’ve fixed (and submitted to Magento, of course…) (except official patches)
- 32. “wiring” Intro modman “connects” existing modules to the Magento core, but how do we manage them?
- 33. htdocs code core community local app app/code/…/My/Module .modman My_Module app/design/… skin/frontend/… app/etc/modules/My_Module.xml modman app/code/…/My/Module My_Module2 app/design/… skin/frontend/… app/etc/modules/My_Module.xml modman <theme> layout template design etc locale <area> <language> modules <package> *.xml Components tools n98-magerun.phar phpunit.phar modman EnvSettingsTool composer.phar htdocs .modman Configuration Installer (Metadata, Doc,…) My_Module My_Module2 app,… and usually there’s even more stuff… These should come from different origins
- 34. Composer
- 36. AOEpeople/composer-installers "replace": { "magento-hackathon/magento-composer-installer":"*" } “inspired” by composer/installers “magento-module” “magento-source” handles package types
- 37. <?php namespace AoepeopleComposerInstallers; class MagentoInstaller extends BaseInstaller { protected $locations = array( 'module' => '.modman/{$name}/', 'source' => 'htdocs/' ); } AOEpeople/composer-installers
- 38. • Fully compatible with magento-hackathon/magento-composer-installer • Adds support for type “magento-source” • Only puts packages into place • Native modman script is used to deploy modules • Wrapped in a simple installer script AOEpeople/composer-installers
- 39. { "minimum-stability":"dev", "require":{ "aoepeople/composer-installers": "*", "fbrnc/aoe_scheduler": "*", "fbrnc/aoe_cachecleaner": "*", "aoepeople/magento_enterprise": "1.13.1.0", "aoepeople/envsettingstool": "*" }, "config": { "bin-dir": "bin" } } AOEpeople/composer-installers replaces Hackathon Installer some modules Vanilla Magento Source Tools,…
- 42. discover use code review add modman add composer git integrate test deploy Magento Connect The Right Thing™ one-click install download good luck with that!
- 43. Code Quality Modules Not enterprise ready Not production ready Not cloud ready Bad performance Security
- 44. 0% 100% Writing Code Time spent… 5 years ago today Drinking Coffee Drinking Coffee while waiting for builds/tests Twitter VCS Deployment Design / Architecture / Infrastructure Writing Code Ping Pong Think about it
- 45. master Feature B Feature A Hotfix (if master is not modified) Hotfix (if master is modified) Feature C build install on integration tests build install on integration tests install on deploy build install on integration tests deploy to stage deploy to prod Git Workflow build install on integration tests deploy to stage deploy to prod build install on integration tests deploy to stage deploy to prod single mainline no commits, only --no-ff merges
- 46. build
- 47. to recreate What do we need an environment?
- 48. Build Packaging
- 51. Settings Urls Database Settings Payment Provider Configuration Feature Flags… Everything that’s different between two environments
- 52. EnvSettingsTool
- 55. not go on What should production? Every file is a potential security risk Don’t deploy anything you don’t need to operate the website
- 59. Jenkins Travis CI Use Jenkins to implement a full deployment pipeline for your projects! Test our Open Source Magento modules with Travis CI!
- 61. Vagrant Boxes
- 62. Awesome stuff Every single line potentially can break production! Bratwurst (Germans) Donut (Americans) Pizza (Italians)
- 63. Version Control GIT, SVN,… PHP lint
- 64. Version Control Code Reviews Gerrit, Crucible, reVu,…
- 65. Code Reviews Build Files DB Installer Settings Triggered by commit, by time or manually Jenkins minify js/css .tar.gz “virtual package” (revision)
- 68. Static Code Analysis Install on “Integration” First system where code from all developers/teams meets each other unstable system. Might be broken. Will be rebuild without warning
- 70. Unit Tests Integration Tests AOE PMD (for Magento) broken links, HTTP headers, W3C validity,… Test features that rely on other parts (e.g. framework, external services,…) External components (SSL, Redis, Varnish, ERP, Data Import,…) Basically this is also PHPUnit, but addressing other stuff
- 71. Integration Tests Acceptance Tests Selenium Firefox Other Browsers
- 72. Acceptance Tests Install on “Staging” Behat (Cucumber) Same setup as production, but different machines Client QA / approval
- 73. Install on “Staging” *http://www.slideshare.net/aoemedia/performance-measurement-and-tuning Stress Tests Jmeter Spin up EC2 instances in the cloud to produce traffic*
- 74. Again: multiple servers or autoscaling setup Stress Tests Install on “Production” A/B Deployments on different scales Plan B: rollback Zero Downtime
- 77. Version Control Code Reviews Build Static Code Analysis Install on “Integration” Unit Tests Integration Tests Acceptance Tests Install on “Staging” Install on “Production” Enable Features
- 78. Pipeline Visualization #284 #283 #282 #281 #280 Build Static Code Analysis Unit Tests Install on “Integration” Integration Tests Acceptance Tests #285 for team dashboards
- 80. deploy to production deploy to production Continuous Integration Continuous Deployment type “YESIKNOWWHATIMDOING” + click
- 81. deploy
- 82. Automate!
- 83. timespent task size does it manually does it manually gets annoyed writes script to automate runs script wins loses Geeks vs. Non-Geeks Makes fun of geek’s complicated method
- 84. Deploy often!
- 85. No manual interaction! no creating CMS blocks no creating product attributes no updating of any configuration settings! no clearing the cache no purging CDN or Reverse Proxy content!
- 86. Details? High Performance Magento in the Cloud
- 92. Build What is it? A simple shell script. That’s it! No Ant, no Phing, no fancy PHP tool/framework Where is it used? In the build job of a Jenkins server What does it need to know? Where to get all the source code from What does it do? add metadata, composer, modman, minify, packaging, upload to S3
- 93. Provisioning What is it? A couple of chef cookbooks. Run by AWS OpsWorks or Vagrant,… Where is it used? On the target servers What does it need to know? The role of the server (web server, devbox, Redis,…) What does it do? Installing and configuring web server, PHP, MySQL, Redis,…
- 94. Deployment What is it? A simple shell script. Or the “deploy” chef cookbook Or EasyDeployWorkflows Where is it used? On the target servers What does it need to know? How to get the build and where to deploy it to What does it do? (Resetting the environment), getting the build, extracting it, managing release folders and symlinks, triggering installer, cleanup old releases
- 95. Installation What is it? A simple shell script. Sometimes triggered inside “deploy” before_migrate.rb Where is it used? On the target servers, called from deployment step What does it need to know? What environment this is. Injected settings What does it do? Run modman, connect to shared directories, apply settings, trigger update scripts, customize cache prefix,
- 96. Deployment != Installation doesn’t know anything about the app, except where to get it from and where to put it knows how to get the app up and running
- 97. Cache Invalidation Cache Warming add build number to id_prefix
- 102. test
- 103. Unit Service UI Acceptance http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid What the customer thinks the code should do What the developer thinks the code should do Load Test
- 104. Menta Selenium 2 Testing Framework for PHP Who is “Menta”? What is “Menta”?
- 105. Gallery Screenshot
- 106. Perceptual diffs Build X Build X-1 Perceptual Diff
- 110. give takeand be part of the community