Talk by Bernd Alter Slides of the talk about running Spryker with Docker & Kubernetes (local developmkent with Docker, deployment with Kubernetes and additional tips & tricks) at the second Spryker User Group meetup on 27.01.2020

1. DISTRIBUTE YOUR SPRYKERDISTRIBUTE YOUR SPRYKER
DEPLOYMENT WITH DOCKER & KUBERNETESDEPLOYMENT WITH DOCKER & KUBERNETES
Spryker User Group Berlin Meetup #2 (2020/01/27)

2. AGENDAAGENDA
Local docker setup
Deployment in Kubernetes - the Turbine way
Tips & tricks - learn from our failures :-)

3. ABOUT MEABOUT ME
Bernd Alter
Technical director at
(Twi er/Github)
Spryker early adopter
(4+ years experience, 7 projects)
Turbine Kreuzberg
@bazoo0815

4. Opinionated content ahead!

5. USING VM STILL ... OR DOCKER ALREADY?USING VM STILL ... OR DOCKER ALREADY?

6. LOCAL DOCKER SETUPLOCAL DOCKER SETUP
SAME SAME BUT DIFFERENTSAME SAME BUT DIFFERENT

7. PRE-PROVISIONED BASE IMAGESPRE-PROVISIONED BASE IMAGES
like Spryker, we create base PHP images
project independent
required modules & tooling included
New Relic
Blackfire
XDebug
pcov

8. BUT ...BUT ...

9. WE SPLIT CONTAINERSWE SPLIT CONTAINERS

10. WE SPLIT CONTAINERSWE SPLIT CONTAINERS
separate containers (locally & in K8s)
Yves/Zed/Glue
PHP/nginx
no shared filespace
/public copied into nginx

11. WHY?WHY?
faster, cleaner setup
reduced dependencies
no addi onal supervisord process required

12. EXTENDED USE OF ENVIRONMENTAL VARIABLESEXTENDED USE OF ENVIRONMENTAL VARIABLES
PHP configura on can process values of env vars

13. WHY?WHY?
built-in into generic Docker images
pre-configured values for produc on
no config templates needed
no addi onal processing on build/(re)deploy

14. DEALING WITH LOCAL PERFORMANCE ISSUESDEALING WITH LOCAL PERFORMANCE ISSUES
use op on delegated for volume mounts
volumes:
- ./public/Zed:/var/www/public/Zed:delegated

15. DEALING WITH LOCAL PERFORMANCE ISSUESDEALING WITH LOCAL PERFORMANCE ISSUES
on MacOS hosts, file I/O causes bad performance
enable Spryker's unresolvable cache
use fswatch to clear cache on file changes
(almost) as fast as with Linux machines
$config[KernelConstants::AUTO_LOADER_UNRESOLVABLE_CACHE_ENABLED] = true;

16. DEPLOYMENT IN KUBERNETESDEPLOYMENT IN KUBERNETES
THE TURBINE WAYTHE TURBINE WAY

17. KUBERNETES CLUSTERSKUBERNETES CLUSTERS
several own Kubernetes clusters
nodes = Hetzner bare-metal servers
(semi)automated setup with kubeadm
for large projects: one dedicated cluster
shared cluster for smaller projects

18. KUBERNETES CLUSTERSKUBERNETES CLUSTERS
Problem
lots of image builds
docker builder becomes bo leneck
Solu on
parallelize docker builds with custom image builder

19. KUBERNETES CLUSTERSKUBERNETES CLUSTERS
Problem
high load due to lots of pipelines (test envs, review
envs)
Solu on
cleanup namespaces based on life me/exis ng
branches

20. GITLAB-CI ANYONE?GITLAB-CI ANYONE?

21. GITLAB-CI PIPELINEGITLAB-CI PIPELINE

22. GITLAB-CI PIPELINEGITLAB-CI PIPELINE
image builds
one applica on with all code
deployment to review environment
one environment per branch

23. GITLAB-CI PIPELINEGITLAB-CI PIPELINE
quality tools & automated tes ng
PHP syntax lin ng
phpstan
phpmd
code sniffer
unit, func onal & frontend tests

24. GITLAB-CI PIPELINEGITLAB-CI PIPELINE
sta c review environment for master pipeline
stateful services (db, redis, elas csearch etc.)
merged code coverage reports for unit/func onal &
acceptance tests
merge done with phpcov & Robo

25. GITLAB-CI PIPELINEGITLAB-CI PIPELINE
EXAMPLESEXAMPLES

26. DEPLOYMENT TO CUSTOMER ENVIRONMENTSDEPLOYMENT TO CUSTOMER ENVIRONMENTS

27. DEPLOYMENT TO CUSTOMER ENVIRONMENTSDEPLOYMENT TO CUSTOMER ENVIRONMENTS

28. DEPLOYMENT TO CUSTOMER ENVIRONMENTSDEPLOYMENT TO CUSTOMER ENVIRONMENTS
separate repositories per environment for
deployment
configura on
deploy changes get merged to subsequent repos
configura on changes are maintained manually

29. DEPLOYMENT TO CUSTOMER ENVIRONMENTSDEPLOYMENT TO CUSTOMER ENVIRONMENTS
CODE EXAMPLESCODE EXAMPLES

30. FLAVORS OF KUBERNETES TARGETFLAVORS OF KUBERNETES TARGET
ENVIRONMENTSENVIRONMENTS
OpenShi (RedHat)
requires containers to run as non-root user
(SysEleven)
AWS
MetaKube
OpenStack

31. TIPS & TRICKSTIPS & TRICKS

32. TIPS & TRICKSTIPS & TRICKS
make commands to bundle all CLI commands
for local development
for Kubernetes deployment

33. TIPS & TRICKSTIPS & TRICKS
don't use docker-sync for local dev environment
never stable for us
causes issues under Linux (although it's supposed
to be just a wrapper for na ve moun ng)

34. TIPS & TRICKSTIPS & TRICKS
use new PHPStan baseline feature
use pcov for code coverage
significantly faster than XDebug
'na ve' support only for PHPUnit 8+
code coverage for FE tests quite complicated
- for both unit/functional tests & acceptance tests
-> merged with phpcov & Robo

35. QUESTIONS?QUESTIONS?

37. ADDITIONAL LINKS & REFERENCESADDITIONAL LINKS & REFERENCES
(includes also how to setup with PHPUnit 7 or less)
Setup pcov for faster code coverage
OpenShi S2I image build
PHPStan baseline feature