Symfony Live NYC 2014 - Rock Solid Deployment of Symfony Apps

Pablo Godel !
@pgodel!
https://joind.in/12199
Rock Solid Deployment
of Symfony Applications
Photo:AlvaroVidela

Deployment
Software deployment is all of the activities that !
make a software system available for use.
http://en.wikipedia.org/wiki/Software_deployment

Deployment
A very important part of
the application life-cycle

Deployment
A very important critical part
of the application life-cycle

Deployment
It should not be an !
after thought

Deployment
It should be predictable

Deployment
The more you do it the
better it goes

Questions?
Slides: http://slideshare.net/pgodel

Twitter: @pgodel

One-click deploys
Deployment Goals

Continuous deploys
Deployment Goals

Anytime & Anywhere
Deployment Goals

Deployment starts with the developer
Deployment Fact #1

• Development environment must be as close as
possible to productions servers!
Deployment Fact #1

• Setup test/qa/staging servers!
Deployment Fact #1

• Use Vagrant to manage VMs!
Deployment Fact #1

• Use Containers with Docker!
Deployment Fact #1

• Use Containers with Docker!
• Automate your development environment setup
(Ansible, Homebrew Cask)
Deployment Fact #1

Success depends on server OS setup
Deployment Fact #2

• Automate installation/conﬁguration with Ansible/
Puppet/Chef !
Deployment Fact #2

Puppet/Chef !
• Create OS packages for 3rd party software
Deployment Fact #2

Puppet/Chef !
• Create OS packages for 3rd party software!
• Setup your own package (rpm/deb) repositories
Deployment Fact #2

Monitoring is uptime
Deployment Fact #3

• Use tools to know what is going on with your
servers (Ganglia, Cacti, Zabbix, etc.)!
Deployment Fact #3

• Add metrics to your app (Graphite, StatsD, New
Relic)!
Deployment Fact #3

• Add metrics to your app (Graphite, StatsD, New
Relic)!
• Use your logs wisely (Logstash, Hecka, Kibana)
Deployment Fact #3

Deployment Methodologies
• VIM-style

• VIM-style!
• FTP uploads

• VIM-style!
• FTP uploads!
• Rsync

• VIM-style!
• FTP uploads!
• Rsync!
• Source control (GIT, SVN)

• VIM-style!
• FTP uploads!
• Rsync!
• Source control (GIT, SVN)!
• Build tools (Ant, Phing, Jenkins)!

• VIM-style!
• FTP uploads!
• Rsync!
• Package based (RPM, DEB, …) !

• VIM-style!
• FTP uploads!
• Rsync!
• Specialized tools (Capifony, Deployer, …)!

• VIM-style!
• FTP uploads!
• Rsync!
• Specialized tools (Capifony, Deployer, …)!
• IT automation tools (Ansible, Puppet, Chef, …)

Deployment: First time
• Copy files to server(s)!
• Set server-side configurations!
• Load DB fixtures!
• Process and install assets!
• Warm up cache!
• Enable site

Deployment: Subsequent times
• Copy ﬁles to server(s)!
• Update server-side conﬁgurations!
• Update DB (migrations)!
• Process and install assets!
• Warm up cache!
• Enable new version

Challenge: Secure
Deployment Challenges

• use ssh based connections!
Challenge: Secure

• don’t store passwords on source control
Challenge: Secure

• don’t store passwords on source control!
• use environment variables for sensitive data
Challenge: Secure

Challenge: Static assets

• Minimize/combine JS and CSS ﬁles!

• Enable web server compression!

• Add versioning to static assets links (code.js?v=1)!

• Run utilities locally or in a staging server, create
artifact, deploy result!

• Run utilities locally or in a staging server, create
artifact, deploy result!
• Serve static ﬁles from subdomain / CDN

Challenge: File permission conﬂicts

• Run Apache/PHP with same user!

• Use php-fpm instead of mod_php!

• Create “deploy” user and add web server to the
group

group!
• Use setfacl to give write access to multiple users!

group!
• Use setfacl to give write access to multiple users!
• Use external services for writing ﬁles and create
readonly installations

• Case sensitive ﬁlesystems!
Common Pitfalls

!
src/Acme/ClassName !
!= !
src/Acme/Classname.php
Common Pitfalls

• Conﬁguration differences!
Common Pitfalls

• Outdated 3rd party software
Common Pitfalls

• Outdated 3rd party software!
• Github down
Common Pitfalls

• Outdated 3rd party software!
• Github down
$ git daemon --base-path=/git/repo/path/ --
export-all!
!
$ git clone git://127.0.0.1/repo!
http://ozmm.org/posts/when_github_goes_down.html
Common Pitfalls

Simplest continuous deployment ever!
<?php !
!
exec(‘/usr/bin/env -i HOME=/var/www git pull’);!
echo “All done!”;
hook.php
Deployment Examples

<?php !
!
exec(‘/usr/bin/env -i HOME=/var/www git pull’);!
echo “All done!”;
hook.php
screenshot
Deployment Examples
GitHub hook
Simplest continuous deployment ever!

Capistrano!
!
+ !
!
Capifony
Deployment Examples

Capistrano / Capifony
• Ruby based!
• Very extensible!
• Large number of extensions!
• Simple client side installation
Deployment Examples

• Ruby based!
• Very extensible!
• Large number of extensions!
• Simple client side installation
 
$ gem install capistrano!
Deployment Examples

set :application, "myapp" # Application name

set :deploy_to, "/var/www/myapp"

!
set :user, "deployer"

set :use_sudo, false # sudo isn't required

!
set :deploy_via, :remote_cache

set :repository, "git@github.com:user/repo.git"

!
role :web, "server.example.com",“server2.example.com”

Deployment Examples

$ cap deploy:setup 
 
Deployment Examples

!
|-- releases!
`-- shared!
|-- logs!
`-- uploads!
Deployment Examples

$ cap deploy!
$ cap deploy:migrations!
$ cap deploy:rollback!
Deployment Examples

!
|-- current  
(symlink to releases/20130112)!
|-- releases!
| `-- 20130112!
`-- shared!
|-- logs!
`-- uploads!
Deployment Examples

Deployment Examples
Deploying with

Deployment Examples
!
!
Define hosts in inventory file
[webservers]
foo.example.com
bar.example.com 
www[01:50].example.com
!
[dbservers]
one.example.com
two.example.com
three.example.com

Deployment Examples
!
!
Define tasks / actions in playbook
---
- hosts: webservers
vars:
http_port: 80
max_clients: 200
remote_user: root
tasks:
- name: ensure apache is at the latest version
yum: pkg=httpd state=latest
- name: write the apache conﬁg ﬁle
template: src=/srv/httpd.j2 dest=/etc/httpd.conf
notify:
- restart apache
- name: ensure apache is running

Deployment Examples
!
!
Reuse tasks with Roles
- hosts: webservers
roles:
- {
role: servergrove.symfony2,
symfony2_project_root: /var/www/vhosts/
example.com/,
symfony2_project_name: demo,
symfony2_project_branch: master ,
symfony2_project_release: 1
}

Deployment Examples
!
!
Run process
$ ansible-playbook -i inventories/servers
playbook.yml -v

Deployment Examples
!
!
Run process

Deployment: Other options
• Fabric (Python)
• Idephix (PHP)
• Magellanes (PHP)
• Deployer (PHP)
• Laravel / envoy (PHP)
• Rocketeer (PHP)

Packaging: fpm
https://github.com/jordansissel/fpm
Build packages for multiple platforms (deb, rpm, etc) with great ease and sanity.
$ fpm -s dir -t rpm -n "myapp" -v 1.0 /var/www/myapp
!
$ fpm -s dir -t deb -a all -n myapp -v 1.0 /etc/apache2/
conf.d/my.conf /var/www/myapp
Deployment Complement Tools

App Metrics: StatsD & Graphite

App Metrics: liuggio/statsd-php-client
$ composer require liuggio/statsd-php-client:dev-master

$sender = new SocketSender(/*'localhost', 8126, 'udp'*/);
!
$client = new StatsdClient($sender);
$factory = new StatsdDataFactory('LiuggioStatsdClientEntityStatsdData');
!
// create the data with the factory
$data[] = $factory->timing('usageTime', 100);
$data[] = $factory->increment('visitor');
$data[] = $factory->decrement('click');
$data[] = $factory->gauge('gaugor', 333);
$data[] = $factory->set('uniques', 765);
!
// send the data as array or directly as object
$client->send($data);

$data[] = $factory->timing('usageTime', 100);!
!

$data[] = $factory->increment('orders');!
!

$data[] = $factory->gauge('memory', 333);!
!

App Metrics: StatsD & Graphite
App
StatsD Graphite
Grafana
App App

App Metrics: Grafana

Logging: Logstash
Ship logs from any source, parse them, get the right
timestamp, index them, and search them
input {
ﬁle {
path => “/var/log/apache2/access_log”
}
}
output {
elasticsearch {
host => localhost
}
}

Conﬁgure Apache to log json
LogFormat "{ "@timestamp": "%{%Y-%m-%dT
%H:%M:%S%z}t", "@fields": { "client":
"%a", "duration_usec": %D, "status":
%s, "request": "%U%q", "method": "%m
", "referrer": "%{Referer}i" } }"
logstash_json!
!
!
# Write our 'logstash_json' logs to logs/
access_json.log!
CustomLog logs/access_json.log logstash_json!
Logging: Logstash

Conﬁgure Apache to log json
LogFormat "{ "@timestamp": "%{%Y-%m-%dT%H:%M:%S%z}t", "@fields": { "client": "%a",
"duration_usec": %D, "status": %s, "request": "%U%q", "method": "%m", "referrer": "%
{Referer}i" } }" logstash_json!
!
!
# Write our 'logstash_json' logs to logs/access_json.log!
CustomLog logs/access_json.log logstash_json!
{ "@timestamp": "2012-08-22T14:35:19-0700", "client": "127.0.0.1",
"duration_usec": 532, "status": 404, "request": "/favicon.ico",
"method": "GET", "referrer": "-" }!
Result
Logging: Logstash

Logging: Kibana
Kibana is a user friendly way to view, search and visualize
your log data

Logging: Logstash + ElasticSearch + Kibana
App / Logstash
Redis
Logstash
filter/processor
ElasticSearch Kibana
App / Logstash App / Logstash

Developer
Tests
build artifact
Ansible Production
GitHub
Jenkins QA deploy
Integration  
Tests
Notifications
Deployment Summary

Now, we did ﬁnish!

!
Questions?

Twitter: @pgodel

Thank you!

Twitter: @pgodel
https://joind.in/12199
Feedback please!

Symfony Live NYC 2014 - Rock Solid Deployment of Symfony Apps

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Symfony Live NYC 2014 - Rock Solid Deployment of Symfony Apps

Similar to Symfony Live NYC 2014 - Rock Solid Deployment of Symfony Apps (20)

More from Pablo Godel

More from Pablo Godel (20)

Recently uploaded

Recently uploaded (16)

Symfony Live NYC 2014 - Rock Solid Deployment of Symfony Apps