Igor Alpert, profile picture
Uploaded byIgor Alpert
1,429 views

Js infrostructure

1. The document discusses modern web application infrastructure practices, flows, and tools. It covers development workflows, dependency management, build pipelines, source management, and monitoring. 2. Key aspects of the development workflow covered include collaborative development between developers, QA, managers and support. Frequent iterations are emphasized with automated testing and integration. 3. Dependency management discusses tools for managing dependencies like Node Version Manager, Ruby Version Manager, and virtualenv. Package managers like NPM, Bower, and dependencies in package.json files are also covered.

Embed presentation

Download to read offline
MODERN WEB APPLICATIONS ! INFRASTRUCTURE PRACTICES, FLOWS AND TOOLS $CUGFQP4'#.UVQTKGU
! ! IGOR ALPERT # IGOR_ALPERT@EPAM.COM HTTP://UA.LINKEDIN.COM/IN/IALPERT EPAM Systems 2
Application ! ! GXGNQRGT EPAM Systems 3
Application CSS JS HTML ! ! +%CP(62 EPAM Systems 4
5 Application EPAM Systems $ Feature #1 Feature #2 Bug fixing ! 6JG[CEVCUCVGCO
Logs 6 Application EPAM Systems $ % ! 5QWTEGEQFG )KICD[VGUQHFGDWI
7 Application EPAM Systems Logs Doc ! $ % %QOOGPVU CPFGZCORNGU
8 Application $ Logs Docs Config ! % KHHDGVYGGPFGXCPFRTQFWEVKQP EPAM Systems
Packages 9 Application $ Config ! % L3WGT[CPFHTKGPFU EPAM Systems Logs Docs
10 Application $ Logs Docs Config Tests ! % Packages *CRR[RCVJ EPAM Systems
11 Application $ ! % /CIKEDWKNFU[UVGO EPAM Systems
12 Application 0.5 $ 0.8 1.0 ! % #NRJC$GVC4% EPAM Systems
13 Application 0.5 $ 0.8 1.0 ! Dev Test Prod % GXU3#5WRRQTV%NKGPV EPAM Systems
14 Application 0.5 $ 0.8 1.0 ! Dev Test Prod APP DB SV % ' #RR5GTXGT EPAM Systems
' ' ' ' DB DB DB DB 15 Application $ ! % 6QPUQHUGTXGTU CPFCVC$CUGU EPAM Systems .QCFDCNCPEGT
16 Application $ ! % 7 Errors Metrics Logs 7UGHWNKPHQTOCVKQPNKXGUJGTG EPAM Systems
17 Agenda ! $ DEVELOPMENT WORKFLOW % SOURCE MANAGEMENT BUILD PIPELINE DEPLOY PLATFORMS 7 MONITORING METRICS # CONTINUOUS INTEGRATION EPAM Systems
$ DEVELOPMENT WORKFLOW
DEVELOPMENT WORKFLOW $ #TEJKVGEV6GEJ.GCFGXGNQRGTU DEV ( $ Managers 5WRRQTVGX1RU2TQDNGOOCPCIGOGPV ) QA % Support 3#.GCF/CPWCN#WVQOCVKQP #EEQWPV/CPCIGT#PCN[VKE EPAM Systems 19
DEVELOPMENT WORKFLOW $ 6JG[YCPVVQEQFG 0GYHGCVWTGU6JG[YCPVVQIQNFGPRNCVGVJGKTEQFG 6JG[YCPVVQTGFWEGVGEJPKECNFGRV ( $ DEV #NYC[UJCXGUQOGňVKP[ʼnEJCPIG Managers ) QA % Support 6JG[YCPVUKORNKEKV[ 0QOQTGUWFFGPRNCVHQTO EJCPIGU 6JG[YCPVUVCDKNKV[ VQTGSWKTGOGPVUCPFUVQTKGU #UC7UGT+YCPVŎ -PQYPDWIU6QQOWEJVKOGVQFQHWNNTGITGUUKQP DGVVGTVQWUGRTGXKQWUňUVCDNGʼnXGTUKQP EPAM Systems 20
DEVELOPMENT WORKFLOW $ $ DEV QA ( Managers ) % Support #EVYKVJ+PVGITKV[UJCTGFIQCNU EPAM Systems 21
DEVELOPMENT WORKFLOW $ ( DESIGN ) TESTING $ DEVELOP BUILD, DEPLOY LAUNCH a BUG FIX ' 2-4 WEEKS ITERATION EPAM Systems 22
DEVELOPMENT WORKFLOW #WVQOCVGFVGUVU %QNNCDQTCVKXGFGXGNQROGPV %QFGHGCVWTGUYKVJVGUVKPOKPF #WVQOCVGFDWKNF 9TKVGCUOWEJHCKNKPIVGUVUCURQUUKDNGVQ EQXGTTGSWKTGOGPVU 2NCPCPFGUKIP $ 'CEJUQWTEGEJCPIGVTKIIGTUYJQNG DWKNFRKRGNKPGVQTWP 6JKPMJQY[QWTHGCVWTGYKNNDG KORNGOGPVGFCPFKPVGITCVGFYKVJ QVJGTHGCVWTGU ( * % $ +PVGITCVKQP 4GCNVKOGOQPKVQTKPICPFHGGFDCEM UP TO 1 DAY ITERATION EPAM Systems 23
24 DEVELOPMENT WORKFLOW SERVERS 1. NGINX 2. APACHE HTTPd 3. TOMCAT 4. IIS 5. NODEJS 6. EXPRESS 7. … EPAM Systems STYLES 1. TWITTER BOOTSTRAP 2. ZURB FOUNDATION 3. COMPASS 4. SASS 5. LESS 6. STYLUS 7. CUSTOM SOLUTION FRAMEWORKS 1. ANGULARJS 2. BACKBONE 3. EXTJS 4. SENCHA TOUCH 5. EMBERJS 6. METEOR 7. DERBY 8. CUSTOM SOLUTION TESTING 1. JASMINE 2. MOCHA 3. BUSTER 4. QUNIT 5. KARMA 6. PROTRACTOR 7. NIGHTWATCH 8. INTERN 9. WEBDRIVER.IO 10.CUSTOM SOLUTION OS 1. WINDOWS 2. OSX 3. UBUNTU 4. CENTOS 5. FREEBSD 6. COREOS TOOLS 1. GRUNT 2. GULP 3. NPM 4. BOWER 5. YEOMAN 6. CUSTOM SOLUTION DATABASES 1. MONGODB 2. COUCHDB 3. RIAK 4. REDIS 5. CASSANDRA SERVICES 1. AMAZON 2. NODEJITSU 3. HEROKU 4. MONGOLAB 5. FIREBASE 6. JOYENT 7. PUSHER 8. DOCKER $ 6QPUQHTGCF[VQWUG 1RVKQPUHQT[QWT RTQLGEV SERVER SIDE 1. PHP 2. RUBY 3. PYTHON 4. … !
DEVELOPMENT WORKFLOW $ Ability to compile native modules — easier to “make from source” then in Windows ;QWTHTKGPFU VIRTUAL MACHINE NODEJS, RUBY, PYTHON Your toolset will ask for them as a dependency Works better and faster on Unix based systems WINDOWS Building a Module in Windows node-gyp, Python, shell, VS, … 55*0Q)7+ %JGH2WRRGV8 EPAM Systems 25
DEPENDENCY MANAGEMENT $ Homebrew Packager for OSX, uses formulas to install software Mac OSX brew install [package] Advanced Packaging Tool Package manager for Debian GNU/Linux distribution and its variants Ubuntu apt-get install [package] Yum The Yellowdog Updater, Modified (yum) is an open-source command-line package management utility for Linux operating CentOS yum install [package] Chocolatey Chocolatey NuGet is a Machine Package Manager, somewhat like apt-get, but built with Windows in mind 42/ Windows choco install [package] '$ EPAM Systems 26
DEPENDENCY MANAGEMENT $ OPENSSL PRCE NGINX PKG-CONFIG MAKEDEPEND GIT GIT-FLOW brew install git-flow brew install nginx EPAM Systems 27
DEPENDENCY MANAGEMENT $ NVM APP1 Node 0.11x NVM APP2 Node 0.10.31 5VKNNVJGUCOGRTQLGEV EPAM Systems 28
DEPENDENCY MANAGEMENT $ NodeJS Node Version Manager - Simple bash script to manage multiple active node.js versions NVM https://github.com/creationix/nvm Ruby RVM is the Ruby enVironment Manager. It manages Ruby application environments and enables switching between them RVM https://github.com/wayneeseguin/rvm Python It creates an environment that has its own installation directories, that doesn’t share libraries with other virtualenv environments virtualenv https://github.com/pypa/virtualenv NodeJS A Node version manager for the windows folks out there. Inspired by n and nodenv Nodist https://github.com/marcelklehr/nodist 9KPFQYU EPAM Systems 29
DEPENDENCY MANAGEMENT $ +PVGTHCEGKUVJGUCOG NPM BOWER manager install dependencies: { name: version, name: folder, name: package }, devDependencies: { test-framework-name: version } dependencies: { name: version, name: folder, name: package }, devDependencies: { test-framework-name: version } manager install manager install EPAM Systems 30
DEPENDENCY MANAGEMENT $ NPM LODASH GRUNT PACKAGE.JSON ASYNC DEV-DEPS KARMA Packages: Downloads: Corporate mirrors npm init npm install npm install —save QPņVHQTIGVVQ WRFCVG[QWTRCEMCIGU https://docs.npmjs.com/ EPAM Systems 31
DEPENDENCY MANAGEMENT $ BOWER BACKBONE LODASH BOWER JQUERY UNDERSCORE BOOTSTRAP Packages: npm install -g bower init bower install http://bower.io/ (QTHTQPVGPF EPAM Systems 32
BUILD PIPELINE
BUILD PIPELINE Source Concatenate Uglify SourceMaps Test Karma Protractor Mocha Coverage Preprocess LESS SASS Compass Watch LiveReload Rebuild Serve Assets Templates CSS HTML processing Images optimization Custom ChangeLog Notifications console.debug 6CUMUVQCWVQOCVG KP[QWTDWKNFRKRGNKPG EPAM Systems 34
BUILD PIPELINE ! GRUNT Packages: grunt grunt coffee:app FILE BASED Good for file operations like copy/move/save. Configuration over code. Better for small projects with small amount of files. TONS OF PLUGINS Most popular JS task runner. Almost any possible task is available as plugin. You can perform build-in or custom operations. Sync/ Async 1 2 Gruntfile.js Gruntfile.coffee jshint: { // define the files to lint files: ['gruntfile.js', 'src/**/*.js', 'test/**/*.js'], // configure JSHint options: { // more options here globals: { jQuery: true, console: true, module: true } } } http://gruntjs.com/ http://gruntjs.com/plugins ITWPVEQPVTKDLUJKPV EPAM Systems 35
BUILD PIPELINE ! GULP 1 2 gulpfile.js EASY API Only 4 API methods: task, watch, src, dest. Easy to write complex flows. STREAM BASED No temporary files. Code over Configuration. Much more faster then Grunt for file-content processing operations. ZHCUVGT var gulp = require('gulp'); ! gulp.task('default', function() { // place code for your default task here }); Packages: npm install --save-dev gulp gulp grunt coffee http://gulpjs.com http://gulpjs.com/plugins/ EPAM Systems 36
BUILD PIPELINE ! YEOMAN KARMA TESTS Pre-packed with test suites SCAFFOLDING Easy scaffolding system to generate application components SERVER Comes with build-in live-reload and grunt task 1 2 3 $ yo angular:controller myController $ yo angular:directive myDirective $ yo angular:filter myFilter $ yo angular:service myService http://gulpjs.com http://gulpjs.com/plugins/ Generators: ~1100 npm install -g yo npm install -g generator-angular yo angular ITWPVUGTXG EPAM Systems 37
BUILD PIPELINE SLUSH https://www.npmjs.org/package/slush BROCCOLI https://www.npmjs.org/package/broccoli JAM AUTOMATION https://github.com/caolan/jam http://indigounited.com/automaton/ BRUNCH ANGUS http://brunch.io/ https://github.com/nickjanssen/angus ! EPAM Systems 38
! SOURCE MANAGEMENT
SOURCE GIT EASY BRANCHING AND MERGING Cheap branching — just a reference to commit. Lots of possible merging strategies and conflict resolving. History rewrite DISTRIBUTED You can work alone or with a team. You can work with or without central server. Even without network connection. FAST You can clone whole repo/branch or just a few commits. All meta-data is stored in one place ~/.git 1 2 3 git init ! git add git commit ! git push —force ! git rebase -i git merge ! git tag -a %QPHNKEVTGUQNXGF EPAM Systems 40
SOURCE GITLAB PRIVATELY HOSTED You can integrate it with your own infrastructure, users base, private services etc TRUSTED BY ENTERPRISE Fully manageable and configurable Same capabilities — collaboration, forking, wiki and JIRA OPEN-SOURCE Hosted on GitHub. You can contribute and write your own features 1 2 3 - *CRR[%NKGPVU EPAM Systems 41
SOURCE GITHUB WEB INTERFACE You are able to create branches, tags, pull-requests, edit and commit files directly from browser CODE REVIEW AND COLLABORATION Do code-review with your team, leave comments, track issues and maintain WIKI pages FORK, PULL REQUEST You can fork and contribute to any public repository. Home for open-source projects 1 2 3 Mirror mirror on the wall, who forks best of them all? EPAM Systems 42
SOURCE BITBUCKET FREE PRIVATE REPOS Unlike GitHub this service will allow you to create *unlimited* amount of private repositories. ENTERPRISE ORIENTED Natively integrates with Atlasssian software stack. Trusted by Enterprise. SPOONING vs. FORKING Spooning - with Bitbucket is a pair programming process as an opposite to forking 1 2 3 ň$KVDWEMGVURQQPKPI ŃLWUV)QQINGKV EPAM Systems 43
SOURCE BRANCHING MODELS Centralized Gitflow Github Feature branch FEATURE BRANCH Commit Commit Commit Commit REBASE SQUASH … REBASE UPSTREAM BRANCH FEATURE FEATURE FEATURE FEATURE EPAM Systems 44
SOURCE HOOKS Use Cases SPELLING ERRORS ENFORCE RULES EMAIL / SMS NOTIFICATIONS DEPLOY TRIGGER http://githooks.com/ 9GDJQQMUVQQ All Git hooks are ordinary scripts that Git executes when certain events occur in the repository. This makes them very easy to install and configure Client Server PRE-COMMIT PREPARE-COMMIT-MSG COMMIT-MSG POST-COMMIT POST-CHECKOUT PRE-REBASE PRE-RECEIVE UPDATE POST-RECEIVE EPAM Systems 45
SOURCE COMMIT MESSAGES [FIX] Closes: #1234 [BREAKING] Interface of method has been changed… [COMPLETE] Feature (F16:Raptor) is ready for integration [ENV] Some minor refactoring MAKE YOUR CONVENTION ISSUE MANAGEMENT 1 2 3 RELEASE NOTES AND CHANGE LOGS 4 ANNOTATIONS: squash! fixup! ň+ņXGHKZGFVJCVʼn EPAM Systems 46
# CONTINUOUS INTEGRATION
CONTINUOUS INTEGRATION # TECHNICAL DEPT TESTS WILL BE IN THE NEXT RELEASE $WITKXGPGXGNQROGPV CODE ENTROPY: “IF I TOUCH THAT CODE EVERYTHING WILL BREAK” TODO/FIXME STATEMENTS DOCS? MY CODE IS STATE OF ART LET’S JUST COPY/PASTE FOR NOW 1 2 3 4 Fix this code, the only one who can. Is in another company already. http://en.wikipedia.org/wiki/Technical_debt 5 EPAM Systems 48
CONTINUOUS INTEGRATION # CODE QUALITY TECH BACKLOG CODE-STYLE: TABS/SPACES, INDENTATION .KUVQHVCUMU RTKQTKV[ STATIC ANALYZE AND COMPLEXITY: BUGS, DUPLICATION, STANDARDS 1 2 3 4 UNIT-TESTS AND COVERAGE DOCS AND COMMENTS AUTOMATE 5 EPAM Systems 49
CONTINUOUS INTEGRATION # CODE STYLE Other validations JSCS Presets - COFFEELINT - CSS - HTML Tools - JSHINT + STYLISH - PLATO - CODE PAINTER - EDITORCONFIG - JSCS - ESLINT - AIRBNB - CROCKFORD - GOOGLE - JQUERY - MDCS (THREE.JS) - WIKIMEDIA - YANDEX 1 2 3 4 5 READABILITY GOOD NAMES CLEAR LOGIC POTENTIAL ISSUES GUIDELINES EPAM Systems 50
CONTINUOUS INTEGRATION TESTS # 4GF)TGGP4GHCEVQT LONG (hours) FEEDBACK TIME MEDIUM (minutes) FAST (seconds) SMOKE TESTS UNIT-TESTS UI API TDD (BDD) BETTER CODE UNDERSTANDING 1 2 3 MOTIVATION 4 RELEASE FASTER RELIABILITY 5 FILE SYSTEM DATABASE HEADLESS END-TO-END SERVICES 5VWDU/QEMU .QECNQPN[ %CPDGTGOQVG 5CHGTTGHCEVQTKPI (KTUVHCKNGF 2GTHQTOCPEGOGVTKEU EPAM Systems 51
CONTINUOUS INTEGRATION FIXTURES # Permission.coffee Role.coffee module.exports.Permission = login: name: 'login' title: 'Login Page' ! home: name: 'home' title: 'Home Page' ! student: name: 'student' title: 'Student Section' ! moderator: name: 'moderator' title: 'Admin Section' module.exports.Role = guest: name: 'Guest' permissions: [ Permissions.login Permissions.home ] ! user: name: 'User' permissions: [ Permissions.home Permissions.student ] ! admin: name: 'Admin' permissions: [ Permissions.home Permissions.student Permissions.moderator ] db.Role Clean Role.coffee 6GUVKPI$TGNCVGFNQIKE EPAM Systems 52
CONTINUOUS INTEGRATION CODE COVERAGE # COVERALS.IO CODECLIMATE 97% NOT TESTED AREA OF APP DEAD CODE DETECTION 1 2 3 TESTING QUALITY 4 ACCEPTANCE THRESHOLD 70-90% 5 REPORTS Istanbul JSCoverage Blanket *KUVQT[CPFUVCVUUGTXKEG #9'51/' EPAM Systems 53
CONTINUOUS INTEGRATION DOCUMENTATION GENERATION # KEEP THEM UP-TO-DATE METHODS AND CLASSES 1 2 3 PUBLIC API 4 USAGE EXAMPLES 5 (RE) USE YOUR TESTS @example @depricated @package @private @api Output HTML MARKDOWN JSDoc @param @name @class @method @option Tools JSDOC* CROJSDOC APIDOCJS DOX MOX DOCCO CODO ;17$7+.6+6 ;17470+6Ŏ *WOCPTGCFCDNGCPF )KV*WDHTKGPFN[ EPAM Systems 54
CONTINUOUS INTEGRATION .dot files # Project System .gitignore .gitattributes .jshintrc .jshintignore .editorconfig .jscs.json .travis.yml ESSENTIAL PART OF YOUR ENVIRONMENT SHAREABLE CONFIGURATION EASY TO MANAGE 1 2 3 4 IDE INTEGRATION 5 NOT A TRASH .bashrc .zshrc .gitconfig .aliases .functions .osx http://dotfiles.github.io/ Invest time learning to configure your machine and automate processes 1P7PKZCNKMGU[UVGOU EPAM Systems 55
CONTINUOUS INTEGRATION IDE # Code Completion and Inspection Refactoring, Metrics 1 2 3 Test framework integration 4 Debugger, Frameworks support 5 Source Version control Issue trackers integration Online IDE CODIO CLOUD9 CODEBOX CODENVY 9GD5VQTO EPAM Systems 56
CONTINUOUS INTEGRATION # CI SERVERS BUILDS HISTORY AND VISIBILITY LAST GREEN/RED STATUS 1 2 3 PARALLEL BUILDS 4 MULTIPLE ENVIRONMENTS 5 ROLLBACK TOOLS JENKINS TEAMCITY GRUNT CONCRETE STRIDER CI 1+6;1745'.( And badges: http://shields.io/ EPAM Systems 57
CONTINUOUS INTEGRATION # HOSTED SERVICES CI AS A SERVICE INTEGRATED WITH GITHUB AND BITBUCKET 1 2 3 BUILD ON SCHEDULE 4 DEPLOY GREEN 5 REPORTS AND STATUS DASHBOARD Options circle.yml .travis.yml Services TRAVIS CI CODESHIP CIRCLE CI BAMBOO MAGNUM CI SEMAPHORE GONDOR RULTOR
[ON EPAM Systems 58
DEPLOY PLATFORMS
DEPLOY PLATFORMS SERVER # CUSTOMIZABLE STACK AND ENVIRONMENT DATA: COMPANY POLICY OWN SERVICES TO USE NEED FOR (DEV) OPS g / NGINX APACHE TOMCAT d e f g ÑSSH BASH 7SYSLOG # FILES TMP CACHE $SQL NOSQL KEY:VAL (SERVICES DAEMONS CRON mSENDMAIL W IPTABLES w .QQMUIQQF CHVGTC[GCTQTVYQ 1 2 3 4 5 INFRASTRUCTURE K +CC5#/#10+)+6#.1%'#0 QT4#%-52#%' EPAM Systems 60
EPAM Systems % 61 DEPLOY PLATFORMS PaaS # CLI DEPLOYS CONFIGURATION DASHBOARD 1 2 3 BUILDING BLOCKS (DISK SPACE, DB, MONITORING, ADDONS) 4 MONITORING 5 SLA AND NODES MANAGEMENT Services NODEJITSU HEROKU CLOUD FOUNDRY JOYENT ENGINE YARD #NN[QWPGGFVQTWP[QWTCRR 7RFCVGU5GEWTKV[Ŏ
DEPLOY PLATFORMS Docker # YOUR OWN PAAS OPEN SOURCE 1 2 3 EASY SCALE 4 MANY READY TO USE STACKS 5 EASY TO MIGRATE TOOLS DEIS FLYNN TSURU OCTOHOST ! 1RGP5QWTEG2CC5 YKVJ$NCEMLCEM #RRNKECVKQP 2NCVHQTO%QPVCKPGT EPAM Systems 62
7 MONITORING EVENTS METRICS
MONITORING EVENTS Logs management # FORMAT IS IMPORTANT AGGREGATION AND ROTATION 1 2 3 SEARCH 4 ALERTS AND NOTIFICATIONS 5 WATCHERS ITGRCEMUQTVQTŎ ŎWUGNQIUVCUJ EPAM Systems 64
MONITORING EVENTS Example # 2014/10/02 13:58:32 [error] 925#0: *14 connect() failed (111: Connection refused) while… CVG .GXGN 'XGPV SIZE DATE LOGS 10Mb Sept 10Mb Oct 07 EPAM Systems 65
MONITORING EVENTS Logging services # Services PAPERTAIL LOGENTRIES SUMOLOGIC BOUNDARY SENTRY GRAYLOG2 QKV[QWTUGNH APP %ELASTIC SEARCH DB SRV SYS n 8 ! 5QNWVKQPU CVCUQWTEGU EPAM Systems 66
MONITORING Errors # CONTEXT IS IMPORTANT GROUPING REPRODUCE FAIL GRACEFULLY HISTORY Services … RAYGUN TRACKJS AIRBRAKE QBAKA MUSCULA JSERRLOG TRACEKIT 1 2 3 4 5 5VCEMVTCEGQT)6(1 GHGEVKPRTQFWEVKQP! 9QTMUQPO[OCEJKPG QKV[QWTUGNH EPAM Systems 67
MONITORING METRICS Health Page # SERVICE #1 (UP) Ã SERVICE #1 (10k ops / s) Ã SERVICE #3 (10k users / s) Ã FREE SPACE (~2Gb) Â ;QWDGVVGTFQUQOGVJKPIYKVJKV HARDWARE SERVICES AND API 1 2 3 TRANSPORTS 4 PERFORMANCE 5 UPTIME EPAM Systems 68
SUMMARY
70 SUMMARY EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 +VņUGCU[KVUVCTV
71 SUMMARY EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 +VņUHTGGHQT[QWTVGCO
72 SUMMARY EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app BUILD PIPELINE Build Blocks Keep it fast Run cycles CONTINUOUS INTEGRATION ' ! # 7 QYPNQCFCPFKPVGITCVG
73 SUMMARY EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 1PGUOCNNUVGRHQT[QW IKCPVNGCRHQT[QWT2TQLGEV
74 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service +PVTQFWEGKV[QWTUGNH
Logs rotation 75 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service Metrics Checklist 5GG#EV2TGXGPV
Logs rotation 76 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service Metrics Checklist 6T[KVVQFC[

More Related Content

PPTX
London Node.js User Group - Cloud-native Node.js
byBethany Nicolle Griggs
 
PDF
Zero Downtime Deployment with Ansible
byStein Inge Morisbak
 
PDF
Automating your workflow with Gulp.js
byBo-Yi Wu
 
PPT
How to host an app for $20 in 20min using buildout and hostout
byDylan Jay
 
PDF
Zero Downtime Deployment with Ansible
byStein Inge Morisbak
 
PDF
Introduction to Node.JS
byEueung Mulyana
 
PDF
Frontend JS workflow - Gulp 4 and the like
byDamien Seguin
 
PDF
Automating Large Applications on Modular and Structured Form with Gulp
byAnderson Aguiar
 
London Node.js User Group - Cloud-native Node.js
byBethany Nicolle Griggs
 
Zero Downtime Deployment with Ansible
byStein Inge Morisbak
 
Automating your workflow with Gulp.js
byBo-Yi Wu
 
How to host an app for $20 in 20min using buildout and hostout
byDylan Jay
 
Zero Downtime Deployment with Ansible
byStein Inge Morisbak
 
Introduction to Node.JS
byEueung Mulyana
 
Frontend JS workflow - Gulp 4 and the like
byDamien Seguin
 
Automating Large Applications on Modular and Structured Form with Gulp
byAnderson Aguiar
 

What's hot

PDF
How to add non root user account to netapp for commvault
byAshwin Pawar
 
PDF
How to Install Configure and Use sysstat utils on RHEL 7
byVCP Muthukrishna
 
PDF
How To Configure Nginx Load Balancer on CentOS 7
byVCP Muthukrishna
 
PPTX
Bugzilla Installation Process
byVino Harikrishnan
 
PDF
NetApp ontap simulator
byAshwin Pawar
 
PDF
How To Install and Configure Salt Master on Ubuntu
byVCP Muthukrishna
 
PDF
Build system
byAndrey Subbota
 
PPTX
Web deploy command line
byLarry Nung
 
PPTX
Web deploy
byLarry Nung
 
PDF
FullStack London - Cloud Native Node.js
byBethany Nicolle Griggs
 
PDF
Buildout - Alles im Griff
byfrisi
 
PDF
“warpdrive”, making Python web application deployment magically easy.
byGraham Dumpleton
 
PPTX
NLIT 2011: Chef & Capistrano
bynickblah
 
TXT
Hello click click boom
bysymbian_mgl
 
PDF
Native Hadoop with prebuilt spark
byarunkumar sadhasivam
 
PDF
Install and Configure WordPress in AWS on RHEL 7 or CentOS 7
byVCP Muthukrishna
 
PPTX
Django deployment best practices
byErik LaBianca
 
PDF
Submitting and Reviewing changes lab guide
byopenstackcisco
 
TXT
Easy install
byLee Dohyup
 
PDF
Openstack bug list
byopenstackcisco
 
How to add non root user account to netapp for commvault
byAshwin Pawar
 
How to Install Configure and Use sysstat utils on RHEL 7
byVCP Muthukrishna
 
How To Configure Nginx Load Balancer on CentOS 7
byVCP Muthukrishna
 
Bugzilla Installation Process
byVino Harikrishnan
 
NetApp ontap simulator
byAshwin Pawar
 
How To Install and Configure Salt Master on Ubuntu
byVCP Muthukrishna
 
Build system
byAndrey Subbota
 
Web deploy command line
byLarry Nung
 
Web deploy
byLarry Nung
 
FullStack London - Cloud Native Node.js
byBethany Nicolle Griggs
 
Buildout - Alles im Griff
byfrisi
 
“warpdrive”, making Python web application deployment magically easy.
byGraham Dumpleton
 
NLIT 2011: Chef & Capistrano
bynickblah
 
Hello click click boom
bysymbian_mgl
 
Native Hadoop with prebuilt spark
byarunkumar sadhasivam
 
Install and Configure WordPress in AWS on RHEL 7 or CentOS 7
byVCP Muthukrishna
 
Django deployment best practices
byErik LaBianca
 
Submitting and Reviewing changes lab guide
byopenstackcisco
 
Easy install
byLee Dohyup
 
Openstack bug list
byopenstackcisco
 

Viewers also liked

PPTX
A broken body isn't a broken person - TEDx Talk by Janine Shepherd
bySameer Mathur
 
PDF
Miten sosiokratia voisi auttaa yhteisön päätöksentekoa?
byOsuuskunta Ehta Raha
 
PDF
Doma2 with Kotlin
byyy yank
 
PDF
Nsu catering guide
byDiana Sirghi
 
PDF
Lk eksponen
byrianika safitri
 
PDF
Supply Chain Metrics That Matter - A Focus on Pharmaceutical Companies - 27 A...
byLora Cecere
 
PDF
El escudo personal del retcambio
byDr.Jose A Santos. +4500 contactos
 
DOCX
Tipos de tequilas
byShelly Miller Moore
 
PDF
Power from big data - Are Europe's utilities ready for the age of data?
bySteve Bray
 
PPTX
Gross Domestic Product (GDP) - Canada - July 2016
bypaul young cpa, cga
 
PDF
TRANSIT Overview
byguest2af2cf
 
PDF
3 d pie chart circular puzzle with hole in center process 8 stages style 2 po...
bySlideTeam.net
 
PDF
Open Belgium 2015 Partner Proposal
byOpen Knowledge Belgium
 
PDF
Destination France - Le passeport pour l’attractivité culturelle
byLa French Team
 
PPTX
First competence / Third evidence / My last vacations
byJescica Barrera
 
DOC
Lengua cultura francesa
byfinaanton
 
PPTX
MedicalResearch.com: Medical Research Exclusive Interviews May 26 2015
byMarie Benz MD FAAD
 
DOCX
uas gangsal 2016/2016
byrianika safitri
 
PDF
Innovation participative poleemploiveutfaireemergerlesidees
bySarah DANINTHE
 
PDF
Lessons from Norway: Policy Responses to Evidence From PIACC
byIpsos UK
 
A broken body isn't a broken person - TEDx Talk by Janine Shepherd
bySameer Mathur
 
Miten sosiokratia voisi auttaa yhteisön päätöksentekoa?
byOsuuskunta Ehta Raha
 
Doma2 with Kotlin
byyy yank
 
Nsu catering guide
byDiana Sirghi
 
Lk eksponen
byrianika safitri
 
Supply Chain Metrics That Matter - A Focus on Pharmaceutical Companies - 27 A...
byLora Cecere
 
El escudo personal del retcambio
byDr.Jose A Santos. +4500 contactos
 
Tipos de tequilas
byShelly Miller Moore
 
Power from big data - Are Europe's utilities ready for the age of data?
bySteve Bray
 
Gross Domestic Product (GDP) - Canada - July 2016
bypaul young cpa, cga
 
TRANSIT Overview
byguest2af2cf
 
3 d pie chart circular puzzle with hole in center process 8 stages style 2 po...
bySlideTeam.net
 
Open Belgium 2015 Partner Proposal
byOpen Knowledge Belgium
 
Destination France - Le passeport pour l’attractivité culturelle
byLa French Team
 
First competence / Third evidence / My last vacations
byJescica Barrera
 
Lengua cultura francesa
byfinaanton
 
MedicalResearch.com: Medical Research Exclusive Interviews May 26 2015
byMarie Benz MD FAAD
 
uas gangsal 2016/2016
byrianika safitri
 
Innovation participative poleemploiveutfaireemergerlesidees
bySarah DANINTHE
 
Lessons from Norway: Policy Responses to Evidence From PIACC
byIpsos UK
 

Similar to Js infrostructure

PDF
JavaScript Application Design A Build First Approach 1st Edition Nicolas Beva...
byrcfbour9744
 
PDF
Node.js Tools Ecosystem
byRocket Software
 
PDF
Repository Management with JFrog Artifactory
byStephen Chin
 
PDF
Modern web applications infrastructure
byEPAM
 
PDF
Modern Web Application Development Workflow - EclipseCon Europe 2014
byStéphane Bégaudeau
 
PDF
The Secrets of The FullStack Ninja - Part A - Session I
byOded Sagir
 
PDF
Modern Web Application Development Workflow - web2day 2014
byStéphane Bégaudeau
 
PDF
Workflow automation for Front-end web applications
byMayank Patel
 
PPTX
Modern Development Tools
byYe Maw
 
KEY
Release management with NuGet/Chocolatey/JIRA
byYaroslav Serhieiev
 
PPTX
Docker for Development
byallingeek
 
PPT
Node js
byChirag Parmar
 
PDF
Multiplatform hybrid development
byDarko Kukovec
 
KEY
Nodeconf npm 2011
byFlorent Jaby ヅ
 
PPTX
GDG Morgantown, WV: Write code you can depend on!
byLogan Spears
 
PDF
Bringing Open-Source Practices to Your Day Job
byBen Coe
 
PPTX
Bringing Open-Source Practices to Your Day Job
byBen Coe
 
PDF
DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem
byFITC
 
PDF
DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem
byFITC
 
PPTX
Building node.js applications on windows azure
byAidan Casey
 
JavaScript Application Design A Build First Approach 1st Edition Nicolas Beva...
byrcfbour9744
 
Node.js Tools Ecosystem
byRocket Software
 
Repository Management with JFrog Artifactory
byStephen Chin
 
Modern web applications infrastructure
byEPAM
 
Modern Web Application Development Workflow - EclipseCon Europe 2014
byStéphane Bégaudeau
 
The Secrets of The FullStack Ninja - Part A - Session I
byOded Sagir
 
Modern Web Application Development Workflow - web2day 2014
byStéphane Bégaudeau
 
Workflow automation for Front-end web applications
byMayank Patel
 
Modern Development Tools
byYe Maw
 
Release management with NuGet/Chocolatey/JIRA
byYaroslav Serhieiev
 
Docker for Development
byallingeek
 
Node js
byChirag Parmar
 
Multiplatform hybrid development
byDarko Kukovec
 
Nodeconf npm 2011
byFlorent Jaby ヅ
 
GDG Morgantown, WV: Write code you can depend on!
byLogan Spears
 
Bringing Open-Source Practices to Your Day Job
byBen Coe
 
Bringing Open-Source Practices to Your Day Job
byBen Coe
 
DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem
byFITC
 
DownTheRabbitHole.js – How to Stay Sane in an Insane Ecosystem
byFITC
 
Building node.js applications on windows azure
byAidan Casey
 

Js infrostructure

  • 1.
    MODERN WEB APPLICATIONS ! INFRASTRUCTURE PRACTICES, FLOWS AND TOOLS $CUGFQP4'#.UVQTKGU
  • 2.
    ! ! IGORALPERT # IGOR_ALPERT@EPAM.COM HTTP://UA.LINKEDIN.COM/IN/IALPERT EPAM Systems 2
  • 3.
    Application ! ! GXGNQRGT EPAM Systems 3
  • 4.
    Application CSS JS HTML ! ! +%CP(62 EPAM Systems 4
  • 5.
    5 Application EPAMSystems $ Feature #1 Feature #2 Bug fixing ! 6JG[CEVCUCVGCO
  • 6.
    Logs 6 Application EPAM Systems $ % ! 5QWTEGEQFG )KICD[VGUQHFGDWI
  • 7.
    7 Application EPAMSystems Logs Doc ! $ % %QOOGPVU CPFGZCORNGU
  • 8.
    8 Application $ Logs Docs Config ! % KHHDGVYGGPFGXCPFRTQFWEVKQP EPAM Systems
  • 9.
    Packages 9 Application $ Config ! % L3WGT[CPFHTKGPFU EPAM Systems Logs Docs
  • 10.
    10 Application $ Logs Docs Config Tests ! % Packages *CRR[RCVJ EPAM Systems
  • 11.
    11 Application $ ! % /CIKEDWKNFU[UVGO EPAM Systems
  • 12.
    12 Application 0.5 $ 0.8 1.0 ! % #NRJC$GVC4% EPAM Systems
  • 13.
    13 Application 0.5 $ 0.8 1.0 ! Dev Test Prod % GXU3#5WRRQTV%NKGPV EPAM Systems
  • 14.
    14 Application 0.5 $ 0.8 1.0 ! Dev Test Prod APP DB SV % ' #RR5GTXGT EPAM Systems
  • 15.
    ' ' '' DB DB DB DB 15 Application $ ! % 6QPUQHUGTXGTU CPFCVC$CUGU EPAM Systems .QCFDCNCPEGT
  • 16.
    16 Application $ ! % 7 Errors Metrics Logs 7UGHWNKPHQTOCVKQPNKXGUJGTG EPAM Systems
  • 17.
    17 Agenda ! $ DEVELOPMENT WORKFLOW % SOURCE MANAGEMENT BUILD PIPELINE DEPLOY PLATFORMS 7 MONITORING METRICS # CONTINUOUS INTEGRATION EPAM Systems
  • 18.
  • 19.
    DEVELOPMENT WORKFLOW $ #TEJKVGEV6GEJ.GCFGXGNQRGTU DEV ( $ Managers 5WRRQTVGX1RU2TQDNGOOCPCIGOGPV ) QA % Support 3#.GCF/CPWCN#WVQOCVKQP #EEQWPV/CPCIGT#PCN[VKE EPAM Systems 19
  • 20.
    DEVELOPMENT WORKFLOW $ 6JG[YCPVVQEQFG 0GYHGCVWTGU6JG[YCPVVQIQNFGPRNCVGVJGKTEQFG 6JG[YCPVVQTGFWEGVGEJPKECNFGRV ( $ DEV #NYC[UJCXGUQOGňVKP[ʼnEJCPIG Managers ) QA % Support 6JG[YCPVUKORNKEKV[ 0QOQTGUWFFGPRNCVHQTO EJCPIGU 6JG[YCPVUVCDKNKV[ VQTGSWKTGOGPVUCPFUVQTKGU #UC7UGT+YCPVŎ -PQYPDWIU6QQOWEJVKOGVQFQHWNNTGITGUUKQP DGVVGTVQWUGRTGXKQWUňUVCDNGʼnXGTUKQP EPAM Systems 20
  • 21.
    DEVELOPMENT WORKFLOW $ $ DEV QA ( Managers ) % Support #EVYKVJ+PVGITKV[UJCTGFIQCNU EPAM Systems 21
  • 22.
    DEVELOPMENT WORKFLOW $ ( DESIGN ) TESTING $ DEVELOP BUILD, DEPLOY LAUNCH a BUG FIX ' 2-4 WEEKS ITERATION EPAM Systems 22
  • 23.
    DEVELOPMENT WORKFLOW #WVQOCVGFVGUVU %QNNCDQTCVKXGFGXGNQROGPV %QFGHGCVWTGUYKVJVGUVKPOKPF #WVQOCVGFDWKNF 9TKVGCUOWEJHCKNKPIVGUVUCURQUUKDNGVQ EQXGTTGSWKTGOGPVU 2NCPCPFGUKIP $ 'CEJUQWTEGEJCPIGVTKIIGTUYJQNG DWKNFRKRGNKPGVQTWP 6JKPMJQY[QWTHGCVWTGYKNNDG KORNGOGPVGFCPFKPVGITCVGFYKVJ QVJGTHGCVWTGU ( * % $ +PVGITCVKQP 4GCNVKOGOQPKVQTKPICPFHGGFDCEM UP TO 1 DAY ITERATION EPAM Systems 23
  • 24.
    24 DEVELOPMENT WORKFLOW SERVERS 1. NGINX 2. APACHE HTTPd 3. TOMCAT 4. IIS 5. NODEJS 6. EXPRESS 7. … EPAM Systems STYLES 1. TWITTER BOOTSTRAP 2. ZURB FOUNDATION 3. COMPASS 4. SASS 5. LESS 6. STYLUS 7. CUSTOM SOLUTION FRAMEWORKS 1. ANGULARJS 2. BACKBONE 3. EXTJS 4. SENCHA TOUCH 5. EMBERJS 6. METEOR 7. DERBY 8. CUSTOM SOLUTION TESTING 1. JASMINE 2. MOCHA 3. BUSTER 4. QUNIT 5. KARMA 6. PROTRACTOR 7. NIGHTWATCH 8. INTERN 9. WEBDRIVER.IO 10.CUSTOM SOLUTION OS 1. WINDOWS 2. OSX 3. UBUNTU 4. CENTOS 5. FREEBSD 6. COREOS TOOLS 1. GRUNT 2. GULP 3. NPM 4. BOWER 5. YEOMAN 6. CUSTOM SOLUTION DATABASES 1. MONGODB 2. COUCHDB 3. RIAK 4. REDIS 5. CASSANDRA SERVICES 1. AMAZON 2. NODEJITSU 3. HEROKU 4. MONGOLAB 5. FIREBASE 6. JOYENT 7. PUSHER 8. DOCKER $ 6QPUQHTGCF[VQWUG 1RVKQPUHQT[QWT RTQLGEV SERVER SIDE 1. PHP 2. RUBY 3. PYTHON 4. … !
  • 25.
    DEVELOPMENT WORKFLOW $ Ability to compile native modules — easier to “make from source” then in Windows ;QWTHTKGPFU VIRTUAL MACHINE NODEJS, RUBY, PYTHON Your toolset will ask for them as a dependency Works better and faster on Unix based systems WINDOWS Building a Module in Windows node-gyp, Python, shell, VS, … 55*0Q)7+ %JGH2WRRGV8 EPAM Systems 25
  • 26.
    DEPENDENCY MANAGEMENT $ Homebrew Packager for OSX, uses formulas to install software Mac OSX brew install [package] Advanced Packaging Tool Package manager for Debian GNU/Linux distribution and its variants Ubuntu apt-get install [package] Yum The Yellowdog Updater, Modified (yum) is an open-source command-line package management utility for Linux operating CentOS yum install [package] Chocolatey Chocolatey NuGet is a Machine Package Manager, somewhat like apt-get, but built with Windows in mind 42/ Windows choco install [package] '$ EPAM Systems 26
  • 27.
    DEPENDENCY MANAGEMENT $ OPENSSL PRCE NGINX PKG-CONFIG MAKEDEPEND GIT GIT-FLOW brew install git-flow brew install nginx EPAM Systems 27
  • 28.
    DEPENDENCY MANAGEMENT $ NVM APP1 Node 0.11x NVM APP2 Node 0.10.31 5VKNNVJGUCOGRTQLGEV EPAM Systems 28
  • 29.
    DEPENDENCY MANAGEMENT $ NodeJS Node Version Manager - Simple bash script to manage multiple active node.js versions NVM https://github.com/creationix/nvm Ruby RVM is the Ruby enVironment Manager. It manages Ruby application environments and enables switching between them RVM https://github.com/wayneeseguin/rvm Python It creates an environment that has its own installation directories, that doesn’t share libraries with other virtualenv environments virtualenv https://github.com/pypa/virtualenv NodeJS A Node version manager for the windows folks out there. Inspired by n and nodenv Nodist https://github.com/marcelklehr/nodist 9KPFQYU EPAM Systems 29
  • 30.
    DEPENDENCY MANAGEMENT $ +PVGTHCEGKUVJGUCOG NPM BOWER manager install dependencies: { name: version, name: folder, name: package }, devDependencies: { test-framework-name: version } dependencies: { name: version, name: folder, name: package }, devDependencies: { test-framework-name: version } manager install manager install EPAM Systems 30
  • 31.
    DEPENDENCY MANAGEMENT $ NPM LODASH GRUNT PACKAGE.JSON ASYNC DEV-DEPS KARMA Packages: Downloads: Corporate mirrors npm init npm install npm install —save QPņVHQTIGVVQ WRFCVG[QWTRCEMCIGU https://docs.npmjs.com/ EPAM Systems 31
  • 32.
    DEPENDENCY MANAGEMENT $ BOWER BACKBONE LODASH BOWER JQUERY UNDERSCORE BOOTSTRAP Packages: npm install -g bower init bower install http://bower.io/ (QTHTQPVGPF EPAM Systems 32
  • 33.
  • 34.
    BUILD PIPELINE Source Concatenate Uglify SourceMaps Test Karma Protractor Mocha Coverage Preprocess LESS SASS Compass Watch LiveReload Rebuild Serve Assets Templates CSS HTML processing Images optimization Custom ChangeLog Notifications console.debug 6CUMUVQCWVQOCVG KP[QWTDWKNFRKRGNKPG EPAM Systems 34
  • 35.
    BUILD PIPELINE ! GRUNT Packages: grunt grunt coffee:app FILE BASED Good for file operations like copy/move/save. Configuration over code. Better for small projects with small amount of files. TONS OF PLUGINS Most popular JS task runner. Almost any possible task is available as plugin. You can perform build-in or custom operations. Sync/ Async 1 2 Gruntfile.js Gruntfile.coffee jshint: { // define the files to lint files: ['gruntfile.js', 'src/**/*.js', 'test/**/*.js'], // configure JSHint options: { // more options here globals: { jQuery: true, console: true, module: true } } } http://gruntjs.com/ http://gruntjs.com/plugins ITWPVEQPVTKDLUJKPV EPAM Systems 35
  • 36.
    BUILD PIPELINE ! GULP 1 2 gulpfile.js EASY API Only 4 API methods: task, watch, src, dest. Easy to write complex flows. STREAM BASED No temporary files. Code over Configuration. Much more faster then Grunt for file-content processing operations. ZHCUVGT var gulp = require('gulp'); ! gulp.task('default', function() { // place code for your default task here }); Packages: npm install --save-dev gulp gulp grunt coffee http://gulpjs.com http://gulpjs.com/plugins/ EPAM Systems 36
  • 37.
    BUILD PIPELINE ! YEOMAN KARMA TESTS Pre-packed with test suites SCAFFOLDING Easy scaffolding system to generate application components SERVER Comes with build-in live-reload and grunt task 1 2 3 $ yo angular:controller myController $ yo angular:directive myDirective $ yo angular:filter myFilter $ yo angular:service myService http://gulpjs.com http://gulpjs.com/plugins/ Generators: ~1100 npm install -g yo npm install -g generator-angular yo angular ITWPVUGTXG EPAM Systems 37
  • 38.
    BUILD PIPELINE SLUSH https://www.npmjs.org/package/slush BROCCOLI https://www.npmjs.org/package/broccoli JAM AUTOMATION https://github.com/caolan/jam http://indigounited.com/automaton/ BRUNCH ANGUS http://brunch.io/ https://github.com/nickjanssen/angus ! EPAM Systems 38
  • 39.
  • 40.
    SOURCE GIT EASY BRANCHING AND MERGING Cheap branching — just a reference to commit. Lots of possible merging strategies and conflict resolving. History rewrite DISTRIBUTED You can work alone or with a team. You can work with or without central server. Even without network connection. FAST You can clone whole repo/branch or just a few commits. All meta-data is stored in one place ~/.git 1 2 3 git init ! git add git commit ! git push —force ! git rebase -i git merge ! git tag -a %QPHNKEVTGUQNXGF EPAM Systems 40
  • 41.
    SOURCE GITLAB PRIVATELY HOSTED You can integrate it with your own infrastructure, users base, private services etc TRUSTED BY ENTERPRISE Fully manageable and configurable Same capabilities — collaboration, forking, wiki and JIRA OPEN-SOURCE Hosted on GitHub. You can contribute and write your own features 1 2 3 - *CRR[%NKGPVU EPAM Systems 41
  • 42.
    SOURCE GITHUB WEB INTERFACE You are able to create branches, tags, pull-requests, edit and commit files directly from browser CODE REVIEW AND COLLABORATION Do code-review with your team, leave comments, track issues and maintain WIKI pages FORK, PULL REQUEST You can fork and contribute to any public repository. Home for open-source projects 1 2 3 Mirror mirror on the wall, who forks best of them all? EPAM Systems 42
  • 43.
    SOURCE BITBUCKET FREE PRIVATE REPOS Unlike GitHub this service will allow you to create *unlimited* amount of private repositories. ENTERPRISE ORIENTED Natively integrates with Atlasssian software stack. Trusted by Enterprise. SPOONING vs. FORKING Spooning - with Bitbucket is a pair programming process as an opposite to forking 1 2 3 ň$KVDWEMGVURQQPKPI ŃLWUV)QQINGKV EPAM Systems 43
  • 44.
    SOURCE BRANCHING MODELS Centralized Gitflow Github Feature branch FEATURE BRANCH Commit Commit Commit Commit REBASE SQUASH … REBASE UPSTREAM BRANCH FEATURE FEATURE FEATURE FEATURE EPAM Systems 44
  • 45.
    SOURCE HOOKS Use Cases SPELLING ERRORS ENFORCE RULES EMAIL / SMS NOTIFICATIONS DEPLOY TRIGGER http://githooks.com/ 9GDJQQMUVQQ All Git hooks are ordinary scripts that Git executes when certain events occur in the repository. This makes them very easy to install and configure Client Server PRE-COMMIT PREPARE-COMMIT-MSG COMMIT-MSG POST-COMMIT POST-CHECKOUT PRE-REBASE PRE-RECEIVE UPDATE POST-RECEIVE EPAM Systems 45
  • 46.
    SOURCE COMMIT MESSAGES [FIX] Closes: #1234 [BREAKING] Interface of method has been changed… [COMPLETE] Feature (F16:Raptor) is ready for integration [ENV] Some minor refactoring MAKE YOUR CONVENTION ISSUE MANAGEMENT 1 2 3 RELEASE NOTES AND CHANGE LOGS 4 ANNOTATIONS: squash! fixup! ň+ņXGHKZGFVJCVʼn EPAM Systems 46
  • 47.
  • 48.
    CONTINUOUS INTEGRATION # TECHNICAL DEPT TESTS WILL BE IN THE NEXT RELEASE $WITKXGPGXGNQROGPV CODE ENTROPY: “IF I TOUCH THAT CODE EVERYTHING WILL BREAK” TODO/FIXME STATEMENTS DOCS? MY CODE IS STATE OF ART LET’S JUST COPY/PASTE FOR NOW 1 2 3 4 Fix this code, the only one who can. Is in another company already. http://en.wikipedia.org/wiki/Technical_debt 5 EPAM Systems 48
  • 49.
    CONTINUOUS INTEGRATION # CODE QUALITY TECH BACKLOG CODE-STYLE: TABS/SPACES, INDENTATION .KUVQHVCUMU RTKQTKV[ STATIC ANALYZE AND COMPLEXITY: BUGS, DUPLICATION, STANDARDS 1 2 3 4 UNIT-TESTS AND COVERAGE DOCS AND COMMENTS AUTOMATE 5 EPAM Systems 49
  • 50.
    CONTINUOUS INTEGRATION # CODE STYLE Other validations JSCS Presets - COFFEELINT - CSS - HTML Tools - JSHINT + STYLISH - PLATO - CODE PAINTER - EDITORCONFIG - JSCS - ESLINT - AIRBNB - CROCKFORD - GOOGLE - JQUERY - MDCS (THREE.JS) - WIKIMEDIA - YANDEX 1 2 3 4 5 READABILITY GOOD NAMES CLEAR LOGIC POTENTIAL ISSUES GUIDELINES EPAM Systems 50
  • 51.
    CONTINUOUS INTEGRATION TESTS # 4GF)TGGP4GHCEVQT LONG (hours) FEEDBACK TIME MEDIUM (minutes) FAST (seconds) SMOKE TESTS UNIT-TESTS UI API TDD (BDD) BETTER CODE UNDERSTANDING 1 2 3 MOTIVATION 4 RELEASE FASTER RELIABILITY 5 FILE SYSTEM DATABASE HEADLESS END-TO-END SERVICES 5VWDU/QEMU .QECNQPN[ %CPDGTGOQVG 5CHGTTGHCEVQTKPI (KTUVHCKNGF 2GTHQTOCPEGOGVTKEU EPAM Systems 51
  • 52.
    CONTINUOUS INTEGRATION FIXTURES # Permission.coffee Role.coffee module.exports.Permission = login: name: 'login' title: 'Login Page' ! home: name: 'home' title: 'Home Page' ! student: name: 'student' title: 'Student Section' ! moderator: name: 'moderator' title: 'Admin Section' module.exports.Role = guest: name: 'Guest' permissions: [ Permissions.login Permissions.home ] ! user: name: 'User' permissions: [ Permissions.home Permissions.student ] ! admin: name: 'Admin' permissions: [ Permissions.home Permissions.student Permissions.moderator ] db.Role Clean Role.coffee 6GUVKPI$TGNCVGFNQIKE EPAM Systems 52
  • 53.
    CONTINUOUS INTEGRATION CODE COVERAGE # COVERALS.IO CODECLIMATE 97% NOT TESTED AREA OF APP DEAD CODE DETECTION 1 2 3 TESTING QUALITY 4 ACCEPTANCE THRESHOLD 70-90% 5 REPORTS Istanbul JSCoverage Blanket *KUVQT[CPFUVCVUUGTXKEG #9'51/' EPAM Systems 53
  • 54.
    CONTINUOUS INTEGRATION DOCUMENTATION GENERATION # KEEP THEM UP-TO-DATE METHODS AND CLASSES 1 2 3 PUBLIC API 4 USAGE EXAMPLES 5 (RE) USE YOUR TESTS @example @depricated @package @private @api Output HTML MARKDOWN JSDoc @param @name @class @method @option Tools JSDOC* CROJSDOC APIDOCJS DOX MOX DOCCO CODO ;17$7+.6+6 ;17470+6Ŏ *WOCPTGCFCDNGCPF )KV*WDHTKGPFN[ EPAM Systems 54
  • 55.
    CONTINUOUS INTEGRATION .dotfiles # Project System .gitignore .gitattributes .jshintrc .jshintignore .editorconfig .jscs.json .travis.yml ESSENTIAL PART OF YOUR ENVIRONMENT SHAREABLE CONFIGURATION EASY TO MANAGE 1 2 3 4 IDE INTEGRATION 5 NOT A TRASH .bashrc .zshrc .gitconfig .aliases .functions .osx http://dotfiles.github.io/ Invest time learning to configure your machine and automate processes 1P7PKZCNKMGU[UVGOU EPAM Systems 55
  • 56.
    CONTINUOUS INTEGRATION IDE # Code Completion and Inspection Refactoring, Metrics 1 2 3 Test framework integration 4 Debugger, Frameworks support 5 Source Version control Issue trackers integration Online IDE CODIO CLOUD9 CODEBOX CODENVY 9GD5VQTO EPAM Systems 56
  • 57.
    CONTINUOUS INTEGRATION # CI SERVERS BUILDS HISTORY AND VISIBILITY LAST GREEN/RED STATUS 1 2 3 PARALLEL BUILDS 4 MULTIPLE ENVIRONMENTS 5 ROLLBACK TOOLS JENKINS TEAMCITY GRUNT CONCRETE STRIDER CI 1+6;1745'.( And badges: http://shields.io/ EPAM Systems 57
  • 58.
    CONTINUOUS INTEGRATION # HOSTED SERVICES CI AS A SERVICE INTEGRATED WITH GITHUB AND BITBUCKET 1 2 3 BUILD ON SCHEDULE 4 DEPLOY GREEN 5 REPORTS AND STATUS DASHBOARD Options circle.yml .travis.yml Services TRAVIS CI CODESHIP CIRCLE CI BAMBOO MAGNUM CI SEMAPHORE GONDOR RULTOR
  • 59.
  • 60.
  • 61.
    DEPLOY PLATFORMS SERVER # CUSTOMIZABLE STACK AND ENVIRONMENT DATA: COMPANY POLICY OWN SERVICES TO USE NEED FOR (DEV) OPS g / NGINX APACHE TOMCAT d e f g ÑSSH BASH 7SYSLOG # FILES TMP CACHE $SQL NOSQL KEY:VAL (SERVICES DAEMONS CRON mSENDMAIL W IPTABLES w .QQMUIQQF CHVGTC[GCTQTVYQ 1 2 3 4 5 INFRASTRUCTURE K +CC5#/#10+)+6#.1%'#0 QT4#%-52#%' EPAM Systems 60
  • 62.
    EPAM Systems % 61 DEPLOY PLATFORMS PaaS # CLI DEPLOYS CONFIGURATION DASHBOARD 1 2 3 BUILDING BLOCKS (DISK SPACE, DB, MONITORING, ADDONS) 4 MONITORING 5 SLA AND NODES MANAGEMENT Services NODEJITSU HEROKU CLOUD FOUNDRY JOYENT ENGINE YARD #NN[QWPGGFVQTWP[QWTCRR 7RFCVGU5GEWTKV[Ŏ
  • 63.
    DEPLOY PLATFORMS Docker # YOUR OWN PAAS OPEN SOURCE 1 2 3 EASY SCALE 4 MANY READY TO USE STACKS 5 EASY TO MIGRATE TOOLS DEIS FLYNN TSURU OCTOHOST ! 1RGP5QWTEG2CC5 YKVJ$NCEMLCEM #RRNKECVKQP 2NCVHQTO%QPVCKPGT EPAM Systems 62
  • 64.
  • 65.
    MONITORING EVENTS Logs management # FORMAT IS IMPORTANT AGGREGATION AND ROTATION 1 2 3 SEARCH 4 ALERTS AND NOTIFICATIONS 5 WATCHERS ITGRCEMUQTVQTŎ ŎWUGNQIUVCUJ EPAM Systems 64
  • 66.
    MONITORING EVENTS Example # 2014/10/02 13:58:32 [error] 925#0: *14 connect() failed (111: Connection refused) while… CVG .GXGN 'XGPV SIZE DATE LOGS 10Mb Sept 10Mb Oct 07 EPAM Systems 65
  • 67.
    MONITORING EVENTS Logging services # Services PAPERTAIL LOGENTRIES SUMOLOGIC BOUNDARY SENTRY GRAYLOG2 QKV[QWTUGNH APP %ELASTIC SEARCH DB SRV SYS n 8 ! 5QNWVKQPU CVCUQWTEGU EPAM Systems 66
  • 68.
    MONITORING Errors # CONTEXT IS IMPORTANT GROUPING REPRODUCE FAIL GRACEFULLY HISTORY Services … RAYGUN TRACKJS AIRBRAKE QBAKA MUSCULA JSERRLOG TRACEKIT 1 2 3 4 5 5VCEMVTCEGQT)6(1 GHGEVKPRTQFWEVKQP! 9QTMUQPO[OCEJKPG QKV[QWTUGNH EPAM Systems 67
  • 69.
    MONITORING METRICS Health Page # SERVICE #1 (UP) Ã SERVICE #1 (10k ops / s) Ã SERVICE #3 (10k users / s) Ã FREE SPACE (~2Gb) Â ;QWDGVVGTFQUQOGVJKPIYKVJKV HARDWARE SERVICES AND API 1 2 3 TRANSPORTS 4 PERFORMANCE 5 UPTIME EPAM Systems 68
  • 70.
  • 71.
    70 SUMMARY EPAMSystems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 +VņUGCU[KVUVCTV
  • 72.
    71 SUMMARY EPAMSystems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 +VņUHTGGHQT[QWTVGCO
  • 73.
    72 SUMMARY EPAMSystems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app BUILD PIPELINE Build Blocks Keep it fast Run cycles CONTINUOUS INTEGRATION ' ! # 7 QYPNQCFCPFKPVGITCVG
  • 74.
    73 SUMMARY EPAMSystems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION ' ! # 7 1PGUOCNNUVGRHQT[QW IKCPVNGCRHQT[QWT2TQLGEV
  • 75.
    74 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service +PVTQFWEGKV[QWTUGNH
  • 76.
    Logs rotation 75 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service Metrics Checklist 5GG#EV2TGXGPV
  • 77.
    Logs rotation 76 SUMMARY ' ! # 7 EPAM Systems DEVELOPMENT WORKFLOW SOURCE MANAGEMENT DEPLOY PLATFORMS MONITORING METRICS Automate Tests Small features Code style Commits convention 12 factor app Build Blocks Keep it fast Run cycles Fail early Fast feedback Step by Step BUILD PIPELINE CONTINUOUS INTEGRATION DevOps Production alike …as a Service Metrics Checklist 6T[KVVQFC[