Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
DevOps at Callcredit
…..a year nearer awesome
Ian Watson
Head of DevOps at Callcredit
Email : ian.watson@callcreditgroup.com
Twitter : @purplemarauder
I am….
What’s the challenge?
Where we were….
Actual Deployment plan
Check if access to the deployment packages is available.
• R:Callcredit Development DMLLLBuildsRele...
We needed to change
Research, research, research
What is DevOps?
Universal Truths
You can’t ‘do’ DevOps…
…. in a windows Environment
…. on an Enterprise scale
…. in a database-centric com...
Topologies
The Teams – System Build
The Teams – Platform Build
Death to Manual Deployments!
Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in ...
Death to Manual Deployments!
Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in ...
Death to Manual Deployments!
Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in ...
Deployment automation - Picking a tool
https://xebialabs.com/periodic-table-of-devops-tools/
Pilot teams
Continuous Delivery
What :
We make sure our software is always potentially shippable throughout its
entire lifecycle and t...
Deploying Databases isn’t easy
But it doesn’t
have to be
difficult either
0
10
20
30
40
50
60
70
80
Aug Sept Oct Nov Dec Jan Feb Mar Apr
Test Pre-Prod Prod
Deployments/Month
Meanwhile – Platform & Infrastructure….
Tooling, tooling, tooling
Achievements so far
Achievements so far…
People actually understand
what DevOps is!
In fact…
We now have an active DevOps
Community 
Achievements so far…
A new definition of done
“it’s been coded and tested”
“it’s working in Production”
Achievements so far…
Packaged, scripted deployments are now the standard
rather than the exception
40% of products deployi...
Achievements so far…
Able to build dozens of
version controlled servers
in very short timescales
Not all smooth sailing
Culture change is HARD!
Technical challenges
Too fast?
Still plenty of work to do to get to….
Next steps along the road - Culture
- Complete the move from Project Teams to Product Teams
- Really treating Pre-Producti...
Next steps along the road - Monitoring
- MUCH more monitoring – proactive rather than reactive and visible to everyone
- L...
Next steps along the road - Environments
- IaaS – internally and externally
- MUCH more monitoring – proactive rather than...
Next steps along the road – Delivery
- Blue/Green deployments with zero downtime
- Continuous performance testing
Anyone can ‘do’ DevOps
If we can…..
Just keep aiming at Awesome!
Ian Watson - DevOps at Callcredit….a year nearer awesome
Ian Watson - DevOps at Callcredit….a year nearer awesome
Upcoming SlideShare
Loading in …5
×

Ian Watson - DevOps at Callcredit….a year nearer awesome

511 views

Published on

Agile Tour Kaunas 2015
http://agileturas.lt/kaunas

Published in: Leadership & Management
  • Be the first to comment

  • Be the first to like this

Ian Watson - DevOps at Callcredit….a year nearer awesome

  1. 1. DevOps at Callcredit …..a year nearer awesome
  2. 2. Ian Watson Head of DevOps at Callcredit Email : ian.watson@callcreditgroup.com Twitter : @purplemarauder I am….
  3. 3. What’s the challenge?
  4. 4. Where we were….
  5. 5. Actual Deployment plan Check if access to the deployment packages is available. • R:Callcredit Development DMLLLBuildsRelease- v6.1.56.14856.zip Extract the relevant (Web or App) files zip within the release to c:program filescallcreditLL on each Web and App servers. Ensure the correct rollback version location is known. Deployment Steps Instruction Done (1,2&3) Done (4,5&6) Run script to take the first 3 pairs of Web and App servers out of the pool “C:scriptsscripts” on WIN**WB01 server….(run Phase 1 script). ENSURE YOU ARE NOT REMOVING ALL SERVERS FROM THE POOL On the app server: • Open a command prompt in the "Release" folder, e.g. "C:Program FilescallcreditLL v6.1.56.14856Release" • Enter the command: • Teardown_APP On the app server: • Open a command prompt in the "Release" folder, e.g. "C:Program FilescallcreditLL v6.1.56.14856Release" • Enter the command: • nant -D:"config=siteconfigid" -D:"encrypt.key=yourencryptionkey“ ptionkey = see app support passwordsafe) (where siteconfigid: • Live = “LV” • Site 2 QA = “qa” • Site 2 CT = “ct” On the web server, open INETMGR and delete the following: From IIS ? Callcredit Web Site ? services • Admin • Call • DL1 • DL2 • LL From IIS ? Callcredit Web Site • Call • DL • LL On the web server: • Open a command prompt in the "Release" folder, e.g. "C:Program FilescallcreditLL v6.1.56.14856Release" • Enter the command: • Teardown_WEB On the web server: • Open a command prompt in the "Release" folder, e.g. "C:Program FilesLL v6.1.56.14856Release" • Enter the command: • nant -D:"config=siteconfigid"-D:"encrypt.key=yourencryptionkey" (where yourencryptionkey= see app support passwordsafe) (where siteconfigid: • Live = “LV” • Site 2 QA = “qa” • Site 2 CT = “ct” On each of the App servers: Under component servicescomputersCOM+ApplicationsCAST Job controllerRolesPermittedUsers Add the user: ServerName_LL_CS_WebSvc e.g. OLSWINxxAP0xLL_CS_WebSvc the user should already be present under computer Managementusers On each of the App servers: Open DCOMCNFG -> servicescomputersCOM+ApplicationsCAST Job controller Right click on the component and: • Shut down • Disable • Enable DBA should run following script on ML_Lookup_Vws5 databse: UPDATE vw_IDType SET [Desc] = 'Passport' WHERE [ID] = 5 Rerun the pairing scripts to update COM+ configs (if COM+ has been updated) ENSURE YOU ARE RUNNING THE CORRECT “PHASE” SCRIPT TO MAINTAIN SEPERATION BETWEEN UPGRADED AND NOT UPGRADED VERSIONS OF THE RELEASE!! QA can then verify the web and app tier install Add the 3 pairs back into the pool and remove next 3 pairs (run phase 2 script). ENSURE YOU ARE RUNNING THE CORRECT “PHASE” SCRIPT Repeat above steps for each pair Once paired testing is complete, add all servers back into pool (run Phase 3 script) ENSURE YOU ARE RUNNING THE CORRECT “PHASE” SCRIPT QA will perform a final BIGIP test.
  6. 6. We needed to change
  7. 7. Research, research, research
  8. 8. What is DevOps?
  9. 9. Universal Truths You can’t ‘do’ DevOps… …. in a windows Environment …. on an Enterprise scale …. in a database-centric company
  10. 10. Topologies
  11. 11. The Teams – System Build
  12. 12. The Teams – Platform Build
  13. 13. Death to Manual Deployments! Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in the market now and in the future (2014), PuppetLabs State of DevOps Report 2014
  14. 14. Death to Manual Deployments! Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in the market now and in the future (2014), PuppetLabs State of DevOps Report 2014
  15. 15. Death to Manual Deployments! Numbers from : OctopusDeployment AutomationSurvey 2013, State of SoftwareDelivery: Trends in the market now and in the future (2014), PuppetLabs State of DevOps Report 2014
  16. 16. Deployment automation - Picking a tool https://xebialabs.com/periodic-table-of-devops-tools/
  17. 17. Pilot teams
  18. 18. Continuous Delivery What : We make sure our software is always potentially shippable throughout its entire lifecycle and that any build could potentially be released to users at the touch of a button using a fully automated process. Why : We can put the release schedule in the hands of the business rather than IS. Be this with a regular rhythm or on demand.
  19. 19. Deploying Databases isn’t easy But it doesn’t have to be difficult either
  20. 20. 0 10 20 30 40 50 60 70 80 Aug Sept Oct Nov Dec Jan Feb Mar Apr Test Pre-Prod Prod Deployments/Month
  21. 21. Meanwhile – Platform & Infrastructure…. Tooling, tooling, tooling
  22. 22. Achievements so far
  23. 23. Achievements so far… People actually understand what DevOps is!
  24. 24. In fact… We now have an active DevOps Community 
  25. 25. Achievements so far… A new definition of done “it’s been coded and tested” “it’s working in Production”
  26. 26. Achievements so far… Packaged, scripted deployments are now the standard rather than the exception 40% of products deploying via Octopus Deploy
  27. 27. Achievements so far… Able to build dozens of version controlled servers in very short timescales
  28. 28. Not all smooth sailing Culture change is HARD!
  29. 29. Technical challenges
  30. 30. Too fast?
  31. 31. Still plenty of work to do to get to….
  32. 32. Next steps along the road - Culture - Complete the move from Project Teams to Product Teams - Really treating Pre-Production and Production the same - We need to breed more champions across the company – Development, Security, Operations, Business
  33. 33. Next steps along the road - Monitoring - MUCH more monitoring – proactive rather than reactive and visible to everyone - Log aggregation – choose a tool and allow access to Dev and Ops - Get development teams delivering monitoring as a standard part of any system
  34. 34. Next steps along the road - Environments - IaaS – internally and externally - MUCH more monitoring – proactive rather than reactive and visible to everyone - The Cloud – use the best technology for the required solution
  35. 35. Next steps along the road – Delivery - Blue/Green deployments with zero downtime - Continuous performance testing
  36. 36. Anyone can ‘do’ DevOps If we can…..
  37. 37. Just keep aiming at Awesome!

×