A Taste of What’s Cooking at US Foods
Step 1 in our quest for DevOps
November 13th, 2015
David Kent - Senior Director, Enterprise Architecture
David.kent@usfoods.com
Where we’ve come from
2
Step 1 in our Quest (Complete)
● Business
● In 2012 we made a commitment to rethink our ECOM strategy
● Adopted Agile Methodology - Agile Coaches Hired
● Dev
● New tools adopted (Jira, SVN, Archiva)
● Starting Build Automation (CI with Bamboo, SVN, Archiva)
● Ops
● Leverage Virtualization – Linux virtual machine is standard
● Starting automating server builds (Ansible, Python scripting)
● Implemented APM solution (New Relic)
● QA
● Implemented Testing Automation (HP QC, Perfecto Mobile)
3
ECOM Reference Architecture
● Oracle Database
● Oracle WebLogic Server
● Oracle WebCenter Portal
● Oracle Coherence
● Oracle API Gateway
● Oracle Endeca Search
● Tibco EMS
● Tibco BW
● Kony Mobile Platform
4
ECOM Roll Out
● 166K Customers (107K Customers Order through ECOM)
● ECOM “Release 3” Customer Rollout 85% complete
ECOM Historical Adoption (% of Revenue) ECOM R3 Roll Out (Customers versus Order Volume)
5
New Relic Configuration
APM Licenses
Since 1 month ago
250
Licenses
Agents deployed
Since 1 month ago
223
Agents
Active Users
Since 1 month ago
121
Users
Applications Monitored
Since 1 month ago
40
Applications
Server Agents
Since 1 month ago
116
Agents
Dashboards
Since 1 month ago
6
Dashboards
Plugins Configured
Since 1 month ago
5
Plugins
Mobile
Since 1 month ago
Pilot
Status
Browser
Since 1 month ago
Pilot
Status
F5 LTM
Apache HTTPd
Endeca
Redis
Elastic Search
Oracle DB
6
Challenges
Geographic Financial
Tools GapsCultural, Technical
7
Dev Ops Tools Status
Source Code Management
Containers
Monitoring
Logging
Continuous Integration
Configuration Management
Security
Build
Testing
Deployment
Collaboration
Cloud / IaaS / PaaS
Release Management Repo Management Code Quality / Peer Review
???
Complete POC Gap
8
Agile Development Tools
Conceptual Physical
9
Step 2 in our quest (To Do)
Focus on culture and collaboration
● Educate IT on the benefits of DevOps culture
Operations Improvements
● Build a private cloud (Vrealize Automation)
● Embrace Infrastructure Automation (Chef)
● More automation between teams
QA Improvements
● ECOM has 80% automated test coverage
● Improve test environments
Dev Improvements
● Config file tokenization/templating strategy
● Artifact versioning standardization
● Unit test/code coverage improvements across
dev teams
Monitoring Improvements
● Leverage more New Relic tools (Browser,
Insights, Synthetics, Ducksboard)
Planning Improvements
● Move from project teams to product teams
1
1
2
2
3
3
4
4
5
5
6
6
10
64 WebSphere JVMs / 15 WebLogic JVMs
Release 2
Release 3
11
New Relic APM - ECOM Portal Farm
12
Web Services Farm with EJB Transaction graphs
13
New Relic Dashboards
Server Agent: CPU Usage/Load of ECOM Servers
14
New Relic Synthetics
Basic Ping of ECOM Portal Farm
15
New Relic Browser
16
New Relic Plugins
F5 Load Balancing Throughput
17
New Relic Insights
18
New Relic Tools (Custom Dashboards)
19
New Relic Servers
20
New Relic APM: All Transactions Table
21
New Relic APM: Errors
22
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods  11122015

New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods 11122015

  • 1.
    A Taste ofWhat’s Cooking at US Foods Step 1 in our quest for DevOps November 13th, 2015 David Kent - Senior Director, Enterprise Architecture David.kent@usfoods.com
  • 2.
  • 3.
    Step 1 inour Quest (Complete) ● Business ● In 2012 we made a commitment to rethink our ECOM strategy ● Adopted Agile Methodology - Agile Coaches Hired ● Dev ● New tools adopted (Jira, SVN, Archiva) ● Starting Build Automation (CI with Bamboo, SVN, Archiva) ● Ops ● Leverage Virtualization – Linux virtual machine is standard ● Starting automating server builds (Ansible, Python scripting) ● Implemented APM solution (New Relic) ● QA ● Implemented Testing Automation (HP QC, Perfecto Mobile) 3
  • 4.
    ECOM Reference Architecture ●Oracle Database ● Oracle WebLogic Server ● Oracle WebCenter Portal ● Oracle Coherence ● Oracle API Gateway ● Oracle Endeca Search ● Tibco EMS ● Tibco BW ● Kony Mobile Platform 4
  • 5.
    ECOM Roll Out ●166K Customers (107K Customers Order through ECOM) ● ECOM “Release 3” Customer Rollout 85% complete ECOM Historical Adoption (% of Revenue) ECOM R3 Roll Out (Customers versus Order Volume) 5
  • 6.
    New Relic Configuration APMLicenses Since 1 month ago 250 Licenses Agents deployed Since 1 month ago 223 Agents Active Users Since 1 month ago 121 Users Applications Monitored Since 1 month ago 40 Applications Server Agents Since 1 month ago 116 Agents Dashboards Since 1 month ago 6 Dashboards Plugins Configured Since 1 month ago 5 Plugins Mobile Since 1 month ago Pilot Status Browser Since 1 month ago Pilot Status F5 LTM Apache HTTPd Endeca Redis Elastic Search Oracle DB 6
  • 7.
  • 8.
    Dev Ops ToolsStatus Source Code Management Containers Monitoring Logging Continuous Integration Configuration Management Security Build Testing Deployment Collaboration Cloud / IaaS / PaaS Release Management Repo Management Code Quality / Peer Review ??? Complete POC Gap 8
  • 9.
  • 10.
    Step 2 inour quest (To Do) Focus on culture and collaboration ● Educate IT on the benefits of DevOps culture Operations Improvements ● Build a private cloud (Vrealize Automation) ● Embrace Infrastructure Automation (Chef) ● More automation between teams QA Improvements ● ECOM has 80% automated test coverage ● Improve test environments Dev Improvements ● Config file tokenization/templating strategy ● Artifact versioning standardization ● Unit test/code coverage improvements across dev teams Monitoring Improvements ● Leverage more New Relic tools (Browser, Insights, Synthetics, Ducksboard) Planning Improvements ● Move from project teams to product teams 1 1 2 2 3 3 4 4 5 5 6 6 10
  • 11.
    64 WebSphere JVMs/ 15 WebLogic JVMs Release 2 Release 3 11
  • 12.
    New Relic APM- ECOM Portal Farm 12
  • 13.
    Web Services Farmwith EJB Transaction graphs 13
  • 14.
    New Relic Dashboards ServerAgent: CPU Usage/Load of ECOM Servers 14
  • 15.
    New Relic Synthetics BasicPing of ECOM Portal Farm 15
  • 16.
  • 17.
    New Relic Plugins F5Load Balancing Throughput 17
  • 18.
  • 19.
    New Relic Tools(Custom Dashboards) 19
  • 20.
  • 21.
    New Relic APM:All Transactions Table 21
  • 22.
    New Relic APM:Errors 22