1 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
CollabNet DevOps Product Strategy
Putting the Ops back into DevOps for Operational Intelligence
Eric Robertson
DevOps Product Line General Manager
2 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
My Background and Story
• Responsible for the strategic direction of the DevOps product line at CollabNet.
• Led a solutions and services team at Unisys for migrating legacy environments to Web-scale-IT
architectures
• Joined Cisco through a company acquisition (Tidal Software), where he served as Director for Product
Management and as a subject-matter expert and solution management leader for Cisco’s cloud
orchestration and automation products.
• Spearheaded the joint partnership between Cisco and SAP, whereby, SAP resold Cisco’s Intelligent
Automation solution as a SAP Application Lifecycle Management (ALM) extension.
• Successfully held product engineering and management roles (Microsoft, Motorola, HP, BMC
Software, Cap Gemini) and has provided consulting to Fortune 500 companies.
• Hold patents in the area of Hardware Abstraction Layers for Microkernel OS and a Bachelor Degree in
Computer Science and Master’s Degree in Electrical and Software Engineering from University of
Texas in Austin.
3 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Agile Focus Areas
CollabNet defines three Agile focus areas:
• Agile PPM: Agile “planning” capabilities including project, portfolio & program level, backlog and
milestone management, capacity planning, etc.
• Agile Execution: features focused on Agile team execution of iterations and kanban-style workflow
• Downstream Agile: visibility and traceability of engineering activities downstream of planning and
tasking (SCM, CI, CD, etc.).
Agile
PPM
Upstream Agile
Version
control
Continuous
Delivery
Continuous
Integration
Binary
Repository
Downstream Agile
Agile
Execution
Operations
4 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Software Development Lifecycle Traceability and Visibility
5 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Our DevOps Focus Areas
Continuous Lifecycle Integration (Plan-to-Ops)
Continuous Integration
Continuous Delivery Management
Focus areas (as per Forrester Research):
Key Benefits:
INTEGRATION
Leverage investment
in existing infrastructure
and tools Interchange
tools to match
evolving needs
AUTOMATION
Detect events and
take actions
(across tools &
workflow systems)
TRACEABILITY
For impact analysis
and fast-fix
VERSION
CONTROL
[everything]
Across the
pipeline (Source,
IaC, OaC)
REPORTING
Single pane of
glass reporting
(metrics , KPIs)
across tool chain
CONTINUOUS
FEEDBACK
Ops-to-Plan with
Collaboration
(ChatOps)
Continuous Lifecycle Integration spanning the tool chain across Plan-to-Ops
6 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Supporting Multi-Variant Software Development Life-cycle
Write
(ALM)
Store
(SCM)
Deploy - Continuous
Delivery
(ARA)
DevOps:
Operation
Intelligence
(Ops)
Plan-to-Ops Life-cycle Integration
Biz Value
through
feature
Lifecycle Continuous Feedback,
Traceability & Visibility
Teamforge
Teamforge
SCM
Electric Cloud /
Xebia/Clarive
IBM UrbanCode
Mode 2 - Container
Deployment Engines
Mode 2 - Planning, Dev & Test Tools
Monitoring
ITIL tools
7 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Trace view – exploring traceability
8 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Associations list view
9 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
TeamForge – Leverage Association and Extend Downstream
“Assoc”
Project App
10 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
TeamForge – Downstream linkage
“Assoc”
Project App
Provide Lifecycle Automation and Orchestration
Provide Tool
Chain Integration
MetaModel (Schemas)
Tool Chain Integration
11 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
ALERT MONITORING
HEALTH EVENT
WORK ITEM
Continuous Lifecycle Integration Featuring End-to-End Traceability
SERVICE DESK
COMPLIANCE AUDIT
SECURITY CHECK
DEPLOYMENT
EPIC
STORY
TASK
COMMIT
CODE REVIEW
CI BUILD
BINARY
TEST
PLAN CODE BUILD TEST RELEASE DEPLOY OPERATE MONITORREVIEW
RELEASE PACKAGE
12 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
DevOps Integration and Workflow Extension
7
Networkin
g
Security
CI/CD/CM Workflows
Security
• Sensors are inbound integration plugins that watch for
events from external systems. When an event occurs, it
fires a trigger (e.g., NewRelic app performance alert,
Github commit, or JIRA issue update).
• Rules use the trigger to select which action or workflow
to execute and pass the data needed to execute the
action.
• Workflows stitch actions together into “uber-actions”
with simple declarative DSL, defining the order,
transitions, conditions, and data flow.
• Actions are outbound integrations and can be any
scripts with meta-data. Actions are invoked by users
via GUI, CLI, API, or ChatOps(*), or triggered by
automations - rules and workflows.
• Audit trails record action executions, whether manual
or automated, and stores them with full details of
triggering context and execution results.
13 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Out-of-the-box Rule Based Templates Across Tool
Chains and Version Controlled!
Continuous Integration (CI)
& Testing Flows
Continuous Release &
Deployment Flows
Continuous Monitoring &
Operations Flows
Workflows for Sensing and Executing Actions
Environment, Orchestration, Integration
and Intelligence captured as Code
14 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Dashboard and SDLC Traceability
Concept
15 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Deployment Drilldown to Health Events
16 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Deployment Drilldown to Security and Compliance Events
17 Copyright © 2016 CollabNet, Inc. All Rights Reserved.
Build 51
Server 26Line 27
Algorithm.java
Ticket 234
Project App
Visibility & Traceability
Intelligent Orchestration, Integration & Action Platform
Continuous Lifecycle Integration and Automation
18 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Pipeline View – Status across Tool Chains
19 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
• Incidents & Problems often have a gap between
1. Knowing that there is a problem and it’s impact, and
2. Knowing where it came from and how to fix it
• Our DevOps traceability functions allows quick…
– Identification of the problem’s source, related activities and team involvement
– Problem repairs, contextually understanding ‘how it happened’
– Improvement capabilities for teams, activities, process or practices…globally
• Our DevOps fast-fix response capability allows the Enterprise to embrace
agility with a continuous improvement strategy
– Platform enables quality at speed!
Quick-Fix Visibility and Continuous Improvement
Fixed
here
But fix it
here too
- Ops team & user feedback recorded
- Apps performance & use monitored
- Process reviewed
- List new requirements
- Dev team reassigned
8
Cloud/Hybrid & Automation
Deployment
Examples: - Amazon, Microsoft Azure, etc.
Developers get Defects/Requirements
- via (IDE) Eclipse, Visual Studio, etc.
- Global teams leverage productivity and collaboration…
…code search for reuse, discussion forums and wikis
Product Owner
BA / QA Submit
- New Requirements
- or New Defects
Dev / Team Lead
Review, sets priorities,
drives team effort
Developers Code and Collaborate
- Meet requirements, fix bugs, run unit tests & commit code
Continuous Integration
- Hudson/Jenkins (Build Automation – on-success) triggers Test/QA execution
- Test/QA/Defect results and activities recorded.
- Developers complete all supporting Release Files.
Deploy/Release
to create:
- Release config. (BOM)
- Workflows, Profiles
- Cookbook-Recipes
Deployment Patterns
Project FRSApp
Enable Operations
Process review, feedback loops
& App monitoring/remediation
1
2
3
4
5
6
Providing Visibility and Traceability
DevOps
End-to-End Continuous Lifecycle for your Value Streams
Dashboards
7
•Visibility across development,
delivery pipeline and OPS
•Out of the box rule based templates
across tool chains
•Make decisions based on real time
information.
Putting the Ops back into DevOps
Operational Intelligence
22 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
TeamForge
UI/Infra
Workflow&
Orchestration
Integrations/
Associations
16.06 (Q2 2016) 16.09 (Q3 2016)(Q1 2016) POC
Deploy & Release,
Mgt, App View
Pipeline View
(Planning -> Ops)
Feedback Loop
Sample Reports
Demo Deploy Flows
(Chef)
Community integrations:
Chef, Jenkins, Nexus
Powershell, git, Docker,
AWS, vmware
NewRelic, uDeploy
Associations View
Deploy/ Release, App
View
Pipeline View (Pl -> Ops)
DevOps Reports
Action/Triggering Server
Package Object
Operational Health flows
(remediation, APM+ support)
Operational Health
(Incidents) – NewRelic,Sensu
Integrated OaC* Console and
Versioning
OAC* and IaC in release
notes
OaC – Orchestration as Code
Pipeline Analytics
ChatOps (Approvals)
Deployment Strategies & Patterns
Deploy Flows (IaC, ARA
templates)
SLDC Analytics/Insight (Plan-
>Ops)
CI Flows & Patterns
EventQ Integration
CollabNet DevOps Roadmap - 2016
*OaC – Orchestration as Code
*ARA – Application Release Automation
*IAC – Infrastructure As Code
CD Integrations+:
aws,azure,docker,
puppet,ansible,
openstack, kubernetes,
salt , ARA*
Operations+: Nagios,
servicenow, sensu, hubot,
securitymonkey
CD Integrations+: APM+ support,
ARA+, Testing, Governance
Operations+:
dripstat,elasticsearch, fireeye,
alerlogic, pagerduty splunk,
victorops
CI Integrations+: circleci, travisci
Roadmap Subject to Change
23 Copyright ©2015 CollabNet, Inc. All Rights Reserved.23 Copyright ©2015 CollabNet, Inc. All Rights Reserved.
Questions?

2016 Federal User Group Conference - DevOps Product Strategy

  • 1.
    1 Copyright ©2016 CollabNet, Inc. All Rights Reserved. CollabNet DevOps Product Strategy Putting the Ops back into DevOps for Operational Intelligence Eric Robertson DevOps Product Line General Manager
  • 2.
    2 Copyright ©2016 CollabNet, Inc. All Rights Reserved. My Background and Story • Responsible for the strategic direction of the DevOps product line at CollabNet. • Led a solutions and services team at Unisys for migrating legacy environments to Web-scale-IT architectures • Joined Cisco through a company acquisition (Tidal Software), where he served as Director for Product Management and as a subject-matter expert and solution management leader for Cisco’s cloud orchestration and automation products. • Spearheaded the joint partnership between Cisco and SAP, whereby, SAP resold Cisco’s Intelligent Automation solution as a SAP Application Lifecycle Management (ALM) extension. • Successfully held product engineering and management roles (Microsoft, Motorola, HP, BMC Software, Cap Gemini) and has provided consulting to Fortune 500 companies. • Hold patents in the area of Hardware Abstraction Layers for Microkernel OS and a Bachelor Degree in Computer Science and Master’s Degree in Electrical and Software Engineering from University of Texas in Austin.
  • 3.
    3 Copyright ©2015CollabNet, Inc. All Rights Reserved. Agile Focus Areas CollabNet defines three Agile focus areas: • Agile PPM: Agile “planning” capabilities including project, portfolio & program level, backlog and milestone management, capacity planning, etc. • Agile Execution: features focused on Agile team execution of iterations and kanban-style workflow • Downstream Agile: visibility and traceability of engineering activities downstream of planning and tasking (SCM, CI, CD, etc.). Agile PPM Upstream Agile Version control Continuous Delivery Continuous Integration Binary Repository Downstream Agile Agile Execution Operations
  • 4.
    4 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Software Development Lifecycle Traceability and Visibility
  • 5.
    5 Copyright ©2015CollabNet, Inc. All Rights Reserved. Our DevOps Focus Areas Continuous Lifecycle Integration (Plan-to-Ops) Continuous Integration Continuous Delivery Management Focus areas (as per Forrester Research): Key Benefits: INTEGRATION Leverage investment in existing infrastructure and tools Interchange tools to match evolving needs AUTOMATION Detect events and take actions (across tools & workflow systems) TRACEABILITY For impact analysis and fast-fix VERSION CONTROL [everything] Across the pipeline (Source, IaC, OaC) REPORTING Single pane of glass reporting (metrics , KPIs) across tool chain CONTINUOUS FEEDBACK Ops-to-Plan with Collaboration (ChatOps) Continuous Lifecycle Integration spanning the tool chain across Plan-to-Ops
  • 6.
    6 Copyright ©2015CollabNet, Inc. All Rights Reserved. Supporting Multi-Variant Software Development Life-cycle Write (ALM) Store (SCM) Deploy - Continuous Delivery (ARA) DevOps: Operation Intelligence (Ops) Plan-to-Ops Life-cycle Integration Biz Value through feature Lifecycle Continuous Feedback, Traceability & Visibility Teamforge Teamforge SCM Electric Cloud / Xebia/Clarive IBM UrbanCode Mode 2 - Container Deployment Engines Mode 2 - Planning, Dev & Test Tools Monitoring ITIL tools
  • 7.
    7 Copyright ©2015CollabNet, Inc. All Rights Reserved. Trace view – exploring traceability
  • 8.
    8 Copyright ©2015CollabNet, Inc. All Rights Reserved. Associations list view
  • 9.
    9 Copyright ©2015CollabNet, Inc. All Rights Reserved. TeamForge – Leverage Association and Extend Downstream “Assoc” Project App
  • 10.
    10 Copyright ©2015CollabNet, Inc. All Rights Reserved. TeamForge – Downstream linkage “Assoc” Project App Provide Lifecycle Automation and Orchestration Provide Tool Chain Integration MetaModel (Schemas) Tool Chain Integration
  • 11.
    11 Copyright ©2016 CollabNet, Inc. All Rights Reserved. ALERT MONITORING HEALTH EVENT WORK ITEM Continuous Lifecycle Integration Featuring End-to-End Traceability SERVICE DESK COMPLIANCE AUDIT SECURITY CHECK DEPLOYMENT EPIC STORY TASK COMMIT CODE REVIEW CI BUILD BINARY TEST PLAN CODE BUILD TEST RELEASE DEPLOY OPERATE MONITORREVIEW RELEASE PACKAGE
  • 12.
    12 Copyright ©2016 CollabNet, Inc. All Rights Reserved. DevOps Integration and Workflow Extension 7 Networkin g Security CI/CD/CM Workflows Security • Sensors are inbound integration plugins that watch for events from external systems. When an event occurs, it fires a trigger (e.g., NewRelic app performance alert, Github commit, or JIRA issue update). • Rules use the trigger to select which action or workflow to execute and pass the data needed to execute the action. • Workflows stitch actions together into “uber-actions” with simple declarative DSL, defining the order, transitions, conditions, and data flow. • Actions are outbound integrations and can be any scripts with meta-data. Actions are invoked by users via GUI, CLI, API, or ChatOps(*), or triggered by automations - rules and workflows. • Audit trails record action executions, whether manual or automated, and stores them with full details of triggering context and execution results.
  • 13.
    13 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Out-of-the-box Rule Based Templates Across Tool Chains and Version Controlled! Continuous Integration (CI) & Testing Flows Continuous Release & Deployment Flows Continuous Monitoring & Operations Flows Workflows for Sensing and Executing Actions Environment, Orchestration, Integration and Intelligence captured as Code
  • 14.
    14 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Dashboard and SDLC Traceability Concept
  • 15.
    15 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Deployment Drilldown to Health Events
  • 16.
    16 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Deployment Drilldown to Security and Compliance Events
  • 17.
    17 Copyright ©2016 CollabNet, Inc. All Rights Reserved. Build 51 Server 26Line 27 Algorithm.java Ticket 234 Project App Visibility & Traceability Intelligent Orchestration, Integration & Action Platform Continuous Lifecycle Integration and Automation
  • 18.
    18 Copyright ©2015CollabNet, Inc. All Rights Reserved. Pipeline View – Status across Tool Chains
  • 19.
    19 Copyright ©2015CollabNet, Inc. All Rights Reserved. • Incidents & Problems often have a gap between 1. Knowing that there is a problem and it’s impact, and 2. Knowing where it came from and how to fix it • Our DevOps traceability functions allows quick… – Identification of the problem’s source, related activities and team involvement – Problem repairs, contextually understanding ‘how it happened’ – Improvement capabilities for teams, activities, process or practices…globally • Our DevOps fast-fix response capability allows the Enterprise to embrace agility with a continuous improvement strategy – Platform enables quality at speed! Quick-Fix Visibility and Continuous Improvement Fixed here But fix it here too
  • 20.
    - Ops team& user feedback recorded - Apps performance & use monitored - Process reviewed - List new requirements - Dev team reassigned 8 Cloud/Hybrid & Automation Deployment Examples: - Amazon, Microsoft Azure, etc. Developers get Defects/Requirements - via (IDE) Eclipse, Visual Studio, etc. - Global teams leverage productivity and collaboration… …code search for reuse, discussion forums and wikis Product Owner BA / QA Submit - New Requirements - or New Defects Dev / Team Lead Review, sets priorities, drives team effort Developers Code and Collaborate - Meet requirements, fix bugs, run unit tests & commit code Continuous Integration - Hudson/Jenkins (Build Automation – on-success) triggers Test/QA execution - Test/QA/Defect results and activities recorded. - Developers complete all supporting Release Files. Deploy/Release to create: - Release config. (BOM) - Workflows, Profiles - Cookbook-Recipes Deployment Patterns Project FRSApp Enable Operations Process review, feedback loops & App monitoring/remediation 1 2 3 4 5 6 Providing Visibility and Traceability DevOps End-to-End Continuous Lifecycle for your Value Streams Dashboards 7
  • 21.
    •Visibility across development, deliverypipeline and OPS •Out of the box rule based templates across tool chains •Make decisions based on real time information. Putting the Ops back into DevOps Operational Intelligence
  • 22.
    22 Copyright ©2015CollabNet, Inc. All Rights Reserved. TeamForge UI/Infra Workflow& Orchestration Integrations/ Associations 16.06 (Q2 2016) 16.09 (Q3 2016)(Q1 2016) POC Deploy & Release, Mgt, App View Pipeline View (Planning -> Ops) Feedback Loop Sample Reports Demo Deploy Flows (Chef) Community integrations: Chef, Jenkins, Nexus Powershell, git, Docker, AWS, vmware NewRelic, uDeploy Associations View Deploy/ Release, App View Pipeline View (Pl -> Ops) DevOps Reports Action/Triggering Server Package Object Operational Health flows (remediation, APM+ support) Operational Health (Incidents) – NewRelic,Sensu Integrated OaC* Console and Versioning OAC* and IaC in release notes OaC – Orchestration as Code Pipeline Analytics ChatOps (Approvals) Deployment Strategies & Patterns Deploy Flows (IaC, ARA templates) SLDC Analytics/Insight (Plan- >Ops) CI Flows & Patterns EventQ Integration CollabNet DevOps Roadmap - 2016 *OaC – Orchestration as Code *ARA – Application Release Automation *IAC – Infrastructure As Code CD Integrations+: aws,azure,docker, puppet,ansible, openstack, kubernetes, salt , ARA* Operations+: Nagios, servicenow, sensu, hubot, securitymonkey CD Integrations+: APM+ support, ARA+, Testing, Governance Operations+: dripstat,elasticsearch, fireeye, alerlogic, pagerduty splunk, victorops CI Integrations+: circleci, travisci Roadmap Subject to Change
  • 23.
    23 Copyright ©2015CollabNet, Inc. All Rights Reserved.23 Copyright ©2015 CollabNet, Inc. All Rights Reserved. Questions?

Editor's Notes

  • #13 Plug into existing operation environments via sensors and actions – integrations are simple to author, thousands of which already exist in community Sensors are inbound integration plugins that watch for events from external systems. When an event occurs, it fires a trigger (e.g., NewRelic app performance alert, Github commit, or JIRA issue update). Rules use the trigger to select which action or workflow to execute and pass the data needed to execute the action. Workflows stitch actions together into “uber-actions” with simple declarative DSL, defining the order, transitions, conditions, and data flow. Actions are outbound integrations and can be any scripts with meta-data. Actions are invoked by users via GUI, CLI, API, or ChatOps(*), or triggered by automations - rules and workflows. Audit trails record action executions, whether manual or automated, and stores them with full details of triggering context and execution results.
  • #22 Who is CollabNet? For 15+ years CollabNet has pioneered collaborative and agility driven software development for globally distributed teams. Instead of struggling with disparate and disconnected processes and tools, we realized that organizations and distributed development teams could realize greater innovation through a set of modern and transparent collaborative methodologies on a Web-based platform, which we call CollabNet TeamForge.   Along with TeamForge, CollabNet provides services that focus on helping companies overcome their software engineering challenges by bringing the benefits of open, agile and collaborative development methods to its teams of developers – inside and outside of their company. As such, we have trained 14,000+ individuals on Agile Scrum, in Public and Private Classes, across the globe.  We have created best-practice development environments to facilitate the enterprise shift from On-premise and Packaged Software using Waterfall; to On-Demand and Cloud/SaaS/Mobile Applications using Agile. Our tool platform and services approach embrace automated or manual practices, local or distributed teams, tightly centralized or loosely connected client tools and flows, while at the same time provides unsurpassed organizational wide governance and visibility.   The business returns to our clients have been impressive, with enterprise rollouts achieving gains into the 10s of millions of dollars annually while achieving time-to-market and productivity gains of 10% - 70% depending upon the amount of i) agile approaches, and ii) collaboration employed by these organizations. These gains are just not possible with silo’d based tools and processes. Some of the best companies in the world, literally # 1 in their respective markets - FedEx, American Express, Walmart, HP, Capgemini, Deutsche Bank, the US DOD and many others - have standardized on CollabNet. CollabNet’s core product, TeamForge, is the innovation and collaboration backbone for these organizations. Due to our unique product differentiators and our deep experience in open source, agile development, and enterprise scale collaborative software development, CollabNet stands alone in being able to provide these results for global enterprises such as these and such as your company. Let us highlight the key components of the CollabNet solution capabilities that have enabled these companies to achieve these results, and how your company can do the same.