Transform Test Organizations for the New World of DevOps

DT7
Concurrent Session
11/9/17 3:00 PM

Transform Test Organizations for the
New World of DevOps

Presented by:

Sumit Kumar
Capgemini

Brought to you by:

350 Corporate Way, Suite 400, Orange Park, FL 32073
888---268---8770 ·· 904---278---0524 - info@techwell.com - https://www.techwell.com/

Sumit Kumar
Capgemini

Director at Capgemini Sumit Kumar has more than seventeen years of experience
in testing delivery, leading testing transformation, and assisting testing
organizations adopting changes. In recent years Sumit has worked with various
mid- to large-size testing organizations to make them DevOps ready. Sumit works
through organizational restructuring, baselining testing maturity, drawing testing
transformation roadmaps, and implementing initiatives spanning across test
engineering functions, tools strategy, solutions build-up, workforce enablement,
and establishing collaborations. Sumit has constantly conceptualized and
delivered solution platforms that enable better DevOps adoption.

1October 2017 © 2017 Capgemini. All rights reserved.
Transforming Test
Organizations for the New
World of DevOps
- Sumit Kumar
2© 2017 Capgemini. All rights reserved.
What To Expect In This Session

About Me…….
Designing Test Organizations For DevOps
Implementation Of DevOps Ready Test
Practices and Solutions
Global Test Delivery – Distributed Agile and
DevOps QA
Part Of Capgemini Team
https://www.linkedin.com/in/sumit-kumar-a5a8154/
“IN TIMES OF RAPID CHANGE, **********
COULD BE YOUR WORST ENEMY”
EXPERIENCE

IN TIMES OF RAPID CHANGE, OTHER’S
EXPERIENCE COULD BE YOUR WORST ENEMY
FRIEND
EXPERIENCE I AM LOOKING AT SHARING
TODAY….
CHANGE IMPACT STRUGGLE
ACTION PLAN
MAKING IT
REAL
WAY AHEAD

CHANGE
S&P 500 charts indicate that the average company’s
tenure is shrinking. By 2030, it’s estimated
that 75 percent of the companies on the S&P
list will be new companies.
Source - http://electric-cloud.com/blog/2017/07/devops-trends-predictions/

Study has proven that a successful DevOps
transformation introduces a disruptive effect —
a new competitive environment where the traditional
business model is unable to survive
Source - http://assets1.dxc.technology/cloud/downloads/DXC_Cloud_The_DevOps_Disruption_8199a-16.pdf

Change The Lens

Don’t undermine the pace of adoption
Source - Gartner
??
Current IT State Where IT Want To Be With DevOps

Are Testing Organizations Ready For DevOps?
OR Is QA Killing DevOps?
REALLY!!!

IMPACT

No Real Improvement in Quality observed
between 2016 and 2017 while DevOps adoption
has been much higher!
Testing Organizations are trying to be effective
in DevOps models
Source – World Quality Report 2017, Capgemini
>50% of the
Testing
organizations have
moved away from
being centralized
testing entity
SPEED (Test Cycle Time)

“Within Eighteen months of
the introduction of Google
Maps Navigation, the makers
of stand-alone GPS devices
had lost as much as 85
percent of their market
value”
AGILITY (Requirement Stability Index)
CUSTOMER EXPERIENCE
(Production Incidents, Social Media)

COMPETITION
(Revenue, Market Share)
Employees in high-performing teams are 2.2 times
more likely to recommend their organizations as a
great place to work.
TALENT
(High Performance Vs Low
Performance)
Source – 2017 State of DevOps Report From Puppet

STRUGGLE
Love for
code has
been
under
scanner

IT leadership is not
natural
Are there any real
Super Powers?
Rest Of IT Test Organization

Change agents?
Haven’t
developed
enough of
this….

Attention is
coming late
and……
ACTION PLAN

We need to own this!
Speak out

FUNCTIONAL
ENGINEERING
TECHNICAL
SPECIALIZATION
MODERNIZATION
INTEGRATION
ANALYTICS

Leadership for
change
Let’s transform
workforce
differently

MAKING IT
REAL
1. ORGANIZATIONAL
CHANGES
2. PROCESSES/SOLUTIONS
TRANSFORMATIONS
3. OPTIMIZING TOOLS
LANDSCAPE
4. CHANGING SKILLS
FABRIC
5. MAKING QA
SMART

1. ORGANIZATIONAL CHANGES
Test Delivery
Large/Critical
Projects & Programs
Delivery
Maintenance and
Enhancements
Projects Delivery
Test Engineering
Shared Services –
Delivery
Test Capability
Centers
Community Of
Practices – Strategy
and Planning (Test
Architects)
Planning and
Effectiveness
Demand and Intake
Management
Financial
Management
Service Performance
Management
Processes & SQA
QA Head
Community of
Practice - Test
Program
Management
Vendor & Contract
Management
Strategic
Initiatives
Reporting and
Change Management
Non Functional
Testing
Performance Testing
& Engineering
Security Testing
EI Outbound/Infra
Upgrade Testing
INTRODUCED NEW
REDESIGNED
2. PROCESSES/SOLUTIONS TRANSFORMATION
DevQA Framework
BDD Component
Features
(QA)
Steps
Definition
(Dev/QA)
API
Collector
API Info
(Dev)
Validator
Report
Generator
Data Store
Expected
data
(QA)
Results
Quality Gate on Dev
Machine & Pipeline
API layer Testing reduces
UI Testing
Mandatory Maintenance of
Test Code along with App
Code
Reduced Environment &
Data Dependency

3. OPTIMIZING TOOLS LANDSCAPE
Requirements Architecture & Design Development Testing Release
ShiftLeft
Test Driven Development
Automation: 80 – 100%
Unit Tests
Behavior driven development
Service Virtualization
Automation 40 – 60%
Non functional tests
Automation: 80-100%
Performance Tests
Automation; 100%Regression test
Test Management/Defect Management
Sprint Acceptance Tests
Exploratory tests
Functional Tests
ShiftRight
UAT Automation
40 – 60%
Continuous Monitoring
Auto: 40 – 60%
Continuous Integration
Auto: 80 – 100%
Continuous Delivery
Auto:10-60%
Environment virtualization
Auto: 40 – 60%
Tools enable solutions,
have their limitations
Evaluate
Resources
Measure
Project
Readiness
Index
Apply
Mitigation
Plan
Analyze
for
Execution
Risks
Primary Application
Upstream/Downstream
Apps
Interfaces
E2E Flow
Test Execution
Agile/DevOps Expertise
Defect Mgmt.
Programming Experience
Insurance
Products
Business Area
Negotiation
Facilitation
Leadership
Communication
Estimation On Time Delivery
PM Process
Compliance
Project Readiness Index Framework
Test Strategy
Test Creation
Automation
PlanningTeam Motivation
4. CHANGING SKILLS FABRIC PROJECT READINESS INDEX

Knowledge Index – 2015
Legend
< 2
>= 2 & < 4
>= 4
2.7
3.3 3.5 3.2 3.5 2.8 2.9
2.8 2.6 2.5 3.1 2.5 2.9
2.2 2.6 2.2 1.9 2.1 2.1
3.1 3.0 3.1 3.4 2.2 2.9
2.0 1.2 2.6 1.0 2.6 2.4
2.9 2.5 2.3 3.5 1.7 2.6
Test Org. PRI
CCI
Surety
Claims
CPI
CSI
F&C
Domain Score
[15%]
Application Score
[30%]
QA Skills &
Tools Score
[39%]
Soft Skills Score
[9%]
Project Management
Skills Score
[7%]
PROJECT READINESS INDEX4. CHANGING SKILLS FABRIC
Re-Baseline
Leveraging Robotic Process
Automation
Natural Language
Processing Based BOTS
BOTS with Deep Learning
Capabilities
5. MAKING QA SMART
COGNITIVE ANALYTICS DRIVEN AUTOMATION
Predictive Analytics

WAY AHEAD

With more than 190,000 people, Capgemini is present in over 40 countries and
celebrates its 50th Anniversary year in 2017. A global leader in consulting, technology
and outsourcing services, the Group reported 2016 global revenues of EUR 12.5 billion.
Together with its clients, Capgemini creates and delivers business, technology and
digital solutions that fit their needs, enabling them to achieve innovation and
competitiveness. A deeply multicultural organization, Capgemini has developed its own
way of working, the Collaborative Business Experience™, and draws on Rightshore®, its
worldwide delivery model.
About Capgemini
Learn more about us at
www.capgemini.com
This message contains information that may be privileged or confidential and is
the property of the Capgemini Group.
Copyright © 2017 Capgemini. All rights reserved.
Rightshore® is a trademark belonging to Capgemini.
This message is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to
read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please
notify the sender immediately and delete all copies of this message.

Transform Test Organizations for the New World of DevOps

More Related Content

What's hot

Similar to Transform Test Organizations for the New World of DevOps

More from TechWell

Recently uploaded

Transform Test Organizations for the New World of DevOps