Ravi Lakkavalli - World Quality Report.pptx

THE CLOSER
YOU LOOK
THE MORE YOU SEE
Key findings from the
2022 WQR
Ravi Lakkavalli
blakkava@capgemini.com

WORLD QUALITY REPORT - KEY FINDINGS 2022 © Capgemini 2022. All rights reserved | 3
WORLD’S LARGEST SURVEY ON STATUS OF QUALITY AND TESTING
1,750
Participants from
32 countries,
10 sectors,
7 respondent groups
420 980 350

WORLD QUALITY REPORT 2022-23 THEMES
Quality automation
Quality infrastructure testing and provisioning
Test Data Provisioning and Data Validation
Quality Orchestration in Agile Enterprises
Quality and Sustainable IT
Quality Engineering for Emerging Technologies
Value stream management

QUALITY
ORCHESTRATION IN
AGILE ENTERPRISES
1

IMPLEMENT AGILE QUALITY ORCHESTRATION
How important are the following QA skills when executing a successful agile program?
Quality Assurance in Agile is
critical to ensure application
quality and reliability while
moving at a faster pace with
flexibility
Quality Orchestration in Agile
enterprises continues to see an
upward trend
Continue to integrate quality
processes in your agile teams

QUALITY AUTOMATION
How much has each of the following areas improved since your organization adopted
Agile/DevOps?
On time delivery measure
improved > 30% for over 60% of
respondents.
There is a sense of confidence
due to better predictability for
the customers.
Survey does indicate few
organizations struggle to deliver
faster releases.
Quality in Agile delivery needs
strategic Testing approach and
Quality controls.

BEST PRACTICE MODEL FOR AGILE QUALITY ORCHESTRATION
Agile QA Architect
Agile QA
Architect
QA Guidelines
QA Dashboard
QA Innovation
QA chapter lead
Agile QA Support
Agile QA
Coaches
QA Strategy
QA Technology stack
QA Skills enablement
Environments & Data
Specialized test as a service
Agile QA
Service center
Performance Test
Security Test
Usability test
E2E QA Squad
E2E QA
Engineer
Customer journey test
E2E integration test
Ops QA monitoring
QA Chapter/Community Test Technology Guilds Agile Quality Indicators
Agile Quality Engineers
in feature teams
Quality enablement of team
TDD / BDD
In-sprint test strategy
In-sprint test automation
Coverage based testing
Experience based testing
Coverage monitoring
Agile QA
Engineer

QUALITY AUTOMATION
What proportion (if any) of your team currently achieves the following benefits from
test automation?
Few organizations struggle to
make test automation work.
Key is to get the processes right,
identify right tools and clear
expectations.
Teams with a mature Agile
process typically get more
benefits from test automation
activities
One tool doesn’t do everything,
Pick the best tools for the job.

QUALITY AUTOMATION
What are the top three most important factors in determining your test automation?
Priority for most organizations
is meeting business needs
rather than justifying ROI on
automation.
Embed an automation-first
approach in your development
process at user-story stage
Review your tooling and
frameworks on a regular basis.
RPA, Low-code and model-based
testing solutions continue to
grow in popularity.

QUALITY
INFRASTRUCTURE
TESTING AND
PROVISIONING
3

What proportion of test environments is provisioned on cloud?
MODERNIZING TEST-ENVIRONMENTS
Move test environments to
multi-premise cloud
Create user-friendly
environment monitoring, booking
and provisioning platform
Implement test environment
support team
Legacy systems modernization
needs strategic approach

What type of projects (if any) include cloud testing as an integral part of the
development lifecycle?
MODERNIZING TEST-ENVIRONMENTS
40% of respondents mentioned
all their projects have cloud
testing
Cloud Testing as a trend is slowly
gaining acceptance and increased
adoption.
Organizations should focus on
creating an end-to-end cloud and
infrastructure testing strategy.

TEST DATA
PROVISIONING AND
DATA VALIDATION
4

How important is data validation to your organization?
DATA QUALITY IS OF GROWING IMPORTANCE
Create an end-to-end
enterprise-wide test data
provisioning strategy
Data integrity, accuracy and
quality are essential for testing.
Provision Test data into CI/CD
pipeline – Available On demand

To what extent does having a ‘robust data validation capability’ provide a benefit to
your organization?
DATA QUALITY IS OF GROWING IMPORTANCE
Implementing an effective data
validation strategy or
approach lie in multiple
complex database architectures
Consider RPA, AI for Test data
generation.
42% see implementing data
validation as a time consuming
exercise
Devise strategies that include
effective validation rules and
enterprise standards.

TEST DATA PROVISIONING PRACTICES
Use of de-sensitized and
synthetically generated test
data stored in the cloud, is a
positive trend
Focus is to provision test data
safely and securely due to
stringent regulatory and security
requirements around data.
How do you store test data?
Organizations are slowly
adopting cloud storage for Test
data.
Use a hybrid approach to deploy
test data in the cloud based on
the project needs and the test
data sensitivity.

QUALITY AND SUSTAINABLE IT
Shift-left QA, static testing, API
optimization can increase
efficiencies across development
life cycle.
A higher quality ensures less
wastage of resources and
increased efficiencies
The role of quality within
sustainable IT is huge and
evolving.
In your opinion, what, if any, are the most important benefits of having green QE as a part of
sustainable IT strategy?
There is no sustainability in IT
without quality.

QUALITY AND SUSTAINABLE IT
Teams don’t test for
sustainability attributes
consistently.
How often do teams test for sustainability characteristics?
Lot of room for quality to be
more effectively used to drive
sustainable IT objectives.
Quality needs to be
a core part of the strategy to
drive more sustainable IT.
Organizations are
adopting sustainability goals into
their core IT strategy

QUALITY ENGINEERING
FOR EMERGING
TECHNOLOGIES
6

QUALITY ENGINEERING FOR EMERGING TECHNOLOGIES
Quality approach essential for a
seamless user experience.
Build quality engineering skills
around emerging technologies
such as blockchain, Cybersecurity,
AI/ML, Web 3.0 and cloud
computing
Quality engineering will have a
critical role to play in implementing
technologies for real-world use
case.
How would you rate the enterprise quality risks for NOT adopting QE for emerging
technologies?
Quality engineers will need
to have an evolved skill set that is in
line with the technology
landscape

VALUE STREAM MANAGEMENT
What are the most important value objectives for the quality function?
VSM is one of the emerging and
developing trends
Define with product stakeholders
the expected value outcome of
testing and quality activities.
Define measurable value indicators
connected to business objectives
Implement your value indicator
dashboard

The development and transformation of the quality assurance function from pure testing to actual quality engineering practices is more than ever
required for companies to stay successful in their domain. Customer experience, time to market, security and cost continue to be the core objectives
for the quality assurance function. Quality experts and teams have a critical role to play in the agile transformation as they best positioned for this task,
centred between development and operations teams.
Key Takeaways
Quality
Orchestration
in Agile
Enterprises
Quality
automation
Quality infra
testing &
provisioning
Test Data
provisioning
and data
validation
Quality and
sustainable IT
Quality
Engineering
for Emerging
Technologies
Value stream
management
WORLD QUALITY REPORT 2022-23: SUMMARY
Implement Agile Quality
Orchestration
• Inject quality engineers in
agile teams
• Create an agile quality
support center.
• Develop agile quality
metrics
• Transform testers to full
stack quality engineers
Set your automation
strategy
• Define automation
strategy early in the
process
• Focus on business needs
before ROI
• Review tooling platform
on regular basis
Leverage cloud for
testing
• Adopt a multi-premise
cloud strategy for test
environments
• Include cloud and
infrastructure testing in
all your projects
Focus on Data Quality
• Implement enterprise-
wide strategy for test
data provisioning
• Integrate test data
provisioning tools in
CI/CD pipeline
• Develop your data
validation strategy and
team
No sustainability
without quality
• Think earlier about
sustainable aspects of
Apps
• Use a quality
framework to achieve
sustainable design
principles
Be future-proof
• Build quality
engineering skills
around blockchain,
Web 3.0, and
cybersecurity
• Test for seamless user
experiences between
the physical and digital
world
Connect quality with
value
• Set clear business
objectives for IT
projects
• Define measurable
value indicators
• Connect quality and
test results to these
value indicators
Key Recommendations
On average 30% of test
environments are on
cloud.
Cloud testing is a
standard part of most
projects. However, only
87% of organizations
believe they have an
effective cloud test
strategy.
Only 20% of organizations
have an enterprise-wide
test data strategy
implemented.
believe data quality is
important for improved
decision making.
A quality focus will help
improve the overall
maturity framework
towards defining,
measuring, and controlling
the implementation of all
aspects (human, social and
environmental) of
Sustainable IT.
believe that a quality
approach is required for a
seamless user experience
between the digital and
physical realities.
Agile has delivered
significant benefits: 64%
have improved their time
to market, 62% improved
cost efficiency and 61%
improved customer
experience
Test automation is a
standard way of working,
but only 50% of teams
achieve actual benefits
from it.
are using Value
Stream Mapping
concepts.
66% of
organizations use
quality engineering
to manage and
control the value
stream.

CONCLUDING RECOMMENDATIONS
Focus on smart Automation Strategy
Install Test Environment and Test Data support teams
Define Quality Value Metrics with sustainability touch
Build your Agile Quality Orchestration Structure
Focus on business outcomes and customer experience

GET YOUR COPY OF THE
WORLD QUALITY
REPORT

Ravi Lakkavalli - World Quality Report.pptx

Recommended

Recommended

More Related Content

Similar to Ravi Lakkavalli - World Quality Report.pptx

Similar to Ravi Lakkavalli - World Quality Report.pptx (20)

More from QA or the Highway

More from QA or the Highway (20)

Recently uploaded

Recently uploaded (20)

Ravi Lakkavalli - World Quality Report.pptx