Centralization of testing services into a testing center of excellence (TCoE) for system testing is common in IT shops today. To make this transformation mature, the next logical step is to incorporate the user acceptance testing (UAT) function into the TCoE. This poses unique challenges for the TCoE and mandates the testing team develop a combination of business process knowledge coupled with technology and test process expertise. Deepika Mamnani shares her experiences in implementing a UAT TCoE and best practices—from inception to planning to execution. Learn techniques to create business-oriented testable requirements, strategies to size and structure the team, and the role of automation. Review testing metrics needed to measure the success of the UAT function. Hear a real-world transformation journey and the quantitative business benefits achieved by an organization incorporating UAT as a centralized function within the TCoE. Take back strategies to incorporate UAT as a part of your TCoE.
User Acceptance Testing in the Testing Center of Excellence
1. T20
Test Techniques
10/16/2014 3:00:00 PM
User Acceptance Testing in the
Testing Center of Excellence
Presented by:
Deepika Mamnani
Capgemini
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
2. Deepika Mamnani
Capgemini
Deepika Mamnani heads the solutions arm of the Quality Assurance and
Testing Services group at Capgemini. She is responsible for devising testing
solutions and creating improvement roadmaps for testing organizations across
industry verticals. Deepika’s core competency is conducting assessments for
testing processes across software development lifecycles. An expert at defining
organization and governance structures for testing organizations, she has helped
organizations implement centralized testing centers of excellence. Deepika is a
speaker at international testing conferences, conducts webinars on QA topics,
and is a CSTE, CSQA Certified, and a Certified ScrumMaster.
3. UAT in the TCoE
September 2014
2
UAT in the TCoE | September 2014
Best practice 1:
UAT in a nutshell
The choices we make today impact our future
Risk
Profiling
UAT Test
planning
Estimation
Execution
4. 3
UAT in the TCoE | September 2014
Best practice 2:
Risk profiling factors
Criticality
Internal
versus
External
User
Base
Revenue
ROI Complexity
Business
Rules
Technology
Interfaces
Data
If there is no risk there is no reward
4
UAT in the TCoE | September 2014
Best practice 3:
Methodology for determining team size
! A combination of Top Down and Bottom Up techniques
! Percentage of overall budget(15 – 40%)
UAT CoE Project Roles Shared CoE Roles
Test Lead BA.QA Program Manager Automation Tester Environment Analyst
Application 1 2 3
1 2 5
Application 2 1 5
Application 3 2 7
Application 4 1 4
Successful repetition is the foundation of a methodology
5. 5
UAT in the TCoE | September 2014
Best practice 4:
UAT Test types break up
Functional
60- 70%
Usability
10-15%
Non
Functional
Performance
Other
15- 20%
Test type
There is no point in digging shallow wells in a thousand places
6
UAT in the TCoE | September 2014
Best practice 5:
Techniques to determine acceptance criteria
As a user I would like to create an order on an ecommerce portal.
Negative
Flow
Number
of
Devices
Orders
Technique 1
Mind Maps
Technique 2
Process Workflow – Design acceptance criteria
Create an
order line
Process
Order
Deliver
Order
Create and
order
Repeat and Repeat till it becomes second nature
6. 7
UAT in the TCoE | September 2014
Best practice 5:
Techniques to determine acceptance criteria
Technique 4
Decision Tables – Test Data – Unit and Automated Tests
Technique 3
Brain Storming on Testing quadrants
Input 1 Input 2 Outcome
User 1
User 2
Items >
100
Items >
400 USD
20%
discount
Free
shipping
iOS
Positive
Flow
Windows
Android Orders
Repeat and Repeat till it becomes second nature
8
UAT in the TCoE | September 2014
Best practice 6:
Degree of automation
UAT
API
Functional
Regression
Unit
Performance
Security
! Subset of earlier tests
! Test Data
! Environment
Automation is the means and not the end
7. 9
UAT in the TCoE | September 2014
Best practice 7:
Risk based testing based on data
Entitlement
Engine (Y)
Profile
Engine (X)
Rules Matrix Risk-based approach
! Functional criticality
! Frequency of use
! Business impact
Rules Engine
Exhaustive testing is impossible
10
UAT in the TCoE | September 2014
Best practice 8:
RACI Matrix
Activity
UAT
team
Client
SMEs
SIT
Team
Infrastructure
team
Development
team
Prepare UAT Strategy R C C C I
Prepare test scenarios R C C - -
Test Data generation R C - - C
UAT Release Notes I C R - -
Test Environment readiness R I C A C
Test Execution R C A A A
Defect Management R A A C A
Metrics management R I I I I
UAT Summary Report R C C I I
There is no right without responsibility