SlideShare a Scribd company logo
1 of 10
Download to read offline
T20
Test Techniques
10/16/2014 3:00:00 PM
User Acceptance Testing in the
Testing Center of Excellence
Presented by:
Deepika Mamnani
Capgemini
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Deepika Mamnani
Capgemini
Deepika Mamnani heads the solutions arm of the Quality Assurance and
Testing Services group at Capgemini. She is responsible for devising testing
solutions and creating improvement roadmaps for testing organizations across
industry verticals. Deepika’s core competency is conducting assessments for
testing processes across software development lifecycles. An expert at defining
organization and governance structures for testing organizations, she has helped
organizations implement centralized testing centers of excellence. Deepika is a
speaker at international testing conferences, conducts webinars on QA topics,
and is a CSTE, CSQA Certified, and a Certified ScrumMaster.
UAT in the TCoE
September 2014
2
UAT in the TCoE | September 2014
Best practice 1:
UAT in a nutshell
The choices we make today impact our future
Risk
Profiling
UAT Test
planning
Estimation
Execution
3
UAT in the TCoE | September 2014
Best practice 2:
Risk profiling factors
Criticality
Internal
versus
External
User
Base
Revenue
ROI Complexity
Business
Rules
Technology
Interfaces
Data
If there is no risk there is no reward
4
UAT in the TCoE | September 2014
Best practice 3:
Methodology for determining team size
!  A combination of Top Down and Bottom Up techniques
!  Percentage of overall budget(15 – 40%)
UAT CoE Project Roles Shared CoE Roles
Test Lead BA.QA Program Manager Automation Tester Environment Analyst
Application 1 2 3
1 2 5
Application 2 1 5
Application 3 2 7
Application 4 1 4
Successful repetition is the foundation of a methodology
5
UAT in the TCoE | September 2014
Best practice 4:
UAT Test types break up
Functional
60- 70%
Usability
10-15%
Non
Functional
Performance
Other
15- 20%
Test type
There is no point in digging shallow wells in a thousand places
6
UAT in the TCoE | September 2014
Best practice 5:
Techniques to determine acceptance criteria
As a user I would like to create an order on an ecommerce portal.
Negative
Flow
Number
of
Devices
Orders
Technique 1
Mind Maps
Technique 2
Process Workflow – Design acceptance criteria
Create an
order line
Process
Order
Deliver
Order
Create and
order
Repeat and Repeat till it becomes second nature
7
UAT in the TCoE | September 2014
Best practice 5:
Techniques to determine acceptance criteria
Technique 4
Decision Tables – Test Data – Unit and Automated Tests
Technique 3
Brain Storming on Testing quadrants
Input 1 Input 2 Outcome
User 1
User 2
Items >
100
Items >
400 USD
20%
discount
Free
shipping
iOS
Positive
Flow
Windows
Android Orders
Repeat and Repeat till it becomes second nature
8
UAT in the TCoE | September 2014
Best practice 6:
Degree of automation
UAT
API
Functional
Regression
Unit
Performance
Security
!  Subset of earlier tests
!  Test Data
!  Environment
Automation is the means and not the end
9
UAT in the TCoE | September 2014
Best practice 7:
Risk based testing based on data
Entitlement
Engine (Y)
Profile
Engine (X)
Rules Matrix Risk-based approach
!  Functional criticality
!  Frequency of use
!  Business impact
Rules Engine
Exhaustive testing is impossible
10
UAT in the TCoE | September 2014
Best practice 8:
RACI Matrix
Activity
UAT
team
Client
SMEs
SIT
Team
Infrastructure
team
Development
team
Prepare UAT Strategy R C C C I
Prepare test scenarios R C C - -
Test Data generation R C - - C
UAT Release Notes I C R - -
Test Environment readiness R I C A C
Test Execution R C A A A
Defect Management R A A C A
Metrics management R I I I I
UAT Summary Report R C C I I
There is no right without responsibility
11
UAT in the TCoE | September 2014
Best practice 9:
UAT SLA’s
SLA Definition Norm
Defect Detection Ratio
Defect Rejection Ratio
Ability to detect severity
1 defects
Ability to capture
true defects
>=95%
<=5%
Reverse SLA Definition Norm
Environment downtime
Defect Turnaround time
Availability of environment
Availability of defect fixes
<=5%
Severity 1<= 1 day
What is measured improves
12
UAT in the TCoE | September 2014
©
200
9
UAT TCoE for a credit card services group
Case Study:
Snapshot Solution Measurable Results
Business Challenges:
!  Bandwidth bottlenecks of
business users due to
production responsibilities
!  Dated UAT scripts
!  Inadequate time for testing
!  High number of post
production defects
!  Lack of testing processes
!  High operational costs
!  Acquired application knowledge through close
interaction with business users
!  Rewrote scripts from outdated manual scripts
and created additional scripts for improved
test coverage
!  Created repository of regression test scripts
!  Established test management plan
!  Performed UAT for each release with
measured continuous improvement in testing
effectiveness
!  Set up dashboard
!  Application defects cut
by 63%
!  Reduced testing cycle
time
!  Scripts repository
enabled script reusability
!  Faster application rollout
enabled launching new
products more quickly
!  Reduction in cost of
operations
1
2
13
UAT in the TCoE | September 2014
©
200
7
Ca
pge
min
i -
All
righ
ts
res
erv
ed
Benefits – Decreased Business user involvement in
UAT
Year 1
Testing FTE
60%
Business
Testers
40%
Year 2
Testing FTE
64%
Business
Testers
36%
Year 3
Testing FTE
80%
Business
Testers
20%
!  End user perspective
!  Reduction in business user
involvement in the UAT
process
14
UAT in the TCoE | September 2014
©
200
7
Benefits – Reduction in post production defects
!  Year on year Quantifiable decrease in
production incidents
!  Decrease in overall cost
!  Freeing up client resources for future projects
!  Optimal leverage of existing domain knowledge/
skills
!  Increase in testing maturity across the board
!  100% visibility into testing health and compliance
from the metrics-driven Testing Dashboard
0
200
400
600
800
1000
Year 1 Year 2 Year 3 Year 4
Decrease in production incidents
0
10
23
0
5
10
15
20
25
Year 1 Year 2 Year 3
#ofProjects
Number of Projects done by Capgemini
COE team as Test Managers
15
UAT in the TCoE | September 2014
Questions
deepika.mamnani@capgemini.com

More Related Content

What's hot

A Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingA Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingSmartBear
 
6 Traits of a Successful Test Automation Architecture
6 Traits of a Successful Test Automation Architecture6 Traits of a Successful Test Automation Architecture
6 Traits of a Successful Test Automation ArchitectureErdem YILDIRIM
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planningSivaprasanthRentala1975
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessLee Barnes
 
How to Design a Successful Test Automation Strategy
How to Design a Successful Test Automation Strategy How to Design a Successful Test Automation Strategy
How to Design a Successful Test Automation Strategy Impetus Technologies
 
Idexcel Independent Testing Services Presentation
Idexcel Independent Testing Services PresentationIdexcel Independent Testing Services Presentation
Idexcel Independent Testing Services PresentationIdexcel
 
Quality Assurance/Testing Overview & Capability Deck
Quality Assurance/Testing Overview & Capability DeckQuality Assurance/Testing Overview & Capability Deck
Quality Assurance/Testing Overview & Capability DeckSowmak Bardhan
 
Final Automation Testing
Final Automation TestingFinal Automation Testing
Final Automation Testingpriya_trivedi
 
Shift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deploymentShift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deploymentClaudia Ring
 
Test Case Naming 02
Test Case Naming 02Test Case Naming 02
Test Case Naming 02SriluBalla
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comIdexcel Technologies
 
Test Automation: A Roadmap For Sucesss
Test Automation: A Roadmap For SucesssTest Automation: A Roadmap For Sucesss
Test Automation: A Roadmap For SucesssDavid O'Dowd
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategytharindakasun
 
Testing Centralization
Testing CentralizationTesting Centralization
Testing CentralizationCognizant
 
Setting up Performance Testing &amp; Engineering COE - Top 10 success secrets
Setting up Performance Testing &amp; Engineering COE - Top 10 success secretsSetting up Performance Testing &amp; Engineering COE - Top 10 success secrets
Setting up Performance Testing &amp; Engineering COE - Top 10 success secretsRamya Ramalinga Moorthy
 

What's hot (20)

QA Best Practices in Agile World_new
QA Best Practices in Agile World_newQA Best Practices in Agile World_new
QA Best Practices in Agile World_new
 
A Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingA Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End Testing
 
6 Traits of a Successful Test Automation Architecture
6 Traits of a Successful Test Automation Architecture6 Traits of a Successful Test Automation Architecture
6 Traits of a Successful Test Automation Architecture
 
Testing Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabsTesting Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabs
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
 
How to Design a Successful Test Automation Strategy
How to Design a Successful Test Automation Strategy How to Design a Successful Test Automation Strategy
How to Design a Successful Test Automation Strategy
 
Test Automation - Keytorc Approach
Test Automation - Keytorc Approach Test Automation - Keytorc Approach
Test Automation - Keytorc Approach
 
Idexcel Independent Testing Services Presentation
Idexcel Independent Testing Services PresentationIdexcel Independent Testing Services Presentation
Idexcel Independent Testing Services Presentation
 
Quality Assurance/Testing Overview & Capability Deck
Quality Assurance/Testing Overview & Capability DeckQuality Assurance/Testing Overview & Capability Deck
Quality Assurance/Testing Overview & Capability Deck
 
Final Automation Testing
Final Automation TestingFinal Automation Testing
Final Automation Testing
 
User acceptance testing checklist (uat)
User acceptance testing checklist (uat)User acceptance testing checklist (uat)
User acceptance testing checklist (uat)
 
Shift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deploymentShift left - find defects earlier through automated test and deployment
Shift left - find defects earlier through automated test and deployment
 
Test Case Naming 02
Test Case Naming 02Test Case Naming 02
Test Case Naming 02
 
QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Test Automation: A Roadmap For Sucesss
Test Automation: A Roadmap For SucesssTest Automation: A Roadmap For Sucesss
Test Automation: A Roadmap For Sucesss
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
 
Testing Centralization
Testing CentralizationTesting Centralization
Testing Centralization
 
Setting up Performance Testing &amp; Engineering COE - Top 10 success secrets
Setting up Performance Testing &amp; Engineering COE - Top 10 success secretsSetting up Performance Testing &amp; Engineering COE - Top 10 success secrets
Setting up Performance Testing &amp; Engineering COE - Top 10 success secrets
 

Similar to User Acceptance Testing in the Testing Center of Excellence

Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationTechWell
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software QualityAnand Prabhala
 
Test Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTest Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTechWell
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationTechWell
 
Automation Essentials for the Age of Agile
Automation Essentials for the Age of AgileAutomation Essentials for the Age of Agile
Automation Essentials for the Age of AgileApplause
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven TestingJorge Boria
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingJames Briers
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity Software Ireland
 
Chapter 1 - Why Testing.ppt
Chapter 1 - Why Testing.pptChapter 1 - Why Testing.ppt
Chapter 1 - Why Testing.pptAsgar Ali Sayed
 
How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycleDiUS
 
Enabling CD in Enterprises with Testing
Enabling CD in Enterprises with TestingEnabling CD in Enterprises with Testing
Enabling CD in Enterprises with TestingAnand Bagmar
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of AgileApplause
 
How to Deliver Winning Mobile Apps
How to Deliver Winning Mobile AppsHow to Deliver Winning Mobile Apps
How to Deliver Winning Mobile AppsTechWell
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsTaUB Solutions
 

Similar to User Acceptance Testing in the Testing Center of Excellence (20)

Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service Virtualization
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 
Test Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTest Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back Tomorrow
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service Virtualization
 
Automation Essentials for the Age of Agile
Automation Essentials for the Age of AgileAutomation Essentials for the Age of Agile
Automation Essentials for the Age of Agile
 
Future of QA
Future of QAFuture of QA
Future of QA
 
Futureofqa
FutureofqaFutureofqa
Futureofqa
 
Test Automation in Agile
Test Automation in AgileTest Automation in Agile
Test Automation in Agile
 
Automation Concepts
Automation ConceptsAutomation Concepts
Automation Concepts
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven Testing
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Chapter 1 - Why Testing.ppt
Chapter 1 - Why Testing.pptChapter 1 - Why Testing.ppt
Chapter 1 - Why Testing.ppt
 
How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
 
Enabling CD in Enterprises with Testing
Enabling CD in Enterprises with TestingEnabling CD in Enterprises with Testing
Enabling CD in Enterprises with Testing
 
Service pemanas air solahart hp 081313462267
Service pemanas air solahart hp 081313462267Service pemanas air solahart hp 081313462267
Service pemanas air solahart hp 081313462267
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of Agile
 
CV_Thirumalai_1.0
CV_Thirumalai_1.0CV_Thirumalai_1.0
CV_Thirumalai_1.0
 
How to Deliver Winning Mobile Apps
How to Deliver Winning Mobile AppsHow to Deliver Winning Mobile Apps
How to Deliver Winning Mobile Apps
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 

Recently uploaded (20)

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 

User Acceptance Testing in the Testing Center of Excellence

  • 1. T20 Test Techniques 10/16/2014 3:00:00 PM User Acceptance Testing in the Testing Center of Excellence Presented by: Deepika Mamnani Capgemini Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Deepika Mamnani Capgemini Deepika Mamnani heads the solutions arm of the Quality Assurance and Testing Services group at Capgemini. She is responsible for devising testing solutions and creating improvement roadmaps for testing organizations across industry verticals. Deepika’s core competency is conducting assessments for testing processes across software development lifecycles. An expert at defining organization and governance structures for testing organizations, she has helped organizations implement centralized testing centers of excellence. Deepika is a speaker at international testing conferences, conducts webinars on QA topics, and is a CSTE, CSQA Certified, and a Certified ScrumMaster.
  • 3. UAT in the TCoE September 2014 2 UAT in the TCoE | September 2014 Best practice 1: UAT in a nutshell The choices we make today impact our future Risk Profiling UAT Test planning Estimation Execution
  • 4. 3 UAT in the TCoE | September 2014 Best practice 2: Risk profiling factors Criticality Internal versus External User Base Revenue ROI Complexity Business Rules Technology Interfaces Data If there is no risk there is no reward 4 UAT in the TCoE | September 2014 Best practice 3: Methodology for determining team size !  A combination of Top Down and Bottom Up techniques !  Percentage of overall budget(15 – 40%) UAT CoE Project Roles Shared CoE Roles Test Lead BA.QA Program Manager Automation Tester Environment Analyst Application 1 2 3 1 2 5 Application 2 1 5 Application 3 2 7 Application 4 1 4 Successful repetition is the foundation of a methodology
  • 5. 5 UAT in the TCoE | September 2014 Best practice 4: UAT Test types break up Functional 60- 70% Usability 10-15% Non Functional Performance Other 15- 20% Test type There is no point in digging shallow wells in a thousand places 6 UAT in the TCoE | September 2014 Best practice 5: Techniques to determine acceptance criteria As a user I would like to create an order on an ecommerce portal. Negative Flow Number of Devices Orders Technique 1 Mind Maps Technique 2 Process Workflow – Design acceptance criteria Create an order line Process Order Deliver Order Create and order Repeat and Repeat till it becomes second nature
  • 6. 7 UAT in the TCoE | September 2014 Best practice 5: Techniques to determine acceptance criteria Technique 4 Decision Tables – Test Data – Unit and Automated Tests Technique 3 Brain Storming on Testing quadrants Input 1 Input 2 Outcome User 1 User 2 Items > 100 Items > 400 USD 20% discount Free shipping iOS Positive Flow Windows Android Orders Repeat and Repeat till it becomes second nature 8 UAT in the TCoE | September 2014 Best practice 6: Degree of automation UAT API Functional Regression Unit Performance Security !  Subset of earlier tests !  Test Data !  Environment Automation is the means and not the end
  • 7. 9 UAT in the TCoE | September 2014 Best practice 7: Risk based testing based on data Entitlement Engine (Y) Profile Engine (X) Rules Matrix Risk-based approach !  Functional criticality !  Frequency of use !  Business impact Rules Engine Exhaustive testing is impossible 10 UAT in the TCoE | September 2014 Best practice 8: RACI Matrix Activity UAT team Client SMEs SIT Team Infrastructure team Development team Prepare UAT Strategy R C C C I Prepare test scenarios R C C - - Test Data generation R C - - C UAT Release Notes I C R - - Test Environment readiness R I C A C Test Execution R C A A A Defect Management R A A C A Metrics management R I I I I UAT Summary Report R C C I I There is no right without responsibility
  • 8. 11 UAT in the TCoE | September 2014 Best practice 9: UAT SLA’s SLA Definition Norm Defect Detection Ratio Defect Rejection Ratio Ability to detect severity 1 defects Ability to capture true defects >=95% <=5% Reverse SLA Definition Norm Environment downtime Defect Turnaround time Availability of environment Availability of defect fixes <=5% Severity 1<= 1 day What is measured improves 12 UAT in the TCoE | September 2014 © 200 9 UAT TCoE for a credit card services group Case Study: Snapshot Solution Measurable Results Business Challenges: !  Bandwidth bottlenecks of business users due to production responsibilities !  Dated UAT scripts !  Inadequate time for testing !  High number of post production defects !  Lack of testing processes !  High operational costs !  Acquired application knowledge through close interaction with business users !  Rewrote scripts from outdated manual scripts and created additional scripts for improved test coverage !  Created repository of regression test scripts !  Established test management plan !  Performed UAT for each release with measured continuous improvement in testing effectiveness !  Set up dashboard !  Application defects cut by 63% !  Reduced testing cycle time !  Scripts repository enabled script reusability !  Faster application rollout enabled launching new products more quickly !  Reduction in cost of operations 1 2
  • 9. 13 UAT in the TCoE | September 2014 © 200 7 Ca pge min i - All righ ts res erv ed Benefits – Decreased Business user involvement in UAT Year 1 Testing FTE 60% Business Testers 40% Year 2 Testing FTE 64% Business Testers 36% Year 3 Testing FTE 80% Business Testers 20% !  End user perspective !  Reduction in business user involvement in the UAT process 14 UAT in the TCoE | September 2014 © 200 7 Benefits – Reduction in post production defects !  Year on year Quantifiable decrease in production incidents !  Decrease in overall cost !  Freeing up client resources for future projects !  Optimal leverage of existing domain knowledge/ skills !  Increase in testing maturity across the board !  100% visibility into testing health and compliance from the metrics-driven Testing Dashboard 0 200 400 600 800 1000 Year 1 Year 2 Year 3 Year 4 Decrease in production incidents 0 10 23 0 5 10 15 20 25 Year 1 Year 2 Year 3 #ofProjects Number of Projects done by Capgemini COE team as Test Managers
  • 10. 15 UAT in the TCoE | September 2014 Questions deepika.mamnani@capgemini.com