SlideShare a Scribd company logo
PAIRWISE TESTING
Example
What is pairwise testing?
• Pairwise Testing also known as all-
pairs testing is a testing approach taken
for testing the software using combinatorial
method for two test inputs.
n-way combinations
• n = 2, 3, 4, 5, 6
• Focus on testing all possible combinations of
two test inputs (2-way)
Benefits of pairwise testing
Total test cases:
> 2^87 = 154.742.504.910.762.534.362.390.528
Pairwise: 16
Benefits of pairwise testing
• Tool generates test cases
• Reduce time and effort
• Find flaws efficiently: 50%-90%
Apply to pAudit
- Audit types: 14 values
- Audit Title: 1-255 characters
- Medical Blend Rate: number <999.999.999 (pick up 3 random
numbers)
- Compliance Audit: 2 values
- Audit Location: 2 values
- Nature of Audit: 2 values
- Scope of Audit: 2 values
- Coding Classification System: 3 values
- Record Selection by: 2 values
- Record Selection Decided by: 2 values
- Standard list: 9 values
- Audit Date: 1 value
 Total test cases: >18 millions
2-way without constraints
2-way with constraints
Pairwise testing basic and how to apply

More Related Content

What's hot

Software engineering Testing technique,test case,test suit design
Software engineering Testing technique,test case,test suit designSoftware engineering Testing technique,test case,test suit design
Software engineering Testing technique,test case,test suit designMaitree Patel
 
Test case techniques
Test case techniquesTest case techniques
Test case techniquesPina Parmar
 
Software Test Metrics and Measurements
Software Test Metrics and MeasurementsSoftware Test Metrics and Measurements
Software Test Metrics and MeasurementsDavis Thomas
 

What's hot (6)

Software engineering Testing technique,test case,test suit design
Software engineering Testing technique,test case,test suit designSoftware engineering Testing technique,test case,test suit design
Software engineering Testing technique,test case,test suit design
 
Test case techniques
Test case techniquesTest case techniques
Test case techniques
 
ICP QC protocol
ICP  QC  protocolICP  QC  protocol
ICP QC protocol
 
Whitebox
WhiteboxWhitebox
Whitebox
 
11 whiteboxtesting
11 whiteboxtesting11 whiteboxtesting
11 whiteboxtesting
 
Software Test Metrics and Measurements
Software Test Metrics and MeasurementsSoftware Test Metrics and Measurements
Software Test Metrics and Measurements
 

Similar to Pairwise testing basic and how to apply

Test case prioritization usinf regression testing.pptx
Test case prioritization usinf regression testing.pptxTest case prioritization usinf regression testing.pptx
Test case prioritization usinf regression testing.pptxmaheshwari581940
 
Accuracy and precision presentation
Accuracy and precision presentationAccuracy and precision presentation
Accuracy and precision presentationSampatChoudhary4
 
Combinatorial testing ppt
Combinatorial testing pptCombinatorial testing ppt
Combinatorial testing pptKedar Kumar
 
Orthogonal array approach a case study
Orthogonal array approach   a case studyOrthogonal array approach   a case study
Orthogonal array approach a case studyKarthikeyan Rajendran
 
Validation of Analytical method.ppt
Validation of Analytical method.pptValidation of Analytical method.ppt
Validation of Analytical method.pptPriyanka Yadav
 
Multi-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsMulti-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsAravind Sesagiri Raamkumar
 
Analytical methods validation as per ich & usp
Analytical methods validation as per ich & uspAnalytical methods validation as per ich & usp
Analytical methods validation as per ich & uspGANESH NIGADE
 
Random testing
Random testingRandom testing
Random testingCan KAYA
 
qc final final.pptx
qc final final.pptxqc final final.pptx
qc final final.pptxRavi Kothari
 
Analytical method validation
Analytical method validationAnalytical method validation
Analytical method validationSai Praveen Reddy
 
Share_Total_Quality_Management.pptx
Share_Total_Quality_Management.pptxShare_Total_Quality_Management.pptx
Share_Total_Quality_Management.pptxRiyaKaushal21ZO042
 
Combinatorial testing
Combinatorial testingCombinatorial testing
Combinatorial testingKedar Kumar
 
Method Validation: What Are Its Key Parameters
Method Validation:What Are Its Key ParametersMethod Validation:What Are Its Key Parameters
Method Validation: What Are Its Key Parameterscomplianceonline123
 
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing TestsHo Chi Minh City Software Testing Club
 
Analytical Method Validation.pptx
Analytical Method Validation.pptxAnalytical Method Validation.pptx
Analytical Method Validation.pptxBholakant raut
 
Analytical method validation
Analytical method validationAnalytical method validation
Analytical method validationArti Thakkar
 
Unit 5 - Lect 1 Benchmarking the Laboratory.pptx
Unit 5 - Lect 1 Benchmarking the Laboratory.pptxUnit 5 - Lect 1 Benchmarking the Laboratory.pptx
Unit 5 - Lect 1 Benchmarking the Laboratory.pptxJermaineChambers2
 

Similar to Pairwise testing basic and how to apply (20)

Test case prioritization usinf regression testing.pptx
Test case prioritization usinf regression testing.pptxTest case prioritization usinf regression testing.pptx
Test case prioritization usinf regression testing.pptx
 
Accuracy and precision presentation
Accuracy and precision presentationAccuracy and precision presentation
Accuracy and precision presentation
 
Combinatorial testing ppt
Combinatorial testing pptCombinatorial testing ppt
Combinatorial testing ppt
 
Orthogonal array approach a case study
Orthogonal array approach   a case studyOrthogonal array approach   a case study
Orthogonal array approach a case study
 
Se unit 4
Se unit 4Se unit 4
Se unit 4
 
Validation of Analytical method.ppt
Validation of Analytical method.pptValidation of Analytical method.ppt
Validation of Analytical method.ppt
 
HPLC validation.ppt
HPLC validation.pptHPLC validation.ppt
HPLC validation.ppt
 
Multi-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender SystemsMulti-method Evaluation in Scientific Paper Recommender Systems
Multi-method Evaluation in Scientific Paper Recommender Systems
 
Analytical methods validation as per ich & usp
Analytical methods validation as per ich & uspAnalytical methods validation as per ich & usp
Analytical methods validation as per ich & usp
 
Random testing
Random testingRandom testing
Random testing
 
qc final final.pptx
qc final final.pptxqc final final.pptx
qc final final.pptx
 
Analytical method validation
Analytical method validationAnalytical method validation
Analytical method validation
 
Share_Total_Quality_Management.pptx
Share_Total_Quality_Management.pptxShare_Total_Quality_Management.pptx
Share_Total_Quality_Management.pptx
 
Combinatorial testing
Combinatorial testingCombinatorial testing
Combinatorial testing
 
Method Validation: What Are Its Key Parameters
Method Validation:What Are Its Key ParametersMethod Validation:What Are Its Key Parameters
Method Validation: What Are Its Key Parameters
 
Quality assurance in a medical laboratory
Quality assurance in a medical laboratoryQuality assurance in a medical laboratory
Quality assurance in a medical laboratory
 
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests[Vu Van Nguyen]  Value-based Software Testing an Approach to Prioritizing Tests
[Vu Van Nguyen] Value-based Software Testing an Approach to Prioritizing Tests
 
Analytical Method Validation.pptx
Analytical Method Validation.pptxAnalytical Method Validation.pptx
Analytical Method Validation.pptx
 
Analytical method validation
Analytical method validationAnalytical method validation
Analytical method validation
 
Unit 5 - Lect 1 Benchmarking the Laboratory.pptx
Unit 5 - Lect 1 Benchmarking the Laboratory.pptxUnit 5 - Lect 1 Benchmarking the Laboratory.pptx
Unit 5 - Lect 1 Benchmarking the Laboratory.pptx
 

Recently uploaded

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILNatan Silnitsky
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...rajkumar669520
 
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion Clinic
 
Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfMeon Technology
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
 
GraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysisGraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysisNeo4j
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfmbmh111980
 
Designing for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesDesigning for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesKrzysztofKkol1
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1KnowledgeSeed
 
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAGAI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAGAlluxio, Inc.
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Krakówbim.edu.pl
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfkalichargn70th171
 

Recently uploaded (20)

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
 
Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdf
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
 
GraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysisGraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysis
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
 
Designing for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesDesigning for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web Services
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
 
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAGAI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Kraków
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
 

Pairwise testing basic and how to apply

  • 3. What is pairwise testing? • Pairwise Testing also known as all- pairs testing is a testing approach taken for testing the software using combinatorial method for two test inputs.
  • 4. n-way combinations • n = 2, 3, 4, 5, 6 • Focus on testing all possible combinations of two test inputs (2-way)
  • 5. Benefits of pairwise testing Total test cases: > 2^87 = 154.742.504.910.762.534.362.390.528 Pairwise: 16
  • 6.
  • 7. Benefits of pairwise testing • Tool generates test cases • Reduce time and effort • Find flaws efficiently: 50%-90%
  • 8.
  • 9. Apply to pAudit - Audit types: 14 values - Audit Title: 1-255 characters - Medical Blend Rate: number <999.999.999 (pick up 3 random numbers) - Compliance Audit: 2 values - Audit Location: 2 values - Nature of Audit: 2 values - Scope of Audit: 2 values - Coding Classification System: 3 values - Record Selection by: 2 values - Record Selection Decided by: 2 values - Standard list: 9 values - Audit Date: 1 value  Total test cases: >18 millions

Editor's Notes

  1. Hello everyone, how are you now? I am very happy to be here to talk about my topic. The truth is - we want to improve quality of the product but we cannot test everything. Is there anyway to help us select fewer test cases but still achieve adequate coverage? Luckily, we have a test design method to achieve greater coverage in fewer tests. Even though you prioritize speed or thoroughness, this method will help you. This is combinatorial test. Today, I will talk a part of this method, that is pairwise testing.
  2. We have a system which is controlled by switch panel as image. Each switch has 2 states: on/off. A question for you is how many test cases need to be tested for this one? Make sure that the number of test cases can cover at least 50% of the flaws. You think about this and I will come back later.  There is a tip that if we use traditional method, we cannot complete the test.
  3. There are 2 factors you need to note here: test inputs and combination.
  4. There are some ways to combine test inputs: 2, 3, 4, 5, and maximum is 6. Most software defects in production today can be triggered by just one test input. Bugs also come from the interaction of two test inputs. Bugs come from 3 or more test inputs are rare. So, to find bugs efficiently, we should focus first on testing all possible combinations of two test inputs!!! You – human will identify what test inputs should be tested. Computer – used computer algorithms generate test cases for you. Why we need to use pairwise testing? Is there any benefit?
  5. To talk about the most benefits of pairwise testing, I will come back the example. How many test cases need to be tested to cover at least 50% of the flaws? Does anyone have a specific number? With traditional method, total test cases to be tested: greater than 2^87 (two to the power eighty seven). Is your number closed to this? :D How many test cases do you think pairwise can offer? With pairwise, we just need: 16 (2-ways) test cases. Each test case has to set state for 87 switches. Am I lying?
  6. Here are the number of test cases are generated by tool.
  7. You job is just identify test inputs, computer will generate test cases for you. Fewer of test cases Better of tests. Although, it is good but not enough. It has limitation and cannot cover 100% of the flaws.
  8. Now, does anyone want to get on the plane which is covered 90% of the flaws?
  9. With those benefits, I decided to apply this method for pAudit. In pAudit, we have a create audit feature which is required data like this. How many test case I had to test for this feature? More than 18millions? Did I do that? Of course, NO. I am a lazy tester, so I did not do that. I just ran fewer.
  10. With 126 test cases, they can cover 100% of the flaws.
  11. I just put 3 constraint, the number of test cases are fewer. So, will you apply this method to your project?
  12. I just introduce a great testing method. Not just fewer, better tests.