Download to read offline
![©2015,HCLTechnologies.ReproductionProhibited.ThisdocumentisprotectedunderCopyrightbytheAuthor,allrightsreserved.
From Table3,itisapparentthatthepairwiseapproachfound19% moredefectsthanthelegacyapproach
withasavingsinexecutioneffortof70%.Itwasalsofoundthatthepairwisescenarioswereabletounveilall
thedefectsthatthelegacytestapproachdiscovered,leavingNOleakages.
Table4showsthekeydifferencesbetweenthelegacyapproachandthepairwiseapproach.
AnotherapproachintheindustrythatattemptstosolvetheproblemdefinedinthispaperisOrthogonalArray
TestStrategy(OATS).Orthogonalarraysaretwodimensionalarraysofnumberswhichpossesstheinteresting
qualitythatbychoosinganytwocolumnsinthearrayyoureceiveanevendistributionofallthepair-wise
combinationsofvaluesinthearray.OATSusestheconceptoforthogonalarraystodesigntestsforsoftware
systems.
Asampleorthogonalarray[L9(34)]hasbeenshowninTable5forreference.
BestPractices
LegacyApproach
Randomized
Subjective
Coveragecannotbequantitativelymeasuredasthe
dataisrandomized
Cannotbeautomatedeasily
Optimized
Objective
Coveragecanbequantitativelymeasured
Greatcandidateforautomation!
PairwiseApproach
AdoptingthePairwiseTestDesignTechniquetoOptimizePrinterDriverTestCoverage |7
Table4.Pairwiseapproachv/sLegacyapproach](https://image.slidesharecdn.com/adoptingthepairwisetestdesigntechniquetooptimizeprinterdrivertestcoveragev1-150203230723-conversion-gate01/85/Adopting-the-Pairwise-Test-Design-Technique-to-Optimize-Printer-Driver-Test-Coverage-7-320.jpg)
Uploaded byHCL Technologies
Adopting the Pairwise Test Design Technique to Optimize Printer Driver Test Coverage
The document discusses the adoption of pairwise test design techniques to optimize the test coverage for printer drivers, highlighting its effectiveness over traditional randomization methods. A case study demonstrated that the pairwise approach detected 19% more defects while reducing execution effort by 70%. This method allows for improved test coverage measurement and is essential for managing the complexity of testing numerous variable interactions.
More Related Content
Similar to Adopting the Pairwise Test Design Technique to Optimize Printer Driver Test Coverage
Adopting the Pairwise Test Design Technique to Optimize Printer Driver Test Coverage
- 1.
- 2.
- 3.
- 4. ©2015,HCLTechnologies.ReproductionProhibited.ThisdocumentisprotectedunderCopyrightbytheAuthor,allrightsreserved. environmentandtheneedforareducedtimetomarket(TTM),thetestteamsarechallengedtocomeupwith variousstrategiestooptimizetestingwithoutcompromisingonthequalityofthedeliverables.Thismay includereducingtheoverallnumberoftestcasestoaccelerateproducttimetomarket Sometimes,testteamschooseoption(2)whichcanefficientlyunveilamorenumberofdefectsbutnotmost ofthem.Withthisoption,providingaquantitativenumberintermsoftestcoverageisachallengeaswell. Mostoften,option(1)ischosenbymanytestteamswhichbringsineffectivetestcoverage,leadingtopoor DefectRemovalEfficiency(DRE).ApoorDREmeansmorefielddefectsandlesssatisfiedcustomers. Byrandomlypickingasubsetoftestsfrom theoverallcountwithoutadoptingastrategy(pureran- domizationorguessing) Byrandomlypickingasubsetoftestsfrom theoverallcountusingoperationalprofiles(morefocus oncustomerusagelikepapersizes/papertypes,highestcustomerbaselikeWindows8.1,Mac10.9, etc.)or Bychoosingastatistically-basedtestdesigntechnique. ThesolutiontothecombinatorialtestingproblemstatedinthepreviouspageistoadoptthePairwiseTest DesignTechniquefortestingtheprinterdriver’svariableinteractions. PairwisePairwisetestingisaneconomicalalternativetotestingallthepossiblecombinationsofasetofvariables.Itis aneffectivetestcasegenerationtechniquebasedonthehistoricaldatathatmostfaultsarecausedbyinterac- tionsoftwoactions.Inpairwisetesting,testcasesaredesignedtoexecuteallthepossiblediscretecombina- tionsofeachpairofinputparameters.Pairwise-generatedtestsuitescoverallthecombinationsoftwo;and arethereforemuchsmallerthanexhaustiveones,yetstillveryeffectiveinfindingdefects.Pairwisetestingis alsoreferredtoasall-pairstestingor2-waytesting. Graph1showsthecumulativepercentageofsoftwaredefectsdetectedbythen-tupleinteractionswhereitis apparentthatformedicaldevicesoftwareandNASAapplications,pairwiseinteractionsareabletodetect morethan90%ofsoftwarefailures.Higher-orderinteractions(3-way,4-way,etc.)canstillbeadopted,ifpre- ferred,butthebenefit-costratiowillbeconsiderablyless. Graph1.Errordetectionratesforinteractionstrengths1to6 Cumulativepercentof softwarefailures Interactions MediacalDevices Browser Sensor NASA NetworkSecurity Solution AdoptingthePairwiseTestDesignTechniquetoOptimizePrinterDriverTestCoverage |4
- 5.
- 6. ©2015,HCLTechnologies.ReproductionProhibited.ThisdocumentisprotectedunderCopyrightbytheAuthor,allrightsreserved. Table1representsasampleoftheinputdatausedforgeneratingpairwisescenarios. Table2representsasampleofthepairwisedatageneratedforthecasestudy. Variables States Letter(8.5x11”) Legal(8.5x14”) Statement(5.5x8.5”) Executive(7.25x10.5”) 8.5”x13” AutomaticallySelect PrinterDefaultType Plain HolePunched Transparency AutomaticallySelect White Blue Yellow Green 1SidedPrint 2SidedPrint 2Sidedprint,Flip onShortEdge MediaSize MediaType MediaColor2-SidedPrinting Variables Total#oftestcases Resource(s)Utilized Duration(InManDays) EffortSavingsThroughPairwiseStrategy Uniquedefectdidentified(excl.invalid&duplicate defects) %ofdefectsdetectedadditionallybyPairwise scenories ~5000 6 396 59 70 70% 19% ~2800 3 114 LegacyApproach MediaType Testcase# No63/4Envelop B5(176x250mm) New A4(210x297mm) Letter(8.5x11”) B5(176x250mm) 1 2 3 4 5 6 Letterhead Plain Custom Type2 Custom Type1 Custom Type5 HolePunched Clear(Transparency) Gray Goldenrod Custom Color3 Pink Custom Color1 1SidedPrint 2SidedPrint 1SidedPrint 2SidedPrintFliponShortEdge 2SidedPrint 2SidedPrintFliponShortEdge MediaSize MediaType MediaColor 2-SidedPrinting AdoptingthePairwiseTestDesignTechniquetoOptimizePrinterDriverTestCoverage |6 Table1.Sampleofinputdata Table2.Sampleofpairwisedata Table3.ComparisondatabetweenthePairwiseapproachandtheLegacyapproach
- 7.
- 8.
- 9.
- 10. Formoredetailscontact:ers.info@hcl.com Followusontwitter:http://twitter.com/hclersand Ourbloghttp://www.hcltech.com/blogs/engineering-and-rd-services Visitourwebsite:http://www.hcltech.com/engineering-rd-services Hello,I’m from HCL’sEngineeringandR&DServices.Weenabletechnologyledorganizationstogotomarketwithinnovativeproducts andsolutions.Wepatnerwithourcustomersinbuildingworldclassproductsandcreatingassociatedsolutiondeliveryecosystems tohelp bringmarketleadership.Wedevelop engineeringproducts,solutionsand platformsacrossAerospaceand Defense, Automotive,ConsumerElectronics,Software,Online,IndustrialManufacturing,MedicalDevices,NetworkingandTelecom,Office Automation,SemiconductorandServers&Storageforourcustomers. ThiswhitepaperispublishedbyHCLEngineeringandR&DServices. Theviewsandopinionsinthisarticleareforinformationalpurposesonlyandshouldnotbeconsideredasasubstituteforprofessional businessadvice.TheusehereinofanytrademarksisnotanassertionofownershipofsuchtrademarksbyHCLnorintendedtoimply anyassociationbetweenHCLandlawfulownersofsuchtrademarks. FormoreinformationaboutHCLEngineeringandR&DServices, Pleasevisithttp://www.hcltech.com/engineering-rd-services Copyright@ HCCopyright@ HCLTechnologies Allrightsreserved. SwadishAaryan HCLEngineeringandR&DServices Reference AuthorInfo 1)http://www.pairwise.org/ 2)PairwiseTestingintheRealWorld: PracticalExtensionstoTest-CaseScenarios.(http://msdn.microsoft.com/en-us/library/cc150619.aspx#Pairwise_topic1) 3)JamesBachandPatrickJ.Schroeder,PairwiseTesting:ABestPracticeThatIsn’t 4)JacekCzerwonka,PICT3.3User’sGuide 5)PracticalCombinatorialTesting.SP800-142.(Report).Natl.Inst.ofStandardsandTechnology.2010. AdoptingthePairwiseTestDesignTechniquetoOptimizePrinterDriverTestCoverage |10