• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
ROI on Test automation
 

ROI on Test automation

on

  • 1,081 views

Test Automation is a logical step towards taking your QA process to the next level. Right from choosing the correct automated testing tool to the people associated with this initiative will impact the ...

Test Automation is a logical step towards taking your QA process to the next level. Right from choosing the correct automated testing tool to the people associated with this initiative will impact the overall ROI. You know that and you have taken well informed and wise decisions. You have calculated the ROI as well. But have you ever thought of changing some or all parameters in your testing ecosystem that can further increase or accelerate your ROI?

Statistics

Views

Total Views
1,081
Views on SlideShare
1,067
Embed Views
14

Actions

Likes
0
Downloads
34
Comments
0

4 Embeds 14

https://twitter.com 10
https://twimg0-a.akamaihd.net 2
http://www.slideshare.net 1
http://www.slashdocs.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    ROI on Test automation ROI on Test automation Document Transcript

    • ®ARTICLE With or Without Qualitia… What’s your ROI on Test Automation? Can you increase it?Test Automation is a logical step towards taking your wise decisions. You have calculated the ROI as well.QC process to the next level. Right from choosing the But have you ever thought of changing some or allcorrect automated testing tool to the people associated parameters in your testing ecosystem that can furtherwith this initiative will impact the overall ROI. You increase or accelerate your ROI?know that and you have taken well informed and
    • ROI is nothing but return on investment(s) done.Simply put it is: ROI=Benefit(s)/CostSo basically,ROI is directly proportional to the benefitsderived (keeping cost as constant)Here, let’s assume cost of automation remainsunchanged. This means I can neither increase nordecrease the cost of automation. I have to spend a fixedamount. But if somehow I increase the benefits derivedfrom automation, my ROI will proportionally increase.Agreed?ROI is inversely proportional to cost (keepingbenefits derived as constant)Here, let’s assume I derive the same benefits from testautomation. No matter how and what I do to make testautomation successful. I am unable to increase thebenefits - both in number and proportion. But, if I canreduce the cost of automation, my ROI will increase.Now, I am able to derive the same benefits from testautomation at a lower cost. Agreed?Copyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 2
    • Setting upExpectationsWe all know the reason for testing. Improve quality. Weneed quality, so we perform testing. Improved quality isan obvious benefit from testing. If it is not being derivedthen the whole purpose of testing is lost. So for thisarticle, we will not consider quality improvements asa benefit that will contribute towards calculating ROI.Now let’s revisit the other benefits of test automation.Productivity gains and cost savings are test automationbenefits. But, the reason for these benefits is theincrease in speed of test execution. Also, the ability toexecute additional test cycles within a given schedule isbecause of increase in speed of test execution. All thiseventually leads to faster time-to-market - which is aderived as well as an indirect benefit.For the purpose of this article, we will consider ‘increasein speed of test execution’ as the benefit. So if I caneither bolster this benefit further, i.e. increase the speed What if we would do both the things? Increase the speedof test execution from what I already get or else I reduce of test execution and decrease the cost of automation?the cost of automation and get the same speed of test Ooooooooohhhhhhhhhh! sounds wizardly. Doesn’t it?execution - my ROI will increase in both cases. But, let me tell you it is possible.Copyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 3
    • With or Without Qualitia.The speed story...Qualitia increases the speed of test execution by 68.2% considering the tester works for the same hourseliminating the need for script based automation and with or without Qualitia.also making the test suite maintenance a damn easyjob. Below is a comparative chart (chart no. 1) that mentions the speed of automation through standard automationThis increases the speed of test execution by upwards of approach and with Qualitia.33%. This means the overall productivity increases by Benefit Standard Test Automation Approach Test Automation with Qualitia Time to automate one test 4.2 2.8 case in hoursChart No. 1Copyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 4
    • With or Without Qualitia.The cost story...But, you may ask how I can reduce cost of automation substantial that the investment on Qualitia doesn’t eventhrough Qualitia. I mean I will still need to invest in make a dent in the total savings? Here, you may want toQualitia. Are the savings achieved through Qualitia so understand what the cost of automation is. Cost of Automation = CHS + CDM + CTRWhere,CHS = Cost of buying hardware and software includes the CTR = Cost of training includes the investment done oncost of hardware, test automation tools, test management resources to make them production readytools and associated maintenance costs for each Below is a chart (chart no. 2) that mentions the cost ofCDM = Cost of developing and maintaining automated test automation. I have distributed the costs across people,suites includes hiring, staffing, and retaining costs for all processes, and systems and technology. These the keypeople and processes associated with the test automation elements of your test automation ecosystem.initiative Stakeholders One Time Cost Recurring Cost People • Hiring cost to get resources on board • Staffing cost to build test automation • Training cost to get the resources trained • Staffing cost to maintain test on the tool automation Processes • Cost to set up initial processes and their • Cost to maintain processes management Systems and Technology • Cost of hardware and software • Associated maintenance cost • Cost of test automation tool licensesChart No. 2Copyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 5
    • Let’s take an examplewhere,Let’s take an example where we will automate 10,000 Where we assume,test cases and calculate the cost of automation throughtraditional test automation and Qualitia. We are CHS is cost of buying software for test automationassuming we will need a team of 25 people to finish this assuming the cost of hardware and its associatedproject. maintenance cost remains unchanged.We know, Cost of Automation = CHS + CDM + CTR Cost Head Elements Standard Test Automation Test Automation with Approach Qualitia Number of test automation tool licenses 20 8 Cost per test automation tool license 12,500 USD 12,500 USD Total test automation tool license cost 250,000 USD 100,000 USD Number of Qualitia licenses 0 20 Cost per Quaitia license 5,000 USD 5,000 USD Total Qualitia license cost 0 100,000 USD Total license cost ( test automation tool + Qualitia) 250,000 USD 200,000 USDChart No. 3 : License costAs you can see the cost of buying test automation licenses drop by more than 20%. So basically we have reduced onevariable in the equation.Cost of Automation = CHS + CDM + CTRCopyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 6
    • Let’s calculcate the cost of developingand maintaining automated test suites.Taking the same example, CDM is the cost of developingand maintaining the automated test suites. Cost Head Elements Standard Test Automation Test Automation with Approach Qualitia Number of test automation experts 25 5 Average cost per test automation expert per month 1,000 USD 1,000 USD Number of manual testers 0 20 Average cost per manual tester per month 600 USD 600 USD Time to automate 10,000 test cases 12 months 8 months Total cost of test automation experts 300,000 USD 40,000 USD Total cost of manual testers 0 96,000 USD Total resource cost 300,000 USD 136,000 USDChart No. 4 : Manpower costOnce again Qualitia helps reduce the cost of resources by 54.7%.Cost of Automation = CHS + CDM + CTRCopyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 7
    • Last but not theleast...Taking the same example, CTR is cost of training testautomation engineers on the tool itself. Cost Head Elements Standard Test Automation Test Automation with Approach Qualitia Days of training 30 15 Number of resources to be trained 25 25 Cost of training per day 500 USD 500 USD Cost of resources 25,000 USD 8,500 USD Total cost of training 40,000 USD 16,000 USDChart No. 5 : Resource costAs you can see, once again Qualitia helps reduce the cost of training by 60%.Cost of Automation = CHS + CDM + CTRCopyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 8
    • The final word.With Qualitia we have reduced all the three parametersthat contribute to the cost of automation.Cost of Automation is now equal to: CHS by 20% + CDM by 54% + CTR by 60%At an average the cost of automation in Test Automation with Qualitia? Anddecreases by 45% and the speed to this ROI will increase as the frequencyautomate increases by 1.6 times. What of the test cycles increases.more can you ask from your investmentCopyright Qualitia. All rights reserved. Qualitia is a ZenSOFT product. 9
    • ®www.qualitiasoft.comWorldwide HeadquartersZenSOFT Services Pvt. Ltd.Adhyapak SocietySahakar NagarPune - 411009Maharashtra, IndiaQualitia is a registered trademark of ZenSOFT Services Pvt. Ltd. All company names, brand names, trademarks and logos used in this document are the properties of their respective owners. ZenSOFTServices acknowledges the proprietary rights of other companies mentioned in this document. Information included in this document is proprietary to ZenSOFT Services and may not be used, copied,adapted, or abridged without its prior written consent.