1. INDIUM SOFTWARE
An Independent Software Testing Firm
Assess with your blinkers off
- Widen your scope for Tool Evaluation
“Business Assurance through Quality Assurance”

2. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
• Introduction
• Growing Trends
• Are we doing it Right?
• Refined Tool Evaluation
• Case Studies and Inferences
• Benefits of the Refined Approach
• Conclusion

3. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Introduction
3
For reasons
well known,
automation is
important in
today’s world
of testing
The focus
should be on a
reliable
automation
solution that
can last the
entire life span
of a product
With varying
platforms and
new age n-tier
applications it
is not
advisable to
stop with the
life span of a
project
To beat the
race process
tweaks are
necessary to
make an
automation
project a
success

4. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Growing Trends
4

5. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Are we doing it Right?
5
Steps involved in general tool evaluation
• A few common parameters that seem to play a vital role in evaluating a tool are picked
• A POC is conducted on the selected tool
• Automation is kicked off
External sources that can impact tool evaluation
• Personal influence of peers – Remember two experiences are never the same. Tool
Evaluation should not biased.
• Resources’ skill set – Picking the wrong tool may end up more expensive than training a
resource.
• Closed mind – Be open and up to date on what is available in the market.

6. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Refined Tool Evaluation
6
Select the Best
PoC
Pick top 4
Determine tool
capabilities
Understanding
Application
• Technologies and techniques
used
• Third party components used
• Architecture
• Feature knowledge
• Review all test cases
• Interacting interfaces
Refined Approach

7. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Refined Tool Evaluation
7
Select the Best
PoC
Pick top 4
Determine tool
capabilities
Understanding
Application
• Features supported
• Skill required
• Cost
• Support

8. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Refined Tool Evaluation
8
Select the Best
PoC
Pick top 4
Determine tool
capabilities
Understanding
Application

9. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Refined Tool Evaluation
9
Select the Best
PoC
Pick top 4
Determine tool
capabilities
Understanding
Application
•Real device scenarios
•Web services, message queues and
database absorption layers
• Interface interaction
• Synchronization between client
and server
• Plug in and devices
• Database / ODBC
• Communication protocol
• Client / server response time

10. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Refined Tool Evaluation
10
Select the Best
PoC
Pick top 4
Determine tool
capabilities
Understanding
Application

11. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Case Study 1
11
Challenges
• Selecting a tool that supports all the three platforms to ensure:
• Coverage of device integrated test cases
• Reduce cost
• Some of the licensed tools had limited or no support to the browsers like Chrome and
Firefox
Benefit of Refined Process
• Promised support for current / upcoming platforms
• Complete automation test coverage
• Significant cost savings on license
Client
• Leading windshield provider in
US
Domain
• Retail POS
Platforms
•Desktop – VB / SQL
•Web – Application in development
(Firefox, Chrome and IE)
•Mobile–Sync data between mobile
and desktop (Android)

12. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Inferences
12
The number of automated candidates
has drastically increased by ~ 25%
The increase in automation test
coverage has reduced manual effort by
50%
Defects found in critical areas have
increased by 80%

13. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Case Study 2
13
Challenges
• Selecting a tool that supports UI and UI less layers testing
• Testing all the service layers in the application such as:
• Web Services
• Metadata Services
• Integration Services
• Workflow Services
Benefit of Refined Process
• 100 % automation coverage and solution
• Reducing the risk of service layer failures
• Early defect detection
• Significant cost savings on license
• Increased test coverage and shorten testing cycles
• Improving the overall quality by testing services and its consumers
Client
•Leading Automobile
Reseller
Domain
•CRM
Platforms
•Web – via only IE
•Plug-in – via Outlook

14. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Inferences
14
Knowing the application before
hand and picking the right tool
does have an impact on the UI
test coverage ~ by 10%
Test coverage on Service layers
have increased by 55% therefore
gaining confidence in delivery as
not just the UI has been tested but
also the Service layers
Automation defects detection has
increased by 50% with our refined
approach

15. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Benefits of the Refined Approach
15
Key Levers With Refined Approach Value Additions
Test Coverage Increased by 30%
 Ensuring test coverage on interacting
devices across platforms
 Reducing the risk of service layer
failures
Test Execution Faster by 40%
 With more automated test cases,
manual test time is saved
Early Defect Detection Faster by 10%
 Early defect detection in critical
performance areas, service layer
defects help reduce UI defects
 Very easy root cause analysis of defects
Cost Increased bottom line
 No need to invest on a different tool for
different devices and Service layers
 Significant cost saving on license cost

16. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Conclusion
16
Tools and Technologies growing at a rapid speed, you can be sure to
beat the competition if you just open up to
assess with your blinkers off!

17. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
17
Thank You
USA:
americas.sales@indiumsoft.com
EMEA & APAC:
apac.sales@indiumsoft.com
emea.sales@indiumsoft.com
INDIA:
sales@indiumsoft.com
Sunnyvale
Suite 210, 1250 Oakmead Parkway
Sunnyvale, CA – 94085.
Phone: +1(408) 501-8844
Fax: +1(408) 501-8808
Atlanta
Crown Office Suites
1870 The Exchange, Suite 100
Atlanta, GA 30339
Phone: +1 (678) 608-0809, +1(770) 989-7302
New Delhi
F-1/5 Okhla Industrial Area Phase-I,
New Delhi – 110 020.
Phone: +91-11-6613 0400
Bengaluru
SRS Plaza, No. 246, 2nd & 3rd Floor
13th Cross, Indira Nagar 2nd Stage
Bengaluru – 560 038.
Phone: +91-80-4914 7777
Chennai
VDS House
41, 2nd Floor, Cathedral Road
Chennai – 600 086.
Phone: +91-44-2811 6330
Fax: +91-44-4210 4033