Let the adventure begin the 80-20 testing - ingenuity

INDIUM SOFTWARE
An Independent Software Testing Firm
Let the Adventure Begin
- The 80-20 Testing
“Business Assurance through Quality Assurance”

© 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
Testing – The Need to be Quick
Challenges – With Scripted Tests
Interesting Usage of Intelligence
Case Study – Req & Risks
Exploratory Approach
Metrics and Value Additions
Conclusion

Testing - The Need to be Quick
3
Today’s need:
New technology and resources – the
environment is unwilling to take its time
for the quality achievements
Quick turnaround
Compact lifecycles
The above said:
Are we testing enough?
Do we have the time to test enough?
Are scripted tests complete?
What best can we do to ensure
coverage?
Let the adventure begin with Exploratory Testing…

Challenges – With Scripted Tests
4
Constant change and Lack of documented requirements
Time constraints and Insufficient test coverage
Early detection of defects
Code breaks & Performance Bottlenecks

Interesting Usage of Intelligence
5
Several types
of random
tests - When
to use what
Situations
where
requirement
changes along
with an
unsettled
process
Current
A well
groomed
approach
yielding
maximum test
coverage and
high defect
catch rate
Need
Do not
validate
unplanned
A complete
process with
maximum
utilization of
minimum
resources
Solution

Case Study
6
Requirement
Changing combination of environments
Release Frequency
Weekly (sometimes even lesser)
Content Change Rate
Daily
Testing Life Cycle
3-4 Days
Testing Scope
Compatibility / Functionality
Types of Testing
Scripted & Exploratory
Application Type
Web Application

Risk
7
Story
Board
Discussions
Short
development
cycles
Unrelated
Weekly
Changes
Support
Quick
Updates
Platform
Dependent
Test Cases

Exploratory Approach – Team Setup
8
Team Setup
Planning
Execution
Reporting
Maintenance
• Skilled resources
• Knowledge in product
General
• Handy documents
• Training is easy
• Converts any resource
to handle the process
Derived

Exploratory Approach – Planning
9
Team Setup
Planning
Execution
Reporting
Maintenance
• Minimum planning
• Traditional testing
technique used at random
General
• Know your domain and your
user
• Data analysis & Areas to
focus on
• RCA / Know your environment
• Identify test cases from the
suite
Derived

Exploratory Approach – Execution
10
Team Setup
Planning
Execution
Reporting
Maintenance
• Focused testing
• Fixed combination
General
• Standardized charter
• Soap opera testing
• Negative testing
Derived

Exploratory Approach – Reporting
11
Team Setup
Planning
Execution
Reporting
Maintenance
• No formal documentation
• Chances of missed
scenario
• Redundant testing
General
• Parallel documentation
• Exploratory Procedure
• Charted
• Reviewed
• Supervised
Derived

Exploratory Approach – Maintenance
12
Team Setup
Planning
Execution
Reporting
Maintenance
• Testing is considered
done
• Script updates
General
• Trackers
• Fine tuning scripted
tests
Derived

Metrics
13
o This metrics highlights defects found
in Scripted vs. Exploratory
o Introduction of derived exploratory
testing contributed to 20% more
defects in the High and Medium
category
o Derived exploratory testing helped to
uncover affected component under
the UI, Display and behind the scenes
functionality
0
10
20
30
40
50
60
1
2
3
4
5
6
Scripted Testing
Generalized Exploratory
Derived Exploratory

Metrics
14
o This chart shows the defects in
Test case
o Projects with consecutive
iterations need lots of effort in
script maintenance, which helps in
hands-on testing
o The derived exploratory testing,
helped make documentation more
stable therefore reducing time
spent in test script fixes
35
40
23
15
8 7
0
5
10
15
20
25
30
35
40
45
1 2 3 4 5 6
Defects
Iterations
Test Case Defects

Metrics
15
o This pie chat represents the
distribution of defects based on
the testing type
o Defects with the derived approach
is 20% more
o This 20% raises confidence in the
application by 80%
o Proves derived approach is a best
practice for faster iterations and
frequent builds
70%
8%
22%
Defect Distribution
Scprited Testing
Generalized Exploratory
Derived Exploratory

Value Additions
16
Key Levers With Derived Exploratory Testing Value Additions
Test Script
maintenance
Reduced by 50%  Advanced strategy for bug detection
 More coverage area
 Easier to maintain platform dependent scripts
 Reduced timelines in test script maintenance
TC Defects Reduced by 80%  Time saved in test cases fixes
Defect Detection Increased by 25%  Defect pattern identified easily
 Early detection of bugs
Exploratory Issues Increased by 20%  Logged high severity issues
 Increased confidence in product for the
business team
Reporting Better by 40%  Proactive monitoring
 Effective documentation for future reference

Conclusion
17
All paths may or may not lead to the same destination…
… but have all paths been tested?
Try our Derived Exploratory Approach!

18
Thank You
USA:
americas.sales@indiumsoft.com
EMEA & APAC:
apac.sales@indiumsoft.com
emea.sales@indiumsoft.com
INDIA:
sales@indiumsoft.com
Sunnyvale
Suite 210, 1250 Oakmead Parkway
Sunnyvale, CA – 94085.
Phone: +1(408) 501-8844
Fax: +1(408) 501-8808
Atlanta
Crown Office Suites
1870 The Exchange, Suite 100
Atlanta, GA 30339
Phone: +1 (678) 608-0809, +1(770) 989-7302
New Delhi
F-1/5 Okhla Industrial Area Phase-I,
New Delhi – 110 020.
Phone: +91-11-6613 0400
Bengaluru
SRS Plaza, No. 246, 2nd & 3rd Floor
13th Cross, Indira Nagar 2nd Stage
Bengaluru – 560 038.
Phone: +91-80-4914 7777
Chennai
VDS House
41, 2nd Floor, Cathedral Road
Chennai – 600 086.
Phone: +91-44-2811 6330
Fax: +91-44-4210 4033

Let the adventure begin the 80-20 testing - ingenuity

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Let the adventure begin the 80-20 testing - ingenuity

Similar to Let the adventure begin the 80-20 testing - ingenuity (20)

More from Indium Software

More from Indium Software (20)

Recently uploaded

Recently uploaded (20)

Let the adventure begin the 80-20 testing - ingenuity