More Related Content Similar to Compatibility testing a must do of the web apps 2012 Similar to Compatibility testing a must do of the web apps 2012 (20) More from Indium Software More from Indium Software (20) Compatibility testing a must do of the web apps 20121. INDIUM SOFTWARE
An Independent Software Testing Firm
Compatibility Testing - A Must Do of the
Web Apps
“Business Assurance through Quality Assurance”
2. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
The Need
The Impact
The Challenges
The Strategy
The Checklist
Metrics
Inferences
The Road Ahead
3. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Need
3
Operating
Systems
Windows XP, Vista, Win7,
MAC, Unix, Linux, etc.,
Browsers IE, Firefox, Chrome,
Safari, Opera, etc.,
Databases Oracle, Sybase, DB2,
Mysql, SqlServer, etc.,
System
Software
Web server, networking,
messaging tool
Platforms PC, PDA, Laptop, Mobile,
PAD
Choices are in
abundance for users
4. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Impact
4
Impact:-
• High cost of customer support
• Decrease in user willingness to
recommend
• Negative client feedback
• Increase channel cost
• Tarnish company’s reputation
• Lost sales
That was a
bad choice
5. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Challenges
5
Many different browsers
Many different versions
New versions released frequently
User preferences changes
Standard follows, still there’s
always variation
Business
Setting up test environment
Huge resource allocation
Test coverage in multiple browser
Quality deliverable in short time
Testing
6. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Strategy
6
Resource
Management
Targeting
PlanningTesting
Communication
Reporting
• Browsers, Platforms and
Plugins Tracking
• Systems & contact
maintenance
• Platform
Identification
• Current
deployment core
list
• Scope, Objectives
• Define & Schedule
• Virtualization
• Record test results
• Dashboard with
compatibility data
• Configurations and
goals
• Schedule & status
• Testing platforms
of top priority
• Pilot deployments
7. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Checklist
7
Compatibility testing should ensure that
Users have the same visual experience irrespective of the browsers
In terms of functionality, the application must behave & respond the same way across
browsers
UI Validations Functionality Validations
CSS Rendering JavaScript
Copyrights Applets
Dropdown controls Check-in / Checkout
Tabs Export / Import
Clipboard Links
8. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Metrics
8
13
20
30
37
0
5
10
15
20
25
30
35
40
IE FF Safari Chrome
Defects
CSS Rendering Issues (%)
23
14
37
26
0
5
10
15
20
25
30
35
40
IE FF Safari Chrome
Defects
Add-on Errors (%)
42
33
13 12
0
5
10
15
20
25
30
35
40
45
IE FF Safari Chrome
Defects
3rd Party Entities (%)
15
32
13
40
0
5
10
15
20
25
30
35
40
45
IE FF Safari Chrome
Browser Performance (%)
9. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Inferences
9
Inferences (based on the test results of our case study)
Application is faster in Firefox compared to other browsers
Testing in Windows 8 developer edition/ IE 10 Beta brought out more bugs as in IE6
Application is more stable in Firefox versions, IE latest versions and Safari
Java applets are not supported in Chrome. Some features of the application throws UI
issues.
The following browsers are suggested for inclusion in the test matrix :
Browser Reason for inclusion in test matrix
Chrome Most common browser in use today & has significant rising
market share of 29%
IE 8, IE 9 Top browser with the highest market share of 22%
Firefox Fastest browser next to Chrome in use with 19% share
iPhone & iPad Uses webkit, the largest single mobile browser
Safari 5.x, Safari 6.x Default browser on OS X
10. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
The Road Ahead
10
Our compatibility testing is based on proven testing methodologies and experience, powered with
Framework comes with the following features:
Automated, Re-usable Framework to reduce Compatibility Testing overheads
Seamless updates to compatibility matrix to ensure high quality End User experience
Key Levers
With
Compatibility
Framework
Value Additions Before After Value
Delivery Cycle Reduced by 30% Streamlined process cycle time
Ensures high quality service delivery
* 8 – 10
days
5–7 days
~USD
100,000
Test Execution
Phase
Faster by 20% Automated, Re-usable Framework Execute
Automated tests
* 5 – 7
days
4–6 days
Reporting Faster by 40% Proactive monitoring of end-user device
configurations
* 2 days 1 day
Defect
Detection
Increased by 25% Jump Start Kits-Known failure patterns
across different OS/Browser combinations
100
defects
/Qtr
125
defects /
Qtr
~USD
50,000
Testing ROI 50-60% Savings Reduces compatibility Testing overheads ~USD
200,000
USD
100,000
~USD
100,000
-> Total cost saving ~ USD 300,000
11. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
11
Thank You
USA:
americas.sales@indiumsoft.com
EMEA & APAC:
apac.sales@indiumsoft.com
emea.sales@indiumsoft.com
INDIA:
sales@indiumsoft.com
Sunnyvale
Suite 210, 1250 Oakmead Parkway
Sunnyvale, CA – 94085.
Phone: +1(408) 501-8844
Fax: +1(408) 501-8808
Atlanta
Crown Office Suites
1870 The Exchange, Suite 100
Atlanta, GA 30339
Phone: +1 (678) 608-0809, +1(770) 989-7302
New Delhi
F-1/5 Okhla Industrial Area Phase-I,
New Delhi – 110 020.
Phone: +91-11-6613 0400
Bengaluru
SRS Plaza, No. 246, 2nd & 3rd Floor
13th Cross, Indira Nagar 2nd Stage
Bengaluru – 560 038.
Phone: +91-80-4914 7777
Chennai
VDS House
41, 2nd Floor, Cathedral Road
Chennai – 600 086.
Phone: +91-44-2811 6330
Fax: +91-44-4210 4033