3. Regression Testing Cycle Current State
Component Time (In hours) Days Resources OS Browser
Desktop
58
3 3 Separate for PC and MAC
Host: On Webview
Guest: Safari on MAC is used while on PC Chrome/FF.
Client
47
2.5 3 Separate for PC and MAC
Host: Safari on MAC is used while on PC Chrome/FF.
Guest: Other browsers and devices are used.
iPad
42
3 2 iOS8
Host: iPad
Guest: Browser and iPhone
iPhone
37
2.5 2 iOS8
Host: iPhone
Guest: Browser and iPad/Android
Android
44
3 3 Lollipop
Host: Android
Guest: Browser and iPad/iPhone/Android
5.5 days for
45%
regression
5 days post
production
testing
4. Regression Testing Cycle Desired State
Reduction of regression testing time by reinvesting in Functional UI Automation,
and Test Case Optimization.
Automation
Strategy
Automation
Planning
Automation
Framework
Design
Data, Harness
Development
Automation
Execution
5. Selenium
What is Selenium?
Selenium is a set of tools for cross-platform automated testing of web applications.
Selenium Supports:
• IE, Firefox, Chrome, Safari, Opera, and Other browsers.
• Windows, OS X, Linux, Solaris, and Other OS’s
• C#, Java, Perl, PHP, Python, Ruby, and Other Languages
• Bromine, NUnit, Junit, Rspec, TestNG, Unittest
It currently takes 5.5 days to complete 45% of a full “regression” cycle with all hand on deck (13 resources)
Then another 5 + days to retest the tickets again in production.
Selenium an open source tool that supports Flex (FlexUISelenium
Detailed documentation and commenting the automation scripts will be required to manage turnover.
Ultimate goal is to move towards completing 100% of a regression (with a combination of both manual and automation tests) and reduce the regression cycle time.
We could also leverage automation to help create smoke tests within the development environment prior to deployments to QA.
1. Selenium is a pure open source, freeware and portable tool.
2. Selenium supports variety of languages that include Java, Perl, Python, C#, Ruby, Groovy, Java Script, and VB Script. etc.
3. Selenium supports many operating systems and browsers.
4. Selenium can be integrated with ANT or Maven kind of framework for source code compilation and can be integrated with Jenkins for continuous integration.
5. Selenium supports very little CPU and RAM consumption for script execution
1. It does not support non web-based applications, it only supports web based applications.
2. It’s an open source tool so in case of any technical issues we need to rely on the selenium community forums to get an issue resolved.
3. No built-in reporting capability so user needs plugins like JUnit and TestNG for test reports.
4. Technical challenges with IE browser. Performance issue and some locator type is very less supportive.