Todays' IT industry has vastly grown in multiple segments serving many time critical offerings. Need of the hour is continuous nature of requirements with the expectation of continuous delivery. Challenge in Agile methodology is managing 3 stages viz. requirements gathering, development & testing simultaneously. This nature of process has changed the traditional model of Waterfall process where each segment was controlled independently and process called Continuous Integration or Automated Integration is evolving. In this program, we will discuss about one virtual project having continuous mode of changing requirements and define Test Driven Development model using Open Source Tools combination.

1. www.unicomlearning.com
World Conference on Next
Generation Testing
Bangalore, 17th and 18th July 2014
AUTOMATED INTEGRATION TESTING
MANOJ KOLHE
www.nextgentesting.org

2. www.unicomlearning.com
About Me…
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Manoj Kolhe
Project Lead
* Manoj.Kolhe@Lntinfotech.com
 www.Lntinfotech.com
) +91 880 50 15 100
• 8+ years of IT experience Development & Testing areas
• Certified in Java, PL/SQL & MongoDB
• Technology Consultant in Technology Competency Group within
Testing Service Line BU
• Team awarded with top rated entry for Innovation in Test Automation
from L&T
• Domains: DW/BI, Insurance, Telecom, Automobile, Media &
Entertainment

3. www.unicomlearning.com
AGENDA
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
• Introduction
• Traditional way of Testing
• Challenges in existing Testing Model
• Addressing challenges using Open Source Solutions
• Introduction to Automated Test Integration
• Implementation of CIT / AIT
• Tool selection criteria for Test Automation
• Case Study
• Covering Up

4. www.unicomlearning.com
Introduction – Typical Enterprise Landscape
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Sales & Marketing Team
Business Customers
Business
Requirements
Development Team
Code Repository Staging /
Production Server
Testing Team
Regression
Testing
That’s a
bug!!!
That
was
working
before!
Testing and Iterations
New
Requirement

5. www.unicomlearning.com
Challenges in existing Testing Model
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Traditional way of testing
Difficult to maintain stringent timelines
Drawbacks
Increased Project cost
Development oriented project
instead of customer / quality oriented

6. www.unicomlearning.com
Challenges in existing Testing Model
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Environment Challenges
• Multiple Test environments
• Continuous deployment
• Automated Deployment and Regression
Testing
People Challenges
• Lack of Skill set & Strong knowledge
• Lack of competence to work in additional
technologies - Scripting & Macros
Process Challenges
• Stringent and varying timelines
• Multiple layers and diversified testing at
various layers
Technology Challenges
• Unavailability of a technology agnostic
tool
• Increasing vendor stack in the testing
space

7. www.unicomlearning.com
Addressing challenges using Open Source Solutions
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
• Test Driven Development (TDD)
• Unit Testing Tools
• Mocking Frameworks
• Source Code Management Utilities
• Code Review and Analysis
• Continuous Integration Testing Tools
• Continuous Deployment

8. www.unicomlearning.com
Addressing challenges using Open Source Solutions
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
• Test Driven Development (TDD)
Write the Test Case Execute the Test Case
Write enough code to
pass the test
1 2
3
Test Case
Failed
Repeat
Test Case Passed
Write the next Test Case
1
Code Review and
Continuous Integration
Testing

9. www.unicomlearning.com
Introduction to Automated Test Integration
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Need for Automation Testing
• Can accurately record and test the time lapsed between two transactions
• Increased Test Speed, Test Efficiency and Software Quality
• Decreased Costs and shorter Time to Market
• Record and play feature
• Increased Confidence
• Greater Test Coverage
• Reusability
• Automated Reporting

10. www.unicomlearning.com
Implementation of CIT / AIT
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Source Code
Version Control System
Source Code Build
Static Code Analysis
Run Automated
Unit Tests
Code Coverage Analysis
Set-up Test ‘Fixtures’
Deploy to Test Environment
Run Automated Functional
TestsPublish
Reports
Development Team
1
234
5 6 7
8910
1112
Automated Testing is
the key to AGILE
Artefact

11. www.unicomlearning.com
Tool selection criteria for Test Automation
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
• Small learning curve
• Environment Support
• Easy to use
• Generic across multiple platforms
• Easy Troubleshooting and debugging
• Minimum configuration
• Support for various types of Tests
• Precise Reporting

12. www.unicomlearning.com
Case Study – Sparrow – M&E Leader in Nordic
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Sales & Marketing Team
Business Customers
Business
Requirements
Development Team
Code Repository Web Server
Testing Team
Regression
Testing
That’s a
bug!!!
That
was
working
before!
Testing and Iterations
New
Requirement

13. www.unicomlearning.com
Case Study – Web Platform Existing Scenario
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Web Application Flow
RequirementsPhase
Requirement
Analysis
Getting
defects data
Coding Browser
Specific
Coding
Run Unit
Tests
Manual/UnitTesting
Prepare debug
release
Deployment
Activity
Testing
Run regression
suit
Validate bugs /
defects
Update defect
database
Production
Prepare
Production
build
Deployment
activity

14. www.unicomlearning.com
Case Study – Mobile Platform Existing Scenario
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Mobile Application Development Flow
RequirementsPhase
Requirement
Analysis
Getting
defects data
Coding Device /
Platform
specific
coding
Prepare
Debug
Release
Manual/UnitTesting
Deploy Debug
Package on
Emulator
Run manual
Unit Tests
RegressionTesting
Prepare Beta
Package
Validate bugs /
defects
Update defect
database
Production
Prepare
Release
Package
Perform pre-
release
activities
Publish to the
market /
central
repository

15. www.unicomlearning.com
Case Study – CIT Setup
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Jenkins
QC
Data Testing
Framework
Software Test
Platform
BI Reports
Validation
Test Data
Management
Batch Job Layer
ReportUpload
Mobile Platform
Simulator
Developer
Source Code
Repository
Defect Report
Check-In
Source code Pull Request
LeadingMedia&EntertainmentCompanyinNordic
Cross Browser
Testing

16. www.unicomlearning.com
Case Study – CIT Setup
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Code
Repository
Continuous
Integration
Server
Job Configuration
1. Code Checkout
2. Run Unit Tests / Selenium Tests
3. Run Database Automation Scripts
6. Deploy on Staging server
8. Run Performance Tests
9. Publish Functional / Performance
Test Result(s)
5. Build Deploy package
7. Trigger Regression Suit
4. Run GUI Tests, via Sikuli / QTP
Push
Defects
to QC
Development
Team
Staging
Server
Database

17. www.unicomlearning.com
Case Study – Infrastructure Requirements
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Hardware Requirements
• 4 GB RAM
• 3 GHz CPU
Software Requirements
• JRE 1.6
• Microsoft Office 2007
• Windows / Unix OS
• Apache Tomcat 7.0
• Android Emulator (v19 preferred)
• HP Quality Center v11
• CVS
• Jenkins WAR and plugins
• RADAR Framework tools
• Apache Maven / Apache Ant / Gradle

18. www.unicomlearning.com
Case Study
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Accuracy Dependability Value Benefits Quality
 Reduced effort by
40%
 Improved test
coverage by 80%
 Automated and rule
based code review
 Utilized various
components under
single umbrella
 Performed integration
with HP-QC and CVS
using open source
plugins
 End-to-end automated
data testing strategy
 Reduced testing cycle
time by 70%
 De-skilling of
resources
 Improved time-to-
market by 30%
 90% of the Test Cases
Automated End-to-end
 Automated reports
generation
 Reports status update
in QC instantly post
test execution
Automated Integration Testing for Sparrow Tech Pvt. Ltd.
Benefits Achieved through Automated Integration Testing

19. www.unicomlearning.com
Covering Up…
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Limitations / Drawbacks of Automated Integration Testing
• Initial Setup time required
• Methodology can not be ‘one-size-fits-all’ Exception: Too Small Product life
• Automatic Compile, Deploy does not mean Automation
• It's about tests not builds
• Continuous Integration is an Attitude – Not a Tool
• Source code in the repository must always build and pass our tests
• Places where outcome of CI Reports does not mean to anyone
• Failover conditions’ analysis required

20. www.unicomlearning.com
UNICOM Presents
World Conference on Next
Generation Testing www.nextgentesting.org
Q&A

21. www.unicomlearning.com
World Conference on Next Generation
Testing
Organized by
UNICOM Trainings & Seminars Pvt. Ltd.
contact@unicomlearning.com
MANOJ KOLHE
Manoj.Kolhe@Lntinfotech.com