More Related Content
Similar to Automation on the go ict
Similar to Automation on the go ict (20)
More from Indium Software
More from Indium Software (20)
Automation on the go ict
- 2. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Agenda
2
Outline
Industry Expectations
Overview
Automation in Agile Environment
Approach – ICT (In Cycle Testing)
Phases in ICT
Metrics
Value Additions
Conclusion
- 3. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Industry Expectations
3
• Increased Test Coverage
• Test More
• Test Fast
• Defect Free System
• Improved Accuracy
- 4. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Overview
4
Frequent releases - Increased need of regression execution
Extensive regression suite – Unfeasible test effort
Less regression time – Reduced test coverage / Defect leakage
Manual
Hurried development – Fragile non scalable scripts
Last minute modifications – Costly to fix
Frequent change in requirements - Unstable tests
Automation
An automation suite that
grows in parallel
has control over current features
ensures additional test coverage of new features
The only way out is
- 5. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Automation in Agile Environment
5
Usually automation happens at the end but with quick turnaround time required for
frequent release testing becomes strenuous. That means just manual testing may
not suffice.
Application
Updates
Write
Functional
Test cases
Execute
Functional
Test cases
Analyze test
results &
Report
Defects
Code Freeze &
Deployment
Identify Test
case for
Automation
Develop &
Execute Test
script
Add the Script
to Existing
Suite
- 6. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Approach – ICT (In Cycle Testing)
6
Why not automate as soon as the test cases are identified and written?
.
Application
Updates
Write
Functional
Test cases
Execute
Functional
Test cases
Analyze test
results &
Report
Defects
Code Freeze &
Deployment
Identify Test
case for
Automation
Develop &
Execute Test
script
Add the Script
to Existing
Suite
- 7. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Merge
7
• Tester = Automation + ManualRole
• Testing = Automation + ManualProcess
- 8. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
8
• IM prioritizes requirements
• ICT Automation QA assesses
requirements for ICT feasibility
Kick Off
Effort Estimation & Schedule
Planning
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
1
2
1
2
3
4
5
6
7
8
3
45
6
7
8
- 9. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
9
Planning
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
1
2
3
4
5
6
7
8
Kick Off
• ICT Automation QA provides estimation for
Automating
• QA Lead / IM schedules and
prioritizes
Effort Estimation & Schedule2
1
1
2
3
45
6
7
8
- 10. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
10
Functional Verification
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
1
2
3
4
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• ICT Automation QA identifies / writes
manual tests
• ICT Automation QA emails Developers &
BAs to review the tests
Planning3
1
2
3
45
6
7
8
- 11. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
11
Automation Script Development
Automation Script Sign-Off
Script Integration
Script Execution
1
2
3
4
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• BA signs off
• ICT Automation QA begins testing
Functional Verification4
Planning3
1
2
3
45
6
7
8
- 12. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
12
Automation Script Sign-Off
Script Integration
Script Execution
1
2
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• ICT Automation QA begins script
development
• QA Lead coordinates with
ICT Automation QA on issues / concerns
Automation Script Development5
Planning3
Functional Verification4
1
2
3
45
6
7
8
- 13. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
13
Script Integration
Script Execution
1
2
5
6
7
8
Kick Off
2
1
Effort Estimation & Schedule2
• Peer reviews are conducted
• ICT Automation QA modifies scripts if any
Automation Script Sign-Off6
Planning3
Functional Verification4
Automation Script Development5
1
2
3
45
6
7
8
- 14. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
14
Script Execution
1
2
5
6
8
Kick Off
2
1
Effort Estimation & Schedule2
• Regression Automation QA integrates ICT
Automation scripts with existing regression
scripts
Script Integration7
Planning3
Functional Verification4
Automation Script Development5
Automation Script Sign-Off6
1
2
3
45
6
7
8
- 15. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Phases in ICT
15
1
2
7
Kick Off
2
1
Effort Estimation & Schedule2
• Regression Automation QA executes ICT
scripts before regression scripts
Script Execution8
Planning3
Functional Verification4
Automation Script Development5
Automation Script Sign-Off6
Script Integration7
1
2
3
45
6
7
8
- 16. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Metrics
16
Schedule
14
12
14
16 15
7 6 7 8 8
0
2
4
6
8
10
12
14
16
18
R95 R96 R97 R98 R99 R100 R101 R102 R103 R104
#Scripts
Releases
Backlog Scripts
7
8
7
9
8
5
4 4
5
4
0
2
4
6
8
10
R95 R96 R97 R98 R99 R100 R101 R102 R103 R104
#Days
Releases
With ICT
Without ICT
2 3
1 2 3
18
20
15
20
13
22
29 30 30
28
8
5
7
4 5
0
5
10
15
20
25
30
35
R95 R96 R97 R98 R99 R100 R101 R102 R103 R104#ofDefects
Releases
Defect Detection
Defects found in the QA environment
Defects found in the BA environment
- 17. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Value Additions
17
Key Levers With ICT Value Addition Before After
Test Execution Faster by 30%
Delivery ahead of
schedule
8 – 10 Days 5 – 7 Days
Retesting Effort
Decreased by
40%
Multiple execution of
automation scripts
2 – 3 Days
Less than 1
Day
Backlog
Decreased by
50%
Increased productivity
12 – 14 Scripts
per Release
6 – 8 Scripts
per Release
Regression
Effort
Decreased by
35%
Instant Sign-Off
Stable Code
3 – 5 Days 1 – 3 Days
Defect Catch
Rate
Faster by 60%
High quality service
delivery
25 – 30 Defects
in QA
5 – 8 Defects
in QA
- 18. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
Conclusion
18
Clean and
Rapid
Delivery
Good
Framework
Coding
Standards
Stable
Process
Reusable
Code
- 19. © 2014 Indium Software
ENHANCING SOFTWARE QUALITY
19
Thank You
USA:
americas.sales@indiumsoft.com
EMEA & APAC:
apac.sales@indiumsoft.com
emea.sales@indiumsoft.com
INDIA:
sales@indiumsoft.com
Sunnyvale
Suite 210, 1250 Oakmead Parkway
Sunnyvale, CA – 94085.
Phone: +1(408) 501-8844
Fax: +1(408) 501-8808
Atlanta
Crown Office Suites
1870 The Exchange, Suite 100
Atlanta, GA 30339
Phone: +1 (678) 608-0809, +1(770) 989-7302
New Delhi
F-1/5 Okhla Industrial Area Phase-I,
New Delhi – 110 020.
Phone: +91-11-6613 0400
Bengaluru
SRS Plaza, No. 246, 2nd & 3rd Floor
13th Cross, Indira Nagar 2nd Stage
Bengaluru – 560 038.
Phone: +91-80-4914 7777
Chennai
VDS House
41, 2nd Floor, Cathedral Road
Chennai – 600 086.
Phone: +91-44-2811 6330
Fax: +91-44-4210 4033