SlideShare a Scribd company logo
1 of 23
Download to read offline
Presented By:
  RAVI KUMAR
HCL Technologies Ltd.

                        http://www.bilzits.com/servicests_en.asp
• agile – 1 minute intro
•agile loves testers and testers fear
•Brian Maricks test categories
•testing role , old and agile ways of
testing                                 •case for IV&V in the agile world
•agile testing – challenges, how to     • role of automation and continuous
and role of tester                      integration
                                        •agile IV&V – Patterns &Anti
                                        Patterns
                                        •strategies & challenges

                                                                              2
3
–
Iterative & Incremental


      Something


       agile



                          5
–
http://cartoontester.blogspot.com/2010/01/cartoon-agile-testing.html



                                                                       7
Testers are Obsolete:
• Not true at all.
• Testers add value by
   – Unearthing flaws than
     validating just the
     completeness.
   – Focussing on feature
     usage for customer than
     looking into technical
     implementation.
• Testers need to learn and
  adapt to new ways.           http://www.altrock.su/music/metal/print:page,1,4083-fear-
                               factory-obsolete-1998.html


                                                                                           8
Brian Marick’s Test Categorization




           http://www.raysullivan.com/2009/05/it-takes-a-village-to-test/


                                                                            9
   Process of testing after dev.
             Quality gates come to effect.
             Code hand-off.
             Managing test show-stoppers, support etc.
             Reduced functional deliverables


           Meant for Performance Testing
           Rewrites of automation scripts
           Tools adoption



 Unit      Developer Tests (resistance to writing unit tests)
Testing    Does not know what to test.
           Often lack of unit tests result in show stoppers
            for QA/Functional Testing




                                                                 10
 Expensive and has to be minimized.
                                         Tools: Sahi, Watir, Selenium,
 Minimizing requires thoughts and
                                         Abbot, Frankenstein




                                                                                   Role of tester
  analysis.                                                                UI
                                                                         Testing
  Acceptance Testing.
 Very good to capture customer or
business user perspective.               Tools: Fit, Fitnesse, RSpec,
 Not a substitute to unit testing.
                                         JBehave



   Foundation of a solid test
automation strategy.                                                Unit Testing
 Acceptance Criteria drives unit test
creation.                                Tools: xUnit, TestNG
 Testers can help developers to
identify unit test cases.




                                                                                                    11
–
testers are committed to ….
• define acceptance criteria and acceptance tests.
• clarify any ambiguity until it is understood by the team.
• testing along with development without sitting behind the QA wall
  awaiting code hand-off.
• being an equal participant with the customer and the developer in
  defining “DONE” criteria.
• maintaining of acceptance and other test scripts with automation
  where feasible.
• provide frequent and continuous feedback to the team.

                                                                      12
–
• Work with Customers, Business, Developers and
  BAs to define acceptance criteria.
• Pair with developers and testers.
• Automate whatever you can. (xUnit test suites,
  Web automation…)
   – Can avoid manual regression tests.
   – creating mocks to test end-to-end testing
     scenarios.
• Metrics on bugs surfaced…..but remember
   – Trailing indicators don’t help team much. (
     Bugs that escaped into UAT)
   – Leading indicators does help. (Bugs that
     escaped just an iteration).
                                                   13
–
• Old ways die hard
• Adoption of automation tools.
   – Tools such as QTP alone may not be
     sufficient.
• Automating/maintaining test scripts.
• Bringing testing forward.
   – In agile testing is first and then
     development.
• Change in tester and management mindset
   – Testers are also developers.
   – Writing test scripts is similar to writing
     code

                                                  14
• Conducts many types of testing
  which the dev team may not
  performs
   – Includes Non functional, SIT,
     Exploratory, Risk Based,
     Security, Usability etc.
• IV&V teams support multiple        •
  dev teams.                         •
• Engaging IV&V teams are
                                     •
  economical.
• Helps is scaling agile in the
                                     •
  organization.
                                         16
To achieve the above…..the IV&V teams must have
• Skills in right tools
   • Just expensive proprietary tools may not work.
   • Any tool to support testing.
• Right roles represented in the team
   • Toolsmith                                        Continuous
                                                      Integration is
   • Test Developer                                   CRITICAL !!!
   • Testers
                                                                       17
–
Early Testing: Component Based




Early Testing: Layered Approach




                                  18
Early Testing Continued…
• Functional                                 • RBT for Evolving
 • Leveraging common testing frameworks        Requirements
   (Ex. xunits , Acceptance Tests etc.)
                                                • Release planning to identify potential
 • Invoke QC/QTP tests as part of weekly          RBTs
   builds.                                      • Collaborate with BAs as an ongoing
• End-to-End Testing                              basis by parallel test teams
                                                • Automate RBTs on stable sprint code
 • Identify Services Interdependencies.
 • Test Data Creation and Canned Test Data
   Repositories ahead of time.
 • Leverage Functional Test Suites from
   Functional Team. Automate Input
   Scenarios, Business Flows and Expected
   Outputs.

                                                                                       19
PATTERNS                       ANTI PATTERNS
• Share a common product       • Separate backlogs
  backlog and sprint backlog   • Separate teams
• Work in the same team as     • Testers only planning
  developers                     sessions.
• Common planning sessions     • Reliance on only manual
• Automation and test script     testing.
  refactoring                  • Await code drops and hand
• Helps developers pre-empt      offs to begin testing
  bugs                         • Catalogue bugs.

                                                             20
Questions
1.   Agile Testing: http://en.wikipedia.org/wiki/Agile_testing
2.   Agile Testing and Quality Strategies: Discipline Over Rhetoric:
     http://www.ambysoft.com/essays/agileTesting.html#IndependentParallelTe
     sting
3.   Lisa Crispin, Janet Gregory (2009). Agile Testing: A Practical Guide for
     Testers and Agile Teams. Addison-Wesley. ISBN 0-321-53446-8.
4.   Agile Manifesto: http://agilemanifesto.org/
5.   Brian Marick Test Categories: http://www.raysullivan.com/2009/05/it-
     takes-a-village-to-test/
6.   Agile and Independent Testing:
     https://www.ibm.com/developerworks/mydeveloperworks/blogs/ambler/entr
     y/agile_and_independent_testing25?lang=en
7.   Agile Test Automation:
     http://www.satisfice.com/presentations/agileauto.pdf
                                                                           22
Engaging IV&V Testing Services for Agile Projects

More Related Content

What's hot

An Introduction to Test Driven Development
An Introduction to Test Driven Development An Introduction to Test Driven Development
An Introduction to Test Driven Development CodeOps Technologies LLP
 
30 testing interview questions for experienced
30 testing interview questions for experienced30 testing interview questions for experienced
30 testing interview questions for experienceddilipambhore
 
Qa mockup interview for automation testing
Qa mockup interview for automation testingQa mockup interview for automation testing
Qa mockup interview for automation testingKadharBashaJ
 
Software testing ... who’s responsible is it?
Software testing ... who’s responsible is it?Software testing ... who’s responsible is it?
Software testing ... who’s responsible is it?Manjula03809891
 
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...Ievgenii Katsan
 
Test driven development
Test driven developmentTest driven development
Test driven developmentNascenia IT
 
Unit testing & TDD concepts with best practice guidelines.
Unit testing & TDD concepts with best practice guidelines.Unit testing & TDD concepts with best practice guidelines.
Unit testing & TDD concepts with best practice guidelines.Mohamed Taman
 
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Wolfgang Grieskamp
 
ASDSpec, Model Based Testing
ASDSpec, Model Based TestingASDSpec, Model Based Testing
ASDSpec, Model Based TestingRachid Kherrazi
 
TDD (Test Driven Design)
TDD (Test Driven Design)TDD (Test Driven Design)
TDD (Test Driven Design)nedirtv
 
Behavior Driven Development with SpecFlow
Behavior Driven Development with SpecFlowBehavior Driven Development with SpecFlow
Behavior Driven Development with SpecFlowRachid Kherrazi
 
Istqb intro with question answer for exam preparation
Istqb intro with question answer for exam preparationIstqb intro with question answer for exam preparation
Istqb intro with question answer for exam preparationKevalkumar Shah
 
Test driven development
Test driven developmentTest driven development
Test driven developmentnamkha87
 
TDD - Test Driven Development
TDD - Test Driven DevelopmentTDD - Test Driven Development
TDD - Test Driven DevelopmentTung Nguyen Thanh
 
Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++Hong Le Van
 

What's hot (19)

An Introduction to Test Driven Development
An Introduction to Test Driven Development An Introduction to Test Driven Development
An Introduction to Test Driven Development
 
30 testing interview questions for experienced
30 testing interview questions for experienced30 testing interview questions for experienced
30 testing interview questions for experienced
 
Qa mockup interview for automation testing
Qa mockup interview for automation testingQa mockup interview for automation testing
Qa mockup interview for automation testing
 
Software testing ... who’s responsible is it?
Software testing ... who’s responsible is it?Software testing ... who’s responsible is it?
Software testing ... who’s responsible is it?
 
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
Volodymyr Prymakov and Vlada Benyukh Detailed manual estimation approach for ...
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
 
Test driven development
Test driven developmentTest driven development
Test driven development
 
TDD and BDD and ATDD
TDD and BDD and ATDDTDD and BDD and ATDD
TDD and BDD and ATDD
 
Unit testing & TDD concepts with best practice guidelines.
Unit testing & TDD concepts with best practice guidelines.Unit testing & TDD concepts with best practice guidelines.
Unit testing & TDD concepts with best practice guidelines.
 
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
 
Unit testing
Unit testingUnit testing
Unit testing
 
ASDSpec, Model Based Testing
ASDSpec, Model Based TestingASDSpec, Model Based Testing
ASDSpec, Model Based Testing
 
TDD (Test Driven Design)
TDD (Test Driven Design)TDD (Test Driven Design)
TDD (Test Driven Design)
 
Behavior Driven Development with SpecFlow
Behavior Driven Development with SpecFlowBehavior Driven Development with SpecFlow
Behavior Driven Development with SpecFlow
 
Python and test
Python and testPython and test
Python and test
 
Istqb intro with question answer for exam preparation
Istqb intro with question answer for exam preparationIstqb intro with question answer for exam preparation
Istqb intro with question answer for exam preparation
 
Test driven development
Test driven developmentTest driven development
Test driven development
 
TDD - Test Driven Development
TDD - Test Driven DevelopmentTDD - Test Driven Development
TDD - Test Driven Development
 
Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++
 

Viewers also liked

Mathematics of life
Mathematics of lifeMathematics of life
Mathematics of lifeMar Zafar
 
Card & Payments Industry Overview
Card & Payments Industry OverviewCard & Payments Industry Overview
Card & Payments Industry Overviewankitinxs
 
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...Coupa Software
 
Software Testing for International Students
Software Testing for International StudentsSoftware Testing for International Students
Software Testing for International Studentscristianoribeirosilva
 
Evolution of Software Testing - Chuan Chuan Law
Evolution of Software Testing - Chuan Chuan Law Evolution of Software Testing - Chuan Chuan Law
Evolution of Software Testing - Chuan Chuan Law Chuan Chuan Law
 
Fundamentals of Software Testing
Fundamentals of Software TestingFundamentals of Software Testing
Fundamentals of Software TestingSagar Joshi
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesNed Potter
 

Viewers also liked (7)

Mathematics of life
Mathematics of lifeMathematics of life
Mathematics of life
 
Card & Payments Industry Overview
Card & Payments Industry OverviewCard & Payments Industry Overview
Card & Payments Industry Overview
 
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...
Staying railsy - while scaling complexity or Ruby on Rails in Enterprise Soft...
 
Software Testing for International Students
Software Testing for International StudentsSoftware Testing for International Students
Software Testing for International Students
 
Evolution of Software Testing - Chuan Chuan Law
Evolution of Software Testing - Chuan Chuan Law Evolution of Software Testing - Chuan Chuan Law
Evolution of Software Testing - Chuan Chuan Law
 
Fundamentals of Software Testing
Fundamentals of Software TestingFundamentals of Software Testing
Fundamentals of Software Testing
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and Archives
 

Similar to Engaging IV&V Testing Services for Agile Projects

Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?alind tiwari
 
Testing in agile
Testing in agileTesting in agile
Testing in agilesachxn1
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversionAshish Kumar
 
Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012Imaginet
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterDeclan Whelan
 

Similar to Engaging IV&V Testing Services for Agile Projects (20)

Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?
 
Agile process
Agile processAgile process
Agile process
 
Testing in agile
Testing in agileTesting in agile
Testing in agile
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
 
Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile Tester
 
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference SpeechVaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
 
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
 
Vaidyanathan Ramalingam Software Testing Eco System Conference Speech
Vaidyanathan Ramalingam Software Testing Eco System Conference SpeechVaidyanathan Ramalingam Software Testing Eco System Conference Speech
Vaidyanathan Ramalingam Software Testing Eco System Conference Speech
 
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
 
Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011
Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011
Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011
 
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference SpeechVaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
 
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 SpeechVaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
 
Vaidyanathan Ramalingam Rca In Testing Conference Speech
Vaidyanathan Ramalingam Rca In Testing Conference SpeechVaidyanathan Ramalingam Rca In Testing Conference Speech
Vaidyanathan Ramalingam Rca In Testing Conference Speech
 
Vaidyanathan Ramalingam Testing Checklist Conference Speech
Vaidyanathan Ramalingam Testing Checklist Conference SpeechVaidyanathan Ramalingam Testing Checklist Conference Speech
Vaidyanathan Ramalingam Testing Checklist Conference Speech
 
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
 
Vaidyanathan Ramalingam Agile Conference Speech
Vaidyanathan Ramalingam Agile Conference SpeechVaidyanathan Ramalingam Agile Conference Speech
Vaidyanathan Ramalingam Agile Conference Speech
 
Vaidyanathan Ramalingam Agile Testing Conference Speech
Vaidyanathan Ramalingam Agile Testing Conference SpeechVaidyanathan Ramalingam Agile Testing Conference Speech
Vaidyanathan Ramalingam Agile Testing Conference Speech
 
Vaidyanathan Ramalingam Rca In Agile Conference Speech
Vaidyanathan Ramalingam Rca In Agile Conference SpeechVaidyanathan Ramalingam Rca In Agile Conference Speech
Vaidyanathan Ramalingam Rca In Agile Conference Speech
 

More from Ravi Kumar

Accelerating Business Value - Culture Shift Enablers
Accelerating Business Value - Culture Shift EnablersAccelerating Business Value - Culture Shift Enablers
Accelerating Business Value - Culture Shift EnablersRavi Kumar
 
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over Process
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over ProcessAttaining Agile Fluency: Coaching Techniques - Focus on Goals Over Process
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over ProcessRavi Kumar
 
Embracing Agile for Business Impact: Role of Leadership & Management
Embracing Agile for Business Impact: Role of Leadership & ManagementEmbracing Agile for Business Impact: Role of Leadership & Management
Embracing Agile for Business Impact: Role of Leadership & ManagementRavi Kumar
 
Delivering Business Value - The Deal Breakers
Delivering Business Value - The Deal BreakersDelivering Business Value - The Deal Breakers
Delivering Business Value - The Deal BreakersRavi Kumar
 
Agile IT Services Manifesto
Agile IT Services ManifestoAgile IT Services Manifesto
Agile IT Services ManifestoRavi Kumar
 
Agile Adoption in IT Services - Evolution over Revolution
Agile Adoption in IT Services - Evolution over RevolutionAgile Adoption in IT Services - Evolution over Revolution
Agile Adoption in IT Services - Evolution over RevolutionRavi Kumar
 
BSPIN-Agile Practices Benchmark
BSPIN-Agile Practices BenchmarkBSPIN-Agile Practices Benchmark
BSPIN-Agile Practices BenchmarkRavi Kumar
 
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …Ravi Kumar
 
DevOps Days 2012 - Going LEAN in IT Services Organization
DevOps Days 2012 -  Going LEAN in IT Services OrganizationDevOps Days 2012 -  Going LEAN in IT Services Organization
DevOps Days 2012 - Going LEAN in IT Services OrganizationRavi Kumar
 
Agile india2012 - Dealing with agile RFP
Agile india2012   - Dealing with agile RFPAgile india2012   - Dealing with agile RFP
Agile india2012 - Dealing with agile RFPRavi Kumar
 
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negatives
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negativesAgile Tour 2010 - SCRUM Turning Scum - Ignoring the false negatives
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negativesRavi Kumar
 

More from Ravi Kumar (11)

Accelerating Business Value - Culture Shift Enablers
Accelerating Business Value - Culture Shift EnablersAccelerating Business Value - Culture Shift Enablers
Accelerating Business Value - Culture Shift Enablers
 
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over Process
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over ProcessAttaining Agile Fluency: Coaching Techniques - Focus on Goals Over Process
Attaining Agile Fluency: Coaching Techniques - Focus on Goals Over Process
 
Embracing Agile for Business Impact: Role of Leadership & Management
Embracing Agile for Business Impact: Role of Leadership & ManagementEmbracing Agile for Business Impact: Role of Leadership & Management
Embracing Agile for Business Impact: Role of Leadership & Management
 
Delivering Business Value - The Deal Breakers
Delivering Business Value - The Deal BreakersDelivering Business Value - The Deal Breakers
Delivering Business Value - The Deal Breakers
 
Agile IT Services Manifesto
Agile IT Services ManifestoAgile IT Services Manifesto
Agile IT Services Manifesto
 
Agile Adoption in IT Services - Evolution over Revolution
Agile Adoption in IT Services - Evolution over RevolutionAgile Adoption in IT Services - Evolution over Revolution
Agile Adoption in IT Services - Evolution over Revolution
 
BSPIN-Agile Practices Benchmark
BSPIN-Agile Practices BenchmarkBSPIN-Agile Practices Benchmark
BSPIN-Agile Practices Benchmark
 
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …
ALN-Bengaluru - Agile Management - Driving Leadership & Complexity of …
 
DevOps Days 2012 - Going LEAN in IT Services Organization
DevOps Days 2012 -  Going LEAN in IT Services OrganizationDevOps Days 2012 -  Going LEAN in IT Services Organization
DevOps Days 2012 - Going LEAN in IT Services Organization
 
Agile india2012 - Dealing with agile RFP
Agile india2012   - Dealing with agile RFPAgile india2012   - Dealing with agile RFP
Agile india2012 - Dealing with agile RFP
 
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negatives
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negativesAgile Tour 2010 - SCRUM Turning Scum - Ignoring the false negatives
Agile Tour 2010 - SCRUM Turning Scum - Ignoring the false negatives
 

Engaging IV&V Testing Services for Agile Projects

  • 1. Presented By: RAVI KUMAR HCL Technologies Ltd. http://www.bilzits.com/servicests_en.asp
  • 2. • agile – 1 minute intro •agile loves testers and testers fear •Brian Maricks test categories •testing role , old and agile ways of testing •case for IV&V in the agile world •agile testing – challenges, how to • role of automation and continuous and role of tester integration •agile IV&V – Patterns &Anti Patterns •strategies & challenges 2
  • 3. 3
  • 4.
  • 5. Iterative & Incremental Something agile 5
  • 6.
  • 8. Testers are Obsolete: • Not true at all. • Testers add value by – Unearthing flaws than validating just the completeness. – Focussing on feature usage for customer than looking into technical implementation. • Testers need to learn and adapt to new ways. http://www.altrock.su/music/metal/print:page,1,4083-fear- factory-obsolete-1998.html 8
  • 9. Brian Marick’s Test Categorization http://www.raysullivan.com/2009/05/it-takes-a-village-to-test/ 9
  • 10. Process of testing after dev.  Quality gates come to effect.  Code hand-off.  Managing test show-stoppers, support etc.  Reduced functional deliverables  Meant for Performance Testing  Rewrites of automation scripts  Tools adoption Unit  Developer Tests (resistance to writing unit tests) Testing  Does not know what to test.  Often lack of unit tests result in show stoppers for QA/Functional Testing 10
  • 11.  Expensive and has to be minimized. Tools: Sahi, Watir, Selenium,  Minimizing requires thoughts and Abbot, Frankenstein Role of tester analysis. UI Testing  Acceptance Testing.  Very good to capture customer or business user perspective. Tools: Fit, Fitnesse, RSpec,  Not a substitute to unit testing. JBehave  Foundation of a solid test automation strategy. Unit Testing  Acceptance Criteria drives unit test creation. Tools: xUnit, TestNG  Testers can help developers to identify unit test cases. 11
  • 12. – testers are committed to …. • define acceptance criteria and acceptance tests. • clarify any ambiguity until it is understood by the team. • testing along with development without sitting behind the QA wall awaiting code hand-off. • being an equal participant with the customer and the developer in defining “DONE” criteria. • maintaining of acceptance and other test scripts with automation where feasible. • provide frequent and continuous feedback to the team. 12
  • 13. – • Work with Customers, Business, Developers and BAs to define acceptance criteria. • Pair with developers and testers. • Automate whatever you can. (xUnit test suites, Web automation…) – Can avoid manual regression tests. – creating mocks to test end-to-end testing scenarios. • Metrics on bugs surfaced…..but remember – Trailing indicators don’t help team much. ( Bugs that escaped into UAT) – Leading indicators does help. (Bugs that escaped just an iteration). 13
  • 14. – • Old ways die hard • Adoption of automation tools. – Tools such as QTP alone may not be sufficient. • Automating/maintaining test scripts. • Bringing testing forward. – In agile testing is first and then development. • Change in tester and management mindset – Testers are also developers. – Writing test scripts is similar to writing code 14
  • 15.
  • 16. • Conducts many types of testing which the dev team may not performs – Includes Non functional, SIT, Exploratory, Risk Based, Security, Usability etc. • IV&V teams support multiple • dev teams. • • Engaging IV&V teams are • economical. • Helps is scaling agile in the • organization. 16
  • 17. To achieve the above…..the IV&V teams must have • Skills in right tools • Just expensive proprietary tools may not work. • Any tool to support testing. • Right roles represented in the team • Toolsmith Continuous Integration is • Test Developer CRITICAL !!! • Testers 17
  • 18. – Early Testing: Component Based Early Testing: Layered Approach 18
  • 19. Early Testing Continued… • Functional • RBT for Evolving • Leveraging common testing frameworks Requirements (Ex. xunits , Acceptance Tests etc.) • Release planning to identify potential • Invoke QC/QTP tests as part of weekly RBTs builds. • Collaborate with BAs as an ongoing • End-to-End Testing basis by parallel test teams • Automate RBTs on stable sprint code • Identify Services Interdependencies. • Test Data Creation and Canned Test Data Repositories ahead of time. • Leverage Functional Test Suites from Functional Team. Automate Input Scenarios, Business Flows and Expected Outputs. 19
  • 20. PATTERNS ANTI PATTERNS • Share a common product • Separate backlogs backlog and sprint backlog • Separate teams • Work in the same team as • Testers only planning developers sessions. • Common planning sessions • Reliance on only manual • Automation and test script testing. refactoring • Await code drops and hand • Helps developers pre-empt offs to begin testing bugs • Catalogue bugs. 20
  • 22. 1. Agile Testing: http://en.wikipedia.org/wiki/Agile_testing 2. Agile Testing and Quality Strategies: Discipline Over Rhetoric: http://www.ambysoft.com/essays/agileTesting.html#IndependentParallelTe sting 3. Lisa Crispin, Janet Gregory (2009). Agile Testing: A Practical Guide for Testers and Agile Teams. Addison-Wesley. ISBN 0-321-53446-8. 4. Agile Manifesto: http://agilemanifesto.org/ 5. Brian Marick Test Categories: http://www.raysullivan.com/2009/05/it- takes-a-village-to-test/ 6. Agile and Independent Testing: https://www.ibm.com/developerworks/mydeveloperworks/blogs/ambler/entr y/agile_and_independent_testing25?lang=en 7. Agile Test Automation: http://www.satisfice.com/presentations/agileauto.pdf 22