SlideShare a Scribd company logo
1 of 10
Download to read offline
Leadership Lessons
     for the Test & QA Profession



                        Vaidyanathan Ramalingam (Vaidya)
                              Director Engineering (Test)
                  Huawei Technologies India Pvt. Ltd., Bangalore, INDIA




http://www.siliconindia.com/events-speakers/software-testing-Bangalore-SoftecBangalore_2011.html
5 Key Lessons!
                 1. Waterfall Testing Vs Agile Testing
                 2. Testing Checklist – 5 W & 2 H
                 3. Trade Off Economics in Testing
                 4. Software Testing Eco System
                 5. RCA (Root Cause Analysis)


                     Huawei is a global telecommunications solutions provider with long-term partnerships with operators
                     around the world. Huawei actively participates in 91 international standardization organization
                     including ITU, 3GPP, 3GPP2, ETSI, IETF, OMA andIEEE. Huawei holds the world’s #1 position in PCT
                     Patent applications (WIPO 2008) and is ranked among the top 3 in LTE essential patents. Huawei’s
                     products and solutions have been deployed in over 100 countries and have served 45 of the world's
                     top 50 telecom operators, as well as one third of the world's population.
www.huawei.com

                     *The content of this presentation is non commercial and based on self experience, interpretations/view points. The
                     data provided may not be full, accurate and latest. The intention is knowledge sharing & to promote the software
                     testing. The Product names, logos, brands, standard body/institute’s names & other trademarks referred within the
                     presentation are the property of their respective trademark holders.
1. Waterfall Testing Vs Agile Testing (1 of 2)

    Area            Testing In Waterfall Model                            Testing in Agile Model

(1) Test                    •Complete & Base-line (freeze)      •Incremental Req. as stories
Requirement                 •Separate Change Request /          •To accommodate change/dynamic Req.
                            Enhancement                         •Req. prioritized based on: business values of customers, early
                                                                realization & feedback


(2) Test                    •Detailed upfront test strategy     •Initial test strategy
Strategy                    •Covers e2e test scope              • incremental changes during iterations/sprints


(3) Test Team               •Independent team /mindset          •Collaborative team (dev & test) ; common goal; Agile mindset
Structure                   •Test Manager: Project &            •Test Manager:
                            Resource Management (people                  •Test Planning & Estimation (input to backlogs)
                            & lab)                                       •Resource Management (people & lab)
                            •Defined & Clear role               •Scrum Master: Release/Scrum Management
                                                                •Lack of role clarity & 100% buy-in on agile practices

(4) Test Cases              •One time TC dev.                   •Iterative/Sprint wise TCs dev. @ story level (Functional & Non
(TCs)                       •Longer time                        Functional)
Development                 •Ver. level contribution (partial   •TCs for inter-relation between stories (within & previous iterations)
                            & at the end) for acceptance        •Story level acceptance TCs dev. with customers
                            tests
(5) Test                    •Automation behind manual           •Iteration/Sprint based automation & in C.I.
Automation                  test phase                          •Shortage of time (poor scope) leads to missing/detailed scenarios
                            •Typically separate manual,         •Automation suite quality deteriorates - Poor Focus on:
                            automation & performance test                –     Scripting standard/review
                            team                                         –     SDLC approach
                                                                         –     Maintenance (Ver.2 Ver.)
                                                                         –     No Synch.: code <-> automation
                                                                •Lack of attention leads to: Random Failures, Longer time to run, GUI
                                                                errors, where the issue: defect or automation suite?
                                                                •Coverage metric
1. Waterfall Testing Vs Agile Testing (2 of 2)

   Area           Testing In Waterfall Model                           Testing in Agile Model
(6)                     •Not strict                            •Strictly followed (early feedback/defects); back bone of agile
Continuous              •Relatively longer time                •Efficient CI topology, architecture & timely automation suite
Integration             •Relatively less frequent builds       are critical
(C.I.)                                                         •CI pass rate metric




(7) Test Lab            •Required just before the testing      •Required from initial iteration onwards
/ Test bed              (due to phase approach)




(8) Test                •Longer, dedicated & multiple          •All the stories TCs tested within the iteration/sprint
Execution               test cycles                            •Continuous product/application visibility to testers
                        •Late product/application visibility   •Customer demo at each iteration
                        •Phase wise test cycles                •Short test cycles for Non Functional Testing @ iteration end
                                                               •Same Test engineers to iteratively test & be an expert in:
                                                                        –     customer domain
                                                                        –     test design
                                                                        –     test automation / scripting
                                                                        –     Non functional test
                                                                        –     C.I.

(9) Defect              •Zero defect target @ end of Ver.      •Early & iterative defect finding
Finding                 •Relatively Defect backlog is          •Less/zero iterative defect backlog
                        larger                                 •How much re-work metric
                        •Test cycle wise # defects trend       •Iteration wise # defects trend (much controlled)
                        (high-low-high-low ….)
2. Testing Checklist – 5 W & 2 H

       Why To TEST? To meet the Req., Architecture, Design, Code, Production
       Environment, Usability, Interoperability, Migration and their changes

       What to TEST? Customer/Domain Requirements, Test Strategy, Weak & Strong
       Area, Test Iteration/Sprint Scope or Focus, Buggy Module,

       When to TEST? Timeline asked for test iterations/sprints/phases/post release
       tests [R&D or Field tests)

       Who will TEST? Functional/Non Functional testers; integration/field testers; ext.
       certification bodies, customer reps.

       Where To TEST? Environment: Typical R&D Env, Integration
       (Platform/Component/Solution/Multiple Inter-operation Systems)

       How to TEST? Test Techniques, Automation, Script less Automation (Ref: Qualitia),
       Model Based Testing (Ref: Conformiq), Hypothesis Based Testing (Ref: STAG S/w)

       How Long to TEST? #Test Cycles, Release quality criteria, Iteration/ Sprints check
       point exit quality, Defects Trend, deadline/feedback based approach

 Note: The same approach can be applied for Test Automation also.
Example: Why to automate? What to automate? When to automate?....
3. Trade Off Economics in Testing




•Test coverage scope                                  •Iteration/Sprint & Release
•Iteration/sprint wise plan                           quality goal
•Test priorities                                      •Design/Code changes
•Automation scope / goal                              •Continuous reporting to
•Late features / stories                              PMO & prioritization
•Test Scope Risk mitigation                           •Defect Trend & Backlog
                                                      •Quality Risk Mitigation




•Test Estimation/planning &                           •Test phases/ iterations
resource allocation                                   •Handover to QA timeline
•Test bed/lab need                                    •Iteration/Sprint/Version
•Quality based (defect                                level release dates
trend/backlog) test cycles                            •Automation & Defect
•Automation cost                                      verification timeline
•Cost Risk Mitigation                                 •Time Risk Mitigation
4. Software Testing Eco System



 Technology (DB, OS, Platform,    Management / Client      QA / Testing               Development                   Program Office /
 IDE & Configuration/Topology,                            Capital / Budget         (add/delete/modify/               Product Owner
    Standards & Protocols)                                                           enhancements)




  Human Resource (On-site,                                                                                    Competency Development
  Offshore, Customers’ site,                                                                                        Framework
      Vendor partners)




Defect Management System                                                                                    Quality & Release Process
 & Project Tracking Tools                                                                                   Framework (SDLC or PDLC,
                                                                                                             Agile/Lean/ISO/CMMi etc)




    Test Automation &                                                                                          IT Support / Professional
   Tools Centre / CoE                                                                                           Services / Field & Tech
                                                                                                                       Support




   Software Configuration          Software Build &        System Test Lab /        Document Repository /       Access to Customers /
        Management               Continuous Integration   Test bed / Third party       Test Artifacts &           Clients / Remote
                                                             certification or      Knowledge Management         Environments / Cloud
                                                           benchmark / Cloud             Framework            Production Environments /
                                                            Test environment                                             HQ




(Needs collaboration with each stakeholders / elements to ensure QUALITY, COST, TIME-LINE & SCOPE
                                    based on your project need!)
5. RCA (Root Cause Analysis) 1 of 2



      Focus: within the version                           Focus: version to version


     RCA on defects must be used like                 RCA on defects should “not” be like
“preventive health check-up” to live longer            investigating “dead body” during
       & healthy (In-Phase Quality)                   postmortem (Post Release Quality)

The software we build & test to have in-phase     Often (in waterfall model) the RCA is done at
RCA at every checkpoints/ iterations/ sprints to   the end of the project to improve the “next”
ensure no defect slippage to next stage            release (not before death of the patient)
Each phase/iteration/sprint to demand quality     In this case the poor quality impact is already
from previous one and ensure to next one           made to S/w customers. (RCA learning in this
Quality to be achieved continuously!              case saves other patients, not the one who is
                                                   already dead!)
5. RCA (Root Cause Analysis) 2 of 2
 feedback
                                                          (I) Requirement Analysis & Architecture Phase Defects RCA
                                                                      with Corrective & Preventive Actions
                        RCA Scope: Requirement Documents /             RCA on: Requirement & Architecture           RCA by: Sys. Analyst/Architects/Product
                                    Architecture                                     Defects                       owner; Source: Review comments, Defects




                                                       (II) Design & Development Phase/Iterations/Sprints Defects RCA
                                                                      with Corrective & Preventive Actions
                                                                    RCA on: Design Issues; Unit & Module Test       RCA by: System Architects & Developers
                           RCA Scope: Design, Source Code
                                                                                      Defects                            Source: Review comments, Defects




                                                               (III) Testing Phase/Iterations/Sprints Defects RCA
                                                                      with Corrective & Preventive Actions
                      RCA Scope: Test Cases/Automation suite of                                                                  RCA by: Testers
                                                                       RCA on: Product / Application Defects
                       New & Old Features / Maintenance Fixes                                                        Source: Defects & Customers Feedback




                        (IV) SDLC [Software Development Life Cycle] Defects RCA with Corrective & Preventive Actions
                                       RCA by: Quality Engineers; Source: Defects (in-phase/post release)
                              RCA Scope: To analyze root causes on slipped defects & where/how the defects got                            customer
                                                             originated/injected.
                         Outcome: Report on systematic improvements w.r.t. SDLC phases/iterations/sprints/release


Iteration /sprint/release wise feedback to previous SDLC phases. Teams to conduct iterative/in-phase/Post Release RCA.
Thus team can improve/prevent on defects slippage in next iteration/sprints/release.
Knowledge Is Power
            Thank You!

                     Feedback / Suggestions / Power Point Request to:
                                              rvaidya67@hotmail.com

                                                          Vaidyanathan Ramalingam




http://www.siliconindia.com/events-speakers/software-testing-Bangalore-SoftecBangalore_2011.html

More Related Content

What's hot

Quality Coding: What's New with Visual Studio 2012
Quality Coding: What's New with Visual Studio 2012Quality Coding: What's New with Visual Studio 2012
Quality Coding: What's New with Visual Studio 2012Imaginet
 
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Wolfgang Grieskamp
 
Manual Testing Notes
Manual Testing NotesManual Testing Notes
Manual Testing Notesguest208aa1
 
TEA Presentation V 0.3
TEA Presentation V 0.3TEA Presentation V 0.3
TEA Presentation V 0.3Ian McDonald
 
Model-Based Testing: Concepts, Tools, and Techniques
Model-Based Testing: Concepts, Tools, and TechniquesModel-Based Testing: Concepts, Tools, and Techniques
Model-Based Testing: Concepts, Tools, and TechniquesTechWell
 
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COM
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COMSOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COM
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COMKiran Chandra Chitmalla
 
SAP Test automation - fully automatic test of complex business processes incl...
SAP Test automation - fully automatic test of complex business processes incl...SAP Test automation - fully automatic test of complex business processes incl...
SAP Test automation - fully automatic test of complex business processes incl...Tobias Trapp
 

What's hot (8)

Quality Coding: What's New with Visual Studio 2012
Quality Coding: What's New with Visual Studio 2012Quality Coding: What's New with Visual Studio 2012
Quality Coding: What's New with Visual Studio 2012
 
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
Model-Based Testing: Theory and Practice. Keynote @ MoTiP (ISSRE) 2012.
 
Manual Testing Notes
Manual Testing NotesManual Testing Notes
Manual Testing Notes
 
TEA Presentation V 0.3
TEA Presentation V 0.3TEA Presentation V 0.3
TEA Presentation V 0.3
 
Model-Based Testing: Concepts, Tools, and Techniques
Model-Based Testing: Concepts, Tools, and TechniquesModel-Based Testing: Concepts, Tools, and Techniques
Model-Based Testing: Concepts, Tools, and Techniques
 
Manual testing1
Manual testing1Manual testing1
Manual testing1
 
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COM
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COMSOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COM
SOFTWARE TESTING COURSE MODULES BY WWW.QATESTINGONLINETRAINING.COM
 
SAP Test automation - fully automatic test of complex business processes incl...
SAP Test automation - fully automatic test of complex business processes incl...SAP Test automation - fully automatic test of complex business processes incl...
SAP Test automation - fully automatic test of complex business processes incl...
 

Similar to Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011

Engaging IV&V Testing Services for Agile Projects
Engaging IV&V Testing Services for Agile ProjectsEngaging IV&V Testing Services for Agile Projects
Engaging IV&V Testing Services for Agile ProjectsRavi Kumar
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Synerzip
 
Manual Testing Online Training
Manual Testing Online Training Manual Testing Online Training
Manual Testing Online Training QEdge Tech
 
C:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing processC:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing processselvam mc
 
Gl scrum testing_models
Gl scrum testing_modelsGl scrum testing_models
Gl scrum testing_modelsPragya Rastogi
 
Agile product development and management
Agile product development and managementAgile product development and management
Agile product development and managementAshwinee Kumar
 
Agileproductdevelopmentandmanagement 120420040535-phpapp02
Agileproductdevelopmentandmanagement 120420040535-phpapp02Agileproductdevelopmentandmanagement 120420040535-phpapp02
Agileproductdevelopmentandmanagement 120420040535-phpapp02Cognizant
 
Agile Testing Introduction
Agile Testing IntroductionAgile Testing Introduction
Agile Testing IntroductionHai Tran Son
 
Building Quality In in SAFe – The Testing Organization’s Perspective
Building Quality In in SAFe – The Testing Organization’s Perspective	  Building Quality In in SAFe – The Testing Organization’s Perspective
Building Quality In in SAFe – The Testing Organization’s Perspective Yuval Yeret
 
Test automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application ServerTest automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application ServerRobbie Minshall
 
New trends in testing automation
New trends in testing automationNew trends in testing automation
New trends in testing automationEran Kinsbrunner
 
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...TEST Huddle
 
Software development life cycle
Software development life cycleSoftware development life cycle
Software development life cycleGurban Daniel
 
SWT2_tim.pptx
SWT2_tim.pptxSWT2_tim.pptx
SWT2_tim.pptxBnhT27
 
Topic production code
Topic production codeTopic production code
Topic production codeKavi Kumar
 

Similar to Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011 (20)

Engaging IV&V Testing Services for Agile Projects
Engaging IV&V Testing Services for Agile ProjectsEngaging IV&V Testing Services for Agile Projects
Engaging IV&V Testing Services for Agile Projects
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
 
Manual Testing Online Training
Manual Testing Online Training Manual Testing Online Training
Manual Testing Online Training
 
C:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing processC:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing process
 
Gl scrum testing_models
Gl scrum testing_modelsGl scrum testing_models
Gl scrum testing_models
 
Agile product development and management
Agile product development and managementAgile product development and management
Agile product development and management
 
Agileproductdevelopmentandmanagement 120420040535-phpapp02
Agileproductdevelopmentandmanagement 120420040535-phpapp02Agileproductdevelopmentandmanagement 120420040535-phpapp02
Agileproductdevelopmentandmanagement 120420040535-phpapp02
 
Agile Testing Introduction
Agile Testing IntroductionAgile Testing Introduction
Agile Testing Introduction
 
Building Quality In in SAFe – The Testing Organization’s Perspective
Building Quality In in SAFe – The Testing Organization’s Perspective	  Building Quality In in SAFe – The Testing Organization’s Perspective
Building Quality In in SAFe – The Testing Organization’s Perspective
 
Test automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application ServerTest automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application Server
 
New trends in testing automation
New trends in testing automationNew trends in testing automation
New trends in testing automation
 
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...
 
Sdlc models
Sdlc modelsSdlc models
Sdlc models
 
Software development life cycle
Software development life cycleSoftware development life cycle
Software development life cycle
 
Sdlc
SdlcSdlc
Sdlc
 
SWT2_tim.pptx
SWT2_tim.pptxSWT2_tim.pptx
SWT2_tim.pptx
 
Session2
Session2Session2
Session2
 
SDLC
SDLCSDLC
SDLC
 
Ppt nardeep
Ppt nardeepPpt nardeep
Ppt nardeep
 
Topic production code
Topic production codeTopic production code
Topic production code
 

More from Skills2Talent (Integrated Talent Management and L&D Software - Hire to ROI)

More from Skills2Talent (Integrated Talent Management and L&D Software - Hire to ROI) (20)

LMS eLearning Course Solution_14 APR 2016
LMS eLearning Course Solution_14 APR 2016LMS eLearning Course Solution_14 APR 2016
LMS eLearning Course Solution_14 APR 2016
 
#Cloud #Talent #software for #Startups #SMBs and Large #enterprises #MNCs
#Cloud #Talent #software for #Startups #SMBs and Large #enterprises #MNCs#Cloud #Talent #software for #Startups #SMBs and Large #enterprises #MNCs
#Cloud #Talent #software for #Startups #SMBs and Large #enterprises #MNCs
 
Skills2Talent - Integrated Talent Management & HR ERP Software - Hire to Retire
Skills2Talent - Integrated Talent Management & HR ERP Software - Hire to RetireSkills2Talent - Integrated Talent Management & HR ERP Software - Hire to Retire
Skills2Talent - Integrated Talent Management & HR ERP Software - Hire to Retire
 
Integrated Talent Management Solution - from hire to retire
Integrated Talent Management Solution - from hire to retire Integrated Talent Management Solution - from hire to retire
Integrated Talent Management Solution - from hire to retire
 
Transform from tactical talent management to strategic integrated talent dev...
Transform from tactical talent management  to strategic integrated talent dev...Transform from tactical talent management  to strategic integrated talent dev...
Transform from tactical talent management to strategic integrated talent dev...
 
A world class integrated talent development life cycle solution from hire to ...
A world class integrated talent development life cycle solution from hire to ...A world class integrated talent development life cycle solution from hire to ...
A world class integrated talent development life cycle solution from hire to ...
 
Top 100 agile books for reference vaidyanathan ramalingam director engineerin...
Top 100 agile books for reference vaidyanathan ramalingam director engineerin...Top 100 agile books for reference vaidyanathan ramalingam director engineerin...
Top 100 agile books for reference vaidyanathan ramalingam director engineerin...
 
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
Vaidyanathan Ramalingam_Sprint Testing_SOFTEC_2_July2011_Silicon India Conf_B...
 
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
Vaidyanathan Ramalingam_Iterative Testing_SOFTEC_2_July2011_Silicon India Con...
 
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
Vaidyanathan Ramalingam_Testing in Agile_SOFTEC_2_July2011_Silicon India Conf...
 
Vaidyanathan Ramalingam_Agile QA_SOFTEC_2_July2011_Silicon India Conf_Bangalore
Vaidyanathan Ramalingam_Agile QA_SOFTEC_2_July2011_Silicon India Conf_BangaloreVaidyanathan Ramalingam_Agile QA_SOFTEC_2_July2011_Silicon India Conf_Bangalore
Vaidyanathan Ramalingam_Agile QA_SOFTEC_2_July2011_Silicon India Conf_Bangalore
 
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference SpeechVaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
Vaidyanathan Ramalingam Waterfall Vs Agile Testing Conference Speech
 
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference SpeechVaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
Vaidyanathan Ramalingam Trade Off Economics In Testing Conference Speech
 
Vaidyanathan Ramalingam Testing Checklist Conference Speech
Vaidyanathan Ramalingam Testing Checklist Conference SpeechVaidyanathan Ramalingam Testing Checklist Conference Speech
Vaidyanathan Ramalingam Testing Checklist Conference Speech
 
Vaidyanathan Ramalingam Software Testing Eco System Conference Speech
Vaidyanathan Ramalingam Software Testing Eco System Conference SpeechVaidyanathan Ramalingam Software Testing Eco System Conference Speech
Vaidyanathan Ramalingam Software Testing Eco System Conference Speech
 
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 SpeechVaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
Vaidyanathan Ramalingam Silicon India Testing Conference 2 July2011 Speech
 
Vaidyanathan Ramalingam Rca In Testing Conference Speech
Vaidyanathan Ramalingam Rca In Testing Conference SpeechVaidyanathan Ramalingam Rca In Testing Conference Speech
Vaidyanathan Ramalingam Rca In Testing Conference Speech
 
Vaidyanathan Ramalingam Rca In Agile Conference Speech
Vaidyanathan Ramalingam Rca In Agile Conference SpeechVaidyanathan Ramalingam Rca In Agile Conference Speech
Vaidyanathan Ramalingam Rca In Agile Conference Speech
 
Vaidyanathan Ramalingam Agile Conference Speech
Vaidyanathan Ramalingam Agile Conference SpeechVaidyanathan Ramalingam Agile Conference Speech
Vaidyanathan Ramalingam Agile Conference Speech
 
Vaidyanathan Ramalingam Agile Testing Conference Speech
Vaidyanathan Ramalingam Agile Testing Conference SpeechVaidyanathan Ramalingam Agile Testing Conference Speech
Vaidyanathan Ramalingam Agile Testing Conference Speech
 

Recently uploaded

Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdfJamie (Taka) Wang
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 

Recently uploaded (20)

Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 

Vaidyanathan Ramalingam Agile Testing Leadership Lessons Softec 2 July2011

  • 1. Leadership Lessons for the Test & QA Profession Vaidyanathan Ramalingam (Vaidya) Director Engineering (Test) Huawei Technologies India Pvt. Ltd., Bangalore, INDIA http://www.siliconindia.com/events-speakers/software-testing-Bangalore-SoftecBangalore_2011.html
  • 2. 5 Key Lessons! 1. Waterfall Testing Vs Agile Testing 2. Testing Checklist – 5 W & 2 H 3. Trade Off Economics in Testing 4. Software Testing Eco System 5. RCA (Root Cause Analysis) Huawei is a global telecommunications solutions provider with long-term partnerships with operators around the world. Huawei actively participates in 91 international standardization organization including ITU, 3GPP, 3GPP2, ETSI, IETF, OMA andIEEE. Huawei holds the world’s #1 position in PCT Patent applications (WIPO 2008) and is ranked among the top 3 in LTE essential patents. Huawei’s products and solutions have been deployed in over 100 countries and have served 45 of the world's top 50 telecom operators, as well as one third of the world's population. www.huawei.com *The content of this presentation is non commercial and based on self experience, interpretations/view points. The data provided may not be full, accurate and latest. The intention is knowledge sharing & to promote the software testing. The Product names, logos, brands, standard body/institute’s names & other trademarks referred within the presentation are the property of their respective trademark holders.
  • 3. 1. Waterfall Testing Vs Agile Testing (1 of 2) Area Testing In Waterfall Model Testing in Agile Model (1) Test •Complete & Base-line (freeze) •Incremental Req. as stories Requirement •Separate Change Request / •To accommodate change/dynamic Req. Enhancement •Req. prioritized based on: business values of customers, early realization & feedback (2) Test •Detailed upfront test strategy •Initial test strategy Strategy •Covers e2e test scope • incremental changes during iterations/sprints (3) Test Team •Independent team /mindset •Collaborative team (dev & test) ; common goal; Agile mindset Structure •Test Manager: Project & •Test Manager: Resource Management (people •Test Planning & Estimation (input to backlogs) & lab) •Resource Management (people & lab) •Defined & Clear role •Scrum Master: Release/Scrum Management •Lack of role clarity & 100% buy-in on agile practices (4) Test Cases •One time TC dev. •Iterative/Sprint wise TCs dev. @ story level (Functional & Non (TCs) •Longer time Functional) Development •Ver. level contribution (partial •TCs for inter-relation between stories (within & previous iterations) & at the end) for acceptance •Story level acceptance TCs dev. with customers tests (5) Test •Automation behind manual •Iteration/Sprint based automation & in C.I. Automation test phase •Shortage of time (poor scope) leads to missing/detailed scenarios •Typically separate manual, •Automation suite quality deteriorates - Poor Focus on: automation & performance test – Scripting standard/review team – SDLC approach – Maintenance (Ver.2 Ver.) – No Synch.: code <-> automation •Lack of attention leads to: Random Failures, Longer time to run, GUI errors, where the issue: defect or automation suite? •Coverage metric
  • 4. 1. Waterfall Testing Vs Agile Testing (2 of 2) Area Testing In Waterfall Model Testing in Agile Model (6) •Not strict •Strictly followed (early feedback/defects); back bone of agile Continuous •Relatively longer time •Efficient CI topology, architecture & timely automation suite Integration •Relatively less frequent builds are critical (C.I.) •CI pass rate metric (7) Test Lab •Required just before the testing •Required from initial iteration onwards / Test bed (due to phase approach) (8) Test •Longer, dedicated & multiple •All the stories TCs tested within the iteration/sprint Execution test cycles •Continuous product/application visibility to testers •Late product/application visibility •Customer demo at each iteration •Phase wise test cycles •Short test cycles for Non Functional Testing @ iteration end •Same Test engineers to iteratively test & be an expert in: – customer domain – test design – test automation / scripting – Non functional test – C.I. (9) Defect •Zero defect target @ end of Ver. •Early & iterative defect finding Finding •Relatively Defect backlog is •Less/zero iterative defect backlog larger •How much re-work metric •Test cycle wise # defects trend •Iteration wise # defects trend (much controlled) (high-low-high-low ….)
  • 5. 2. Testing Checklist – 5 W & 2 H Why To TEST? To meet the Req., Architecture, Design, Code, Production Environment, Usability, Interoperability, Migration and their changes What to TEST? Customer/Domain Requirements, Test Strategy, Weak & Strong Area, Test Iteration/Sprint Scope or Focus, Buggy Module, When to TEST? Timeline asked for test iterations/sprints/phases/post release tests [R&D or Field tests) Who will TEST? Functional/Non Functional testers; integration/field testers; ext. certification bodies, customer reps. Where To TEST? Environment: Typical R&D Env, Integration (Platform/Component/Solution/Multiple Inter-operation Systems) How to TEST? Test Techniques, Automation, Script less Automation (Ref: Qualitia), Model Based Testing (Ref: Conformiq), Hypothesis Based Testing (Ref: STAG S/w) How Long to TEST? #Test Cycles, Release quality criteria, Iteration/ Sprints check point exit quality, Defects Trend, deadline/feedback based approach Note: The same approach can be applied for Test Automation also. Example: Why to automate? What to automate? When to automate?....
  • 6. 3. Trade Off Economics in Testing •Test coverage scope •Iteration/Sprint & Release •Iteration/sprint wise plan quality goal •Test priorities •Design/Code changes •Automation scope / goal •Continuous reporting to •Late features / stories PMO & prioritization •Test Scope Risk mitigation •Defect Trend & Backlog •Quality Risk Mitigation •Test Estimation/planning & •Test phases/ iterations resource allocation •Handover to QA timeline •Test bed/lab need •Iteration/Sprint/Version •Quality based (defect level release dates trend/backlog) test cycles •Automation & Defect •Automation cost verification timeline •Cost Risk Mitigation •Time Risk Mitigation
  • 7. 4. Software Testing Eco System Technology (DB, OS, Platform, Management / Client QA / Testing Development Program Office / IDE & Configuration/Topology, Capital / Budget (add/delete/modify/ Product Owner Standards & Protocols) enhancements) Human Resource (On-site, Competency Development Offshore, Customers’ site, Framework Vendor partners) Defect Management System Quality & Release Process & Project Tracking Tools Framework (SDLC or PDLC, Agile/Lean/ISO/CMMi etc) Test Automation & IT Support / Professional Tools Centre / CoE Services / Field & Tech Support Software Configuration Software Build & System Test Lab / Document Repository / Access to Customers / Management Continuous Integration Test bed / Third party Test Artifacts & Clients / Remote certification or Knowledge Management Environments / Cloud benchmark / Cloud Framework Production Environments / Test environment HQ (Needs collaboration with each stakeholders / elements to ensure QUALITY, COST, TIME-LINE & SCOPE based on your project need!)
  • 8. 5. RCA (Root Cause Analysis) 1 of 2 Focus: within the version Focus: version to version RCA on defects must be used like RCA on defects should “not” be like “preventive health check-up” to live longer investigating “dead body” during & healthy (In-Phase Quality) postmortem (Post Release Quality) The software we build & test to have in-phase Often (in waterfall model) the RCA is done at RCA at every checkpoints/ iterations/ sprints to the end of the project to improve the “next” ensure no defect slippage to next stage release (not before death of the patient) Each phase/iteration/sprint to demand quality In this case the poor quality impact is already from previous one and ensure to next one made to S/w customers. (RCA learning in this Quality to be achieved continuously! case saves other patients, not the one who is already dead!)
  • 9. 5. RCA (Root Cause Analysis) 2 of 2 feedback (I) Requirement Analysis & Architecture Phase Defects RCA with Corrective & Preventive Actions RCA Scope: Requirement Documents / RCA on: Requirement & Architecture RCA by: Sys. Analyst/Architects/Product Architecture Defects owner; Source: Review comments, Defects (II) Design & Development Phase/Iterations/Sprints Defects RCA with Corrective & Preventive Actions RCA on: Design Issues; Unit & Module Test RCA by: System Architects & Developers RCA Scope: Design, Source Code Defects Source: Review comments, Defects (III) Testing Phase/Iterations/Sprints Defects RCA with Corrective & Preventive Actions RCA Scope: Test Cases/Automation suite of RCA by: Testers RCA on: Product / Application Defects New & Old Features / Maintenance Fixes Source: Defects & Customers Feedback (IV) SDLC [Software Development Life Cycle] Defects RCA with Corrective & Preventive Actions RCA by: Quality Engineers; Source: Defects (in-phase/post release) RCA Scope: To analyze root causes on slipped defects & where/how the defects got customer originated/injected. Outcome: Report on systematic improvements w.r.t. SDLC phases/iterations/sprints/release Iteration /sprint/release wise feedback to previous SDLC phases. Teams to conduct iterative/in-phase/Post Release RCA. Thus team can improve/prevent on defects slippage in next iteration/sprints/release.
  • 10. Knowledge Is Power Thank You! Feedback / Suggestions / Power Point Request to: rvaidya67@hotmail.com Vaidyanathan Ramalingam http://www.siliconindia.com/events-speakers/software-testing-Bangalore-SoftecBangalore_2011.html