• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
'Lessons Learned in Test Management' by Bob van de Burgt
 

'Lessons Learned in Test Management' by Bob van de Burgt

on

  • 343 views

After an introduction of the full breadth of the Test Management Model, the webinar will focus on: ...

After an introduction of the full breadth of the Test Management Model, the webinar will focus on:

- The combination of Risk & Requirement Based Testing;
- Defining successful test strategies based on several contexts;
- Adapting test management to a fast changing Agile environment

Statistics

Views

Total Views
343
Views on SlideShare
343
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • [Iris]Nu worden we serieus en gaan we kijkennaar het testmanagement model waar het 10 jaargeledenmeebegon.Erwarentoen al testmethoden, testtools, etc.. maarnoggeen model speciaalvoortestmanagement.Bob en ikzijnhier de grondleggers van geweesttoen we allebeinogwerktenbijLogica.
  • [Bob]
  • [Bob]

'Lessons Learned in Test Management' by Bob van de Burgt 'Lessons Learned in Test Management' by Bob van de Burgt Presentation Transcript

  • www.eurostarconferences.com@esconfs#esconfsLessons Learned in TestManagementBob van de Burgt , Professional Testing BVBob van de Burgt is test advisor at Professional Testing BV. He contributedto the development of the testing method TestFrame® and the testmanagement approach of Logica for which he also was co-author of thepublished books. Bob has given many testing courses (including ISTQB) andis a frequent speaker at (inter)national congresses. He was member of theboard of the Dutch SIGIST TestNet for 10 years of which 6 year aschairman. Bob was Programme Chair of EuroSTAR 2008 in The Hague.www.eurostarconferences.com
  • www.eurostarconferences.com@esconfs#esconfsJoin the conversation on Twitter#esconfs@esconfswww.eurostarconferences.comContinue the conversation with the speaker on Twitter after the show!
  • www.eurostarconferences.com@esconfs#esconfs3Agenda-Introduction- Test Management Model- 10 years later- Agile and Test Management- Conclusions
  • www.eurostarconferences.com@esconfs#esconfsTest ManagementModel• Risk & Requirement Based Testing(RRBT)• Preparation and Execution• Eight phases• Secure in Test Management File4PreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsRequirementsRRBT: Risks versusRequirementsA risk, no requirement:• Adding requirements(finding faults earlier)• Remove risk (don’t testmore than necessary)A requirement, no risk:• Adjusting risk list(improved coveragetest)• Removing requirement(don’t develop morethan necessary, no“frills”)Matching risks and requirementsProductRisksMatching requirements and risks5
  • www.eurostarconferences.com@esconfs#esconfsPriorities product risks: anexample6If thisgoeswrongthan...… it has non-financialconsequencesfor ourcustomer.… it hasfinancialconsequencesfor ourcustomer.… it has non-financialconsequencesfor ourdepartment.… it hasfinancialconsequencesfor ourdepartment.AllcustomersOnecustomerAllcustomersOnecustomerNoworkaroundWorkaroundNoworkaroundWorkaroundMust testShould testShould testCould testCould testWon t testCould testWon t test
  • www.eurostarconferences.com@esconfs#esconfsWon’t testconditions:……The Strategic Test SlicingMethod (STSM)7Could testconditions:……Should testconditions:……Must testconditions:……Ouch !!!
  • www.eurostarconferences.com@esconfs#esconfs8Agenda- Introduction- Test Management Model- 10 years later- Agile and Test Management- Conclusions
  • www.eurostarconferences.com@esconfs#esconfsExperience RRBTChallenges:• Difficulty in defining risks• When is my risk assessmentcomplete?• When do I start the riskanalysis?• The requirements are notgood or not completeAchievements:• Speaking the language ofhigher management• Looking at requirementswith a “testing” eye• Applicable in traditionaland agile environments9PreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Difficulty with risk analysis•Difficulty with using risks as basis for teststrategy10Experience Risk Analysis & TestStrategyAchievements:• Missing requirements becameapparent• Stakeholder buy-in for testing• The first difficult questions are askedPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges•Still very difficult•Lack of maturity in keeping metrics•Project budget has no actual basis•Moving targets11Experience EstimationAchievements:• Model will help• Estimate based on risks is easier tosellPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Planning is always a rough estimate•Overall project planning often notrealistic12Experience PlanningAchievements:• Planning in Earned Valuemethod gives advantages• Planning got better as we nowaim for testing the mostimportant firstPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Moving to agile teams•Limited possibilities to assemble yourdream team•Test environments still difficult•A better structured test process leads tothe best test organisation•Testing does not always gets the mostattention, so not always the best fittingorganization or resources13Experience Test OrganisationAchievements:• Moving to virtual environmentssaves time and moneyPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Excel is the most used tool•Align your reports to your stakeholders14Experience Progress ManagementAchievements:• In control with EVM• TM becomes trusted advisorwith controls over time,budget and qualityPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Issue management needs a good process•Issues should always be input for progressmanagement•Adjust existing tooling where necessary15Experience Issue ManagementAchievements:• Stakeholder involvement iscrucial for success• Excellent tools available(e.g. JIRA)PreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Adjust frequency to audience•Report to all stakeholders•Measuring is key16Experience Reporting &Implementation AdviceAchievements:• Reporting is easy with the controls ofprogress management!PreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfsChallenges:•Maintenance is done better for manualtest cases then test automation•Good release management is key17Experience Transfer &MaintenanceAchievements:• Plan for transfer• Plan time to update regressiontest ware• Train the maintenancedepartmentPreparationTestOrganisationPlanning IssueManagementReportingAndImplementationadviceTransferAndMaintenanceEstimationRisk AnalysisAndTest StrategyTestManagementFileExecutionProgressManagementRisk & RequirementBased Testing
  • www.eurostarconferences.com@esconfs#esconfs18Agenda- Introduction- Test Management Model- 10 years later- Agile and Test Management- Conclusions
  • www.eurostarconferences.com@esconfs#esconfsHow do we see Agile?• Agile is• A method, an approach• Highly demanding!• A team effort• Flexible19
  • www.eurostarconferences.com@esconfs#esconfsThe customer• What are the characteristics of an agile method?• Increments/iterations• ‘Reduce the waste’• Continues feedback• How do we trace these to our customers?20
  • www.eurostarconferences.com@esconfs#esconfsAgile is flexible• The customer expects flexibility• Scope decisions between iterations• Good structure and light documentation• Don’t be too flexible!21
  • www.eurostarconferences.com@esconfs#esconfsChallenges of Agile• Team takes too many decisions• Signals of testers are not recognized• Testers are only seen as testers• Not all team members are involved indecision making• Test environment not available fast enough• New builds are not delivered flexible enough22
  • www.eurostarconferences.com@esconfs#esconfsBenefits of Agile• More added value for the customer• Highly flexible organization• Better structured risk management• High acceptance level of end users23
  • www.eurostarconferences.com@esconfs#esconfsThe role of the Test Manager• Plans, monitors and controls testing• Typical tasks include:• Define the test approach / strategy• Contribute to other project activities• Manage end to end tests• Introduce suitable metrics for test progress & Quality control• Write summary reports24
  • www.eurostarconferences.com@esconfs#esconfsConclusions• The Test Management Model still applies toall projects• Product risk assessment still difficult• Agile will challenge the test manager toadjust accents within the Test Managementmodel• The test manager has to be more flexible:result focus instead of process focus25
  • www.eurostarconferences.com@esconfs#esconfswww.eurostarconferences.comQuestions?
  • www.eurostarconferences.com@esconfs#esconfsEuroSTAR Webinar ArchiveAccess almost 50 on-demand software testing webinars by the worlds leadingtesting experts. Topics include….www.eurostarconferences.comAgile, Automation, Test Management, Process Improvements, Risk-based Testing, PerformanceTesting, Test Documentation, Cloud Testing, Session-based Testing, Weekend TestersVisit the archive!http://www.eurostarconferences.com/community/member/webinar-archive@esconfs#esconfs
  • www.eurostarconferences.com@esconfs#esconfsThe EuroSTAR Community.Are you a member?Did you know we have an online resource area with almost …www.eurostarconferences.com600 software testing presentations, 50 topicalwebinars, over 40 videos and podcasts and 20 experteBooksDo you know that membership is completely free and you can access thesepremium testing resources anytime?Join today!http://www.eurostarconferences.com/community/member@esconfs#esconfs
  • www.eurostarconferences.com@esconfs#esconfsCall for Submissions to speak at the 2013 EuroSTARConference is now open!Speak at Europe’s #1 Software Testing EventTheme: Questioning Testing Deadline for submissions February 13thFor more information http://www.eurostarconferences.com/speakers/conference-2013-call-for-submissions