SlideShare a Scribd company logo
Project Management for QA manager
Liang Gao (liangg@gmail.com)
Different Roles in a Modern Product Development
• Project/Program manager.
• Product Marketing people
• Development/QA manager. (people manager)
• Technical lead
• Team member (engineers)
QA Manager’s Role
• Managing team (people management)
• Interact with other function team in the product development
• Guardian of the product quality
• Make sure the team’s work is on time with Quality
QA Manager QA Team
Development
Manager
Documentation
Team
Product
Manager
SE/Support
Pre-Project Planning
• Understand the working scope and requirement
• Logistics
• Resource and Schedule.
• Define clear deliverables and acceptance criteria
• Communication with peers and team members
Understand the working
scope• Talk to Program manager
• What is the over all release schedule.
• How long is the coding, how long is the testing.
• Talk to product manager and marketing folks.
• Why we need this product/features.
• Impact on the revenu
• Talk to Development manager
• Understand the implementation in high level
• Define the code hand over criteria
Logistics
• Any product related trainings your team need and when?
• Any technology related trainings your team need and when?
• Equipments needed, budget and where to get them
• Device under test
• PCs
• Routers/switches
• Software
Resource and Schedule.
• Need to justify the resource and schedule that you need
• Need to have a productivity estimation of the team’s capability
on
• Number of test cases develop per day per engineer
• Number of test cases manual execution per day per engineer
• Number of test scripts develop per day per engineer
• A Week by Week detail schedule would be good
Sample Manual
Execution Report
Sample Regression
Report
Resource and Schedule.
• Leave buffer for the emergency and last minute change.
• Have your priority list of the projects you are doing right now.
• Communicate your priority list with your peers and upper
management
Deliverables and Acceptance
Criteria• Test case and test plan
• Manual testing
• Automated regression testing
• Automation script development
Test Case & Test Plan
Development
• Deliverables:
• Test case high level design (test purpose)
• Detail test case & test plan documentation.
• Acceptance Criteria
• On Schedule
• High level design reviewed with development team and
marketing people, passed development team and marketing
people’s internal review process.
• Test case & test plan reviewed with development team and
marketing people, passed development team and marketing
people's internal review process.
Test Case Manual Execution
• Deliverables
• Test case execution log
• Defects
• Acceptance Criteria
• On Schedule
• Case execution log reviewed and approved by development team
and marketing people.
• All test cases are either in a state of “PASS” or in a state of “FAIL”
with a open defect ID.
• No invalid defects filed by Sigma
• All defects are valid & reproducible.
• Defects response time from Sigma no later than 12 hours.
Test Case Automated
Regression
• Deliverable
• Automated Regression Report.
• Regression Defects
• Acceptance Criteria
• On Schedule.
• All scripts results are either in a state of “PASS” or in a state of
“FAIL” with an open defect ID.
• Results are in consistent with baseline result.
• All bugs reported are valid regression bugs after a clean baseline
establishment.
• Defects response time from Sigma no later than 12 hours.
Script Development –
Deliverables.
• Deliverables
• Script template
• Scripts
• Execution logs (results are either in a state of “PASS” or in a state
of “FAIL” with an open defect ID)
• Script code structure documentation
• Script integration guideline (to integrate in team’s testing
environment)
Script Development –
Acceptance Criteria
• Acceptance Criteria
• On schedule
• Each script passed on team predefined
• Hardware product list
• Software (platform) version list.
Log will be provided. (can fail but Sigma will provide an open bug
id)
• Scripts are reviewed and approved by team internal review
process
• Scripts can be executed with same results in team’s testing
environment as in Sigma testing environment
• 30 days post-project script support.
Communication and Sale
• Propose your test project plans to the upper management and
your peer.
• Justify your claim on the cost/budget
• Equipments
• Resources.
• Justify your schedules
• Communicate with the team on the project background, scope
and requirement
Standard Template and Standard Test Case
• Standard template of test plan/test cases.
• Standard template of scripts
• Standard test case library that every one can share
• CLI test cases
• GUI test cases.
• Negative values library
Test Plan Template Sample Scripts
Effective Review Meetings
• At lest 2 sets of reviews on the deliverables
• Internal review
• External review
• Invite
• Coder, development manager
• Marketing, product managers
• Sales Engineers
• Assign roles of “Recorder”, “Reviewer”, “Moderator”, “Reader”
in the review meeting
• Make sure all feedbacks are recorded, have a follow up plan
and have been updated on the deliverables
Action Item List
• Weekly reviews on the action item and its state
• New
• Pending
• In progress
• Completed (can be removed from the list)
• Make sure once a AI is on the list, it will be there for ever if not
“completed”, and track the status every week
• Always list last week's objectives and this
week'saccomplishments against them
Quality Checklist
Bug Quality
Checklist
Script Quality
Checklist
Tset Case Quality
Checklist
Review with Team Member’s
Work• In the tester's cube, not yours
• Show me your best work from last week
• Show me your most interesting bugs
• Show me your most interesting test cases
• What have you been testing? Why did you do it that way? Have
you thought about this?
Daily report for the bug trend and bug state
• Have a dedicated team member to send out
• Number of bugs filed today and by who
• Total number of bugs filed by each of the team members till
today
• Bugs that need team members to response today
Daily report on the team member’s productivity
• Number of the test cases manually or auto executed today by
each of the team member
• Number of the scripts developed today by each of the team
member
• Number of the test cases developed today by each of the team
member
Report and Post Mortem
Analysis• Generate your testing report to the upper management
• Defects: very important, no defects, no talk.
• Participate the release meeting to sign off or not
• Post Mortem analysis with the team
Generate your testing report
• Make sure your report is accurate and clean
• Failed test case must have an open bug ID
• High level summary for your boss:
• Total number of test cases developed and executed
• Total number of defects
• Total number of test cases.
• Bug trend – Bug open rate, close rate during the project period
Participate the release
meeting• Make a decision if you will sign off or not on the release
• Prepare your bug report to justify your claim
• Remember to release or not is a business decision, not a
testing decision
• Make sure you provide the accurate risk analysis to the upper
management
Post Mortem Analysis
• A round table survey and talk with in your team
• What you think we do good in this project
• What you think we do bad on this project
• If there is one thing you wish we could do better ,what would
that be?
• Read the post mortem report, it is a very good way to
understand your team, and do better in the next project.
Version control
• Version 1.0, February 2008, Liang Gao
Project management for qa manager

More Related Content

What's hot

Role Of Qa And Testing In Agile 1225221397167302 8
Role Of Qa And Testing In Agile 1225221397167302 8Role Of Qa And Testing In Agile 1225221397167302 8
Role Of Qa And Testing In Agile 1225221397167302 8
a34sharm
 
QA in an agile world Tom Churchwell
QA in an agile world Tom ChurchwellQA in an agile world Tom Churchwell
QA in an agile world Tom Churchwell
Tom Churchwell
 
Agile QA 2.0
Agile QA 2.0Agile QA 2.0
Agile QA 2.0
Matthew Philip
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
Tharinda Liyanage
 
Agile Testing Best Practices
Agile Testing Best PracticesAgile Testing Best Practices
Agile Testing Best Practices
Stephen Ritchie
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
QA in an Agile World for Agile and Beyond 2015
QA in an Agile World for Agile and Beyond 2015QA in an Agile World for Agile and Beyond 2015
QA in an Agile World for Agile and Beyond 2015
Tom Churchwell
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
Original Software
 
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
Scrum Bangalore
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
tharindakasun
 
Scrum Testing Methodology
Scrum Testing MethodologyScrum Testing Methodology
Scrum Testing Methodology
Gaya1985
 
QA in Agile
QA in AgileQA in Agile
QA in Agile
Mikalai Alimenkou
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
Original Software
 
QA in Agile World
QA in Agile WorldQA in Agile World
QA in Agile World
Eli (Elle) Bauer
 
What is Agile Testing?
What is Agile Testing? What is Agile Testing?
What is Agile Testing?
Dr. Alexander Schwartz
 
There and back again, Our journey with QA Reports and metrics
There and back again, Our journey with QA Reports and metricsThere and back again, Our journey with QA Reports and metrics
There and back again, Our journey with QA Reports and metrics
Zbyszek Mockun
 
Test Management in Agile - Agile testing Days 2018
Test Management in Agile - Agile testing Days 2018Test Management in Agile - Agile testing Days 2018
Test Management in Agile - Agile testing Days 2018
Derk-Jan de Grood
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornThe 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
TEST Huddle
 

What's hot (19)

Role Of Qa And Testing In Agile 1225221397167302 8
Role Of Qa And Testing In Agile 1225221397167302 8Role Of Qa And Testing In Agile 1225221397167302 8
Role Of Qa And Testing In Agile 1225221397167302 8
 
QA in an agile world Tom Churchwell
QA in an agile world Tom ChurchwellQA in an agile world Tom Churchwell
QA in an agile world Tom Churchwell
 
Agile QA 2.0
Agile QA 2.0Agile QA 2.0
Agile QA 2.0
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
 
Agile Testing Best Practices
Agile Testing Best PracticesAgile Testing Best Practices
Agile Testing Best Practices
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
 
QA in an Agile World for Agile and Beyond 2015
QA in an Agile World for Agile and Beyond 2015QA in an Agile World for Agile and Beyond 2015
QA in an Agile World for Agile and Beyond 2015
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
 
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
Scrum_BLR 11th meet up 13 dec-2014 - SDET - They Way to go for Testers - Jaya...
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
 
Scrum Testing Methodology
Scrum Testing MethodologyScrum Testing Methodology
Scrum Testing Methodology
 
QA in Agile
QA in AgileQA in Agile
QA in Agile
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
 
QA in Agile World
QA in Agile WorldQA in Agile World
QA in Agile World
 
What is Agile Testing?
What is Agile Testing? What is Agile Testing?
What is Agile Testing?
 
There and back again, Our journey with QA Reports and metrics
There and back again, Our journey with QA Reports and metricsThere and back again, Our journey with QA Reports and metrics
There and back again, Our journey with QA Reports and metrics
 
Test Management in Agile - Agile testing Days 2018
Test Management in Agile - Agile testing Days 2018Test Management in Agile - Agile testing Days 2018
Test Management in Agile - Agile testing Days 2018
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
 
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornThe 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
 

Viewers also liked

Snag It Overview
Snag It OverviewSnag It Overview
Snag It Overview
askforsudha
 
Pre-opening interior snagging services for luxury hotels
Pre-opening interior snagging services for luxury hotelsPre-opening interior snagging services for luxury hotels
Pre-opening interior snagging services for luxury hotels
Samir Khosla
 
Corporate Presentation | Software Testing Company USA | Indium
Corporate Presentation | Software Testing Company USA | IndiumCorporate Presentation | Software Testing Company USA | Indium
Corporate Presentation | Software Testing Company USA | Indium
Indium Software
 
How to Prioritize Projects?
How to Prioritize Projects?How to Prioritize Projects?
How to Prioritize Projects?
MakeItRational
 
TCoE
TCoETCoE
What is (tcoe) testing center of excellence
What is (tcoe) testing center of excellenceWhat is (tcoe) testing center of excellence
What is (tcoe) testing center of excellence
Maveric Systems
 
Testing capability ppt
Testing capability pptTesting capability ppt
Testing capability ppt
anilreddyqa
 
Punch list app_software
Punch list app_softwarePunch list app_software
Punch list app_software
Bridgit
 
Testing Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabsTesting Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabs
VIJAYA BHASKARA VARMA YARAKARAJU
 
10-step B2B Customer Satisfaction Survey Pre-Survey Check List
10-step B2B Customer Satisfaction Survey Pre-Survey Check List10-step B2B Customer Satisfaction Survey Pre-Survey Check List
10-step B2B Customer Satisfaction Survey Pre-Survey Check List
John Coldwell
 
[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great
Ho Chi Minh City Software Testing Club
 
QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)
JAX Chamber IT Council
 
ACH 216 Lecture 12 (Closeut & Turnover)
ACH 216 Lecture 12 (Closeut & Turnover)ACH 216 Lecture 12 (Closeut & Turnover)
ACH 216 Lecture 12 (Closeut & Turnover)
Anne Arundel Community College
 

Viewers also liked (13)

Snag It Overview
Snag It OverviewSnag It Overview
Snag It Overview
 
Pre-opening interior snagging services for luxury hotels
Pre-opening interior snagging services for luxury hotelsPre-opening interior snagging services for luxury hotels
Pre-opening interior snagging services for luxury hotels
 
Corporate Presentation | Software Testing Company USA | Indium
Corporate Presentation | Software Testing Company USA | IndiumCorporate Presentation | Software Testing Company USA | Indium
Corporate Presentation | Software Testing Company USA | Indium
 
How to Prioritize Projects?
How to Prioritize Projects?How to Prioritize Projects?
How to Prioritize Projects?
 
TCoE
TCoETCoE
TCoE
 
What is (tcoe) testing center of excellence
What is (tcoe) testing center of excellenceWhat is (tcoe) testing center of excellence
What is (tcoe) testing center of excellence
 
Testing capability ppt
Testing capability pptTesting capability ppt
Testing capability ppt
 
Punch list app_software
Punch list app_softwarePunch list app_software
Punch list app_software
 
Testing Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabsTesting Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabs
 
10-step B2B Customer Satisfaction Survey Pre-Survey Check List
10-step B2B Customer Satisfaction Survey Pre-Survey Check List10-step B2B Customer Satisfaction Survey Pre-Survey Check List
10-step B2B Customer Satisfaction Survey Pre-Survey Check List
 
[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great
 
QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)
 
ACH 216 Lecture 12 (Closeut & Turnover)
ACH 216 Lecture 12 (Closeut & Turnover)ACH 216 Lecture 12 (Closeut & Turnover)
ACH 216 Lecture 12 (Closeut & Turnover)
 

Similar to Project management for qa manager

Agile software development
Agile software developmentAgile software development
Agile software development
Siddharth Sharma
 
Tester performance evaluation
Tester performance evaluationTester performance evaluation
Tester performance evaluation
gaoliang641
 
Tester career path
Tester career pathTester career path
Tester career path
gaoliang641
 
Test planning and software's engineering
Test planning and software's engineeringTest planning and software's engineering
Test planning and software's engineering
MansiganeshJawale
 
Things to keep in mind before starting a test plan
Things to keep in mind before starting a test planThings to keep in mind before starting a test plan
Things to keep in mind before starting a test plan
NexSoftsys
 
Fundamentals of agile tntu (2015-04-27)
Fundamentals of agile   tntu (2015-04-27)Fundamentals of agile   tntu (2015-04-27)
Fundamentals of agile tntu (2015-04-27)
Oleg Nazarevych
 
Backward thinking design qa system for quality goals
Backward thinking   design qa system for quality goalsBackward thinking   design qa system for quality goals
Backward thinking design qa system for quality goals
gaoliang641
 
IT Software - Release cycle & Delivery roadmap
IT Software - Release cycle & Delivery roadmapIT Software - Release cycle & Delivery roadmap
IT Software - Release cycle & Delivery roadmap
Jean-François Nguyen
 
Sustainable agile testing
Sustainable agile testingSustainable agile testing
Sustainable agile testing
mimmozzo_
 
Vladimir Lozanov How to deliver high quality apps to the app store
Vladimir Lozanov	How to deliver high quality apps to the app storeVladimir Lozanov	How to deliver high quality apps to the app store
Vladimir Lozanov How to deliver high quality apps to the app store
Аліна Шепшелей
 
Invite the tester to the party
Invite the tester to the partyInvite the tester to the party
Invite the tester to the party
Allan Rennebo Jepsen
 
Introduction to Scrum
Introduction to ScrumIntroduction to Scrum
Introduction to Scrum
Fahad Alshareef
 
Project Management Tips to Improve Test Planning
Project Management Tips to Improve Test PlanningProject Management Tips to Improve Test Planning
Project Management Tips to Improve Test Planning
TechWell
 
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Eggplant
 
Agile testing
Agile testingAgile testing
Agile testing
Joe Phan
 
Methodology: IT test
Methodology: IT testMethodology: IT test
Methodology: IT test
Jean-François Nguyen
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile World
Maurizio Mancini
 
Software quality assurance
Software quality assuranceSoftware quality assurance
Software quality assurance
Rizky Munggaran
 
Organizational responsibilities and test automation
Organizational responsibilities and test automationOrganizational responsibilities and test automation
Organizational responsibilities and test automation
vineeta vineeta
 
UNIT IV.ppt
UNIT IV.pptUNIT IV.ppt
UNIT IV.ppt
Varshini62
 

Similar to Project management for qa manager (20)

Agile software development
Agile software developmentAgile software development
Agile software development
 
Tester performance evaluation
Tester performance evaluationTester performance evaluation
Tester performance evaluation
 
Tester career path
Tester career pathTester career path
Tester career path
 
Test planning and software's engineering
Test planning and software's engineeringTest planning and software's engineering
Test planning and software's engineering
 
Things to keep in mind before starting a test plan
Things to keep in mind before starting a test planThings to keep in mind before starting a test plan
Things to keep in mind before starting a test plan
 
Fundamentals of agile tntu (2015-04-27)
Fundamentals of agile   tntu (2015-04-27)Fundamentals of agile   tntu (2015-04-27)
Fundamentals of agile tntu (2015-04-27)
 
Backward thinking design qa system for quality goals
Backward thinking   design qa system for quality goalsBackward thinking   design qa system for quality goals
Backward thinking design qa system for quality goals
 
IT Software - Release cycle & Delivery roadmap
IT Software - Release cycle & Delivery roadmapIT Software - Release cycle & Delivery roadmap
IT Software - Release cycle & Delivery roadmap
 
Sustainable agile testing
Sustainable agile testingSustainable agile testing
Sustainable agile testing
 
Vladimir Lozanov How to deliver high quality apps to the app store
Vladimir Lozanov	How to deliver high quality apps to the app storeVladimir Lozanov	How to deliver high quality apps to the app store
Vladimir Lozanov How to deliver high quality apps to the app store
 
Invite the tester to the party
Invite the tester to the partyInvite the tester to the party
Invite the tester to the party
 
Introduction to Scrum
Introduction to ScrumIntroduction to Scrum
Introduction to Scrum
 
Project Management Tips to Improve Test Planning
Project Management Tips to Improve Test PlanningProject Management Tips to Improve Test Planning
Project Management Tips to Improve Test Planning
 
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
 
Agile testing
Agile testingAgile testing
Agile testing
 
Methodology: IT test
Methodology: IT testMethodology: IT test
Methodology: IT test
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile World
 
Software quality assurance
Software quality assuranceSoftware quality assurance
Software quality assurance
 
Organizational responsibilities and test automation
Organizational responsibilities and test automationOrganizational responsibilities and test automation
Organizational responsibilities and test automation
 
UNIT IV.ppt
UNIT IV.pptUNIT IV.ppt
UNIT IV.ppt
 

More from gaoliang641

Why we didn't catch that
Why we didn't catch thatWhy we didn't catch that
Why we didn't catch that
gaoliang641
 
Why we didn't catch that application bugs
Why we didn't catch that   application bugsWhy we didn't catch that   application bugs
Why we didn't catch that application bugs
gaoliang641
 
Understand release engineering
Understand release engineeringUnderstand release engineering
Understand release engineering
gaoliang641
 
Understand regression testing
Understand regression testingUnderstand regression testing
Understand regression testing
gaoliang641
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testing
gaoliang641
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interaction
gaoliang641
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
gaoliang641
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testing
gaoliang641
 
Bug best practice
Bug best practiceBug best practice
Bug best practice
gaoliang641
 
Lessons learned on localization testing
Lessons learned on localization testingLessons learned on localization testing
Lessons learned on localization testing
gaoliang641
 
Lessons learned on software testing automation
Lessons learned on software testing automationLessons learned on software testing automation
Lessons learned on software testing automation
gaoliang641
 
How to become a testing expert
How to become a testing expertHow to become a testing expert
How to become a testing expert
gaoliang641
 
Functionality testing techniqu
Functionality testing techniquFunctionality testing techniqu
Functionality testing techniqu
gaoliang641
 
Protocol Security Testing best practice
Protocol Security Testing best practiceProtocol Security Testing best practice
Protocol Security Testing best practice
gaoliang641
 
Automation framework design and implementation
Automation framework design and implementationAutomation framework design and implementation
Automation framework design and implementation
gaoliang641
 
Automation from start to finish
Automation   from start to finishAutomation   from start to finish
Automation from start to finish
gaoliang641
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
gaoliang641
 

More from gaoliang641 (17)

Why we didn't catch that
Why we didn't catch thatWhy we didn't catch that
Why we didn't catch that
 
Why we didn't catch that application bugs
Why we didn't catch that   application bugsWhy we didn't catch that   application bugs
Why we didn't catch that application bugs
 
Understand release engineering
Understand release engineeringUnderstand release engineering
Understand release engineering
 
Understand regression testing
Understand regression testingUnderstand regression testing
Understand regression testing
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testing
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interaction
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testing
 
Bug best practice
Bug best practiceBug best practice
Bug best practice
 
Lessons learned on localization testing
Lessons learned on localization testingLessons learned on localization testing
Lessons learned on localization testing
 
Lessons learned on software testing automation
Lessons learned on software testing automationLessons learned on software testing automation
Lessons learned on software testing automation
 
How to become a testing expert
How to become a testing expertHow to become a testing expert
How to become a testing expert
 
Functionality testing techniqu
Functionality testing techniquFunctionality testing techniqu
Functionality testing techniqu
 
Protocol Security Testing best practice
Protocol Security Testing best practiceProtocol Security Testing best practice
Protocol Security Testing best practice
 
Automation framework design and implementation
Automation framework design and implementationAutomation framework design and implementation
Automation framework design and implementation
 
Automation from start to finish
Automation   from start to finishAutomation   from start to finish
Automation from start to finish
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
 

Recently uploaded

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 

Recently uploaded (20)

Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 

Project management for qa manager

  • 1. Project Management for QA manager Liang Gao (liangg@gmail.com)
  • 2. Different Roles in a Modern Product Development • Project/Program manager. • Product Marketing people • Development/QA manager. (people manager) • Technical lead • Team member (engineers)
  • 3. QA Manager’s Role • Managing team (people management) • Interact with other function team in the product development • Guardian of the product quality • Make sure the team’s work is on time with Quality QA Manager QA Team Development Manager Documentation Team Product Manager SE/Support
  • 4. Pre-Project Planning • Understand the working scope and requirement • Logistics • Resource and Schedule. • Define clear deliverables and acceptance criteria • Communication with peers and team members
  • 5. Understand the working scope• Talk to Program manager • What is the over all release schedule. • How long is the coding, how long is the testing. • Talk to product manager and marketing folks. • Why we need this product/features. • Impact on the revenu • Talk to Development manager • Understand the implementation in high level • Define the code hand over criteria
  • 6. Logistics • Any product related trainings your team need and when? • Any technology related trainings your team need and when? • Equipments needed, budget and where to get them • Device under test • PCs • Routers/switches • Software
  • 7. Resource and Schedule. • Need to justify the resource and schedule that you need • Need to have a productivity estimation of the team’s capability on • Number of test cases develop per day per engineer • Number of test cases manual execution per day per engineer • Number of test scripts develop per day per engineer • A Week by Week detail schedule would be good Sample Manual Execution Report Sample Regression Report
  • 8. Resource and Schedule. • Leave buffer for the emergency and last minute change. • Have your priority list of the projects you are doing right now. • Communicate your priority list with your peers and upper management
  • 9. Deliverables and Acceptance Criteria• Test case and test plan • Manual testing • Automated regression testing • Automation script development
  • 10. Test Case & Test Plan Development • Deliverables: • Test case high level design (test purpose) • Detail test case & test plan documentation. • Acceptance Criteria • On Schedule • High level design reviewed with development team and marketing people, passed development team and marketing people’s internal review process. • Test case & test plan reviewed with development team and marketing people, passed development team and marketing people's internal review process.
  • 11. Test Case Manual Execution • Deliverables • Test case execution log • Defects • Acceptance Criteria • On Schedule • Case execution log reviewed and approved by development team and marketing people. • All test cases are either in a state of “PASS” or in a state of “FAIL” with a open defect ID. • No invalid defects filed by Sigma • All defects are valid & reproducible. • Defects response time from Sigma no later than 12 hours.
  • 12. Test Case Automated Regression • Deliverable • Automated Regression Report. • Regression Defects • Acceptance Criteria • On Schedule. • All scripts results are either in a state of “PASS” or in a state of “FAIL” with an open defect ID. • Results are in consistent with baseline result. • All bugs reported are valid regression bugs after a clean baseline establishment. • Defects response time from Sigma no later than 12 hours.
  • 13. Script Development – Deliverables. • Deliverables • Script template • Scripts • Execution logs (results are either in a state of “PASS” or in a state of “FAIL” with an open defect ID) • Script code structure documentation • Script integration guideline (to integrate in team’s testing environment)
  • 14. Script Development – Acceptance Criteria • Acceptance Criteria • On schedule • Each script passed on team predefined • Hardware product list • Software (platform) version list. Log will be provided. (can fail but Sigma will provide an open bug id) • Scripts are reviewed and approved by team internal review process • Scripts can be executed with same results in team’s testing environment as in Sigma testing environment • 30 days post-project script support.
  • 15. Communication and Sale • Propose your test project plans to the upper management and your peer. • Justify your claim on the cost/budget • Equipments • Resources. • Justify your schedules • Communicate with the team on the project background, scope and requirement
  • 16. Standard Template and Standard Test Case • Standard template of test plan/test cases. • Standard template of scripts • Standard test case library that every one can share • CLI test cases • GUI test cases. • Negative values library Test Plan Template Sample Scripts
  • 17. Effective Review Meetings • At lest 2 sets of reviews on the deliverables • Internal review • External review • Invite • Coder, development manager • Marketing, product managers • Sales Engineers • Assign roles of “Recorder”, “Reviewer”, “Moderator”, “Reader” in the review meeting • Make sure all feedbacks are recorded, have a follow up plan and have been updated on the deliverables
  • 18. Action Item List • Weekly reviews on the action item and its state • New • Pending • In progress • Completed (can be removed from the list) • Make sure once a AI is on the list, it will be there for ever if not “completed”, and track the status every week • Always list last week's objectives and this week'saccomplishments against them
  • 19. Quality Checklist Bug Quality Checklist Script Quality Checklist Tset Case Quality Checklist
  • 20. Review with Team Member’s Work• In the tester's cube, not yours • Show me your best work from last week • Show me your most interesting bugs • Show me your most interesting test cases • What have you been testing? Why did you do it that way? Have you thought about this?
  • 21. Daily report for the bug trend and bug state • Have a dedicated team member to send out • Number of bugs filed today and by who • Total number of bugs filed by each of the team members till today • Bugs that need team members to response today
  • 22. Daily report on the team member’s productivity • Number of the test cases manually or auto executed today by each of the team member • Number of the scripts developed today by each of the team member • Number of the test cases developed today by each of the team member
  • 23. Report and Post Mortem Analysis• Generate your testing report to the upper management • Defects: very important, no defects, no talk. • Participate the release meeting to sign off or not • Post Mortem analysis with the team
  • 24. Generate your testing report • Make sure your report is accurate and clean • Failed test case must have an open bug ID • High level summary for your boss: • Total number of test cases developed and executed • Total number of defects • Total number of test cases. • Bug trend – Bug open rate, close rate during the project period
  • 25. Participate the release meeting• Make a decision if you will sign off or not on the release • Prepare your bug report to justify your claim • Remember to release or not is a business decision, not a testing decision • Make sure you provide the accurate risk analysis to the upper management
  • 26. Post Mortem Analysis • A round table survey and talk with in your team • What you think we do good in this project • What you think we do bad on this project • If there is one thing you wish we could do better ,what would that be? • Read the post mortem report, it is a very good way to understand your team, and do better in the next project.
  • 27. Version control • Version 1.0, February 2008, Liang Gao

Editor's Notes

  1. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  2. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  3. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  4. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  5. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  6. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  7. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  8. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  9. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  10. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  11. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  12. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  13. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  14. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  15. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  16. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  17. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  18. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。
  19. 到底什么是系统测试,和解决方案测试。 我们可以给出一个定义,但那样子就太理论化了,所以我更愿意给出一个例子来。 看一看别的做的比较好的公司是怎么做的。