1. Software quality assurance days
XX International Conference
of Software Quality Assurance
sqadays.com
November 24-26, 2016. Minsk, Belarus
Yuriy Malyi
COMODO. Odesa, Ukraine
Transparency in QA work for
management
2. Transparency in QA work for management
Who Am I?
Name: Yuriy Malyi
Company: COMODO
Position: QA manager
Experience in IT: 11 years
3. Transparency in QA work for management
Who are You?
• How many test engineers are here?
• How many managers/team leaders?
• How many developers?
• How many HR?
• Any other experts?
4. Transparency -
physical property
of allowing the
transmission of
light through
a material
(с) Wiki
What is Transparency?
Transparency in QA work for management
5. Transparency -
physical property
of allowing the
transmission of
light through
a material
(с) Wiki
What is Transparency?
Transparency in QA work for management
6. Transparency is
operating in such a way that it is
easy for others to see what
actions are performed.
(с) Wiki
What does it mean in management?
Transparency in QA work for management
7. Transparency is
operating in such a way that it is
easy for others to see what
actions are performed.
(с) Wiki
What does it mean in management?
Transparency in QA work for management
8. Transparency in QA work for management
Why do we need it, what’s the problem?
17. Transparency in QA work for management
Prehistory
• What are you doing right now?
• Why testing takes so much time?
• There is nothing to do so long!
• I can complete this task 10 times faster!
• Why You missed those BUGs during testing?
• What are your automation team is doing?
• Convince me!
• Bullshit!
• Etс…
18. Transparency in QA work for management
Preconditions
• Projects and teams ( )
• Tasks and BUGs tracker (~Jira)
• Work time logging system (~Jira Tempo)
• Wiki (~Confluence)
• Calendar (~Confluence calendars)
• Test Management System (~ TestRail)
• Willing to see the real situation in QA
24. Transparency in QA work for management
Feature Risks Statuses
• Feature can’t be delivered in time
• Developments and Testing at risk
• Feature may be delivered in time
• Dev and Testing at the low risk
• Feature may be delivered in time
• Dev done, Testing at the low risk
• Feature will be delivered in time
• Dev done, Testing done
31. Transparency in QA work for management
Detailed current status of Automation
32. Transparency in QA work for management
Detailed plan to achieve a goal
Test cases for automation 1144
Current automation percent 27%
Goal for automation percent 80%
Number of cases to achhive the goal 916
Already automated 311
Need to be automated 605
Team performance (test cases/week) 15
Number of weeks to achhive a goal 40.33
36. Transparency in QA work for management
Time cost
• QA Team current state ~10 min per day for TL
• WorkLog in Jira ~5 min per day for engineer
• Feature Readiness Page ~2 hours create by TL
• Feature Readiness Page ~5 min day to support
• BUG status for releases ~1-3 min create by TL
• Bugs daily progress ~1-3 min create by TL
• Change Management ~10 min for PM on request
• Detailed status and plan of Automation ~1-3 days
• Automation report ~10 min per week for TL
37. Transparency in QA work for management
Success Story
• Half a year of transparency…
• New urgent release required…
• Request to complete in NOW!
• And…
• Just 2 emails in replay
• Details of all previous efforts
• And we protected estimates!
• …
• Profit!
41. Transparency in QA work for management
Email : yuriy.malyi@gmail.com
Skype : yura_clasic
Questions?
Editor's Notes
Transparency - physical property of allowing the transmission of light through a material.
Transparency - physical property of allowing the transmission of light through a material.
Transparency is operating in such a way that it is easy for others to see what actions are performed.
Transparency is operating in such a way that it is easy for others to see what actions are performed.
Usually every fuckup will be treated as team fail because of no trust to the team
Usually every fuckup will be treated as team fail because of no trust to the team
Usually every fuckup will be treated as team fail because of no trust to the team
How to improve transparency:
Reporting
Metrics
Understanding of current situation
How to improve transparency:
Fit the dates
Fit the commitments
Successful releases
During the time we’ll get such trust that it won’t be necessary to continue all the reporting
The most danger situation is when You fail some big release.
So management will ask you everything what was done in details.
And if You don’t have all reports and metrics that moment – it’ll be very bad for you
So the best approach is to move between top to states and keep all the reporting in place
If You need to protect your teams and estimates You should try to understand what metrics and data will be most effective and only after it start gathering