SlideShare a Scribd company logo
How a Game Tester Adds Value 
How does a professional game tester add value to a game development studio? 
Can you measure this value in a good way? I will try to give my view on this 
subject. I am specifically talking about value added that is part of the tester role. 
Obviously anyone can add value outside of their specific role – such as bringing 
coffee to people, or just performing tasks that are not specific to their role. 
First an overview of how I think a game tester adds value: 
 Finding and reporting defects in the game 
 Providing support to developers 
o Help developing Acceptance Criteria 
o Support with test knowledge 
o Provide test environment for developers 
o Test Automation 
o Drive testability in implementation 
 Provide test information & knowledge to stakeholders 
 Certification / Mandatory testing 
 Game design / Fun factor / Balancing / Realism input 
Finding and reporting defects in the game 
A game tester’s primary function is generally to find defects or questionable 
design decisions in the game. This defect is then reported, in a written artifact or 
verbally, to someone who can make a decision regarding that defect. A game 
developer, artist, or other role can then, depending on a host of different factors, 
fix the defect. 
With good enough historical data, metrics and understanding of the users, the 
value of the absence of the defect in the game can then be evaluated. This is a 
clear value add that the game tester brings to the table. 
But there are additional factors to consider before celebrating the value of 
testers. A defect requires analysis, and the tester provides the basis for this 
analysis. If the defect report is of low quality, then suddenly the tester is adding 
to the analysis cost. This can be mitigated by securing that a proper defect 
management process is in place, and that the tester knows which information is 
needed in the defect report.
We also have to consider that every defect submitted that is not fixed has an 
analysis cost. This means that the only value a tester has created if ten defect 
reports are submitted and none of them are fixed is some vague information 
value, but the analysis cost of these ten issues is very real. 
So for a tester to add real value the defects reported must provide the right 
information, and also actually be fixed. This provides a dilemma. Should the 
tester send defect reports of every single thing they find to the developers for 
analysis? There probably needs to be some analysis triage before the defects 
reach the developers to reduce unnecessary analysis cost. This triage could be 
done by testers, but it could also be done by a stakeholder who can make a 
decision if the defect should be fixed or not in the first place, before it is 
analyzed. However there are of course risks introduced when not analyzing all 
defects that are found. 
Finally we cannot forget that the developer that fixes the defect also shares the 
added value of the absence of the defect in the game. How much each role 
contributes to the absence of the defect is probably difficult to assess. 
Providing support to developers 
A part from finding and reporting defects a tester can also provide valuable 
support to developers in many different ways. 
By creating Acceptance Criteria that are testable and understandable to all 
stakeholders, the tester provides some value, which is hard to measure. Good 
Acceptance Criteria bring clarity both to what developers should do, and to what 
stakeholders actually want. A worst-case scenario with a lack of understanding 
between stakeholders and developers could be very costly indeed. In a perfect 
world these Acceptance Criteria can also be used directly as test artifacts, which 
would free up the testers time to perform more valuable activities than creating 
test cases, since test cases in themselves do not add any value. 
A tester can also add value by supporting the developer with expertise to enable 
better testing. Helping with test techniques and methods to improve the testing 
performed by the developer. The value of this support is very hard to measure. 
Providing a test environment for the developers to use is also something that 
adds value. To the testers themselves this is a pre-requisite for their work, but 
you could argue that this is a service they provide to the developers, which adds 
value. The value can be calculated by evaluating how much time it would take for 
the developers to set up and maintain a parallel test environment for themselves. 
When I say test environment it can include a framework for automated testing. 
Testers can also set up, maintain and run different automated test suites to 
support continuous integration, and other automated test runs. Maintaining and 
running automated tests have no inherent value in itself for a tester, but can be a 
pre-requisite for allowing the tester to find defects and provide necessary 
information to stakeholders. However there is a value in enabling continuous
integration, or other development practices that require automated tests. The 
value add of this activity can be measured in the same way as for maintaining a 
test environment for developers. How much would it cost for them to set it up 
themselves? 
Testability needs to be built into a game. This is something that a tester can drive 
at early stages of the game development. By providing knowledge and expertise 
the tester might get developers to build in testability that would otherwise be 
forgotten. The value of this is quite hard to put a number on. 
Provide test information & knowledge to stakeholders 
Also something that is part of the core responsibility of a tester’s job. This can for 
example be done in the form of a test report, an email, verbal communication, a 
post-it, or something similar. I here separate between information and 
information – defects are in a sense also test information, but I separated the two 
for higher granularity. 
So a tester performs a test activity, and submits relevant found defects. Usually 
the tester also creates some kind of a report with regards to this test activity, 
which is then sent to a stakeholder. Sometimes this report is consolidated with 
other testers’ reports by a test lead or project manager. The report created by 
the tester has information value. 
What value the report actually has depends on the decisions based on that 
report. If a stakeholder reads (or does not read) a report, and the report has no 
impact what so ever on decisions, then the report holds little value. Some value, 
but very little. 
I have personally been in a situation were the project manager stated that he 
only wanted a list of new defects, and did not care about the test report. Clearly 
that report held no value, and I recommended to management that we should 
stop writing that report. 
Sometimes managers can feel more secure if they (think they) have control over 
what is happening, even though they don’t take any decision based on the report. 
Then the report has some personal value to the individual manager, but very 
little to the company as a whole. 
But even if the report is valuable to a stakeholder, it is hard to put that value into 
numbers. 
Certification / Mandatory testing 
Sometimes there are mandatory tests that need to be executed to be able to 
release a game. When there are tests that are mandatory to run for some reason, 
then the tester is immediately providing value by just performing the tests. How
much value can easily be calculated by how much it would cost to outsource the 
test execution to a third-party test house. 
Game design / Fun Factor / Balancing / Realism input 
A tester spends many hours playing a game. Building up experience with not 
only a specific game, but with general game design principles. It would be a 
waste not to utilize this experience. 
Some parts of the game design are easier to add value in than others, for testers. 
Balancing and difficulty level is something that a tester could easily evaluate 
based on the many hours spent playing the game. At least relative balancing and 
difficulty level between different components. 
Depending on the tester’s other competencies, and available material on how 
something should work, realism could also be evaluated. 
A tester could also provide input on fun factor, but this is highly subjective unless 
you have the right training in how to evaluate “fun”, I suppose. 
Finally, based on the tester’s own game design competence, a tester could 
provide input on the game design and how it works when implemented in the 
game. 
It seems like a waste not to use the fact that a tester spends so many hours 
playing a game, and not gather feedback from the tester with regards to these 
types of game design questions. 
Obviously all of these things are very hard to measure the value of. 
Conclusion 
Of course there will always be other ways for a person in a game tester role to 
add value to a company than the ones I described above, but I think these are the 
main value contributing factors the game tester role brings to the table. 
In this discussion we should not confuse a person with a role. A person probably 
adds value in many ways – by being a team player, motivated co-worker, nice 
person, part-time developer, part-time team leader, and so on – but in the role of 
a game tester, what I have presented in this article is what I see as the major 
value add to the company. 
But how a game tester role adds value is of course not constant, and my view will 
change over time, as the field changes and as I get new input that makes me 
reconsider my standpoint.

More Related Content

What's hot

Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
TEST Huddle
 
Bridging the communication gap
Bridging the communication gapBridging the communication gap
Bridging the communication gap
Guillagui San
 
Stop! you're testing too much
Stop!  you're testing too muchStop!  you're testing too much
Stop! you're testing too much
Shawn Wallace
 
How Crowd Testing Works
How Crowd Testing WorksHow Crowd Testing Works
How Crowd Testing Works
99tests
 
The Thinking Tester, Evolved
The Thinking Tester, EvolvedThe Thinking Tester, Evolved
The Thinking Tester, Evolved
Elisabeth Hendrickson
 
Testing Intelligence
Testing IntelligenceTesting Intelligence
Testing Intelligence
Lalit Bhamare
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
99tests
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
ANDRI HAIRIYADI, S.Kom.
 
Myths and reality about software testing
Myths and reality about software testingMyths and reality about software testing
Myths and reality about software testing
Alisha Henderson
 
Exploratory Testing in Practice
Exploratory Testing in PracticeExploratory Testing in Practice
Exploratory Testing in Practice
Elisabeth Hendrickson
 
Communicated deadlines = bad quality
Communicated deadlines = bad qualityCommunicated deadlines = bad quality
Communicated deadlines = bad quality
Johan Hoberg
 
Rehan Pair Testing Final
Rehan Pair Testing FinalRehan Pair Testing Final
Rehan Pair Testing Final
RehanShahKhan
 
Common mistakes in software testing and how to overcome?
Common mistakes in software testing and how to overcome?Common mistakes in software testing and how to overcome?
Common mistakes in software testing and how to overcome?
MD ISLAM
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interactiongaoliang641
 
Tester vs Developer
Tester vs DeveloperTester vs Developer
Tester vs Developer
Tricon Infotech
 
Rapid Software Testing: Reporting
Rapid Software Testing: ReportingRapid Software Testing: Reporting
Rapid Software Testing: Reporting
TechWell
 
12 Key Performance Indicators for QA & Test Magers
12 Key Performance Indicators for QA & Test Magers12 Key Performance Indicators for QA & Test Magers
12 Key Performance Indicators for QA & Test Magers
Ryan Spencer Furner
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Test automation Anecdotes
Test automation AnecdotesTest automation Anecdotes
Test automation Anecdotes
Cristiano Caetano
 

What's hot (20)

Rapid Software Testing
Rapid Software TestingRapid Software Testing
Rapid Software Testing
 
Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
Darshan Desai - Virtual Test Labs,The Next Frontier - EuroSTAR 2010
 
Bridging the communication gap
Bridging the communication gapBridging the communication gap
Bridging the communication gap
 
Stop! you're testing too much
Stop!  you're testing too muchStop!  you're testing too much
Stop! you're testing too much
 
How Crowd Testing Works
How Crowd Testing WorksHow Crowd Testing Works
How Crowd Testing Works
 
The Thinking Tester, Evolved
The Thinking Tester, EvolvedThe Thinking Tester, Evolved
The Thinking Tester, Evolved
 
Testing Intelligence
Testing IntelligenceTesting Intelligence
Testing Intelligence
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
 
Myths and reality about software testing
Myths and reality about software testingMyths and reality about software testing
Myths and reality about software testing
 
Exploratory Testing in Practice
Exploratory Testing in PracticeExploratory Testing in Practice
Exploratory Testing in Practice
 
Communicated deadlines = bad quality
Communicated deadlines = bad qualityCommunicated deadlines = bad quality
Communicated deadlines = bad quality
 
Rehan Pair Testing Final
Rehan Pair Testing FinalRehan Pair Testing Final
Rehan Pair Testing Final
 
Common mistakes in software testing and how to overcome?
Common mistakes in software testing and how to overcome?Common mistakes in software testing and how to overcome?
Common mistakes in software testing and how to overcome?
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interaction
 
Tester vs Developer
Tester vs DeveloperTester vs Developer
Tester vs Developer
 
Rapid Software Testing: Reporting
Rapid Software Testing: ReportingRapid Software Testing: Reporting
Rapid Software Testing: Reporting
 
12 Key Performance Indicators for QA & Test Magers
12 Key Performance Indicators for QA & Test Magers12 Key Performance Indicators for QA & Test Magers
12 Key Performance Indicators for QA & Test Magers
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Test automation Anecdotes
Test automation AnecdotesTest automation Anecdotes
Test automation Anecdotes
 

Viewers also liked

Acceptance Criteria as Requirements and Tests
Acceptance Criteria as Requirements and TestsAcceptance Criteria as Requirements and Tests
Acceptance Criteria as Requirements and Tests
Johan Hoberg
 
Codifying Knowledge in Tests
Codifying Knowledge in TestsCodifying Knowledge in Tests
Codifying Knowledge in Tests
Johan Hoberg
 
Systematic inventive thinking and game testing
Systematic inventive thinking and game testingSystematic inventive thinking and game testing
Systematic inventive thinking and game testing
Johan Hoberg
 
Testing in a scrum team
Testing in a scrum teamTesting in a scrum team
Testing in a scrum team
Johan Hoberg
 
Information artifact simplicity
Information artifact simplicityInformation artifact simplicity
Information artifact simplicity
Johan Hoberg
 
Quality in Games
Quality in GamesQuality in Games
Quality in Games
Johan Hoberg
 
Initial thoughts on live user tests for games
Initial thoughts on live user tests for gamesInitial thoughts on live user tests for games
Initial thoughts on live user tests for games
Johan Hoberg
 
Testing & Scrum
Testing & ScrumTesting & Scrum
Testing & Scrum
Johan Hoberg
 
The Value-Adding Test Strategist
The Value-Adding Test StrategistThe Value-Adding Test Strategist
The Value-Adding Test Strategist
Johan Hoberg
 
Software testing vs. Game testing
Software testing vs. Game testingSoftware testing vs. Game testing
Software testing vs. Game testing
Johan Hoberg
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
Johan Hoberg
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration Testing
Johan Hoberg
 
How to structure testing within the Scrum Framework
How to structure testing within the Scrum FrameworkHow to structure testing within the Scrum Framework
How to structure testing within the Scrum Framework
Johan Hoberg
 
Giving feedback & Scrum
Giving feedback & ScrumGiving feedback & Scrum
Giving feedback & Scrum
Johan Hoberg
 
Exploratory Testing for Developers
Exploratory Testing for DevelopersExploratory Testing for Developers
Exploratory Testing for Developers
Johan Hoberg
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for quality
Johan Hoberg
 
Software testing and game testing
Software testing and game testingSoftware testing and game testing
Software testing and game testing
Johan Hoberg
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
Johan Hoberg
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
Johan Hoberg
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
Johan Hoberg
 

Viewers also liked (20)

Acceptance Criteria as Requirements and Tests
Acceptance Criteria as Requirements and TestsAcceptance Criteria as Requirements and Tests
Acceptance Criteria as Requirements and Tests
 
Codifying Knowledge in Tests
Codifying Knowledge in TestsCodifying Knowledge in Tests
Codifying Knowledge in Tests
 
Systematic inventive thinking and game testing
Systematic inventive thinking and game testingSystematic inventive thinking and game testing
Systematic inventive thinking and game testing
 
Testing in a scrum team
Testing in a scrum teamTesting in a scrum team
Testing in a scrum team
 
Information artifact simplicity
Information artifact simplicityInformation artifact simplicity
Information artifact simplicity
 
Quality in Games
Quality in GamesQuality in Games
Quality in Games
 
Initial thoughts on live user tests for games
Initial thoughts on live user tests for gamesInitial thoughts on live user tests for games
Initial thoughts on live user tests for games
 
Testing & Scrum
Testing & ScrumTesting & Scrum
Testing & Scrum
 
The Value-Adding Test Strategist
The Value-Adding Test StrategistThe Value-Adding Test Strategist
The Value-Adding Test Strategist
 
Software testing vs. Game testing
Software testing vs. Game testingSoftware testing vs. Game testing
Software testing vs. Game testing
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration Testing
 
How to structure testing within the Scrum Framework
How to structure testing within the Scrum FrameworkHow to structure testing within the Scrum Framework
How to structure testing within the Scrum Framework
 
Giving feedback & Scrum
Giving feedback & ScrumGiving feedback & Scrum
Giving feedback & Scrum
 
Exploratory Testing for Developers
Exploratory Testing for DevelopersExploratory Testing for Developers
Exploratory Testing for Developers
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for quality
 
Software testing and game testing
Software testing and game testingSoftware testing and game testing
Software testing and game testing
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 

Similar to How a Game Tester Adds Value

The Feedback Playbook
The Feedback PlaybookThe Feedback Playbook
The Feedback Playbook
Centercode
 
Testing and quality romi
Testing and quality romiTesting and quality romi
Testing and quality romi
romi wisarta
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
James Briers
 
SE-Testing.ppt
SE-Testing.pptSE-Testing.ppt
SE-Testing.ppt
vishal choudhary
 
Testing concepts ppt
Testing concepts pptTesting concepts ppt
Testing concepts pptRathna Priya
 
Testing concepts ppt
Testing concepts pptTesting concepts ppt
Testing concepts pptRathna Priya
 
Testing and quality
Testing and qualityTesting and quality
Testing and quality
Ozi Saputra
 
Bab 1
Bab 1Bab 1
Fundamentals of testing (1)
Fundamentals of testing (1)Fundamentals of testing (1)
Fundamentals of testing (1)Aziz Chikhly
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
Emi Rizki Ayunanda
 
EFFECTIVE TEST CASE DESING: A REVIEW
EFFECTIVE TEST CASE DESING: A REVIEWEFFECTIVE TEST CASE DESING: A REVIEW
EFFECTIVE TEST CASE DESING: A REVIEW
Journal For Research
 
5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-TestingMary Clemons
 
Black box testing
Black box testingBlack box testing
Black box testing
Anil Shivaa
 
Black box
Black boxBlack box
Software_testing Unit 1 bca V.pdf
Software_testing Unit 1 bca V.pdfSoftware_testing Unit 1 bca V.pdf
Software_testing Unit 1 bca V.pdf
AnupmaMunshi
 
Software testing lecture notes
Software testing  lecture notesSoftware testing  lecture notes
Software testing lecture notes
TEJVEER SINGH
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdfempite
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdfempite
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdfempite
 

Similar to How a Game Tester Adds Value (20)

The Feedback Playbook
The Feedback PlaybookThe Feedback Playbook
The Feedback Playbook
 
Testing and quality romi
Testing and quality romiTesting and quality romi
Testing and quality romi
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
 
SE-Testing.ppt
SE-Testing.pptSE-Testing.ppt
SE-Testing.ppt
 
Testing concepts ppt
Testing concepts pptTesting concepts ppt
Testing concepts ppt
 
Testing concepts ppt
Testing concepts pptTesting concepts ppt
Testing concepts ppt
 
Testing and quality
Testing and qualityTesting and quality
Testing and quality
 
Bab 1
Bab 1Bab 1
Bab 1
 
Fundamentals of testing (1)
Fundamentals of testing (1)Fundamentals of testing (1)
Fundamentals of testing (1)
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
 
EFFECTIVE TEST CASE DESING: A REVIEW
EFFECTIVE TEST CASE DESING: A REVIEWEFFECTIVE TEST CASE DESING: A REVIEW
EFFECTIVE TEST CASE DESING: A REVIEW
 
5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing
 
Black box testing
Black box testingBlack box testing
Black box testing
 
Black box
Black boxBlack box
Black box
 
Software_testing Unit 1 bca V.pdf
Software_testing Unit 1 bca V.pdfSoftware_testing Unit 1 bca V.pdf
Software_testing Unit 1 bca V.pdf
 
Software testing lecture notes
Software testing  lecture notesSoftware testing  lecture notes
Software testing lecture notes
 
Black box
Black boxBlack box
Black box
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdf
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdf
 
BlackBox.pdf
BlackBox.pdfBlackBox.pdf
BlackBox.pdf
 

More from Johan Hoberg

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problem
Johan Hoberg
 
A business case for a modern QA organization
A business case for a modern QA organizationA business case for a modern QA organization
A business case for a modern QA organization
Johan Hoberg
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on Quality
Johan Hoberg
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI Concept
Johan Hoberg
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing Mountain
Johan Hoberg
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & Visibility
Johan Hoberg
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
Johan Hoberg
 
What is QI?
What is QI?What is QI?
What is QI?
Johan Hoberg
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software
Johan Hoberg
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for Everyone
Johan Hoberg
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Johan Hoberg
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testing
Johan Hoberg
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality Software
Johan Hoberg
 
The Tester Role & Scrum
The Tester Role & ScrumThe Tester Role & Scrum
The Tester Role & Scrum
Johan Hoberg
 

More from Johan Hoberg (14)

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problem
 
A business case for a modern QA organization
A business case for a modern QA organizationA business case for a modern QA organization
A business case for a modern QA organization
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on Quality
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI Concept
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing Mountain
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & Visibility
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
 
What is QI?
What is QI?What is QI?
What is QI?
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for Everyone
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testing
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality Software
 
The Tester Role & Scrum
The Tester Role & ScrumThe Tester Role & Scrum
The Tester Role & Scrum
 

Recently uploaded

Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
Harnessing WebAssembly for Real-time Stateless Streaming PipelinesHarnessing WebAssembly for Real-time Stateless Streaming Pipelines
Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
Christina Lin
 
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERSCW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
veerababupersonal22
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
ClaraZara1
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
fxintegritypublishin
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
TeeVichai
 
Investor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptxInvestor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptx
AmarGB2
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
SamSarthak3
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
ssuser7dcef0
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
ydteq
 
Forklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella PartsForklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella Parts
Intella Parts
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
symbo111
 

Recently uploaded (20)

Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
Harnessing WebAssembly for Real-time Stateless Streaming PipelinesHarnessing WebAssembly for Real-time Stateless Streaming Pipelines
Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
 
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERSCW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
CW RADAR, FMCW RADAR, FMCW ALTIMETER, AND THEIR PARAMETERS
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
 
Investor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptxInvestor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptx
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdfAKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
AKS UNIVERSITY Satna Final Year Project By OM Hardaha.pdf
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
 
Forklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella PartsForklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella Parts
 
Building Electrical System Design & Installation
Building Electrical System Design & InstallationBuilding Electrical System Design & Installation
Building Electrical System Design & Installation
 

How a Game Tester Adds Value

  • 1. How a Game Tester Adds Value How does a professional game tester add value to a game development studio? Can you measure this value in a good way? I will try to give my view on this subject. I am specifically talking about value added that is part of the tester role. Obviously anyone can add value outside of their specific role – such as bringing coffee to people, or just performing tasks that are not specific to their role. First an overview of how I think a game tester adds value:  Finding and reporting defects in the game  Providing support to developers o Help developing Acceptance Criteria o Support with test knowledge o Provide test environment for developers o Test Automation o Drive testability in implementation  Provide test information & knowledge to stakeholders  Certification / Mandatory testing  Game design / Fun factor / Balancing / Realism input Finding and reporting defects in the game A game tester’s primary function is generally to find defects or questionable design decisions in the game. This defect is then reported, in a written artifact or verbally, to someone who can make a decision regarding that defect. A game developer, artist, or other role can then, depending on a host of different factors, fix the defect. With good enough historical data, metrics and understanding of the users, the value of the absence of the defect in the game can then be evaluated. This is a clear value add that the game tester brings to the table. But there are additional factors to consider before celebrating the value of testers. A defect requires analysis, and the tester provides the basis for this analysis. If the defect report is of low quality, then suddenly the tester is adding to the analysis cost. This can be mitigated by securing that a proper defect management process is in place, and that the tester knows which information is needed in the defect report.
  • 2. We also have to consider that every defect submitted that is not fixed has an analysis cost. This means that the only value a tester has created if ten defect reports are submitted and none of them are fixed is some vague information value, but the analysis cost of these ten issues is very real. So for a tester to add real value the defects reported must provide the right information, and also actually be fixed. This provides a dilemma. Should the tester send defect reports of every single thing they find to the developers for analysis? There probably needs to be some analysis triage before the defects reach the developers to reduce unnecessary analysis cost. This triage could be done by testers, but it could also be done by a stakeholder who can make a decision if the defect should be fixed or not in the first place, before it is analyzed. However there are of course risks introduced when not analyzing all defects that are found. Finally we cannot forget that the developer that fixes the defect also shares the added value of the absence of the defect in the game. How much each role contributes to the absence of the defect is probably difficult to assess. Providing support to developers A part from finding and reporting defects a tester can also provide valuable support to developers in many different ways. By creating Acceptance Criteria that are testable and understandable to all stakeholders, the tester provides some value, which is hard to measure. Good Acceptance Criteria bring clarity both to what developers should do, and to what stakeholders actually want. A worst-case scenario with a lack of understanding between stakeholders and developers could be very costly indeed. In a perfect world these Acceptance Criteria can also be used directly as test artifacts, which would free up the testers time to perform more valuable activities than creating test cases, since test cases in themselves do not add any value. A tester can also add value by supporting the developer with expertise to enable better testing. Helping with test techniques and methods to improve the testing performed by the developer. The value of this support is very hard to measure. Providing a test environment for the developers to use is also something that adds value. To the testers themselves this is a pre-requisite for their work, but you could argue that this is a service they provide to the developers, which adds value. The value can be calculated by evaluating how much time it would take for the developers to set up and maintain a parallel test environment for themselves. When I say test environment it can include a framework for automated testing. Testers can also set up, maintain and run different automated test suites to support continuous integration, and other automated test runs. Maintaining and running automated tests have no inherent value in itself for a tester, but can be a pre-requisite for allowing the tester to find defects and provide necessary information to stakeholders. However there is a value in enabling continuous
  • 3. integration, or other development practices that require automated tests. The value add of this activity can be measured in the same way as for maintaining a test environment for developers. How much would it cost for them to set it up themselves? Testability needs to be built into a game. This is something that a tester can drive at early stages of the game development. By providing knowledge and expertise the tester might get developers to build in testability that would otherwise be forgotten. The value of this is quite hard to put a number on. Provide test information & knowledge to stakeholders Also something that is part of the core responsibility of a tester’s job. This can for example be done in the form of a test report, an email, verbal communication, a post-it, or something similar. I here separate between information and information – defects are in a sense also test information, but I separated the two for higher granularity. So a tester performs a test activity, and submits relevant found defects. Usually the tester also creates some kind of a report with regards to this test activity, which is then sent to a stakeholder. Sometimes this report is consolidated with other testers’ reports by a test lead or project manager. The report created by the tester has information value. What value the report actually has depends on the decisions based on that report. If a stakeholder reads (or does not read) a report, and the report has no impact what so ever on decisions, then the report holds little value. Some value, but very little. I have personally been in a situation were the project manager stated that he only wanted a list of new defects, and did not care about the test report. Clearly that report held no value, and I recommended to management that we should stop writing that report. Sometimes managers can feel more secure if they (think they) have control over what is happening, even though they don’t take any decision based on the report. Then the report has some personal value to the individual manager, but very little to the company as a whole. But even if the report is valuable to a stakeholder, it is hard to put that value into numbers. Certification / Mandatory testing Sometimes there are mandatory tests that need to be executed to be able to release a game. When there are tests that are mandatory to run for some reason, then the tester is immediately providing value by just performing the tests. How
  • 4. much value can easily be calculated by how much it would cost to outsource the test execution to a third-party test house. Game design / Fun Factor / Balancing / Realism input A tester spends many hours playing a game. Building up experience with not only a specific game, but with general game design principles. It would be a waste not to utilize this experience. Some parts of the game design are easier to add value in than others, for testers. Balancing and difficulty level is something that a tester could easily evaluate based on the many hours spent playing the game. At least relative balancing and difficulty level between different components. Depending on the tester’s other competencies, and available material on how something should work, realism could also be evaluated. A tester could also provide input on fun factor, but this is highly subjective unless you have the right training in how to evaluate “fun”, I suppose. Finally, based on the tester’s own game design competence, a tester could provide input on the game design and how it works when implemented in the game. It seems like a waste not to use the fact that a tester spends so many hours playing a game, and not gather feedback from the tester with regards to these types of game design questions. Obviously all of these things are very hard to measure the value of. Conclusion Of course there will always be other ways for a person in a game tester role to add value to a company than the ones I described above, but I think these are the main value contributing factors the game tester role brings to the table. In this discussion we should not confuse a person with a role. A person probably adds value in many ways – by being a team player, motivated co-worker, nice person, part-time developer, part-time team leader, and so on – but in the role of a game tester, what I have presented in this article is what I see as the major value add to the company. But how a game tester role adds value is of course not constant, and my view will change over time, as the field changes and as I get new input that makes me reconsider my standpoint.