Playtesting for Indie Studios
Pejman Mirza-Babaei, Ph.D.,
Brandon Drenikow
Naeem Moosajee, M.Sc.
@naeemmoose
naeem.moosajee@gmail.com
Me
o  Focus on taking methods and techniques learned in
industry and developing techniques indies can u7lize
o  Research focused on Games User Research
2
Agenda
Intro
Methods &
Approach
Games
Tested
Takeaways
Next Steps
Execution Labs 4
o  XL is a hands-on early stage investor in game studios
Games User Research 5
o  Games User Research focuses on players’ psychology
and their behaviour via techniques such as
playtes7ng, analy7cs, expert analysis, and others. 
o  Game User Researchers aim to help game developers
deliver players the best gaming experience possible.
h"p://gamesuserresearchsig.org/what-is-gur/
Approach 6
Summary
o  6 different commercial games
o  11 playtest case studies
o  118 par7cipants in total
7
Five Key Factors - Tips
o  Influencing playtes7ng for indie studios
1.  Playtes7ng process
2.  Playtest focus and methods
3.  Playtest lab setup
4.  Building par7cipants database
5.  Developers playtes7ng training
8
(1) Playtesting Process
o  Process should define 
•  Design of playtes7ng stages
•  Number of par7cipants, 7me playing, number of
researchers needed etc.
•  Analysis and repor7ng
9
(2) Playtest Focus & Methods
o  What to evaluate?
o  What ques7ons do you want me to answer?
o  What is your design intent?
o  FTUE and RITE
o  First hour experience and onboarding phase
10
(3) Playtest Lab Setup
o  Dedicated lab vs ad hoc
setup
o  Observa7onal data
•  Video game capture
•  Microphone recording
•  Webcam recording of faces or
input interac7on
11
(4) Building Participants Database
o  Large diverse par7cipant pool
o  Online form with demographic data
•  On which pla^orm do you usually play?
•  How many hours per week do you spend playing video
games on consoles or PC?
•  What are your favorite gaming genres and themes?
•  At which frequency do you play video games on tablets or
smartphones?
•  What are your favorite mobile gaming genres and themes?
12
(5) Developer Training
o  Workshops to train developers
o  Sessions on how to:
•  Conduct an interview / focus group
•  Create a survey
•  What telemetry hooks are important to track
•  Selec7ng par7cipants
•  Colour, shape and signs for Usability
13
Next Steps
o  Playtes7ng can help
•  Resources are not always available 
o  Focus on how to address indie needs
•  More explora7on needed
•  Indie development 7meframe	
14
Questions?
15

Playtesting for Indie Studios

  • 1.
    Playtesting for IndieStudios Pejman Mirza-Babaei, Ph.D., Brandon Drenikow Naeem Moosajee, M.Sc. @naeemmoose naeem.moosajee@gmail.com
  • 2.
    Me o  Focus ontaking methods and techniques learned in industry and developing techniques indies can u7lize o  Research focused on Games User Research 2
  • 3.
  • 4.
    Execution Labs 4 o XL is a hands-on early stage investor in game studios
  • 5.
    Games User Research5 o  Games User Research focuses on players’ psychology and their behaviour via techniques such as playtes7ng, analy7cs, expert analysis, and others. o  Game User Researchers aim to help game developers deliver players the best gaming experience possible. h"p://gamesuserresearchsig.org/what-is-gur/
  • 6.
  • 7.
    Summary o  6 differentcommercial games o  11 playtest case studies o  118 par7cipants in total 7
  • 8.
    Five Key Factors- Tips o  Influencing playtes7ng for indie studios 1.  Playtes7ng process 2.  Playtest focus and methods 3.  Playtest lab setup 4.  Building par7cipants database 5.  Developers playtes7ng training 8
  • 9.
    (1) Playtesting Process o Process should define •  Design of playtes7ng stages •  Number of par7cipants, 7me playing, number of researchers needed etc. •  Analysis and repor7ng 9
  • 10.
    (2) Playtest Focus& Methods o  What to evaluate? o  What ques7ons do you want me to answer? o  What is your design intent? o  FTUE and RITE o  First hour experience and onboarding phase 10
  • 11.
    (3) Playtest LabSetup o  Dedicated lab vs ad hoc setup o  Observa7onal data •  Video game capture •  Microphone recording •  Webcam recording of faces or input interac7on 11
  • 12.
    (4) Building ParticipantsDatabase o  Large diverse par7cipant pool o  Online form with demographic data •  On which pla^orm do you usually play? •  How many hours per week do you spend playing video games on consoles or PC? •  What are your favorite gaming genres and themes? •  At which frequency do you play video games on tablets or smartphones? •  What are your favorite mobile gaming genres and themes? 12
  • 13.
    (5) Developer Training o Workshops to train developers o  Sessions on how to: •  Conduct an interview / focus group •  Create a survey •  What telemetry hooks are important to track •  Selec7ng par7cipants •  Colour, shape and signs for Usability 13
  • 14.
    Next Steps o  Playtes7ngcan help •  Resources are not always available o  Focus on how to address indie needs •  More explora7on needed •  Indie development 7meframe 14
  • 15.