Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Playmation Playtest Strategy & Process

112 views

Published on

Presentation of user research strategy and process (edited slightly for confidentiality).

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Playmation Playtest Strategy & Process

  1. 1. USER RESEARCH STRATEGY & PROCESS
  2. 2. Our playtest strategy will be focused on helping Playmation teams make informed decisions, answering questions to determine direction, and improving execution of new game mechanics and ways to play. Different kinds of testing can be implemented at different times. This is determined by what phase the product is in, what materials are being tested, and what kind of results are needed. R&D Design & Manufacturing (Pre-)Production Frozen Star Wars Cap Shield Gamma Gear Repulsor test goals • Define product experience • Determine physical items • Determine features • Final line list and assortment • Final features and costing • Final content map • Final holistic experience of product with hardware and content together types of tests • Concept/exploratory testing • Focus group • Playtest (Wizard of Oz) • Fit and comfort • Function and usability • Playtest • Hasbro: Volumetrics/ICE tests • Playtest • Field test test topics • What is the holistic experience? • What are the various elements of the product (physical items, features, mechanics)? • Determine MVP and reduction of product features to improve cost • Product design: fit and comfort (weight, wearability), usability (UI), visual design • Content map • Content usability and fun • Tech proving • FTUE and engagement loop • Overall experience Playtest Strategy V3 V2
  3. 3. 1. All testing must go through UX team. 2. We can’t test everything, so there will be no testing purely for information gathering or observation. Every test will be strategically executed and have specific questions to be answered. This way, results can lead to actionable next steps for teams. 3. It is ultimately up to UX if any given test will occur or not. There are many factors that go into this decision and it will not be made lightly, but it should be respected. All alternative options will be explored and discussed prior to the decision. 4. The majority of tests should be determined far in advance in weekly strategy meetings. 5. Minimum of one week’s notice for additional test requests, two weeks for CI/DI- recruited tests. Please note that the more notice that is given, the more likely UX will be able to accommodate the request. 6. Final test materials (including hardware, content, etc.) must be complete at least 24 hours before the test. Playtest Ground Rules
  4. 4. BEFORE TEST • Fielding test requests and determining prioritization and efficacy • Planning meeting(s) to discuss test intentions with relevant team(s) • Scheduling logistics, including calendar invites, observation room reservation, and resource scheduling • All recruiting efforts, including waves of emails and individual communications and updates on an ongoing basis up through the day of the test (to begin 1-2 weeks before test) • Creation of playtest design, discussion guide, test brief, and moderator script • Distribution of pre-test documentation to all stakeholders • Moderator walkthrough of content to ensure test-ready status DAY OF TEST (3-4 hours) • Video needs (setup, streaming to observation rooms, filming during test), audio needs (setup, getting mics on and off each kid, managing audio during test), and other assorted needs in lab (any physical setup, taking photographs if still images are required) • Tester logistics: handling communications with parents, meeting parents and kids in waiting area, getting NDAs signed beforehand and Vinylmations distributed after, escorting kids between waiting area and lab • Other logistics: arrange dinner if test runs late, wrangling of test materials if necessary, etc. • Moderation: test intro and setup for testers, providing whatever moderation is required within the test design, asking pre-determined questions and probing for further answers • Note-taking: objective observations to be leveraged in later test analysis AFTER TEST • Video, images, and NDAs processed and uploaded to maintained database • Post-mortem meetings when needed • Creation of thorough test reports • Distribution of all post-test materials to relevant stakeholders Playtest Process: Friends & Family
  5. 5. BEFORE TEST • Fielding test requests and determining prioritization and efficacy • Planning meeting(s) to discuss test intentions with relevant team(s) • Communicating recruiting and timing needs to Club (1 week before test) • Scheduling logistics, including calendar invites and resource scheduling • Creation of playtest design, discussion guide, test brief, and moderator script • Distribution of pre-test documentation to all stakeholders • Moderator walkthrough of content to ensure test-ready status DAY OF TEST (3-4 hours) • Video needs (setup, filming during test) and other assorted needs (any physical setup, taking photographs if still images are required) • Tester logistics: gathering NDAs signed beforehand and distributing Vinylmations after • Other logistics: wrangling of test materials, transportation of team to Club. • Moderation: test intro and setup for testers, providing whatever moderation is required within the test design, asking pre-determined questions and probing for further answers • Note-taking: objective observations to be leveraged in later test analysis AFTER TEST • Video, images, and NDAs processed and uploaded to maintained database • Post-mortem meetings when needed • Creation of thorough test reports • Distribution of all post-test materials to relevant stakeholders Playtest Process: Boys & Girls Club
  6. 6. BEFORE TEST • Fielding test requests and determining prioritization and efficacy • Planning meeting(s) to discuss test intentions with relevant team(s) • Communicating recruiting and timing needs to CI team (2-4 weeks before test) • Scheduling logistics, including calendar invites, observation room reservation, and resource scheduling • Creation of playtest design, discussion guide, test brief, and moderator script • Distribution of pre-test documentation to all stakeholders • Moderator walkthrough of content to ensure test-ready status DAY OF TEST (3-4 hours) • Video needs (setup, streaming to observation rooms, filming during test), audio needs (setup, getting mics on and off each kid, managing audio during test), and other assorted needs in lab (any physical setup, taking photographs if still images are required) • Tester logistics: handling communications with parents, meeting parents and kids in waiting area, getting NDAs signed beforehand and Vinylmations distributed after, escorting kids between waiting area and lab • Other logistics: arrange dinner if test runs late, wrangling of test materials if necessary, etc. AFTER TEST • Video, images, and NDAs processed and uploaded to maintained database • Distribution of all post-test materials to relevant stakeholders Playtest Process: DCP Consumer Insights
  7. 7. BEFORE TEST • Fielding test requests and determining prioritization and efficacy • Planning meeting(s) to discuss test intentions with relevant team(s) • Communicating recruiting and timing needs to DI team (2-4 weeks before test) • Scheduling logistics, including calendar invites and observation room reservation • Partner with team to create playtest design and test brief • Distribution of pre-test documentation to all stakeholders DAY OF TEST (3-4 hours) • Arrange dinner for observation room if test runs late • Observe test and participate in mid-test discussions and adjustments AFTER TEST • Video, images, and NDAs processed and uploaded to maintained database • Post-mortem meetings when needed • Distribution of all post-test materials to relevant stakeholders Playtest Process: DI User Research

×