1
Getting Customer Validation
Of Your Product Before Release
2
Meet the Speaker
Emily Hossellman
Director of Marketing @ Centercode
emily@centercode.com
@ehossellman
linkedin.com/in/emilyhossellman
3
Who is Centercode?
Services Run hundreds of fully managed beta tests and programs
Software Built a complete beta program management platform
Testers Grown a community of 150k+ deeply profiled testers
Content Created a library of free tools and best practices
Agenda
1. The importance of customer validation
2. Running a beta test
a. Planning
b. Recruiting
c. Managing
d. Closing
3. Leveraging the data post-beta
4. Optimizing your beta program
5. Q&A 4
5
Role of Customer Validation
The Role of Customer Validation
6
I've built an amazing product.
I'm so excited to launch it.
...But will people like it?
7
Beta Testing =
Customer Validation
Real, targeted customers using your product in real environments
Increases quality, improves user experience, validates performance
Other names: CAT, UAT, FUT, Customer Evaluation, Field Trials, Pre-Release
8
Do I Need to Run a Beta Test?
Short answer: Yes
● Any product with an end user needs customer validation
● All product types: B2B, B2C, software, hardware, mobile, new, revision
● Much less expensive and risky to fix issues before launch than after
9
What Beta Brings to the Table
1. Introduces you to your target audience
2. Facilitates a real, meaningful conversation
3. Gives you the opportunity to really listen
10
The Impact of Beta
Development
Product Management
Development/QA
Usability
Product Management
Support
Marketing
Sales
Beta impacts every part of your product:
11
What You Can Achieve During Beta
Not just technical check → Customer validation
● Sanity check / Will they use it
● Out-of-box experience
● Test for interoperability/compatibility
● Prepping support processes
● Marketing insights
● Diversity - more eyeballs, more environments, more use cases
How To Do It Right
12
People
A qualified and capable team --
in the right place at the right time.
Platform
A flexible, secure,
beta-focused tool set
Processes
Well-planned, robust,
adaptable processes
13
Running Your Beta
14
The Process
Planning
Recruiting
Shipping/Distribution
Managing
Closing
15
Planning
1. Identify your stakeholders
2. Set (some) objectives
3. Determine your tester breakdown
4. Plan out your schedule
5. Outline your workflows/processes
16
Recruiting
1. Create a qualification process
2. Craft a compelling message
3. Build a community of potential testers
4. Review applications
5. Select a balanced tester team
17
Shipping/Distribution
1. Create a process for shipping/distribution
2. Keep records
3. Complete the new user experience
4. Plan for failed units/downloads
5. Keep your testers in the loop
18
Managing
1. Collect the right feedback
a. Collect a variety of feedback
b. Check alignment from the beginning
c. Get the right details
d. Mimic real world feedback
2. Create a great testing experience
a. Support your testers
b. Build a feedback loop
3. Triage feedback on the backend
19
Closing
1. Get final feedback
2. Distribute incentives
a. Decide whether testers get to keep it
b. Hold onto rewards until the test is over
c. Say "thank you!"
3. Manage the data
d. Clean and organize the data
e. Pull out & highlight interesting insights
f. Get prioritized data to your stakeholders
20
Leveraging the Data
21
Improve Quality
● Prioritize your bugs using scoring
● Attach test platforms
● Use the data to justify changes
22
Prepare Support
● Improve documentation based on hurdles testers faced
● Prepare for known issues
● Build in more customer feedback mechanisms
23
Fuel Marketing & PR
● Build a trove of user generated content (quotes, videos, testimonials)
● Find what testers loved about your product
● Use data to back up marketing claims
● Find new use cases
● Identify/cultivate evangelists
● Leverage your commitment to customer feedback
24
Optimizing Your Betas
Optimizing Your Beta Program
25
● Dedicate the Resources
● Design Quality Feedback Mechanisms
● Improve Feedback Workflow
● Increase Beta Participation
● Invest in Beta Management Tools
People
PlatformProcesses
26
Final Thoughts
● Beta testing is your chance to get true customer validation
● Plan out your priorities and stakeholders
● Set up your test well and the feedback will come naturally
● Trends will emerge, look for alignment
● Listen to the feedback
27
Q&A
Emily Hossellman
Director of Marketing @ Centercode
emily@centercode.com
@ehossellman
linkedin.com/in/emilyhossellman
28
Thank You!

Getting Customer Validation of Your Product Before Release | Emily Hossellman | Lunch & Learn

  • 1.
    1 Getting Customer Validation OfYour Product Before Release
  • 2.
    2 Meet the Speaker EmilyHossellman Director of Marketing @ Centercode emily@centercode.com @ehossellman linkedin.com/in/emilyhossellman
  • 3.
    3 Who is Centercode? ServicesRun hundreds of fully managed beta tests and programs Software Built a complete beta program management platform Testers Grown a community of 150k+ deeply profiled testers Content Created a library of free tools and best practices
  • 4.
    Agenda 1. The importanceof customer validation 2. Running a beta test a. Planning b. Recruiting c. Managing d. Closing 3. Leveraging the data post-beta 4. Optimizing your beta program 5. Q&A 4
  • 5.
  • 6.
    The Role ofCustomer Validation 6 I've built an amazing product. I'm so excited to launch it. ...But will people like it?
  • 7.
    7 Beta Testing = CustomerValidation Real, targeted customers using your product in real environments Increases quality, improves user experience, validates performance Other names: CAT, UAT, FUT, Customer Evaluation, Field Trials, Pre-Release
  • 8.
    8 Do I Needto Run a Beta Test? Short answer: Yes ● Any product with an end user needs customer validation ● All product types: B2B, B2C, software, hardware, mobile, new, revision ● Much less expensive and risky to fix issues before launch than after
  • 9.
    9 What Beta Bringsto the Table 1. Introduces you to your target audience 2. Facilitates a real, meaningful conversation 3. Gives you the opportunity to really listen
  • 10.
    10 The Impact ofBeta Development Product Management Development/QA Usability Product Management Support Marketing Sales Beta impacts every part of your product:
  • 11.
    11 What You CanAchieve During Beta Not just technical check → Customer validation ● Sanity check / Will they use it ● Out-of-box experience ● Test for interoperability/compatibility ● Prepping support processes ● Marketing insights ● Diversity - more eyeballs, more environments, more use cases
  • 12.
    How To DoIt Right 12 People A qualified and capable team -- in the right place at the right time. Platform A flexible, secure, beta-focused tool set Processes Well-planned, robust, adaptable processes
  • 13.
  • 14.
  • 15.
    15 Planning 1. Identify yourstakeholders 2. Set (some) objectives 3. Determine your tester breakdown 4. Plan out your schedule 5. Outline your workflows/processes
  • 16.
    16 Recruiting 1. Create aqualification process 2. Craft a compelling message 3. Build a community of potential testers 4. Review applications 5. Select a balanced tester team
  • 17.
    17 Shipping/Distribution 1. Create aprocess for shipping/distribution 2. Keep records 3. Complete the new user experience 4. Plan for failed units/downloads 5. Keep your testers in the loop
  • 18.
    18 Managing 1. Collect theright feedback a. Collect a variety of feedback b. Check alignment from the beginning c. Get the right details d. Mimic real world feedback 2. Create a great testing experience a. Support your testers b. Build a feedback loop 3. Triage feedback on the backend
  • 19.
    19 Closing 1. Get finalfeedback 2. Distribute incentives a. Decide whether testers get to keep it b. Hold onto rewards until the test is over c. Say "thank you!" 3. Manage the data d. Clean and organize the data e. Pull out & highlight interesting insights f. Get prioritized data to your stakeholders
  • 20.
  • 21.
    21 Improve Quality ● Prioritizeyour bugs using scoring ● Attach test platforms ● Use the data to justify changes
  • 22.
    22 Prepare Support ● Improvedocumentation based on hurdles testers faced ● Prepare for known issues ● Build in more customer feedback mechanisms
  • 23.
    23 Fuel Marketing &PR ● Build a trove of user generated content (quotes, videos, testimonials) ● Find what testers loved about your product ● Use data to back up marketing claims ● Find new use cases ● Identify/cultivate evangelists ● Leverage your commitment to customer feedback
  • 24.
  • 25.
    Optimizing Your BetaProgram 25 ● Dedicate the Resources ● Design Quality Feedback Mechanisms ● Improve Feedback Workflow ● Increase Beta Participation ● Invest in Beta Management Tools People PlatformProcesses
  • 26.
    26 Final Thoughts ● Betatesting is your chance to get true customer validation ● Plan out your priorities and stakeholders ● Set up your test well and the feedback will come naturally ● Trends will emerge, look for alignment ● Listen to the feedback
  • 27.
    27 Q&A Emily Hossellman Director ofMarketing @ Centercode emily@centercode.com @ehossellman linkedin.com/in/emilyhossellman
  • 28.