SlideShare a Scribd company logo
1
How to Beta Test Hardware
in an Increasingly Complex World
2
Meet the Speaker
Emily Hossellman
Director of Marketing @ Centercode
emily@centercode.com
@ehossellman
Agenda
1. The current hardware landscape
2. The role of customer validation
3. Running a successful hardware beta test
4. Using the data post-beta
5. Q&A
3
4
Who is Centercode?
Services Fully managed tests and programs
Software Complete test management platform
Testers Access to 150k+ deeply profiled global candidates
Content Free tools and best practices
We've been running beta tests since 2001
Beta testing and customer validation are our core competency
5
Current Landscape
6
Current Landscape
1. Tech environments are more complex
2. Customers have higher expectations
3. The spotlight is bright
7
Tech Environments Are More Complex
More devices talking to each other
Products themselves are more complex
Hardware products do not function in a silo anymore
Constant growth and increased fragmentation
You're building for an ecosystem
8
Customers Have Higher Expectations
Decreasing tolerance for friction
Do everything they want
Be intuitive and easy to set up
Instant answers to questions
Personalization and flexibility
Customers are vocal (with the good and the bad)
Many markets don't have established expectations
9
The Spotlight is Bright
Press speculation about who will be the big players
Buzz around product announcements can build hype
A failed launch can be catastrophic to a brand
Tons of companies trying to get into the space
This creates a perfect storm for hardware companies
10
Role of Customer Validation
11
Beta Testing =
Customer Validation
Targeted customers using your product in real environments
Increases quality, improves user experience, validates performance
Many names: CAT, UAT, FUT, Customer Evaluation, Field Trials, Pre-release
12
What Beta Brings to the Table
1. Introduces you to your target audience
2. Facilitates a focused, meaningful conversation
3. Gives you the opportunity to really listen
13
What Beta Brings to the Table
Not just technical check → Customer validation
● Sanity check / will they use it
● Out-of-box experience
● Test for interoperability/compatibility
● Prepping support processes
● Marketing insights
● Diversity - more eyeballs, more environments, more use cases
14
Running Your Beta
15
The Process
Planning
Recruiting
Shipping
Managing
Retrieving Units
Closing
16
Planning
Set your objectives / get stakeholders involved early
Visualize your tester team -- core criteria and segmentations
Determine whether you need to do phases
Anticipate unit cannibalism
17
Recruiting
Recruit targeted testers
Build a detailed qualification process
Look for enthusiasm and good writing
Fill the toughest segmentations first
Be efficient with your selections to get a wide variety
18
Shipping
Create a process for shipping/tracking
Mark units and record serial numbers
Plan for failed units
Plan for international shipping
Do 2-day shipping
19
Shipping
Keep your testers in the loop
Confirm shipping addresses
Make testers sign for packages
Include chargers, cords, accessories
Complete the out-of-the-box experience
20
Managing
Map out your test to align with your objectives
Have a support process in place
Triage feedback you receive
Check alignment from the beginning
Consider collecting video
Collect detailed bug reports
21
Managing
Create a great testing experience
Solicit feedback about comfort/usability/appearance
Ask for feature requests
Mimic real world feedback
Test your firmware update process
Regress fixes / get feedback on changes
22
Retrieving Units
Decide whether you need the units back (or if testers can keep them)
Set the return expectations early
Include return shipping labels and return instructions in the initial package
Hold onto rewards until you have the unit back
Process returned units quickly (and tell the tester you received it)
23
Closing
Say thank you!
Identify rockstars and evangelists
Keep testers informed
Get prioritized data to your stakeholders
24
Leveraging the Data
25
Improve Quality
Prioritize your bugs using scoring
Attach test platforms
Use the data to justify changes
26
Prepare Support
Improve documentation based on hurdles testers faced
Prepare for known issues
Build in more customer feedback mechanisms
27
Fuel Marketing & PR
Build a trove of user generated content (quotes, videos, testimonials)
Find what testers loved about your product
Use data to back up marketing claims
Find new use cases
Identify/cultivate evangelists
Publicize your beta success
28
Final Thoughts
Beta testing is your chance to get true customer validation
Plan out your test: priorities and stakeholders
Set up your test well and the feedback will come naturally
Trends will emerge, look for alignment
Listen to the feedback
29
Q&A
Emily Hossellman
Director of Marketing @ Centercode
emily@centercode.com
@ehossellman
Sign up for our newsletter
For more resources, visit our library
30
Thank You!

More Related Content

What's hot

Angket matematika lia
Angket matematika liaAngket matematika lia
Angket matematika lia
myzero
 
Paul ernest philosophy math
Paul ernest philosophy mathPaul ernest philosophy math
Paul ernest philosophy mathMuhammad Rizaldi
 
Globus Toolkit
Globus ToolkitGlobus Toolkit
Globus Toolkit
Juliane Silva
 
Rpp matematika SMA (program linear ipa)
Rpp matematika SMA (program linear ipa)Rpp matematika SMA (program linear ipa)
Rpp matematika SMA (program linear ipa)Heriyanto Asep
 
Running a Successful B2B Beta Test
Running a Successful B2B Beta TestRunning a Successful B2B Beta Test
Running a Successful B2B Beta Test
Centercode
 
LKPD Statistika Kelas XI kurikulum 2013
LKPD Statistika Kelas XI kurikulum 2013LKPD Statistika Kelas XI kurikulum 2013
LKPD Statistika Kelas XI kurikulum 2013Zulyy Zelyytta
 
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematis
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematisInstrumen tes kemampuan pemahaman konsep dan komunikasi matematis
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematis
Preally A
 
5. ANALISIS CP, TP dan ATP Matematika120.docx
5. ANALISIS CP, TP dan ATP Matematika120.docx5. ANALISIS CP, TP dan ATP Matematika120.docx
5. ANALISIS CP, TP dan ATP Matematika120.docx
MinarMurni
 
Test Environment Management
Test Environment ManagementTest Environment Management
Test Environment Management
Kanoah
 
Lks persegi dan persegi panjang PMR
Lks persegi dan persegi panjang PMRLks persegi dan persegi panjang PMR
Lks persegi dan persegi panjang PMR
sherllly aryantama
 
Rencana pelaksanaan pembelajaran ( himpunan )
Rencana pelaksanaan pembelajaran ( himpunan )Rencana pelaksanaan pembelajaran ( himpunan )
Rencana pelaksanaan pembelajaran ( himpunan )
Intan Saputri
 
Angka maya
Angka mayaAngka maya
Angka mayazxmuadz
 
Bab i-sistem-koordinat
Bab i-sistem-koordinatBab i-sistem-koordinat
Bab i-sistem-koordinatMira Agustina
 
Power point Senam Irama
Power point Senam IramaPower point Senam Irama
Power point Senam Irama
mitakhsn
 

What's hot (17)

Grafik fungsi
Grafik fungsiGrafik fungsi
Grafik fungsi
 
Angket matematika lia
Angket matematika liaAngket matematika lia
Angket matematika lia
 
Paul ernest philosophy math
Paul ernest philosophy mathPaul ernest philosophy math
Paul ernest philosophy math
 
Globus Toolkit
Globus ToolkitGlobus Toolkit
Globus Toolkit
 
Rpp matematika SMA (program linear ipa)
Rpp matematika SMA (program linear ipa)Rpp matematika SMA (program linear ipa)
Rpp matematika SMA (program linear ipa)
 
Rpp atletik
Rpp atletikRpp atletik
Rpp atletik
 
11. penyajian data
11. penyajian data11. penyajian data
11. penyajian data
 
Running a Successful B2B Beta Test
Running a Successful B2B Beta TestRunning a Successful B2B Beta Test
Running a Successful B2B Beta Test
 
LKPD Statistika Kelas XI kurikulum 2013
LKPD Statistika Kelas XI kurikulum 2013LKPD Statistika Kelas XI kurikulum 2013
LKPD Statistika Kelas XI kurikulum 2013
 
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematis
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematisInstrumen tes kemampuan pemahaman konsep dan komunikasi matematis
Instrumen tes kemampuan pemahaman konsep dan komunikasi matematis
 
5. ANALISIS CP, TP dan ATP Matematika120.docx
5. ANALISIS CP, TP dan ATP Matematika120.docx5. ANALISIS CP, TP dan ATP Matematika120.docx
5. ANALISIS CP, TP dan ATP Matematika120.docx
 
Test Environment Management
Test Environment ManagementTest Environment Management
Test Environment Management
 
Lks persegi dan persegi panjang PMR
Lks persegi dan persegi panjang PMRLks persegi dan persegi panjang PMR
Lks persegi dan persegi panjang PMR
 
Rencana pelaksanaan pembelajaran ( himpunan )
Rencana pelaksanaan pembelajaran ( himpunan )Rencana pelaksanaan pembelajaran ( himpunan )
Rencana pelaksanaan pembelajaran ( himpunan )
 
Angka maya
Angka mayaAngka maya
Angka maya
 
Bab i-sistem-koordinat
Bab i-sistem-koordinatBab i-sistem-koordinat
Bab i-sistem-koordinat
 
Power point Senam Irama
Power point Senam IramaPower point Senam Irama
Power point Senam Irama
 

Viewers also liked

Increasing the ROI of Your Beta Tests
Increasing the ROI of Your Beta TestsIncreasing the ROI of Your Beta Tests
Increasing the ROI of Your Beta Tests
Centercode
 
How to Juggle Multiple Beta Tests at Once
How to Juggle Multiple Beta Tests at OnceHow to Juggle Multiple Beta Tests at Once
How to Juggle Multiple Beta Tests at Once
Centercode
 
Recruiting and Selecting Great Beta Testers
Recruiting and Selecting Great Beta TestersRecruiting and Selecting Great Beta Testers
Recruiting and Selecting Great Beta Testers
Centercode
 
The ROI of Beta Testing
The ROI of Beta TestingThe ROI of Beta Testing
The ROI of Beta Testing
Centercode
 
What You Need to Know about Beta Management
What You Need to Know about Beta ManagementWhat You Need to Know about Beta Management
What You Need to Know about Beta Management
Centercode
 
Integrating the Voice of the Customer into Your Product's Development
Integrating the Voice of the Customer into Your Product's DevelopmentIntegrating the Voice of the Customer into Your Product's Development
Integrating the Voice of the Customer into Your Product's Development
Centercode
 
100 Tips for Better Beta Tests
100 Tips for Better Beta Tests100 Tips for Better Beta Tests
100 Tips for Better Beta Tests
Centercode
 

Viewers also liked (7)

Increasing the ROI of Your Beta Tests
Increasing the ROI of Your Beta TestsIncreasing the ROI of Your Beta Tests
Increasing the ROI of Your Beta Tests
 
How to Juggle Multiple Beta Tests at Once
How to Juggle Multiple Beta Tests at OnceHow to Juggle Multiple Beta Tests at Once
How to Juggle Multiple Beta Tests at Once
 
Recruiting and Selecting Great Beta Testers
Recruiting and Selecting Great Beta TestersRecruiting and Selecting Great Beta Testers
Recruiting and Selecting Great Beta Testers
 
The ROI of Beta Testing
The ROI of Beta TestingThe ROI of Beta Testing
The ROI of Beta Testing
 
What You Need to Know about Beta Management
What You Need to Know about Beta ManagementWhat You Need to Know about Beta Management
What You Need to Know about Beta Management
 
Integrating the Voice of the Customer into Your Product's Development
Integrating the Voice of the Customer into Your Product's DevelopmentIntegrating the Voice of the Customer into Your Product's Development
Integrating the Voice of the Customer into Your Product's Development
 
100 Tips for Better Beta Tests
100 Tips for Better Beta Tests100 Tips for Better Beta Tests
100 Tips for Better Beta Tests
 

Similar to How to Beta Test Hardware Products in an Increasingly Complex World

Getting Customer Validation of Your Product Before Release | Emily Hossellman...
Getting Customer Validation of Your Product Before Release | Emily Hossellman...Getting Customer Validation of Your Product Before Release | Emily Hossellman...
Getting Customer Validation of Your Product Before Release | Emily Hossellman...
UCICove
 
How to Achieve Customer Satisfaction Through Beta Testing
How to Achieve Customer Satisfaction Through Beta TestingHow to Achieve Customer Satisfaction Through Beta Testing
How to Achieve Customer Satisfaction Through Beta Testing
Centercode
 
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Maaret Pyhäjärvi
 
Candid Conversations With Product People: Using Continuous Customer Testing f...
Candid Conversations With Product People: Using Continuous Customer Testing f...Candid Conversations With Product People: Using Continuous Customer Testing f...
Candid Conversations With Product People: Using Continuous Customer Testing f...
Aggregage
 
Fusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test ExecutionFusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test Execution
Jamie Tischart
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven Testing
Jorge Boria
 
Exploratory Testing: Make It Part of Your Test Strategy
Exploratory Testing: Make It Part of Your Test StrategyExploratory Testing: Make It Part of Your Test Strategy
Exploratory Testing: Make It Part of Your Test Strategy
TechWell
 
Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designs
Elizabeth Snowdon
 
Software testing
Software testingSoftware testing
Software testingthaneofife
 
Positivityofnegative
PositivityofnegativePositivityofnegative
Positivityofnegative
pramodkg
 
Empowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer ValidationEmpowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer Validation
Aggregage
 
Empowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer ValidationEmpowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer Validation
Hannah Flynn
 
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Aggregage
 
Online testing strategy
Online testing strategyOnline testing strategy
Online testing strategy
Cloud9 Consulting
 
Session 02 - Introduction to Quality Assurance / Software Testing
Session 02 - Introduction to Quality Assurance / Software Testing Session 02 - Introduction to Quality Assurance / Software Testing
Session 02 - Introduction to Quality Assurance / Software Testing
PoojaLQA
 
6 Tips to Accelerate MedTech Time To Clinical Data
6 Tips to Accelerate MedTech Time To Clinical Data6 Tips to Accelerate MedTech Time To Clinical Data
6 Tips to Accelerate MedTech Time To Clinical Data
Andy Rogers
 
Test Cases Maintaining & Documenting
Test Cases Maintaining & DocumentingTest Cases Maintaining & Documenting
Test Cases Maintaining & DocumentingSeyed Ali Marjaie
 
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Vipul Gupta
 
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation
Nadeeshani Aththanagoda
 

Similar to How to Beta Test Hardware Products in an Increasingly Complex World (20)

Getting Customer Validation of Your Product Before Release | Emily Hossellman...
Getting Customer Validation of Your Product Before Release | Emily Hossellman...Getting Customer Validation of Your Product Before Release | Emily Hossellman...
Getting Customer Validation of Your Product Before Release | Emily Hossellman...
 
How to Achieve Customer Satisfaction Through Beta Testing
How to Achieve Customer Satisfaction Through Beta TestingHow to Achieve Customer Satisfaction Through Beta Testing
How to Achieve Customer Satisfaction Through Beta Testing
 
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
 
Candid Conversations With Product People: Using Continuous Customer Testing f...
Candid Conversations With Product People: Using Continuous Customer Testing f...Candid Conversations With Product People: Using Continuous Customer Testing f...
Candid Conversations With Product People: Using Continuous Customer Testing f...
 
Fusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test ExecutionFusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test Execution
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven Testing
 
Exploratory Testing: Make It Part of Your Test Strategy
Exploratory Testing: Make It Part of Your Test StrategyExploratory Testing: Make It Part of Your Test Strategy
Exploratory Testing: Make It Part of Your Test Strategy
 
Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designs
 
Software testing
Software testingSoftware testing
Software testing
 
Positivityofnegative
PositivityofnegativePositivityofnegative
Positivityofnegative
 
Empowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer ValidationEmpowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer Validation
 
Empowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer ValidationEmpowering Product Teams: Build Delightful Products with Customer Validation
Empowering Product Teams: Build Delightful Products with Customer Validation
 
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
 
Testing Framework
Testing FrameworkTesting Framework
Testing Framework
 
Online testing strategy
Online testing strategyOnline testing strategy
Online testing strategy
 
Session 02 - Introduction to Quality Assurance / Software Testing
Session 02 - Introduction to Quality Assurance / Software Testing Session 02 - Introduction to Quality Assurance / Software Testing
Session 02 - Introduction to Quality Assurance / Software Testing
 
6 Tips to Accelerate MedTech Time To Clinical Data
6 Tips to Accelerate MedTech Time To Clinical Data6 Tips to Accelerate MedTech Time To Clinical Data
6 Tips to Accelerate MedTech Time To Clinical Data
 
Test Cases Maintaining & Documenting
Test Cases Maintaining & DocumentingTest Cases Maintaining & Documenting
Test Cases Maintaining & Documenting
 
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
 
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation
 

Recently uploaded

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 

Recently uploaded (20)

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 

How to Beta Test Hardware Products in an Increasingly Complex World

  • 1. 1 How to Beta Test Hardware in an Increasingly Complex World
  • 2. 2 Meet the Speaker Emily Hossellman Director of Marketing @ Centercode emily@centercode.com @ehossellman
  • 3. Agenda 1. The current hardware landscape 2. The role of customer validation 3. Running a successful hardware beta test 4. Using the data post-beta 5. Q&A 3
  • 4. 4 Who is Centercode? Services Fully managed tests and programs Software Complete test management platform Testers Access to 150k+ deeply profiled global candidates Content Free tools and best practices We've been running beta tests since 2001 Beta testing and customer validation are our core competency
  • 6. 6 Current Landscape 1. Tech environments are more complex 2. Customers have higher expectations 3. The spotlight is bright
  • 7. 7 Tech Environments Are More Complex More devices talking to each other Products themselves are more complex Hardware products do not function in a silo anymore Constant growth and increased fragmentation You're building for an ecosystem
  • 8. 8 Customers Have Higher Expectations Decreasing tolerance for friction Do everything they want Be intuitive and easy to set up Instant answers to questions Personalization and flexibility Customers are vocal (with the good and the bad) Many markets don't have established expectations
  • 9. 9 The Spotlight is Bright Press speculation about who will be the big players Buzz around product announcements can build hype A failed launch can be catastrophic to a brand Tons of companies trying to get into the space This creates a perfect storm for hardware companies
  • 10. 10 Role of Customer Validation
  • 11. 11 Beta Testing = Customer Validation Targeted customers using your product in real environments Increases quality, improves user experience, validates performance Many names: CAT, UAT, FUT, Customer Evaluation, Field Trials, Pre-release
  • 12. 12 What Beta Brings to the Table 1. Introduces you to your target audience 2. Facilitates a focused, meaningful conversation 3. Gives you the opportunity to really listen
  • 13. 13 What Beta Brings to the Table Not just technical check → Customer validation ● Sanity check / will they use it ● Out-of-box experience ● Test for interoperability/compatibility ● Prepping support processes ● Marketing insights ● Diversity - more eyeballs, more environments, more use cases
  • 16. 16 Planning Set your objectives / get stakeholders involved early Visualize your tester team -- core criteria and segmentations Determine whether you need to do phases Anticipate unit cannibalism
  • 17. 17 Recruiting Recruit targeted testers Build a detailed qualification process Look for enthusiasm and good writing Fill the toughest segmentations first Be efficient with your selections to get a wide variety
  • 18. 18 Shipping Create a process for shipping/tracking Mark units and record serial numbers Plan for failed units Plan for international shipping Do 2-day shipping
  • 19. 19 Shipping Keep your testers in the loop Confirm shipping addresses Make testers sign for packages Include chargers, cords, accessories Complete the out-of-the-box experience
  • 20. 20 Managing Map out your test to align with your objectives Have a support process in place Triage feedback you receive Check alignment from the beginning Consider collecting video Collect detailed bug reports
  • 21. 21 Managing Create a great testing experience Solicit feedback about comfort/usability/appearance Ask for feature requests Mimic real world feedback Test your firmware update process Regress fixes / get feedback on changes
  • 22. 22 Retrieving Units Decide whether you need the units back (or if testers can keep them) Set the return expectations early Include return shipping labels and return instructions in the initial package Hold onto rewards until you have the unit back Process returned units quickly (and tell the tester you received it)
  • 23. 23 Closing Say thank you! Identify rockstars and evangelists Keep testers informed Get prioritized data to your stakeholders
  • 25. 25 Improve Quality Prioritize your bugs using scoring Attach test platforms Use the data to justify changes
  • 26. 26 Prepare Support Improve documentation based on hurdles testers faced Prepare for known issues Build in more customer feedback mechanisms
  • 27. 27 Fuel Marketing & PR Build a trove of user generated content (quotes, videos, testimonials) Find what testers loved about your product Use data to back up marketing claims Find new use cases Identify/cultivate evangelists Publicize your beta success
  • 28. 28 Final Thoughts Beta testing is your chance to get true customer validation Plan out your test: priorities and stakeholders Set up your test well and the feedback will come naturally Trends will emerge, look for alignment Listen to the feedback
  • 29. 29 Q&A Emily Hossellman Director of Marketing @ Centercode emily@centercode.com @ehossellman Sign up for our newsletter For more resources, visit our library