Presenter: Anthony Rindone When we put our love and sweat into a product, it's normal to feel a mix of trepidation and excitement when releasing to users for the first time. And sometimes, this leads us to encounter a number of pot-holes: confirmation bias, leading questions in user-testing sessions, lack of adaptability, among others. We'll focus on 5 strategies to help guide your user research during a beta launch, from experiment design + data collection to empathetic listening. Senior Product Manager & Storyteller @DataXu. When not overly-caffeinated and talking product strategy frameworks, I am an active yogi, snowboarder, and surfer. Also a cheesecake enthusiast.

1. User Research 101 – Beta
Programs & Scenarios
Anthony Rindone
Senior Product Manager – Tripadvisor
Twitter: @AnthonyRindone
www.MindfulProductManager.com

2. Session Evaluations

3. “Started at the bottom, now we’re
here…”
1-1 Personalization &
Automation
A/B & Multivariate Testing
“On-Demand” or Ad-Hoc
Analytics
Reporting & KPI Scorecards
Raw Data Collected
Analytics Themes – Increasing in Maturity:
Focus for Today

4. “Started at the bottom, now we’re
here…”
1-1 Personalization &
Automation
A/B & Multivariate Testing
“On-Demand” or Ad-Hoc
Analytics
Reporting & KPI Scorecards
Raw Data Collected
Analytics Themes – Increasing in Maturity:
Focus for Today
Session later today…

5. User Research 101 – Guiding Questions
❑ How should we recruit users to help test our go-to-market
strategy?
❑ What are some pot holes to avoid so that we get the best,
most accurate data possible (qualitative & quantitative)?

7. Portfolio Definition

8. Define your portfolio / strategy carefully
Internal Users
External Users

9. Define your scenario / strategy carefully
Internal Users
External Users
Implicit Participation Explicit Participation

10. Define your scenario / strategy carefully
Internal Users
External Users
Implicit Participation Explicit Participation
Dog-Fooding

11. Define your scenario / strategy carefully
Internal Users
External Users
Implicit Participation Explicit Participation
Dog-Fooding
A-B Testing

12. Define your scenario / strategy carefully
Internal Users
External Users
Implicit Participation Explicit Participation
Dog-Fooding
A-B Testing ”Insider” Programs

13. Define your scenario / strategy carefully
Internal Users
External Users
Implicit Participation Explicit Participation
Dog-Fooding
A-B Testing ”Insider” Programs
“High Risk” Scenarios

14. Empathetic
listening

15. Levels of Empathetic Listening

16. Levels of Empathetic Listening
1. “I understand your problem.”

17. Levels of Empathetic Listening
1. “I understand your problem.”
1. “I empathize with your frustration /
challenges / problem…”

18. Levels of Empathetic Listening
1. “I understand your problem.”
1. “I empathize with your frustration /
challenges / problem…”
1. “I’m going to personally help you (us)
address this…”