SlideShare a Scribd company logo
Concept Exploration: The Missing
Link in Creating Great Products
Frank Guo, PhD
Principal, UX Strategized
frank.guo@uxstrategized.com
2
How do you know you’re really working on the right solution?
Jumps directly to
Identify problem Implement solution
• Identify problems based
on user and business
needs
• Implement a concrete
solution, such as designing UI,
coding, …
Typical product development process
3
Explore conceptsIdentify problem
Step 1: Create concept
Step 2: Evaluate concept
The missing link
Create early product concepts and explore, evaluate, and refine
via customer research, and use the output to inform how the
solution should look like
Implement solution
• Identify problems based
on user and business
needs
• Work on a concrete
solution, such as design UI,
write content, coding, …
Concept exploration is the missing link
4
User needs
Product
User needs
Product
Without concept exploration:
misaligned
With concept exploration:
aligned
Concepting lets us explore, identify, and refine best product ideas
leading to final products that really meet user needs
How concept exploration impacts product success
5
1. Create concept
Ideate solutions and represent the
solutions as one or more early-
stage product concepts
2. Evaluate concept
Through user research, evaluate,
evolve, and refine the concepts,
which will then be used to guide the
implementation of the product
Two-step process of concept exploration
Step 1: Create concept
7
Ideate solutions Create conceptIdentify problems
• Analyze exiting
knowledge to identify
user and business
problems
• Ideate possible
solutions with team
members
• Describe how the
solutions work (user flows,
features, value
propositions)
High-level process to create a product concept
Step 1. Create concept -> Step 2. Evaluate concept
8
Who are the
target users?
What are the benefits
to the user?
In what scenario does the
user use the product?
What specific user pain
points does it solve?
What is the user
flow/experience like?
What are the
features/functionality?
Considerations going into a product concept
Step 1. Create concept -> Step 2. Evaluate concept
9
Focus on users, not ourselves
Be creative while keeping it practical
Leverage visual to describe concept
Think through the usage scenarios
Stay high level, leaving room for
exploration via user feedback
Create multiple competing concepts
Make sure to conceive the concept with addressing user problems in mind, as
opposed to simply reflecting things we, the product team, want to make
Push the envelope when thinking about the concept, while still keeping in mind it
should practically solve user problems
Use visual representation (e.g., storyboards, wireframes, montage of various
objects) to describe the concept so as to make it intuitive for you and users to
think through it
Describe the scenarios and overall steps in which the user is expected to use the
product
Only describe the core ideas and overall context, and leave room for exploration
with users during user feedback gathering (i.e., let them fill in the details around
how they expect to use this product, what’s missing, what’s confusing, …).
When possible, explore multiple alternative concepts representing distinct solution
approaches; and later leverage user research to evaluate and compare them to
figure out the best solution
Best practices
Step 1. Create concept -> Step 2. Evaluate concept
10
Here is a hypothetical concept of auto-
detecting email content to produce
calendar event
In this representation of the concept, we
stay high level to only describe the core
idea, and leave lots of details to be filled by
users during concept evaluation, such as:
• Use cases: What are some of the use
cases for which this concept would be
useful (e.g., create calendar invite from
work chat, from phone call, from text
message)
• Cross device uses: What are the
possible cross-device use cases (e.g.,
receive an email from phone and create
an invite on a computer)
• Expectation of the prompt: How and
when do users expect the prompt for
calendar invite show up
• Concerns: What are the concerns that
would prevent users from using it (e.g.,
privacy concern)
• …
A hypothetical example of product concept
Step 1. Create concept -> Step 2. Evaluate concept
Jason
sends email
11
Do focus on communicating the idea and the
context. You can use storyboard, wireframe,
illustration, and drawing to achieve this.
Visual presentation tip: focus on the idea, not the visual details
Step 1. Create concept -> Step 2. Evaluate concept
Don’t use very detailed and polished UI design,
which would focus people’s attention on the visual
aspect and distract them from thinking about the
underlying idea.
12
Illustration
Wireframe UI
Pictures
Visual presentation tip: Combine multiple approaches
Step 1. Create concept -> Step 2. Evaluate concept
Workflow
In this example concept, a phone app to research about college application, multiple visual
approaches (e.g., illustration and wireframe UI) were combined to tell the overall story as
well as communicate core user workflows
High-school
student uses
phone app
Step 2: Evaluate concept
14
Step 1. Create concept -> Step 2. Evaluate concept
Evaluate concept via user research
15
Success factors for concept evaluation
Step 1. Create concept -> Step 2. Evaluate concept
2. Signal
strength
3. Nuanced
use cases
1. Exploration
Great
insight! Understand exactly when
and why users will and will
not use the product (as
opposed to getting a
generic understanding)
Explore possible solutions
and understand users’
rationale (as opposed to
simply validate the
concept)
Obtain clear signals
that users really could
use the product (as
opposed to just pay
lip service)
16
Step 1. Create concept -> Step 2. Evaluate concept
Do explore, evolve, and refine ideas
Use the concept as a conversation starter,
meaning you only introduce the basic idea
and context, and then discuss with the user
in exploring, evolving, and refining product
ideas.
Don’t just validate the concept
We should not ask the user direct questions,
with the expectation of “Yes/No” answers to
whether they would use the product or not.
This would not let us improve on the concept
and help with uncovering additional ideas.
Success factor 1: Explore, not validate
17
Step 1. Create concept -> Step 2. Evaluate concept
Do deep dive into how they would use it
Ask deep questions such as the scenarios in
which they would expect to use the product,
key factors that would drive them to use it, and
key concerns that would prevent them from
using it.
This way we increase signal strength, in other
words, we can be confident that we get valid,
as opposed to misleading, insight.
Don’t just believe lip service of willing to use it
When being interviewed to give feedback on a
concept, users tend to play nice and tell you
that they are willing to use the product and
even that they are excited about it, but that
alone doesn’t imply they will would use it in real
life.
Success factor 2: Increase signal strength and avoid false conclusion
18
Step 1. Create concept -> Step 2. Evaluate concept
Do try to understand nuanced use cases
Dive deep into the use cases, alongside
motivations and circumstances, of how users
might use or not use the product – this kinds
of detailed and contextualized understanding
is critical in generating actionable insight
around product concepts.
Don’t make sweeping and generic conclusions
Avoid talking to users about use cases in a
generic, vague manner, which will lead to
making sweeping, misleading conclusions
around how users might use the product.
Success factor 3: Understand nuanced use cases
19
Step 1. Create concept -> Step 2. Evaluate concept
Conduct at least 2 iterations of user research to rapidly evolve
and re-evaluate concepts based on user feedback
Methodology advice: Use iterative approach to quickly evolve concept
Initial concepts
with crude ideas
Refined concepts
ready to implement
Iteration 1 Iteration 2 More iterations if needed
20
1. Gather baseline understanding
2. Let user ideate solution first
3. Present concept for feedback
4. Ask user to describe expected usage
5. Explore, not validate
6. Gather success factors and barriers
7. Prioritize ideas
Ask about the user’s current behaviors/experiences to establish foundational
understanding and help contextualize the user feedback you’ll gather later
Let the user describe pain points and ideate possible solutions accordingly first, for
spontaneous, unbiased thoughts
Then introduce concepts to the user, with reference to his/her current use cases,
behaviors, and pain points, for first impression and overall feedback
As deep dive, have the user describe – with reference to real life scenarios – how
he/she expects to use the new product (e.g., usage scenario, steps, expected benefits)
Co-build additional product ideas/details with the user, instead of just validating your
concept by getting “Yes/No” responses
Ask about key qualities that would let the user seriously consider using the product in
real life, and concerns that could prevent him/her from using it in real life
Let the user prioritize the features/qualities based on perceived value
Concrete steps of a concept evaluation session
Step 1. Create concept -> Step 2. Evaluate concept
21
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: Listen to, probe into, and build upon what user says
Let the user drive the conversation and position yourself as a just a facilitator of the
discussion to get the user to talk more. This includes being a good listener and gently
probing into and building upon what the user says (as opposed to directly asking
questions in a forceful, context-irrelevant manner).
22
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: Be deliberately vague for the user to fill the gap
Other than providing necessary context so that the user knows what you are talking
about, stay vague and be very open-ended in the way you present the concept and
ask questions.
For example, instead of asking “Please imagine you’re doing [insert task] with this
product – how would you do this?”, ask “Imagine [insert a scenario], and you’re
presented with this product. Please take some time to look around – I will give you 1-
2 minutes, and then please let me know your comments.”
23
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: Don’t directly answer user’s question – use it as opportunity to probe
Users often will ask you questions about how the concept works. Don’t directly
answer the question. Instead, use this as an opportunity to 1) understand why they
are confused, which would reveal some problems in your concept, and 2) let them
suggest possible answers, which would point to an improved concept
24
Step 1. Create concept -> Step 2. Evaluate concept
With concept evaluation, we intend to explore product ideas, and therefore we should
be conversational in the way we conduct the interview – as opposed to sound
scripted – to make it easy to get spontaneous feedback and creative suggestions
from the user.
User interview tips: Be conversational instead of scripted to get user to talk
25
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: “Tell me more …” to naturally probe into details
To encourage the user to provide more details while keeping the conversation
unbiased, you can simply say things like “that’s interesting… please tell me more”;
and if the user struggles to elaborate, you can give a gentle nudge by suggesting a
few ideas, like “for example, why you think this way, what is the scenario, things like
that”.
26
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: “With that in mind …” to anchor user to a context
In order to focus the user feedback on a particular topic, you can describe the
context and goals that that you want the user to keep in mind first, and then say
something like “… with that in mind, …” to anchor the user to the topic, while still
being neutral (as opposed to asking leading questions).
27
Step 1. Create concept -> Step 2. Evaluate concept
User interview tips: Always stay relevant to user’s background
Pay attention to what the user says about his/her real-life behaviors and experiences
– and later during the interview, try to reference back to that so that the discussion
stays grounded in the user’s real-life context (as opposed to an imagined context).
For example, you can say something like “I recall you mentioned you did [insert what
user said before] – with that in mind, any comments on this product?”
28
Background
Frank Guo, Ph.D., is a respected customer/user research
consultant based in San Francisco bay area, providing research
services through his consultancy, UX Strategized, to leading
tech companies since 2011.
Leveraging extensive experience, award-winning insight, and
unique approaches, Frank has helped many top companies
create products with compelling user experience and market
success:
About UX Strategized: Shape innovation strategy via user insight
Philosophy and specialties
1. Decision-focused user research
Focused on informing and shaping decisions via customer/user insight
2. Strategic impact, via lean research
Use iterative and fast-paced research process that works well with
agile development and tight timeline to inform strategic as well as
tactical decisions
3. Concept research to shape innovation
Leverage concept exploration as a cornerstone approach to
fundamentally shape product innovation
4. Full-cycle research to continuously inform decisions
Conduct research in supporting each stage of product cycle, from
foundational user insight research to launch-and-learn customer
feedback gathering, to continuously inform product decisions
29
Contact Frank to learn more: frank.guo@uxstrategized.com
www.uxstrategized.com
Visit our website for more customer insight

More Related Content

Similar to Concept Exploration: The Missing Link in Creating Great Products

UX design & redesign
UX design & redesignUX design & redesign
UX design & redesign
Shanshan Ma
 
DESIGN PROCESS-is the foundation on which any product is designed
DESIGN PROCESS-is the foundation on which any product is designedDESIGN PROCESS-is the foundation on which any product is designed
DESIGN PROCESS-is the foundation on which any product is designed
lekshmy5
 

Similar to Concept Exploration: The Missing Link in Creating Great Products (20)

Product Discovery Canvas
Product Discovery CanvasProduct Discovery Canvas
Product Discovery Canvas
 
week-11-PROTOTYPE.pptx
week-11-PROTOTYPE.pptxweek-11-PROTOTYPE.pptx
week-11-PROTOTYPE.pptx
 
Owning the product by owning the user experience
Owning the product by owning the user experienceOwning the product by owning the user experience
Owning the product by owning the user experience
 
Design thinking for a startup - Imaginea Design
Design thinking for a startup - Imaginea DesignDesign thinking for a startup - Imaginea Design
Design thinking for a startup - Imaginea Design
 
Design thinking for a startup imaginea design
Design thinking for a startup   imaginea designDesign thinking for a startup   imaginea design
Design thinking for a startup imaginea design
 
Design Thinking for Managers - Presentation
Design Thinking for Managers - PresentationDesign Thinking for Managers - Presentation
Design Thinking for Managers - Presentation
 
Best Practices for Early Stage Product Development
Best Practices for Early Stage Product DevelopmentBest Practices for Early Stage Product Development
Best Practices for Early Stage Product Development
 
UX design & redesign
UX design & redesignUX design & redesign
UX design & redesign
 
Lean UX
Lean UXLean UX
Lean UX
 
Lean Innovation for Micro Enterprises Module 4 Design Thinking
Lean Innovation for Micro Enterprises Module 4  Design ThinkingLean Innovation for Micro Enterprises Module 4  Design Thinking
Lean Innovation for Micro Enterprises Module 4 Design Thinking
 
Things you should know before you build your site
Things you should know before you build your siteThings you should know before you build your site
Things you should know before you build your site
 
Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...
 
DESIGN PROCESS-is the foundation on which any product is designed
DESIGN PROCESS-is the foundation on which any product is designedDESIGN PROCESS-is the foundation on which any product is designed
DESIGN PROCESS-is the foundation on which any product is designed
 
Prototyping and MVPs for startups
Prototyping and MVPs for startupsPrototyping and MVPs for startups
Prototyping and MVPs for startups
 
UX Design Tactics for Product Managers
UX Design Tactics for Product ManagersUX Design Tactics for Product Managers
UX Design Tactics for Product Managers
 
Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...
 
Lavanya Raja Presentation
Lavanya Raja PresentationLavanya Raja Presentation
Lavanya Raja Presentation
 
From an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startupsFrom an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startups
 
Agile methodology - Humanity
Agile methodology  - HumanityAgile methodology  - Humanity
Agile methodology - Humanity
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
 

Recently uploaded

Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 

Recently uploaded (20)

Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
Designing for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesDesigning for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web Services
 
AI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in Michelangelo
 
Using IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New ZealandUsing IESVE for Room Loads Analysis - Australia & New Zealand
Using IESVE for Room Loads Analysis - Australia & New Zealand
 
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAGAI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdf
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
 
Studiovity film pre-production and screenwriting software
Studiovity film pre-production and screenwriting softwareStudiovity film pre-production and screenwriting software
Studiovity film pre-production and screenwriting software
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 

Concept Exploration: The Missing Link in Creating Great Products

  • 1. Concept Exploration: The Missing Link in Creating Great Products Frank Guo, PhD Principal, UX Strategized frank.guo@uxstrategized.com
  • 2. 2 How do you know you’re really working on the right solution? Jumps directly to Identify problem Implement solution • Identify problems based on user and business needs • Implement a concrete solution, such as designing UI, coding, … Typical product development process
  • 3. 3 Explore conceptsIdentify problem Step 1: Create concept Step 2: Evaluate concept The missing link Create early product concepts and explore, evaluate, and refine via customer research, and use the output to inform how the solution should look like Implement solution • Identify problems based on user and business needs • Work on a concrete solution, such as design UI, write content, coding, … Concept exploration is the missing link
  • 4. 4 User needs Product User needs Product Without concept exploration: misaligned With concept exploration: aligned Concepting lets us explore, identify, and refine best product ideas leading to final products that really meet user needs How concept exploration impacts product success
  • 5. 5 1. Create concept Ideate solutions and represent the solutions as one or more early- stage product concepts 2. Evaluate concept Through user research, evaluate, evolve, and refine the concepts, which will then be used to guide the implementation of the product Two-step process of concept exploration
  • 6. Step 1: Create concept
  • 7. 7 Ideate solutions Create conceptIdentify problems • Analyze exiting knowledge to identify user and business problems • Ideate possible solutions with team members • Describe how the solutions work (user flows, features, value propositions) High-level process to create a product concept Step 1. Create concept -> Step 2. Evaluate concept
  • 8. 8 Who are the target users? What are the benefits to the user? In what scenario does the user use the product? What specific user pain points does it solve? What is the user flow/experience like? What are the features/functionality? Considerations going into a product concept Step 1. Create concept -> Step 2. Evaluate concept
  • 9. 9 Focus on users, not ourselves Be creative while keeping it practical Leverage visual to describe concept Think through the usage scenarios Stay high level, leaving room for exploration via user feedback Create multiple competing concepts Make sure to conceive the concept with addressing user problems in mind, as opposed to simply reflecting things we, the product team, want to make Push the envelope when thinking about the concept, while still keeping in mind it should practically solve user problems Use visual representation (e.g., storyboards, wireframes, montage of various objects) to describe the concept so as to make it intuitive for you and users to think through it Describe the scenarios and overall steps in which the user is expected to use the product Only describe the core ideas and overall context, and leave room for exploration with users during user feedback gathering (i.e., let them fill in the details around how they expect to use this product, what’s missing, what’s confusing, …). When possible, explore multiple alternative concepts representing distinct solution approaches; and later leverage user research to evaluate and compare them to figure out the best solution Best practices Step 1. Create concept -> Step 2. Evaluate concept
  • 10. 10 Here is a hypothetical concept of auto- detecting email content to produce calendar event In this representation of the concept, we stay high level to only describe the core idea, and leave lots of details to be filled by users during concept evaluation, such as: • Use cases: What are some of the use cases for which this concept would be useful (e.g., create calendar invite from work chat, from phone call, from text message) • Cross device uses: What are the possible cross-device use cases (e.g., receive an email from phone and create an invite on a computer) • Expectation of the prompt: How and when do users expect the prompt for calendar invite show up • Concerns: What are the concerns that would prevent users from using it (e.g., privacy concern) • … A hypothetical example of product concept Step 1. Create concept -> Step 2. Evaluate concept Jason sends email
  • 11. 11 Do focus on communicating the idea and the context. You can use storyboard, wireframe, illustration, and drawing to achieve this. Visual presentation tip: focus on the idea, not the visual details Step 1. Create concept -> Step 2. Evaluate concept Don’t use very detailed and polished UI design, which would focus people’s attention on the visual aspect and distract them from thinking about the underlying idea.
  • 12. 12 Illustration Wireframe UI Pictures Visual presentation tip: Combine multiple approaches Step 1. Create concept -> Step 2. Evaluate concept Workflow In this example concept, a phone app to research about college application, multiple visual approaches (e.g., illustration and wireframe UI) were combined to tell the overall story as well as communicate core user workflows High-school student uses phone app
  • 13. Step 2: Evaluate concept
  • 14. 14 Step 1. Create concept -> Step 2. Evaluate concept Evaluate concept via user research
  • 15. 15 Success factors for concept evaluation Step 1. Create concept -> Step 2. Evaluate concept 2. Signal strength 3. Nuanced use cases 1. Exploration Great insight! Understand exactly when and why users will and will not use the product (as opposed to getting a generic understanding) Explore possible solutions and understand users’ rationale (as opposed to simply validate the concept) Obtain clear signals that users really could use the product (as opposed to just pay lip service)
  • 16. 16 Step 1. Create concept -> Step 2. Evaluate concept Do explore, evolve, and refine ideas Use the concept as a conversation starter, meaning you only introduce the basic idea and context, and then discuss with the user in exploring, evolving, and refining product ideas. Don’t just validate the concept We should not ask the user direct questions, with the expectation of “Yes/No” answers to whether they would use the product or not. This would not let us improve on the concept and help with uncovering additional ideas. Success factor 1: Explore, not validate
  • 17. 17 Step 1. Create concept -> Step 2. Evaluate concept Do deep dive into how they would use it Ask deep questions such as the scenarios in which they would expect to use the product, key factors that would drive them to use it, and key concerns that would prevent them from using it. This way we increase signal strength, in other words, we can be confident that we get valid, as opposed to misleading, insight. Don’t just believe lip service of willing to use it When being interviewed to give feedback on a concept, users tend to play nice and tell you that they are willing to use the product and even that they are excited about it, but that alone doesn’t imply they will would use it in real life. Success factor 2: Increase signal strength and avoid false conclusion
  • 18. 18 Step 1. Create concept -> Step 2. Evaluate concept Do try to understand nuanced use cases Dive deep into the use cases, alongside motivations and circumstances, of how users might use or not use the product – this kinds of detailed and contextualized understanding is critical in generating actionable insight around product concepts. Don’t make sweeping and generic conclusions Avoid talking to users about use cases in a generic, vague manner, which will lead to making sweeping, misleading conclusions around how users might use the product. Success factor 3: Understand nuanced use cases
  • 19. 19 Step 1. Create concept -> Step 2. Evaluate concept Conduct at least 2 iterations of user research to rapidly evolve and re-evaluate concepts based on user feedback Methodology advice: Use iterative approach to quickly evolve concept Initial concepts with crude ideas Refined concepts ready to implement Iteration 1 Iteration 2 More iterations if needed
  • 20. 20 1. Gather baseline understanding 2. Let user ideate solution first 3. Present concept for feedback 4. Ask user to describe expected usage 5. Explore, not validate 6. Gather success factors and barriers 7. Prioritize ideas Ask about the user’s current behaviors/experiences to establish foundational understanding and help contextualize the user feedback you’ll gather later Let the user describe pain points and ideate possible solutions accordingly first, for spontaneous, unbiased thoughts Then introduce concepts to the user, with reference to his/her current use cases, behaviors, and pain points, for first impression and overall feedback As deep dive, have the user describe – with reference to real life scenarios – how he/she expects to use the new product (e.g., usage scenario, steps, expected benefits) Co-build additional product ideas/details with the user, instead of just validating your concept by getting “Yes/No” responses Ask about key qualities that would let the user seriously consider using the product in real life, and concerns that could prevent him/her from using it in real life Let the user prioritize the features/qualities based on perceived value Concrete steps of a concept evaluation session Step 1. Create concept -> Step 2. Evaluate concept
  • 21. 21 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: Listen to, probe into, and build upon what user says Let the user drive the conversation and position yourself as a just a facilitator of the discussion to get the user to talk more. This includes being a good listener and gently probing into and building upon what the user says (as opposed to directly asking questions in a forceful, context-irrelevant manner).
  • 22. 22 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: Be deliberately vague for the user to fill the gap Other than providing necessary context so that the user knows what you are talking about, stay vague and be very open-ended in the way you present the concept and ask questions. For example, instead of asking “Please imagine you’re doing [insert task] with this product – how would you do this?”, ask “Imagine [insert a scenario], and you’re presented with this product. Please take some time to look around – I will give you 1- 2 minutes, and then please let me know your comments.”
  • 23. 23 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: Don’t directly answer user’s question – use it as opportunity to probe Users often will ask you questions about how the concept works. Don’t directly answer the question. Instead, use this as an opportunity to 1) understand why they are confused, which would reveal some problems in your concept, and 2) let them suggest possible answers, which would point to an improved concept
  • 24. 24 Step 1. Create concept -> Step 2. Evaluate concept With concept evaluation, we intend to explore product ideas, and therefore we should be conversational in the way we conduct the interview – as opposed to sound scripted – to make it easy to get spontaneous feedback and creative suggestions from the user. User interview tips: Be conversational instead of scripted to get user to talk
  • 25. 25 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: “Tell me more …” to naturally probe into details To encourage the user to provide more details while keeping the conversation unbiased, you can simply say things like “that’s interesting… please tell me more”; and if the user struggles to elaborate, you can give a gentle nudge by suggesting a few ideas, like “for example, why you think this way, what is the scenario, things like that”.
  • 26. 26 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: “With that in mind …” to anchor user to a context In order to focus the user feedback on a particular topic, you can describe the context and goals that that you want the user to keep in mind first, and then say something like “… with that in mind, …” to anchor the user to the topic, while still being neutral (as opposed to asking leading questions).
  • 27. 27 Step 1. Create concept -> Step 2. Evaluate concept User interview tips: Always stay relevant to user’s background Pay attention to what the user says about his/her real-life behaviors and experiences – and later during the interview, try to reference back to that so that the discussion stays grounded in the user’s real-life context (as opposed to an imagined context). For example, you can say something like “I recall you mentioned you did [insert what user said before] – with that in mind, any comments on this product?”
  • 28. 28 Background Frank Guo, Ph.D., is a respected customer/user research consultant based in San Francisco bay area, providing research services through his consultancy, UX Strategized, to leading tech companies since 2011. Leveraging extensive experience, award-winning insight, and unique approaches, Frank has helped many top companies create products with compelling user experience and market success: About UX Strategized: Shape innovation strategy via user insight Philosophy and specialties 1. Decision-focused user research Focused on informing and shaping decisions via customer/user insight 2. Strategic impact, via lean research Use iterative and fast-paced research process that works well with agile development and tight timeline to inform strategic as well as tactical decisions 3. Concept research to shape innovation Leverage concept exploration as a cornerstone approach to fundamentally shape product innovation 4. Full-cycle research to continuously inform decisions Conduct research in supporting each stage of product cycle, from foundational user insight research to launch-and-learn customer feedback gathering, to continuously inform product decisions
  • 29. 29 Contact Frank to learn more: frank.guo@uxstrategized.com www.uxstrategized.com Visit our website for more customer insight