SlideShare a Scribd company logo
First steps towards an online user experience testing community Giel de Nijs October 22, 2008
Designed around you Reforming our product concept creation to gain a competitive edge.
User-centered innovation Involve the user of the products in all stages of development.
User-centered innovation cycle User insight Concept Confrontation Mock-up Prototype User testing User testing Iterative user testing in all stages of development.
Experience Labs Traditional user testing in the HomeLab and ShopLab.
Contextual inquiry Different levels of knowledge about experience are accessed by different techniques. (Sleeswijk Visser, et al., 2003) An interactive, creative way to stimulate users to share their thoughts.
Online concept confrontation Presenting pictures, videos and user-interface mock-ups for feedback.
Online testing vs. laboratory testing No significant differences were found in initial testing.
Combining implicit and explicit feedback Questionnaires (explicit feedback) More valuable information? Usage logging (implicit feedback)
Benefits of online user testing Provide user insights Validate new concepts Quick Cost effective Diverse demographic No geographical boundaries
The Big Question “ What’s in it for me?”
Usage lifecycle Source: Joshua Porter
Wisdom of the crowds http://flickr.com/photos/jamescridland/613445810
Intrinsic motivation People want to voice their opinion People want to connect with people People want to help other people
The third place An online community is the online equivalent of a local bar. http://flickr.com/photos/gaetanlee/2788513635/
Community vicious circle More content More members More members More content Match content and members to member profiles More members More content Easier transactions More members
Providing statistics motivates Rankings make most people want to participate. http://flickr.com/photos/richardwinchell/2863431314/
Brainstorming community Combining contextual inquiry with community interactivity.
Organizational ingredients Internal leverage Money Good plan Good strategy Good people
Technical ingredients Private testing Public beta Interesting content Target audience Interactivity
The mullet model Business up front, party in the back. http://flickr.com/photos/raveller/950197716/
A good community (simplified) Attract members Keep members Established business channels Existing communities Interesting idea Correct target audience Active maintenance Frequent updates Reputation measurements Interactivity
Social framework vs. market framework Be careful with incentives. http://flickr.com/photos/sis/432090557
Act on ideas http://flickr.com/photos/skenmy/2343003769/
 
Drawbacks of traditional user testing
Internal use with closed user group
Motivations to contribute Content Comments Statistics Inspires own content Provokes discussion Motivates contribution Providing rankings makes most people want to participate.

More Related Content

Similar to First Steps Towards An Online User Experience Testing Community

Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
 
Global Redirective Practices
Global Redirective PracticesGlobal Redirective Practices
Global Redirective Practicesadjwilli
 
Global Redirective Practices: an online workshop for a client
Global Redirective Practices: an online workshop for a clientGlobal Redirective Practices: an online workshop for a client
Global Redirective Practices: an online workshop for a clientSean Connolly
 
Global Redirective Practices
Global Redirective PracticesGlobal Redirective Practices
Global Redirective PracticesKshitiz Anand
 
Social metadata for libraries, archives and museums: Research findings from t...
Social metadata for libraries, archives and museums: Research findings from t...Social metadata for libraries, archives and museums: Research findings from t...
Social metadata for libraries, archives and museums: Research findings from t...Rose Holley
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative ResearchLatitude Insights
 
What Gives Life to our Community
What Gives Life to our CommunityWhat Gives Life to our Community
What Gives Life to our CommunityGeorge Roberts
 
What Is Social Media
What Is Social MediaWhat Is Social Media
What Is Social MediaJason Peck
 
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...Jennifer Koerber
 
Tools and Tactics for Engaging Your Supporters with Social Media
Tools and Tactics for Engaging Your Supporters with Social MediaTools and Tactics for Engaging Your Supporters with Social Media
Tools and Tactics for Engaging Your Supporters with Social MediaNedra Kline Weinreich
 
Using the Web for Global Giving and Activism
Using the Web for Global Giving and ActivismUsing the Web for Global Giving and Activism
Using the Web for Global Giving and ActivismSee3 Communications
 
Educational Technology YWC
Educational Technology YWCEducational Technology YWC
Educational Technology YWCHeidi Dusek
 
Social Media Tools and Mobile Apps for Research and Publishing
Social Media Tools and Mobile Apps for Research and PublishingSocial Media Tools and Mobile Apps for Research and Publishing
Social Media Tools and Mobile Apps for Research and PublishingCheryl Peltier-Davis
 
Better, Faster, Stronger: How nonprofits can better engage their members and ...
Better, Faster, Stronger: How nonprofits can better engage their members and ...Better, Faster, Stronger: How nonprofits can better engage their members and ...
Better, Faster, Stronger: How nonprofits can better engage their members and ...abraun3
 
Getting Started with Enterprise Social Networking
Getting Started with Enterprise Social NetworkingGetting Started with Enterprise Social Networking
Getting Started with Enterprise Social NetworkingDavid Stephens
 
Facilitating Online Interaction 4 Learning Resource Slides
Facilitating Online Interaction 4 Learning Resource SlidesFacilitating Online Interaction 4 Learning Resource Slides
Facilitating Online Interaction 4 Learning Resource SlidesNancy Wright White
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008guest63c15b
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Patañjali Chary
 

Similar to First Steps Towards An Online User Experience Testing Community (20)

Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
Global Redirective Practices
Global Redirective PracticesGlobal Redirective Practices
Global Redirective Practices
 
Global Redirective Practices: an online workshop for a client
Global Redirective Practices: an online workshop for a clientGlobal Redirective Practices: an online workshop for a client
Global Redirective Practices: an online workshop for a client
 
Global Redirective Practices
Global Redirective PracticesGlobal Redirective Practices
Global Redirective Practices
 
Social metadata for libraries, archives and museums: Research findings from t...
Social metadata for libraries, archives and museums: Research findings from t...Social metadata for libraries, archives and museums: Research findings from t...
Social metadata for libraries, archives and museums: Research findings from t...
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative Research
 
What Gives Life to our Community
What Gives Life to our CommunityWhat Gives Life to our Community
What Gives Life to our Community
 
Flickr youtube
Flickr youtubeFlickr youtube
Flickr youtube
 
What Is Social Media
What Is Social MediaWhat Is Social Media
What Is Social Media
 
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...
Teach Them Where They Are: "Learning for Life Online" at the Boston Public Li...
 
Tools and Tactics for Engaging Your Supporters with Social Media
Tools and Tactics for Engaging Your Supporters with Social MediaTools and Tactics for Engaging Your Supporters with Social Media
Tools and Tactics for Engaging Your Supporters with Social Media
 
Using the Web for Global Giving and Activism
Using the Web for Global Giving and ActivismUsing the Web for Global Giving and Activism
Using the Web for Global Giving and Activism
 
Educational Technology YWC
Educational Technology YWCEducational Technology YWC
Educational Technology YWC
 
Social Media Tools and Mobile Apps for Research and Publishing
Social Media Tools and Mobile Apps for Research and PublishingSocial Media Tools and Mobile Apps for Research and Publishing
Social Media Tools and Mobile Apps for Research and Publishing
 
Better, Faster, Stronger: How nonprofits can better engage their members and ...
Better, Faster, Stronger: How nonprofits can better engage their members and ...Better, Faster, Stronger: How nonprofits can better engage their members and ...
Better, Faster, Stronger: How nonprofits can better engage their members and ...
 
Getting Started with Enterprise Social Networking
Getting Started with Enterprise Social NetworkingGetting Started with Enterprise Social Networking
Getting Started with Enterprise Social Networking
 
Facilitating Online Interaction 4 Learning Resource Slides
Facilitating Online Interaction 4 Learning Resource SlidesFacilitating Online Interaction 4 Learning Resource Slides
Facilitating Online Interaction 4 Learning Resource Slides
 
ORBIT | Consumer Engagement in Research: Lessons Learned From Three RCTs
ORBIT | Consumer Engagement in Research: Lessons Learned From Three RCTsORBIT | Consumer Engagement in Research: Lessons Learned From Three RCTs
ORBIT | Consumer Engagement in Research: Lessons Learned From Three RCTs
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
 

Recently uploaded

"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekCzechDreamin
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfChristopherTHyatt
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxAbida Shariff
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsExpeed Software
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsPaul Groth
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Alison B. Lowndes
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Thierry Lestable
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Julian Hyde
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀DianaGray10
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...Product School
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Product School
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIES VE
 

Recently uploaded (20)

"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdf
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 

First Steps Towards An Online User Experience Testing Community