Are you the sole User Experience Researcher in your organization? Do you struggle to get timely research insights and feedback for your stakeholders? Online research tools offer practitioners the ability to gather feedback quickly and asynchronously, without the need for direct facilitation or moderation.
In this presentation, we provide an overview of some of the many online research tools that are available for gathering quick, asynchronous feedback on requirements, designs, and stakeholder sentiment. We offer general guidelines for recruiting, planning, implementing, and analyzing feedback, and then present how to use specific methods that have proven particularly useful for design and requirements research.
UserTesting 2016 webinar: Research to inform product design in Agile environm...Steve Fadden
Designing in agile environments demands many decisions be made in short periods of time. Informing these decisions with formative research enhances our understanding what we’re building, from the viability of concepts, to the effectiveness of designs, to the ultimate success of our solutions.
Design to improve, empower, and fulfill (UX India 2017 keynote)Steve Fadden
Designers have incredible powers - from understanding diverse stakeholder needs, exploring new ways to solve problems, and implementing solutions to help people accomplish their goals like never before. But with these powers come great responsibilities, and we should go further than solving business problems, improving product usability, and increasing user satisfaction. We need to consider the larger contexts in which we design, and ensure that our work is effective for audiences we can’t immediately discern. By enabling people to achieve success without sacrificing their abilities, designers can better improve, empower, and fulfill.
Rethinking our future: Trends and opportunities in UXSteve Fadden
Over the years, the field of User Experience (UX) has grown in popularity. In many organizations, UX practitioners are in demand, and have been elevated from a role of advocating for usable products, to leading and owning the process for engaging and delighting users. Savvy organizations even look for ways to ensure their offerings are meeting the emotional needs and expectations of customers.
However, the field of UX is also experiencing growing pains: some companies have so many design and experience owners that it’s hard to identify what represents the actual “voice of the user,” and others have become so focused on UX-related metrics that they strive to serve the “one metric to rule them all,” losing sight of other data and indicators that yield better insights.
This presentation will explore these and related themes, with a goal of rethinking the future of UX in a more intentional and value-oriented manner.
User Experience Design + Agile: The Good, The Bad, and the UglyJoshua Randall
There's a rumor going around that user experience design (UXD) and Agile don't play well together. In this talk, I'll explain that they do -- most of the time! Learn about the historical reasons for why these two disciplines sometimes butt heads, as well as the good/bad/ugly of various approaches to integrating design and development.
These set of slides will explain the importance of maintaining the user friendly features of any website. It contains statistics gathered from researches that have been already conducted and stats collected over the internet to quantitatively prove the importance of the aforementioned title.
UserTesting 2016 webinar: Research to inform product design in Agile environm...Steve Fadden
Designing in agile environments demands many decisions be made in short periods of time. Informing these decisions with formative research enhances our understanding what we’re building, from the viability of concepts, to the effectiveness of designs, to the ultimate success of our solutions.
Design to improve, empower, and fulfill (UX India 2017 keynote)Steve Fadden
Designers have incredible powers - from understanding diverse stakeholder needs, exploring new ways to solve problems, and implementing solutions to help people accomplish their goals like never before. But with these powers come great responsibilities, and we should go further than solving business problems, improving product usability, and increasing user satisfaction. We need to consider the larger contexts in which we design, and ensure that our work is effective for audiences we can’t immediately discern. By enabling people to achieve success without sacrificing their abilities, designers can better improve, empower, and fulfill.
Rethinking our future: Trends and opportunities in UXSteve Fadden
Over the years, the field of User Experience (UX) has grown in popularity. In many organizations, UX practitioners are in demand, and have been elevated from a role of advocating for usable products, to leading and owning the process for engaging and delighting users. Savvy organizations even look for ways to ensure their offerings are meeting the emotional needs and expectations of customers.
However, the field of UX is also experiencing growing pains: some companies have so many design and experience owners that it’s hard to identify what represents the actual “voice of the user,” and others have become so focused on UX-related metrics that they strive to serve the “one metric to rule them all,” losing sight of other data and indicators that yield better insights.
This presentation will explore these and related themes, with a goal of rethinking the future of UX in a more intentional and value-oriented manner.
User Experience Design + Agile: The Good, The Bad, and the UglyJoshua Randall
There's a rumor going around that user experience design (UXD) and Agile don't play well together. In this talk, I'll explain that they do -- most of the time! Learn about the historical reasons for why these two disciplines sometimes butt heads, as well as the good/bad/ugly of various approaches to integrating design and development.
These set of slides will explain the importance of maintaining the user friendly features of any website. It contains statistics gathered from researches that have been already conducted and stats collected over the internet to quantitatively prove the importance of the aforementioned title.
Usability and User Experience Training Seminarlabecvar
This presentation describes a day-long seminar for giving participants an overview of best practices in usability design and research. Also included are several hand-on exercises to be done throughout the day to solidify participants' understanding of course concepts.
Build The Right Thing With The RITE Method | Rapid Usability TestingKyle Soucy
How can you test your designs faster and more cheaply?
How do you gain valuable user experience insights from one test subject?
To answer these questions and more, CTUXPA is proud to introduce Kyle Soucy from Usable Interface, who will take us through what's involved in rapid turnaround testing (aka RITE—Rapid Iterative Testing & Evaluation).
You’ll learn:
how to utilize RITE to test quickly and cheaply
how to evaluate your test results to iterate to your next solution
how to conduct a through observer debrief and report findings quickly
Learn how to see beyond typical agile user stories that annoy instead of inspire when building the “unknown”. Pave the way forward for your team by writing design stories that break down a complex problem into “tiny pulses” that when put together make up a complex system. Apply “Design Thinking” to not lose sight of the big picture and avoid leading your team down the wrong path of development and stifle innovation. See how thought leaders in Lean startup and Experience design are already re-evaluating their methods when measuring complexities of a system.
Most importantly see how design stories can be the uniting factor for cross-functional teams: everyone “owns” the design, inspires developers to tackle complex and feature rich digital products with selective planning and architecture that include UI patterns, Lean methods, and promotes holistic thinking that makes everyone more effective and efficient in their work.
Whoa! Did You See That? Collaborative Data Collection and AnalysisKyle Soucy
Observing a usability test is like witnessing an accident; everyone sees it go down differently. One of the most important steps in usability testing, and yet often skipped by a lot of firms, is conducting a thorough debrief with the observers after testing is complete. Research should not be performed while working in a vacuum. The data and feedback collected from end users is not complete without understanding the observers’ perspectives, which oftentimes is different from the moderator's. The process for running an observer debrief involves getting all the observers (and even people who did not observe, but should have) to attend a meeting where we review the notes for each test and document the observations and perceived implications. In this session, you will learn various methods for running a debrief, when to use them, and walk away better prepared to get the most out of your research!
After attending this practical session, attendees will be able to take what they have learned and execute a thorough debrief the next day. I will discuss various methods for running a debrief, spending more time on one method in particular, the Wish for/how-to/what-if method. For those that are not familiar, this method is executed by asking observers to create implications for each observation in the form of: Wish for... (W4) How to... (H2) What if... (Wif). The benefit being that stakeholders do not focus on actual solutions at this time, but instead open the discussion up for more out of the box thinking.
What attendees will learn:
- The importance of running a debrief
- How to run a debrief (various options)
- How to keep observers engaged during testing
- Understanding the difference between observation, inference, opinion, and a recommendation
- Pitfalls to avoid
Who will benefit from the presentation and why:
Anyone who moderates usability tests or research studies will benefit greatly from this session. They will learn how to distill the key findings from the observers and keep them engaged throughout the testing process.
Do you have to be an actual designer, a creative type of person, to be good at the UX design process? Essentially, everyone who has any influence over the design is, in part, a designer. In this talk, you will learn how the world needs more UX superheroes within an organization and that ALL team members are an intrinsic part of the UX design process. I'll give an overview of the User Experience Design Process that involves shaping the product and getting it right from the beginning while touching on essential UX methods such as user research and field study techniques, personas, card sorting, brainstorming with sketches, wireframes, interactive prototypes, and testing.
Putting Personas to Work at IIBA ClevelandCarol Smith
Putting Personas to Work: Getting Personas Adopted Throughout Your Organization.
Presented by Carol Smith at the Cleveland IIBA Chapter meeting on March 12, 2013.
Personas need to be recognized and relied on by the entire team and creating a successful persona program can be a huge challenge. This session covers strategies for making sure that the personas you create become essential to your team.
Includes the definition, value, usage and history of heuristics as well as 10 principles with starter questions for use in an evaluation. (As presented most recently at Interaction 12 in Dublin)
Going from Here to There: Transitioning into a UX Careerdpanarelli
A lot of people are curious about transitioning into the field of User Experience Design (UX). In this talk, I talk about a few different ways that you can transition into a UX career, be it grad school, night classes, or the ol' school of hard knocks, backed up by case studies. This talk was given at NoVA UX Meetup in the offices of AddThis, hosted by organizer Jim Lane.
Coaching teams in creative problem solvingFlowa Oy
Agile has helped teams to collaborate and organize work better. That’s great. Better teamwork and better understanding of the work definitely helps a team to do right things. Agile has also lead the way toward technical practices such as Continuous Integration and Delivery, Test Driven Development and SOLID-architecture principles. Great, these things definitely help the team to do things right.
Then again, most of the time in software projects goes into problem solving and similar creative acts. Agile has relatively little to give on these areas. Currently, agile is not about creativity nor is it about problem solving.
This coaching circle session will focus on the creative core of software development: solving creatively novel, original and broad problems more effectively all the time. I will introduce some principles and tools I’ve found useful when helping people to solve hard problems and to find creative solutions.
You don’t need a big budget, weeks of time or special labs to get user insights quickly and inexpensively. We’ll discuss how you can meet your goals, improve your products and make informed decisions through user research. Usability testing (remote & in-person), interviews, surveys and analytics are a few methods we’ll review, particularly in the context of your own business challenges and user questions.
Usability and User Experience Training Seminarlabecvar
This presentation describes a day-long seminar for giving participants an overview of best practices in usability design and research. Also included are several hand-on exercises to be done throughout the day to solidify participants' understanding of course concepts.
Build The Right Thing With The RITE Method | Rapid Usability TestingKyle Soucy
How can you test your designs faster and more cheaply?
How do you gain valuable user experience insights from one test subject?
To answer these questions and more, CTUXPA is proud to introduce Kyle Soucy from Usable Interface, who will take us through what's involved in rapid turnaround testing (aka RITE—Rapid Iterative Testing & Evaluation).
You’ll learn:
how to utilize RITE to test quickly and cheaply
how to evaluate your test results to iterate to your next solution
how to conduct a through observer debrief and report findings quickly
Learn how to see beyond typical agile user stories that annoy instead of inspire when building the “unknown”. Pave the way forward for your team by writing design stories that break down a complex problem into “tiny pulses” that when put together make up a complex system. Apply “Design Thinking” to not lose sight of the big picture and avoid leading your team down the wrong path of development and stifle innovation. See how thought leaders in Lean startup and Experience design are already re-evaluating their methods when measuring complexities of a system.
Most importantly see how design stories can be the uniting factor for cross-functional teams: everyone “owns” the design, inspires developers to tackle complex and feature rich digital products with selective planning and architecture that include UI patterns, Lean methods, and promotes holistic thinking that makes everyone more effective and efficient in their work.
Whoa! Did You See That? Collaborative Data Collection and AnalysisKyle Soucy
Observing a usability test is like witnessing an accident; everyone sees it go down differently. One of the most important steps in usability testing, and yet often skipped by a lot of firms, is conducting a thorough debrief with the observers after testing is complete. Research should not be performed while working in a vacuum. The data and feedback collected from end users is not complete without understanding the observers’ perspectives, which oftentimes is different from the moderator's. The process for running an observer debrief involves getting all the observers (and even people who did not observe, but should have) to attend a meeting where we review the notes for each test and document the observations and perceived implications. In this session, you will learn various methods for running a debrief, when to use them, and walk away better prepared to get the most out of your research!
After attending this practical session, attendees will be able to take what they have learned and execute a thorough debrief the next day. I will discuss various methods for running a debrief, spending more time on one method in particular, the Wish for/how-to/what-if method. For those that are not familiar, this method is executed by asking observers to create implications for each observation in the form of: Wish for... (W4) How to... (H2) What if... (Wif). The benefit being that stakeholders do not focus on actual solutions at this time, but instead open the discussion up for more out of the box thinking.
What attendees will learn:
- The importance of running a debrief
- How to run a debrief (various options)
- How to keep observers engaged during testing
- Understanding the difference between observation, inference, opinion, and a recommendation
- Pitfalls to avoid
Who will benefit from the presentation and why:
Anyone who moderates usability tests or research studies will benefit greatly from this session. They will learn how to distill the key findings from the observers and keep them engaged throughout the testing process.
Do you have to be an actual designer, a creative type of person, to be good at the UX design process? Essentially, everyone who has any influence over the design is, in part, a designer. In this talk, you will learn how the world needs more UX superheroes within an organization and that ALL team members are an intrinsic part of the UX design process. I'll give an overview of the User Experience Design Process that involves shaping the product and getting it right from the beginning while touching on essential UX methods such as user research and field study techniques, personas, card sorting, brainstorming with sketches, wireframes, interactive prototypes, and testing.
Putting Personas to Work at IIBA ClevelandCarol Smith
Putting Personas to Work: Getting Personas Adopted Throughout Your Organization.
Presented by Carol Smith at the Cleveland IIBA Chapter meeting on March 12, 2013.
Personas need to be recognized and relied on by the entire team and creating a successful persona program can be a huge challenge. This session covers strategies for making sure that the personas you create become essential to your team.
Includes the definition, value, usage and history of heuristics as well as 10 principles with starter questions for use in an evaluation. (As presented most recently at Interaction 12 in Dublin)
Going from Here to There: Transitioning into a UX Careerdpanarelli
A lot of people are curious about transitioning into the field of User Experience Design (UX). In this talk, I talk about a few different ways that you can transition into a UX career, be it grad school, night classes, or the ol' school of hard knocks, backed up by case studies. This talk was given at NoVA UX Meetup in the offices of AddThis, hosted by organizer Jim Lane.
Coaching teams in creative problem solvingFlowa Oy
Agile has helped teams to collaborate and organize work better. That’s great. Better teamwork and better understanding of the work definitely helps a team to do right things. Agile has also lead the way toward technical practices such as Continuous Integration and Delivery, Test Driven Development and SOLID-architecture principles. Great, these things definitely help the team to do things right.
Then again, most of the time in software projects goes into problem solving and similar creative acts. Agile has relatively little to give on these areas. Currently, agile is not about creativity nor is it about problem solving.
This coaching circle session will focus on the creative core of software development: solving creatively novel, original and broad problems more effectively all the time. I will introduce some principles and tools I’ve found useful when helping people to solve hard problems and to find creative solutions.
You don’t need a big budget, weeks of time or special labs to get user insights quickly and inexpensively. We’ll discuss how you can meet your goals, improve your products and make informed decisions through user research. Usability testing (remote & in-person), interviews, surveys and analytics are a few methods we’ll review, particularly in the context of your own business challenges and user questions.
Bridging Current Reality & Future Vision with Reality MapsMalini Rao
Using a versatile design research technique, this presentation calls designers to give themselves permission to be flexible in their design practice by being the master of their techniques and get creative with the design process as much as they get creative with the experiences they design!
Are you looking to gather insights from your potential customers? When it comes to your prospects, do you really know what they want? Many startup teams tell us they are missing the key information they need to get into their users' mind. Without this information, the products often fall short of delighting users.
There are those that believe that user research and usability testing must be a complex and scientific process that takes lots of time, money, and resources. However, in the real world, most startups don't have the luxury to spend weeks or months on their user research. That's where guerrilla research techniques come into play.
Julie Grundy gives an overview of user experience Design, why it's important, guiding principles, UX research overview, and tactics used by UX professionals. November 2015.
Renee Anderson, Techniques for prioritizing, road-mapping, and staffing your ...museums and the web
A presentation from Museums and the Web 2009.
Maybe you’re supposed to overhaul your institution’s Web site. Or maybe you’ve been directed to visualize and implement new on-line initiatives. Other than knowing your stakeholders’ wish lists and extensive ideas for Web site content and features – from blogs to on-line collections – you don’t have a clear plan of action. You don’t even have a defense strategy for why or why not to invest in some of their requests. How, then, can your team drive decision-making? How can you get features implemented based on rational reasons, while balancing institutional goals and audience needs – all without going over budget? This mini-workshop will focus on an often-overlooked core Web site activity: the Feature Prioritization Workshop. You will be introduced to prioritization techniques and tools, how and when to use them, methods for navigating the myriad needs and wants of stakeholders, and some approaches for achieving compromise. You will learn to balance “requirements” with “desires” by using concrete proof points and a convincing defense. And you will also learn about building a phased roadmap that will accommodate the immediate needs of your organization at launch, yet will provide a plan for future iterations and builds.
Mini-Workshop: Redesign: Prioritizing [Mini-Workshop]
Early Signal Testing: Designing Atlassian’s New LookAtlassian
You probably have noticed the new look of Atlassian's Cloud products. Our new Design Guidelines took many months to create, and our team had many tough decisions to make. Luckily, we incorporated customer research along the way to guide us.
One of our most valuable research tools is called “early signal testing”, and we think it can help you too. Early signal testing can help you gain confidence in a direction, rather than being paralyzed by a choice. It can help assess your design's usability, clarity, comprehension, and more. This talk explains how your team can gather measurable user feedback in as little as a week, for even the very biggest of problems.
The Trick of Designing User Interfaces that SlayMindfire LLC
Now, the problem every time was the expectation to offer perfect answers, along with supporting reasons. Although my intuition helped me get through on a few, the part I would struggle most was in offering convincing reasons to support my answers. I felt my supposed intuition had some underlying logic and concepts but I needed to reify those. I needed to have constructs that I could use to easily judge any Design, be it a web page, mobile application UI or even a poster.
Newbie UX: Something I learned about UX (Business vs Design)Soon-Aik Chiew
Sharing some tips to those who are new to UX and wish to learn more about UX. The findings and sharing are based on my past learning mistakes, experience and observations.
http://blog.netizentesting.com/newbie-ux-something-learned-user-experience/
I'm currently drafting a material on Startup (Digital) Marketing: Growth Hacking Thru UX. Stay Tuned.
To read more articles, visit: blog.NetizenTesting.com
2 hours training on Mobile UX with Farah Nuraini, Interaction Designer at Traveloka, Indonesia
45 min theory: Research, Analysis, Design solutions and Testing
+ 1h15 min of hands-on exercises with the 5 facilitators from Traveloka.
Supporting Distributed Critique through Interpretation and Sense-Making in an...colin gray
Critique is an important component of creative work in design education and practice, through which individuals can solicit advice and obtain feedback on their work. Face-to-face critique in offline settings such as design studios has been well-documented and theorized. However, little is known about unstructured distributed critique in online creative communities where people share and critique each otherâs work, and how these practices might resemble or differ from studio critique. In this paper, we use mixed-methods to examine distributed critique practices in a UX-focused online creative community on Reddit. We found that distributed critique resembles studio critique categorically, but differs qualitatively. While studio critique often focuses on depth, distributed critique often revolved around collective sensemaking, through which creative workers engaged in iteratively interpreting, defining, and refining the artifact and their process. We discuss the relationship between distributed critique and socio-technical systems and identify implications for future research.
Storytelling For The Web: Integrate Storytelling in your Design ProcessChiara Aliotta
In this slides I explain how I have used storytelling techniques to elevate websites and brands and create memorable user experiences. You can discover practical tips as I showcase the elements of good storytelling and its applied to some examples of diverse brands/projects..
Book Formatting: Quality Control Checks for DesignersConfidence Ago
This presentation was made to help designers who work in publishing houses or format books for printing ensure quality.
Quality control is vital to every industry. This is why every department in a company need create a method they use in ensuring quality. This, perhaps, will not only improve the quality of products and bring errors to the barest minimum, but take it to a near perfect finish.
It is beyond a moot point that a good book will somewhat be judged by its cover, but the content of the book remains king. No matter how beautiful the cover, if the quality of writing or presentation is off, that will be a reason for readers not to come back to the book or recommend it.
So, this presentation points designers to some important things that may be missed by an editor that they could eventually discover and call the attention of the editor.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
Hello everyone! I am thrilled to present my latest portfolio on LinkedIn, marking the culmination of my architectural journey thus far. Over the span of five years, I've been fortunate to acquire a wealth of knowledge under the guidance of esteemed professors and industry mentors. From rigorous academic pursuits to practical engagements, each experience has contributed to my growth and refinement as an architecture student. This portfolio not only showcases my projects but also underscores my attention to detail and to innovative architecture as a profession.
How to effectively implement different online research methods - UXPA 2015 - Fadden & Bedekar
1. How to effectively implement
different online research techniques
for rapid unmoderated feedback
Niyati Bedekar
@nbedekar
Steve Fadden
@sfadden
Presented at UXPA 2015, San Diego Slides: https://goo.gl/X8dolV
2. Agenda
Online techniques
Method toolkit
Common requests and solutions
Case studies and templates
Effective practices
Image source: http://pixabay.com/en/modesto-california-scenic-trail-205544/
5. Who are you?
Years experience in
user research:
<1
1-2
2-5
5+
Image source: Karen Arnold (http://www.publicdomainpictures.net/view-image.php?image=45018)
6. Who are you?
Total number of
employees:
1-20
21-100
101-500
500+
Image source: Karen Arnold (http://www.publicdomainpictures.net/view-image.php?image=45018)
7. Who are you?
Most recent research
request?
Most common
research request?
Jot down
Image source: http://pixabay.com/en/photos/note%20paper/
12. What People Do
What People Say
Why &
How to Fix
How Many & How
Much
Behavioral
Attitudinal
Qualitative Quantitative
Rohrer, C. October 12, 2014. When to use which user experience research methods.
Retrieved from http://www.nngroup.com/articles/which-ux-research-methods/
Toolkit is growing
(Rohrer’s framework)
Image source: http://www.freestockphotos.biz/stockphoto/1772
13. Method (participant effort) Types of answers provided
Click Behavioral: Where to start or go next?
Preference Attitudinal: Compare between options
Recall Hybrid: What do you remember? What are your
first impressions?
Sentiment Attitudinal: How does this make you feel?
Embedded questions Hybrid: What happens next, and why?
How would you rate this?
Terminology/naming Attitudinal: What does something mean?
Commenting Hybrid: What comes to mind while reviewing a
concept/flow? OR Open feedback
Go-to methods
Image source: http://www.geograph.org.uk/photo/1911269
14. Method (participant effort) Types of answers provided
Card sorting Hybrid: What items belong together and what
should they be called?
Discussion groups / Focus
groups
Attitudinal: What comes to mind while reviewing
other feedback?
Unmoderated usability
testing
Hybrid: What do you expect? What do you do?
Why?
Additional methods to consider
Image source: http://www.geograph.org.uk/photo/1911269
16. “Finals week starts on June 1. Where would you first click to put a
reminder on your calendar?”
Click methods (Behavior: Where do users click)
UsabilityTools
17. “Describe what you would expect to see after you clicked the area in
the previous screen?”
Embedded question (Hybrid: What happens next)
Qualtrics
18. “Please click the variation you prefer. [after] Why did you choose it?”
Preference (Attitude: Which do you prefer)
Verify
19. “You will see a screen for 5 seconds. After reviewing the screen, you’ll
be asked questions about it. [after] What do you remember?”
Recall (Hybrid: What do you remember)
Verify
20. “Review this screen and think about how it makes you feel.”
Sentiment (Attitude: How does this make you feel)
Verify
21. “Do you find this design to be attractive?”
Embedded question (Attitude: How do you rate this)
SurveyMonkey
22. “Label each marker with what you would call the icon.”
Terminology/naming (Attitude: What does this mean)
Verify
23. “This design shows what happens when you click the ‘+’ icon.
Comment on areas you find confusing, problematic, helpful, usable.”
Commenting (Hybrid: What comes to mind)
Verify
27. Form groups of 3-5
Review common requests
Discuss how you typically research
Consider online solutions
Discuss pros/cons
Discussion: Research requests
Image source: http://en.wikipedia.org/wiki/Fischer's_lovebird
28. Reference (for Activity)
Image source: http://www.geograph.org.uk/photo/1911269
Method (participant effort) Types of answers provided
Click Behavioral: Where to start or go next?
Preference Attitudinal: Compare between options
Recall Hybrid: What do you remember? What are your
first impressions?
Sentiment Attitudinal: How does this make you feel?
Embedded questions Hybrid: What happens next, and why?
How would you rate this?
Terminology/naming Attitudinal: What does something mean?
Commenting Hybrid: What comes to mind while reviewing a
concept/flow? OR Open feedback
29. Group discussion: Share thoughts
● Problem
● Typical solution
● Online research solution
● Pros/cons
Discussion: Research requests
Image source: http://en.wikipedia.org/wiki/Fischer's_lovebird
31. Case Study 1: Evaluate new data export concept
Background
- New functionality for an existing
product
- Integrated with 3rd party software
- To be implemented ASAP
Goals
- “Boil the ocean” to learn if concept
was understood, desired, and usable
Methods
Embedded question
Critical incident
Embedded question
Comprehension rating
Commenting
On each storyboard panel, after
presenting full story
Embedded question
Open feedback, questions, and
expectations
32. “Consider the last time you had to export data. Describe why you
needed to export data, and list the steps you remember from that
process. (If you haven’t exported data before, or don’t remember the
last time, just skip to the next question).”
Embedded question (Critical Incident)
“I’m pretty old school, so I export
my credit card transaction data
about every quarter. My credit card
site has a button to export to CSV,
so I just click that and it downloads
to my computer.”
“We have our marketing, sales, and
inventory data in different systems.
I have to export data from each
system in order to combine it into a
spreadsheet for my stakeholders.
The export process is easy.
Combining the data is more
involved.
33. “Consider the concept presented on the next 4 slides. After reading
about the concept, you will be asked about what you found to be
confusing, problematic, useful, and appealing about the concept.”
1.
New concept scenario
2.
3.
4.
100%
35. Commenting (Identify strengths and weaknesses)
“You will now be shown each concept slide again. On each slide,
indicate anything you found to be particularly confusing, problematic,
useful, and appealing.”
1.
2.
3.
4.
100%“Doing this would
require a lot of clicks,
even for a small
number of columns.”
“You should embed best
practices for naming
here. Otherwise, the
result could be messy.”
“Will we be able to save
the mappings? That
could save time in the
future.”
36. “Any final comments, questions, or feedback you’d like to share?”
Embedded question (Open feedback)
“It’s great that you don’t have to
jump around different parts of the
system to do this. Very valuable to be
able to complete this from one
place.”
“Seems very clear to me. I think
anyone who has used [XYZ] would
be able to understand it too.”
“Hi, I wanted to
follow up to
reiterate that this
is a REALLY COOL idea
and it fills a much
needed requirement
for our use of the
product. Please
consider me for
future studies like
this, because we need
this functionality!”
37. Template 1: Exploring a new concept
NDA,
Confidentiality,
Demographics
Embedded
Question: Critical
incident to activate
[Present concept]
Video, illustration,
storyboard,
description
Embedded
Question:
Comprehension
rating, after
presenting concept
Commenting:
Concept slides
(storyboards work
well)
Embedded
Question: Open
feedback
38. Case Study 2: Identify problems and preferences for
calendar range selection tools
Background
- Tool developed without support
- Early stage prototype, only worked
within company firewall
- Team wanted feedback before further
refinement
Goals
- Recruit internal participants only
- Identify heuristic violations
- Gauge preference compared to
existing tools
Methods
Click
How would you start task
Commenting
(after using prototype) See
screenshots of tool in different
states
Preference
Compare tool to existing tool
Embedded Question
Explain preference and next steps
39. Template 2: Eliciting usability/heuristic feedback
NDA,
Confidentiality,
Demographics
Recall: What is
remembered? [or]
Sentiment: How
does this make you
feel?
Click: How would
you start this task?
Embedded
Question: What
would you expect to
see after clicking?
Commenting: Open
feedback, after
engaging
Embedded
Question: Usability
rating
40. Case Study 3: Redesign chart type & update visual
treatment
Background
- Existing component used frequently
by customers and loved by many!
- Not scalable
- Prone to misinterpretation
- Team wanted to test new designs
Goals
- Understand if users comprehend the
new design
- Gauge preference among 3 different
approaches (including existing)
- Mix of internal users and customers
Methods
Embedded question
Understandability of information
Preference
Among the various options
Commenting
Open feedback, expectations
41. Template 3: Redesigned visual treatment
NDA,
Confidentiality
Embedded
Question: to gather
understanding of
information on chart
(randomize)
Preference: Which
design do you
prefer? (randomize)
Embedded
Question: Why the
selected design?
Commenting: Open
feedback
Demographics
42. Case Study 4: Understand how people find content
Background
- Team assigned to build new system
- Wanted to create a system where
content was easy to locate
Goals
- Identify how users locate content
- Discover differences based on content
type
- Understand pain points to see if they
can be reduced or eliminated
Methods
Click
(for each method) Where do you
click first to locate this kind of
content?
Sentiment
What feeling is associated?
Commenting
Open feedback, expectations
Embedded Question
(after each method) What do you
find most/least usable?
43. Template 4: Understanding behavior and
expectations
NDA,
Confidentiality,
Demographics
Embedded
Question: Critical
incident to activate
Click: What do you
do first?
Sentiment: How do
you feel when you do
this?
Commenting: What
works well and not
well?
Embedded
Question: Open
feedback
62. Type of Test
Tools Click /
Suc-
cess
Prefer-
ence
Recall Senti-
ment
Ques-
tion
Termin-
ology/
Label
Com-
menting
Card
sorting
Discus-
sion
Unmoder-
ated
usability +
video on
website
Metrics
&
Results
Verify ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Usabilla ✓ ✓ ✓ ✓
Loop11 ✓ ✓ ✓
UserTesting.com ✓ ✓
UserZoom ✓ ✓ ✓ ✓ ✓ ✓
Optimal
Workshop
✓ ✓
Yahoo Groups,
Facebook,
LinkedIn
✓
Survey tools
(Getfeedback,
Qualtrics,
SurveyMonkey)
✓ ✓ ✓ ✓
Examples of types of tests available (Incomplete list)
63. Chrisitan Rohrer’s NNG article about when appropriatenes of a method to help answer specific
questions: http://www.nngroup.com/articles/which-ux-research-methods/
A review of usability and UX testing tools: http://www.smashingmagazine.
com/2011/10/20/comprehensive-review-usability-user-experience-testing-tools/
How to select an unmoderated user testing tool to fit your needs: http://www.nngroup.
com/articles/unmoderated-user-testing-tools/
List of tools for unmoderated testing:
1. http://remoteresear.ch/tools/
2. http://www.infragistics.com/community/blogs/ux/archive/2012/11/07/6-tools-for-remote-
unmoderated-usability-testing.aspx
Kyle Soucy’s article in UX Matters (Unmoderated, Remote Usability Testing: Good or Evil?) http:
//www.uxmatters.com/mt/archives/2010/01/unmoderated-remote-usability-testing-good-or-evil.php
Additional Links