A look at the ins and outs of conducting a great usability test that helps to get you the insight you need - while being mindful of budget constraints and resource issues.
You don’t need a big budget, weeks of time or special labs to get user insights quickly and inexpensively. We’ll discuss how you can meet your goals, improve your products and make informed decisions through user research. Usability testing (remote & in-person), interviews, surveys and analytics are a few methods we’ll review, particularly in the context of your own business challenges and user questions.
You don’t need a big budget, weeks of time or special labs to get user insights quickly and inexpensively. We’ll discuss how you can meet your goals, improve your products and make informed decisions through user research. Usability testing (remote & in-person), interviews, surveys and analytics are a few methods we’ll review, particularly in the context of your own business challenges and user questions.
Introduction to usability and usability testing as a discipline, followed by how to do guerilla usability testing. Presented at Duke Tech Expo April 13, 2018 with co-author Lauren Hirsh, with content from a prior collaborative presentation of hers.
Slides from a session at the American Alliance of Museums 2014 annual meeting, "Tech Tutorial: User Testing on a Shoestring (Beginners)."
Session presenters:
Christina DePaolo
Dana Mitroff Silvers
Charlotte Sexton
http://www.aam-us.org/events/annual-meeting/program/sessions-and-events?ID=2353
Learn 6 tricks you can take home to get participation without politics:
1-KJ Sessions
2-Nav Bar Survivor
3-Design Consequences
4-Mood Boards
5-Posterframes
6-Digital Paper Prototyping
What if teams approached product design like a science experiment? Use this Lab Report template to test hypotheses & capture evidence. Experiment your way to measurable customer value.
This is a talk I gave to students of the Manukau Institute of Technology, focusing on key usability heuristics, and giving them tips on how to run their own user research or usability testing.
In this presentation I point out how paper prototyping can help you to test assumptions early with your target user group and design better services. I gave this presentation/workshop at the Webdeveloper Meetup in Osaka and the Rakuten Tech Conference in Osaka.
How to Avoid Data Pitfalls by Self Spark Chief Science OfficerProduct School
Having numbers to support a conclusion is not a guarantee of its validity. Numbers can come from a variety of methods, many of which can produce fuzzy data and fuzzier results. This talk covered a number of important and easily-avoided pitfalls in using survey data.
Automation vs. intelligence - "follow me if you want to live"Viktor Slavchev
Have you ever heard the story that your job is automatable, that all the human testers will be replaced by machines or automated tests and you will lose your job? Or even worse, that machines and artificial intelligence will take over our craft and our life and we will be totally useless. Do you buy these? Are you afraid?
“Come with me, if you want to live” – this was the famous line that many members of the Human resistance in the Terminator franchise used, when offering their help in the war against Skynet.
So, come with me (and John Connor), and join the testing resistance to fight on the side of intellect against the evil machine army. I am willing to challenge the I part in AI on contest by focusing on few key topics:
Can we translate testing into machine language? Polymorphic and mimeomorphic actions – what are these?
Do we really know what are the benefits of human testing? What are human testers irreplaceable for?
Do we really have empirical evidence that computers are capable of doing professional testing? Do we have evidence of “intelligence” at all?
Last year at RTC ‘17 I was asked – “Is AI the answer to all test automation problems?”. My answer is “No, it’s not!”. And this talk is my explanation why.
My books- Learning to Go https://gumroad.com/l/learn2go & The 30 Goals Challenge for Teachers http://amazon.com/The-Goals-Challenge-Teachers-Transform/dp/0415735343
Resources at http://shellyterrell.com/assessment & http://shellyterrell.com/examprep
Our final class will cover what is expected of a product manager, including the skills, responsibilities and key activities product managers must perform.
This was a 4-hour workshop that was given at World Usability Day Colombia. #wudco14
Summary:
Now more than ever is the survival of the easiest. Whether the product is a website or a handheld device, success depends largely on how easy it is to use. Usability testing is one of the most effective for creating an intuitive methods. By observing actual people when they use the product, you can get valuable insights if your design is easy to use. Attendees will learn how to conduct a usability test with end users of a product. This workshop is highly interactive and includes several practical exercises to give participants practical experience.
You will learn:
- How to plan a usability testing study
- How to define the goals and objectives
- Explore options (unmoderated usability testing vs. unmoderated & remote vs. in-person)
- How to recruit the right participants
- How to create tasks (Interview-based vs. predefined tasks)
- How to moderate a usability test
- How to analyze and report the results
Introduction to usability and usability testing as a discipline, followed by how to do guerilla usability testing. Presented at Duke Tech Expo April 13, 2018 with co-author Lauren Hirsh, with content from a prior collaborative presentation of hers.
Slides from a session at the American Alliance of Museums 2014 annual meeting, "Tech Tutorial: User Testing on a Shoestring (Beginners)."
Session presenters:
Christina DePaolo
Dana Mitroff Silvers
Charlotte Sexton
http://www.aam-us.org/events/annual-meeting/program/sessions-and-events?ID=2353
Learn 6 tricks you can take home to get participation without politics:
1-KJ Sessions
2-Nav Bar Survivor
3-Design Consequences
4-Mood Boards
5-Posterframes
6-Digital Paper Prototyping
What if teams approached product design like a science experiment? Use this Lab Report template to test hypotheses & capture evidence. Experiment your way to measurable customer value.
This is a talk I gave to students of the Manukau Institute of Technology, focusing on key usability heuristics, and giving them tips on how to run their own user research or usability testing.
In this presentation I point out how paper prototyping can help you to test assumptions early with your target user group and design better services. I gave this presentation/workshop at the Webdeveloper Meetup in Osaka and the Rakuten Tech Conference in Osaka.
How to Avoid Data Pitfalls by Self Spark Chief Science OfficerProduct School
Having numbers to support a conclusion is not a guarantee of its validity. Numbers can come from a variety of methods, many of which can produce fuzzy data and fuzzier results. This talk covered a number of important and easily-avoided pitfalls in using survey data.
Automation vs. intelligence - "follow me if you want to live"Viktor Slavchev
Have you ever heard the story that your job is automatable, that all the human testers will be replaced by machines or automated tests and you will lose your job? Or even worse, that machines and artificial intelligence will take over our craft and our life and we will be totally useless. Do you buy these? Are you afraid?
“Come with me, if you want to live” – this was the famous line that many members of the Human resistance in the Terminator franchise used, when offering their help in the war against Skynet.
So, come with me (and John Connor), and join the testing resistance to fight on the side of intellect against the evil machine army. I am willing to challenge the I part in AI on contest by focusing on few key topics:
Can we translate testing into machine language? Polymorphic and mimeomorphic actions – what are these?
Do we really know what are the benefits of human testing? What are human testers irreplaceable for?
Do we really have empirical evidence that computers are capable of doing professional testing? Do we have evidence of “intelligence” at all?
Last year at RTC ‘17 I was asked – “Is AI the answer to all test automation problems?”. My answer is “No, it’s not!”. And this talk is my explanation why.
My books- Learning to Go https://gumroad.com/l/learn2go & The 30 Goals Challenge for Teachers http://amazon.com/The-Goals-Challenge-Teachers-Transform/dp/0415735343
Resources at http://shellyterrell.com/assessment & http://shellyterrell.com/examprep
Our final class will cover what is expected of a product manager, including the skills, responsibilities and key activities product managers must perform.
This was a 4-hour workshop that was given at World Usability Day Colombia. #wudco14
Summary:
Now more than ever is the survival of the easiest. Whether the product is a website or a handheld device, success depends largely on how easy it is to use. Usability testing is one of the most effective for creating an intuitive methods. By observing actual people when they use the product, you can get valuable insights if your design is easy to use. Attendees will learn how to conduct a usability test with end users of a product. This workshop is highly interactive and includes several practical exercises to give participants practical experience.
You will learn:
- How to plan a usability testing study
- How to define the goals and objectives
- Explore options (unmoderated usability testing vs. unmoderated & remote vs. in-person)
- How to recruit the right participants
- How to create tasks (Interview-based vs. predefined tasks)
- How to moderate a usability test
- How to analyze and report the results
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4Anthony D. Paul
You’ve built a shiny, new Drupal site. You asked your grandma and your client if they like it and they both do. However, you’re lying awake at night wondering if you’re missing something—because you know you’re not the end user. You yearn for actionable feedback.
In this talk, I’ll distill my background in usability research into a how-to framework for taking your site and conducting your first unmoderated usability test. I’ll cover what to look for, best practices in facilitation, tools on the cheap, and how to glean the most from a brief window of time.
Organizing Your First Website Usability Test - WordCamp Toronto 2016Anthony D. Paul
You’ve built a shiny, new WordPress site. You asked your co-worker and your boss if they like it and they both do. However, you’re lying awake at night wondering if you’re missing something—because you know you’re not the end user. You yearn for actionable feedback. In this talk, I’ll distill my background in usability research into a how-to framework for taking your site and conducting your first unmoderated usability test. I’ll cover why and when you should be running usability tests; how to set research goals and draft a script for them; setting up your lab environment and capturing feedback; and best practices for facilitation, minimizing bias, keeping users on task and gleaning the most from each brief test.
Are you looking to gather insights from your potential customers? When it comes to your prospects, do you really know what they want? Many startup teams tell us they are missing the key information they need to get into their users' mind. Without this information, the products often fall short of delighting users.
There are those that believe that user research and usability testing must be a complex and scientific process that takes lots of time, money, and resources. However, in the real world, most startups don't have the luxury to spend weeks or months on their user research. That's where guerrilla research techniques come into play.
Lightweight and ‘guerrilla’ usability testing for digital humanities projectsMia
For the 2014 Digital Humanities Summer School at the University of Oxford DHOxSS. Usability doesn’t have to be a drag, and user testing doesn’t have to take months and a cast of thousands. Following the principle that ‘any user testing is better than no user testing’, lightweight usability is based on the idea that all you need to run useful tests with real people is a bit of planning and a couple of hours. In this session you will learn how to plan and run a lightweight usability test on paper prototypes or early versions of digital projects and get tips for recruiting and rewarding participants for 'guerrilla usability testing'. At the end of the workshop we will put it into practice by running a live usability test on a site suggested by the audience.
Guided by Optimizely's training team, participants will leave this session armed with the tools and resources to enable their organization with the technical and strategic skills needed to build a successful optimization program. Through modeling of best-practices and facilitation techniques, participants will gain a strong foundation in the three key Optimizely training modules: Optimizely X - Platform Training, Strategy Ideation, and Hypothesis Creation, and Result Review and Analysis.
This workshop focuses on how to facilitate and what to expect before, during, and after a training. We will discuss the key learning objectives, common questions and takeaways, and follow-up resources from each module.
Join us and learn how to deliver powerful Optimizely trainings to enable your team.
It is possible for a product to pass quality assurance tests and acceptance testing without being user-friendly. It is also too easy for those of us who build digital products to make assumptions about what our users need. As a design thinker, I strive to bring the authentic voices of complex audiences into the product lifecycle through pragmatic research.
A sound design research process not only shapes digital products to be more usable, it also adds value to drive engagement.
Exploratory testing is an approach to testing that emphasizes the freedom and responsibility of testers to continually optimize the value of their work. It is the process of three mutually supportive activities done in parallel: learning, test design, and test execution. With skill and practice, exploratory testers typically uncover an order of magnitude more problems than when the same amount of effort is spent on procedurally scripted testing. All testers conduct exploratory testing in one way or another, but few know how to do it systematically to obtain the greatest benefits. Even fewer can articulate the process. Jon Bach looks at specific heuristics and techniques of exploratory testing that will help you get the most from this highly productive approach. Jon focuses on the skills and dynamics of exploratory testing, and how it can be combined with scripted approaches.
Organizing Your First Website Usability Test - WP Campus 2016Anthony D. Paul
You’ve built a shiny, new WordPress site. You asked your co-worker and your boss if they like it and they both do. However, you’re lying awake at night wondering if you’re missing something—because you know you’re not the end user. You yearn for actionable feedback.
In this talk, I’ll distill my background in usability research into a how-to framework for taking your site and conducting your first unmoderated usability test. I’ll cover why and when you should be running usability tests; how to set research goals and draft a script for them; setting up your lab environment and capturing feedback; and best practices for facilitation, minimizing bias, keeping users on task and gleaning the most from each brief test.
Attendees will walk away with enough information to discuss the value of usability testing with decision-makers, as well as a tactical foundation for organizing and running their own usability study.
Using Automated Testing Tools to Empower Your User ResearchUserZoom
In this Webinar, you'll learn:
-Guidelines for when to use moderated vs. unmoderated testing
-How to structure studies and set up tasks to get valid research results that achieve business objectives for testing
-Tried-and-true tricks for avoiding the most common pitfalls of unmoderated testing
-Advice for recruitment, screening and use of online panels
-How to use automated testing with agile design and development sprints to accommodate tight timelines and satisfy usability needs
3 Steps to Create a Habit of User Research on Your Product Teamvalidately
Webinar slides for Sarah Doody's MasterClass on creating a habit of research on your product team.
Video presentation at:
https://youtu.be/EKjWOvLb8G8
In this free masterclass you'll learn:
- The 3 types of research you should be doing each quarter to gather critical insights to form your product decisions.
- How to build what people want and avoid the expensive "re-work" that often happens after you launch.
- How to tailor your research to your company's timelines and budgets.
- How to empower other members of your team to do more research.
- Free Trello Board: Copy Sarah's "Quarterly Research Toolkit" Trello Board to plan your team's research.
Sarah Doody is a user experience designer, consultant, and writer. She is based in New York, NY and works with clients worldwide.
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
You can utilize various forms of Generative Research to deepen your understanding of how people interact with your product or service.
Craig has amassed a vast toolkit of research methods, which he has employed to optimize websites and apps for over 500 companies. He'll share which methods yielded the highest return on investment, identified key customer pain points, and generated the best experiment ideas.
By sharing the top inspection methods essential for our work, Craig will provide advice for each technique. Anticipate insights on driving experiment hypotheses from research, a list of essential toolkit components for tomorrow, and additional resources for further reading.
Slides from my "Usability Testing How To's" workshop with Event Handler.
http://www.eventhandler.co.uk/events/uxnightclass-usability2
Westminster Hub, London UK 22 January 2014
===
Who is it for?
This workshop is for those who want to create products that will be easy to use. Usability testing is an important part of the process of designing digital products, but it can often be overlooked due to time, money, and training constraints. In this workshop you'll learn how to test any product's usability without spending a large amount of time and money. And how to use what you've learned to improve the product.
Who is it taught by?
This workshop is being taught by Evgenia Grinblo @grinblo, User Experience Specialist at mobile agency, Future Workshops. Born in Siberia, Jenny freelanced and trained in ethnographic research in Israel and the USA, before bringing her talent to the UK. Her pet peeve is badly written error-messages and she has a growing collection of them. You'll find her speaking on empathy, UX, and other passions.
What you'll learn
An introduction to usability testing - what is it?
Who should you test your product on?
What do you test?
How to facilitate a test and get reliable results
How to manage data and act on your findings with your team
Tools: Cheap, quick and effective testing tools for mobile and the web.
Similar to Baltimore UX Meetup - Usability Testing: Tips, Tools, and More (20)
White wonder, Work developed by Eva TschoppMansi Shah
White Wonder by Eva Tschopp
A tale about our culture around the use of fertilizers and pesticides visiting small farms around Ahmedabad in Matar and Shilaj.
Book Formatting: Quality Control Checks for DesignersConfidence Ago
This presentation was made to help designers who work in publishing houses or format books for printing ensure quality.
Quality control is vital to every industry. This is why every department in a company need create a method they use in ensuring quality. This, perhaps, will not only improve the quality of products and bring errors to the barest minimum, but take it to a near perfect finish.
It is beyond a moot point that a good book will somewhat be judged by its cover, but the content of the book remains king. No matter how beautiful the cover, if the quality of writing or presentation is off, that will be a reason for readers not to come back to the book or recommend it.
So, this presentation points designers to some important things that may be missed by an editor that they could eventually discover and call the attention of the editor.
Between Filth and Fortune- Urban Cattle Foraging Realities by Devi S Nair, An...Mansi Shah
This study examines cattle rearing in urban and rural settings, focusing on milk production and consumption. By exploring a case in Ahmedabad, it highlights the challenges and processes in dairy farming across different environments, emphasising the need for sustainable practices and the essential role of milk in daily consumption.
Unleash Your Inner Demon with the "Let's Summon Demons" T-Shirt. Calling all fans of dark humor and edgy fashion! The "Let's Summon Demons" t-shirt is a unique way to express yourself and turn heads.
https://dribbble.com/shots/24253051-Let-s-Summon-Demons-Shirt
4. INVOLVE YOUR TEAM IN PLANNING
Understand their needs and what they may need to learn from the test.
Image Source
5. WRITE TEST GOALS & OBJECTIVES
Make sure east task that you create aligns to them.
Image Source
6. WHO? WHAT? WHEN? WHERE? HOW?
Determine these important things early on.
Image Source
7. If you have participant limitations, get as close to your “ideal” panel as
possible.
Stay flexible and creative - It’s always better to test with someone than no one.
WHO do you need to participate in the test?
8. WHAT exactly are you going to test?
Determine what you’ll test – live site, app, prototype, competitive site – and
figure out what needs to be in place to run a successful test.
Make sure that your participants will be able to easily access the test subject.
9. WHEN is the best time to run your test?
Think about project milestones and when test data will be most actionable.
Align these with team needs, not just your own.
Don’t hesitate to test multiple iterations and to take different paths with different
rounds of testing.
10. WHERE do you need to conduct testing?
Figure out if you need to capture participants in the wild, in a controlled
environment, or behind a firewall.
Keep your timeline and application in mind.
11. HOW are you going to run the test?
The type of testing you conduct needs to align with your available tools,
timeline, and goals/objectives.
Use the tool that’s right for the test you need to run, and make sure you have a way
to capture the information that you need to get.
12. USABILITY TESTING TOOLS
USABILITY TESTING FIRST GLANCE FEEDBACK IA/CONTENT ORGANIZATION ANALYTICS-STYLE TESTING
Moderated:
• WebEx
• GoTo Meeting
Make sure they have recording
and audio features.
Unmoderated:
• UserTesting.com
• Morae
• The User is Drunk
• The User is My Mom
• Chalkmark (Optimal
Workshop)
• Peek (UserTesting.com)
Optimal Workshop:
• Optimal Sort
• Tree Jack
• Crazy Egg
• Analytics Tools (Omniture,
Google Analytics)
Many of these you can try them out for free or for a low cost to see if you like
them. Some deliver more with larger plans and more dedicated support.
13. ASSEMBLE A SOLID PARTICIPANT PANEL
Recruit and screen the best panel that you can. Keep their needs in mind.
Image Source
14. DEFINE SUCCESS AND MEASUREMENT
Establish success criteria and measurement goals – and share them around.
Image Source
15. EDIT, THEN EDIT SOME MORE
Give your test script a second and third look. Is everything clear?
Image Source
16. TAKE IT FOR A TEST DRIVE
Set up a dry run test to make sure you’re happy with your script.
Image Source
17. SET GROUND RULES, BUT BE FLEXIBLE
Share rules of the test with observers, and stay open to participant diversions.
Image Source
19. REPORT AND RECOMMEND
Arm yourself and stakeholders with data and actionable next steps.
Image Source
20. REPORTING
• Reminder of test objectives, demographics, participant details
• Recap test tasks (high-level)
• High-level findings
• Recommendations - Top 5 recommendations
Include video snippets of tests, highlight reels, and user quotes, to
help bring your participants to life in your report.
21. DON’T BE AFRAID TO TRY
Innovate to get the data you need to make informed decisions.
Image Source
22. THANK YOU
If you have questions, let’s chat more!
Twitter: @siovenitti
BUX Slack: siovenitti
Email: s.iovenitti@gmail.com