The document provides an overview of web usability and usability testing. It discusses key aspects of usability including learnability, efficiency, memorability, errors, and satisfaction. It outlines why usability is important for websites. Common usability problems are presented such as bad search functions, PDFs for online reading, and fixed font sizes. Methods for assessing usability through evaluations and testing are described. The testing process, roles, methods, and tools are defined. Metrics for measuring effectiveness, efficiency, satisfaction, and learnability are provided. The relationship between usability testing and user-centered design is explained.
What is Heuristic evaluation
Background
Benefits
Main advantages and drawbacks of the method
Scenario and methods of evaluation
10 usability Heuristics in usability engineering
How to conduct heuristic Evaluation
Phases of the Evaluation Method
Problems and Evaluators
Seamlessness thought the whole user experience
Web Accessibility in its simplest definition is all about making sure websites work for the widest possible audience. This seminar would involve a quick introduction to Web Accessibility, Web Accessibility Issues, Guidelines etc.
What is Heuristic evaluation
Background
Benefits
Main advantages and drawbacks of the method
Scenario and methods of evaluation
10 usability Heuristics in usability engineering
How to conduct heuristic Evaluation
Phases of the Evaluation Method
Problems and Evaluators
Seamlessness thought the whole user experience
Web Accessibility in its simplest definition is all about making sure websites work for the widest possible audience. This seminar would involve a quick introduction to Web Accessibility, Web Accessibility Issues, Guidelines etc.
Learn about the basics of web accessibility: what it is, who it affects, why it matters, and some of the fundamental things you ought to be doing in your pages to make them more accessible.
The 10 Golden Usability Heuristics (Montreal Girl Geeks September 2014)Elida Arrizza
A great User Experience (UX) is key to user delight and a positive attitude toward a brand. We’ve all had that moment when we’ve experienced frustration at doing or getting something online, but may have trouble understanding or communicating why.
A core element of UX is Usability, which focuses on whether or not a given task can be accomplished on a website, helping to rid us of any of those frustrations. This presentation will provide you with a basic understanding of the language and purpose of usability, as well as an overview of tools and techniques to improve your site’s usability by examining the 10 golden heuristics. This talk is ideal for designers, UX professionals, developers and anyone who wants to know more about how users think and what we can do to make things easier for our audience.
http://montrealgirlgeeks.com/2014/09/23/september-10-golden-usability-heuristics-with-elida-arrizza/
This presentation throws light on some of the essential elements of web testing which have become crucial to ensure quality in this day and age. To know more on web testing, Graphical User Interface Testing, workflow testing along with Cross Browser or Compatibility testing, go through this presentation as well as the ones coming soon.
This presentation is an introduction to the fields of User Experience and User Interface design that I created for a Google Hangout talk for Saigon CoWorkshop.
Good designing is also an act of communication between the user and designer and the user. Gets here all the important tips and techniques of user experience design by our expert.
Accessible UX: Beyond the checklist to great experiencesWhitney Quesenbery
Checklists, standards, and even patterns can only make sure that basic rules are followed. Even products that meet standards can be difficult or even impossible to use.
But the questions we want to focus on are:
- How easy, useful, efficient, and delightful is this?
- Is this something people want to use?
- Is it a great experience?
Presentation at IAAP 2015, October 22, 2015
A beginners guide to accessibility testing. An overview of common mistakes websites make and highlighting some easy to use tools that anyone can incorporate into their work.
Presented at www.AccessibilityCalgary.com on May 12, 2013.
Learn about the basics of web accessibility: what it is, who it affects, why it matters, and some of the fundamental things you ought to be doing in your pages to make them more accessible.
The 10 Golden Usability Heuristics (Montreal Girl Geeks September 2014)Elida Arrizza
A great User Experience (UX) is key to user delight and a positive attitude toward a brand. We’ve all had that moment when we’ve experienced frustration at doing or getting something online, but may have trouble understanding or communicating why.
A core element of UX is Usability, which focuses on whether or not a given task can be accomplished on a website, helping to rid us of any of those frustrations. This presentation will provide you with a basic understanding of the language and purpose of usability, as well as an overview of tools and techniques to improve your site’s usability by examining the 10 golden heuristics. This talk is ideal for designers, UX professionals, developers and anyone who wants to know more about how users think and what we can do to make things easier for our audience.
http://montrealgirlgeeks.com/2014/09/23/september-10-golden-usability-heuristics-with-elida-arrizza/
This presentation throws light on some of the essential elements of web testing which have become crucial to ensure quality in this day and age. To know more on web testing, Graphical User Interface Testing, workflow testing along with Cross Browser or Compatibility testing, go through this presentation as well as the ones coming soon.
This presentation is an introduction to the fields of User Experience and User Interface design that I created for a Google Hangout talk for Saigon CoWorkshop.
Good designing is also an act of communication between the user and designer and the user. Gets here all the important tips and techniques of user experience design by our expert.
Accessible UX: Beyond the checklist to great experiencesWhitney Quesenbery
Checklists, standards, and even patterns can only make sure that basic rules are followed. Even products that meet standards can be difficult or even impossible to use.
But the questions we want to focus on are:
- How easy, useful, efficient, and delightful is this?
- Is this something people want to use?
- Is it a great experience?
Presentation at IAAP 2015, October 22, 2015
A beginners guide to accessibility testing. An overview of common mistakes websites make and highlighting some easy to use tools that anyone can incorporate into their work.
Presented at www.AccessibilityCalgary.com on May 12, 2013.
Brief explanation of user experience with a focus on usability and accessibility. Heuristic assessments, WCAG 1.0 checkpoints and how this fits in with real user testing.
Usability engineering is a field that is concerned generally with human-computer interaction and specifically with devising human-computer interfaces that have high usability or user friendliness. It provides structured methods for achieving efficiency and elegance in interface design.
Usability testing (or user testing) involves measuring the ease with which users can complete common tasks on your website. The results of the analysis are a huge eye-opener and their implementation often leads to:
Increased sales and task completion and a high rate of return site visitors
A greatly improved understanding of your customers’ needs
A significant reduction in call centre enquiries
A much more user-focused in-house development team Source: http://www.wbcsoftwarelab.com/wbcblog/read-basics-of-usability-testing
Filip Healy (Threesixty Reality): Making Immersive Tech More UsableAugmentedWorldExpo
A talk from the Design Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018.
Filip Healy (Threesixty Reality): Making immersive tech more usable: Involving target users in your design process
Understanding user needs, design research and usability testing are common practice today for most digital products. It's rare for a mobile app or website from any serious company to go live without some degree of testing with users.
The benefits of involving users in the design process are well known to UX professionals and digital product managers: improved usability, reduced dropouts, optimised conversion rates, higher engagement and better user advocacy.
In this talk I'll discuss how this applies to immersive tech and why it's more important than ever to understand actual user behaviour and develop new interaction paradigms that deliver on the potential of VR and AR platforms. I'll talk through the process of running studies with users, when to test the design, how to set things up and what data to focus on in order to get the most benefit from testing with users. What can we learn from this type of research and why is it important for ensuring the success of our product?
http://AugmentedWorldExpo.com
Integrating User Centered Design with Agile DevelopmentJulia Borkenhagen
The Agile Manifesto emphasizes the importance of individuals and interactions over processes and tools, and that's precisely where the User Centered Design approach comes in. UCD always focuses on the users first, keeps them involved during the entire project and emphasizes the need for iterations and team collaboration.
Adaptation of my IA 7/ UX 1 deck for an InnovationLab talk at Stabilo International, Heroldsberg on 10/17/2012.
Credits & image credits within the presentation.
Axa Hackathon: User Centric Guide to Application PrototypingJay Suthar
Prepared presentation for hackathon participants to communicate key aspects of user centric design process; research (personas, task analysis), design (rapid prototyping to design experience and iterate (collect findings)) and adapting (conducting guerrilla usability testing).
Interactive systems are increasingly interconnected across different devices and platforms. The challenge for interaction designers is to meet the requirements of consistency and continuity across these platforms to ensure the inter-usability of the system. This presentation describes the current challenges the designers are facing in the emerging fields of interactive systems. Through semi-structured interviews of 17 professionals working on interaction design in different domains we probed into the current methodologies and the practical challenges in their daily tasks. The identified challenges include but are not limited to: the inefficiency of using low-fi prototypes in a lab environment to test inter-usability and the challenges of “seeing the big picture” when designing a part of an interconnected system.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
5. Usability
Usability is a quality attribute that assesses how easy user
interfaces are to use. Also refers to methods for improving
ease-of-use during the design process.
Usability is defined by five quality components:
▫ Learnability: How easy is it for users to accomplish basic
tasks the first time they encounter the design?
▫ Efficiency: Once users have learned the design, how
quickly can they perform tasks?
▫ Memorability: When users return to the design after a
period of not using it, how easily can they reestablish
proficiency?
▫ Errors: How many errors do users make, how severe are
these errors, and how easily can they recover from the
errors?
▫ Satisfaction: How pleasant is it to use the design?
Seminari d'Enginyeria de Serveis 5
6. Why Usability matters (www.usabilitynet.org/management/c_cost.htm)
62% of web shoppers gave up looking for an item.
(Zona study)
50% of web sales are lost because visitors can’t easily
find content. (Gartner Group)
40% of repeat visitors do not return due to a negative
experience. (Zona study)
85% of visitors abandon a new site due to poor
design. (cPulse)
Only 51% of sites complied with simple web usability
principles. (Forrester study of 20 major sites)
Seminari d'Enginyeria de Serveis 6
7. Why people fail
Search
Findability (IA, Category names,
Navigation, Links)
Page design (Readability,
Layout, Graphics, Amateur,
Scrolling)
Information (Content, Product
info, Corporate info, Prices)
Task support (Workflow, Privacy,
Forms, Comparison, Inflexible)
Fancy design (Multimedia, Back
button, PDF/Printing, New
window, Sound)
Other (Bugs, Presence on Web,
Ads, New site, Metaphors)
Usability problems weighted by how frequently
they caused users to fail a task [NL06]
Seminari d'Enginyeria de Serveis 7
8. Top Ten (Usability) Mistakes in Web Design
1. Bad search
2. Pdf files for online reading
3. Not changing the color of visited links
4. Non-scannable text
5. Fixed font size
6. Page titles with low search engine visibility
7. Anything that looks like an advertisement
8. Violating design conventions
9. Opening new browser windows
10. Not answering users' questions
Seminari d'Enginyeria de Serveis 8
9. Assessing Usability
Two major types of assessing methods:
▫ Usability evaluations:
• Evaluators and no users
• Techniques: surveys/questionnaires, observational
evaluations, guideline based reviews, cognitive
walkthroughs, expert reviews, heuristic evaluations
▫ Usability tests: focus on users working with the
product
Usability testing is the only way to know if the Web
site actually has problems that keep people from
having a successful and satisfying experience.
Seminari d'Enginyeria de Serveis 9
10. Usability Testing & User-Centered Design (UCD)
Usability testing fits in as one part of the UCD process.
Usability testing is best implemented after completing earlier
steps in the UCD process (It's better to have clearly defined
objectives and risks before testing).
UCD, aka. usability engineering, is a structured approach to
producing a Web site that involves users throughout the entire
design process.
UCD applies several methods at appropriate times:
▫ defining business and user goals and objectives
▫ gathering requirements
▫ evaluating design alternatives, building and testing
prototypes
▫ analyzing usability problems, testing a site with users, and
proposing solutions to problems
Seminari d'Enginyeria de Serveis 10
13. Usability Testing
Usability testing is a methodology that employs
potential users to evaluate the degree to which a
website/software meets predefined usability criteria.
Basic Process:
1. Watch Customers
2. They Perform Tasks
3. Note Their Problems
4. Make Recommendations
5. Iterate
Seminari d'Enginyeria de Serveis 13
14. Measures of Usability
Effectiveness (Ability to successfully accomplish tasks)
▫ Percentage of goals/tasks achieved (success rate)
▫ Number of errors
Efficiency (Ability to accomplish tasks with speed and ease)
▫ Time to complete a task
▫ Frequency of requests for help
▫ Number of times facilitator provides assistance
▫ Number of times user gives up
Seminari d'Enginyeria de Serveis 14
15. Measures of Usability
Satisfaction (Pleasing to users)
▫ Positive and negative ratings on a satisfaction scale
▫ Percent of favorable comments to unfavorable comments
▫ Number of good vs. bad features recalled after test
▫ Number of users who would use the system again
▫ Number of times users express dissatisfaction or
frustration
Learnability (Ability to learn how to use site and remember it)
▫ Ratio of successes to failures
▫ Number of features that can be recalled after the test
Seminari d'Enginyeria de Serveis 15
16. Usability Testing Roles
Facilitator:
▫ Oversees the entire test process
▫ Plan, test, and report.
Participant:
▫ Actual or potential customer.
▫ Representative users (marketing, designers) avoided.
Observer (optional):
▫ Records events as they occur.
▫ Limits interaction with the customer.
▫ Does contribute to the report.
Seminari d'Enginyeria de Serveis 16
17. Testing Methods & Tools
Method/Tool Short description
Usability laboratory A room with computer equipment, a place for
an observer to sit and a special observation
area.
Web-based Online evaluation with live feedback from
users.
Thinking Aloud A test subject thinks aloud while navigating the
site.
Observation Visiting the users and observing them work.
Questionnaires Site or email questionnaires are an effective
way of measuring user satisfaction.
Seminari d'Enginyeria de Serveis 17
18. Testing Methods & Tools
Method/Tool Short description
Interviews Well suited to exploratory studies where one
does not know yet what one is looking for.
Focus groups Users are brought together to discuss new
concepts and identify important issues.
Heuristic evaluation Looking at an interface and trying to come up
with an opinion about pros and cons about it.
Log file analysis The computer automatically collect statistics
about the detailed use of the system.
User feedback Shows the immediate and pressing concerns, is
an ongoing process and is adapts quickly.
Seminari d'Enginyeria de Serveis 18
19. Usability Testing Process
Step 1: Planning The Usability Test
▫ Define what to test
▫ Define which customers should be tested
▫ Define what tasks should be tested
▫ Write usability scenarios and tasks
▫ Select participants
Step 2: Conducting The Usability Test
▫ Conduct a test
▫ Collect data
Step 3: Analyzing and Reporting The Usability Test
▫ Compile results
▫ Make recommendations
Seminari d'Enginyeria de Serveis 19
20. People – Context – Activities
Step 1: Planning The Usability Test
▫ Define what to test
• → Activities (Use Cases)
▫ Define which customers (user profiles) to be tested
• → People (Actors)
▫ Provide a background for the activities to test
• → Context
Seminari d'Enginyeria de Serveis 20
21. Usability Scenarios and Tasks
Provide the participant with motivation and context
to make the situation more realistic
Include several tasks:
▫ Make the first task simple
▫ Give a goal, without describing steps
Set some success criteria, examples:
▫ N% of test participants will be able to complete x% of tasks
in the time allotted.
▫ Participants will be able to complete x% of tasks with no
more than one error per task.
▫ N% of test participants will rate the system as highly usable
on a scale of x to x.
Seminari d'Enginyeria de Serveis 21
22. Example of Scenario with Tasks
Context:
▫ You want to book a sailing on Royal Caribbean International for
next June with your church group. The group is called “Saint
Francis Summer 2010”. The group is selling out fast, so you
want to book a cabin, which is close to an elevator because your
leg hurts from a recent injury.
Tasks to perform:
1. Open your browser
2. Click the link labeled “Royal Caribbean”
3. Tell me the available cabins in the “Saint Francis Summer
2010” group
4. Tell me a cabin number closest to an elevator
5. Book the cabin the best suits your needs
Seminari d'Enginyeria de Serveis 22
23. Selecting Participants
Recruit participants
▫ In-house
▫ recruitment firms, databases, conferences
Match participants with user profiles
Numbers: of participants, floaters
Schedule test sessions
Incentives:
▫ Gift checks ($100 per session)
▫ Food or gift cards
Seminari d'Enginyeria de Serveis 23
24. How Many Test Participants Are Required?
The number of usability problems found in a usability test
with n participants is: N(1-(1-L)n)
▫ N : total number of usability problems in the design
▫ L : the proportion of usability problems discovered while testing
a single participant.
For L = 31%
Seminari d'Enginyeria de Serveis 24
25. How Many Test Participants Are Required?
It seems that you need to test with at least 15 participants
to discover all the usability problems
However, is better to perform 3 tests with 5 participants
than to perform one with 15 participants:
▫ After the first test with 5 participants has found 85% of the
usability problems, you will want to fix them in a redesign.
▫ After creating the new design, you need to test again.
▫ The second test with 5 users will discover most of the
remaining 15% of the original usability problems that were
not found in the first test (and some new one).
▫ The new test will be able to uncover structural usability
problems that were obscured in initial studies as users
were stumped by surface-level usability problems.
▫ Fix the new problems, and test …
Seminari d'Enginyeria de Serveis 25
26. Usability Labs … Not Necessary
The testing room contains office The observer side contains a powerful
furniture, video tape equipment, a computer to collect the usability data
microphone and a computer with and analyze it. A one-way mirror
appropriate software. separates the rooms.
Seminari d'Enginyeria de Serveis 26
27. Usability Labs … Not Necessary?
Seminari d'Enginyeria de Serveis 27
29. Conducting Tests: Facilitator’s Role
Start with an easy task to build confidence
Sit beside the person not behind the glass
Use “think-out-loud” protocol
Give participants time to think it through
Offer appropriate encouragement
Lead participants, don’t answer questions (being an
enabler)
Don’t act knowledgeable (treat them as the experts)
Don’t get too involved in data collection
Don’t jump to conclusions
Don’t solve their problems immediately
Seminari d'Enginyeria de Serveis 29
30. Collecting Data
Performance
▫ Objective (what actually happened)
▫ Usually Quantitative
• Time to complete a task
• Time to recover from an error
• Number of errors
• Percentage of tasks completed successfully
• Number of clicks
• Pathway information
Preference
▫ Subjective (what participants say/thought)
▫ Usually Qualitative
• Preference of versions
• Suggestions and comments
• Ratings or rankings (can be quantitative)
Seminari d'Enginyeria de Serveis 30
31. Report findings and recommendations
Make report usable for your users
Include quantitative data (success rates, times, etc.)
Avoid words like “few, many, several”. Include counts
Use quotes
Use screenshots
Mention positive findings
Do not use participant names, use P1, P2, P3, etc.
Include recommendations
Make it short
Seminari d'Enginyeria de Serveis 31
32. Agenda
Introducing Usability
Usability Testing
Usability vs Aesthetics
Usability vs Accessibilty
Online Services: Beyond Usability
References
Seminari d'Enginyeria de Serveis 32
33. The evolution of culture marches with the
elimination of ornament from useful objects
Ornament und Verbrechen
Adolf Loos
(1870 - 1933)
Seminari d'Enginyeria de Serveis 33
35. Usability & Accessibility
Usability means designing websites to be effective, efficient,
and satisfying for most people
Accessibility makes sure it is effective, efficient, and satisfying
▫ for more people — especially people with disabilities —
▫ in more situations — including with assistive technologies,
mobile devices, and more.
The W3C’s Web Content Accessibility Guidelines (WCAG)
2.0, Authoring Tool Accessibility Guidelines (ATAG) 2.0,
and User Agent Accessibility Guidelines (UAAG) 2.0 provide a
stable set of accessibility requirements that can be met using
different techniques
Seminari d'Enginyeria de Serveis 35
37. A Service Science Perspective for
Interfaces of Online Service Applications [Pin08]
Seminari d'Enginyeria de Serveis 37
38. Online Services: Defining Features
The user does not control most means of production.
(resources, capital, and labor), therefore she cannot
determine
▫ when and how intensively resources are used
▫ where her information is stored and who can access it
▫ how much effort is put on a given task or goal
▫ what the cost of the service is and how it changes
The user (self, belongings, information) is a significant
part of the input to the production process,
▫ therefore the application behave as a service rather than a
manufacture.
Seminari d'Enginyeria de Serveis 38
39. Online Services: Beyond “Classical” Usability
“Classical”HCI evaluation and usability:
▫ determines typical usage scenarios of the device/product
▫ recreates in the laboratory meaningful test procedures.
Web applications required HCI practitioners to change some
techniques to cope with their special needs
Taking one step further, recognizing the specific characteristics
of online services in contrast to generic web applications will
allow the development of more appropriate tools
A new framework is proposed by considering 6 common
characteristics of services reported in the SSME literature:
customer-as-input, heterogeneity, simultaneity, perishability,
coproduction, and intangibility.
Seminari d'Enginyeria de Serveis 39
41. References
[NH06] Nielsen, J. and Loranger, H. 2006 Prioritizing Web
Usability. New Riders Publishing.
[Pin08] Pinhanez, C. 2008. A service science perspective for
interfaces of online service applications. In Proceedings of the
VIII Brazilian Symposium on Human Factors in Computing
Systems
www.useit.com (Jakob Nielsen)
www.usability.gov
Seminari d'Enginyeria de Serveis 41