This report summarizes usability testing conducted on the Victorian Deaf Society website. Testing focused on the Auslan course enrollment and online donation pages. Six participants completed tasks for each page and provided feedback. Results showed the donation page was moderately usable while the course page was slightly usable. Recommendations include consolidating course information, reorganizing the course timetable, and adding context for donations to improve usability.
This document analyzes the usability of Drupal's administrative tools based on usability guidelines and stakeholder reviews. It finds that Drupal adheres well to usability guidelines in its forms, receiving grades ranging from a B- to an A+. A stakeholder review also concludes that Drupal provides sufficiently usable tools to complete common administrative tasks to maintain a website. While Drupal has had usability issues, many are being addressed in subsequent releases. The overall analysis is that Drupal's tools are usable for common website administration.
The document summarizes the findings of a usability test conducted on the XXXXX.gov website. It identifies 4 main problems: (1) poor search results and lack of highlighted search terms, (2) unclear purpose and intended audience of the site, (3) accessibility issues violating Section 508, and (4) confusion about which links were internal/external. It provides recommendations for addressing each problem and improving the user experience and accessibility of the site. The document reports an overall task success rate of XX% and that X users participated in the usability testing.
Elizabeth Snowdon is a senior business analyst and consultant specializing in user-centered design with over 12 years of experience. Her presentation discusses prototyping and usability testing, noting that usability testing should occur throughout the product development lifecycle to identify and address usability issues. She outlines the benefits of usability testing and prototyping, such as creating more useful, efficient and satisfying products for users. The presentation provides guidance on planning, conducting and analyzing usability tests, including determining test objectives, recruiting representative users, developing test tasks and metrics to collect.
Intro talk on lean unmoderated user testing given at General Assembly, Los Angeles in spring 2013. Covers basics, benefits & limitations, when to test, what to test, and a case study.
UX - User Testing to Real Actions
"We need to do user testing"
"Okay, let's do it"
...a few moments later....
"We did it"
".....now what?"
Sound familiar?
This talk is going to be a collection of stories of how Carl turned research into action and how that benefited not only the users but the businesses he consulted for. These small businesses include companies like Adobe, Facebook and many interesting start-ups.
You will leave with a list of actions you can take based on user research data both from Qualitative and Quantitative testing. You will be surprised what you can learn and how it will help your products and or clients.
Google Chromecast Usability Report by Team User FriendlyReed Snider
This usability report for the Google Chromecast® was carried out by team User Friendly of the Bentley University Testing & Assessments course in the Human Factors in Information Design graduate program.
The Google chromecast product was given to a set of 45-80 year old participants who were instructed to simply "set up the device". This project was not organized by Google and all rights of the terms used are attributed to Google® under Alphabet®.
Optimizely Workshop: Mobile Walkthrough Optimizely
This webinar covered how to conduct A/B testing on mobile apps to address challenges like high user drop-off rates. It discussed setting up mobile experiments in Optimizely by making variations, setting audiences and traffic allocation, goals, and testing. Integrating A/B testing into the development process was also covered, with best practices like planning tests in sprints and using phased rollouts. The webinar aimed to explain how to set up and analyze mobile experiments to validate new features and improve key metrics.
This document analyzes the usability of Drupal's administrative tools based on usability guidelines and stakeholder reviews. It finds that Drupal adheres well to usability guidelines in its forms, receiving grades ranging from a B- to an A+. A stakeholder review also concludes that Drupal provides sufficiently usable tools to complete common administrative tasks to maintain a website. While Drupal has had usability issues, many are being addressed in subsequent releases. The overall analysis is that Drupal's tools are usable for common website administration.
The document summarizes the findings of a usability test conducted on the XXXXX.gov website. It identifies 4 main problems: (1) poor search results and lack of highlighted search terms, (2) unclear purpose and intended audience of the site, (3) accessibility issues violating Section 508, and (4) confusion about which links were internal/external. It provides recommendations for addressing each problem and improving the user experience and accessibility of the site. The document reports an overall task success rate of XX% and that X users participated in the usability testing.
Elizabeth Snowdon is a senior business analyst and consultant specializing in user-centered design with over 12 years of experience. Her presentation discusses prototyping and usability testing, noting that usability testing should occur throughout the product development lifecycle to identify and address usability issues. She outlines the benefits of usability testing and prototyping, such as creating more useful, efficient and satisfying products for users. The presentation provides guidance on planning, conducting and analyzing usability tests, including determining test objectives, recruiting representative users, developing test tasks and metrics to collect.
Intro talk on lean unmoderated user testing given at General Assembly, Los Angeles in spring 2013. Covers basics, benefits & limitations, when to test, what to test, and a case study.
UX - User Testing to Real Actions
"We need to do user testing"
"Okay, let's do it"
...a few moments later....
"We did it"
".....now what?"
Sound familiar?
This talk is going to be a collection of stories of how Carl turned research into action and how that benefited not only the users but the businesses he consulted for. These small businesses include companies like Adobe, Facebook and many interesting start-ups.
You will leave with a list of actions you can take based on user research data both from Qualitative and Quantitative testing. You will be surprised what you can learn and how it will help your products and or clients.
Google Chromecast Usability Report by Team User FriendlyReed Snider
This usability report for the Google Chromecast® was carried out by team User Friendly of the Bentley University Testing & Assessments course in the Human Factors in Information Design graduate program.
The Google chromecast product was given to a set of 45-80 year old participants who were instructed to simply "set up the device". This project was not organized by Google and all rights of the terms used are attributed to Google® under Alphabet®.
Optimizely Workshop: Mobile Walkthrough Optimizely
This webinar covered how to conduct A/B testing on mobile apps to address challenges like high user drop-off rates. It discussed setting up mobile experiments in Optimizely by making variations, setting audiences and traffic allocation, goals, and testing. Integrating A/B testing into the development process was also covered, with best practices like planning tests in sprints and using phased rollouts. The webinar aimed to explain how to set up and analyze mobile experiments to validate new features and improve key metrics.
Usability testing can help bridge the gap between developers, marketers, and stakeholders. Usability testing lets the design and development teams identify problems before they are coded. The earlier issues are identified and fixed, the less expensive the fixes will be in terms of both staff time and possible impact to the schedule. Usability testing is a great way to help teams prioritize website redesign efforts. In this session, we'll talk about the main types of usability tests and why it's better to usability test before deciding on making changes to the design. By conducting tests early, your team learns what to change. You'll learn what to keep. Usability testing early makes it easier to build the requirements, define the use cases, and even create QA test scripts, because you can drive all those things right off what you saw in the research. It will likely reduce your development costs because you’ll have data to make decisions, instead of driving everything off some strong-willed individual’s opinions of what users need. Pushing your user research as early as possible in the schedule is the best way to get value from your efforts.
Improve your content: The What, Why, Where and How about A/B Testingintrotodigital
A/B testing, also known as split testing, is a user experience research methodology where users are randomly split into two or more groups to see different versions of the same element. This presentation explains what is A/B testing, why you need it, where you can apply it and how to conduct an A/B test.
Optimization is a powerful tool that can increase performance, lower risk, and provide measurable results. Uncover the benefits of A/B and Multivariate testing in Web Analytics 101 – Optimization.
To build a successful A/B testing strategy, you'll need more than just ideas of what to test, you'll need a plan that builds data into a repeatable strategy for producing winning experiments.
Preparing for a Website Redesign | SEO DesignRaven Tools
The document provides tips for properly preparing for a website redesign by focusing on two key ingredients: preparation and communication. It recommends analyzing current site performance and structure, prioritizing goals like conversion rates and social interaction, user testing designs before and after, and benchmarking metrics like queries, engagement, and conversions to guide structural changes. The overall message is that redesigns do not need to be destructive if properly planned and informed by data analysis.
Elizabeth Snowdon is a senior business/web analyst consultant with over 10 years of experience conducting usability testing. The document discusses what usability is, why it matters, types of usability studies, how to plan and conduct a usability test. Key points covered include identifying target users, developing tasks for testing, observing and collecting feedback from users, and analyzing findings to identify problems and improve designs through an iterative process.
This document discusses website usability testing and user experience measurement. It outlines goals of creating an engaging user experience and compelling content to increase conversions. It then describes how to measure user experience through engagement and usability metrics, as well as qualitative feedback. The methodology section details creating test scenarios, identifying test subjects, running tests, analyzing data and improving based on findings. Specific tools are mentioned like visual analytics, engagement funnels, A/B testing and services like ClickTale, UserTesting.com and SilverBackApp for qualitative and quantitative user research.
Pros and Cons of A/B Testing (UX Camp Brighton 2013)Luke Hay
The document discusses the positives and negatives of A/B testing based on the author's experience over the past year. It notes that while A/B testing can be useful for small changes and clients like quantitative results, it also has limitations like taking a long time to get results, needing a lot of traffic, sometimes producing inconclusive results, and missing bigger picture user experience issues. The document recommends using A/B testing as part of a broader user testing plan, setting realistic expectations about limitations, and combining it with other qualitative and quantitative testing methods to gain a full understanding of users.
User testing is a fantastic method to discover problems. But why is it such a great user research method? How to make sure you recruit the right participants? How to write the right questions and tasks for your usability test? And what is your job as a moderator? This slide deck answers all your questions on usability testing!
The document outlines the typical process for designing and developing a website, including:
1) Information gathering such as interviews and requirements to understand goals and content.
2) Planning and specifications to outline design, functionality, and costs.
3) Design of templates, prototypes, and visual layout.
4) Development of HTML/CSS, forms, and other functionality.
“In God we trust, all others must bring data”. Intuition, experience and well known patterns may give us good indications of successful ideas and features, but nothing gets closer to the truth than data analysis and A/B testing. In this workshop, we’ll show how we do experimentation at Booking: what we test, how to get data through templates and JavaScript, and how we analyse the resulting metrics. We’ll live-code examples, see all potential caveats of dealing with the user tracking on the client-side, and show existent tools you can use to test your own ideas.
SXSW 2016 - Everything you think about A/B testing is wrongDan Chuparkoff
Everything you've learned about A/B Testing is based on the fundamentally flawed belief that there's one right answer. But the era of mass-market, one-right-answers is over. A/B Testing is our most valuable tool in the battle to create a more engaging web. But our strategy is broken. Don't worry, we can gain a better understanding of our users with a little data science. And we can reinvent A/B Testing... I will show you how.
At Civis Analytics, we specialize in Data Science. From here, we can clearly see that all people are not the same. So why are A/B Tests designed to search for a single solution? In this session I'll show you where A/B Testing is headed next. See you in Austin!
This document discusses A/B testing and provides guidance on how to implement it. It begins by explaining that A/B testing involves comparing two versions of the same marketing element, like a button or headline, to determine which performs better. It then outlines the full A/B testing process, including choosing an element to test, writing a hypothesis, setting up the test, analyzing results, and making changes based on the winner. Examples of elements that can be tested on webpages, emails, social media, and more are also provided. The document emphasizes that consistency is key for successful A/B testing.
Talks@Coursera - A/B Testing @ Internet Scalecourseratalks
This document discusses A/B testing at large internet companies. It describes how companies like Amazon, Microsoft, Google, and LinkedIn use A/B testing to evaluate new ideas, measure their impact, and gain customer feedback. It outlines best practices for A/B testing, such as running one experiment at a time, choosing appropriate metrics and statistical significance, properly powering experiments, and addressing issues like multiple testing. The document also describes the key components of a scalable A/B testing system, including experiment management, online infrastructure for traffic routing and data logging, and automated offline analysis.
Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and...SplitMetrics
This document discusses pretotyping as an alternative to app prototyping for validating mobile app ideas. Pretotyping involves creating mockups of an app's title, icon, description and screenshots to test with users before full development. It recommends using A/B testing platforms to compare different pretotype versions and elements like title, description and visuals to decide which idea or features to pursue. The document outlines how A/B testing works with pretotyping and common mistakes to avoid like testing for too short a time, with too small changes or misinterpreting results.
You should test that: How to use A/B testing in product designKelley Howell
This document discusses user experience (UX) testing, specifically A/B testing. It provides an overview of A/B testing, including that it involves creating two versions of a page and splitting traffic between them to see how users interact. The document outlines why testing is important, different types of testing tools, considerations for running a successful A/B test such as defining goals and metrics, and examples of famous A/B tests. It stresses that testing takes time and one should not expect overnight results.
A primer on AB testing and it's application in ecommerce. A necessary tool in every product manager's arsenal. Covers the principles behind setting up a good test and the statistical tools required to analyze results.
Optimizely Experience Customer Story - AtlassianOptimizely
Atlassian uses A/B testing to improve their products and website. They have a cross-functional growth hacking team that collects ideas and prioritizes experiments. Their process involves building test candidates, running experiments, and analyzing results. Some examples of tests they run include reducing friction, increasing visibility, and simplifying interfaces. Their philosophy is to test everything affecting conversions aggressively on a regular cadence.
This document summarizes the results of two rounds of usability testing for the Roomie online roommate matching platform. In the first round, 5 problems were identified and addressed. The prototype was updated and 10 new users participated in a second round, identifying 8 additional issues. Key findings included unclear pictures, complex forms, and missing navigation elements. Both quantitative metrics like task completion times and qualitative feedback helped optimize the prototype between rounds to improve the user experience.
Six participants took part in a usability test of the Ubuntu 8.04.1 operating system. They performed tasks like connecting to wireless networks, changing screen resolutions, and using applications. Participants struggled with some tasks but found others easy. While some saw potential in Ubuntu, most were hesitant to switch from Windows due to concerns about application compatibility and usability issues. The report identifies areas for improvement like more intuitive network settings and clearer menu labels.
Usability testing can help bridge the gap between developers, marketers, and stakeholders. Usability testing lets the design and development teams identify problems before they are coded. The earlier issues are identified and fixed, the less expensive the fixes will be in terms of both staff time and possible impact to the schedule. Usability testing is a great way to help teams prioritize website redesign efforts. In this session, we'll talk about the main types of usability tests and why it's better to usability test before deciding on making changes to the design. By conducting tests early, your team learns what to change. You'll learn what to keep. Usability testing early makes it easier to build the requirements, define the use cases, and even create QA test scripts, because you can drive all those things right off what you saw in the research. It will likely reduce your development costs because you’ll have data to make decisions, instead of driving everything off some strong-willed individual’s opinions of what users need. Pushing your user research as early as possible in the schedule is the best way to get value from your efforts.
Improve your content: The What, Why, Where and How about A/B Testingintrotodigital
A/B testing, also known as split testing, is a user experience research methodology where users are randomly split into two or more groups to see different versions of the same element. This presentation explains what is A/B testing, why you need it, where you can apply it and how to conduct an A/B test.
Optimization is a powerful tool that can increase performance, lower risk, and provide measurable results. Uncover the benefits of A/B and Multivariate testing in Web Analytics 101 – Optimization.
To build a successful A/B testing strategy, you'll need more than just ideas of what to test, you'll need a plan that builds data into a repeatable strategy for producing winning experiments.
Preparing for a Website Redesign | SEO DesignRaven Tools
The document provides tips for properly preparing for a website redesign by focusing on two key ingredients: preparation and communication. It recommends analyzing current site performance and structure, prioritizing goals like conversion rates and social interaction, user testing designs before and after, and benchmarking metrics like queries, engagement, and conversions to guide structural changes. The overall message is that redesigns do not need to be destructive if properly planned and informed by data analysis.
Elizabeth Snowdon is a senior business/web analyst consultant with over 10 years of experience conducting usability testing. The document discusses what usability is, why it matters, types of usability studies, how to plan and conduct a usability test. Key points covered include identifying target users, developing tasks for testing, observing and collecting feedback from users, and analyzing findings to identify problems and improve designs through an iterative process.
This document discusses website usability testing and user experience measurement. It outlines goals of creating an engaging user experience and compelling content to increase conversions. It then describes how to measure user experience through engagement and usability metrics, as well as qualitative feedback. The methodology section details creating test scenarios, identifying test subjects, running tests, analyzing data and improving based on findings. Specific tools are mentioned like visual analytics, engagement funnels, A/B testing and services like ClickTale, UserTesting.com and SilverBackApp for qualitative and quantitative user research.
Pros and Cons of A/B Testing (UX Camp Brighton 2013)Luke Hay
The document discusses the positives and negatives of A/B testing based on the author's experience over the past year. It notes that while A/B testing can be useful for small changes and clients like quantitative results, it also has limitations like taking a long time to get results, needing a lot of traffic, sometimes producing inconclusive results, and missing bigger picture user experience issues. The document recommends using A/B testing as part of a broader user testing plan, setting realistic expectations about limitations, and combining it with other qualitative and quantitative testing methods to gain a full understanding of users.
User testing is a fantastic method to discover problems. But why is it such a great user research method? How to make sure you recruit the right participants? How to write the right questions and tasks for your usability test? And what is your job as a moderator? This slide deck answers all your questions on usability testing!
The document outlines the typical process for designing and developing a website, including:
1) Information gathering such as interviews and requirements to understand goals and content.
2) Planning and specifications to outline design, functionality, and costs.
3) Design of templates, prototypes, and visual layout.
4) Development of HTML/CSS, forms, and other functionality.
“In God we trust, all others must bring data”. Intuition, experience and well known patterns may give us good indications of successful ideas and features, but nothing gets closer to the truth than data analysis and A/B testing. In this workshop, we’ll show how we do experimentation at Booking: what we test, how to get data through templates and JavaScript, and how we analyse the resulting metrics. We’ll live-code examples, see all potential caveats of dealing with the user tracking on the client-side, and show existent tools you can use to test your own ideas.
SXSW 2016 - Everything you think about A/B testing is wrongDan Chuparkoff
Everything you've learned about A/B Testing is based on the fundamentally flawed belief that there's one right answer. But the era of mass-market, one-right-answers is over. A/B Testing is our most valuable tool in the battle to create a more engaging web. But our strategy is broken. Don't worry, we can gain a better understanding of our users with a little data science. And we can reinvent A/B Testing... I will show you how.
At Civis Analytics, we specialize in Data Science. From here, we can clearly see that all people are not the same. So why are A/B Tests designed to search for a single solution? In this session I'll show you where A/B Testing is headed next. See you in Austin!
This document discusses A/B testing and provides guidance on how to implement it. It begins by explaining that A/B testing involves comparing two versions of the same marketing element, like a button or headline, to determine which performs better. It then outlines the full A/B testing process, including choosing an element to test, writing a hypothesis, setting up the test, analyzing results, and making changes based on the winner. Examples of elements that can be tested on webpages, emails, social media, and more are also provided. The document emphasizes that consistency is key for successful A/B testing.
Talks@Coursera - A/B Testing @ Internet Scalecourseratalks
This document discusses A/B testing at large internet companies. It describes how companies like Amazon, Microsoft, Google, and LinkedIn use A/B testing to evaluate new ideas, measure their impact, and gain customer feedback. It outlines best practices for A/B testing, such as running one experiment at a time, choosing appropriate metrics and statistical significance, properly powering experiments, and addressing issues like multiple testing. The document also describes the key components of a scalable A/B testing system, including experiment management, online infrastructure for traffic routing and data logging, and automated offline analysis.
Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and...SplitMetrics
This document discusses pretotyping as an alternative to app prototyping for validating mobile app ideas. Pretotyping involves creating mockups of an app's title, icon, description and screenshots to test with users before full development. It recommends using A/B testing platforms to compare different pretotype versions and elements like title, description and visuals to decide which idea or features to pursue. The document outlines how A/B testing works with pretotyping and common mistakes to avoid like testing for too short a time, with too small changes or misinterpreting results.
You should test that: How to use A/B testing in product designKelley Howell
This document discusses user experience (UX) testing, specifically A/B testing. It provides an overview of A/B testing, including that it involves creating two versions of a page and splitting traffic between them to see how users interact. The document outlines why testing is important, different types of testing tools, considerations for running a successful A/B test such as defining goals and metrics, and examples of famous A/B tests. It stresses that testing takes time and one should not expect overnight results.
A primer on AB testing and it's application in ecommerce. A necessary tool in every product manager's arsenal. Covers the principles behind setting up a good test and the statistical tools required to analyze results.
Optimizely Experience Customer Story - AtlassianOptimizely
Atlassian uses A/B testing to improve their products and website. They have a cross-functional growth hacking team that collects ideas and prioritizes experiments. Their process involves building test candidates, running experiments, and analyzing results. Some examples of tests they run include reducing friction, increasing visibility, and simplifying interfaces. Their philosophy is to test everything affecting conversions aggressively on a regular cadence.
This document summarizes the results of two rounds of usability testing for the Roomie online roommate matching platform. In the first round, 5 problems were identified and addressed. The prototype was updated and 10 new users participated in a second round, identifying 8 additional issues. Key findings included unclear pictures, complex forms, and missing navigation elements. Both quantitative metrics like task completion times and qualitative feedback helped optimize the prototype between rounds to improve the user experience.
Six participants took part in a usability test of the Ubuntu 8.04.1 operating system. They performed tasks like connecting to wireless networks, changing screen resolutions, and using applications. Participants struggled with some tasks but found others easy. While some saw potential in Ubuntu, most were hesitant to switch from Windows due to concerns about application compatibility and usability issues. The report identifies areas for improvement like more intuitive network settings and clearer menu labels.
Usability Testing for Survey Research:How to and Best Practicesegeisen
This presentation describes how usability testing of surveys can be used to improve data quality and reduce respondent burden. We describe what kind of surveys can be tested and when. We also provide practice advice for planning, conducting, and analyzing usability tests of surveys.
The document provides an overview of how to plan and conduct usability testing, including how to determine objectives and target users, create scenarios and tasks, recruit participants, moderate a test by briefing users and having them complete tasks while thinking aloud, and analyze the results to identify areas for improvement. The level of detail covers everything from creating a test plan and protocol to practical tips for interacting with users and taking observational notes during a test. The goal is to educate readers on how to perform low-cost, low-effort usability testing to diagnose usability issues early in the design process.
This document provides an overview of usability testing and highlights from its history. It discusses why usability testing is important and how even simple, qualitative testing can identify major usability issues. Examples of usability metrics like effectiveness, efficiency and satisfaction are given. The document then describes how to plan and conduct DIY usability tests with only a few participants through defining goals, tasks, recruiting testing and debriefing. It also discusses testing accessibility, mobile usability, and using tools like prototyping and A/B testing.
Samantha conducted usability tests on documents she redesigned for her aunt, a fourth grade teacher. She tested documents with parents and students separately. Parents wanted more information in the newsletter and handbook, like lunch menus and event calendars. Students enjoyed the colorful graphs but wanted the y-axis to start at 10% instead of 0%. Based on the feedback, Samantha plans to add requested information to the newsletter and change the graph formatting. The tests helped her improve the documents for their intended audiences.
This document summarizes the results of a usability study conducted on Stephen F. Austin State University's online calendar. 10 participants with varying demographics completed tasks on the calendar and provided feedback. Most found the calendar difficult to navigate due to its lengthy scrolling format without clear month separators. Recommendations include adding color, distinguishing month/day markers, and a more traditional monthly calendar view. The study aims to identify issues and help the university improve its online calendar system.
Grad1-YuanjingSun-CS5760Evaluation-UtestReport-Apr27Yuanjing Sun
This usability test report documents includes test of the Field Form web App http://www.csl.mtu.edu/classes/cs4760/www/projects/s15/group6/www/hci/. The test was carried out in Apr.14 to 16th 2015 by Team Justice League. It adapted paper-based USDA agriculture field condition criteria and evaluation method by using Field Form website. Local farmers can upload weekly report of weather observation, assessment of crop condition as well as GPS location. Such field data collection across 3000 counties in U.S. will have incredible values for stakeholders.
The document summarizes the findings of a usability study conducted on the Surgical Arts Centre website. Key findings include:
1. Users want more information about doctors' credentials, facility details, patient experiences and preparation/recovery processes. They care less about technical medical details.
2. Users highly trust review sites like Yelp over medical facility websites. The site should promote positive Yelp reviews.
3. Users have mixed reactions to the "Surgical Arts Centre" name and diverse service offerings. The branding and messaging may need refinement.
4. Users expect logistical support if traveling for treatment and want anonymity for plastic surgery. Outreach should promote package deals.
The document summarizes the results of usability testing conducted on the University of Central Arkansas' Writing Department website. Testing found several issues with consistency, organization, navigation and clarity of information across various pages of the site. Recommendations are provided to improve consistency of design, clarify intended audiences, reorganize the menu structure and content, and add more descriptive information and headings throughout the site.
eFolioMinnesota Text-Based Usability Test Findings and Analysis ReportKevin L. Glenz
The usability test report summarizes findings from usability testing of the text-based version of the eFolioMN website. Five visually impaired users tested six scenarios on the site. They found issues with content, terminology, and the user interface. Recommendations include improving directions, fixing accessibility issues, and making the interface more intuitive. The report provides details on the methodology, a breakdown of likes and dislikes, and analysis of post-task questions. It aims to help eFolioMN enhance the user experience for blind professionals.
This document summarizes usability testing conducted on the Roomie platform, which helps university students in Hong Kong find suitable roommates. Two rounds of testing were conducted with 10 participants total. The goal was to understand strengths and weaknesses of the prototype. Participants completed registration and roommate search tasks while thinking aloud. Both quantitative metrics like time spent and qualitative feedback were collected to analyze user experience and identify areas for improvement.
We test the site www.whirlpool.net.au and did a detail analysis on that website and tried to find the issues. This is our analysis and finding about the website and some recommendation to improve the design of the website.
Usability test report for inno ventureBrian Gaines
The usability test summary is as follows:
1) 10 participants completed tasks and surveys to evaluate the usability of the InnoVenture.com website.
2) Participants struggled with navigation, finding information, and completing tasks, averaging a score of 2.41 out of 4 on tasks.
3) The System Usability Scale survey scored the site even lower at a mean of 28 out of 100, below the threshold for usable.
4) Major issues identified included too much distracting text, difficulty navigating and locating information, and inconsistencies.
The document summarizes a usability evaluation of the U-Haul website conducted in April 2011. Five participants performed common rental and storage tasks while thinking aloud. The evaluation found that participants struggled to understand insurance coverage, estimate needed storage unit sizes, determine appropriate truck sizes, and find rental items. It provides recommendations to address these issues such as clarifying insurance information, helping estimate storage needs, and distinguishing rentals from purchases. The evaluation provided insights to improve the usability of key tasks and shopping experiences on the U-Haul website.
The Completed Quests page clearly shows the total points earned for each completed assignment as well as the total points earned for the course so far. Participants found this breakdown of points intuitive and helpful for understanding their progress in the class.
The usability test report summarizes testing of a mobile application. Five individuals used the app and provided feedback via surveys and interviews. Testers were mostly aged 20-25 and used Apple devices. The objectives were to find defects, ensure usability, and check if the app met requirements. Feedback indicated searching could be improved, fonts/colors needed adjusting, and navigation was difficult for older users. Recommendations included updating visual design, search features, and ease of use for all ages.
Usability Testing of the Czech Post Mobile Application (Case study)ExperienceU
This case study discusses usability testing of the Czech Post mobile application. Several test participants of varying ages used the app and provided feedback. Younger participants under age 40 were more comfortable exploring the app's features, while older participants age 40 and above were less familiar with their mobile phones in general. The testing uncovered opportunities to improve the intuitiveness and discoverability of features in the Czech Post app.
Student "visual" usability test report using Slidedoc format for instructional information design. 2016 student winner of college media lab mobile app instructional design competition.
The document provided will describe our research group’s findings pertaining to our usability test of
a newly created iteration of the IAKM public facing web site. The testing completed was performed
utilizing the ClearView eye tracking software to accurately monitor the user’s interaction on multiple
dimensions. The facility allowed us to work directly with the user, and monitor interaction via click
tracking, eye movement, audio and video. Combining those attributes, based on a time scale, our
research team was able to more accurately identify where the site changes were successful and where
they were not.
This document outlines a usability test plan for evaluating three Oregon Health Authority websites. The plan includes study objectives, research questions, methodology, tasks, and evaluation measures. Four teams will test different tasks on the websites and collect both quantitative and qualitative user data. The goal is to identify usability issues and areas for improvement to help make the websites more effective and accessible.
Because of confidentiality agreements the UXG will not show any of its actual work with clients. This report is a good example of the UXG approach, the methods, the expression of our critiques, and the action statements we propose for redesign.
The School of Informatics hosted technology employers (Cisco, Oracle, Disney Animation Technology, Intuit, etc) for a day to better express what IU's human-computer-interaction design program. As a member of the committee to design this interaction, we thought there was no better way to see our students in action, then to have our guests design for experience with us. This is the playful, situated, experiential design problem the committee created (and I put together and presented).
The School of Informatics hosted technology employers (Cisco, Oracle, Disney Animation Technology, Intuit, etc) for a day to better express what IU's human-computer-interaction design program. As a member of the committee to design this interaction, we thought there was no better way to see our students in action, then to have our guests design for experience with us. This is the playful, situated, experiential design problem the committee created (and I put together and presented).
The usability test report summarizes testing of a website designed to provide college students with information about managing their finances. Three participants completed tasks on the website and provided feedback. Test findings showed that participants found the site easy to navigate and would recommend it, but suggested slowing transitions between pages and making some content sections longer. The report recommends final revisions based on this user feedback to improve the accessibility and design of the financial website.
This document summarizes the methodology used to evaluate the usability of a university's English graduate studies website. The evaluation included performing individual assessments of the website using heuristics, interviewing the stakeholder to understand goals, and conducting usability tests with current and prospective students. Issues were identified and categorized as severe, major, moderate, or minor. Recommendations were provided to address the usability problems in each category. The conclusions emphasize that improving the usability and accessibility of information on the website can help promote the graduate program and better serve prospective and current students.
Andrewlewis multilib-phase2-report4-rbwm-2007-01-17Andrew Lewis
This document describes a pilot project to create an accessible talking comment form for children using Adobe Flash. The form was tested with various accessibility tools and users. It was found to be generally accessible and received positive feedback, though some limitations of interoperability between Flash and screen readers remained. The pilot demonstrated that Flash can be used to create an engaging and accessible service when designed with user needs in mind.
The usability test report summarizes tests conducted on the Ram Page website. Four participants were observed using eye tracking software as they freely navigated the website for 10 minutes. Both positive and negative feedback was gathered. Positively, pictures drew attention and functionality was good. Negatively, small font size made articles hard to read, event descriptions were confusing, and advertisements were ineffective and missed. The tests provided insights on improving reader engagement and navigation of the website.
This paper focuses on the effects of web page components on web page load time and how they can be modified to reduce load time. Website speed measuring software tools (EValid and YSlow), online website monitoring tools and a mathematical model was used to make quantitative and qualitative analysis on web page load time in relationship to web page content. This research showed that university X’s website loads slowly within an average of 9.766 seconds and may even fail to load as indicated by its average downtime of 9.32%. For application performance across the internet to improve, the website load time must be on average 8 seconds which increases the image of the site hence the perceived quality of services or products offered and thus increasing stakeholders’ satisfaction. The findings of the study revealed that an increase in total size of web page content components is directly proportional to increase in response time and web page content components have different effects on web page load time. The evidence in this study shows that web page load time is mainly affected by its web page content characteristics. The study recommends web developers to measure web page response time against threshold values such as the 8 second rule during designing and implementation of a web page and adapt techniques identified which reduce load time.
Why developing research software is like a startup (and why this matters)Neil Chue Hong
When we think about the software used in research and science, we might think of the commercial packages with thousands of users, or the millions of lines of code that support experiments such as the Large Hadron Collider, or indeed the millions of scripts written every day by researchers across the world to undertake simple tasks. What is clear is that modern research relies on software: a recent survey of UK researchers conducted by the Software Sustainability Institute reported that 92% of researchers used software, and 69% could not conduct their work without it. Millions of dollars are invested each year in supporting a quasi-industry of software production, with the equivalent of the full-spectrum from large multinationals and tiny cottage industries, but little is known about whether this is efficient or indeed appropriate. This talk will examine the similarities between the development of software in the research environment and the lifecycle of technology startup companies. It will also consider the driving factors behind adoption of software and the impact of software sustainability on the ability to conduct research.
Database Web Application Usability TestingTim Broadwater
TechSmithMoraewas used on a laptop computer to conduct usability testing of the newly designed WVU Libraries Database web application. This round of usability testing was internal and focused on WVU Libraries primary target audience.
The document compares two university student websites, Vandalweb and MyWSU, by having a user complete 10 common tasks on each site and evaluating them based on 5 metrics: effectiveness, efficiency, engagement, error tolerance, and ease of learning. For the first task of checking grades, Vandalweb made it extremely easy with obvious links, while MyWSU required searching through tabs and consulting help. For the second task of enrolling in classes, MyWSU provided a pleasant interface and quick links, while Vandalweb's registration process had many steps. Both sites allowed easy updating of contact information in the third task, though Vandalweb dedicated a whole tab to it.
Evaluating Perceived Quality of B-School WebsitesIOSR Journals
Websites are a window for the world for looking in most of the Information and a gateway for many activities. Websites are not only a necessity but also mandatory for B-Schools. A B-School Website serves as portal to all stakeholders in addition to being an information placeholder. The Websites serves from being an administrative tool to a Learning Management system. The utility and the effectiveness of website depend on the quality of the service it provides to the surfer. A study was undertaken to survey the various features of a B-School Website that could serve as a Quality Function Deployment (QFD) touchstones. In addition, the influence of perceived quality on the user satisfaction was also studied. A focus group of B-School Students evaluated the Websites and scored a checklist cum questionnaire. The results highlight the most frequently found features and the least found features of a B-School Website. The factors that are important for creating a quality website are also found. This study will help the B-school administrators and the Website designers to create a quality and satisfying Websites.
American Meridian University Quality Tool Series: The Fish Bone College/University
The Fish Bone:
Articulates the usage of a Fishbone Diagram
Explains how to develop a Fishbone Diagram
Demonstrates the development of a Fishbone Diagram
Research project, proposed, conducted, and reported on a usability study and evaluation of a website. Usability testing involves testing products, documentation, texts, or websites to see if they meet the needs of their users.
This document discusses the benefits of conducting usability testing with people who have disabilities as part of an organization's accessibility testing strategy. Usability testing can help prioritize issues found in accessibility reviews by focusing on tasks that users need to complete. Issues discovered during usability testing include both accessibility problems and usability problems not directly related to accessibility. Involving people with disabilities in usability testing can provide insights not discovered through automated and manual accessibility testing alone. The document provides recommendations for effective usability testing approaches.
This document summarizes a project that developed an online supported assessment environment using a wiki platform to improve completion rates for a Certificate IV in Frontline Management qualification. A team selected the Wetpaint wiki tool, adapted assessment materials, and piloted the online environment. The pilot saw a 90% successful completion rate. Benefits included increased learner motivation, coaching during assessment, and continual feedback. Issues around privacy, etiquette, and accessing the site were addressed. The client was impressed by the collaborative nature and coaching opportunities. The assessment model involved preparation, startup induction and training, a 6-week assessment period with support and feedback, and a completion week with surveys and outcomes.
Online surveys provide efficient, cost-effective, and versatile insights but also face challenges. The document discusses how the Gulf Research Panel addresses disadvantages by utilizing a pre-qualified database of over 60,000 oil and gas professionals. This specialized panel allows for quick, global data collection on industry trends through online surveys while maintaining respondent qualification and anonymity.
The Health and Environmental Research Online (HERO) database was designed by the National Center for Environmental Assessment to systematically organize and manage scientific literature used in EPA science assessments. Team HERO conducted a usability study involving 9 participants to evaluate the HERO website and identify areas for improvement. Participants completed tasks on the HERO website while researchers observed and collected feedback. Most participants found HERO fairly easy to use once familiar, but noted some aspects were not intuitive. Researchers aim to use study findings to enhance the usability and user experience of the HERO database and website.
Similar to Web Site Usability Test - Client Report - Victorian Deaf Society (Ver 1.... (20)
Web Site Usability Test - Client Report - Victorian Deaf Society (Ver 1....
1. Prepared by: ADGS Consulting - Monash University
Usability Test Client Report
Project:
Website Usability Assessment
Client:
Victorian Deaf Society (Vicdeaf)
Team:
Adrian Caceres
Greg Ortega
Steve Remington
Di Zhang
2. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 2
Commercial In Confidence
DOCUMENT INFORMATION
Document Details
Document Title:
Usability Test Client Report
Project Name
Website Usability Assessment
Document Version:
1.0
Document Date:
12/022014
File Name:
Client Report - Victorian Deaf Society (Ver 0.3).Docx
Document Authorisation
Prepared by:
Adrian Caceres; Greg Ortega; Steve Remington; Di Zhang
Authorised by:
Manoj Kathpalia; Julie Fisher
Prepared for:
Ms Lidia Risicato - Victorian Deaf Society (Vicdeaf)
Company Details
Name:
ADGS Consulting - Monash University
Address:
Monash University Caulfield Campus
Caulfield East, Victoria, 3165
3. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 3
Commercial In Confidence
EXECUTIVE SUMMARY
A usability test was conducted on the Auslan course enquiry and enrolment, and online donation functionality of the Vicdeaf website. These two areas of functionality were chosen after a discussion with Michael Parremore about concerns Vicdeaf had about the website. After a review of the website content and functionality two user scenarios and a set of tasks related to the areas of concern were developed.
The usability tests were conducted in the period 03/02/2014 to 08/02/2014. The test protocol required the participants to complete a small number of tasks related to each of the scenarios. The tests were observed by members of the project team. At the completion of the test the participants completed a questionnaire that sought their feedback on the overall usability of the functions tested and suggestions on how the functions of the site could be improved. Six participants were used for the test. The participants were members of the Victorian general public known to the project team members. Five of the participants completed the usability test for both scenarios and one participant only completed the tasks for the Auslan course scenario.
The test results indicated that the participants’ opinion of the usability of the online donation functionality was moderately positive (i.e. 3.6 out of 5.0), while the opinion of the Auslan course functionality was slightly positive (i.e. 3.4 out of 5.0). The responses to open ended questions about the online donation process showed that participants thought the process was generally easy to use however the information on the left side of the donation page is difficult to read, and that it would have been better if there was more obvious access to information about how Vicdeaf uses donations. The responses to the open-ended questions about the Auslan course information and enrolment process showed that participants found it difficult to find information about courses because the information is spread across many pages. Moreover, the layout of the course enrolment page made it difficult to find the particular course they wanted to enrol in.
Based on the test findings and best-practice website usability guidelines a five key changes to the Vicdeaf website are recommended. Additional minor recommendations are presented in the body of this report. The key recommendation are outlined below.
Recommendations – Auslan Course Registration
Create a single Auslan course information page that outlines the course levels, duration, typically available days / time, costs and available locations. The information should ideally be presented in the form of a set of “frequently asked questions” about Auslan courses.
Reorganise the Auslan course timetable so that it clearly shows level, location, date, time of day, and open or closed status of a course and present the information in a tabular format that make it easy for the user to scan. The format of the list should allow users to sort and filter the courses by each of the categories.
Simplify the Auslan course main page so that it only has three links below the video and introductory text, namely; “Course Information”, “Find a Course and Enrol” and “Gift Vouchers”
Recommendations – Online Donations
On the home page near the donation link add a link titled “Learn More” which will take the user to a page that briefly outlines how donations are used. The “Learn More” page should include a “Donate Now” link that takes the user to the existing online donation page.
Change either the font colour to the tone of the background image in the donation page to increase the readability of the information on the left side of the page.
4. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 4
Commercial In Confidence
TABLE OF CONTENTS
EXECUTIVE SUMMARY ................................................................ 3
TABLE OF CONTENTS ................................................................. 4
LIST OF TABLES ...................................................................... 4
1 Introduction .............................................................. 5
1.1 Purpose .................................................................... 5
1.2 Outcomes ................................................................. 5
1.3 Scope ....................................................................... 5
2 Description of the Test ............................................... 5
3 Summary of Results and Findings ................................ 6
3.1.1 Usability Test ............................................................. 6
3.1.2 Heuristic Evaluation .................................................... 7
3.1.3 General Observations ................................................. 7
4 Recommendations ..................................................... 8
Appendix 1 – Usability Test Detailed Results ......................... 10
LIST OF TABLES
Table 1: Scenarios and task used in the usability tests ............. 6
Table 2: Recommended usability changes and benefits ............. 9
Table 3: Summary of participant demographics ..................... 10
Table 4: Summary of participant experience statement responses ............................................................................. 10
Table 5: Summary of key themes mentioned in participants’ responses to open-ended questions ........................... 11
Table 6: Summary of results of heuristic evaluation of the Auslan course enrolment functionality based on Nielsen’s 10 Usability Heuristics for User Interface Design .............. 13
5. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 5
Commercial In Confidence
1 INTRODUCTION
1.1 Purpose
This document briefly describes the usability test on the Auslan course enquiry and enrolment and the online donation functionality on the Vicdeaf website, summarise the results and findings of that usability test and document recommended changes that will improve the usability of those areas of functionality.
1.2 Outcomes
The outcome of this document is Vicdeaf receiving a set of actionable recommendations that will improve the usability of the Auslan course enquiry and enrolment, and the online donation part of the Vicdeaf website.
1.3 Scope
The scope of this project is limited to two specific use scenarios on the Vicdeaf website, namely; Auslan course enquiry and enrolment, and online donation parts of the Vicdeaf website. All other parts of the website were not tested in this project.
2 DESCRIPTION OF THE TEST
The usability test method used for this project was a hybrid of the hallway testing and think-aloud protocols of usability testing. The hallway testing approach recruits a small random group of five or six participants who loosely match the profile of the core group of users of the website. Research has shown that the hallway testing approach can identify approximately 80% of the usability problems with a given website scenario. The think- aloud protocol is a variation of the typical usability testing approach in which the participants are asked to talk through the actions they are performing on the site. The think-aloud protocol helps the observer more clearly understand what the user is looking at, thinking, doing, and feeling as they go about the task.
The usability test involved two scenarios and related tasks. The choice of the functionality on the Vicdeaf website on which the scenarios were based resulted from a phone meeting discussion with Michael Parremore on Friday 30 January. Michael said that a recent review of web search analytics showed that many users were finding the Vicdeaf Auslan course page after searching for terms related to learning sign language in Melbourne, but only a small percentage of those users were enrolling in a course. Michael suggested that it would be good to test if there were any usability problems with the Auslan course part of the site. Michael also suggested that online donations were a growing source of income for Vicdeaf and that it would be useful to know if there are any usability problems in that part of the site.
After a review of the website functionality two scenarios and related tasks corresponding to the two areas of concern were developed. The specific text of the scenarios and the tasks is outlined in Table 1.
At the completion of the scenario tasks the participant was asked to fill in a questionnaire. The questionnaire was divided into three sections, namely; a demographics questions section that captured a few personal attributes of the participant, a website experience statements section that allowed the participant to indicate their overall rating of the usability of the site for the scenario, and an open-ended questions section that allowed the participant to give his or her opinion about and offer suggestions to improve the site.
6. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 6
Commercial In Confidence
Scenario Tasks
Online Donation
You have a friend who is deaf. In a recent conversation she told you how much the services provided by Vicdeaf have helped her through her life. You recently received a good pay rise at work and decided that you would regularly donate part of the pay rise you received to a charity that you like. After hearing about the work that Vicdeaf has done for your friend you decide to choose them as the charity you will support.
1. Find out how Vicdeaf uses the money from donations.
2. Establish a monthly donation of $35 using a credit card.
Enrolling for Auslan Course
A new colleague at your workplace is deaf and primarily communicates using “sign language”. You would like to communicate more effectively with your new work colleague and as a result you have decided to enrol for a course in sign language. Your work colleague told you that in Australia sign language is called “Auslan” (Australian Sign Language) and that Vicdeaf regularly runs Auslan courses in various suburbs in Melbourne. You decide to visit the Vicdeaf website to find out about and enrol on an Auslan course.
1. Find out what is the duration of the Auslan courses and how much do they cost.
2. Find out if there are any courses specifically related to learning Auslan to communicate with a work colleague. Make an enquiry to find out more information about the course.
3. Register for an Auslan class that runs on a weekend at a venue closest to where you live.
Table 1: Scenarios and task used in the usability tests
The usability test were conducted in the period 03/02/2014 to 08/02/2014. The tests were observed by members of the project team. Six participants used for the test. The participants were members of the Victorian general public known to the project team members. Five of the participants completed the usability test for both scenarios and one participant only completed the tasks for the Auslan course scenario. A breakdown of the participant demographics is shown in Table 3.
3 SUMMARY OF RESULTS AND FINDINGS
3.1.1 Usability Test
The ratings of the usability experience for each scenario showed that the participants, overall had a more positive experience with the online donation scenario compared to the Auslan course scenario. The key points from the experience ratings were:
In both scenarios the participants’ responses were moderately negative about the screens generally being too much information on the screen. This indicates that there is an opportunity to review the amount of content on these the pages.
The participants’ responses were slightly positive about the ease of use and visual appeal of the Auslan course pages. This indicates that there is an opportunity to improve the clarity of the content and layout of these pages.
For a more detailed breakdown of the usability experience ratings refer to Table 4 in Appendix 1.
The participants generally had positive comments about the usability of the online donation scenario. It was generally considered easy to make a donation. A few users, however, commented on the difficulty they had finding information about how Vicdeaf
7. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 7
Commercial In Confidence
uses money from donations. On participant summarised it thus: “You must first make the decision to donate to understand / obtain information on how Vicdeaf use the donations”. The participants’ comments about the Auslan course scenario were on the other hand more generally more negative. The common themes raised in the comments were:
The information about the Auslan courses is unnecessarily spread across too many pages, and sometimes pages on a similar topic present inconsistent information.
It was difficult to find out if the desired type of course, is available at the desired location on the desired day.
Even when the desired course was found the participant often clicked on the registration link only to find that the course was full.
The general feeling of the participants about the usability of the Auslan course scenario was summarised thus: “Couldn’t find all the information together. Not all links were working”. A summary of the themes raised by the participants’ responses to the open- ended questions is presented in Table 5 in Appendix 1.
3.1.2 Heuristic Evaluation
In light of the usability issues identified in the Auslan course scenario a heuristic evaluation of the Auslan course scenario pages was conducted to provide an alternate and wider ranging assessment of the usability issues on the relevant web pages. The results confirmed the findings of the participants’ usability test. In particular the heuristic evaluation identified the following key issues:
Related information (e.g. course types, location and cost) is spread over many different pages which requires the user to rely too heavily on remembering what is on each different page to fully understand the details of the course offered.
The current course list page does not advise the user if the course is full until the user clicks on the course resulting in unnecessary clicks and potential frustration for the user.
The course registration page allows the user to submit the page before all required field are filled in. A better user experience would be achieved if the form submission is prevented until all required fields are filled in.
The fully documented results of the heuristic evaluation, including severity rating of the issues found is presented in Table 6 in Appendix 1.
3.1.3 General Observations
While watching the participants conducting the usability tests the observers identified a small number of technical issues with the website that should be addressed. The key items are outlined below:
When the user is directed to the online donation and course registration pages provided by bCommerce the links in the top menu bar and the search field return an error page from bCommerce web server when clicked.
A number of links on the Auslan course pages (e.g. course timetable link, and some of the links in the page “breadcrumb” trail) redirect the user to pages served from the Bliss Media staging web server.
The page “breadcrumb” trail on some of the Auslan course pages do not accurately reflect the position of the page in the site hierarchy.
8. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 8
Commercial In Confidence
4 RECOMMENDATIONS
Based on the findings outlined in the previous section and best-practice website usability guidelines we make the recommendations as outlined in Table 2 below. Recommended Change Benefit of Change Scenario: Enquiring About and Registering for Auslan Courses
Create a single Auslan course information page that outlines the course levels, duration, typically available days / time, costs and available locations.
Present the information in the form of a set of “frequently asked questions” about Auslan courses. Using this format would present users with information is a format that they are familiar with from other websites.
Presenting information about Auslan course to user this way means that it is possible to find all information from a single page.
A single course information page will provide a more targeted page for search engines to land on when search terms such as “learn sign language Melbourne” are used.
Reorganise the Auslan course timetable so that it clearly shows level, location, date, time of day, and open or closed status.
Present the information in a clear tabular format that make it easy for the user to scan. Ideally the list of courses should be (a) sortable by the user on each of the categories, and; (b) filterable by the user (e.g. only show me level 1 course on the weekend).
Do not show other course information on this page, but rather provide links to the above course information page.
Presenting the course timetable in this format with sorting and filtering options will make it easy for the users to find and register for exactly which course they need.
If it is easy for users to find the course and then register then there will be a reduced level of user frustration and site abandonment.
Present the information about and purchase of the Auslan course gift vouchers on a separate page and remove information about gift vouchers from the course list page.
Presenting the Auslan course gift voucher information on a separate page will make it clear that a person is paying for a course sometime in the future rather than enrolling in a specific course.
Reduce the number of image links below the welcome video and introductory text on the Auslan course. The reduced set of image links should be:
o Course Information
o Find a Course and Enrol
o Gift Vouchers
Reducing the image links on the Auslan course main page will not only align the links with the above recommend changes, but also simplify the page and bring it more in line with how most users would approach obtaining information about and enrolling for courses. Scenario: Making and Online Donation
On the home page near the donation link add a link titled “Learn More” which will take the user to a page that briefly outlines how donations are used. The “Learn More” page should include a “Donate Now” link that takes the user to the existing online donation page.
Adding this page will allow potential donor to quickly find out how their money will be used without the perceived pressure of the online form. If the user likes what they read he/she can in one click go directly to the donation page.
9. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 9
Commercial In Confidence
Recommended Change Benefit of Change
Change either the font colour to the tone of the background image to increase the readability of the information on the page.
Making this change will make it easier for a potential donor find out more detail about how donations to Vicdeaf are used. Moreover, research has shown that a user will read more information on a web page and are more likely to complete a transaction if the page is well laid out easy to read. General Site Issues
Change the Vicdeaf site main menu bar that is displayed on the bCommerce e- commerce pages (e.g. course registration and donations) so that the links return the user to the correct pages on the Vicdeaf site.
Correct the small number of links on the site that are pointing to the Bliss Media staging server.
Update the format of the “breadcrumb” trail links so that it more accurately reflect the position of the page on the site.
Making these changes, particularly correcting the e-commerce links will reduce the chance of users seeing unnecessary and confusing error messages. Moreover eliminating these errors will increase the trust that the user has in the Vicdeaf site generally but in the e-commerce parts of the site specifically.
Table 2: Recommended usability changes and benefits
10. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 10
Commercial In Confidence
APPENDIX 1 – USABILITY TEST DETAILED RESULTS
Participant Demographic Attributes Scenario Auslan Course (Count) Online Donation (Count)
Gender
Male (2) | Female (4)
Male (2) | Female (3)
Age Group
18-34 (3) | 35-49 (3)
18-34 (3) | 35-49 (2)
Internet Experience
Some (1) | Extensive (5)
Some (1) | Extensive (4)
Vicdeaf Experience
None (5) | Limited (1)
None (5)
Table 3: Summary of participant demographics
Participant Experience Statements Scenario Auslan Course (Average Score) Online Donation (Average Score)
1. I found the layout of the website easy to understand. 3.2
4.0
2. The design of the website is appealing. 3.2
4.0
3. When assessing the information, the number of steps required was acceptable.
3.8
4.0
4. It was easy to navigate through the website.
3.5 3.4
5. I did not get lost when completing the task.
3.8
3.6
6. The information of the page was effectively laid out.
3.3
3.8
7. Generally there was too much information on the screen. 3.2 2.6
Note: Shaded scores are two worst scores for each scenario.
Table 4: Summary of participant experience statement responses
11. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 11
Commercial In Confidence
Open-Ended Question Auslan Course Online Donation
1. Were you able to easily complete the task set? If yes, what aspect(s) of the site helped you complete the task? If no, what aspect(s) of the site made it difficult complete the task?
Yes
o It is easy to find course related information the home page
No
o Purpose of gift voucher is confusing
o Auslan page very confusing. There is a lot of information in spread across many places
o Hard to find a weekend course
Yes
o Easy to find donation and make an online donation
No
o It is not easy to find how donation money is used without directly to the donate page
o Could not find link to donation page on menu
2. What was the one element of the website that you feel made it easier for you to complete the task(s)?
There was none
Radio buttons to select payment options
The main Auslan page is specific
The donation image link was easy to find
The site menu is useful after the home page
Filling donation details was easy
3. If you could change one thing about the website that would make your experience better, what would it be?
Improve layout of the course timetable
Group related course information together
Reduce size of banner on home page as it distracts from main image links below it
Focus less on appearance more on content
Change white text on light coloured background on donation page
Too many distracting colours on the home page
Make more obvious on home page link to information on how donations are used
4. Were there any elements of the website that caused confusion or slowed down your retrieval of information when completing the task? If yes, please explain what it was and why.
Inconsistent link destinations
Repeated but inconsistent information
The menu links on all four edges of the pages
Lack of clarity on status of courses
It is not clear what types of course are available
Distracting content on the home page
The frequency options
It is possible to set an expiry date that in the past
No instructions on the donation page
Not clear on pages other than the donation page how donations are used.
5. Are there any other comments or suggestions about the website that you would like to add?
Move main link images on home page to above banner
Clearer presentation of course information
Make the site less fancy
Search option in multiple place on home page
Inconsistent colour of donate image on home page and other pages.
No images on the home page makes it feel impersonal
Table 5: Summary of key themes mentioned in participants’ responses to open-ended questions
12. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 12
Commercial In Confidence
Nielsen’s Usability Heuristic Issue Location Issue Details Issue Severity
Visibility system of status
Course registration form
Auslan courses list
Form field error messages should be displayed next to the fields that causes the error, not as a list at the top.
User should not be able to click on a course that is not available or full.
1
2
Match between the system and the real world
Auslan courses list
Grammar mistake, “To register in class”, reads as one can register yourself on the day of the course.
1
User control and freedom
Information for a specific Auslan course and location
The breadcrumb trail does not show the previous page
2
Consistency and standards
When an Auslan course is full
When an Auslan course is full
When clicking on “back to events” link, the page layout of the course list changes. Register and enrol buttons confuse the user
The contact us and make an enquire page have a different page layout.
2
2
Error prevention
Course Registration form
Course Registration form
Auslan course list
Proceed to payment button should not be active if the fields are not filled in
There is no confirmation dialog before registering and payment. When alternate payment options.
There is no map for the new St Kilda course location.
2
2
1
Recognition rather than recall
Enquire or contact about a specific course that is full or not available
The form should be pre filled with the course information that the user is enquiring about.
2
Flexibility and efficiency of use
No issue identified
Not relevant to this case
0
Aesthetic and minimalistic design
Auslan courses list
Button colours for new course locations and gift vouchers should be different because they serve different purposes.
1
Help users recognise, diagnose and recover from errors
Course Registration form
Form field error messages should be displayed next to the fields that causes the error, not as a list at the top.
1
13. ADGS Consulting - Monash University Usability Test Client Report
Victorian Deaf Society (Vicdeaf) Website Usability Assessment
Date: 12/02/2014 Version: 1.0 Page 13
Commercial In Confidence
Nielsen’s Usability Heuristic Issue Location Issue Details Issue Severity
Help and documentation
Course Registration form
Auslan courses list
Auslan Course Information
Message reads click “Enquire” for more payment options, but there is no enquire button or link.
The course list should not show courses that are not available, or that are full.
Related information (e.g. course types, location and cost) is spread over many different pages
2
1
3
Issue Severity Rating
0. There is no usability problem.
1. Cosmetic problem only: Need to fix only if time permits.
2. Minor usability problem: fixing this should be given low priority.
3. Major usability problem: important to fix, so should be given high priority.
4. Usability catastrophe: imperative to fix this before product can be released
Table 6: Summary of results of heuristic evaluation of the Auslan course enrolment functionality based on Nielsen’s 10 Usability Heuristics for User Interface Design