SlideShare a Scribd company logo
HEURISTIC
EVALUATION
Kent State University
Registrar System
1
Kent State University has one the largest regional systems in the country, with an
eight-campus system in the northeastern area of Ohio. More than 22,000 students
use the University’s registrar system at least two times a year.
The mission of the Kent State University Registrar office is to explore new
modern design alternative, to make the user interface of the registration sys-
tem, and to make it easier to use.
The heuristic evaluation of the current system was conducted by four evalua-
tors who assessed the overall usability and effectiveness of the interface, using a
numerical scoring system.
Evaluators:
•	 Shannon Boone
•	 Nick Gonzales
•	 Jennifer Nickloy
•	 Michael Saylor
Evaluations Criteria:
The Kent State University register system evaluation was performed by four reviewers
who examined the interface and judged its compliance by using following seven of the
ten usability principles developed by Jakob Neilson.
	 •	 Visibility of System Status
	 •	 User Control and Freedom
	 •	 Consistency and Standards
	 •	 Recognition Rather than Recall
	 •	 Aesthetic and Minimalist Design
	 •	 Help, Documentation, Recovery from Errors
	 •	 Language
EVALUATION
Method:
Each evaluator answered each question one a scale of zero to two.
0 = poor
1 = good
2 = excellent
Raw scores of all evaluators were collected and also the overall medians for each
category. The full list of questions, scores, and medians is located in the
Appendix section.
INTRODUCTION
HEURISTIC
EVALUATION
Kent State University
Registrar System
2
Visibility of System Status
Score: 0 – poor
Reviewers felt the website lacked a good visibility of the system’s status. The pages
did however have clear elements such as headers and sub-headers, but failed to let
the user know where they were on the site due to the fact there is no visible bread-
crumb. The site had inconsistencies with the “return to previous” option on their
pages. The Class Search page is difficult to navigate, and uses a lot of acronyms
that are hard to decipher.
User Control and Freedom
Score: 1.75 – excellent
In the User Control and Freedom category, the reviewers felt the site performed well
in this section. The site as a whole doesn’t use unnecessary technologies, and it’s clean
and assessable. The “Back to Student Tools” and “Courses tab” are always visible and
can be accessed at top of the page. The graphics icons did fail to show the text when
you click or hover over them.
Consistency and Standards
Score: 1 – good
Reviewers felt the font sizes are inconsistent across browsers, the menu and the tab
options were excellent, but the site failed to notify user of supported browsers. For
the most part the labels matched the destination page, but there was a minor differ-
ence in one instance.
Reviewers comment:
While most labels match destination page titles and headers, the following page titles
slightly differ from the link label:
• Change Course Options (link label) becomes Change Class Options (header)
• View Course Descriptions (link label) becomes Detailed Course Information (header)
Recognition Rather than Recall
Score: 0.75 - good
Reviewers felt actions are not always clear, and actions sometimes get buried in very
heavy content.
Reviewer’s comments:
Multiple Click Here links. User is forced to read the entire paragraph instead of be-
ing able to quickly scan for a link and know where it will take you.
Aesthetic and Minimalist Design
HEURISTIC
EVALUATION
Kent State University
Registrar System
3
Score: 1 – good
Reviewers felt the site was outdated and there is a use of a lot of unnecessary symbols,
however the site is a good example of minimalist design by the use of limited color
distractions.
Reviewer comment:
The site uses black for text, red for important information, blue for links and
various colors for graphic icons. Table headers are light gray, which helps break
up sections. Limited color distractions.
Help, Documentation, Recovery from Errors
Score: 1 – good
Reviewers felt the site had some critical errors, there is no FAQ present, and
search function is only available for looking up classes, but the “Site Map” link is
readily available at the top right of each page.
Reviewers comment:
Critical error discovered on the “Check Registration Status” page. When a user
selects a term, they are taken to a registration status page. There is no “return to
previous page” option, so when a user tries to go back using the browser back ar-
row, they are automatically signed out of their session. The same error occurs on
the “Change Class Options” page.
Language
Score: 1.5 – excellent
Reviewers felt the vocabulary was appropriate for college aged audiences, but can
be intimidating due to the amount of instructions when looking up a class.
SUMMARY
Overall Instrument Median Score: 1 –Good
Overall the Kent State University’s registrar site scored good on four principles,
excellent on two, and one poor for the Visibility of System Status principle.
Below are the sites strengths and weaknesses.
Strengths
	 •	 Doesn’t use unnecessary technologies, clean and assessable
HEURISTIC
EVALUATION
Kent State University
Registrar System
4
	 •	 Limited color distractions
	 •	 “Site Map” link is readily available
	 •	 Clear elements such as headers and sub-headers
	 •	 Appropriate language
Weaknesses
	 •	 No breadcrumbs
	 •	 Site is outdated
	 •	 Heavy content
	 •	 No FAQ
	 •	 Inconsistent return options
Recommendations
Notify user of browser version required:
When the user first log on there is should be a message to clearing indicate the
browser version required to use the site.
Look up class option
Make this simpler more streamlined. A lot of text of instructions is at the top and
it’s a lot to read, so to make it more clean, it’s recommended to us less acronyms
and less options. Also on this page, when make the error of not selecting a re-
quired option is made, pointing out the error to the user is less frustrating, than
what is currently happening where all the options selected is erased and the user
has to start over.
Clean up design and make is more assessable
The colors a great but the fewer icons will clean it up a bit and make less over-
whelming. Also any symbols or images should have text when hovered or clicked.
APPENDIX
HEURISTIC
EVALUATION
Kent State University
Registrar System
5
Visibility of System Status
1. It is easy to know the current location within the overall map of the site.		 0 0 0 0	 0
2. It is clear what information is available at the current location.		 1 2 2 1	 1.5
3. The current information matches what you expect to find.			 2 1 2 1	 1.5
4. It is clear where you can go from the current location.			 0 0 0 0	 0
5. It is always clear what is happening from each action you perform.		 0 0 0 0	 0
User Control and Freedom
6. It is always easy to return to the Home Page.				 2 1 2 1	 1.5
7. It is easy to access all major portions of the site from the Home Page.		 2 2 2 2	 2
8. No unnecessary technologies are used.					 2 1 2 2	 2
9. Graphic links are also available as text links.				 1 0 2 1	 1
User Control and Freedom
10. Links are used and appear in standard web style.				 0 1 2 0	 0.5
11. Menus are used and appear in standard web style.				 2 2 2 1	 2
12. The site supports all major browsers.					 0 1 1 2	 1
13. There is clear notification if special technologies
or browser versions are required.					 0 0 0 0	 0
14. Link labels match destination page titles or headers.			 1 1 2 2	 1.5
15. Overall, the site behaves like one would expect a web site to behave.		 1 1 2 0	 0.5
Recognition Rather than Recall
16. Available actions are always clearly presented.				 0 0 1 1	 0.5
17. Labels and links are described clearly.					 0 1 1 1	 1
Aesthetic and Minimalist Design
18. The site structure is simple and clear without any unnecessary complications.	 0 0 0 0	 0
19. There are no instances of extraneous information.				 0 1 1 0	 1
20. There are no instances of misplaced information.				 1 1 1 2	 1
21. Color choices allow for easy readability.					 1 1 1 1	 1
22. The site is aesthetically pleasing.						 1 0 1 0 	 0.5
Help, Documentation, Recovery from Errors
23. A site map or other navigational assistance is always readily available.		 1 2 2 1	 1.5
24. If needed, an FAQ is available.						 0 1 2 0 	 0.5
25. No errors occur unnecessarily.						 1 0 0 1	 0.5
26. If necessary, a search function is readily available.				 0 0 1 0	 0
27. If necessary, error messages are clear and in plain language.			 0 1 2 1	 1
28. It is easy to cancel or exit from operations.				 0 0 1 1	 1
29. It is easy to contact support through email or a web form.			 1 1 1 1	 1
Language
30. The content language is clear and simple.					 1 1 2 1	 1
31. The vocabulary is appropriate for the intended audience.			 1 2 2 2	 2
Overall Instrument Median					1
Reviewers
1 2 3 4
Median

More Related Content

Viewers also liked

Lab fizik kmj compressed
Lab fizik kmj compressedLab fizik kmj compressed
Lab fizik kmj compressed
sscfbackup
 
Answer to Q D - Santiago Pelaez
Answer to Q D - Santiago PelaezAnswer to Q D - Santiago Pelaez
Answer to Q D - Santiago Pelaez
Santiago Peláez Acevedo
 
MOKOInvestorPresentationAug2016
MOKOInvestorPresentationAug2016MOKOInvestorPresentationAug2016
MOKOInvestorPresentationAug2016
Shripal Shah
 
Shaina Birbalsingh - PPP
Shaina Birbalsingh - PPPShaina Birbalsingh - PPP
Shaina Birbalsingh - PPP
Shaina Ashley
 
Mmc
MmcMmc
Scratch Scratch lo mejor
Scratch Scratch lo mejorScratch Scratch lo mejor
Scratch Scratch lo mejor
scratchsalicru
 
Bernard L
Bernard LBernard L
Bernard L
Bernard Carter
 
Kimia 2007 pspm
Kimia 2007 pspmKimia 2007 pspm
Kimia 2007 pspm
sscfbackup
 
MUHAMMAD BILAL CURRICULUM VITAE APPLY
MUHAMMAD BILAL CURRICULUM VITAE APPLYMUHAMMAD BILAL CURRICULUM VITAE APPLY
MUHAMMAD BILAL CURRICULUM VITAE APPLY
MUHAMMAD BILAL
 
Math 2007 pspm4
Math 2007 pspm4Math 2007 pspm4
Math 2007 pspm4
sscfbackup
 
Web services SOAP
Web services SOAPWeb services SOAP
Web services SOAP
princeirfancivil
 
Kimia 2012 ups
Kimia 2012 upsKimia 2012 ups
Kimia 2012 ups
sscfbackup
 
Informe actividades academicas (1)
Informe actividades academicas (1)Informe actividades academicas (1)
Informe actividades academicas (1)
anasol39
 
Project Hap780
Project Hap780Project Hap780
Project Hap780
ALOK SAGAR
 
target_individuals (2)
target_individuals (2)target_individuals (2)
target_individuals (2)
Jeffrey Buddle
 

Viewers also liked (15)

Lab fizik kmj compressed
Lab fizik kmj compressedLab fizik kmj compressed
Lab fizik kmj compressed
 
Answer to Q D - Santiago Pelaez
Answer to Q D - Santiago PelaezAnswer to Q D - Santiago Pelaez
Answer to Q D - Santiago Pelaez
 
MOKOInvestorPresentationAug2016
MOKOInvestorPresentationAug2016MOKOInvestorPresentationAug2016
MOKOInvestorPresentationAug2016
 
Shaina Birbalsingh - PPP
Shaina Birbalsingh - PPPShaina Birbalsingh - PPP
Shaina Birbalsingh - PPP
 
Mmc
MmcMmc
Mmc
 
Scratch Scratch lo mejor
Scratch Scratch lo mejorScratch Scratch lo mejor
Scratch Scratch lo mejor
 
Bernard L
Bernard LBernard L
Bernard L
 
Kimia 2007 pspm
Kimia 2007 pspmKimia 2007 pspm
Kimia 2007 pspm
 
MUHAMMAD BILAL CURRICULUM VITAE APPLY
MUHAMMAD BILAL CURRICULUM VITAE APPLYMUHAMMAD BILAL CURRICULUM VITAE APPLY
MUHAMMAD BILAL CURRICULUM VITAE APPLY
 
Math 2007 pspm4
Math 2007 pspm4Math 2007 pspm4
Math 2007 pspm4
 
Web services SOAP
Web services SOAPWeb services SOAP
Web services SOAP
 
Kimia 2012 ups
Kimia 2012 upsKimia 2012 ups
Kimia 2012 ups
 
Informe actividades academicas (1)
Informe actividades academicas (1)Informe actividades academicas (1)
Informe actividades academicas (1)
 
Project Hap780
Project Hap780Project Hap780
Project Hap780
 
target_individuals (2)
target_individuals (2)target_individuals (2)
target_individuals (2)
 

Similar to boone_assignment 6

Essential User Experience Skills
Essential User Experience SkillsEssential User Experience Skills
Essential User Experience Skills
Rachel Peters
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
John Sorflaten, PhD, CUXP
 
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
JosephHowerton
 
Heuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour WebsiteHeuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour Website
fabiolaeinhorn
 
Usability review
Usability reviewUsability review
Usability review
sayedshiban
 
IKEA UX Research Study
IKEA UX Research StudyIKEA UX Research Study
IKEA UX Research Study
KailiMartin1
 
Intro to ux and how to design a thoughtful ui
Intro to ux and how to design a thoughtful uiIntro to ux and how to design a thoughtful ui
Intro to ux and how to design a thoughtful ui
Thanos Makaronas
 
Accessibility for Fun and Profit
Accessibility for Fun and ProfitAccessibility for Fun and Profit
Accessibility for Fun and Profit
Mike Wilcox
 
IWMW 2007: Usability Testing for the WWW
IWMW 2007: Usability Testing for the WWWIWMW 2007: Usability Testing for the WWW
IWMW 2007: Usability Testing for the WWW
IWMW
 
Usability Guidelines
Usability GuidelinesUsability Guidelines
Usability Guidelines
homeplate31
 
Background research
Background researchBackground research
Background research
nitish
 
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran KajaEVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
Evolve The Adobe Digital Marketing Community
 
Advanced Internet
Advanced InternetAdvanced Internet
Advanced Internet
Peter Mosley
 
香港六合彩 » SlideShare
香港六合彩 » SlideShare香港六合彩 » SlideShare
香港六合彩 » SlideShare
biyu
 
Web+Design+Guide[1]
Web+Design+Guide[1]Web+Design+Guide[1]
Web+Design+Guide[1]
Anis Chief
 
Design Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation SchemesDesign Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation Schemes
Inductive Automation
 
Design Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation SchemesDesign Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation Schemes
Inductive Automation
 
webdesign.ppt
webdesign.pptwebdesign.ppt
webdesign.ppt
RavneetSingh343801
 
Fundamentals of Web Design | Chandan Chakraborty
Fundamentals of Web Design | Chandan ChakrabortyFundamentals of Web Design | Chandan Chakraborty
Fundamentals of Web Design | Chandan Chakraborty
Chandan Chakraborty
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability Evaluation
Saqib Shehzad
 

Similar to boone_assignment 6 (20)

Essential User Experience Skills
Essential User Experience SkillsEssential User Experience Skills
Essential User Experience Skills
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
 
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
The Freecycle Network (Expert Evaluation: Heuristic Evaluations and Cognitive...
 
Heuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour WebsiteHeuristic Analysis - PBS Newshour Website
Heuristic Analysis - PBS Newshour Website
 
Usability review
Usability reviewUsability review
Usability review
 
IKEA UX Research Study
IKEA UX Research StudyIKEA UX Research Study
IKEA UX Research Study
 
Intro to ux and how to design a thoughtful ui
Intro to ux and how to design a thoughtful uiIntro to ux and how to design a thoughtful ui
Intro to ux and how to design a thoughtful ui
 
Accessibility for Fun and Profit
Accessibility for Fun and ProfitAccessibility for Fun and Profit
Accessibility for Fun and Profit
 
IWMW 2007: Usability Testing for the WWW
IWMW 2007: Usability Testing for the WWWIWMW 2007: Usability Testing for the WWW
IWMW 2007: Usability Testing for the WWW
 
Usability Guidelines
Usability GuidelinesUsability Guidelines
Usability Guidelines
 
Background research
Background researchBackground research
Background research
 
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran KajaEVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
EVOLVE"13 | Maximize & Enhance | Accessibility | Kiran Kaja
 
Advanced Internet
Advanced InternetAdvanced Internet
Advanced Internet
 
香港六合彩 » SlideShare
香港六合彩 » SlideShare香港六合彩 » SlideShare
香港六合彩 » SlideShare
 
Web+Design+Guide[1]
Web+Design+Guide[1]Web+Design+Guide[1]
Web+Design+Guide[1]
 
Design Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation SchemesDesign Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation Schemes
 
Design Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation SchemesDesign Like a Pro: Building Better HMI Navigation Schemes
Design Like a Pro: Building Better HMI Navigation Schemes
 
webdesign.ppt
webdesign.pptwebdesign.ppt
webdesign.ppt
 
Fundamentals of Web Design | Chandan Chakraborty
Fundamentals of Web Design | Chandan ChakrabortyFundamentals of Web Design | Chandan Chakraborty
Fundamentals of Web Design | Chandan Chakraborty
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability Evaluation
 

boone_assignment 6

  • 1. HEURISTIC EVALUATION Kent State University Registrar System 1 Kent State University has one the largest regional systems in the country, with an eight-campus system in the northeastern area of Ohio. More than 22,000 students use the University’s registrar system at least two times a year. The mission of the Kent State University Registrar office is to explore new modern design alternative, to make the user interface of the registration sys- tem, and to make it easier to use. The heuristic evaluation of the current system was conducted by four evalua- tors who assessed the overall usability and effectiveness of the interface, using a numerical scoring system. Evaluators: • Shannon Boone • Nick Gonzales • Jennifer Nickloy • Michael Saylor Evaluations Criteria: The Kent State University register system evaluation was performed by four reviewers who examined the interface and judged its compliance by using following seven of the ten usability principles developed by Jakob Neilson. • Visibility of System Status • User Control and Freedom • Consistency and Standards • Recognition Rather than Recall • Aesthetic and Minimalist Design • Help, Documentation, Recovery from Errors • Language EVALUATION Method: Each evaluator answered each question one a scale of zero to two. 0 = poor 1 = good 2 = excellent Raw scores of all evaluators were collected and also the overall medians for each category. The full list of questions, scores, and medians is located in the Appendix section. INTRODUCTION
  • 2. HEURISTIC EVALUATION Kent State University Registrar System 2 Visibility of System Status Score: 0 – poor Reviewers felt the website lacked a good visibility of the system’s status. The pages did however have clear elements such as headers and sub-headers, but failed to let the user know where they were on the site due to the fact there is no visible bread- crumb. The site had inconsistencies with the “return to previous” option on their pages. The Class Search page is difficult to navigate, and uses a lot of acronyms that are hard to decipher. User Control and Freedom Score: 1.75 – excellent In the User Control and Freedom category, the reviewers felt the site performed well in this section. The site as a whole doesn’t use unnecessary technologies, and it’s clean and assessable. The “Back to Student Tools” and “Courses tab” are always visible and can be accessed at top of the page. The graphics icons did fail to show the text when you click or hover over them. Consistency and Standards Score: 1 – good Reviewers felt the font sizes are inconsistent across browsers, the menu and the tab options were excellent, but the site failed to notify user of supported browsers. For the most part the labels matched the destination page, but there was a minor differ- ence in one instance. Reviewers comment: While most labels match destination page titles and headers, the following page titles slightly differ from the link label: • Change Course Options (link label) becomes Change Class Options (header) • View Course Descriptions (link label) becomes Detailed Course Information (header) Recognition Rather than Recall Score: 0.75 - good Reviewers felt actions are not always clear, and actions sometimes get buried in very heavy content. Reviewer’s comments: Multiple Click Here links. User is forced to read the entire paragraph instead of be- ing able to quickly scan for a link and know where it will take you. Aesthetic and Minimalist Design
  • 3. HEURISTIC EVALUATION Kent State University Registrar System 3 Score: 1 – good Reviewers felt the site was outdated and there is a use of a lot of unnecessary symbols, however the site is a good example of minimalist design by the use of limited color distractions. Reviewer comment: The site uses black for text, red for important information, blue for links and various colors for graphic icons. Table headers are light gray, which helps break up sections. Limited color distractions. Help, Documentation, Recovery from Errors Score: 1 – good Reviewers felt the site had some critical errors, there is no FAQ present, and search function is only available for looking up classes, but the “Site Map” link is readily available at the top right of each page. Reviewers comment: Critical error discovered on the “Check Registration Status” page. When a user selects a term, they are taken to a registration status page. There is no “return to previous page” option, so when a user tries to go back using the browser back ar- row, they are automatically signed out of their session. The same error occurs on the “Change Class Options” page. Language Score: 1.5 – excellent Reviewers felt the vocabulary was appropriate for college aged audiences, but can be intimidating due to the amount of instructions when looking up a class. SUMMARY Overall Instrument Median Score: 1 –Good Overall the Kent State University’s registrar site scored good on four principles, excellent on two, and one poor for the Visibility of System Status principle. Below are the sites strengths and weaknesses. Strengths • Doesn’t use unnecessary technologies, clean and assessable
  • 4. HEURISTIC EVALUATION Kent State University Registrar System 4 • Limited color distractions • “Site Map” link is readily available • Clear elements such as headers and sub-headers • Appropriate language Weaknesses • No breadcrumbs • Site is outdated • Heavy content • No FAQ • Inconsistent return options Recommendations Notify user of browser version required: When the user first log on there is should be a message to clearing indicate the browser version required to use the site. Look up class option Make this simpler more streamlined. A lot of text of instructions is at the top and it’s a lot to read, so to make it more clean, it’s recommended to us less acronyms and less options. Also on this page, when make the error of not selecting a re- quired option is made, pointing out the error to the user is less frustrating, than what is currently happening where all the options selected is erased and the user has to start over. Clean up design and make is more assessable The colors a great but the fewer icons will clean it up a bit and make less over- whelming. Also any symbols or images should have text when hovered or clicked. APPENDIX
  • 5. HEURISTIC EVALUATION Kent State University Registrar System 5 Visibility of System Status 1. It is easy to know the current location within the overall map of the site. 0 0 0 0 0 2. It is clear what information is available at the current location. 1 2 2 1 1.5 3. The current information matches what you expect to find. 2 1 2 1 1.5 4. It is clear where you can go from the current location. 0 0 0 0 0 5. It is always clear what is happening from each action you perform. 0 0 0 0 0 User Control and Freedom 6. It is always easy to return to the Home Page. 2 1 2 1 1.5 7. It is easy to access all major portions of the site from the Home Page. 2 2 2 2 2 8. No unnecessary technologies are used. 2 1 2 2 2 9. Graphic links are also available as text links. 1 0 2 1 1 User Control and Freedom 10. Links are used and appear in standard web style. 0 1 2 0 0.5 11. Menus are used and appear in standard web style. 2 2 2 1 2 12. The site supports all major browsers. 0 1 1 2 1 13. There is clear notification if special technologies or browser versions are required. 0 0 0 0 0 14. Link labels match destination page titles or headers. 1 1 2 2 1.5 15. Overall, the site behaves like one would expect a web site to behave. 1 1 2 0 0.5 Recognition Rather than Recall 16. Available actions are always clearly presented. 0 0 1 1 0.5 17. Labels and links are described clearly. 0 1 1 1 1 Aesthetic and Minimalist Design 18. The site structure is simple and clear without any unnecessary complications. 0 0 0 0 0 19. There are no instances of extraneous information. 0 1 1 0 1 20. There are no instances of misplaced information. 1 1 1 2 1 21. Color choices allow for easy readability. 1 1 1 1 1 22. The site is aesthetically pleasing. 1 0 1 0 0.5 Help, Documentation, Recovery from Errors 23. A site map or other navigational assistance is always readily available. 1 2 2 1 1.5 24. If needed, an FAQ is available. 0 1 2 0 0.5 25. No errors occur unnecessarily. 1 0 0 1 0.5 26. If necessary, a search function is readily available. 0 0 1 0 0 27. If necessary, error messages are clear and in plain language. 0 1 2 1 1 28. It is easy to cancel or exit from operations. 0 0 1 1 1 29. It is easy to contact support through email or a web form. 1 1 1 1 1 Language 30. The content language is clear and simple. 1 1 2 1 1 31. The vocabulary is appropriate for the intended audience. 1 2 2 2 2 Overall Instrument Median 1 Reviewers 1 2 3 4 Median