Lean: From Theory to Practice — One City’s (and Library’s) Lean Story… Abridged
HCI Part 6 - Prototype and Evaluation Plan
1. PROTOTYPE AND EVALUATION PLAN
Evaluation Plan
Usability specifications
The creation of the web site will aim to achieve the following measures when it appeals to the
use:
Effectiveness: In achieving this it will show how good the system is at performing the required
tasks.
Efficiency: This aims to show how efficient and easy the system is to use.
Safety: Achieving this will show that the system protects users from hazards, mistakes and help
them to recover quickly from errors.
Utility: This will aim to show that the system support many suitable function.
Learn ability: This will show how easy users will learn to manipulate the system.
Memo-ability: This will aim to show how easy users will remember steps to take when using the
system.
2. Population
A selection of random users will be selected from sample to perform a test use of new
website. They will be required to try and accomplish tasks that was out lined that the system was
created to achieve for example post an item and search for an item.
The newly created Go - Jamaica must perform all the improved measures that were out lined to
be achieved.
Task Script
These are some task that the selected users will be asked to perform to show that the website
is in fully functional manner:
Persons will be ask to log on a view the website
How easy users will navigate while using the system.
Persons will be asked to sign in the
Person will be ask post an item on the website
Persons will be asked to search for an item
Reasons why these tasks were selected for the users to complete are due to the fact that the newly
developed website was design with these measures in mind:
Easy navigation
Allowing users to sign in
3. Allow users to post
Allow users to search on a wider scale
Roles
In the testing of the web site the developers will do the following while the users interact with
the system.
Developer
Task
Kemar Harris
Will be the keeping record of the time users
take to interact with all the system’s
functions and also directing the user.
Leron Thomas
Will taking notes on critical events pertaining
to what is being observed during the testing
of the site.
Emar Morrison
Will be responsible for ensuring that
technical components such as all necessary
hardware are in place and correctly
accounted for at the end of the testing.
Steven Getten Will be in charge of the security aspect by
monitoring the security camera so users to
not remove any component.
4. CONSENT TO PARTICIPATE IN USER TESTING
Go Jamaica website
You are asked to participate in the testing of a new developed Go Jamaica website. The
redevelopment will be conducted by the team of developers, Kemar Harris, Leron Thomas, Emar
Morrison and Steven Getten from the University of Technology, Jamaica. Your participation in
this study is completely voluntary. Please read the information below and ask questions about
anything you do not understand, before deciding whether or not you want to participate.
RIGHTS OF CONSENT
In signing this form, I _________________________ am giving my consent to participate in the
testing of the newly developed Go - Jamaica website.
________________________________________ _________________________
Signature Date
________________________________________ _________________________
Signature of Witness Date
5. Data gathering Sheet
Date received during the testing of the Go - Jamaica website will be recorded as follows.
__________________________________________________________________________
Comments
______________________________________________________________________________
______________________________________________
______________________________________________________________________________
______________________________________________
6. The times taken to complete certain task along with the critical events will be recorded in the
following table.
Task completion Time Critical events
7. Analysis of results
The results received from the testing process of the web site shows that 93 % of the users
accomplished there task effectively which shows that the newly developed website have met all
the requirements that were set out to be achieved.
Usability problem identified
During the testing of the newly developed Go - Jamaica website a large percentage of the
users comfortably complete task issued to them and were very pleased with the revamp of the
system.
8. Heuristic Evaluation
During the evaluation of the Go – Jamaica website the follow measures where considered.
Visibility of system status
The website always keeps users informed about what is going on, through appropriate
feedback within reasonable time.
Match between system and the real world
The system speaks the users’ language, with words, phrases and concepts familiar to the
user, rather than system-oriented terms. Follow real-world conventions, making
information appear in a natural and logical order.
User control and freedom
The web site offer functions to deal with mistake and provided clearly marked
"emergency exit" to leave the unwanted state without having to go through an extended
dialogue. Support undo and redo.
9. Consistency and standards
Users don’t have to wonder whether different words, situations, or actions mean the same
thing. Follow platform conventions.
Error prevention
Error messages are carefully design which prevents a problem from occurring in the first
place.
Recognition rather than recall
Make objects, actions, and options visible. The user does not have to remember
information from one part of the dialogue to another. Instructions for use of the website is
visible and easily retrievable whenever appropriate.
Flexibility and efficiency of use
The website caters to both inexperienced and experienced users. Users readily tailor
frequent actions.
10. Aesthetic and minimalist design
The Dialogues do not contain information which is irrelevant or rarely needed. Every
extra unit of information in a dialogue competes with the relevant units of information
and diminishes their relative visibility.
Help users recognize, diagnose, and recover from errors
Error messages are expressed in plain language (no codes), precisely indicate the
problem, and constructively suggest a solution.
Help and documentation
Users can easily find help and documentation when need when interacting with the web
site. This information is easy to search for.
11. Evaluation Results
The website was evaluated and tested by a number of users from the sample who were
randomly selected. The newly created Go - Jamaica website was tested to find out if all the
requirements and functionality were achieved.
The users were asked to log on to the website and view, if they were already a member, if not
they will have to create an account. The users did not have any difficulty in doing so because the
website was properly structured so the user could easily locate the login view which is also user
friendly.
Secondly the users were successful in navigating from one web page to another or even on the
same page navigation was made easy because of the numerous link buttons and menu tabs that
were made available. To Post an item on the website or searching for an item was no more of a
problem for users because it was easier to understand as the steps were design in a simpler way
which was user friendly and more interactive for the users because of the different graphical
icons that were used and help tips.
Finally the heuristics method was use in the testing of the website to help identify the problems
that the users were still facing and ways in which they could be solved based on the feedbacks
that were received from the users as this method allow users to give their feedbacks.