Case.org Usability Test Summary

1. Summary of Usability Test
by Matt Cotter

2. Hello, my name is Matt Cotter and I’m going to be in charge of redesigning a website by the name of Case.
org.
First, I want to say that we’re not testing you. There’s no right or wrong answers in regards to the questions
that I’m asking. We’re testing the usability of the website and are trying to determine if there are any issues
with its functionality All I would ask of you is to think out loud while carrying out tasks so we can follow your
reasoning. For example, if you see two links that may contain the information you’re looking to find, we ask
that you speak out loud about it before continuing.
With your permission, we will be using screen capture software and a microphone to record your actions
and thoughts. Before I continue, are there any questions?
User Information
First of all, can you state your name, profession (or past profession), and your age?
What is your computer and Internet experience like?
Warm-Up
What is your initial impression of the site’s over-all design?
While on the home page and without clicking anything, what would you would click on?
What do you think the website is about?
Tasks
If I wanted to make a recommendation to CASE about someone that they should have speak at their conference,
where would I go?
If I wanted to find out Charity deductions in the US, where would I navigate to?
Where would I go if I wanted to rent CASE’s Membership mailing list?
Final Thoughts:
CASE.org Usability Test Sheet
User Information
First of all, can you state your name, profession (or past profession), and your age?
Audrey Adams, Healthcare, 27 years old.
What is your computer and Internet experience like?
More than 4 hours a day, but mostly used on Netflix and chatting on Facebook.
Warm-Up
What is your initial impression of the site’s over-all design?
“Nice”, “Nothing wrong with it”.
While on the home page and without clicking anything, what would you would click on?
“Highlights, it stands out the most.”
What do you think the website is about?
“Connecting with people.”
Tasks
If I wanted to make a recommendation to CASE about someone that they should have speak at their conference,
where would I go?
She was unable to find the“Nominate”link, and concluded the best way to recommend someone to speak at their
conference was to call or e-mail CASE.
If I wanted to find out Charity deductions in the US, where would I navigate to?
After navigating to the Public Policy page, she navigated away and neglected to click the United States. After finding
the related material, she states,“that was too much clicking.”
Where would I go if I wanted to rent CASE’s Membership mailing list?
Was able to very easily find the information; no issues locating rental list.
Final Thoughts:
I’m not sure as to why she was unable to determine what the web site was about just by looking at the front
page. Maybe not being able to move the mouse around or click on anything threw her off.
CASE.org Usability Test Sheet 21

3. User Information
First of all, can you state your name, profession (or past profession), and your age?
Rodolfo Mayorga, Retail, 23 years old.
What is your computer and Internet experience like?
Uses computer for recreational and school use, spends over 4-5 hours a day using internet.
Warm-Up
What is your initial impression of the site’s over-all design?
“Nice”, “Colorful”, “Nothing wrong with it.”
While on the home page and without clicking anything, what would you would click on?
“Highlights, it’s front and center and grabs the most attention.”
What do you think the website is about?
User reads directly off logo and the “About” section on the homepage.
Tasks
If I wanted to make a recommendation to CASE about someone that they should have speak at their conference,
where would I go?
Initially goes to correct section but navigates away. Eventually comes back to correct path and
successfully locates “Nominate Speaker” link.
If I wanted to find out Charity deductions in the US, where would I navigate to?
Had difficulty locating under “Public Policy” but later concedes that the informations location “makes
sense”.
Where would I go if I wanted to rent CASE’s Membership mailing list?
No issue locating data, finds information easily with the keyword being “Membership”.
Final Thoughts:
Very interesting test, user test was conducted using Open Broadcasting System, Twitch.TV and Skype.
CASE.org Usability Test Sheet
User Information
First of all, can you state your name, profession (or past profession), and your age?
Nancy Cotter, Retired, 57 years old.
What is your computer and Internet experience like?
Averages less than an hour a week.
Warm-Up
What is your initial impression of the site’s over-all design?
“Easy enough to read, I don’t have any complaints regarding it.”
While on the home page and without clicking anything, what would you would click on?
“Highlights, it stands out the most.”
What do you think the website is about?
User never locates information on homepage, “about” is partially obscured by “select region screen”,
which the user never closes which may be why.
Tasks
If I wanted to make a recommendation to CASE about someone that they should have speak at their conference,
where would I go?
User never successfully locates link. She locates correct path but only after navigating to several
different areas.
If I wanted to find out Charity deductions in the US, where would I navigate to?
Public Policy is the first place she looks but navigates away from it and never see’s the sub-navigation. After
locating the sub-navigation on another page, she comes back to Public Policy and locates correct path.
Where would I go if I wanted to rent CASE’s Membership mailing list?
Keyword “Membership”, user locates information easily.
CASE.org Usability Test Sheet
User stuggled on front page determining what the site was about partially due to“Select Region”screen. I
wouldn’t suggest removing the region selection but making the About-blurb further up on screen, maybe in
the header. See wireframe.
Final Thoughts:
43

4. UserTestSummary Summary of Usability Test 5
User #1
User #1 is 23 years old, works retail and uses a computer on a daily basis for
recreational use and school, averaging more than 4 hours a day or more. His
inital impression of the website’s design is positive, citing no real issues with it
and likes the color usage. He admits the first thing that stands out to him are
the Highlights section. When asked what he thought the site was about, he
simply read off the logo and the“About section”on the main page.
• Question #1: clicked several links, even the neccessary path and then
navigated away before coming back to the correct page.
• Question #2: struggled with finding information under“Public Policy”,
but conceded later that the location“made sense”.
• Question #3: Hearing the keyword“Membership”, the user found this
information almost immediately.
User #2
User #2 is 27 years old and is a healthcare professional. She spends 3-4
hours a a day average using the internet but admits that’s primarily spent
watching Netflix and chatting with friends and doesn’t spend much time
browsing. She finds the design“colorful”and“easy to read”. She admits that
the Highlight section of the site is what stands out to her due to it being front
and center of the main page. She admits she doesn’t understand what the
website is about, despite the“about”blurb above highlights.
• Question #1: She was unable to find the“Nominate”link, and concluded
the best way to recommend someone to speak at their conference was
to call or e-mail CASE.
• Question #2: After navigating to the Public Policy page, she navigated
away and neglected to click the United States. After finding the related
material, she states,“that was too much clicking.”
• Question #3: Was able to very easily find the information; no issues
locating rental list. UserTestSummary
Summary of Usability Test 6
User #3
User #3 is 57 years old, retired and legally blind. She rarely uses the computer,
averaging about an hour or less a week. After taking several seconds to move
around the site and become acquainted with it, she states that the website’s
easy enough to read and has no complaints regarding it. She identifies the
“highlights”section first as her first point of interest. When asked to identify
what the website is about, she’s unable to read the“About”blurb on the front
page because the“Select Region”screen partially blocks it. She spends almost
a full 2 minutes trying to figure out what the website is about but concedes
she can’t just by the front page and never once knew that she had to select a
region first before the full view of the website would be available.
Question #1: She never locates the“Nominate a Conference Speaker”link,
looking under several different sections as to what she thought it may be
under.
Question #2: Public Policy was her first choice to look under, but
navigated away and never identified the sub-navigation. After she
identified the sub-navigation on another page, she was able to go back
to Public Policy and locate it successfully.
Question #3: Easily found due to the keyword,“Membership”.