The team tested the usability of a university admissions webpage using laboratory and guerrilla testing methods. They recruited undergraduate and high school students to complete tasks and measure effectiveness, efficiency, errors, and satisfaction. Results showed the "Find the steps to enroll" task was most difficult. Overall, users were satisfied but felt the layout could be improved, especially the apply/enroll pages. The conclusion was that organization and clear formatting are important for usability.

1. MWSU ADMISSIONS
WEBPAGE
Nelson (Team Lead)
Hicks
Khalandi
Madannagari
Elliott, PhD (Advisor)

2. AGENDA
1. Primary Question
a. Developer Needs
2. Testing Methods
a. Tasks
b. Laboratory Testing
c. Guerrilla Testing
3. Results
4. Strengths & Opportunities
5. Conclusion

3. PRIMARY QUESTION What are we looking to find
out?

4. DEVELOPER NEEDS
1. We want people to easily find the “Apply” page.
2. We want people to easily find the "Join our Mailing List" button.
3. Can students find information regarding their particular student type?
4. Are students able to easily schedule a campus visit appointment?
5. Can students easily find the Majors/Minors section of our Admissions website?
6. Is the scholarships and tuition pages of the admissions page easily navigable?
Hicks Khalandi Madannagari Nelson
Primary Question

5. PRIMARY QUESTION
Is the Admissions page user-friendly?
Are users finding the information they're looking for?
Hicks Khalandi Madannagari Nelson
Primary Question

6. TESTING METHODS
Tasks
Laboratory Testing
Guerrilla Testing

7. METHODS
Laboratory Setting
• Formal usability testing
• Conducted on campus
• Recruited 5 MWSU undergraduate students
• Signed consent form
• Think-aloud method
• Completed 7 tasks per participant
• Recorded sessions using Camtasia
Guerrilla Style
• Less formal usability testing
• Conducted at Lafayette High School
• Recruited 5 high school seniors
• Signed consent form
• Think-aloud method
• Completed 7 tasks per participant
• Recorded sessions using Morae
Testing Methods

9. MEASURES COLLECTED
1. Effectiveness
2. Efficiency
3. Error
4. Task completion rate
5. Satisfaction
Testing Methods

10. RESULTS

11. EFFICIENCY
TIME ON TASK
Results
0
50
100
150
200
250
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
TimeonTask(sec)
Lab
Guerrilla

12. EFFECTIVENESS
NUMBER OF CLICKS
Results
0
2
4
6
8
10
12
14
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
NumberofClicks
Lab
Guerrilla

13. ERRORS
Results
0
2
4
6
8
10
12
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
AverageError
Lab
Guerrilla

14. COMPLETION RATE
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
CompletionRate(%)
Lab
Guerrilla
Results

15. SATISFACTION
0
1
2
3
4
5
6
7
8
EaseofCompletion Time SupportInfo
AverageSatisfaction
Lab
Guerrilla
Results

16. MOST DIFFICULT/FRUSTRATING
Results
0
2
4
6
8
10
12
14
16
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
MostFrustrating
MostDifficult

17. LEAST DIFFICULT/FRUSTRATING
Results
0
2
4
6
8
10
12
14
16
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
LeastFrustrating
LeastDifficult

18. FUNCTION AS EXPECTED?
Results
YES NO

19. STRENGTHS &
OPPORTUNITIES

20. USABILITY SCORE
Strengths & Opportunities

21. USABILITY SCORES
Strengths & Opportunities
63.2
100
73.4
150
71.2
139.4
42.4
47.2
102.6
50.8
139.2
88.4
68.8
53
0
20
40
60
80
100
120
140
160
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
UsabilityScore
Lab
Guerrilla

22. 55.7
101.8
62.6
146.6
79.8
104.1
47.7
0
20
40
60
80
100
120
140
160
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
UsabilityScore
Strengths & Opportunities
COMBINED USABILITY SCORE

23. COMBINED USABILITY SCORE
STRENGTHS
55.7
101.8
62.6
146.6
79.8
104.1
47.7
0
20
40
60
80
100
120
140
160
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
UsabilityScore
Strengths & Opportunities

24. COMBINED USABILITY SCORE
OPPORTUNITIES
55.7
101.8
62.6
146.6
79.8
104.1
47.7
0
20
40
60
80
100
120
140
160
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
UsabilityScore
Strengths & Opportunities

25. COMBINED USABILITY SCORE
OPPORTUNITIES
55.7
101.8
62.6
146.6
79.8
104.1
47.7
0
20
40
60
80
100
120
140
160
Apply Mailing Transfer Stepsto Enroll Appointment Nursing Scholarship
UsabilityScore
Strengths & Opportunities

26. CONCLUSION

27. CONCLUSION
• Users were satisfied with the Admissions site overall
• Majority of users were able to complete all tasks
• Main issue we found – Task 4 (Find the steps to enroll)
• Did the site function as expected?
• “No because other colleges have a better layout to find direct access to the necessary page.”
• “I feel the program could be better, but as a senior I find it the easiest to guide through,
compared to other college websites. I would improve the 'profile' pages and the 'apply/enroll'
pages”
Conclusion

28. TASK 4
Find the steps to enroll at MWSU

30. TASK 2
How would you get admissions information
about MWSU sent to you?

32. LESSONS LEARNED
• Organization pays off
• Communication
• Better formatting our questionnaires
• High schools offer a great source of users
Conclusion

33. QUESTIONS Don’t be shy!

34. TASKS
1. As a high school student, where would you go to apply to MWSU?
2. How would you get admissions information about MWSU sent to you?
3. Where would you go to find admissions information about transferring to MWSU?
4. Find the steps to enroll at MWSU.
5. Schedule an appointment with the admissions office for November 13th at 1:30pm.
6. Where would you go to find information about majoring in nursing?
7. Where would you go to find information about scholarships for transfer students?
Testing Methods