This is the Part 1 of a User Experience testing presentation from June 2014. Project Manager Whitney Baer and I traveled to Atlanta to test with adult learners currently enrolled at a literacy center.

1. Atlanta UX
Sessions
Part 1
Patrick Hays
June 17, 2014
User Interviews and Testing with CSAL

2. Testing Session Flow
1. User first filled out informed consent
(read aloud)
2. User viewed Lesson 19
3. User then filled out 3 questionnaires (24
items total)
4. A semi semi-structured interview was
carried out with the user

3. Example Media from
Lesson We Tested

4. Measures
• CSAL Likeability Questions
–4 items
• General Self-Efficacy Scale
–10 items - Jerusalem, M., & Schwarzer, R. (1992)
• Self-Regulation Scale
–10 items - Diehl, M., Semegon, A. B., & Schwarzer, R. (2006)

5. Did you enjoy using the CSAL program?
1 1 1
13
0
2
4
6
8
10
12
14
1 2 3 4
#ofParticipants
Rating
n = 16

6. 4
12
0
2
4
6
8
10
12
14
1 2 3 4
#ofParticipants
Rating
Did the CSAL lesson make sense to you?
n = 16

7. Do you think you learned something
by using the CSAL program?
1
4
11
0
2
4
6
8
10
12
14
1 2 3 4
#ofParticipants
Rating
n = 16

8. Would you like to use the CSAL
program again in the future?
1
3
12
0
2
4
6
8
10
12
14
1 2 3 4
#ofParticipants
Rating
n = 16

9. Overall Averages
Scales Mean Avg. SD
Likeability of CSAL 3.67 0.245
Self-Regulation 2.98 1.184 n = 16
Self-Efficacy 3.52 0.501
All measures used 4 point scales (1-4)

10. • Interest in a mobile version of CSAL
• Interest in dictionary and pronunciation
• Handful of people need human assistance
• Career goals/business skills, topics of
interest
• Novelty definitely seems to be a factor
Observations & Take-Home
Messages - Part 1

11. Observations & Take-Home
Messages - Part 2
• Most learners got sent to easy path of
script
• High performers bored by system, tedious
• Agent name pronunciation not an issue
for learners
• Differences in tutoring class structure

12. Please see my other presentation
for data from these same sessions that
I captured and coded with Techsmith
Morae.
See Atlanta UX Sessions Part 2