The document discusses light-weight user testing for designing online instructional materials, emphasizing the importance of user-centered design and usability testing. It outlines a structured approach for conducting tests, including planning, designing, executing, and acting on results, alongside practical examples and guidelines. A case study on testing a specific site, 'rockin’ russian', is also included to illustrate the user testing process.

1. Light‐Weight User Tes.ng
for the design of online instruc.onal materials
Rachael Gilg, Interac0ve Developer
Carl Blyth, Director
Texas Language Technology Center
College of Liberal Arts
The University of Texas at Aus.n

2. Light‐Weight User Tes.ng

3. Light‐Weight User Tes.ng

4. Light‐Weight User Tes.ng

5. User‐Centered Design

6. Usability Tes0ng
Personas
Card Sor.ng
Focus Groups
Surveys
Func.onal Tes.ng,
Site Analy.cs
Surveys
Interviews
User‐Centered Design

7. Basic Characteris.cs of
Usability Tes.ng
“Think Aloud”
Protocol
Real Tasks
Real Users

8. Beyond Usability: Facets of User Experience
Source: Peter Morville http://semanticstudios.com

9. Why do we need User Tes.ng?
Can’t we just ask users what they
think about our site?

10. Case Study: Rockin’ Russian

11. Rockin’ Russian Tes.ng Process
1. Planning the Test
2. Designing the Test
3. Conduc.ng the Test
4. Ac.ng on the Results
Let’s look at some sample materials:
hSp://coerll.utexas.edu/coerll_media/tutorials/usability.pdf

12. Planning the Test
• Plan to test early and oUen
• Decide on goals for the tes.ng
• Recruit users that are members of your target
audience(s)
• Expect the unexpected

13. Designing the Test
• Develop task scenarios that are
– Realis.c
– Simple
– Tailored to your audience
– Don’t use leading language
• Develop pre‐ and post‐test surveys and
interview ques.ons

14. Conduc.ng the Test
• If possible, have someone impar.al (not the
developer) administer the test
• Set up technology and have packets ready
• Have user sign a waiver
• Orient the par.cipant using a script
• Prompt the user to think aloud, but stay neutral
• Administer post‐test survey
• Follow up on problem areas during interview

15. Ac.ng on the Results
• Compile data
• Iden.fy and priori.ze issues
• Brainstorm solu.ons
• Implement solu.ons and re‐test

16. Ques.ons?

17. Ac.vity
• Start the Screenflow applica.on and begin recording.
Use the task provided to interact with the Rockin’
Russian site at hSp://tltc.la.utexas.edu/rr
• Discussion:
– What do you think of the task you were given?
– Do you see any poten.al problems with it?
– What kind of results do you think you would get?
– How would you improve the task to get beSer results?
• Demo of Screenflow playback and edi.ng
func.onality.