The document discusses different methods for testing content, including readability formulas, cloze tests, and usability testing. It provides details on how to conduct each type of test, what each tests, their benefits and limitations. Readability formulas quickly estimate text difficulty but should not be the only evaluation method. Cloze tests indicate appropriateness for an audience and take little time. Usability testing directly observes users and is most effective but also most resource-intensive. The document recommends using multiple methods of testing for comprehensive evaluation of content.

1. TESTING CONTENT
Angela Colter
@angelacolter #testcon
May 9, 2011

3. “
If at any time during any rolling consecutive twelve
billing cycle period you fail to make two Minimum
Payments on a timely basis or exceed your Credit Limit
twice we may elect to increase your Purchase, Cash
Advance and/or Balance Transfer APRs to the Penalty
APRs. All Penalty APRs will remain in effect until, in a
subsequent rolling consecutive six billing cycle period,
you do not exceed your Credit Limit at any time and
you make all of your required Minimum Payments on a
timely basis when, in your next billing cycle, all Penalty
APRs will no longer apply.

4. “
If at any time during any rolling consecutive twelve
billing cycle period you fail to make two Minimum
Payments on a timely basis or exceed your Credit Limit
twice we may elect to increase your Purchase, Cash
Advance and/or Balance Transfer APRs to the Penalty
APRs. All Penalty APRs will remain in effect until, in a
subsequent rolling consecutive six billing cycle period,
you do not exceed your Credit Limit at any time and
you make all of your required Minimum Payments on a
timely basis when, in your next billing cycle, all Penalty
APRs will no longer apply.

5. WHY TEST
YOUR CONTENT?

6. Photo: @DavidFeng

7. Photo: John Van Laer

8. Photo credit: Laura C. Gooch

9. Photo: Zara Arshad

10. Photo: Ben Hobson

11. Readability Formula
Usability Test
Cloze Test

12. READABILITY
FORMULA

13. Flesch-Kincaid Grade Level Formula
# words # syllables
.39 x + 11.8 x – 15.59 = grade level
# sentences # words

14. Whether you're a content strategy
veteran or curious about where to
start, this is your conference.
9TH GRADE

15. Conference this you're where or
veteran your about strategy is
whether a content start curious to.
9TH GRADE

16. FORMULAS
· Quickly estimate text difficulty
· Produce an easily understood metric
· Can help you argue for funding to test with users
· Are not magic
· Should not be your only evaluation method
· Are not a guide for writing good content

17. “
Improving comprehension by writing
to a readability formula is like lighting
a match under a thermometer
to warm up a room.
–George Klare

18. USABILITY TEST

19. Did you
understand that?

20. Find out what users do,
not what they say they do.
–Jakob Nielsen

21. Find out what users understand,
not what they say they understand.
–Me

22. How to design a usability test
Recruit the right participants
Identify critical issues to users and business
Create tasks that test those issues
Ask users to think aloud, paraphrase
Know what the correct answer looks like

24. THIS TASK:
• Buy a Zone 2 TrailPass
TESTS THIS CONTENT:
• Where is the online store?
• Can I figure out how to use it to make a purchase?

30. THIS TASK:
• Buy a pass that suits your needs.
TESTS THIS CONTENT:
• Where is the online store?
• Can I figure out how to use it to make a purchase?
• What modes of transportation will I use?
• Are my start and end stations in the city?
• How many times a week will I use it?
• How many days are left in the month?

31. USABILITY TESTS
· Tell you what problems users have
· Reveal why they are having problems
· Make you feel the user’s pain
· End opinion-based arguments
· Can require lots of time and resources

32. CLOZE TEST

34. andyrutledge.com/closure.php

35. CANCELLATION AND SUBSTITUTION POLICY
You can transfer your ______ registration to
someone else ______ up to May 3 ______
no charges or penalties. ______ note that if
you ______ up for both the ______ and a
workshop, you’ll ______ to transfer both
registrations; ______ are no partial
substitutions ______ registrants.

36. How to create a Cloze test
Take at least a 125-word sample of text
Remove every 5th word
Go for 25-50 blanks
Ask users to fill in the exact word the author used
Calculate the percentage of exact matches

37. How to score a Cloze test
60% or more: appropriate
40-60%: may need additional help
40% or less: too difficult

38. CLOZE TESTS
· Indicate whether material is appropriate for a
given audience.
· Take into account reader’s prior knowledge of the
subject matter
· Take little time to design, administer and score
· Do not require subject matter expertise

39. Comparison of testing methods
Formula Cloze Usability
People Just you As many as it takes to As many as it takes to
convince you (5+) convince you (5+)
Time Very quick Quick Not quick
Cost Low Mid High
$0-$100 $0-$25 per participant $100+ per participant
Content Text Text Text and
Wireframes

40. WANT MORE?
Web: angelacolter.com
A List Apart: alistapart.com/articles/testing-content/
Email: acolter@electronicink.com
Twitter: @angelacolter