Appen

1. Ads Rating Qualification
1

2. Course Overview
 Chapter 1: Project Introduction &
Requirements
 Chapter 2: Project Basics
 Chapter 3: Ratings Explanation
 Chapter 4: Writing Comments
 Chapter 5: Submitting Your Responses & Extra
Factors to Consider
2

3. Chapter 1
Project Introduction & Requirements

4. Chapter 1 Learning Objectives
 Understand the purpose of the project
 Learn critical items to keep in mind
4

5. Project Purpose
 Understand which advertisements (also known as
“ads”) people want to see in their News Feed, and
why
 Understand what makes a good or bad ad based
on relevance, usefulness, entertainment factor,
offensiveness, deceptiveness and any other aspect
that may influence how people feel about ads
5

6. Project Service Level Requirements
 Production Hours
 1 hour per day
 Minimum of 5 days per week, maximum of 7 days
 Task Breakdown
 1 Batch (20 ads) – 1 hour
6

7. Chapter 2
Project Basics

8. Chapter 2 Learning Objectives
 Understand your News Feed
 Learn parts of the rating window
 Know how to interact with Ad
 Learn the rating matrix
8

9. 9
What is your News Feed?

10. Rating Window Overview
10
The ad you
will rate
Rating Panel

11. Interacting with Ad
11

12. Rating Matrix
12

13. Chapter 3
Ratings Explanation

14. Chapter 3 Learning Objectives
 Consider relevance
 Consider usefulness
 Consider entertainment aspect
 Consider offensiveness
 Consider deceptive intent
 Understand overall rating
 Difference between overall 1’s and 2’s
14

15. Ad Relevance
15
Key Question
 How relevant is this ad to you?
1 – Not at all
2 – A little
3 – A lot
Key Factors
 Does it relate to:
 Your interests?
 Your demographic?
 Your location?
 Any other dimension?

16. 16
Ad Relevance Examples

17. Ad Usefulness
17
Key Question
 How useful is this ad to you?
1 – Not at all
2 – A little
3 – A lot
Key Factors
 Does it provide an actual use?
 Valuable information/knowledge
 Usable item – coupon, product for
purchase
 Service that you need
 Not something that is only interesting or
entertaining

18. 18
Ad Usefulness Examples

19. Ad Entertainment Factor
19
Key Question
 How entertaining is this ad to you?
1 – Not at all
2 – A little
3 – A lot
Key Factors
 Is it amusing or enjoyable (not just
interesting or informative)?
 Does it make you feel good, smile, laugh,
elicit a positive emotion?

20. 20
Ad Entertainment Factor Examples

21. Ad Offensiveness
21
Key Question
 How offensive is this ad to you?
1 – Not at all
2 – A little
3 – A lot
Key Factors
 Does it cause you to feel:
 Hurt
 Upset
 Angry
 Or have a negative emotional
response
IMPORTANT
Ads should be rated in isolation. Do not be negatively
swayed by recurring ads or ads with similar theme –
consider them in isolation from each other.

22. 22
Ad Offensiveness Factor Examples

23. Ad Deceptiveness
23
Key Question
 How misleading is this ad to you?
1 – Not at all
2 – A little
3 – A lot
Key Factors
 Trust your initial reaction
 Scams, too good to be true
 Do not click to investigate unless you
would normally do so
 Difference between misleading and
offensive
 Confused? Not necessarily misleading

24. 24
Ad Deceptiveness Examples

25. Overall Rating
25
Key Question
How much do you want to see this in
your News Feed?
 5=best, 1=worst
 Fully consider all aspects of the ad
 It is unlikely you would want to see ads that
are irrelevant, offensive, or misleading

26. Overall Rating – Difference Between
2’s and 1’s
26
 Rate “1” for an ad that negatively impacts you and detracts from your
Facebook experience
 Rate “2” for ads you have no interest in seeing and want it removed, saving
“1” for those causing a negative impact

27. Ratings Flow for Overall Rating
27
 Consider
 Relevance
 Usefulness
 Entertainment aspect
 Offensiveness
 Deceptiveness aspect

28. Chapter 4
Writing Comments

29. Chapter 4 Learning Objectives
 Understand comment requirements
 Learn how to describe your overall feelings
towards the ad
 Learn how to write great comments
29

30. Writing Comments
Comments must address your overall feelings toward the ad, taking into account all of
the rating categories:
 Comments should focus on answering the “why”
 Do not simply repeat the rating (eg. The ad is really relevant to me.)
 Discuss any factors which contributed to the selected rating.
 Specifically mention a minimum of two of the rating categories.
 Align with numerical ratings chosen
 Others should be able to determine what your ratings were based solely on your
comments
 Reference the numerical rating chosen accurately
 Use language from the guidelines to clearly describe the rating
 Provide a thorough reason for the numerical rating chosen
 Provide your overall thoughts and feelings
30

31. Examples of Great Comments for Overall
This ad from Full Sail University for a masters degree in Instructional Design is a little relevant
to me as my background is in instructional design, but I am not considering doing a Masters
program right now. Because I may change my mind in the future, it is good to understand the
options available to me, so this ad is a little useful to me, and I do want to see this ad in my
news feed.
31
Because I play computer games, this Happy Acres game ad is very relevant. However, I don't
enjoy farming games, so I wouldn't play this one. I don't mind seeing the ad in my feed,
though, because the picture is a little entertaining and I love games, but I wouldn't play this
game.
I definitely do not want to see this ad for why men cheat on their spouses in my feed because I
find it very offensive. I find cheating to be extremely hurtful and I do not care to read about the
reasons for it. This is absolutely not useful to me, and reminds me of someone who cheated on
me - this would ruin my whole day.

32. 32
Additional Questions – Important Notes
• You should not feel compelled to report that something is relevant,
useful, makes you feel entertained or offended if you do not feel that
way.
• Be honest and thoughtful and explain your choices in the comments
where required.

33. Chapter 5
Submitting Your Responses
&
Extra Factors to Consider

34. Chapter 7 Learning Objectives
 Learn when to use Submit and Skip
 Understand the time allotted to view content
 Learn how to handle repetition
34

35. Submit and Skip
 When to Submit
 Use for the majority of ads
 When to Skip
 Ads with technical issues only (rendering
problems, blank frame)
 When NOT to skip
 Foreign language ads
 Previously seen ads
 Hard time deciding
 Offensive, adult or bad content
35

36. Time Allotted to View Content, Repetition
Time Allotted to Review Content
 Reading articles
 Watching videos
 Playing games
Balance importance of reviewing articles,
videos, playing games, etc. with need to
complete ratings within the time provided.
36
Repetition
 Should not be taken into account
 Each ad should be considered in
isolation
Reminders
 Comments for each ad must include a why for the numerical rating chosen
 Interact with each ad as you normally would
 Like, comment, share or click BEFORE providing your ratings

37. 37
Thank You!
Reminders