Reputation Bryce Glass
Reputation is… Information  used to make a   value judgment  about an  object or person …
… or an animal. What do you think of this guy?
“ Reputation is another potential source of information about an opponent's  fighting ability . Reputation is defined here...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context   for a period ...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Now we’re gonna jump around a bit.
Reputable Entity (RE) <ul><li>The objects or people within your system capable of accruing reputation. </li></ul>
REs are… <ul><li>Up to you to define </li></ul><ul><li>Things with some persistent value </li></ul><ul><ul><li>They should...
RE as Person Reputation extends one’s identity… …  esp. when said identity is  weak Metadata is reputation Gathered from R...
RE as Object Objects frequently come from  people . Statistical Evidence Volume of response Community Ratings
Lighting Round: Identify the RE <ul><li>7 different web screens. </li></ul><ul><li>These all use reputation-type methods f...
 
 
 
 
 
 
 
Different Strokes <ul><li>Display reputation at all? </li></ul><ul><ul><li>Flickr doesn’t </li></ul></ul><ul><ul><li>Y! Lo...
Different Strokes, cont. <ul><li>Which display pattern to use? </li></ul><ul><li>For content: </li></ul><ul><ul><li>Relate...
How about you? <ul><li>Did you come here today with a reputation-based system in mind?  </li></ul><ul><li>Care to share? W...
How to choose?  <ul><li>Work backwards, from the types of  value judgments   users might make on your site. </li></ul>
Do users want to… <ul><li>…  compare and contrast the quality of objects on your site? </li></ul><ul><li>…  determine whet...
A user might ask… <ul><li>“ Is this video worth my time? Should I watch it?” </li></ul><ul><li>“ What’s the  best  mid-siz...
Choosing, cont. <ul><li>Keep reputations for entities only when it makes sense to do so. </li></ul><ul><li>Only when it ca...
Good Decision <ul><li>YouTube keeps numerous reputation-types, all derived from diff combinations of various inputs. These...
Bad Decision <ul><li>Orkut allowed people to explicitly rate other users on iconic dimensions like  trusty ,  cool , and  ...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
<ul><li>A quick overview of how reputation systems work… </li></ul>Where does this information come from?
The classic love triangle…
 
 
 
 
 
 
 
 
 
 
 
Sally has found her Bits.
Bob is rewarded for his Bits.
And, yes, Sally admires Bob.
<ul><li>Gathered by monitoring  events  that occur on (or off) your site. </li></ul>Where does this information come from?
<ul><li>The fundamental building block of any reputation system. </li></ul>The Reputation Statement
 
Individual statements combine to form aggregate or community scores
What are the Targets? Claims?
<ul><li>Explicit:  Someone makes a statement about the quality of something </li></ul><ul><li>Implicit:  Someone  acts  on...
Explicit
Implicit
Lighting Round: Explicit or Implicit <ul><li>Some of the examples from before </li></ul><ul><li>I’ve marked some possible ...
 
 
 
<ul><li>Each method has value. </li></ul><ul><li>You can use them in combination. </li></ul><ul><li>Explicit invites gamin...
<ul><li>To give a variety of means for participation </li></ul><ul><ul><li>Vote, poll, ‘Buzz’, Rate </li></ul></ul><ul><li...
Reputation is… Information  used to make a   value judgment  about an  object or person  within a  context  for a period o...
Reputation can help your users decide… <ul><li>“ Is this video worth my time?” </li></ul><ul><li>“ Who are the people on t...
But not always in the ways you think!
Consider instead…
Or…
<ul><li>For your project, you’ve already identified the users & drafted some designs to represent their  Identities . Furt...
<ul><li>Now, let’s identify the types of reputations that would be most useful </li></ul><ul><li>Identify which entities o...
Upcoming SlideShare
Loading in...5
×

The Architecture of Social Websites: Reputation

1,414

Published on

The Reputation-specific slides from our IA Summit 2009 Workshop, The Architecture of Social Websites. Workshop given by Christina Wodtke, Joshua Porter, Christian Crumlish, and myself Bryce Glass.

Published in: Technology
0 Comments
8 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,414
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
8
Embeds 0
No embeds

No notes for slide
  • The Architecture of Social Websites: Reputation

    1. 1. Reputation Bryce Glass
    2. 2. Reputation is… Information used to make a value judgment about an object or person …
    3. 3. … or an animal. What do you think of this guy?
    4. 4. “ Reputation is another potential source of information about an opponent's fighting ability . Reputation is defined here as the estimation held by one individual of another individual's qualities or characteristics . Reputation is thus a property of one animal in relation to another. One animal's reputation may be learned by another through personal experience with it, or secondhand, through the experiences of others .” — Deception, Perspectives on Human and Nonhuman Deceit By Robert W. Mitchell, Nicholas S. Thompson Photo: “ Scars ” by Imansyah™ used under Creative Commons license .
    5. 5. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time .
    6. 6. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . What kinds of information? Where does this information come from ?
    7. 7. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . What kinds of value judgments can we make?
    8. 8. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . We call these reputable entities . Reputable entities may be people on your site, or they may be the objects & artifacts that they interact with. What qualities do good reputable entities possess? Is people reputation ( karma ) demonstrably different than content reputation ?
    9. 9. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . Can one reputation serve all contexts ? Global vs. local reputations Choosing the right scope . Is reputation portable ? Can I “carry” it from context to context?
    10. 10. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . Nothing lasts forever. Reputations should decay . Use time-based filters for reputation-ranked content.
    11. 11. Now we’re gonna jump around a bit.
    12. 12. Reputable Entity (RE) <ul><li>The objects or people within your system capable of accruing reputation. </li></ul>
    13. 13. REs are… <ul><li>Up to you to define </li></ul><ul><li>Things with some persistent value </li></ul><ul><ul><li>They should stick around long enough for work done by the community to benefit others. </li></ul></ul>
    14. 14. RE as Person Reputation extends one’s identity… … esp. when said identity is weak Metadata is reputation Gathered from Ratings Associations & Affiliations are also reputation Rep can be displayed as a score
    15. 15. RE as Object Objects frequently come from people . Statistical Evidence Volume of response Community Ratings
    16. 16. Lighting Round: Identify the RE <ul><li>7 different web screens. </li></ul><ul><li>These all use reputation-type methods for enhancing the user experience. </li></ul><ul><li>Yell out the primary reputable entities on these sites. They might be people, or objects, or both. </li></ul>
    17. 24. Different Strokes <ul><li>Display reputation at all? </li></ul><ul><ul><li>Flickr doesn’t </li></ul></ul><ul><ul><li>Y! Local does </li></ul></ul><ul><li>To rank, or not to rank. </li></ul><ul><ul><ul><li>Again, Flickr doesn’t </li></ul></ul></ul><ul><ul><ul><li>Y! Answers does, in a leaderboard </li></ul></ul></ul><ul><ul><ul><li>Digg numbers, but doesn’t rank strictly according to # of Diggs. </li></ul></ul></ul>
    18. 25. Different Strokes, cont. <ul><li>Which display pattern to use? </li></ul><ul><li>For content: </li></ul><ul><ul><li>Related to the input methods used to determine an objects score. (eg. If you’re collecting Star Ratings, then show Avg Star Rating back.) </li></ul></ul><ul><li>For people: </li></ul><ul><ul><li>Related to the context, the community, and other considerations. </li></ul></ul>
    19. 26. How about you? <ul><li>Did you come here today with a reputation-based system in mind? </li></ul><ul><li>Care to share? What are the Reputable Entities you’re tracking and why did you choose those ones? </li></ul>
    20. 27. How to choose? <ul><li>Work backwards, from the types of value judgments users might make on your site. </li></ul>
    21. 28. Do users want to… <ul><li>… compare and contrast the quality of objects on your site? </li></ul><ul><li>… determine whether a piece of information is true or false? </li></ul><ul><li>…  determine the credibility of an author of an article? </li></ul>
    22. 29. A user might ask… <ul><li>“ Is this video worth my time? Should I watch it?” </li></ul><ul><li>“ What’s the best mid-size sedan in this price-range?” </li></ul>
    23. 30. Choosing, cont. <ul><li>Keep reputations for entities only when it makes sense to do so. </li></ul><ul><li>Only when it can be presented back to the user in a way that aids them in making these judgments. </li></ul>
    24. 31. Good Decision <ul><li>YouTube keeps numerous reputation-types, all derived from diff combinations of various inputs. These help users compare video quality/interest across several different axes. </li></ul>
    25. 32. Bad Decision <ul><li>Orkut allowed people to explicitly rate other users on iconic dimensions like trusty , cool , and sexy for no utility other than display. This caused all kinds of social backlash. </li></ul>
    26. 33. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . What kinds of information? Where does this information come from? How do we experience it ?
    27. 34. <ul><li>A quick overview of how reputation systems work… </li></ul>Where does this information come from?
    28. 35. The classic love triangle…
    29. 47. Sally has found her Bits.
    30. 48. Bob is rewarded for his Bits.
    31. 49. And, yes, Sally admires Bob.
    32. 50. <ul><li>Gathered by monitoring events that occur on (or off) your site. </li></ul>Where does this information come from?
    33. 51. <ul><li>The fundamental building block of any reputation system. </li></ul>The Reputation Statement
    34. 53. Individual statements combine to form aggregate or community scores
    35. 54. What are the Targets? Claims?
    36. 55. <ul><li>Explicit: Someone makes a statement about the quality of something </li></ul><ul><li>Implicit: Someone acts on something, so we infer value from that. </li></ul>2 Kinds of Reputation Statement
    37. 56. Explicit
    38. 57. Implicit
    39. 58. Lighting Round: Explicit or Implicit <ul><li>Some of the examples from before </li></ul><ul><li>I’ve marked some possible reputation inputs ( events that generate reputation statements .) </li></ul><ul><li>For each input: is it an explicit statement? Or an implicit one? </li></ul>
    40. 62. <ul><li>Each method has value. </li></ul><ul><li>You can use them in combination. </li></ul><ul><li>Explicit invites gaming, tho’ neither method defends against it. </li></ul>Use both
    41. 63. <ul><li>To give a variety of means for participation </li></ul><ul><ul><li>Vote, poll, ‘Buzz’, Rate </li></ul></ul><ul><li>You want explicit DISPLAY </li></ul><ul><ul><li>Show a score or Avg. Rating </li></ul></ul><ul><ul><li>To enable comparisons, leaderboards </li></ul></ul>Go ‘Explicit’ when…
    42. 64. Reputation is… Information used to make a value judgment about an object or person within a context for a period of time . What kinds of value judgments? Who’s doing the judging? How are these judgments expressed ?
    43. 65. Reputation can help your users decide… <ul><li>“ Is this video worth my time?” </li></ul><ul><li>“ Who are the people on this site that I should pay attention to?” </li></ul><ul><li>“ Who’s most helpful here?” </li></ul><ul><ul><li>Funniest? </li></ul></ul><ul><ul><li>A good conversation-starter? </li></ul></ul>
    44. 66. But not always in the ways you think!
    45. 67. Consider instead…
    46. 68. Or…
    47. 69. <ul><li>For your project, you’ve already identified the users & drafted some designs to represent their Identities . Furthermore, you’ve thought about the Social Objects that they’re likely to generate, and the types of activities that those objects will support… </li></ul>Exercise 3
    48. 70. <ul><li>Now, let’s identify the types of reputations that would be most useful </li></ul><ul><li>Identify which entities on your site (people and objects) should be reputable ones </li></ul><ul><li>Discuss what types of reputations you’d like to keep for each </li></ul><ul><li>List a number of Inputs, or actions that—when taken—will produce Reputation Statements. </li></ul>Exercise 3, cont.

    ×