Hacker News          vs.       Slashdot    Reputation Systems inCrowdsourced Technology News Robert Lehmann, Christoph Mat...
100020003000       2011   2012
Slashdot●●●●    ○●●●    ○
Slashdot usersalexa.com, Nov 25th 2012
$ $
+1, InsightfulUnfair
●●●●●
+1, Insightful
“    ■    ■
+1, InsightfulUnfair
+1 / -1Unfair
○                                                         ○                                                         ○     ...
Hacker News●●    ○●●●●“    If you apply for YC and get    rejected, pg [Paul Graham] may    follow-up with an explanation ...
Hacker News usersalexa.com, Nov 25th 2012
“         Anything that good hackers would find interesting.          That includes more than hacking and startups.If you ...
UpvotesUpvotes
no duplicate votes  once you have voted
kinda bookmarksnot only endorsements
scale
rewards
report inappropriate contentreply flag             (spam or offtopic, for stories too)
new story type: polls
change top color         (yay! o/)
downvotes for comments only
comment score below zero(def comment-color (c)  (if (> c!score 0) black (grayrange c!score)))
Community Nature
Four design goals for distributed moderation systems
Four design goals for distributed moderation systems
Four design goals for distributed moderation systems
Four design goals for distributed moderation systems
Four design goals for distributed moderation systems
Effectiveness of metamoderation on Slashdot % of moderations reversed                Metamoderations agreement with fairne...
Other considerations
Other considerations
Other considerations
Other considerations
Other considerations
political discussion●                  ●●                  ●    ○●    ○●    ○●
buried treasures
Is this aproblem?
% ofmoderationsreversed              Metamoderations agreement with                  fairness of moderation
How? Attention Deficit●    ○                                    29%   30%                              25%                ...
How? Attention Deficit●    ○●    ○    ○
How? Attention Deficit●                        X II   ⅕    ○●                        X II    ○    ○                       ...
How? Information Cascade Effect
Information Cascade Effect                as applicable to Slashdot                    +3, Insightful         explicitly v...
Remember, though though      Remember,All these effects dont have to be negative.e.g. Information Cascade Effect can stren...
Lampe’s Solution [1]                   visible                                                 hidden          Adjust the ...
The four design goals in Lampe’s proposal
Lampe’s Solution     as applied to Hacker News
Power to the people M2             *
Encourage constant greatness            *
protection mechanisms
cheating, the secret sauce (def vote-for (user i (o dir up)) ● karma bombing prevention   (unless (or ((votes user) i!id) ...
and now a word from CmdrTacorigorous checks for legit posts  ● HTTP Proxy  ● maximum number of posts per day  ● "trollishn...
and now a word from CmdrTacorigorous filters for legit posts  ● 7 whitespaces in the subject     lots of space in the subj...
banhammer
Use -f to forcibly slap     warning if a user has more than 10 Karma● Karma: Terrible (-10) ● Karma: Terrible (-10)● defau...
nukeblast                      blast    kill submission            +ban the site               +              ban user
hellbanning                  ●                  ●                  ●                  ●“a hellbanned user is likely to get...
Backup slides
General cheating (this always works)             ●             ●             ●             ●             ●             ●
Gaming the System●●●●●●●●
“
unless ($opts{f}) {    die <<ERR if $user->{karma} > 10;User $_ has a karma of $user->{karma}. Slap aborted. Use -f to for...
Moderation adjectives
Tweaking options on Slashdot
Basic Social Media
Submit-Publish
Slashdot submission overview
Hacker News submission overview
Comment overview on Slashdot
Hacker News comment overview
Distribution of comment scores on Slashdot
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News
Upcoming SlideShare
Loading in …5
×

Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News

1,262 views
1,121 views

Published on

Comparing the reputation systems of Slashdot (slashdot.org) and Hacker News (news.ycombinator.com), highligting details and presenting possible changes.

Christoph Matthies (@chrima0), Robert Lehmann (@rlehmann)

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,262
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
11
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Hacker News vs. Slashdot—Reputation Systems in Crowdsourced Technology News

  1. 1. Hacker News vs. Slashdot Reputation Systems inCrowdsourced Technology News Robert Lehmann, Christoph Matthies (@rlehmann) (@chrisma0) Nov 2012
  2. 2. 100020003000 2011 2012
  3. 3. Slashdot●●●● ○●●● ○
  4. 4. Slashdot usersalexa.com, Nov 25th 2012
  5. 5. $ $
  6. 6. +1, InsightfulUnfair
  7. 7. ●●●●●
  8. 8. +1, Insightful
  9. 9. “ ■ ■
  10. 10. +1, InsightfulUnfair
  11. 11. +1 / -1Unfair
  12. 12. ○ ○ ○ ○ -10 -1 0 12 25Defaults in Slash CMS (slashcode/sql/mysql/defaults.sql)
  13. 13. Hacker News●● ○●●●●“ If you apply for YC and get rejected, pg [Paul Graham] may follow-up with an explanation just because you have a high score.
  14. 14. Hacker News usersalexa.com, Nov 25th 2012
  15. 15. “ Anything that good hackers would find interesting. That includes more than hacking and startups.If you had to reduce it to a sentence, the answer might be: anything that gratifies ones intellectual curiosity.
  16. 16. UpvotesUpvotes
  17. 17. no duplicate votes once you have voted
  18. 18. kinda bookmarksnot only endorsements
  19. 19. scale
  20. 20. rewards
  21. 21. report inappropriate contentreply flag (spam or offtopic, for stories too)
  22. 22. new story type: polls
  23. 23. change top color (yay! o/)
  24. 24. downvotes for comments only
  25. 25. comment score below zero(def comment-color (c) (if (> c!score 0) black (grayrange c!score)))
  26. 26. Community Nature
  27. 27. Four design goals for distributed moderation systems
  28. 28. Four design goals for distributed moderation systems
  29. 29. Four design goals for distributed moderation systems
  30. 30. Four design goals for distributed moderation systems
  31. 31. Four design goals for distributed moderation systems
  32. 32. Effectiveness of metamoderation on Slashdot % of moderations reversed Metamoderations agreement with fairness of moderation
  33. 33. Other considerations
  34. 34. Other considerations
  35. 35. Other considerations
  36. 36. Other considerations
  37. 37. Other considerations
  38. 38. political discussion● ●● ● ○● ○● ○●
  39. 39. buried treasures
  40. 40. Is this aproblem?
  41. 41. % ofmoderationsreversed Metamoderations agreement with fairness of moderation
  42. 42. How? Attention Deficit● ○ 29% 30% 25% 9%
  43. 43. How? Attention Deficit● ○● ○ ○
  44. 44. How? Attention Deficit● X II ⅕ ○● X II ○ ○ X II ⅕● ○
  45. 45. How? Information Cascade Effect
  46. 46. Information Cascade Effect as applicable to Slashdot +3, Insightful explicitly visible comment scores
  47. 47. Remember, though though Remember,All these effects dont have to be negative.e.g. Information Cascade Effect can strengthengood comments and further demote bad ones.
  48. 48. Lampe’s Solution [1] visible hidden Adjust the damn comment filter.before most recentafter recently written recently moderated
  49. 49. The four design goals in Lampe’s proposal
  50. 50. Lampe’s Solution as applied to Hacker News
  51. 51. Power to the people M2 *
  52. 52. Encourage constant greatness *
  53. 53. protection mechanisms
  54. 54. cheating, the secret sauce (def vote-for (user i (o dir up)) ● karma bombing prevention (unless (or ((votes user) i!id) (and (~live i) (isnt user i!by))) ○ prevent cabal against individual users (withs (ip (logins* user) ● downvote ratio vote (list (seconds) ip user dir i!score)) (unless (or (and (or (ignored user) (check-key user novote)) ○ cannot cast too many downvotes (isnt user i!by)) (and (is dir down) ● sockpuppet protection (~editor user) (or (check-key user nodowns) (> (downvote-ratio user) downvote-ratio-limit*) ; prevention of karma-bombing (just-downvoted user i!by))) (and (~legit-user user) (isnt user i!by) (find [is (cadr _) ip] i!votes)) (and (isnt i!type pollopt) (biased-voter i vote))) (++ i!score (case dir up 1 down -1))
  55. 55. and now a word from CmdrTacorigorous checks for legit posts ● HTTP Proxy ● maximum number of posts per day ● "trollishness" ○ half-lived amount of downvotes if ($constants->{comments_portscan} ● compresses too well (with Zlib) && ( $constants->{comments_portscan} == 2 || $constants->{comments_portscan} == 1 && ○ ASCII art $user->{is_anon} ) ) { my $is_trusted = $slashdb->checkAL2($user->{srcids}, "nobody should be using that many wide trusted); characters in the Standard English alphabet" if (!$is_trusted) { my $is_proxy = $slashdb->checkForOpenProxy ($user->{hostip}); if ($is_proxy) { $$error_message = getError(open proxy, { Anonymous Cowards punished harder. unencoded_ip port => $ENV{REMOTE_ADDR}, => $is_proxy, }); $form_success = 0; return; } } }
  56. 56. and now a word from CmdrTacorigorous filters for legit posts ● 7 whitespaces in the subject lots of space in the subject ... lots of space in the head. ● more than one character one character. Hmmm. Gee, might this be a troll? ● words longer than 80 letters if ($constants->{comments_portscan} && ( $constants->{comments_portscan} == 2 thats an awful long string of letters there! || $constants->{comments_portscan} == 1 && $user->{is_anon} ) ● 50% caps ) { my $is_trusted = $slashdb->checkAL2($user->{srcids}, trusted); PLEASE DONT USE SO MANY CAPS. if (!$is_trusted) { USING CAPS IS LIKE YELLING! my $is_proxy = $slashdb->checkForOpenProxy ($user->{hostip}); ● "feces", "goatse.cx" if ($is_proxy) { $$error_message = getError(open proxy, { unencoded_ip => $ENV{REMOTE_ADDR}, too smelly to submit port => $is_proxy, }); $form_success = 0; return; } } }
  57. 57. banhammer
  58. 58. Use -f to forcibly slap warning if a user has more than 10 Karma● Karma: Terrible (-10) ● Karma: Terrible (-10)● default comment ● revoke all score of -1 moderation points● set all comment scores to Offtopic (-1)
  59. 59. nukeblast blast kill submission +ban the site + ban user
  60. 60. hellbanning ● ● ● ●“a hellbanned user is likely to get bored orfrustrated and leave [...]the silent treatment is the cruelestpunishment of them all. [1] — Jeff Atwood
  61. 61. Backup slides
  62. 62. General cheating (this always works) ● ● ● ● ● ●
  63. 63. Gaming the System●●●●●●●●
  64. 64.
  65. 65. unless ($opts{f}) { die <<ERR if $user->{karma} > 10;User $_ has a karma of $user->{karma}. Slap aborted. Use -f to forcibly slap.ERR}print "Bitch Slapping #$_...n";print "Karma Reducedn";print "Default Score Reducedn";$slashdb->setUser($_, { -karma => $constants->{badkarma}, -defaultpoints => -1,});print "ALL live comments moderated downnn";$slashdb->sqlDo("UPDATE comments SET points=-1,reason=1 WHERE uid=$_"); Exhibit A — source of bitchslap (Slashdot)
  66. 66. Moderation adjectives
  67. 67. Tweaking options on Slashdot
  68. 68. Basic Social Media
  69. 69. Submit-Publish
  70. 70. Slashdot submission overview
  71. 71. Hacker News submission overview
  72. 72. Comment overview on Slashdot
  73. 73. Hacker News comment overview
  74. 74. Distribution of comment scores on Slashdot

×