Building crowdsourcing applications
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Building crowdsourcing applications

on

  • 13,419 views

A talk on my experiences building crowdsourcing applications, both at the Guardian newspaper and for my own personal projects. Presented at Web Directions @media 2010 on June 9th.

A talk on my experiences building crowdsourcing applications, both at the Guardian newspaper and for my own personal projects. Presented at Web Directions @media 2010 on June 9th.

Statistics

Views

Total Views
13,419
Views on SlideShare
8,548
Embed Views
4,871

Actions

Likes
29
Downloads
318
Comments
1

21 Embeds 4,871

http://dailycrowdsource.com 3826
http://www.webdirections.org 716
http://lanyrd.com 109
http://beta.dailycrowdsource.com 108
http://simonwillison.net 27
http://www.dailycrowdsource.com 19
http://marbella.directrouter.com 10
http://paper.li 10
http://gamma.dailycrowdsource.com 7
http://twitter.com 7
http://translate.googleusercontent.com 6
http://jungle.dailycrowdsource.com 5
http://delta.dailycrowdsource.com 5
http://webcache.googleusercontent.com 4
http://www.unroll.me 3
http://www.slideshare.net 3
http://safe.tumblr.com 2
http://archive.dailycrowdsource.com 1
http://lanyrd.dev 1
https://twitter.com 1
http://feeds.feedburner.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Don't be afraid! Take risks! This is the most important lesson in this presentation!

    Thank you for this presentation, Simon! It's really inspirational!

    Kudos! from all of us at crowdsourcing.org
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Building crowdsourcing applications Presentation Transcript

  • 1. Building crowdsourcing applications Simon Willison - simonwillison.net - @simonw @media - 9th June 2010
  • 2. Crowdsourcing? Let me just cop to the fact that “crowdsourcing” is a stupid buzzword. But like “blog” before it, sometimes it’s the stupid term that sticks. For my purposes, it means collaborating with the people who used to be the silent audience to make something better than you could make alone. - Derek Powazek http://powazek.com/posts/2443
  • 3. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 4. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 5. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 6. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 7. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 8. Accuracy Game mechanics Psychology Real-time Copywriting Usability Crowdsourcing Visual design Incentives Moderation Ethics Write-heavy Competition Statistics Legal liability
  • 9. Examples
  • 10. OpenStreetMap
  • 11. Google Image Labeler
  • 12. ScenicOrNot
  • 13. XKCD colour survey
  • 14. Crowdsourcing at the Guardian
  • 15. The Blair Rich Project
  • 16. MP’s expenses v1 http://mps-expenses.guardian.co.uk/
  • 17. Background June 2009 450,000 pages of expenses documents released “Transparency” = dodgy scanned PDFs One week notice - so one week to build it!
  • 18. Stuff that worked The progress bar Photos of the MPs Releasing a small group of documents at first Score boards (once we finally added them) Especially the “top in last 48 hours” one
  • 19. Stuff that didn't Releasing everything else at once Asking the wrong questions Line items! Too much time fighting scalability fires Reporting tools were 24 hours too late
  • 20. Contributors total users date
  • 21. Votes per user users number of votes cast
  • 22. MP’s expenses v2 http://mps-expenses2.guardian.co.uk/
  • 23. Background December 2009 Smaller number of documents One weeks notice (again) Opportunity to learn from our earlier mistakes
  • 24. Goals Find stuff our journalists cared about Less boring data entry Data coming out again from the start Visible rewards for contributors More digestible tasks Better sense of activity by other people
  • 25. Lessons learned Use Redis for random selections, not MySQL Assignments made a huge improvement The most important logic in a crowdsourcing system is the next thing to review button “Oldest first” pagination is critical
  • 26. WildlifeNearYou.com
  • 27. /dev/fort
  • 28. Where’s my nearest llama?
  • 29. Lessons learned Be flexible: your users may not share your precise goals Optimise for the fat head of your user base Expose recent activity to site staff Users will do almost anything for a medal!
  • 30. Final thoughts Don’t be afraid: even flawed crowdsourcing systems produce fascinating results Think hard about the questions you ask Have a minimal barrier to entry Get the next task logic right. Seriously.
  • 31. Thank you http://simonwillison.net/ http://twitter.com/simonw http://simonwillison.net/tags/crowdsourcing/