View stunning SlideShares in full-screen with the new iOS app!Introducing SlideShare for AndroidExplore all your favorite topics in the SlideShare appGet the SlideShare app to Save for Later — even offline
View stunning SlideShares in full-screen with the new Android app!View stunning SlideShares in full-screen with the new iOS app!
Gold Standard Worker 1 Worker 2
A A A
D B D
2 4 2
Downs et al. 2010
Callison-Burch, 2009 Ipeirotis et al. 2010
Dekel & Shamir, 2009 Snow et al. 2008
WorkerID Video Transcript
AF34DB9 Coloring comics in Photoshop is easy. First you…
TK421S9S Coloring comcs in photoshop is easy first u…
APC3C55 Coloring comics in Photoshop is easy. First you…
IDKFAD1 Coloring comics in photoshop is easy. First you…
- Time consuming iteration
- Not always available
- Not always applicable
- Limits response range
- Subject to majority effects
- Not always applicable
Experimental MTurk Tasks
“Identify which words are nouns.”
“Generate 3-5 tags for each of 4 images.”
“Read and then answer the following questions.”
Provide at least 3 tags for
the following image…
Series and series of works starting with “Godzilla"
monster movie Godzilla was released in special
effects is the name of the fictional monster of
The film named “Godzilla" is a special effects
monster movie, and Godzilla is the monster.
I like to visit Alappuzha in Kerala, the God's own country.
This place is blessed with heavenly lakes. The view of lake
shores from the boats is very beautiful. We can enjoy cool
wind standing in the boats. We can see a complete
picture of a beautiful village by a trip through the lakes of
My favorite place in the world to be is right at home!
Ideally my daughter and husband and I just spending
time together watching television, sharing a meal, or
discussing our day. I know it might sound boring to some
but I find joy and security in the familiar surroundings. Sure,
there are other places I enjoy but given the choice my
home will always be the place I am the happiest.
Have you ever wondered what causes swing sets to move
with no one on them? Or why bridges twist and tear
themselves apart? The answer is aeroelastic tension. But the
science behind it is the most interesting part. Watch this and
you'll find out how it works in less than two minutes.
collapse bridge physics tension aeroelastic
Tacoma Narrows Bridge Collapse
Logging is not perfect
Feature set, ML algorithms