The presentation gives a broad overview of crowdsourcing and crowdsensing. It motivates the ideas of several types of crowdsourcing and crowdsensing applications using typical examples from business and society.
2. THE WISDOM OF CROWDS
The crowd at a county fair accurately guessed the weight of
an ox when their individual guesses were averaged (the
average was closer to the ox's true butchered weight than
the estimates of most crowd members, and also closer than
any of the separate estimates made by cattle experts).
- the wisdom of crowds
20-11-2015 Slide no. 2
Read more about taxonomy here: Hosseini, M.; Phalp, K.; Taylor, J.; Ali, R., "The four
pillars of crowdsourcing: A reference model," in Research Challenges in Information
Science (RCIS), 2014 IEEE Eighth International Conference on , vol., no., pp.1-12, 28-30
May 2014
3. THE KEY COMPONENTS
1. An organisation that has a task it needs performed
2. A community (crowd) that is willing to perform the task
3. An online environment that allows the work to take place
and the community to interact with the organization
4. Mutual benefit for the organization and the community
20-11-2015 Slide no. 3
6. CROWDSOURCING BY TYPE
20-11-2015 Slide no. 6
Type How it works Kinds of problems Examples
Knowledge discovery and
management
Organization tasks a
crowd with finding and
collecting information into
a common location and
format
Ideal for info gathering,
organization and
reporting problems, such
as the creation of
collective resources
Peer-to-patent
SeeClickFix
Broadcast search Organization tasks a
crowd with solving
empirical problems
Ideal for ideation
problems with empirical
provable solutions, such
as scientific problems
InnoCentive
Goldcorp Challenge
Peer-vetted creative
production
Organization tasks a
crowd with creating and
selecting creative ideas
Ideal for ideation
problems where solutions
are matters of taste or
market support, such as
design or aesthetic
problems
Threadless
Doritos Crash the Super
Bowl Contest
Next Stop Design
Distributed human-
intelligence tasking
Organization tasks a
crowd with analyzing
large amounts of
information
Ideal for large-scale data
analysis where human
intelligence is more
efficient or effective than
computer analysis
Amazon Mechanica
Subvert and Profit
7. FROM CROW/SENSING TO SOURCING
20-11-2015 Slide no. 7
Criterion Involvement of the user Type of measurement
Types of
crowd/sensing
• Participatory
crowd/sensing (active)
• Opportunistic
crowd/sensing (passive)
• Environmental
(pollution)
• Infrastructure
(traffic)
• Social
(cinema visit)
Knowledge discovery and management
11. INGRESS
Ryoma Kawajiri, Masamichi Shimosaka, and Hisashi Kashima. 2014. Steered crowdsensing: incentive
design towards quality-oriented place-centric crowdsensing. In Proceedings of the 2014 ACM
International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York,
NY, USA, 691-701. DOI=http://dx.doi.org/10.1145/2632048.2636064
https://www.youtube.com/watch?v=92rYjlxqypM
13. ISSUES WITH CROWD/SENSING
• Motivating and maintaining the crowd
– intrinsic motivators (fun and challenge)
– extrinsic motivators (financial reward, fame, social pressure)
– which motivators generate higher quality of work?
• Technology
– data collection mechanisms (low power, low cost)
– reliability, quality and frequency of data
– data analytics and annotation
– engagement – the fun-factor
• Ethics, Legal, Ownership and Copyright
20-11-2015 Slide no. 13
14. Mirko Presser @mirkopresser
Vice President of the IoT Forum
Head of Research and Innovation
Smart City Lab
Alexandra Instituttet A/S
Editor's Notes
The Wisdom of Crowds was published in 2004 and written by James Surowiecki about the aggregation of information in groups, resulting in decisions that, he argues, are often better than could have been made by any single member of the group. The opening anecdote relates Francis Galton's surprise that the crowd at a county fair accurately guessed the weight of an ox when their individual guesses were averaged and outperformed the professional cattle experts.
Jeff Howe and Mark Robinson, from Wired Magazine, coined the term "crowdsourcing" in 2005 after conversations about how businesses were using the Internet to outsource work to individuals.
The first scientific article on crowdsourcing (using the term) was published by Daren C. Brabham on 1st February 2008. So we only have been talking about this term for 10 years and in the scientific community only for around 7 years. Business has been doing this for some time now. So it might be more fitting to dig into business for the state of the art.
organisation = city with task = pot holes
community = citizens
online environment = web + mobile app OR web + sensor
mutual benefit = city knows where the pot holes are and citizens get them fixed more quickly (need to have a feedback mechanisms on the web, e.g. fixing pipeline or priority…?)
If the focus is on crowd it becomes a collaborative community.
If the focus is on the organization it becomes too limited in using the collective intelligence of the crowd, e.g. what do you like better.
SeeClickFix allows you to play an integral role in public services — routing neighborhood concerns like potholes and light outages to the right official with the right information.
Innocentive crowdsources innovation solutions from the world’s smartest people, who compete to provide ideas and solutions to important business, social, policy, scientific, and technical challenges.
Artists from around the world submit designs, the Threadless community scores each design and the best of the best are printed and sold. New designs are chosen for print every week and the winning artists can profit handsomely for their designs, and in some cases, also take home big cash prizes from special themed design challenges.
Amazon Mechanical Turk is a marketplace for work. It gives business and developers access to an on-demand, scalable workforce. Workers select from thousands of tasks and work whenever it’s convenient. HITs = Human Intelligence Tasks, e.g. identify items on receipts or draw a sketch. Avg pay is around $2.25/h.
11 March 2011 – SAFECAST is a posterboy project about participatory crowdsensing on environmental data (radiation levels). 3 min video.
Smartsantander project made a great app (a bit like seeclickfix, but with additional features and an ecosystem) – let’s watch the movie. Play form 1:10min to 2:20mins.
The ECOSENSE project is a national project form funded by the Danish research council and looks at crowdsensing of people’s movements. It focuses almost entirely in this aspect on the technological components like the algorithm to determine mode of transportation, data collection from mobile phones and visualizations.
The trojan!
Steered Crowdsensing
Google’s new location-based MMORPG (massive-multiplayer-online-role-playing-game)
Collects data about your movement – knows where you mainly walk – better maps for pedestrians.
In reality (a popular conspiracy theory) is that Google can solve the problem of routing people efficiently.