Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Nichesourcing:         Harnessing the Power of Crowds of Experts         Victor de Boer, Michiel Hildebrand, Lora Aroyo, P...
Rijksmuseum Prints                     Img: Flickr/ only_point_five
What is this?   Iris
What is this?   Castle “Wijk bij Duurstede”
A colossal effortFor Print Room Online 11 professional cataloguersare expected to describe 20% of the collectionduring the...
Crowdsourcing?Not suited for this knowledge intensive task  Not ‘a castle’, but castle ‘Wijk bij Duurstede’  Not ‘a flower...
In general, we observe that there is    (i) a growing demand for solving also complex        knowledge-intensive tasks and...
Professional effort                                Crowdsourcing                      Human-based computation             ...
ACCURATOR - Nichesourcing Specific Knowledge        for Cultural Heritage Institutions    Step 1: identify the main topics...
Crowd vs. Niche                  Img: Flickr/creativejenna
The Atomic Task:     Simple vs. Knowledge-intensiveCrowdsourcing for simple atomic tasks.Nichesourcing for atomic tasks th...
Product:               Quantity vs. QualitySuccess of crowdsourcing lies in quantity   Quality can be achieved through eit...
Resource Pool:    Crowd vs. Community of PracticeMotivating the crowd requires careful design  (gamification, payment,…)In...
Second Case Study:Who wants to be a regreening super hero?                                Photo credit: Chris Reij
Nichesourcing for pluvial data digitization for the Sahel                                  [W4RA-related M.Sc. thesis by B...
Nichesourcing challenges• Identification of and access to niche(s)• Task distribution   Use intrinsic social connections  ...
Thank you                                 v.de.boer@vu.nl                                  @victordeboerWeb for regreening...
Upcoming SlideShare
Loading in …5
×

Ekaw2012 nichesourcing

956 views

Published on

Slides for a position paper about "Nichesourcing" presented at EKAW 2012 in Galway Ireland at 11 Oct. 2012.

In this position paper we identify nichesourcing, a specific form of
human-based computation that harnesses the computational efforts from niche groups rather than the “faceless crowd”. We claim that nichesourcing combine the strengths of the crowd with those of professionals, optimizing the result of human-based computation for certain tasks. We illustrate our claim using scenarios
in two domains: cultural heritage and regreening in Africa. The contribution
of this paper is to provide a definition of the main characteristics of nichesourcing as a natural extension of crowdsourcing and to outline research challenges for realizing nichesourcing applications.

Published in: Education
  • Be the first to comment

Ekaw2012 nichesourcing

  1. 1. Nichesourcing: Harnessing the Power of Crowds of Experts Victor de Boer, Michiel Hildebrand, Lora Aroyo, Pieter De Leenheer, Chris Dijkshoorn, Binyam Tesfa, Guus SchreiberEKAW 2012, Galway, Ireland. 8-12 Oct. 2012
  2. 2. Rijksmuseum Prints Img: Flickr/ only_point_five
  3. 3. What is this? Iris
  4. 4. What is this? Castle “Wijk bij Duurstede”
  5. 5. A colossal effortFor Print Room Online 11 professional cataloguersare expected to describe 20% of the collectionduring the 3 years of the project.Also, in some cases they lack the specific expertise
  6. 6. Crowdsourcing?Not suited for this knowledge intensive task Not ‘a castle’, but castle ‘Wijk bij Duurstede’ Not ‘a flower’, but ‘Iris’, or even more precise Not ‘frog’ but the symbolic meaning of a frog in a Japanese printHigh quality annotationsLong-term motivation
  7. 7. In general, we observe that there is (i) a growing demand for solving also complex knowledge-intensive tasks and (ii) a natural expectation to focus on the quality of the final result. Oomen, J., Aroyo, L.: Crowdsourcing in the cultural heritage domain: opportunities and challenges. Oded Nov, O.A., Anderson, D.: Dusting for science: motivation and participation of digital citizen science volunteers. Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. Gligorov, R., Hildebrand, M., van Ossenbruggen, J., Schreiber, G., Aroyo, L.: On the role ofuser-generated metadata in audio visual collections
  8. 8. Professional effort Crowdsourcing Human-based computation Nichesourcing Niche groups of amateur experts with shared characteristics
  9. 9. ACCURATOR - Nichesourcing Specific Knowledge for Cultural Heritage Institutions Step 1: identify the main topics for annotation from Rijksmuseum printsStep 2: allocate the annotation tospecific niche groupsStep 3: Gather and rate the qualityof annotations provided by niches Specific windmill Step 4: Select the most complete and accurate annotations Specific boat Adapted from C. Dijkshoorn, M Leyssen, A Nottamkandath, J. Oosterman, M Traub [SEALINCMedia project ]
  10. 10. Crowd vs. Niche Img: Flickr/creativejenna
  11. 11. The Atomic Task: Simple vs. Knowledge-intensiveCrowdsourcing for simple atomic tasks.Nichesourcing for atomic tasks that a) require specific knowledge b) require more effort
  12. 12. Product: Quantity vs. QualitySuccess of crowdsourcing lies in quantity Quality can be achieved through either careful application design or post processing.In nichesourcing the expertise and intrinsic courtesyleads to higher quality individual results
  13. 13. Resource Pool: Crowd vs. Community of PracticeMotivating the crowd requires careful design (gamification, payment,…)In a niche, we expect intrinsic motivation throughconnection with the task, shared goal or context.Furthermore, we can exploit the social relationswithin the community of practice for motivation altruism,reputation
  14. 14. Second Case Study:Who wants to be a regreening super hero? Photo credit: Chris Reij
  15. 15. Nichesourcing for pluvial data digitization for the Sahel [W4RA-related M.Sc. thesis by Binyam Tesfa]
  16. 16. Nichesourcing challenges• Identification of and access to niche(s)• Task distribution Use intrinsic social connections cf. expert finding• Adequate motivation reputation, altruism,…• Quality assurance within peer networks Trust, reputation
  17. 17. Thank you v.de.boer@vu.nl @victordeboerWeb for regreening in Africa (W4RA) SEALINCMedia project w4ra.few.vu.nl sealincmedia.wordpress.com

×