• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Ekaw2012 nichesourcing
 

Ekaw2012 nichesourcing

on

  • 725 views

Slides for a position paper about "Nichesourcing" presented at EKAW 2012 in Galway Ireland at 11 Oct. 2012. ...

Slides for a position paper about "Nichesourcing" presented at EKAW 2012 in Galway Ireland at 11 Oct. 2012.

In this position paper we identify nichesourcing, a specific form of
human-based computation that harnesses the computational efforts from niche groups rather than the “faceless crowd”. We claim that nichesourcing combine the strengths of the crowd with those of professionals, optimizing the result of human-based computation for certain tasks. We illustrate our claim using scenarios
in two domains: cultural heritage and regreening in Africa. The contribution
of this paper is to provide a definition of the main characteristics of nichesourcing as a natural extension of crowdsourcing and to outline research challenges for realizing nichesourcing applications.

Statistics

Views

Total Views
725
Views on SlideShare
715
Embed Views
10

Actions

Likes
1
Downloads
6
Comments
0

2 Embeds 10

https://twitter.com 9
https://si0.twimg.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • The Print Room of the Rijksmuseum in Amsterdamhas a collection of about 700 000 prints, drawings and photographs. Within the projectPrint Room Online they register the basic properties of each print, such as the object ID,storage location, title, creator and measurements. In addition, they describe the subjectmatter of the prints. The annotation is performed by eleven professional cataloguerswhich are expected to describe 20% of the collection during the 3 years of the project.
  • Does anyone know what flower this is? -> Iris
  • Or this (CastleWijkbijDuurstede)
  • Clearly, there is a need for more human effort in order to describe the entire collection of the Print Room. Crowdsourcing seems like the natural solution to the problem.Indeed, many museums and cultural heritage archives have already embraced the notionof human-computing in order to solve the same problem. Typically, they applycrowdsourcing techniques [7], [12]. As a result they receive large quantities of metadata,but not necessarily of sufficient quality [13].

Ekaw2012 nichesourcing Ekaw2012 nichesourcing Presentation Transcript

  • Nichesourcing: Harnessing the Power of Crowds of Experts Victor de Boer, Michiel Hildebrand, Lora Aroyo, Pieter De Leenheer, Chris Dijkshoorn, Binyam Tesfa, Guus SchreiberEKAW 2012, Galway, Ireland. 8-12 Oct. 2012
  • Rijksmuseum Prints Img: Flickr/ only_point_five
  • What is this? Iris
  • What is this? Castle “Wijk bij Duurstede”
  • A colossal effortFor Print Room Online 11 professional cataloguersare expected to describe 20% of the collectionduring the 3 years of the project.Also, in some cases they lack the specific expertise
  • Crowdsourcing?Not suited for this knowledge intensive task Not ‘a castle’, but castle ‘Wijk bij Duurstede’ Not ‘a flower’, but ‘Iris’, or even more precise Not ‘frog’ but the symbolic meaning of a frog in a Japanese printHigh quality annotationsLong-term motivation
  • In general, we observe that there is (i) a growing demand for solving also complex knowledge-intensive tasks and (ii) a natural expectation to focus on the quality of the final result. Oomen, J., Aroyo, L.: Crowdsourcing in the cultural heritage domain: opportunities and challenges. Oded Nov, O.A., Anderson, D.: Dusting for science: motivation and participation of digital citizen science volunteers. Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. Gligorov, R., Hildebrand, M., van Ossenbruggen, J., Schreiber, G., Aroyo, L.: On the role ofuser-generated metadata in audio visual collections
  • Professional effort Crowdsourcing Human-based computation Nichesourcing Niche groups of amateur experts with shared characteristics
  • ACCURATOR - Nichesourcing Specific Knowledge for Cultural Heritage Institutions Step 1: identify the main topics for annotation from Rijksmuseum printsStep 2: allocate the annotation tospecific niche groupsStep 3: Gather and rate the qualityof annotations provided by niches Specific windmill Step 4: Select the most complete and accurate annotations Specific boat Adapted from C. Dijkshoorn, M Leyssen, A Nottamkandath, J. Oosterman, M Traub [SEALINCMedia project ]
  • Crowd vs. Niche Img: Flickr/creativejenna
  • The Atomic Task: Simple vs. Knowledge-intensiveCrowdsourcing for simple atomic tasks.Nichesourcing for atomic tasks that a) require specific knowledge b) require more effort
  • Product: Quantity vs. QualitySuccess of crowdsourcing lies in quantity Quality can be achieved through either careful application design or post processing.In nichesourcing the expertise and intrinsic courtesyleads to higher quality individual results
  • Resource Pool: Crowd vs. Community of PracticeMotivating the crowd requires careful design (gamification, payment,…)In a niche, we expect intrinsic motivation throughconnection with the task, shared goal or context.Furthermore, we can exploit the social relationswithin the community of practice for motivation altruism,reputation
  • Second Case Study:Who wants to be a regreening super hero? Photo credit: Chris Reij
  • Nichesourcing for pluvial data digitization for the Sahel [W4RA-related M.Sc. thesis by Binyam Tesfa]
  • Nichesourcing challenges• Identification of and access to niche(s)• Task distribution Use intrinsic social connections cf. expert finding• Adequate motivation reputation, altruism,…• Quality assurance within peer networks Trust, reputation
  • Thank you v.de.boer@vu.nl @victordeboerWeb for regreening in Africa (W4RA) SEALINCMedia project w4ra.few.vu.nl sealincmedia.wordpress.com