Components and Functions of Crowdsourcing Systems –  A Systematic Literature Review
Upcoming SlideShare
Loading in...5
×
 

Components and Functions of Crowdsourcing Systems – A Systematic Literature Review

on

  • 1,194 views

Many organizations are now starting to introduce crowdsourcing as a new model of business to outsource tasks, which are traditionally performed by a small group of people, to an undefined large ...

Many organizations are now starting to introduce crowdsourcing as a new model of business to outsource tasks, which are traditionally performed by a small group of people, to an undefined large workforce. While the utilization of crowdsourcing offers a lot of advantages, the development of the required system carries some risks, which are reduced by establishing a profound theo-retical foundation. Thus, this article strives to gain a better understanding of what crowdsourcing systems are and what typical design aspects are considered in the development of such systems. In this paper, the author conducted a sys-tematic literature review in the domain of crowdsourcing systems. As a result, 17 definitions of crowdsourcing systems were found and categorized into four perspectives: the organizational, the technical, the functional, and the human-centric. In the second part of the results, the author derived and presented com-ponents and functions that are implemented in a crowdsourcing system.

Statistics

Views

Total Views
1,194
Views on SlideShare
669
Embed Views
525

Actions

Likes
1
Downloads
7
Comments
0

4 Embeds 525

http://www.larshetmank.com 447
http://www.hetmank.de 76
http://translate.googleusercontent.com 1
http://131.253.14.98 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Components and Functions of Crowdsourcing Systems –  A Systematic Literature Review Components and Functions of Crowdsourcing Systems – A Systematic Literature Review Presentation Transcript

  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement Components and Functions of Crowdsourcing Systems A Systematic Literature ReviewLars HetmankDresden, 27.02.2013
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopShort Vita• Dipl.-Wirt.-Inf. Lars Hetmank, TU Dresden• Research interests: • Information and Knowledge Management • Semantic Web and Linked Data • Crowdsourcing• Affiliations: • Manifesto for a Standard on Knowledge Exchange in Social Knowledge Management Environments • Knowledge Research Center (KRC) e.V. Dresden28.02.2013 Components and Functions of Crowdsourcing Systems Slide 2 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopMotivationPractical relevance:• development of a crowdsourcing system (CSS) and its integration into existing IT infrastructure is risky, cost-intensive, and time-consuming,• structured development process requiredTheoretical relevance:• various theoretical contribution in the area of crowdsourcing• however, little has been investigated to define a crowdsourcing system and its technical design aspects precisely2/28/2013 Components and Functions of Crowdsourcing Systems Slide 3 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopMethod: Systematic Literature ReviewResearch Questions (RQs):RQ1: How and in which detail are CSSs defined in current research literature? What design aspects do they cover?RQ2: What type of components and functions of a CSS can be conceptualized?2/28/2013 Components and Functions of Crowdsourcing Systems Slide 4 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopSearch Strategy #1• Population: peer-reviewed conference proceedings and journal papers in English since 2006; dissertations, newspaper articles, unpublished works or non-scientific articles were not considered• Search Resources: ACM Digital Library, Ebscohost (Academic Search Complete and Business Source Complete), Emerald, IEEE Xplore Digital Library, Sage Journals, ScienceDirect, SpringerLink and Wiley• Search Terms: crowdsourcing system, crowdsourcing application, and crowdsourcing platform (in singular and plural)2/28/2013 Components and Functions of Crowdsourcing Systems Slide 5 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopSearch Strategy #2• Inclusion criteria: • define or at least propose a description of what CSSs are (RQ 1) • address design issues of CSSs (RQ 2) • or classify or give an overview of CSSs (RQ 2).• Exclusion criteria: • use CSSs for evaluation purposes but do not address design issues2/28/2013 Components and Functions of Crowdsourcing Systems Slide 6 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopConduct SearchStep 1: a) review the abstract, introduction, and conclusion b) check inclusion and exclusion criteria c) label publication and research type  Relevant studies = 72 Publication type Research typeStep 2: a) read article, find and record the definitions of CSS b) set keyword for each article to identify components and functions of CSSs2/28/2013 Components and Functions of Crowdsourcing Systems Slide 7 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. Schoop Results: Crowdsourcing System Definitions (RQ1) • 17 definitions or descriptions of the term crowdsourcing system, application, or platform • vary in detail and none of them covers all of the four derived perspectives“Crowdsourcing Platform is a trusted broker ensuring that providerssuccessfully complete the task requests and that requestors pay for thecharges. Crowdsourcing Platform issues authentication credentials forrequestors and providers when they join the platform, stores details aboutskill-set, history of completed requests, handles charging andpayments, and manages platform misuse. Crowdsourcing platform canexecute crowdsourcing requests in a number of different modes, by advertisingthem on the marketplace, allowing providers to bid for them, or in the form ofa competition, where requestor identifies criteria to be used for selection of thewinning submission. Crowdsourcing platform may further allow requestors andproviders to team-up.” (Vukovic, 2009) 28.02.2013 Components and Functions of Crowdsourcing Systems Slide 8 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopPerspectives iv al c t on mediator, detailed actions e pr spe pe t i pe rs iza marketplace, performed to data oc c crowd r pe a n es tive interface, or objects or users g s trusted broker or broker crowdsourcing process requester Crowd- sourcing user interface System algorithm history tracking standardization payment mechanism workflow support iv ic ct ntr te rsp social pe e authentication c h ec pe e rs n- c interaction ni tiv APIs ca e pe a software human m l components, hu brainpower and technical functions, collective or data objects intelligence Perspectives of crowdsourcing systems (source: own illustration)28.02.2013 Components and Functions of Crowdsourcing Systems Slide 9 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopResults: Components and Functions (RQ 2) Components and functions of crowdsourcing systems (source: own illustration)28.02.2013 Components and Functions of Crowdsourcing Systems Slide 10 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopConclusion and Next Steps• development of an integrated CSS definition• overview of reusable software components and functions may be used as a checklist• dependencies between the elements are not well represented• designing a semantic model to support knowledge-intensive crowdsourcing activities28.02.2013 Components and Functions of Crowdsourcing Systems Slide 11 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopReferences(1) Kitchenham, B.: Guidelines for performing Systematic Literature Reviews in Software Engineering. (2007).(2) Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., Linkman, S.: Systematic literature reviews in software engineering – A systematic literature review. Information and Software Technology. 51, 7–15 (2009).(3) Brereton, P., Kitchenham, B. a., Budgen, D., Turner, M., Khalil, M.: Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software. 80, 571–583 (2007).(4) Wieringa, R., Maiden, N., Mead, N., Rolland, C.: Requirements engineering paper classification and evaluation criteria: a proposal and a discussion. Requirements Engineering. 11, 102– 107 (2006).(5) Bortz, J., Döring, N.: Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler. Springer, Heidelberg (2009). http://larshetmank.com/documents/wi2013_css_concept_map.pdf28.02.2013 Components and Functions of Crowdsourcing Systems Slide 12 / 13
  • Fakultät Wirtschaftswissenschaften | Lehrstuhl für Wirtschaftsinformatik, insbes. Informationsmanagement | Prof. SchoopContact Email: lars@hetmank.de Twitter: https://twitter.com/larshetmank28.02.2013 Components and Functions of Crowdsourcing Systems Slide 13 / 13