McKinley NDF2013 crowdsourcing

  • 82 views
Uploaded on

 

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
82
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
2
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Evaluating crowdsourcing websites (Why evaluation isn’t a party at the end) Donelle McKinley PhD candidate, Victoria University of Wellington Supervisors: Dr Sydney Shep and Dr Brenda Chawner www.digitalglam.org National Digital Forum conference, 27 November 2013, Wellington, New Zealand
  • 2. Heuristics for user interface design • Heuristics can resemble high-level (conceptual) design principles (Rogers et al., 2011) • Heuristics serve as both criteria to guide the design process and a basis for evaluation (Cockton et al., 2012; Hartson & Pyla, 2012). • Heuristic evaluation is inexpensive, informal, relatively intuitive, people are easily motivated to participate in the process, it requires no advance planning, and can be used early in the development process (Nielsen and Molich,1990)
  • 3. Potential usability problems identified in the heuristic evaluation of the UK-RED task interface
  • 4. UK-RED task interface problems identified by survey respondents
  • 5. Requirements for a NZ-RED task interface 1. Minimize user effort 2. Support integration of the task with research processes 3. Enable new visitors and contributors to understand what the task involves quickly and easily 4. Support accurate and controlled data entry 5. Be easy to use for people reasonably confident with the Web 6. Support flexible, structured data entry 7. Support bilingual data entry
  • 6. What did I learn? • The UK-RED task interface only partially meets four of the seven NZ-RED requirements • Using an existing project ‘template’ may not be the most effective way to serve the needs of your volunteers or your project objectives. The only way you can determine this is by subjecting it to evaluation. • Heuristics can be an efficient and effective method of website evaluation
  • 7. What’s next? Develop a set of heuristics for non-profit crowdsourcing
  • 8. Interested? Email donelle.mckinley@vuw.ac.nz Follow @donellemckinley Research updates at www.digitalglam.org Thanks!