Successfully reported this slideshow.

Metadata quality criteria

2,502 views

Published on

Second part of the presentation in "WHY metadata for MY resources" workshop in TELSS 2010!

Published in: Technology
  • Be the first to comment

Metadata quality criteria

  1. 1. Metadata quality criteria WHY metadata for MY resources? Palavitsinis N., Ebner H., Manouselis N.
  2. 2. WHY assess quality? • Bad metadata  “Invisible” resources • Bad metadata  Less “cool” things to do with metadata (explain) • Bad metadata  Mess… 10/6/2010 WHY metadata for MY resources? 2
  3. 3. 10/6/2010 WHY metadata for MY resources? 3 Description: 566 words!!!
  4. 4. Metadata Quality Review • In Organic.Edunet, mainly based on Bruce & Hillman’s framework we’ve chosen some criteria to assess metadata quality • Produced a grid to review metadata records – Using 5 point scales – Using Yes/No questions – Using free text field for comments 10/6/2010 WHY metadata for MY resources? 4
  5. 5. Selected Criteria (1/2) • Completeness – Number of elements provided by the annotator, compared to the total number of elements in AP • Appropriateness – Are the metadata values provided appropriate for the targeted use? 10/6/2010 WHY metadata for MY resources? 6
  6. 6. Selected Criteria (2/2) • Accuracy – Do the values correspond to what is annotated? – Do they reflect the actual resource? • Consistency – Are the values provided consistent with the standard or the AP used? 10/6/2010 WHY metadata for MY resources? 7
  7. 7. Interactive session metadata quality criteria & interface design 10/6/2010 8WHY metadata for MY resources?
  8. 8. Setting up • Divide <total number of participants> with 3 • Create X groups of three • Each group must have only one laptop open • Roles – One person to handle the laptop – One person to keep notes (will be collected) – One person to report back to the plenary 10/6/2010 WHY metadata for MY resources? 9
  9. 9. 1st Step • Which two metadata elements would NOT be useful for describing context specific resources? • Report back by identifying: – The context – field of interest (as a group) – One element – WHY this is not useful 10/6/2010 WHY metadata for MY resources? 10 Time in groups: 5’ Reporting back: 1’ per group
  10. 10. Getting all laptops involved • Please open your laptops • Visit: http://whymetadata.jimdo.com – Under JTEL2010 / Workshop / Workshop resources 10/6/2010 WHY metadata for MY resources? 11
  11. 11. 10/6/2010 WHY metadata for MY resources? 12 Hi! I am Bruce & Hillman’s “Repository Genie” & I am here to grant you 3 wishes! I can make your Learning Object Repository score 100% in only 3 of the criteria presented! The rest I will leave on the annotators hands… Choose wisely!!!
  12. 12. • Visit: http://whymetadata.jimdo.com – Under JTEL2010 / Workshop / Workshop resources • Read the criteria and what they actually mean • Use the questionnaire to “wish” for 3 of them – Reveal one wish in the end! 10/6/2010 WHY metadata for MY resources? 13 2nd Step Time on your own: 5 mins Reporting back: 5 seconds per person!
  13. 13. 3rd Step • Imagine you have a big amount of resources. How would you like to manage them? – Traditional folder structure (Confolio) – Tag-based folders (Google Docs, Flickr) – Search-based folders (Thunderbird) 10/6/2010 WHY metadata for MY resources? 14 Time in groups: 5’ Reporting back: plenary & individually (on paper)
  14. 14. Questions to consider • Is metadata quality linked to context? • Do metadata quality criteria apply to all cases? • Can the interface design ensure “high-quality” metadata? 10/6/2010 WHY metadata for MY resources? 15
  15. 15. Thank you • For the patience • For your time • For really participating & contributing • One last thing to let us know how we did… – http://whymetadata.jimdo.com – Find Workshop/Questionnaire 10/6/2010 WHY metadata for MY resources? 16
  16. 16. End of session Post Workshop Exercise Develop a personalized metadata evaluation framework Evaluate at least 10 LOs Provide a 5 page description (per LO) of your findings Deadline: Friday 6 pm (there is enough time if you don't go swimming) 10/6/2010 17WHY metadata for MY resources?

×