The document discusses metadata quality criteria and assessing the quality of metadata for learning resources. It describes how bad or low quality metadata can make resources invisible, limit what can be done with metadata, and create a messy information environment. The document then outlines criteria selected from Bruce and Hillman's framework for reviewing metadata quality, including completeness, appropriateness, accuracy, and consistency. An interactive session is proposed for workshop participants to explore these criteria and different methods for organizing resources using metadata.

1. Metadata quality criteria
WHY metadata for MY resources? Palavitsinis N., Ebner H., Manouselis N.

2. WHY assess quality?
• Bad metadata  “Invisible” resources
• Bad metadata  Less “cool” things to do with
metadata (explain)
• Bad metadata  Mess…
10/6/2010 WHY metadata for MY resources? 2

3. 10/6/2010 WHY metadata for MY resources? 3
Description: 566 words!!!

4. Metadata Quality Review
• In Organic.Edunet, mainly based on Bruce &
Hillman’s framework we’ve chosen some
criteria to assess metadata quality
• Produced a grid to review metadata records
– Using 5 point scales
– Using Yes/No questions
– Using free text field for comments
10/6/2010 WHY metadata for MY resources? 4

6. Selected Criteria (1/2)
• Completeness
– Number of elements provided by the annotator,
compared to the total number of elements in AP
• Appropriateness
– Are the metadata values provided appropriate for
the targeted use?
10/6/2010 WHY metadata for MY resources? 6

7. Selected Criteria (2/2)
• Accuracy
– Do the values correspond to what is annotated?
– Do they reflect the actual resource?
• Consistency
– Are the values provided consistent with the
standard or the AP used?
10/6/2010 WHY metadata for MY resources? 7

8. Interactive session
metadata quality criteria
& interface design
10/6/2010 8WHY metadata for MY resources?

9. Setting up
• Divide <total number of participants> with 3
• Create X groups of three
• Each group must have only one laptop open
• Roles
– One person to handle the laptop
– One person to keep notes (will be collected)
– One person to report back to the plenary
10/6/2010 WHY metadata for MY resources? 9

10. 1st Step
• Which two metadata elements would NOT be
useful for describing context specific resources?
• Report back by identifying:
– The context – field of interest (as a group)
– One element
– WHY this is not useful
10/6/2010 WHY metadata for MY resources? 10
Time in groups: 5’
Reporting back: 1’ per group

11. Getting all laptops involved
• Please open your laptops
• Visit: http://whymetadata.jimdo.com
– Under JTEL2010 / Workshop / Workshop resources
10/6/2010 WHY metadata for MY resources? 11

12. 10/6/2010 WHY metadata for MY resources? 12
Hi! I am Bruce & Hillman’s
“Repository Genie” &
I am here to grant you 3 wishes!
I can make your Learning Object
Repository score 100% in only
3 of the criteria presented!
The rest I will leave on the
annotators hands…
Choose wisely!!!

13. • Visit: http://whymetadata.jimdo.com
– Under JTEL2010 / Workshop / Workshop resources
• Read the criteria and what they actually mean
• Use the questionnaire to “wish” for 3 of them
– Reveal one wish in the end!
10/6/2010 WHY metadata for MY resources? 13
2nd Step
Time on your own: 5 mins
Reporting back: 5 seconds per person!

14. 3rd Step
• Imagine you have a big amount of resources.
How would you like to manage them?
– Traditional folder structure (Confolio)
– Tag-based folders (Google Docs, Flickr)
– Search-based folders (Thunderbird)
10/6/2010 WHY metadata for MY resources? 14
Time in groups: 5’
Reporting back: plenary & individually (on paper)

15. Questions to consider
• Is metadata quality linked to context?
• Do metadata quality criteria apply to all cases?
• Can the interface design ensure “high-quality”
metadata?
10/6/2010 WHY metadata for MY resources? 15

16. Thank you
• For the patience
• For your time
• For really participating & contributing
• One last thing to let us know how we did…
– http://whymetadata.jimdo.com
– Find Workshop/Questionnaire
10/6/2010 WHY metadata for MY resources? 16

17. End of session
Post Workshop Exercise
Develop a personalized metadata evaluation framework
Evaluate at least 10 LOs
Provide a 5 page description (per LO) of your findings
Deadline: Friday 6 pm
(there is enough time if you don't go swimming)
10/6/2010 17WHY metadata for MY resources?