Tags by teachers -  what's expert indexers'    opinion on it?     Riina Vuorikari   European Schoolnet   Eminent 2008
Usefulness of metadata <ul><li>validity , i.e. creating valid metadata for every learning resource, and
searchability , having the search tools in place to use that metadata.  </li></ul>Barritt, C. and F. Alderman (2004). Crea...
<ul><li>Metadata externally applied to an item </li></ul>
 
What is a tag?
What is a tag? <ul><li>Metadata externally applied to an item
Usually by  a user , not a librarian or other expert indexer
Personal marker  to help associate with the resource
Can be used for sorting or managing
Provides identifier and/or description – easy to get back! </li></ul>
 
Tags in MELT <ul><li>1064 individual tags by teachers
Tags used 1994 times in 670 favourites
Tags associated with 463 distinct resources
85 users </li></ul>1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Rom...
Evaluation of tags by experts How useful are the tags created by  users (e.g. teachers)  as metadata descriptors  to descr...
Evaluation of tags by experts 10 learning resources from MELT  <ul><ul><li>Some with high number of tags from teachers
Variety of content, languages and providers </li></ul></ul>10 – 15 indexer experts from MELT partners <ul><li>Online quest...
Answers gathered in November 2008 </li></ul>
Data and resources <ul><li>Each resource had a different ratio of thesaurus terms and tags
Upcoming SlideShare
Loading in...5
×

Tags by teachers - what's expert indexers' opinion?

3,000

Published on

An early result on an evaluation on teachers' tags by expert indexers. Looking good for tags!

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
3,000
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Tags by teachers - what's expert indexers' opinion?"

  1. 1. Tags by teachers - what's expert indexers' opinion on it? Riina Vuorikari European Schoolnet Eminent 2008
  2. 2. Usefulness of metadata <ul><li>validity , i.e. creating valid metadata for every learning resource, and
  3. 3. searchability , having the search tools in place to use that metadata. </li></ul>Barritt, C. and F. Alderman (2004). Creating a Reusable Learning Objects Strategy. San Diego, Pfeiffer.
  4. 4. <ul><li>Metadata externally applied to an item </li></ul>
  5. 6. What is a tag?
  6. 7. What is a tag? <ul><li>Metadata externally applied to an item
  7. 8. Usually by a user , not a librarian or other expert indexer
  8. 9. Personal marker to help associate with the resource
  9. 10. Can be used for sorting or managing
  10. 11. Provides identifier and/or description – easy to get back! </li></ul>
  11. 13. Tags in MELT <ul><li>1064 individual tags by teachers
  12. 14. Tags used 1994 times in 670 favourites
  13. 15. Tags associated with 463 distinct resources
  14. 16. 85 users </li></ul>1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501
  15. 17. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources?
  16. 18. Evaluation of tags by experts 10 learning resources from MELT <ul><ul><li>Some with high number of tags from teachers
  17. 19. Variety of content, languages and providers </li></ul></ul>10 – 15 indexer experts from MELT partners <ul><li>Online questionnaire
  18. 20. Answers gathered in November 2008 </li></ul>
  19. 21. Data and resources <ul><li>Each resource had a different ratio of thesaurus terms and tags
  20. 22. 23 thesaurus terms/ 89 tags </li></ul>Number of Thesaurus terms Number of Tags 5 3 4 9 3 13 3 6 2 7 2 5 1 15 1 18 1 7 1 6 23 89
  21. 24. Evaluation of tags by experts Each resource had a link and 3 questions Q2. The current indexing keywords are: xx, xx. Would you want to revise the original LOM description of the resource and, if so, which of the following terms might you adopt? Q3. Below you can find teachers' keywords. Compared to the current indexing words (xx), estimate their additional value as descriptors. Scale 1 to 5 (Does not add any useful information - Adds very useful information) Option: “I don't understand the word”
  22. 25. Results Q1 <ul><li>110 keywords, both thesaurus terms and tags
  23. 26. 401 votes from experts
  24. 27. We use percentage of votes/resource </li></ul>Both SD quite low, which indicates a low variance in the views of the experts (high agreement) n=401 Thesaurus Tags Average votes 44% 29% Standard dev 0.29 0.24
  25. 28. Results Q1 <ul><li>21 thesaurus terms and 21 most voted tags
  26. 29. 265 votes from experts
  27. 30. We use percentage of votes/resource </li></ul>Most voted tags are relevant for expert indexers too! n=265 Thesaurus Tags Average 44% 65% Standard dev 0.29 0.14
  28. 32. 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501 Most used tags in MELT Discrepancy between users' needs and expert thinking..
  29. 34. 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501 Most used tags in MELT Discrepancy between users' needs and expert thinking <ul>TAGS CAN FILL THE GAP!! </ul>
  30. 35. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources? A very provisional answer: they seem useful , but let's wait until the end of the story...
  31. 36. social bookmarks Metadata LOM tags folksonomy social tagging multi-linguality social classification thanks ! for your attention learning resources user communities discover resources and item s questions ? teachers social navigation social traces paths , trails flock
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×