Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Tags by teachers - what's expert indexers' opinion?

3,303 views

Published on

An early result on an evaluation on teachers' tags by expert indexers. Looking good for tags!

Published in: Education, Technology, Business
  • Be the first to comment

  • Be the first to like this

Tags by teachers - what's expert indexers' opinion?

  1. 1. Tags by teachers - what's expert indexers' opinion on it? Riina Vuorikari European Schoolnet Eminent 2008
  2. 2. Usefulness of metadata <ul><li>validity , i.e. creating valid metadata for every learning resource, and
  3. 3. searchability , having the search tools in place to use that metadata. </li></ul>Barritt, C. and F. Alderman (2004). Creating a Reusable Learning Objects Strategy. San Diego, Pfeiffer.
  4. 4. <ul><li>Metadata externally applied to an item </li></ul>
  5. 6. What is a tag?
  6. 7. What is a tag? <ul><li>Metadata externally applied to an item
  7. 8. Usually by a user , not a librarian or other expert indexer
  8. 9. Personal marker to help associate with the resource
  9. 10. Can be used for sorting or managing
  10. 11. Provides identifier and/or description – easy to get back! </li></ul>
  11. 13. Tags in MELT <ul><li>1064 individual tags by teachers
  12. 14. Tags used 1994 times in 670 favourites
  13. 15. Tags associated with 463 distinct resources
  14. 16. 85 users </li></ul>1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501
  15. 17. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources?
  16. 18. Evaluation of tags by experts 10 learning resources from MELT <ul><ul><li>Some with high number of tags from teachers
  17. 19. Variety of content, languages and providers </li></ul></ul>10 – 15 indexer experts from MELT partners <ul><li>Online questionnaire
  18. 20. Answers gathered in November 2008 </li></ul>
  19. 21. Data and resources <ul><li>Each resource had a different ratio of thesaurus terms and tags
  20. 22. 23 thesaurus terms/ 89 tags </li></ul>Number of Thesaurus terms Number of Tags 5 3 4 9 3 13 3 6 2 7 2 5 1 15 1 18 1 7 1 6 23 89
  21. 24. Evaluation of tags by experts Each resource had a link and 3 questions Q2. The current indexing keywords are: xx, xx. Would you want to revise the original LOM description of the resource and, if so, which of the following terms might you adopt? Q3. Below you can find teachers' keywords. Compared to the current indexing words (xx), estimate their additional value as descriptors. Scale 1 to 5 (Does not add any useful information - Adds very useful information) Option: “I don't understand the word”
  22. 25. Results Q1 <ul><li>110 keywords, both thesaurus terms and tags
  23. 26. 401 votes from experts
  24. 27. We use percentage of votes/resource </li></ul>Both SD quite low, which indicates a low variance in the views of the experts (high agreement) n=401 Thesaurus Tags Average votes 44% 29% Standard dev 0.29 0.24
  25. 28. Results Q1 <ul><li>21 thesaurus terms and 21 most voted tags
  26. 29. 265 votes from experts
  27. 30. We use percentage of votes/resource </li></ul>Most voted tags are relevant for expert indexers too! n=265 Thesaurus Tags Average 44% 65% Standard dev 0.29 0.14
  28. 32. 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501 Most used tags in MELT Discrepancy between users' needs and expert thinking..
  29. 34. 1 interactive 50 2 geschiedenis 47 3 Romeinen 43 4 latijn 43 5 Rome 41 6 koolielu 41 7 English 40 8 Romein 33 9 esl 19 10 history 16 11 culture 16 12 efl 15 13 vocabulary 14 14 quiz 13 15 subjonctif 12 16 grammar 11 17 Geografi 10 18 animation 10 19 London 9 20 fizika 9 21 angol 9 25.1% of all tags 501 Most used tags in MELT Discrepancy between users' needs and expert thinking <ul>TAGS CAN FILL THE GAP!! </ul>
  30. 35. Evaluation of tags by experts How useful are the tags created by users (e.g. teachers) as metadata descriptors to describe learning resources? A very provisional answer: they seem useful , but let's wait until the end of the story...
  31. 36. social bookmarks Metadata LOM tags folksonomy social tagging multi-linguality social classification thanks ! for your attention learning resources user communities discover resources and item s questions ? teachers social navigation social traces paths , trails flock

×