Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary
I’m about ‘Victorians’
BBC Topic Page I’m about ‘Victorians’ Outside the BBC BBC silo #1 BBC silo #3 BBC silo #2
BBC Topic Page I’m about ‘Victorians’ viktorianisch V 잊도 r 이안  Ελληνικά   NY Times, flickr, wikipedia Outside the BBC BBC ...
An index language exists primarily to:
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
Could Wikipedia be used as a universal language for identifying subjects?
Story of Wikipedia-as-CV
Story of Wikipedia-as-CV: personal origins
 
Story of Wikipedia-as-CV: personal origins We needed a system to categorise movie & TV reviews
Story of Wikipedia-as-CV: personal origins So of course we built a categorisation system from scratch -- including its own...
Story of Wikipedia-as-CV: personal origins And when people saw the system, they always said: “Hey, that reminds me of Inte...
 
Story of Wikipedia-as-CV: personal origins It struck me that the way Internet Movie Database is set up isn’t dissimilar to...
Story of Wikipedia-as-CV: personal origins But its’s one where the emphasis is on “related to”, not broader/narrower, syno...
Story of Wikipedia-as-CV: personal origins From then, I couldn’t help but be drawn to websites where the structure is clea...
Story of Wikipedia-as-CV: personal origins From then, I couldn’t help but be drawn to websites where the structure is clea...
Story of Wikipedia-as-CV: personal origins Could those “one Concept per page” webpages be used as “terms” as in a controll...
Are some websites actually  “ indexing languages” in disguise?
conText  -- a Wikipedia-as-CV auto-categoriser prototype
 
conText --   a Wikipedia-as-CV auto-categoriser prototype: http://sells.welcomebackstage.com:5000/item/submit
 
Demo of  conText --   a Wikipedia-as-CV auto-categoriser prototype
Demo of  conText --   a Wikipedia-as-CV auto-categoriser prototype: Take text from audience!
Wikipedia is already being used across the Web as a form of subject identification & disambiguation, in a grassroots way:
Wikipedia is already being used across the Web as a form of subject identification & disambiguation, in a grassroots way: ...
http://en.wikipedia.org/wiki/British http://en.wikipedia.org/wiki/Science_fiction http://en.wikipedia.org/wiki/BBC http://...
These days, by convention, when you link to Wikipedia from your webpage, more than saying “go and have a look at this othe...
These days, by convention, when you link to Wikipedia from your webpage, more than saying “go and have a look at this othe...
For general knowledge, though, Wikipedia is becoming the Web’s defacto controlled vocabulary
http://en.wikipedia.org/wiki/Heerlen http://en.wikipedia.org/wiki/Beethoven http://en.wikipedia.org/wiki/Amsterdam http://...
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
Wikipedia pages provide the best scope notes in the world
Wikipedia pages provide the best scope notes in the world Wikipedia-as-CV benefits from being developed through a social p...
Wikipedia pages provide the best scope notes in the world Wikipedia-as-CV benefits from being developed through a social p...
Wikipedia pages provide the best scope notes in the world For each Concept, the document edit history, discussion around c...
 
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
So, we can tag pretty accurately semi-automatically with globally unique subject identifiers using this approach… So what?
So, we can tag pretty accurately semi-automatically with globally unique subject identifiers using this approach… So what?...
 
 
 
 
Now playing vs. the Web
 
 
Now playing vs. the Web Why not bring in BBC Archive materials to this service via Wikipedia-as-CV tagging and linked data...
 
 
By using  Wikipedia-as-CV,  you can get your repository onto this diagram quickly,  for free
 
<ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of docum...
A Web-scale, globally accessible index language accidentally exists:
<ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple inde...
<ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple inde...
<ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple inde...
<ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple inde...
Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Wikipedia is a controlled vocabulary
Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Wikipedia is a controlled vocabulary
Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Chris Sizemore Silver Oliver BBC Wikipedia is a contro...
Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Chris Sizemore Silver Oliver BBC Wikipedia is a contro...
Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary http://flickr.com/photos/deniscollette/1817034358/
Upcoming SlideShare
Loading in...5
×

Wikipedia as controlled vocabulary

9,224

Published on

The Essentials of Metadata and Taxonomy - Henry Stewart Event

The Next Wave: Using Wikipedia as a Controlled Vocabulary

* Leveraging an online resource for internal use
* Integrating pre-existing unique identifications numbers (UIDs)
* Inherited relations
* Capturing and cataloging
* Risks and remedies
Chris Sizemore BBC Future Technology & Media and Silver Oliver, BBC Future Technology & Media

Published in: Technology

Wikipedia as controlled vocabulary

  1. 1. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary
  2. 2. I’m about ‘Victorians’
  3. 3. BBC Topic Page I’m about ‘Victorians’ Outside the BBC BBC silo #1 BBC silo #3 BBC silo #2
  4. 4. BBC Topic Page I’m about ‘Victorians’ viktorianisch V 잊도 r 이안 Ελληνικά NY Times, flickr, wikipedia Outside the BBC BBC silo #1 BBC silo #3 BBC silo #2
  5. 5. An index language exists primarily to:
  6. 6. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul>
  7. 7. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul>
  8. 8. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul><ul><li>Provide means whereby a searcher can modulate the search strategy to attain comprehensive or selective results as user needs dictate </li></ul>
  9. 9. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul><ul><li>Provide means whereby a searcher can modulate the search strategy to attain comprehensive or selective results as user needs dictate </li></ul>F.W. Lancaster Vocabulary control for information retrieval
  10. 10. Could Wikipedia be used as a universal language for identifying subjects?
  11. 11. Story of Wikipedia-as-CV
  12. 12. Story of Wikipedia-as-CV: personal origins
  13. 14. Story of Wikipedia-as-CV: personal origins We needed a system to categorise movie & TV reviews
  14. 15. Story of Wikipedia-as-CV: personal origins So of course we built a categorisation system from scratch -- including its own controlled vocab
  15. 16. Story of Wikipedia-as-CV: personal origins And when people saw the system, they always said: “Hey, that reminds me of Internet Movie Database…”
  16. 18. Story of Wikipedia-as-CV: personal origins It struck me that the way Internet Movie Database is set up isn’t dissimilar to the structure of a thesaurus or a very flat taxonomy…
  17. 19. Story of Wikipedia-as-CV: personal origins But its’s one where the emphasis is on “related to”, not broader/narrower, synonym, antonym, etc
  18. 20. Story of Wikipedia-as-CV: personal origins From then, I couldn’t help but be drawn to websites where the structure is clearly:
  19. 21. Story of Wikipedia-as-CV: personal origins From then, I couldn’t help but be drawn to websites where the structure is clearly: “ a single primary Concept per page -- and pages for related Concepts link to each other”
  20. 22. Story of Wikipedia-as-CV: personal origins Could those “one Concept per page” webpages be used as “terms” as in a controlled vocabulary?
  21. 23. Are some websites actually “ indexing languages” in disguise?
  22. 24. conText -- a Wikipedia-as-CV auto-categoriser prototype
  23. 26. conText -- a Wikipedia-as-CV auto-categoriser prototype: http://sells.welcomebackstage.com:5000/item/submit
  24. 28. Demo of conText -- a Wikipedia-as-CV auto-categoriser prototype
  25. 29. Demo of conText -- a Wikipedia-as-CV auto-categoriser prototype: Take text from audience!
  26. 30. Wikipedia is already being used across the Web as a form of subject identification & disambiguation, in a grassroots way:
  27. 31. Wikipedia is already being used across the Web as a form of subject identification & disambiguation, in a grassroots way: in the form of hyperlinks embedded by authors in blog posts, news articles, music reviews, etc everywhere!
  28. 32. http://en.wikipedia.org/wiki/British http://en.wikipedia.org/wiki/Science_fiction http://en.wikipedia.org/wiki/BBC http://en.wikipedia.org/wiki/Time_travel http://en.wikipedia.org/wiki/Dr_who http://en.wikipedia.org/wiki/Tardis
  29. 33. These days, by convention, when you link to Wikipedia from your webpage, more than saying “go and have a look at this other page”, you are more likely giving a definition to a concept referred to in your content…
  30. 34. These days, by convention, when you link to Wikipedia from your webpage, more than saying “go and have a look at this other page”, you are more likely giving a definition to a concept referred to in your content… Also used in this way for specific domains are Internet Movie Database (for films & TV programmes), MySpace (for bands), Amazon (for books), etc
  31. 35. For general knowledge, though, Wikipedia is becoming the Web’s defacto controlled vocabulary
  32. 36. http://en.wikipedia.org/wiki/Heerlen http://en.wikipedia.org/wiki/Beethoven http://en.wikipedia.org/wiki/Amsterdam http://en.wikipedia.org/wiki/Van_Gogh_Museum
  33. 37. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul><ul><li>Provide means whereby a searcher can modulate the search strategy to attain comprehensive or selective results as user needs dictate </li></ul>F.W. Lancaster Vocabulary control for information retrieval
  34. 38. Wikipedia pages provide the best scope notes in the world
  35. 39. Wikipedia pages provide the best scope notes in the world Wikipedia-as-CV benefits from being developed through a social process, maintained and kept current by the Wikipedia community
  36. 40. Wikipedia pages provide the best scope notes in the world Wikipedia-as-CV benefits from being developed through a social process, maintained and kept current by the Wikipedia community Each concept represents a consensus view and its meaning can be understood simply by reading the associated Wikipedia page
  37. 41. Wikipedia pages provide the best scope notes in the world For each Concept, the document edit history, discussion around concept definition, & debate is important here…
  38. 43. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul><ul><li>Provide means whereby a searcher can modulate the search strategy to attain comprehensive or selective results as user needs dictate </li></ul>F.W. Lancaster Vocabulary control for information retrieval
  39. 44. So, we can tag pretty accurately semi-automatically with globally unique subject identifiers using this approach… So what?
  40. 45. So, we can tag pretty accurately semi-automatically with globally unique subject identifiers using this approach… So what? Un-silo your content repository quickly and cheaply, by connecting it to the Web via Wikipedia
  41. 50. Now playing vs. the Web
  42. 53. Now playing vs. the Web Why not bring in BBC Archive materials to this service via Wikipedia-as-CV tagging and linked data bridge between Wikipedia & MusicBrainz?
  43. 56. By using Wikipedia-as-CV, you can get your repository onto this diagram quickly, for free
  44. 58. <ul><li>An index language exists primarily to: </li></ul><ul><li>Allow an indexer to represent the subject matter of documents in a consistent way </li></ul><ul><li>Bring the vocabulary used by the searcher into coincidence with the vocabulary used by the indexer </li></ul><ul><li>Provide means whereby a searcher can modulate the search strategy to attain comprehensive or selective results as user needs dictate </li></ul>F.W. Lancaster Vocabulary control for information retrieval
  45. 59. A Web-scale, globally accessible index language accidentally exists:
  46. 60. <ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple indexers across the Web to represent the subject matter of any content in a consistent way </li></ul>
  47. 61. <ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple indexers across the Web to represent the subject matter of any content in a consistent way </li></ul><ul><li>It brings the vocabulary used by info seekers into coincidence with the vocabulary used by indexers -- the searchers ARE indexers, and vice versa </li></ul>
  48. 62. <ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple indexers across the Web to represent the subject matter of any content in a consistent way </li></ul><ul><li>It brings the vocabulary used by info seekers into coincidence with the vocabulary used by indexers -- the searchers ARE indexers, and vice versa </li></ul><ul><li>It provides means whereby a searcher can modulate a search and/or browse strategy to attain comprehensive or selective results as user needs dictate </li></ul>
  49. 63. <ul><li>A Web-scale, globally accessible index language accidentally exists: </li></ul><ul><li>It encourages multiple indexers across the Web to represent the subject matter of any content in a consistent way </li></ul><ul><li>It brings the vocabulary used by info seekers into coincidence with the vocabulary used by indexers -- the searchers ARE indexers, and vice versa </li></ul><ul><li>It provides means whereby a searcher can modulate a search and/or browse strategy to attain comprehensive or selective results as user needs dictate </li></ul><ul><li>It adds Web-scale navigation & cross-reference possibilities </li></ul>
  50. 64. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Wikipedia is a controlled vocabulary
  51. 65. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Wikipedia is a controlled vocabulary
  52. 66. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Chris Sizemore Silver Oliver BBC Wikipedia is a controlled vocabulary
  53. 67. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary Chris Sizemore Silver Oliver BBC Wikipedia is a controlled vocabulary Much thanks! Questions, comments, & constructive criticism?
  54. 68. Chris Sizemore Silver Oliver BBC Wikipedia as controlled vocabulary http://flickr.com/photos/deniscollette/1817034358/
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×