My presentation at Wikimania 2009 on August 28th, 2009

1. Enhancing Navigation on Wikipedia with Social Tags
Wikimania 2009
Arkaitz Zubiaga
NLP & IR Group @ UNED
August 28th, 2009

2. Introduction
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 2 / 33

3. Introduction
A Tagging System
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 3 / 33

4. Introduction
Simple Tagging
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 4 / 33

5. Introduction
Collaborative Tagging
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 5 / 33

6. Introduction
Tag Cloud
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 6 / 33

7. Navigating on Wikipedia
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 7 / 33

8. Navigating on Wikipedia
Navigating on Wikipedia
Categories
Links in articles
Search engine
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 8 / 33

9. Navigating on Wikipedia
Navigating on Wikipedia: Categories
Pro: Great for organizing content
Con: Limited to the taxonomy and categorization.
An article is or is not in a category.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 9 / 33

10. Navigating on Wikipedia
Navigating on Wikipedia: Links in articles
Pro: Access to related articles
Con: Subject to link availability
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 10 / 33

11. Navigating on Wikipedia
Navigating on Wikipedia: Search engine
Pro: Article search by keyword
Con: Subject to term availability in content/categories
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 11 / 33

12. Navigating on Wikipedia
Motivation
Can article retrieval be improved by means of
tagging?
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 12 / 33

13. Benefits of Tagging
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 13 / 33

14. Benefits of Tagging
Benefits of Tagging
Tags...
...are simple
...rely on an open vocabulary
...can be aggregated
...allow users to differ on the definition
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 14 / 33

15. Benefits of Tagging
How Can We Navigate Through Tags?
Three ways to navigate through tags1 :
Pivot-browsing
Popularity
Filtering
1
Tagging: People-Powered Metadata for the Social Web, by Gene Smith
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 15 / 33

16. Benefits of Tagging
Tag Navigation: Pivot-browsing
Benefit: Switching to related tags/topics.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 16 / 33

17. Benefits of Tagging
Tag Navigation: Popularity
Benefit: What has people considered interesting/relevant for a tag?
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 17 / 33

18. Benefits of Tagging
Tag Navigation: Filtering
Benefit: Retrieving documents containing a tag(s), but not another.
Hence, users can retrieve articles related to a topic, and excluding a
subtopic.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 18 / 33

19. Benefits of Tagging
How Can Tagging Enhance Taxonomies? (1)
Definition
Categories must be created before using them, unlike tags, which are
created the first time a user uses them
Each user defines a set of tags, generating a global weighted set of tags
as a result. This allows a tag to be more relevant than another, unlike
with categories, for which an agreement among users is necessary.
Tags can handle synonimy, hypernims, hyponims,... unlike categories.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 19 / 33

20. Benefits of Tagging
How Can Tagging Enhance Taxonomies? (and 2)
Navigation and search
Providing the aforementioned new ways to navigate.
Providing new terms to describe the articles.
Providing a bottom-up classification, instead of a top-down one.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 20 / 33

21. Benefits of Tagging
An Example Combining Tags and Categories: Amazon
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 21 / 33

22. Benefits of Tagging
Avoiding Tag Mess
Letting users to relate tags, as in Librarything2 :
2
http://www.librarything.com
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 22 / 33

23. Dataset Generation
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 23 / 33

24. Dataset Generation
Dataset Generation
Starting point: a set of 2M+ English Wikipedia3 articles.
Data retrieval:
Tag data for each article on Delicious4 .
Article content.
Removed not relevant tags for Wikipedia articles: wikipedia,
reference, wiki.
Filtered to articles annotated by at least 10 users.
Result: 20,764 tagged Wikipedia articles5 .
3
http://en.wikipedia.org
4
http://delicious.com
5
The dataset is available for download at http://nlp.uned.es/social-tagging/
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 24 / 33

25. Results
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 25 / 33

26. Results
Results: Tag cloud
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 26 / 33

27. Results
Results: Presence of tags
Found Not Found % Found
Document 251,139 206,569 54.86%
Content 202,151 255,557 44.16%
Categories 35,237 422,471 7.70%
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 27 / 33

28. Results
Results: Presence of tags
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 28 / 33

29. Results
Results: Some examples
Users defined the tag programming for the article Framework, but
that word is not present in content.
The same occurs for the tag mathematics in the article Zipf’s law.
As well as for the tag audio in the article List of Internet stations.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 29 / 33

30. Results
Prototype
A preliminary prototype on applying tags to
Wikipedia can be found at:
http://taggedwiki.zubiaga.org
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 30 / 33

31. Conclusions
Index
1 Introduction
2 Navigating on Wikipedia
3 Benefits of Tagging
4 Dataset Generation
5 Results
6 Conclusions
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 31 / 33

32. Conclusions
Conclusions
A social tagging system would provide new ways to navigate
Wikipedia:
Pivot-browsing
Popularity
Filtering
Bottom-up classification besides top-down classification.
An experiment with tags over Wikipedia shows encouraging results.
Providing new unexisting terms.
Providing new ways to navigate through tags.
Helping to improve the search engine.
Discovering popular articles.
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 32 / 33

33. Conclusions
Thank You for Your Attention
Achiu Arigato Danke Dhannvaad Dua Netjer en ek Efcharisto
Gracias Gr`cies Gratia Grazie Guishepeli Hvala Kiitos
a
K¨sz¨n¨m Merc´ Merci Mila esker Obrigado Shukran
o o o e
Shukriya Tack Tak Takk T¨nan Tapadh leat Tesekk¨r ederim Thank
a u
you Toda
http://blog.zubiaga.org
Arkaitz Zubiaga (UNED) Wikipedia & Social Tags August 28th, 2009 33 / 33