Linking Topics of News and Blogs with
Wikipedia for Complementary Navigation

      Yuki Sato† Daisuke Yokomoto†
   Hiroyu...
3 Information     Wikipedia
   Sources
 on the Web          fundamental
                      background
                 ...
3 Information         Wikipedia
   Sources
 on the Web              fundamental
                          background
     ...
July 2009, Dragon Quest 9
       (console role-playing game
for the Nintendo Entertainment System)
         was published ...
3 Information           Wikipedia
   Sources
 on the Web               fundamental
                           background
 ...
Overview of the      Wikipedia
 Framework of
                        fundamental
Complementary            background
  Nav...
Outline of the Talk
• Purpose of the Work:
  Linking Topics of News and Blogs with Wikipedia
• Mock-up: from News to close...
Outline of the Talk
• Purpose of the Work:
  Linking Topics of News and Blogs with Wikipedia
• Mock-up: from News to close...
News Article
                         Queue of guys
                        who are waiting
                         for t...
Complementary Navigation from News to Blog:
                Our Approach
Wikipedia Entries as Conceptual Search Index
1. S...
News Article             Queue of guys
                           who are waiting
                            for the sale...
Complementary Navigation from News to Blog:
                Our Approach
Wikipedia Entries as Conceptual Search Index
1. S...
News Article




Related Topics




                   Blog
                  Search
                           18
News Article             Queue of guys
                           who are waiting
                            for the sale...
Selected Topic




      Blog Post Ranking


1st




                          DS
2nd




                               20
News Article             Queue of guys
                           who are waiting
                            for the sale...
Another Topic which damages
     Blog Post Ranking




 Blog Post Ranking (damaged)


    1st
                            ...
News Article

          Precision of Top 10 ranked
             Blog Posts per Topic

Related Topics 50%
 40%             ...
Outline of the Talk
• Purpose of the Work:
  Linking Topics of News and Blogs with Wikipedia
• Mock-up: from News to close...
Complementary Navigation from News to Blog:
                Our Approach
Wikipedia Entries as Conceptual Search Index
1. S...
Ranking Wikipedia Entries with Topic Related Terms



        Related Wikipedia Entries
                             Ninte...
Extracting topic-related terms
         from Wikipedia
Wikipedia    describes background knowledge of the Topic


        ...
Ranking Wikipedia Entries with Topic Related
                  Terms
                    WikiNewsScore(e, n)         ¦ (we...
Complementary Navigation from News to Blog:
                Our Approach
Wikipedia Entries as Conceptual Search Index
    ...
Search for Bloggers/Blog Posts
   closely related to the Index Wikipedia Entries
                                         ...
Topic-related blog feed (blogger) retrieval
[Kawaba et. al, ICWSM2008; Nakasaki et. al, ICWSM2009]

       Yahoo! Japan Se...
Selecting blog posts by topic-related terms
Requirements
Blog Feed: Topic Keyword Frequency in the Blog Feed      10


Blo...
Ranking Blog Posts with Topic Related Terms

                      WikiBlogScore(e, b)     ¦ (weight(type(t )) u freq(t ))...
Outline of the Talk
• Purpose of the Work:
  Linking Topics of News and Blogs with Wikipedia
• Mock-up: from News to close...
Evaluation:
before/after Manual Selection of Relevant Wikipedia Entries

                         Top 10 Ranked Wikipedia ...
Evaluation:
before/after Manual Selection of Relevant Wikipedia Entries

         Manually Selected Relevant 3 Wikipedia E...
Evaluation Results:
    Precision of Top Ranked Blog Posts
                 Ranking Blog Posts after Manually Selecting
  ...
Conclusion and Future Works
• Purpose of the Work:
  Linking Topics of News and Blogs with Wikipedia
• Details of the Prop...
Upcoming SlideShare
Loading in …5
×

Linking Topics of News and Blogs with Wikipedia for Complementary Navigation

1,121 views

Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Linking Topics of News and Blogs with Wikipedia for Complementary Navigation

  1. 1. Linking Topics of News and Blogs with Wikipedia for Complementary Navigation Yuki Sato† Daisuke Yokomoto† Hiroyuki Nakasaki† Mariko Kawaba‡ Takehito Utsuro† Tomohiro Fukuhara†† †Universityof Tsukuba ‡NTT Cyber Space Laboratories, NTT Corporation ††University of Tokyo 1
  2. 2. 3 Information Wikipedia Sources on the Web fundamental background facts and knowledge Events report in the Real World subjective precise facts information: personal opinions and experiences News Blog 2
  3. 3. 3 Information Wikipedia Sources on the Web fundamental background facts and knowledge Purpose of the research: Linking Topics of News and Blogs with Wikipedia Events report in the Real World subjective precise facts information: personal opinions and experiences News Blog 3
  4. 4. July 2009, Dragon Quest 9 (console role-playing game for the Nintendo Entertainment System) was published in Japan. 4
  5. 5. 3 Information Wikipedia Sources on the Web fundamental background facts and knowledge Dragon Quest 9 on sale Events in the Real World report subjective precise facts information: personal opinions and experiences News Blog 6
  6. 6. Overview of the Wikipedia Framework of fundamental Complementary background Navigation facts and knowledge Complementary Complementary Navigation Navigation subjective report Events information: precise facts personal opinions in the Real World and experiences News Complementary Navigation Blog 11
  7. 7. Outline of the Talk • Purpose of the Work: Linking Topics of News and Blogs with Wikipedia • Mock-up: from News to closely related Blog Posts • Details of the Proposed Method – Ranking related Wikipedia Entries given a News Article – Ranking related Bloggers/Blog Posts given an Index Wikipedia Entry • Evaluation • Conclusion and Future Works 12
  8. 8. Outline of the Talk • Purpose of the Work: Linking Topics of News and Blogs with Wikipedia • Mock-up: from News to closely related Blog Posts • Details of the Proposed Method – Ranking related Wikipedia Entries given a News Article – Ranking related Bloggers/Blog Posts given an Index Wikipedia Entry • Evaluation • Conclusion and Future Works 13
  9. 9. News Article Queue of guys who are waiting for the sales of Dragon Quest 9. Blog Search 14
  10. 10. Complementary Navigation from News to Blog: Our Approach Wikipedia Entries as Conceptual Search Index 1. Search for 2. Search for Wikipedia Bloggers/Blog Entries closely Posts closely related to the related to the given News Index Article Use as Wikipedia Search Index Entries Wikipedia 15 News Blog
  11. 11. News Article Queue of guys who are waiting for the sales of Dragon Quest 9. Blog Search Related Topics 16
  12. 12. Complementary Navigation from News to Blog: Our Approach Wikipedia Entries as Conceptual Search Index 1. Search for Wikipedia Entries closely related to the given News Article Use as Search Index Wikipedia 17 News Blog
  13. 13. News Article Related Topics Blog Search 18
  14. 14. News Article Queue of guys who are waiting for the sales of Dragon Quest 9. Related Topics Blog Search 19
  15. 15. Selected Topic Blog Post Ranking 1st DS 2nd 20
  16. 16. News Article Queue of guys who are waiting for the sales of Dragon Quest 9. Related Topics Blog Search 21
  17. 17. Another Topic which damages Blog Post Ranking Blog Post Ranking (damaged) 1st Parade of a famous festival in Kyoto 2nd Queue of a Noodle Restaurant in Shibuya 22
  18. 18. News Article Precision of Top 10 ranked Blog Posts per Topic Related Topics 50% 40% 60% 0 10 Improved to 50% after Manually 21% on the Average 30 Selecting Relevant Topics 10 0 0 10 Blog Search 23
  19. 19. Outline of the Talk • Purpose of the Work: Linking Topics of News and Blogs with Wikipedia • Mock-up: from News to closely related Blog Posts • Details of the Proposed Method – Ranking related Wikipedia Entries given a News Article – Ranking related Bloggers/Blog Posts given an Index Wikipedia Entry • Evaluation • Conclusion and Future Works 24
  20. 20. Complementary Navigation from News to Blog: Our Approach Wikipedia Entries as Conceptual Search Index 1. Search for Wikipedia Entries closely related to the given News Article Use as Search Index Wikipedia 25 News Blog
  21. 21. Ranking Wikipedia Entries with Topic Related Terms Related Wikipedia Entries Nintendo News Article Dragon Quest series Dragon Quest 9 on sale Game Top ranked 10 Entries 26
  22. 22. Extracting topic-related terms from Wikipedia Wikipedia describes background knowledge of the Topic Types of topic-related terms 1. Bold Text 2. Redirect paraphrase of the entry title 3. Title of each paragraph 4. Noun phrase in body text Extracted Related Terms Super Mario Bros Pokémon Nintendo DS Wii Game Sony Role-playing game Fighting game 27
  23. 23. Ranking Wikipedia Entries with Topic Related Terms WikiNewsScore(e, n) ¦ (weight (type(t )) u freq(t )) t Related Wikipedia type of related term tt type(t) Entries type(t) type of related term weight(type(t)) weight of the type type(t) weight(type(t)) weight of the type type(t) Nintendo weight(type(t) = Redirect) = 1 weight(type(t) = Redirect) = 1 weight(type(t) = Bold text) = 1 weight(type(t) = Bold text) = 1 News Article weight(type(t) = Title of each paragraph) = 1 weight(type(t) = Title of each paragraph) = 1 Dragon Quest series weight(type(t) = Noun phrase in body text) = 1 weight(type(t) = Noun phrase in body text) = 1 Dragon Quest 9 on sale Game Top ranked 10 Entries 28
  24. 24. Complementary Navigation from News to Blog: Our Approach Wikipedia Entries as Conceptual Search Index 2. Search for Bloggers/Blog Posts closely related to the Index Wikipedia Entries Wikipedia 29 News Blog
  25. 25. Search for Bloggers/Blog Posts closely related to the Index Wikipedia Entries Ranking related Blog Posts 1st Related Wikipedia Entries ranked Blog Post Blog Post Nintendo 2nd ranked Dragon Quest series Blog Post Blog Post News Article Dragon Quest 9 3rd on sale ranked Blog Post Game Blog Post Top ranked 10 Entries Related Blog Posts 30
  26. 26. Topic-related blog feed (blogger) retrieval [Kawaba et. al, ICWSM2008; Nakasaki et. al, ICWSM2009] Yahoo! Japan Search API List of blog feeds Hits of topic which have high hits of keyword topic keyword. appeared in feed Usual search Re-ranked list Blog feed A group of blog posts which are written by same blogger. 31
  27. 27. Selecting blog posts by topic-related terms Requirements Blog Feed: Topic Keyword Frequency in the Blog Feed 10 Blog post: At least one Topic Related Term included in the Blog Post DS 2008 9 13 32
  28. 28. Ranking Blog Posts with Topic Related Terms WikiBlogScore(e, b) ¦ (weight(type(t )) u freq(t )) t Nintendo type(t) type of related term tt type(t) type of related term “Nintendo” weight(type(t)) weight of the type type(t) weight(type(t)) Related terms from Wikipedia weight of the type type(t) Super Mario Bros Pokémon Nintendo DS Wii Game Sony, = Redirect) = 3 weight(type(t) = Redirect) = 3 weight(type(t) Role-playing game Fighting game Bold text) = 2 weight(type(t) = Bold text) = 2 weight(type(t) = weight(type(t) = Anchor text) = 0.5 weight(type(t) = Anchor text) = 0.5 collected ranked blog posts blog posts Ranking blog posts with WikiBlogScore 33
  29. 29. Outline of the Talk • Purpose of the Work: Linking Topics of News and Blogs with Wikipedia • Mock-up: from News to closely related Blog Posts • Details of the Proposed Method – Ranking related Wikipedia Entries given a News Article – Ranking related Bloggers/Blog Posts given an Index Wikipedia Entry • Evaluation • Conclusion and Future Works 34
  30. 30. Evaluation: before/after Manual Selection of Relevant Wikipedia Entries Top 10 Ranked Wikipedia Entries (Post Kyoto Protocol (United nations) (Protocol) (Carbon dioxide) (United States) Negotiation) (Debate) (Kyoto) (Greenhouse gas) (Minister) (Poland) Wikipedia A News Article on 35 Kyoto Protocol Blog
  31. 31. Evaluation: before/after Manual Selection of Relevant Wikipedia Entries Manually Selected Relevant 3 Wikipedia Entries (Post-Kyoto Protocol (United nations) (Protocol) (Carbon dioxide) (United States) Negotiation) (Debate) (Kyoto) (Greenhouse gas) (Minister) (Poland) Wikipedia A News Article on 36 Kyoto Protocol Blog
  32. 32. Evaluation Results: Precision of Top Ranked Blog Posts Ranking Blog Posts after Manually Selecting Relevant Specific Terms, excluding General Terms which damage the Blog Posts Ranking % missile Hillary Clinton Kyoto Protocol Ranking Blog Posts with All of the Top 10 Wikipedia Entries including General Terms which damage the Blog Posts Ranking 37
  33. 33. Conclusion and Future Works • Purpose of the Work: Linking Topics of News and Blogs with Wikipedia • Details of the Proposed Method – Ranking related Wikipedia Entries given a News Article – Ranking related Bloggers/Blog Posts given an Index Wikipedia Entry • Future Works: – Automatic Selection of Related Wikipedia Entries – Implementing Complementary Navigation System – Evaluation by Real Users 38

×