Woogle4MediaWiki: An Extension to Improve Search and to Guide Contributions


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Woogle4MediaWiki: An Extension to Improve Search and to Guide Contributions

  1. 1. Woogle4MediaWiki An Extension to Improve Search and to Guide Contributions Hans-Jörg Happel, FZI Karlsruhe, Germany Denny Vrandečić , Karlsruhe Institute of Technology, Germany 2010-08-05 @ Wikimania 2011; Haifa, Israel
  2. 2. Basic facts <ul><li>Woogle is an extension for MediaWiki </li></ul><ul><li>Goal: Guide and motivate contributions </li></ul><ul><ul><li>Show people what is „missing“ in the Wiki </li></ul></ul><ul><ul><li>Especially in smaller/enterprise Wikis </li></ul></ul><ul><li>Sub-Goal: improve search in MediaWiki </li></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  3. 3. Contribution in Wikis <ul><li>Wikis are great in enabling contributions </li></ul><ul><ul><li>Everybody may contribute </li></ul></ul><ul><li>But: Wikis are poor in guiding & motivating contributions </li></ul><ul><ul><li>„ Why should I contribute?“ </li></ul></ul><ul><ul><li>„ Where should I put it?“ </li></ul></ul><ul><ul><li>„ What can I contribute anyway?“ </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  4. 4. What to contribute to a Wiki? <ul><li>„ Red links“ </li></ul><ul><ul><li>Great innovation : „Dead“ links that help to express a demand rather than a (404) error </li></ul></ul><ul><ul><li>But: „Red links“ do not tell how much information is sought </li></ul></ul><ul><ul><li>What to fill first, if there are plenty of red links?  Special:WantedPages is useless on most Wikimedia Wikis </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  5. 5. How to improve contributions to a Wiki? <ul><li>Assumptions </li></ul><ul><ul><li>Wiki authors are motivated by the audience (readers) </li></ul></ul><ul><ul><li>Readers can hardly influence content creation </li></ul></ul><ul><ul><li>(Some of) readers needs are expressed by searching </li></ul></ul><ul><li>Woogle core ideas </li></ul><ul><ul><li>Use search logs to guide contributions </li></ul></ul><ul><ul><li>Make it easier for readers/searchers to contributors </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  6. 6. Woogle Feature: Red Link Popups (I) <ul><li>Plain MediaWiki Red Link </li></ul><ul><li>Normal display </li></ul><ul><li>Mouse-over display </li></ul><ul><li>Woogle Red Link </li></ul><ul><li>Normal display </li></ul><ul><li>Mouse-over display </li></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  7. 7. Woogle Feature: Red Link Popups (II) <ul><li>Lesson learned </li></ul><ul><ul><li>Many red links denote synonyms (abbreviations, misspellings) of existing pages – at least in smaller Wikis </li></ul></ul><ul><li>New feature/extension </li></ul><ul><ul><li>„ Redirector“ – create a one-click #REDIRECT based on suggestions </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel Under development Help appreciated!
  8. 8. Woogle Feature: Search (I) <ul><li>Woogle replaces MediaWiki built-in search or can act as an additional/parallel search engine (user-configurable!) </li></ul><ul><li>Small features </li></ul><ul><ul><li>Search suggestions based on fulltext </li></ul></ul><ul><ul><li>Allows to index Wikitext or rendered text </li></ul></ul><ul><ul><li>Allows to index certain files (e.g., PDF) </li></ul></ul><ul><ul><li>Show previous search attempts based on query log </li></ul></ul><ul><ul><li>Social search (Wiki-page per query, social ranking) </li></ul></ul><ul><li>Two setups </li></ul><ul><ul><li>WoogleNative : Native PHP; based on Zend Lucene Search </li></ul></ul><ul><ul><ul><li>For small Wikis – does not scale that good for Wikis >100.000 pages </li></ul></ul></ul><ul><ul><li>WoogleRemote : Connect to Java-based search backend </li></ul></ul><ul><ul><ul><li>Scales well </li></ul></ul></ul><ul><ul><ul><li>Allows to search multiple Wikis and many other systems (e.g., SVN, JIRA, Bugzilla, …) at once </li></ul></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  9. 9. Woogle4MediaWiki - Wikimania 2011; Haifa, Israel http://localhost/wiki/Woogle:Woogle4MediaWiki <ul><li> Each query can be a Wiki page </li></ul><ul><li>Allows for </li></ul><ul><ul><li>Wiki-Text on top of results („Social Did-You-Mean“) </li></ul></ul><ul><ul><li>Discussion page for query </li></ul></ul><ul><ul><li>Watches based on keywords </li></ul></ul><ul><li>Shows basic statistics about query </li></ul><ul><ul><li>„ How many people searched for that?“ </li></ul></ul>
  10. 10. Woogle Feature: Search (III) <ul><li>Social search </li></ul><ul><ul><li>Add, remove and re-rank query results </li></ul></ul><ul><ul><li>Add comments </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel Under development Help appreciated!
  11. 11. Woogle Feature: Even more… <ul><li>Query log statistics </li></ul><ul><ul><li>Popular queries </li></ul></ul><ul><ul><li>Popular results </li></ul></ul><ul><li>Preferences might be defined globally or by each individual user (e.g., Woogle can be enabled by individual users) </li></ul><ul><li>Instrumentation framework </li></ul><ul><ul><li>Logs certain kinds of user interactions </li></ul></ul><ul><ul><li>Experimental groups with randomized user assignment </li></ul></ul><ul><ul><li>Customize system and override configuration for groups </li></ul></ul><ul><ul><li>Informed consent (user acceptance dialog) </li></ul></ul><ul><ul><li> Useful for UI research and A/B testing </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  12. 12. Further related tools to guide contributions Woogle4MediaWiki - Wikimania 2011; Haifa, Israel MediaWiki Semantic MediaWiki MediaWiki extension External tool (via API) Intopedia (intopedia.org) Extension: Woogle4MediaWiki Extension: SemanticNeed
  13. 13. Summary <ul><li>Woogle is an extension to improve search & content contribution in Wikis </li></ul><ul><ul><li>Info & Download http://www.mediawiki.org/wiki/Extension:Woogle4MediaWiki </li></ul></ul><ul><ul><li>Online-Demo http://amazonas.fzi.de/wooglenative/ </li></ul></ul><ul><li>What‘s in for Wikimedia projects? </li></ul><ul><ul><li>May help bootstrapping smaller Wikis (small language Wikipedias Wikimedia projects) </li></ul></ul><ul><ul><li>Woogle allows to search across multiple MediaWikis at once </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  14. 14. BACKUP SLIDES Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  15. 15. Demand guidance <ul><li>Woogle uses queries and further metadata to qualify desired content </li></ul><ul><li>Users are informed how strong the information need is, and in which context it arises </li></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  16. 16. Two flavours of Woogle <ul><li>Native PHP (using Zend Lucene Search) </li></ul><ul><ul><li>Can handle Wikis up to 50.000 pages (Wikipedia size) and serves normal queries in >1 sec </li></ul></ul><ul><li>Accesses Java (Lucene) backend via Webservices </li></ul><ul><li>Supports searching additional sources (e.g. Ticket systems, SVN, other Wiki engines) </li></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  17. 17. Collaborative description of the information need Notifications concerning search activities Discussion page Directly create new knowledge from the search dialog Search has a URI and can be linked from within the Wiki (one page per search term) Search across different data sources/types (WoogleRemote) Additional clues with meta-information about a need http://localhost/wiki/Woogle:Woogle4MediaWiki Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  18. 18. Statistics Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  19. 19. Woogle Configuration Woogle4MediaWiki - Wikimania 2011; Haifa, Israel
  20. 20. Implementation Trivia <ul><li>Search UI </li></ul><ul><ul><li>Completely intercepts MW search process – indenpendent of MW search interfaces </li></ul></ul><ul><li>Red Links </li></ul><ul><ul><li>Realized via JavaScript/jQuery (parses red links, retrieves needs from backend batch-wise) to avoid patching MW </li></ul></ul><ul><li>Very basic implementation of access rights (via MediaWiki groups) </li></ul><ul><li>Instrumentation addon </li></ul><ul><ul><li>Allows to re-configure most system features based on user groups </li></ul></ul><ul><ul><li>Provides evaluation participation dialog </li></ul></ul><ul><ul><li>Logs various user behaviour data </li></ul></ul>Woogle4MediaWiki - Wikimania 2011; Haifa, Israel