Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Citation Needed: A Taxonomy and Algorithmic Assessment of Wikipedia’s Verifiability

28 views

Published on

komachi lab

Published in: Science
  • Be the first to comment

  • Be the first to like this

Citation Needed: A Taxonomy and Algorithmic Assessment of Wikipedia’s Verifiability

  1. 1. CITATION NEEDED: A TAXONOMY AND ALGORITHMIC ASSESSMENT OF WIKIPEDIA’S VERIFIABILITY MIRIAM REDI, BESNIK FETAHU, JONATHAN MORGAN, DARIO TARABORELLI D2 ANDO WWW 2019 1
  2. 2. • Wikipedia ” “ • ” “(Verifiability) ≒ • Wikipedia • 2
  3. 3. • Citation {citation needed} 350,000 • Citation Citation • Citation 1. Citation 2. 3
  4. 4. • Wikipedia Cita*on verifica*on, fact-checking • • • • Cita*on Cita*on 4
  5. 5. WIKIPEDIA • Stub • • featured articles • • Stub Citation Best practice Gold label Stub 5
  6. 6. CITATION NEEDED • Featured • featured ar*cles 10,000 posi*ve ({cita*on needed} ) nega*ve ({cita*on needed} ) • Low Quality • 1 {cita*on needed} posi nega 26,140 • Cita*on • Random • 200,000 posi nega 6
  7. 7. CITATION • Wikipedia Citation ([1]) Citation ⇨ 7
  8. 8. CITATION REASON GOLD LABEL • 35 335 (posi=255, nega=80) 13 • ⇨ 8
  9. 9. CITATION REASON CROWD WORK • 3 , 498 • • 0.63 • • • Statics, Scientific, Historical, Quotation opinion, • • Statement 9 0.6(0.6~good)
  10. 10. CITATION REASON • Featured articles 4,000 {citation needed} Amazon Mechanical Turk • 10 Expert
  11. 11. • Vanilla RNN • Bi-RNN • RNN with Global Attention • Glove 11 Context vector Context? Attension Reason context Attension
  12. 12. FEATURE • Feature-based Baseline • Factive Verbs. • Assertive Verbs. • Entailment Verbs. • Stylistic Features. • POS • Word Vector-Based Baseline • • Random Forest 12
  13. 13. • Section Featured articles Over view • Featured articles Section + Attention FA Train • Data set 13 Grey out?RNN
  14. 14. • • • Citation ⇨Annotation • Annotation • 14
  15. 15. CITATION REASON MODEL • • Citation Needed Dense Fine-tuning • train • Pre-trained • 4000 50% Train 50% Test • 15
  16. 16. • end to end • • • 17
  17. 17. • Citation Hunt Citation Citation 18

×