SlideShare a Scribd company logo
1 of 27
Download to read offline
Wikipedia as
Participatory
Journalism: Reliable
Sources?
Metrics for evaluating collaborative media
as a news source
Andrew Lih, Assistant Professor
International Symposium on Online Journalism
April 17, 2004
Overview
Participatory journalism
Wikipedia introduction
Growth
Methodology
Results
Participatory Journalism
We Media, Bowman and Willis
The act of a citizen, or group of citizens, playing an
active role in the process of collecting, reporting,
analyzing and disseminating news and
information. The intent of this participation is to
provide independent, reliable, accurate, wide-
ranging and relevant information that a
democracy requires.
Forms
Web logs – one to many
Wikis – many to many
Wikis
Based on Hawaiian word for quick wikiwiki
Web site where any page can be edited by
users (Edit this page button)
Registered or anonymous users
Wikipedia encyclopedia format
How could it possibly work?
How could it work?
Neutral point of view (NPOV)
“The neutral point of view attempts to present
ideas and facts in such a fashion that both
supporters and opponents can agree.”
Journalistic decisions
Avoiding the use of word “terrorism,” very
much like Reuters
Intense debate on naming accuser in Kobe
Bryant case
Wikipedia Traffic Rank vs. Other Encyclopedias (2003-2004)
TrafficRank
Wikipedia.org
Britannica.com
Encyclopedia.com
500
2000
1000
4000
6000
Apr-03 Jul-03 Oct-03 Jan-04
10,000
12,000
Source: www.alexa.com
How could it work?
Neutral point of view (NPOV)
“The neutral point of view attempts to present
ideas and facts in such a fashion that both
supporters and opponents can agree.”
Research questions
What quantitative metrics for quality?
Analyze articles cited in the press
Any patterns or quality level of articles?
Effects of citation on article?
Metrics for each article
Rigor - number of edits
Diversity - number of unique editors
Taken from the edit history for each page
Metadata only, can be used for any language
Methodology
Establish benchmark by analyzing
representative general topics
Assumption that these would be exemplars
Measure median for those topics in Wikipedia
Edits: 61
Unique editors: 36.5
Methodology
Determine metrics for cited articles
Examine movement before citation, after
citation
Reputation of Major Encyclopedia Topics in English Wikipedia
(Diversity vs. Rigor)
Median
Sport
Buddhism
Law
History_of_China
Hinduism
World_War_II
Astronomy
Islam
Religion
Canada
Philosophy
Mathematics
World_War_I
Earth
Native_American
0
100
200
300
400
500
600
700
800
0 50 100 150 200 250 300 350
Diversity (number of unique editors)
Rigor(numberofedits)
Reputation of Major Encyclopedia Topics in Wikipedia
(Diversity vs. Rigor) using Logarithmic Scale
Colonial_America
History_of_the_Middle_East
World_War_II
Astronomy
Islam
Hinduism
History_of_China
Median
1
10
100
1000
1 10 100 1000
Diversity (number of unique editors)
Rigor(numberofedits)
News outlets citing Wikipedia
Aljazeerah.info
Arizona Republic
Associated Press
CBC Newsworld
Daily Telegraph online
Greenville News
Groklaw
Guardian
Houston Chronicle
JapanToday.com
Kansas City Star
Knoxville News Sentinel (Tennessee)
Loudon Times-Mirror
Lowell Sun Online
Metropolis
New Straits Times
NewScientist.com
OC Weekly
Sacramento Bee
Salt Lake Tribune
San Francisco Chronicle
San Jose Mercury News
Slashdot
Star-Telegram
Sydney Morning Herald
TechTV
The Age
The Dallas Morning News
The Globe and Mail
The New Zealand Herald
The Philadelphia Inquirer
The Pocono Record
The Straits Times
The Sydney Morning Herald
Time.com
Venezuelan News and Analysis
WOAI-TV San Antonio
Wikipedia Articles Cited in Press Jan 2003-March 2004 (Before Citation)
Highlighted Articles
X_Window_System
Who_Wants_to_Be_a_Millionaire
Vietnam_War
List_of_recipes
11_March_2004_Madrid_attacks
Saddam_Hussein
Fuck
Chen_Shui-bian
Communist_Party_of_China
0
100
200
300
400
500
600
700
800
900
1000
0 20 40 60 80 100 120 140 160 180
Diversity (number of unique editors)
Rigor(numberofedits)
Trends
Madrid attacks subject of constant updates
Asian topics have high edits, but low number
of contributors
Science and history have high showing
Wikipedia Articles Cited in Press Jan 2003-March 2004 (Before Citation)
1
10
100
1000
10000
1 10 100 1000
Diversity (number of unique editors)
Rigor(numberofedits)
Wikipedia Articles Cited in Press Jan 2003-March 2004 (After Citation)
1
10
100
1000
10000
1 10 100 1000
Diversity (number of unique editors)
Rigor(numberofedits)
Articles Moving Across Benchmark Point
62274522British_honours_system
63362811Suez_Crisis
54383528Leap_year
69385930Explosive_material
65404628Palestinian_Authority
70405330Execution_by_firing_squad
76412712Iain_Duncan_Smith
86413930Alexander_Graham_Bell
60434131Breakdancing
83435423Form_of_government
105446032Australian_dollar
95474716History_of_Iraq
98472717Lyndon_LaRouche
95482015Provisional_Irish_Republican_Army
102515022Weapons_of_mass_destruction
106545229Juliana_of_the_Netherlands
84624133Aramaic_language
2261102413Ahmed_Yassin
EUEEUE
AfterBeforeArticle name
Articles improved, without
direct link to current events
Alexander_Graham_Bell
Australian_dollar
Breakdancing
Execution_by_firing_squad
Explosive_material
Form_of_government
Lyndon_LaRouche
Suez_Crisis
Conclusions
Simple metrics for rigor and diversity can help
identify trends
Citations in press can lead to improvement of
articles
If news is the first draft of history, Wikipedia
is a “working draft of history”
Future Work
Content analysis in conjunction with
metadata
Detect edit wars, vandalism, which skew results
Analyze internal and external hyperlinks
Measure more limited window of time
More broad benchmark topics
Andrew Lih
alih@hku.hk
http://jmsc.hku.hk/

More Related Content

Viewers also liked (20)

Molyneux holton
Molyneux holtonMolyneux holton
Molyneux holton
 
Domingo
DomingoDomingo
Domingo
 
Debth
DebthDebth
Debth
 
Mc combs
Mc combsMc combs
Mc combs
 
Picard
PicardPicard
Picard
 
Lee2011
Lee2011Lee2011
Lee2011
 
Espen2011
Espen2011Espen2011
Espen2011
 
Robinson. 2006
Robinson. 2006Robinson. 2006
Robinson. 2006
 
Jonathan
JonathanJonathan
Jonathan
 
Blasingame2011
Blasingame2011Blasingame2011
Blasingame2011
 
Jake
JakeJake
Jake
 
Anderson2011
Anderson2011Anderson2011
Anderson2011
 
Mensing. 2005.
Mensing. 2005.Mensing. 2005.
Mensing. 2005.
 
Rutigliano. 2006
Rutigliano. 2006Rutigliano. 2006
Rutigliano. 2006
 
Pilhofer
PilhoferPilhofer
Pilhofer
 
Collins
CollinsCollins
Collins
 
Strecker
StreckerStrecker
Strecker
 
Brady jim
Brady jimBrady jim
Brady jim
 
Hermida
HermidaHermida
Hermida
 
Katarina
KatarinaKatarina
Katarina
 

Similar to Wikipedia. lih.

PRSA Webinar: PR in a Wikipedia Age
PRSA Webinar: PR in a Wikipedia AgePRSA Webinar: PR in a Wikipedia Age
PRSA Webinar: PR in a Wikipedia AgeAndrew Lih
 
Approaches for Improving and Enriching Textual Knowledge Bases
Approaches for Improving and Enriching Textual Knowledge BasesApproaches for Improving and Enriching Textual Knowledge Bases
Approaches for Improving and Enriching Textual Knowledge BasesBesnik Fetahu
 
NOA - Framing China's Olympic Games
NOA - Framing China's Olympic GamesNOA - Framing China's Olympic Games
NOA - Framing China's Olympic GamesAna ADI
 
Ng Ophenomenon 17 Feb 2009
Ng Ophenomenon 17 Feb 2009Ng Ophenomenon 17 Feb 2009
Ng Ophenomenon 17 Feb 2009karsalan
 
Personalized and Adaptive Semantic Information Filtering for Social Media
Personalized and Adaptive Semantic Information Filtering for Social MediaPersonalized and Adaptive Semantic Information Filtering for Social Media
Personalized and Adaptive Semantic Information Filtering for Social MediaPavan Kapanipathi
 
Personalized and Adaptive Semantic Information Filtering for Social Media - P...
Personalized and Adaptive Semantic Information Filtering for Social Media - P...Personalized and Adaptive Semantic Information Filtering for Social Media - P...
Personalized and Adaptive Semantic Information Filtering for Social Media - P...Artificial Intelligence Institute at UofSC
 
How much is Wikipedia lagging behind News?
How much is Wikipedia lagging behind News?How much is Wikipedia lagging behind News?
How much is Wikipedia lagging behind News?Besnik Fetahu
 
Running head MLK PRESCRIPTION SCRIPT .docx
Running head MLK PRESCRIPTION SCRIPT                             .docxRunning head MLK PRESCRIPTION SCRIPT                             .docx
Running head MLK PRESCRIPTION SCRIPT .docxgemaherd
 
The Quest for Subcommunities and the Rise of American SportA.docx
The Quest for Subcommunities and the Rise of American SportA.docxThe Quest for Subcommunities and the Rise of American SportA.docx
The Quest for Subcommunities and the Rise of American SportA.docxssusera34210
 
Wikimedia presentation data mining meetup pub
Wikimedia presentation data mining meetup pubWikimedia presentation data mining meetup pub
Wikimedia presentation data mining meetup pubhowiewiki
 
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014Andrew Lih
 
The blogosphere
The blogosphereThe blogosphere
The blogospheresukyning
 
On the Value of Temporal Anchor Texts in Wikipedia
On the Value of Temporal Anchor Texts in WikipediaOn the Value of Temporal Anchor Texts in Wikipedia
On the Value of Temporal Anchor Texts in WikipediaNattiya Kanhabua
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...Jake Orlowitz
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media AttentionVincent Traag
 

Similar to Wikipedia. lih. (20)

Web of Knowledge Arun Joseph MLISc
Web of Knowledge Arun Joseph MLIScWeb of Knowledge Arun Joseph MLISc
Web of Knowledge Arun Joseph MLISc
 
PRSA Webinar: PR in a Wikipedia Age
PRSA Webinar: PR in a Wikipedia AgePRSA Webinar: PR in a Wikipedia Age
PRSA Webinar: PR in a Wikipedia Age
 
Approaches for Improving and Enriching Textual Knowledge Bases
Approaches for Improving and Enriching Textual Knowledge BasesApproaches for Improving and Enriching Textual Knowledge Bases
Approaches for Improving and Enriching Textual Knowledge Bases
 
NOA - Framing China's Olympic Games
NOA - Framing China's Olympic GamesNOA - Framing China's Olympic Games
NOA - Framing China's Olympic Games
 
Ng Ophenomenon 17 Feb 2009
Ng Ophenomenon 17 Feb 2009Ng Ophenomenon 17 Feb 2009
Ng Ophenomenon 17 Feb 2009
 
Personalized and Adaptive Semantic Information Filtering for Social Media
Personalized and Adaptive Semantic Information Filtering for Social MediaPersonalized and Adaptive Semantic Information Filtering for Social Media
Personalized and Adaptive Semantic Information Filtering for Social Media
 
Personalized and Adaptive Semantic Information Filtering for Social Media - P...
Personalized and Adaptive Semantic Information Filtering for Social Media - P...Personalized and Adaptive Semantic Information Filtering for Social Media - P...
Personalized and Adaptive Semantic Information Filtering for Social Media - P...
 
Zimmer wikileaks
Zimmer wikileaksZimmer wikileaks
Zimmer wikileaks
 
How much is Wikipedia lagging behind News?
How much is Wikipedia lagging behind News?How much is Wikipedia lagging behind News?
How much is Wikipedia lagging behind News?
 
MVHC 2010
MVHC 2010MVHC 2010
MVHC 2010
 
Running head MLK PRESCRIPTION SCRIPT .docx
Running head MLK PRESCRIPTION SCRIPT                             .docxRunning head MLK PRESCRIPTION SCRIPT                             .docx
Running head MLK PRESCRIPTION SCRIPT .docx
 
The Quest for Subcommunities and the Rise of American SportA.docx
The Quest for Subcommunities and the Rise of American SportA.docxThe Quest for Subcommunities and the Rise of American SportA.docx
The Quest for Subcommunities and the Rise of American SportA.docx
 
Wikimedia presentation data mining meetup pub
Wikimedia presentation data mining meetup pubWikimedia presentation data mining meetup pub
Wikimedia presentation data mining meetup pub
 
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014
The Future of Knowledge in the Age of Wikipedia - REMIXNYC 2014
 
The blogosphere
The blogosphereThe blogosphere
The blogosphere
 
On the Value of Temporal Anchor Texts in Wikipedia
On the Value of Temporal Anchor Texts in WikipediaOn the Value of Temporal Anchor Texts in Wikipedia
On the Value of Temporal Anchor Texts in Wikipedia
 
Mega Mitchell Essay
Mega Mitchell EssayMega Mitchell Essay
Mega Mitchell Essay
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
 
Wikis for BBB 2009
Wikis for BBB 2009Wikis for BBB 2009
Wikis for BBB 2009
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media Attention
 

More from Knight Center (20)

Martin
MartinMartin
Martin
 
Britt
BrittBritt
Britt
 
Joseph yoo
Joseph yooJoseph yoo
Joseph yoo
 
Singer
SingerSinger
Singer
 
Ramirez
RamirezRamirez
Ramirez
 
Griggs
GriggsGriggs
Griggs
 
Ting tingchia
Ting tingchiaTing tingchia
Ting tingchia
 
Symson
SymsonSymson
Symson
 
Garcia ruiz
Garcia ruizGarcia ruiz
Garcia ruiz
 
Brundrett. 2015
Brundrett. 2015Brundrett. 2015
Brundrett. 2015
 
J moroney
J moroneyJ moroney
J moroney
 
Ray
RayRay
Ray
 
Owen
OwenOwen
Owen
 
Royal blasingame
Royal blasingameRoyal blasingame
Royal blasingame
 
Diakopoulos
DiakopoulosDiakopoulos
Diakopoulos
 
Scacco
ScaccoScacco
Scacco
 
Havlak
HavlakHavlak
Havlak
 
Lee
LeeLee
Lee
 
Hernandez
HernandezHernandez
Hernandez
 
Robins
RobinsRobins
Robins
 

Recently uploaded

HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...
HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...
HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...Ismail Fahmi
 
VIP Girls Available Call or WhatsApp 9711199012
VIP Girls Available Call or WhatsApp 9711199012VIP Girls Available Call or WhatsApp 9711199012
VIP Girls Available Call or WhatsApp 9711199012ankitnayak356677
 
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书如何办理(BU学位证书)美国贝翰文大学毕业证学位证书
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书Fi L
 
Vashi Escorts, {Pooja 09892124323}, Vashi Call Girls
Vashi Escorts, {Pooja 09892124323}, Vashi Call GirlsVashi Escorts, {Pooja 09892124323}, Vashi Call Girls
Vashi Escorts, {Pooja 09892124323}, Vashi Call GirlsPooja Nehwal
 
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...Axel Bruns
 
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...Pooja Nehwal
 
complaint-ECI-PM-media-1-Chandru.pdfra;;prfk
complaint-ECI-PM-media-1-Chandru.pdfra;;prfkcomplaint-ECI-PM-media-1-Chandru.pdfra;;prfk
complaint-ECI-PM-media-1-Chandru.pdfra;;prfkbhavenpr
 
Quiz for Heritage Indian including all the rounds
Quiz for Heritage Indian including all the roundsQuiz for Heritage Indian including all the rounds
Quiz for Heritage Indian including all the roundsnaxymaxyy
 
Referendum Party 2024 Election Manifesto
Referendum Party 2024 Election ManifestoReferendum Party 2024 Election Manifesto
Referendum Party 2024 Election ManifestoSABC News
 
How Europe Underdeveloped Africa_walter.pdf
How Europe Underdeveloped Africa_walter.pdfHow Europe Underdeveloped Africa_walter.pdf
How Europe Underdeveloped Africa_walter.pdfLorenzo Lemes
 
Manipur-Book-Final-2-compressed.pdfsal'rpk
Manipur-Book-Final-2-compressed.pdfsal'rpkManipur-Book-Final-2-compressed.pdfsal'rpk
Manipur-Book-Final-2-compressed.pdfsal'rpkbhavenpr
 
Brief biography of Julius Robert Oppenheimer
Brief biography of Julius Robert OppenheimerBrief biography of Julius Robert Oppenheimer
Brief biography of Julius Robert OppenheimerOmarCabrera39
 
Different Frontiers of Social Media War in Indonesia Elections 2024
Different Frontiers of Social Media War in Indonesia Elections 2024Different Frontiers of Social Media War in Indonesia Elections 2024
Different Frontiers of Social Media War in Indonesia Elections 2024Ismail Fahmi
 
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptx
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptxLorenzo D'Emidio_Lavoro sullaNorth Korea .pptx
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptxlorenzodemidio01
 
Identifying & Combating Misinformation w/ Fact Checking Tools
Identifying & Combating Misinformation w/ Fact Checking ToolsIdentifying & Combating Misinformation w/ Fact Checking Tools
Identifying & Combating Misinformation w/ Fact Checking ToolsUjjwal Acharya
 
26042024_First India Newspaper Jaipur.pdf
26042024_First India Newspaper Jaipur.pdf26042024_First India Newspaper Jaipur.pdf
26042024_First India Newspaper Jaipur.pdfFIRST INDIA
 
Roberts Rules Cheat Sheet for LD4 Precinct Commiteemen
Roberts Rules Cheat Sheet for LD4 Precinct CommiteemenRoberts Rules Cheat Sheet for LD4 Precinct Commiteemen
Roberts Rules Cheat Sheet for LD4 Precinct Commiteemenkfjstone13
 
Opportunities, challenges, and power of media and information
Opportunities, challenges, and power of media and informationOpportunities, challenges, and power of media and information
Opportunities, challenges, and power of media and informationReyMonsales
 
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victory
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep VictoryAP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victory
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victoryanjanibaddipudi1
 
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docxkfjstone13
 

Recently uploaded (20)

HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...
HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...
HARNESSING AI FOR ENHANCED MEDIA ANALYSIS A CASE STUDY ON CHATGPT AT DRONE EM...
 
VIP Girls Available Call or WhatsApp 9711199012
VIP Girls Available Call or WhatsApp 9711199012VIP Girls Available Call or WhatsApp 9711199012
VIP Girls Available Call or WhatsApp 9711199012
 
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书如何办理(BU学位证书)美国贝翰文大学毕业证学位证书
如何办理(BU学位证书)美国贝翰文大学毕业证学位证书
 
Vashi Escorts, {Pooja 09892124323}, Vashi Call Girls
Vashi Escorts, {Pooja 09892124323}, Vashi Call GirlsVashi Escorts, {Pooja 09892124323}, Vashi Call Girls
Vashi Escorts, {Pooja 09892124323}, Vashi Call Girls
 
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...
Dynamics of Destructive Polarisation in Mainstream and Social Media: The Case...
 
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...
Call Girls in Mira Road Mumbai ( Neha 09892124323 ) College Escorts Service i...
 
complaint-ECI-PM-media-1-Chandru.pdfra;;prfk
complaint-ECI-PM-media-1-Chandru.pdfra;;prfkcomplaint-ECI-PM-media-1-Chandru.pdfra;;prfk
complaint-ECI-PM-media-1-Chandru.pdfra;;prfk
 
Quiz for Heritage Indian including all the rounds
Quiz for Heritage Indian including all the roundsQuiz for Heritage Indian including all the rounds
Quiz for Heritage Indian including all the rounds
 
Referendum Party 2024 Election Manifesto
Referendum Party 2024 Election ManifestoReferendum Party 2024 Election Manifesto
Referendum Party 2024 Election Manifesto
 
How Europe Underdeveloped Africa_walter.pdf
How Europe Underdeveloped Africa_walter.pdfHow Europe Underdeveloped Africa_walter.pdf
How Europe Underdeveloped Africa_walter.pdf
 
Manipur-Book-Final-2-compressed.pdfsal'rpk
Manipur-Book-Final-2-compressed.pdfsal'rpkManipur-Book-Final-2-compressed.pdfsal'rpk
Manipur-Book-Final-2-compressed.pdfsal'rpk
 
Brief biography of Julius Robert Oppenheimer
Brief biography of Julius Robert OppenheimerBrief biography of Julius Robert Oppenheimer
Brief biography of Julius Robert Oppenheimer
 
Different Frontiers of Social Media War in Indonesia Elections 2024
Different Frontiers of Social Media War in Indonesia Elections 2024Different Frontiers of Social Media War in Indonesia Elections 2024
Different Frontiers of Social Media War in Indonesia Elections 2024
 
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptx
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptxLorenzo D'Emidio_Lavoro sullaNorth Korea .pptx
Lorenzo D'Emidio_Lavoro sullaNorth Korea .pptx
 
Identifying & Combating Misinformation w/ Fact Checking Tools
Identifying & Combating Misinformation w/ Fact Checking ToolsIdentifying & Combating Misinformation w/ Fact Checking Tools
Identifying & Combating Misinformation w/ Fact Checking Tools
 
26042024_First India Newspaper Jaipur.pdf
26042024_First India Newspaper Jaipur.pdf26042024_First India Newspaper Jaipur.pdf
26042024_First India Newspaper Jaipur.pdf
 
Roberts Rules Cheat Sheet for LD4 Precinct Commiteemen
Roberts Rules Cheat Sheet for LD4 Precinct CommiteemenRoberts Rules Cheat Sheet for LD4 Precinct Commiteemen
Roberts Rules Cheat Sheet for LD4 Precinct Commiteemen
 
Opportunities, challenges, and power of media and information
Opportunities, challenges, and power of media and informationOpportunities, challenges, and power of media and information
Opportunities, challenges, and power of media and information
 
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victory
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep VictoryAP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victory
AP Election Survey 2024: TDP-Janasena-BJP Alliance Set To Sweep Victory
 
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx
2024 02 15 AZ GOP LD4 Gen Meeting Minutes_FINAL_20240228.docx
 

Wikipedia. lih.

  • 1. Wikipedia as Participatory Journalism: Reliable Sources? Metrics for evaluating collaborative media as a news source Andrew Lih, Assistant Professor International Symposium on Online Journalism April 17, 2004
  • 3. Participatory Journalism We Media, Bowman and Willis The act of a citizen, or group of citizens, playing an active role in the process of collecting, reporting, analyzing and disseminating news and information. The intent of this participation is to provide independent, reliable, accurate, wide- ranging and relevant information that a democracy requires.
  • 4. Forms Web logs – one to many Wikis – many to many
  • 5. Wikis Based on Hawaiian word for quick wikiwiki Web site where any page can be edited by users (Edit this page button) Registered or anonymous users Wikipedia encyclopedia format How could it possibly work?
  • 6. How could it work? Neutral point of view (NPOV) “The neutral point of view attempts to present ideas and facts in such a fashion that both supporters and opponents can agree.”
  • 7. Journalistic decisions Avoiding the use of word “terrorism,” very much like Reuters Intense debate on naming accuser in Kobe Bryant case
  • 8.
  • 9. Wikipedia Traffic Rank vs. Other Encyclopedias (2003-2004) TrafficRank Wikipedia.org Britannica.com Encyclopedia.com 500 2000 1000 4000 6000 Apr-03 Jul-03 Oct-03 Jan-04 10,000 12,000 Source: www.alexa.com
  • 10. How could it work? Neutral point of view (NPOV) “The neutral point of view attempts to present ideas and facts in such a fashion that both supporters and opponents can agree.”
  • 11. Research questions What quantitative metrics for quality? Analyze articles cited in the press Any patterns or quality level of articles? Effects of citation on article?
  • 12. Metrics for each article Rigor - number of edits Diversity - number of unique editors Taken from the edit history for each page Metadata only, can be used for any language
  • 13.
  • 14. Methodology Establish benchmark by analyzing representative general topics Assumption that these would be exemplars Measure median for those topics in Wikipedia Edits: 61 Unique editors: 36.5
  • 15. Methodology Determine metrics for cited articles Examine movement before citation, after citation
  • 16. Reputation of Major Encyclopedia Topics in English Wikipedia (Diversity vs. Rigor) Median Sport Buddhism Law History_of_China Hinduism World_War_II Astronomy Islam Religion Canada Philosophy Mathematics World_War_I Earth Native_American 0 100 200 300 400 500 600 700 800 0 50 100 150 200 250 300 350 Diversity (number of unique editors) Rigor(numberofedits)
  • 17. Reputation of Major Encyclopedia Topics in Wikipedia (Diversity vs. Rigor) using Logarithmic Scale Colonial_America History_of_the_Middle_East World_War_II Astronomy Islam Hinduism History_of_China Median 1 10 100 1000 1 10 100 1000 Diversity (number of unique editors) Rigor(numberofedits)
  • 18. News outlets citing Wikipedia Aljazeerah.info Arizona Republic Associated Press CBC Newsworld Daily Telegraph online Greenville News Groklaw Guardian Houston Chronicle JapanToday.com Kansas City Star Knoxville News Sentinel (Tennessee) Loudon Times-Mirror Lowell Sun Online Metropolis New Straits Times NewScientist.com OC Weekly Sacramento Bee Salt Lake Tribune San Francisco Chronicle San Jose Mercury News Slashdot Star-Telegram Sydney Morning Herald TechTV The Age The Dallas Morning News The Globe and Mail The New Zealand Herald The Philadelphia Inquirer The Pocono Record The Straits Times The Sydney Morning Herald Time.com Venezuelan News and Analysis WOAI-TV San Antonio
  • 19. Wikipedia Articles Cited in Press Jan 2003-March 2004 (Before Citation) Highlighted Articles X_Window_System Who_Wants_to_Be_a_Millionaire Vietnam_War List_of_recipes 11_March_2004_Madrid_attacks Saddam_Hussein Fuck Chen_Shui-bian Communist_Party_of_China 0 100 200 300 400 500 600 700 800 900 1000 0 20 40 60 80 100 120 140 160 180 Diversity (number of unique editors) Rigor(numberofedits)
  • 20. Trends Madrid attacks subject of constant updates Asian topics have high edits, but low number of contributors Science and history have high showing
  • 21. Wikipedia Articles Cited in Press Jan 2003-March 2004 (Before Citation) 1 10 100 1000 10000 1 10 100 1000 Diversity (number of unique editors) Rigor(numberofedits)
  • 22. Wikipedia Articles Cited in Press Jan 2003-March 2004 (After Citation) 1 10 100 1000 10000 1 10 100 1000 Diversity (number of unique editors) Rigor(numberofedits)
  • 23. Articles Moving Across Benchmark Point 62274522British_honours_system 63362811Suez_Crisis 54383528Leap_year 69385930Explosive_material 65404628Palestinian_Authority 70405330Execution_by_firing_squad 76412712Iain_Duncan_Smith 86413930Alexander_Graham_Bell 60434131Breakdancing 83435423Form_of_government 105446032Australian_dollar 95474716History_of_Iraq 98472717Lyndon_LaRouche 95482015Provisional_Irish_Republican_Army 102515022Weapons_of_mass_destruction 106545229Juliana_of_the_Netherlands 84624133Aramaic_language 2261102413Ahmed_Yassin EUEEUE AfterBeforeArticle name
  • 24. Articles improved, without direct link to current events Alexander_Graham_Bell Australian_dollar Breakdancing Execution_by_firing_squad Explosive_material Form_of_government Lyndon_LaRouche Suez_Crisis
  • 25. Conclusions Simple metrics for rigor and diversity can help identify trends Citations in press can lead to improvement of articles If news is the first draft of history, Wikipedia is a “working draft of history”
  • 26. Future Work Content analysis in conjunction with metadata Detect edit wars, vandalism, which skew results Analyze internal and external hyperlinks Measure more limited window of time More broad benchmark topics