Your SlideShare is downloading. ×
0
Augmented Social Cognition: Who Edits Wikipedia? Ed H. Chi Augmented Social Cognition Area Palo Alto Research Center 2007-...
Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
High-end of the collaboration spectrum <ul><li>Groups utilize systems to make sense and share complex topics and materials...
Middle of the spectrum <ul><li>Systems that evolve structures that can be used to organize information. </li></ul><ul><li>...
Lightweight social processes <ul><li>Counting votes </li></ul><ul><ul><li>A way to increase signal-to-noise ratio </li></u...
Layers of Models Needed 2007-06-17 Ed H. Chi - Who writes Wikipedia? Heavier  collaboration Voting systems Digg.com Collab...
Research Vision Augmented Social Cognition <ul><li>Cognition : the ability to remember, think, and reason; the faculty of ...
The first step in solving any interesting problem is to get some paper and pencil. John Tukey  (not a direct quote) 2007-0...
Increasing Coordination Cost in Wikipedia (joint work with Niki Kittur, Bongwon Suh, Bryan Pendleton) Published in CHI2007...
What is Wikipedia? 2007-06-17 Ed H. Chi - Who writes Wikipedia? “ Wikipedia is the best thing ever.  Anyone in the world c...
Increasing Coordination Costs in Wikipedia <ul><li>Understanding coordination costs is vital for long-term viability of co...
Less direct work <ul><li>Decrease in proportion of edits to article page </li></ul>2007-06-17 Ed H. Chi - Who writes Wikip...
More indirect work <ul><li>Increase in proportion of edits to user talk </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipe...
More indirect work <ul><li>Increase in proportion of edits to user talk </li></ul><ul><li>Increase in proportion of edits ...
More maintenance work <ul><li>Increase in proportion of edits that are reverts </li></ul>2007-06-17 Ed H. Chi - Who writes...
More wasted work <ul><li>Increase in proportion of edits that are reverts </li></ul><ul><li>Increase in proportion of edit...
Global level <ul><li>Conflict and coordination costs are growing </li></ul><ul><ul><li>Less direct work (articles) </li></...
Conflict at the article level <ul><li>Conflict is growing at the global level </li></ul><ul><li>We have some idea about wh...
Measure of controversy <ul><li>“ Controversial” tag </li></ul><ul><li>Use # revisions tagged controversial </li></ul>2007-...
Page metrics <ul><li>Possible metrics for identifying conflict in articles </li></ul>2007-06-17 Ed H. Chi - Who writes Wik...
Performance: Cross-validation <ul><li>5x cross-validation, R 2  = 0.897 </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipe...
Performance: Cross-validation <ul><li>5x cross-validation, R 2  = 0.897 </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipe...
Determinants of conflict <ul><li>  Revisions (talk) </li></ul><ul><li>  Minor edits (talk) </li></ul><ul><li>  Uniqu...
Model Generalization and Validation survey <ul><li>Applied model to untagged articles (100+ edits) </li></ul><ul><li>Sampl...
Who edits Wikipedia? % of edits made by administrators 2007-06-17 Ed H. Chi - Who writes Wikipedia?
% of edits by 10k+ editors 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Word changes made by admins 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Shifting user population in Wikipedia (more and more bottom driven!) 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Proportion of edits made by top editors in Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Long tail of participation in Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
The participation architecture is a power law 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Only 60% of top 1% editors stay around month to month! 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Living Laboratory: Prototyping Social Applications on the Internet Create a Living Laboratory as a platform to develop, te...
WikiDashboard Joint work with  Bongwon Suh, Aniket Kittur, Bryan Pendleton 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Risks for Using Wikipedia <ul><li>Factual accuracy </li></ul><ul><li>Motives of editors </li></ul><ul><li>Uncertain expert...
Social Dashboard <ul><li>Social translucent for effective communication and collaboration </li></ul><ul><ul><li>Make socia...
WikiDashboard <ul><li>Surfacing hidden social context to users </li></ul><ul><li>For readers </li></ul><ul><ul><li>Any inc...
Article Dashboard 2007-06-17 Ed H. Chi - Who writes Wikipedia?
User Dashboard 2007-06-17 Ed H. Chi - Who writes Wikipedia?
Drilling Down <ul><li>List of every edits that a user made </li></ul><ul><li>Let readers examine each individual revision ...
Augmented Social Cognition: From Social Foraging to Social Sensemaking 2007-06-17 Ed H. Chi - Who writes Wikipedia? Image ...
Upcoming SlideShare
Loading in...5
×

Research on Social Dynamics in Wikipedia

1,834

Published on

presented at Stanford Open Source lab unconference and Recent Changes Camp 2008

Published in: Technology, Education
1 Comment
4 Likes
Statistics
Notes
  • Hello, this is very interesting. Do you have any update on this study ? Thank you. -Hyunjung Bae
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
1,834
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
31
Comments
1
Likes
4
Embeds 0
No embeds

No notes for slide
  • Transcript of "Research on Social Dynamics in Wikipedia"

    1. 1. Augmented Social Cognition: Who Edits Wikipedia? Ed H. Chi Augmented Social Cognition Area Palo Alto Research Center 2007-06-17 Ed H. Chi - Who writes Wikipedia? Image from: http://www.flickr.com/photos/ourcommon/480538715/
    2. 2. Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    3. 3. High-end of the collaboration spectrum <ul><li>Groups utilize systems to make sense and share complex topics and materials. </li></ul><ul><li>Wikipedia (social status) </li></ul><ul><li>Slashdot (karma points) </li></ul><ul><li>eHow.com </li></ul><ul><li>Lostpedia.com </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    4. 4. Middle of the spectrum <ul><li>Systems that evolve structures that can be used to organize information. </li></ul><ul><li>Del.icio.us </li></ul><ul><li>Flickr </li></ul><ul><li>YouTube </li></ul><ul><li>Friendster </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    5. 5. Lightweight social processes <ul><li>Counting votes </li></ul><ul><ul><li>A way to increase signal-to-noise ratio </li></ul></ul><ul><ul><li>Information faddishness </li></ul></ul><ul><li>Examples: </li></ul><ul><ul><li>Digg.com </li></ul></ul><ul><ul><li>Most bookmarked items on del.icio.us </li></ul></ul><ul><ul><li>Estimating the weight of an ox or temperature of a room </li></ul></ul><ul><ul><li>The true value of a stock </li></ul></ul><ul><ul><li>PageRank or Hub / Authority algorithms </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    6. 6. Layers of Models Needed 2007-06-17 Ed H. Chi - Who writes Wikipedia? Heavier collaboration Voting systems Digg.com Collaborative Creation Wikipedia Col. Information Structures Slashdot eHow.com Del.icio.us IBM dogear PageRank Flickr <ul><li>Understanding of micro-economics </li></ul><ul><li>of foraging [PARC] </li></ul><ul><li>Personal vs. group [Huberman, Adamic] </li></ul><ul><li>Wisdom of Crowd [Surowieki] </li></ul><ul><li>Information cascades [Anderson and Holt] </li></ul><ul><li>Understanding of conflicts and coordination </li></ul><ul><li>Wikipedia coordination costs [PARC] </li></ul><ul><li>Invisible Colleges [Sandstrom] </li></ul><ul><li>Interference effects [Pirolli] </li></ul><ul><li>Co-laboratories [Olson and Olson] </li></ul><ul><li>Community networks / Col. Problem solving [Carroll] </li></ul><ul><li>Understanding of info and social networks </li></ul><ul><li>Tag network analysis [PARC, Golder, Yahoo] </li></ul><ul><li>Structural holes (info brokerage) [Burt] </li></ul><ul><li>Network constraints and structure [various] </li></ul><ul><li>Semantic of semiotic structures / words [IR, LSA] </li></ul>
    7. 7. Research Vision Augmented Social Cognition <ul><li>Cognition : the ability to remember, think, and reason; the faculty of knowing. </li></ul><ul><li>Social Cognition : the ability of a group to remember, think, and reason; the construction of knowledge structures by a group. </li></ul><ul><ul><li>(not quite the same as in the branch of psychology that studies the cognitive processes involved in social interaction, though included) </li></ul></ul><ul><li>Augmented Social Cognition : Supported by systems, the enhancement of the ability of a group to remember, think, and reason; the system-supported construction of knowledge structures by a group. </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    8. 8. The first step in solving any interesting problem is to get some paper and pencil. John Tukey (not a direct quote) 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    9. 9. Increasing Coordination Cost in Wikipedia (joint work with Niki Kittur, Bongwon Suh, Bryan Pendleton) Published in CHI2007 conference: Aniket Kittur, Bongwon Suh, Bryan Pendleton, Ed H. ChiHe Says, She Says: Conflict and Coordination in Wikipedia. In Proc. of ACM Conference on Human Factors in Computing Systems (CHI2007), pp. 453--462, April 2007. ACM Press. San Jose, CA 
 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    10. 10. What is Wikipedia? 2007-06-17 Ed H. Chi - Who writes Wikipedia? “ Wikipedia is the best thing ever. Anyone in the world can write anything they want about any subject, so you know you’re getting the best possible information.” – Steve Carell, The Office
    11. 11. Increasing Coordination Costs in Wikipedia <ul><li>Understanding coordination costs is vital for long-term viability of collaborative information environment </li></ul><ul><li>Data: </li></ul><ul><ul><li>Entire dump on July 2, 2006 </li></ul></ul><ul><ul><li>58 million revisions </li></ul></ul><ul><ul><li>4.7 million wiki pages </li></ul></ul><ul><ul><li>2.4 million article pages </li></ul></ul><ul><ul><li>800 gigabytes </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    12. 12. Less direct work <ul><li>Decrease in proportion of edits to article page </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? 70%
    13. 13. More indirect work <ul><li>Increase in proportion of edits to user talk </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? 8%
    14. 14. More indirect work <ul><li>Increase in proportion of edits to user talk </li></ul><ul><li>Increase in proportion of edits to procedure </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? 11%
    15. 15. More maintenance work <ul><li>Increase in proportion of edits that are reverts </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? 7%
    16. 16. More wasted work <ul><li>Increase in proportion of edits that are reverts </li></ul><ul><li>Increase in proportion of edits reverting vandalism </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? 1-2%
    17. 17. Global level <ul><li>Conflict and coordination costs are growing </li></ul><ul><ul><li>Less direct work (articles) </li></ul></ul><ul><ul><li>More indirect work (article talk, user, procedure) </li></ul></ul><ul><ul><li>More maintenance work (reverts, vandalism) </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    18. 18. Conflict at the article level <ul><li>Conflict is growing at the global level </li></ul><ul><li>We have some idea about where it is </li></ul><ul><li>But what defines conflict at the local level? </li></ul><ul><li>Build a characterization model of article conflict </li></ul><ul><ul><li>Identify metrics relevant to conflict </li></ul></ul><ul><ul><li>Automatically identify high-conflict articles </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    19. 19. Measure of controversy <ul><li>“ Controversial” tag </li></ul><ul><li>Use # revisions tagged controversial </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    20. 20. Page metrics <ul><li>Possible metrics for identifying conflict in articles </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? Metric type Page Type Revisions (#) Article, talk, article/talk Page length Article, talk, article/talk Unique editors Article, talk, article/talk Unique editors / revisions Article, talk Links from other articles Article, talk Links to other articles Article, talk Anonymous edits (#, %) Article, talk Administrator edits (#, %) Article, talk Minor edits (#, %) Article, talk Reverts (#, by unique editors) Article
    21. 21. Performance: Cross-validation <ul><li>5x cross-validation, R 2 = 0.897 </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    22. 22. Performance: Cross-validation <ul><li>5x cross-validation, R 2 = 0.897 </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    23. 23. Determinants of conflict <ul><li>  Revisions (talk) </li></ul><ul><li>  Minor edits (talk) </li></ul><ul><li>  Unique editors (talk) </li></ul><ul><li>  Revisions (article) </li></ul><ul><li>  Unique editors (article) </li></ul><ul><li>  Anonymous edits (talk) </li></ul><ul><li>  Anonymous edits (article) </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? <ul><li>Highly weighted features of conflict model: </li></ul>
    24. 24. Model Generalization and Validation survey <ul><li>Applied model to untagged articles (100+ edits) </li></ul><ul><li>Sampled range of predicted conflict scores </li></ul><ul><li>Rated by expert Wikipedians </li></ul><ul><li>Significantly correlated with predicted scores </li></ul><ul><ul><li>By rank correlation, p < 0.013 (Spearman’s rho) </li></ul></ul><ul><li>Validates characterization model </li></ul><ul><ul><li>Detects conflicts even for articles with no ground truth </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    25. 25. Who edits Wikipedia? % of edits made by administrators 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    26. 26. % of edits by 10k+ editors 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    27. 27. Word changes made by admins 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    28. 28. Shifting user population in Wikipedia (more and more bottom driven!) 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    29. 29. Proportion of edits made by top editors in Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    30. 30. Long tail of participation in Wikipedia 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    31. 31. The participation architecture is a power law 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    32. 32. Only 60% of top 1% editors stay around month to month! 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    33. 33. Living Laboratory: Prototyping Social Applications on the Internet Create a Living Laboratory as a platform to develop, test, and market our innovations, and as a vehicle for creating collaborations and thought leadership. 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    34. 34. WikiDashboard Joint work with Bongwon Suh, Aniket Kittur, Bryan Pendleton 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    35. 35. Risks for Using Wikipedia <ul><li>Factual accuracy </li></ul><ul><li>Motives of editors </li></ul><ul><li>Uncertain expertise </li></ul><ul><li>Volatility </li></ul><ul><li>Spotty coverage </li></ul><ul><li>Unproven/non-independent source </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? [Denning et al. 2005]
    36. 36. Social Dashboard <ul><li>Social translucent for effective communication and collaboration </li></ul><ul><ul><li>Make socially significant information visible and salient </li></ul></ul><ul><ul><li>Support awareness of the rules and constraints </li></ul></ul><ul><ul><li>Accountability for actions </li></ul></ul><ul><li>Wikis can be a prime candidate </li></ul><ul><ul><li>Every edit is logged and retrievable </li></ul></ul><ul><ul><li>WikiScanner.com </li></ul></ul><ul><ul><li>WikiRage.com </li></ul></ul><ul><ul><li>Intellipedia </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia? [Erickson and Kellogg 2002]
    37. 37. WikiDashboard <ul><li>Surfacing hidden social context to users </li></ul><ul><li>For readers </li></ul><ul><ul><li>Any incidents in the past e.g. A sudden burst of edits? </li></ul></ul><ul><ul><li>Who are the editors? </li></ul></ul><ul><ul><li>What is their motivation / point of views / expertise / topics of interest </li></ul></ul><ul><ul><li>Help them judging the quality/trustworthiness/usefulness of an article </li></ul></ul><ul><li>For writers </li></ul><ul><ul><li>Measure expertise / contribution / reputation </li></ul></ul><ul><ul><li>Motivate them to be more active / responsible (?) </li></ul></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    38. 38. Article Dashboard 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    39. 39. User Dashboard 2007-06-17 Ed H. Chi - Who writes Wikipedia?
    40. 40. Drilling Down <ul><li>List of every edits that a user made </li></ul><ul><li>Let readers examine each individual revision for validity, which is hard to accomplish when only provided with aggregate visual summaries. </li></ul>2007-06-17 Ed H. Chi - Who writes Wikipedia?
    41. 41. Augmented Social Cognition: From Social Foraging to Social Sensemaking 2007-06-17 Ed H. Chi - Who writes Wikipedia? Image from: http://www.flickr.com/photos/ourcommon/480538715/ <ul><li>Research Vision: Understand how social computing systems enhance the ability of a group of people to remember, think, and reason. </li></ul><ul><li>Living Laboratory: Create breakthrough applications that harness collective intelligence to improve knowledge capture, transfer, and discovery. </li></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×