1. The document proposes a method to automatically analyze wiki edit histories and derive high-level descriptions of the edits. 2. It describes a prototype system called the Wiki Edit History Analyzer that uses text differencing and rule-based categorization to analyze edits and generate summaries. 3. An evaluation of the prototype found an average agreement rate of 84.1% between the system's edit categorizations and those of human evaluators. The system is still being improved based on findings from the preliminary evaluation.

1. What Did They Do? Deriving High-Level Edit Histories in Wikis Peter Kin-Fong Fong and Robert P. Biuk-Aghai Data Analytics and Collaborative Computing Group Department of Computer and Information Science Faculty of Science and Technology University of Macau

5. Try to answer:

6. What Did They Do? 1: en - de (..450,000) 2: es - it (..70,000) 3: ja - pt (..50,000) 4: vo - nl (..35000) 5: zh - sv (..22500) 6: hu - tr (..20,000) 7: ca - no (..15000) http://stats.wikimedia.org/EN/ PlotsPngDatabaseEdits.htm

7. Revision History

8. Looking at Byte Count? 2,070 bytes (new) – 2,055 bytes (old) = 15 bytes changed But: 56 bytes were cut 71 bytes were added 56 + 71 = 127 bytes changed

9. Looking at Minor vs. Non-Minor Edit? -> Minor edit flag: may not be available; subjective 53 bytes changed Minor 1 byte changed Non-Minor

10. Related Work

12. Does not take movement into account

13. Basis of Wikipedia “Diff” function Alpha Bravo Charlie Delta Echo Alpha Charlie Delta Golf Bravo Alpha Bravo Charlie Delta Echo Alpha Charlie Delta Golf Bravo

15. Movement can be detected

16. Basis of Wikitrust Alpha Charlie Delta Golf Bravo Alpha Bravo Charlie Delta Echo Alpha Charlie Delta Golf Bravo Alpha Bravo Charlie Delta Echo

20. A hard-to-read Wikipedia Diff

23. Classify each of 3,665 edit by bare eye: “simple but tedious”

25. Self-defined: Challenged, Unchallenged

28. Proposed Design

29. Wiki Edit History Analyzer

33. Only consider segment with 4 or more tokens, to avoid false tagging of common words

38. Inter-language links

39. Spelling correction

40. Add / Modify category

41. Add references

42. Content re-organization

43. Content re-writing

44. ……

47. Prototype

51. Prototype Screenshot

52. Prototype Screenshot

53. Compare with Wikipedia diff

56. Technical background (4 have, 6 haven’t)

60. Present the edit list generated by our prototype

62. State the reason of disagreement, if any

64. Remaining 9 evaluations ranged from 33.3% to 88.9%

65. No significant differences between the different evaluator groups

67. Conclusions

69. Design of edit history analyzer

70. Prototype implementation

73. Design of questionnaire and following experiments

74. Prototype source code available at: http://sourceforge.net/projects/weha/ Data Analytics and Collaborative Computing Group http://www.fst.umac.mo/se/dacc/