Follow-up study “Conduct a study which analyses articles across both languages and subjects to allow differences in levels of accuracy and quality across language and subject domains to be identified. The results could inform editor recruitment efforts and the design of expert feedback mechanisms.”
Assessing the Accuracy and Quality ofWikipedia Entries Compared to PopularOnline Alternative Encyclopaedias:A Preliminary Comparative Study Across Disciplines inEnglish, Spanish and Arabic.
Key aimsA small-scale preliminary project to determine a soundresearch methodology.Explore the opinion of Compare the Explore the viability of theexpert reviewers accuracy, quality, style, r methods used in respectregarding attributes eferences and judgment of the first two aims for arelating to the of Wikipedia entries as possible future study on aaccuracy, quality and rated by experts to larger scale.style of a sample of analogous entries fromWikipedia across a range popular online alternativeof languages and encyclopaedias in thedisciplines. same language.
Research methodologyPairs of 22 articles English Wikipedia vs Encyclopaedia Britannica Spanish Wikipedia vs Enciclonet Arabic Wikipedia vs Mawsoah and Arab EncyclopaediaFour broad disciplinary areasBlind assessed by 2-3 native speaking academic expertsQualitative and quantitative assessmentThis formed the Moodle requirements
User managementEmail notifications sent after batch enrolmentEach academic assigned 2 articlesArticle = course (amended Moodle language files)Tracked progress through Moodle course reports
Why Moodle for research? Assign users to individual articles Feedback - flexible and configurable Feedback - data export Source code available for scrutiny
ConclusionsMoodle worked well and would scale up for a larger projectChange: add automated reminder notificationsChange: build custom report for Feedback progress across allcoursesChange: test out feedback criteria betterLogistics blocker: researcher recruitmentLogistics blocker: article consistency
ConclusionsA series of Consistent Shared: Coursemanageable, small- methodology will backup file andscale studies of be required across feedback surveysquality in the future those projects.would be worthwhile.