Transcript of "Many hands make light work, the american version [charleston library conference 201111]"
Many Hands Make Light Work, the American Version Experiences with User-Text-Correction at California Digital Newspaper Collection (CDNC): How crowd-sourcing OCR text correction impacts a historic newspaper collection
About the CollectionThe California Digital NewspaperCollection contains over 490,000 pages of visits per month signiﬁcant California newspapers publishedfrom 1846 to 1922. The newspapers were digitized to both minutes per visit page and article level METS/ALTO data aspart of the National Digital NewspaperProgram. pages per visit site statistics between Nov. 2010 and Aug. 2011 The collection is displayed using Veridiandigital library software.
poor OCR reduces search recall to low levels OCR quality ranges between 50%-90% of word level accuracy
Daily Alta California, 2 January 1850 $$post OCR text correction is expensive≈ $0.50 per 1000 characters or $5.00 to $10.00 per newspaper page
The Average CDNC User users above 40 years old users who considerLike the users of many digital newspaper themselves genealogists collections, patrons of the CDNC visit thesite for personal reasons, consider users who visit the site atthemselves genealogists or family least weekly historians, and return to the sitefrequently.
Wikipedia on Crowdsourcing: “distributed problem-solving and production model”“sourcing tasks traditionally performed by specific individualsto an undefined large group of people or community (crowd) through an open call”
Crowd-Sourcing Projects Project Gutenberg Family Search The National Library of Australia The National Library of Finland FreeBMD.org
Site Statistics SinceUser Text Correction visits per month minutes per visit pages per visit
lines per month corrected by the top corrector 30,000 ‘Engaging with users and building virtual communities is just as important to the users as providing the data itself. They want total lines corrected since 2008 49 Million to be part of a community.’ Rose Holley, The National Library of Australia total number of text correctors 30,000 lines corrected per month in 2011 2,000,000 +
Results August 22 - October 22 Users who have Lines Corrected Per Monthcorrected text Lines corrected bytop corrector Total number of linescorrected
Goals• Improve OCR text at low cost • Improve search precision / recall • Build user community
Risks?• User text correction of newspapers is (relatively) new • Users won’t know what to do, interface is confusing • Users don’t understand errors in OCR text • Vandalism of text
Benefits• Text quality improved • Cost effective $• Community involvement • Users empowered
User Reaction“Great feature (I tested it during the beta) for a “I have used the new system and like it. The usergreat site, which I have used extensively. I plan to correction is great idea.” use the edit feature when I get back to research in ~Pat the Los Angeles Herald and the Daily AltaCalifornia.” ~Lawrence B. “Exactly what the system needed!!! Pulled up a couple articles in the beta system and made some text corrections. Went back and tried the old system using the words I corrected and it worked!! “STUNNINGLY FANTASTIC!!!! is what I think!” Outstanding enhancement!” ~A ﬁfth generation Californian ~Mary B. of multiple Forty-niner families
“The addition of user text correction (UTC) to the California Digital Newspaper Collection has dramatically improved the quality of the computer-generated text and enlivened our relationship with ourusers. Within a couple of weeks of implementing UTC, and with little publicity, a handful of users had already corrected thousands of linesof text. Many of those users emailed us directly with questions aboutor praise for the UTC, building direct, personal connections between our staff and users that hadn’t existed before.” ~Brian Geiger, Center for Bibliographic Research, UC Riverside
? Brian Geiger, Director Center for Bibliographic Studies and Research University of California Riverside firstname.lastname@example.org Frederick Zarndt, Chair IFLA Newspapers Section email@example.com
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.