Umd draft-2010 jun22

crowdsourcing for the crowd generating and curating open and accessible linguistic data Crowdsoucing and Translation Workshop University of Maryland June 10-11, 2010

mission The Language Commons seeks to increase open and accessible linguistic data of all forms for all languages. We are a consortium of individuals, institutes, organizations, and corporations working to build and promote the tools, standards, policy, infrastructure, awareness, and community needed to preserve the world’s linguistic diversity and gather the open data needed to provide global access to knowledge and information across all languages.

urgency [Linguistics may] go down in history as the only science that presided obliviously over the disappearance of 90 per cent of the very ﬁeld to which it is dedicated. –Hale et al We live during a brief period of overlap between the mass extinction of the world’s languages and the advent of the digital age. –Bird

rationale Web-based: The multi-lingual, read/write web has created the opportunity to generate, share, curate linguistic data Open: leverage the momentum behind open content (Creative Commons) and open data (data.gov) movements Crowdsourced: Semisupervised communities can scale datasets (Haiti) Capturing the public imagination: This project represents the convergence of a grand social and grand scientiﬁc challenge

solution Function as a consortium working in parallel on various aspects of the mission: Collaborate on needed tools Inﬂuence data/content publishers to open license their data Inﬂuence policy makers to mandate an open linguistic data for publicly funded projects Generate and curate open data among our consortium members Work to identify and share resources - Language Commons SourceWiki Pursue longer term goals for universal corpus infrastructure and API design

projects NSF Si2 annotation framework for video/audio data (LDC/Meedan) UN Corpus effort ~600 million words/ seven languages (LC Steering Committee) Language Commons SourceWiki - presenting at WikiMania (Rosetta Project, Freebase) Human Language Project universal corpus infrastructure and API design (Bird, Abney)

1. theory

“the meaning of a word is its use in the language” Wittgenstein Philosophical Investigations

a language is a socially constructed framework for storing and transporting meaning within a community however, there is an increasing need to transport meaning across this:

often the meaning (use) of the words does not translate

the war on terror

global understanding problem ? ? Creative Commons - Mushon Zer-Aviv

semantic namespace problem

translation in sensitive contexts often does not solve for understanding, it merely exposes the mis(dis)understanding

2. practice

we are building translation solutions for bloggers and bishops

translation for news.meedan.net http://news.meedan.net

translation for the distrib global newsroom Wikipedia ethic to translation editing +translation as dynamic +revisions are collaborative +show translation history +the consumer as editor +MT feedback loop +able to translate more, better +constantly improving +Community vets translations +humanizes the translator- translators proﬁle Makes media global, conversational, social, cross-language http://news.meedan.net

translation a network of religious scholars Translation as a form of scholarship +no Machine Translation +Domain trained translators +Glossaries +Annotation layers- addresses the namespace issue +Granular Attribution - word/sentence/document level

the user interface the meaning of a translation includes the fact that it is a translation

Showing two languages side by side counter to traditional UI/UX best practices +provenance +attribution +version control +visual cues +url translation +lots of human effort

unintended consequences: language learning

other fun stuff: generating data, transporting knowledge, globalizing great NGOs WikiArabia Meedan Memory Kiva.org +Project with KACST +Open AR/EN TM +Translate 700k words +Translate 2000 articles +Circa 2m words +Jump start Kiva AR +Science Tech Health +Informal domain +Cisco Funded +116k articles in AR WP +on Github +530 million AR speakers

Umd draft-2010 jun22

by Ed Bice

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Umd draft-2010 jun22 Presentation Transcript