Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Villar translation 2009_csdi


Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

Villar translation 2009_csdi

  1. 1. Research on Translation Assessment Procedures: Back Translation and Expert ReviewPRESENTERS: ANA VILLAR & KATHLEEN KEPHARTC O N T R I B U T O R S : J H A R K N E S S 1, A V I L L A R 1,K K E P H A R T 1, D B E H R 2, & A S C H O U A - G L U S B E R G 31 UNIVERSITY OF NEBRASKA-LINCOLN2 GESIS, GERMANY3 RESEARCH SUPPORT SERVICES, EVANSTON, ILLINOIS
  2. 2. OutlineResearch goalsKey definitionsLiterature reviewUse of previous researchResearch designResearch toolsPreliminary findings
  3. 3. Research goalsTo gain insight into advantages and disadvantagesand cost/benefits of different approaches toassessing translationsTwo approaches discussed here “Expert review” and Back translation
  4. 4. Back translation (BT)A text already translated into language B fromlanguage A is translated back into language A.The two language A texts are compared to try todecide on the quality of the text in language B.Language B itself is not reviewed in this process.(Much written on BT not discussed here.)
  5. 5. Expert review(Source) text in language A is compared to texttranslated into language B to try to decide on thequality of the text in language B.Comparison made by an “expert” that knows bothlanguages (and ideally cultures and surveys).Language B itself is reviewed in this process.
  6. 6. Evaluation process We asked people with experience in designing surveys to evaluate the products (outputs) from two different translation assessment strategies.1. Source questions and their back translations2. An “expert” (bilingual) review [We call the experts in the current study “evaluators” and people who made the reviews “reviewers”]
  7. 7. Literature review17 Bibliographic Databases + Internet searchKeyword: “Back translation”4,000+ hits (Refworks)2,422 articles in database currentlySelection of articles Most relevant abstracts 2005-2008 Most relevant titles 1970-2004 All articles 1937-1969 and most citedCreation of Data Entry Protocol
  8. 8. Previous research on these questions1. Translation quality assessments for WMHI and ESS2. Oral translation research on ESS questions3. Interpreting research on WMHI and ESS4. Interviews with translators on ESS questions
  9. 9. Research designUsed ESS and WMHI questions already assessedSpanish and GermanTranslators and evaluators with differentbackgroundsCompare comments on BT output with commentson reviews of translations
  10. 10. Research toolsBriefing docs Translators EvaluatorsTemplates Translators Evaluators
  11. 11. BT Evaluation TemplatesSource Back- Evaluator translation CommentsPlease tell me on a Please place on a Comparable - noscore of 0 to 10, scale of 0 to 10, changes to Spanishwhere 0 means you where 0 meanscant be too careful ‘you can never beand 10 means that too careful’ and 10most people can be means ‘thetrusted. majority of people can be trusted’
  12. 12. Review Comments Evaluation TemplatesSource Reviewer Evaluator Translation Comments Comments Change, ifHow often do Meet socially is necessary addyou meet translated as for social Wie oft treffen Siesocially with "how often do activities or sich mit Freunden,friends, you meet with some other Verwandten oderrelatives or friends, relatives expression. privat mit or privately with Otherwise there Arbeitskollegen?workcolleagues? work colleagues" is no sense of social activities.
  13. 13. Findings 1) first findings on BTOur findings corroborate points often made BT will reflect some possible issues NB: Review of translated text still needed to decide what has happened (work beyond BT) BT contains mistakes BT may seem to signal mistakes that are not mistakes BT disguises mistakes
  14. 14. First findings on BTOur findings corroborates points often made BT will reflect some possible issues NB: Review of translated text still needed to decide what has happened (work beyond BT) BT contains mistakes BT may seem to signal mistakes that are not mistakes BT disguises mistakes
  15. 15. First findings on BT BT contains mistakesSource: You were in a bad moodBT: You were moodyTranslation: You were in a bad mood BT may seem to signal mistakesSource: Gain weight without trying toBT: Gain weight without wishing toTranslation: Gain weight without wishing to
  16. 16. First findings on BT BT disguises issuesSource: your emotional problemsBT: your emotional problemsTranslation: your psychological problems(lowkey euphemistic translation “seelische Probleme”) Limited options to describe “emotional problems “ in German BT does not reflect these challenges and differences
  17. 17. Preliminary findings on BT BT will not find resolutions (Strong contrast to what happened in bilinguals reviews) Means further analysis and resolution work No evidence that BT is more efficient or better than other approachesApart from what goes wrong Anything flagged calls for further work with people who can translate (time effort costs) Flagging done on basis of what matters for English
  18. 18. Evaluator review findingsEvaluators (and reviewers) commented on morethan BT comparisons producedEvaluations (and reviews) found things not reflectedin BTEvaluators (and reviewers) often suggested solutionsor possible causes of problems
  19. 19. Evaluator review findingsBilingual evaluators focus more on the translationsthan on the reviewer’s commentsAgreed, disagreed, and added to reviewer commentson basis of their viewNo indication from bilingual review if reviewercomments ALONE more useful[However, comments alone would not berecommended practice for evaluation]More evaluations to come including monolingualEnglish
  20. 20. In sumWork in progressEvaluators (and reviewers) “missed” things in bothprojects(We also missed things)BT less good than review and evaluationBut cost/benefit issues for review/evaluation notresolved Specific instructions needed but also room for things “missed” Iterative practice catches more but optimal minimal approach is goal More research
  21. 21. Thank YouQuestions