SlideShare a Scribd company logo
1 of 23
Translation universals: do they exist?
A corpus-based and NLP approach to convergence
Gloria Corpas*, Ruslan Mitkov**, Naveed Afzal***, Lisette Garcia Moya***
* University of Malaga
** University of Wolverhampton
*** Centre for Pattern Recognition and Data Mining, Santiago de Cuba
Translation universals
(Baker 1993, 1996; Toury 1995)
Translated texts tend to be simpler than non-
translated, original texts (simplification)
Translated texts tend to be more explicit than
non-translated texts (explicitation)
Translated texts tend to be more similar than
non-translated texts (convergence)
Previous research on translation
universals
Formulation and initial explanation been based
of intuition and introspection
Follow-up corpus research limited to
comparatively small-size corpora, literary or
newswire texts and semi-manual analysis
No sufficient guidance as to which are the
features which account for these universals to
be regarded as valid
Objective of this study
To test the validity of convergence (translated texts
tend to be more similar than non-translated texts)
Test (target) language: Spanish
General methodology
Employment of NLP techniques on corpora of
translated Spanish and on comparable corpora
of non-translated (original) Spanish
Similarity between every pair of corpora of
translated texts and between every pair of
corpora of original texts computed
Similarity is measured in terms of both style and
syntax
Corpora used
Corpus of Medical Spanish Translations by Professionals
(MSTP: 1,058,122)
Corpus of Medical Spanish Translations by Students (MSTS:
1,058,122)
Corpus of Technical Spanish Translations (TST: 1,736,027)
Corpus of Original Medical Spanish Comparable to
Translations by Professionals (MSTPC: 1,402,172)
Corpus of Original Medical Spanish Comparable to
Translations by Students (MSTSC: 1,164,435)
Corpus of Original Technical Spanish Comparable to
Technical Translations (TSTC: 1,986,651)
Comparability of corpora
Comparability in terms of
(i) Text types and forms
(ii) Domains and sub domains
(iii) Level of specialisation and formality
(iv) Diatopic restrictions (Peninsular Spanish)
(v) Time span (2005-2008)
(vi) Similar size
Comparability of corpora (2)
Comparability of corpora is mathematically an
equivalence relation
Reflexivity: A corpus is comparable to itself (C ~ C)
Symmetry: If a corpus C is comparable to corpus D,
then D is comparable to C (C ~ D, then D ~ C)
Transitivity: if a corpus C is comparable to corpus D
and if corpus D is comparable to corpus E, then C
is comparable to E (C ~ D and D ~ E, then C ~ E)
Therefore, comparability splits the universe of all
corpora into disjoint classes of corpora.
CORPUS DESIGNCORPUS DESIGN
TRANSLATED
CORPUS
MSTTST
MSTP MSTS
NON
TRANSLATED
CORPUS
MSC
MSTSC MSTPC
TSTC
ES (TT) ES (NT)
Specific methodology (1)
Compared:
all 3 pairs of translated texts (MSTP-MSTS; MSTS-
TST; MSTP-TST)
all 3 pairs of comparable non- translated texts
(MSTPC-MSTSC; MSTSC-TSTC; MSTPC-TSTC)
Premise: If convergence universals holds, higher
similarity for pairs of translated texts expected.
Specific methodology (2)
Texts compared on the basis of
(i) style (stylistic features)
(ii) syntax (syntactic features).
Our proposal for stylistic and syntactic features
Style comparison: stylistic features
Lexical density:
(number of types)/
(total number of tokens present in corpus)
Lexical richness:
(number of lemmas)/
(number of tokens present in corpus)
Sentence length:
(number of tokens in corpus)/
(number of sentences)
Style comparison: stylistic features (2)
Simple/complex sentences
Discourse markers (Spanish)
Two statistical tests (Chi-Square test and T-test)
employed
Syntax comparison
Sequences of POS tags for every pair of corpora
compared
Corpora represented as frequency vectors of 3-
grams (Nerbonne and Wiersma, 2006)
Measures:
Cosine
Recurrence metrics R and Rsq (Kessler, 2001)
Experimental results
Computation of stylistic features
Chi-square values for global comparison
T-test values for statistical significance
Measuring vector differences for syntax
comparison
Style comparison: Stylistic Features
Features MSTP MSTS TST MSTPC MSTSC TSC
Lexical
Density
0.027954 0.052715 0.020679 0.042505 0.041159 0.025529
Lexical
Richness
0.016929 0.037709 0.013281 0.029992 0.028905 0.015591
Average
Sentence
Length
25.256248 28.499456 27.292782 20.702349 26.442412 18.124363
Simple
Sentence
s (%)
0.441768121 0.507205751 0.476949103 0.638889238 0.52120611 0.592110096
Discourse
Markers
(Ratio)
0.001268941 0.001852604 0.000763805 0.002022331 0.002099085 0.001649655
Style comparison: Chi-Square Values
Corpora Chi-Square Values
1MSTP  2MSTS 0.010622566
1MSTP  3TST 0.00266151
2MSTS  3TST 0.023731912
Total 0.037015988
Average 0.012338663
Corpora Chi-Square Values
1MSTPC  2MSTSC 0.059779549
1MSTPC  3TSC 0.006140764
2MSTSC  3TSC 0.07122404
Total 0.137144352
Average 0.045714784
Translated Corpora Non-Translated Corpora
Style comparison: T-Test Values
Features Translated Corpora (T-test Values)
MSTP MSTS MSTS  TST MSTP  TST
Non-translated Corpora (T-test Values)
MSTPC MSTSC MSTSC TSC MSTPCTSC
Lexical Density 0.002545387 0.000123172 0.079875166 0.140348431 0.201151185 0.000748439
Lexical
Richness 0.0006604 0.000006.9792 0.140236542 0.140711253 0.015893183 0.00009.71905
Sentence
Length 0.011826639 0.522122939 0.202480843 0.145216739 0.002807505 0.368840258
Simple
Sentences 0.057465277 0.673936375 0.202830407 0.096465071 0.462960518 0.21217697
Discourse
Markers 0.001048007 0.005746253 0.351552034 0.063428055 0.00084074 0.072337471
Syntax comparison: Results Measuring
Vector Differences
Corpora 1-C R Rsq
Translated texts
MSTP - MSTS 0.206015066283 252526.914323 638848591.082
MSTP - TST 0.337626383799 388466.504863 3146471863.13
MSTS - TST 0.176310545152 432725.578482 2643068563.82
Non-Translated texts
MSTPC - MSTSC 0.0176469276126 98448.0858054 82218137.9687
MSTPC - TSC 0.150912596476 364322.217714 851312764.364
MSTSC - TSC 0.167167511143 372940.61477 1008322991.78
Discussion (1)
Stylistic features: translated texts included in
experiment are more similar than non-translated
texts (Chi-square test)
Discussion (2)
T-test observations
There are non-translated texts which are not statistically
different in terms of stylistic features whereas
corresponding translated texts different statistically
There are non-translated texts which are statistically
different in terms of only one stylistic feature whereas
corresponding translated texts different statistically with
regard to two stylistic features
Translated texts could often differ significantly with regard
to certain style features (lexical density).
Discussion (3)
Translated texts differ more in terms of syntax
for all compared pairs and from the point of view
of all measures (1-C, R and Rsq)
Conclusions
Style: convergence appears to be broadly holding,
but no definite conclusion can be made that
convergence is a clear-cut universal
Syntax: there is no evidence that convergence
holds in terms of syntax
General: results do not provide sufficient support to
the convergence ‘universal’

More Related Content

Similar to LREC'2008 translation universals

Similarity Features, and their Role in Concept Alignment Learning
Similarity Features, and their Role in Concept Alignment Learning Similarity Features, and their Role in Concept Alignment Learning
Similarity Features, and their Role in Concept Alignment Learning
Shenghui Wang
 
A Biological Sequence Compression Based on cross chromosomal similarities usi...
A Biological Sequence Compression Based on cross chromosomal similarities usi...A Biological Sequence Compression Based on cross chromosomal similarities usi...
A Biological Sequence Compression Based on cross chromosomal similarities usi...
CSCJournals
 
Conceptual similarity: why, where and how
Conceptual similarity: why, where and howConceptual similarity: why, where and how
Conceptual similarity: why, where and how
Giannis Tsakonas
 
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
SemEval-2012 Task 6: A Pilot on Semantic Textual SimilaritySemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
pathsproject
 

Similar to LREC'2008 translation universals (20)

The Effect of Translationese on Statistical Machine Translation
The Effect of Translationese on Statistical Machine TranslationThe Effect of Translationese on Statistical Machine Translation
The Effect of Translationese on Statistical Machine Translation
 
Multiset path orderings and their application to termination of term rewritin...
Multiset path orderings and their application to termination of term rewritin...Multiset path orderings and their application to termination of term rewritin...
Multiset path orderings and their application to termination of term rewritin...
 
art.pdf
art.pdfart.pdf
art.pdf
 
Extractive Document Summarization - An Unsupervised Approach
Extractive Document Summarization - An Unsupervised ApproachExtractive Document Summarization - An Unsupervised Approach
Extractive Document Summarization - An Unsupervised Approach
 
[Paper Introduction] Supervised Phrase Table Triangulation with Neural Word E...
[Paper Introduction] Supervised Phrase Table Triangulation with Neural Word E...[Paper Introduction] Supervised Phrase Table Triangulation with Neural Word E...
[Paper Introduction] Supervised Phrase Table Triangulation with Neural Word E...
 
Similarity Features, and their Role in Concept Alignment Learning
Similarity Features, and their Role in Concept Alignment Learning Similarity Features, and their Role in Concept Alignment Learning
Similarity Features, and their Role in Concept Alignment Learning
 
word level analysis
word level analysis word level analysis
word level analysis
 
Statistical machine translation
Statistical machine translationStatistical machine translation
Statistical machine translation
 
Analysis And Indexing General Terms Experimentation
Analysis And Indexing General Terms ExperimentationAnalysis And Indexing General Terms Experimentation
Analysis And Indexing General Terms Experimentation
 
A survey on parallel corpora alignment
A survey on parallel corpora alignment A survey on parallel corpora alignment
A survey on parallel corpora alignment
 
A Biological Sequence Compression Based on cross chromosomal similarities usi...
A Biological Sequence Compression Based on cross chromosomal similarities usi...A Biological Sequence Compression Based on cross chromosomal similarities usi...
A Biological Sequence Compression Based on cross chromosomal similarities usi...
 
Corpus Effects on the Evaluation of Automated Transliteration Systems
Corpus Effects on the Evaluation of Automated Transliteration SystemsCorpus Effects on the Evaluation of Automated Transliteration Systems
Corpus Effects on the Evaluation of Automated Transliteration Systems
 
Biomedical literature mining
Biomedical literature miningBiomedical literature mining
Biomedical literature mining
 
Conceptual similarity: why, where and how
Conceptual similarity: why, where and howConceptual similarity: why, where and how
Conceptual similarity: why, where and how
 
MT SUMMIT13.Language-independent Model for Machine Translation Evaluation wit...
MT SUMMIT13.Language-independent Model for Machine Translation Evaluation wit...MT SUMMIT13.Language-independent Model for Machine Translation Evaluation wit...
MT SUMMIT13.Language-independent Model for Machine Translation Evaluation wit...
 
AINL 2016: Eyecioglu
AINL 2016: EyeciogluAINL 2016: Eyecioglu
AINL 2016: Eyecioglu
 
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
SemEval-2012 Task 6: A Pilot on Semantic Textual SimilaritySemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
 
Genetic Algorithm for the Traveling Salesman Problem using Sequential Constru...
Genetic Algorithm for the Traveling Salesman Problem using Sequential Constru...Genetic Algorithm for the Traveling Salesman Problem using Sequential Constru...
Genetic Algorithm for the Traveling Salesman Problem using Sequential Constru...
 
Introduction to complexity theory assignment
Introduction to complexity theory assignmentIntroduction to complexity theory assignment
Introduction to complexity theory assignment
 
Building of Database for English-Azerbaijani Machine Translation Expert System
Building of Database for English-Azerbaijani Machine Translation Expert SystemBuilding of Database for English-Azerbaijani Machine Translation Expert System
Building of Database for English-Azerbaijani Machine Translation Expert System
 

LREC'2008 translation universals

  • 1. Translation universals: do they exist? A corpus-based and NLP approach to convergence Gloria Corpas*, Ruslan Mitkov**, Naveed Afzal***, Lisette Garcia Moya*** * University of Malaga ** University of Wolverhampton *** Centre for Pattern Recognition and Data Mining, Santiago de Cuba
  • 2. Translation universals (Baker 1993, 1996; Toury 1995) Translated texts tend to be simpler than non- translated, original texts (simplification) Translated texts tend to be more explicit than non-translated texts (explicitation) Translated texts tend to be more similar than non-translated texts (convergence)
  • 3. Previous research on translation universals Formulation and initial explanation been based of intuition and introspection Follow-up corpus research limited to comparatively small-size corpora, literary or newswire texts and semi-manual analysis No sufficient guidance as to which are the features which account for these universals to be regarded as valid
  • 4. Objective of this study To test the validity of convergence (translated texts tend to be more similar than non-translated texts) Test (target) language: Spanish
  • 5. General methodology Employment of NLP techniques on corpora of translated Spanish and on comparable corpora of non-translated (original) Spanish Similarity between every pair of corpora of translated texts and between every pair of corpora of original texts computed Similarity is measured in terms of both style and syntax
  • 6. Corpora used Corpus of Medical Spanish Translations by Professionals (MSTP: 1,058,122) Corpus of Medical Spanish Translations by Students (MSTS: 1,058,122) Corpus of Technical Spanish Translations (TST: 1,736,027) Corpus of Original Medical Spanish Comparable to Translations by Professionals (MSTPC: 1,402,172) Corpus of Original Medical Spanish Comparable to Translations by Students (MSTSC: 1,164,435) Corpus of Original Technical Spanish Comparable to Technical Translations (TSTC: 1,986,651)
  • 7. Comparability of corpora Comparability in terms of (i) Text types and forms (ii) Domains and sub domains (iii) Level of specialisation and formality (iv) Diatopic restrictions (Peninsular Spanish) (v) Time span (2005-2008) (vi) Similar size
  • 8. Comparability of corpora (2) Comparability of corpora is mathematically an equivalence relation Reflexivity: A corpus is comparable to itself (C ~ C) Symmetry: If a corpus C is comparable to corpus D, then D is comparable to C (C ~ D, then D ~ C) Transitivity: if a corpus C is comparable to corpus D and if corpus D is comparable to corpus E, then C is comparable to E (C ~ D and D ~ E, then C ~ E) Therefore, comparability splits the universe of all corpora into disjoint classes of corpora.
  • 9. CORPUS DESIGNCORPUS DESIGN TRANSLATED CORPUS MSTTST MSTP MSTS NON TRANSLATED CORPUS MSC MSTSC MSTPC TSTC ES (TT) ES (NT)
  • 10. Specific methodology (1) Compared: all 3 pairs of translated texts (MSTP-MSTS; MSTS- TST; MSTP-TST) all 3 pairs of comparable non- translated texts (MSTPC-MSTSC; MSTSC-TSTC; MSTPC-TSTC) Premise: If convergence universals holds, higher similarity for pairs of translated texts expected.
  • 11. Specific methodology (2) Texts compared on the basis of (i) style (stylistic features) (ii) syntax (syntactic features). Our proposal for stylistic and syntactic features
  • 12. Style comparison: stylistic features Lexical density: (number of types)/ (total number of tokens present in corpus) Lexical richness: (number of lemmas)/ (number of tokens present in corpus) Sentence length: (number of tokens in corpus)/ (number of sentences)
  • 13. Style comparison: stylistic features (2) Simple/complex sentences Discourse markers (Spanish) Two statistical tests (Chi-Square test and T-test) employed
  • 14. Syntax comparison Sequences of POS tags for every pair of corpora compared Corpora represented as frequency vectors of 3- grams (Nerbonne and Wiersma, 2006) Measures: Cosine Recurrence metrics R and Rsq (Kessler, 2001)
  • 15. Experimental results Computation of stylistic features Chi-square values for global comparison T-test values for statistical significance Measuring vector differences for syntax comparison
  • 16. Style comparison: Stylistic Features Features MSTP MSTS TST MSTPC MSTSC TSC Lexical Density 0.027954 0.052715 0.020679 0.042505 0.041159 0.025529 Lexical Richness 0.016929 0.037709 0.013281 0.029992 0.028905 0.015591 Average Sentence Length 25.256248 28.499456 27.292782 20.702349 26.442412 18.124363 Simple Sentence s (%) 0.441768121 0.507205751 0.476949103 0.638889238 0.52120611 0.592110096 Discourse Markers (Ratio) 0.001268941 0.001852604 0.000763805 0.002022331 0.002099085 0.001649655
  • 17. Style comparison: Chi-Square Values Corpora Chi-Square Values 1MSTP  2MSTS 0.010622566 1MSTP  3TST 0.00266151 2MSTS  3TST 0.023731912 Total 0.037015988 Average 0.012338663 Corpora Chi-Square Values 1MSTPC  2MSTSC 0.059779549 1MSTPC  3TSC 0.006140764 2MSTSC  3TSC 0.07122404 Total 0.137144352 Average 0.045714784 Translated Corpora Non-Translated Corpora
  • 18. Style comparison: T-Test Values Features Translated Corpora (T-test Values) MSTP MSTS MSTS  TST MSTP  TST Non-translated Corpora (T-test Values) MSTPC MSTSC MSTSC TSC MSTPCTSC Lexical Density 0.002545387 0.000123172 0.079875166 0.140348431 0.201151185 0.000748439 Lexical Richness 0.0006604 0.000006.9792 0.140236542 0.140711253 0.015893183 0.00009.71905 Sentence Length 0.011826639 0.522122939 0.202480843 0.145216739 0.002807505 0.368840258 Simple Sentences 0.057465277 0.673936375 0.202830407 0.096465071 0.462960518 0.21217697 Discourse Markers 0.001048007 0.005746253 0.351552034 0.063428055 0.00084074 0.072337471
  • 19. Syntax comparison: Results Measuring Vector Differences Corpora 1-C R Rsq Translated texts MSTP - MSTS 0.206015066283 252526.914323 638848591.082 MSTP - TST 0.337626383799 388466.504863 3146471863.13 MSTS - TST 0.176310545152 432725.578482 2643068563.82 Non-Translated texts MSTPC - MSTSC 0.0176469276126 98448.0858054 82218137.9687 MSTPC - TSC 0.150912596476 364322.217714 851312764.364 MSTSC - TSC 0.167167511143 372940.61477 1008322991.78
  • 20. Discussion (1) Stylistic features: translated texts included in experiment are more similar than non-translated texts (Chi-square test)
  • 21. Discussion (2) T-test observations There are non-translated texts which are not statistically different in terms of stylistic features whereas corresponding translated texts different statistically There are non-translated texts which are statistically different in terms of only one stylistic feature whereas corresponding translated texts different statistically with regard to two stylistic features Translated texts could often differ significantly with regard to certain style features (lexical density).
  • 22. Discussion (3) Translated texts differ more in terms of syntax for all compared pairs and from the point of view of all measures (1-C, R and Rsq)
  • 23. Conclusions Style: convergence appears to be broadly holding, but no definite conclusion can be made that convergence is a clear-cut universal Syntax: there is no evidence that convergence holds in terms of syntax General: results do not provide sufficient support to the convergence ‘universal’