Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Mt translation with free software en
1. Machine translation with
free software for
enterprises
Bordeaux, 6th July 2010
Garbiñe Aranbarri
Machine translation with free software for enterprises 09/07/2010 1/45
2. Introduction
ELEKA
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations www.eleka.net info@eleka.net
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 2/45
3. Translation engines with
free software
Introduction
Apertium
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A. http://sourceforge.net/projects/apertium/files/
publish
sports
finance
Matxin
Integrations
Matxin
ES-EU
Modules
http://sourceforge.net/projects/matxin/files/
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 3/45
4. Based on the
Apertium and
Matxin
Introduction
MT and free software technologies
Machine translation with
Apertium and Matxin
Apertium
Modules
free software
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU www.opentrad.com
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 4/45
5. Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 5/45
6. Practical and accessible
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 6/45
7. Quality: revise always!
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 7/45
8. MT: speeds up translation process
Free software
Introduction
MT and free software continuous improvements
Apertium and Matxin
Apertium
Modules
Adaptations
flexibility for the adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 8/45
9. Translation engines with
free software
Introduction
Apertium
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A. http://sourceforge.net/projects/apertium/files/
publish
sports
finance
Matxin
ES-EU
Integrations
Matxin
Modules
http://sourceforge.net/projects/matxin/files/
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 9/45
10. Apertium in the beginning
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
Language pairs of the same family
EU-ES
Conclusion
Superficial transfer
Machine translation with free software for enterprises 09/07/2010 10/45
11. Superficial transfer modules of Apertium
Source text Deformatting
Introduction Morphological analysis
MT and free software
Apertium and Matxin
Apertium
Modules Lexical disambiguation
Adaptations
Linguistic A.
publish
sports Structural transfer Lexical transfer
finance
Integrations
Matxin
ES-EU Morphological generation
Modules
ESǂEU
Adaptations
EU-ES After-generation
Conclusion
Reformatting Translation
Machine translation with free software for enterprises 09/07/2010 11/45
12. ES: He recibido un pagaré.
...
Modules
Source text
Deformatting
Morphological analysis
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 12/45
13. Deformatting:
He recibido un pagaré.
...
Modules
Source text
Deformatting
Morphological analysis
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 13/45
14. Morphological analysis:
He: He/Haber, verb, pres. indic., 1st p. sg.
recibido: recibido/recibido, adj, m. sg. / recibir, verb, participle, m. sg.
...
Modules
Source text
Deformatting
un: un/uno, det, ind, m. sg.
Morphological analysis
Disambiguation pagaré: pagaré/pagaré, n, m. sg. / pagar, verb, future indic, 1st p. sg.
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 14/45
15. Lexical disambiguation:
He: Haber, verb indic., 1st p. sg.
recibido: recibir, verb, participle, m. sg.
...
Modules
Source text
Deformatting
un: uno, det., ind, m. sg.
Morphological analysis
Disambiguation pagaré: pagaré, n, m. sg.
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 15/45
16. Structural and lexical transfer
He: (haber) pp1, sg – (avoir) pp1, sg.
recibido: (recibir) participle, m, sg – (recevoir) participle,m, sg.
...
Modules
Source text
un: (uno) det, ind, m, sg – (un) det, ind, m, sg.
Deformatting
Morphological analysis pagaré: (pagaré) n, m, sg – billet (m, sg) à ordre
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 16/45
17. Morphological generation
...
Modules
Source text
~Je ai reçu un billet à ordre~.~
Deformatting
Morphological analysis
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 17/45
18. After-generation
...
Modules
Source text
J'ai reçu un billet à ordre.
Deformatting
Morphological analysis
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 18/45
19. Reformatting
...
Modules
Source text
Deformatting
J'ai reçu un billet à ordre.
Morphological analysis
Disambiguation
Transfer
Generation
After-generation
Reformatting
Translation
...
Machine translation with free software for enterprises 09/07/2010 19/45
21. Apertium today
Language pairs of
Introduction
different families
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
Deep transfer
publish
sports
finance Statistical training of the
Integrations
Matxin
ES-EU
Modules
dictionaries
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 21/45
22. Linguistic adaptations
Introduction
MT and free software Objectives
Apertium and Matxin
Apertium
Modules
Adaptations
Context
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Ex.: media
Modules
ESǂEU
Adaptations Understandable
EU-ES
Conclusion
General
Machine translation with free software for enterprises 09/07/2010 22/45
23. scie/sierra - sierra (fr-es)
sierra-sierra
Introduction
MT and free software
scie-sierra (LR)
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports MULTIWORDS
finance
Integrations
Matxin
ES-EU
scie circulaire – sierra circular
Modules
ESǂEU
Adaptations scie à archet – sierra de arco
EU-ES
Conclusion
scie à ruban – sierra de cinta
etc.
Machine translation with free software for enterprises 09/07/2010 23/45
24. Publishing house
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 24/45
25. Several fields:
es-ca / es-gl
Introduction
MT and free software
Apertium and Matxin
mitocondria-mitòcondria, …
Apertium
Modules
alejandrino-alexandrí, …
Adaptations
Linguistic A. califato-califat, …
publish
sports blues-blues
finance
Integrations
Pitágoras-Pitàgores
Matxin
ES-EU
Modules
etc.
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 25/45
26. « Trainières » association
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 26/45
27. Specific terminology:
Remo-oar
Introduction
MT and free software club de remo-rowing club
Apertium and Matxin
Apertium
Modules Caja Madrid-Caja Madrid
Adaptations
Linguistic A.
publish
sports
(not “Box Madrid”)
finance
Integrations
Matxin Zarauzko estropadak-
ES-EU
Modules
ESǂEU Zarauzko estropadak
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 27/45
28. Savings bank
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 28/45
29. Bank terminology (multiwords):
payer en espèces -
Introduction pagar en metálico
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
payer en liquide –
sports
finance
Integrations
pagar en metálico (LR)
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES billet à ordre - pagaré
Conclusion
Machine translation with free software for enterprises 09/07/2010 29/45
30. Integrations
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Needs?
Adaptations
Linguistic A.
publish
sports
finance
What translation
Integrations
Matxin
ES-EU
Modules
ESǂEU procedure?
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 30/45
31. Implementation
Introduction
MT and free software
Integration of Apertium in
Apertium and Matxin
Apertium
Modules
the system of the company
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Definition of an API
Matxin
ES-EU
Modules
ESǂEU
EU-ES
Adaptations
Readaptation of the
Conclusion
codification
Machine translation with free software for enterprises 09/07/2010 31/45
32. Translation engines with
free software
Introduction
MT and free software
Apertium
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish http://sourceforge.net/projects/apertium/files/
sports
finance
Integrations
Matxin
ES-EU
Modules
Matxin
ESǂEU
http://sourceforge.net/projects/matxin/files/
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 32/45
33. RBMT
ES EU
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU Rule-based
Adaptations
EU-ES
Conclusion Deep transfer
Machine translation with free software for enterprises 09/07/2010 33/45
34. Deep transfer modules of Matxin
Source text Deformatting
Introduction
Deep analysis
MT and free software
Apertium and Matxin
Apertium
Modules Structural transfer Lexical transfer
Adaptations
Linguistic A.
publish
sports
Syntactical generation
finance
Integrations
Matxin
ES-EU Morphological generation
Modules
ESǂEU
Adaptations
EU-ES After-generation
Conclusion
Reformatting Translation
Machine translation with free software for enterprises 09/07/2010 34/45
35. Apertium (superficial transfer) Matxin
ST Deformatting ST Deformatting
Introduction
Morphological analysis Deep analysis
MT and free software
Apertium and Matxin
Apertium
Modules Lexical disambiguation ST LT
Adaptations
Linguistic A.
publish
sports ST LT Sintactical generation
finance
Integrations
Matxin
ES-EU Morphological generation Morphological generation
Modules
ESǂEU
Adaptations
EU-ES After-generation After-generation
Conclusion
Reformatting T Reformatting T
Machine translation with free software for enterprises 09/07/2010 35/45
36. Differences between ES and EU
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations ES EU
Linguistic A.
publish inflected agglutinative
sports
finance
Matxin
Integrations
inflections and prepositions words= lexemes + affixes
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 36/45
37. «para los de la casa = etxekoentzako»
(« for those of the house »)
Introduction
MT and free software
para (prep.) etxe- (n)
Apertium and Matxin
Apertium
Modules -koentzako (morpheme
Adaptations los (art./m/pl) = « for those of the »)
Linguistic A.
publish
sports
finance
Integrations
de (prep.)
Matxin
ES-EU
Modules
ESǂEU la (art./f/sg)
Adaptations
EU-ES
Conclusion
casa (SN/f/sg)
Machine translation with free software for enterprises 09/07/2010 37/45
38. Terminological adaptation
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
Improve the lexical choice
publish
Method based on corpus
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 38/45
39. Polysemy
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules ES EU_1 EU_2
Adaptations
Linguistic A. capital (m/f) hiriburu kapitala
publish (capital city) (capital)
sports
finance formación (f) alderdi trebakuntza
Matxin
Integrations
(political party) (training)
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 39/45
40. Similar signifiers in ES and in EU:
Introduction capital => kapital
MT and free software
Apertium and Matxin
Apertium
Modules
formación => formazio
Adaptations
Linguistic A.
publish
sports
finance
Integrations Multiword
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 40/45
41. Multiword
PN: Pilar del Castillo => gazteluko mugarri
(pilier du château / pilar of the castle)
Introduction
MT and free software
Apertium and Matxin
Others: ministro de educación, política social y deporte
Apertium
Modules
Adaptations (ministre d'éducation, politique social et sports /
Linguistic A.
publish
sports education, social policy and sports minister)
finance
Integrations
Matxin recinto cerrado => esparru itxi
ES-EU
Modules
ESǂEU
Adaptations
(enceinte fermée / enclosure)
EU-ES
Conclusion
recinto ferial => azoka barruti
(enceinte de l'exposition / exhibition site)
Machine translation with free software for enterprises 09/07/2010 41/45
42. SMT
EU ES
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU
Modules
ESǂEU
Adaptations
EU-ES Moses
Conclusion
Less developed than ES-EU
Machine translation with free software for enterprises 09/07/2010 42/45
43. Challenges
Matxin: ES<->EU productive
Introduction
MT and free software
Apertium and Matxin
Apertium
Modules
Adaptations Apertium :
Linguistic A.
publish
sports Keep on improving
finance
Integrations
Matxin
ES-EU
Create new language pairs
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Follow the technological
research
Machine translation with free software for enterprises 09/07/2010 43/45
44. Based on the
Apertium and
Matxin
Introduction
MT and free software technologies
Machine translation with
Apertium and Matxin
Apertium
Modules
free software
Adaptations
Linguistic A.
publish
sports
finance
Integrations
Matxin
ES-EU www.opentrad.com
Modules
ESǂEU
Adaptations
EU-ES
Conclusion
Machine translation with free software for enterprises 09/07/2010 44/45
45. Thank you very much!
garbine@eleka.net | www.eleka.net
Machine translation with free software for enterprises 09/07/2010 45/45