presentation on history of MT and how language resources have helped to develop MT (particularly statistical MT) with an emphasis in Pangeanic's experience

1. PangeaMT – putting open standards to work… wellMT+ LR = ADOPTION ∞ Manuel Herranz Pangea.com.MT

2. Short history (MT) DIY SMT http://t.co/HDTboxQ Chomsky: Imagine thatif in thefuturelargeenoughamounts of data existed, theycould be processedbycomputerswithenoughcomputingpower TranslationindustryappropriatingMoses http://euromatrixplus.net/moses 𝟓𝟎 1st Open source SMT Firststatisticalpapers rule-basedsystems, IBM licenses, manylinkedtopatent EN/RU & Intel 𝒍𝒂𝒕𝒆 𝟗𝟎𝒔 𝟔𝟎 − 𝟕𝟎 −𝟖𝟎𝐬 𝑨𝒍𝒑𝒂𝒄 𝒓𝒆𝒑𝒐𝒓𝒕

3. Short history (digital) Content generated BY USERS / CONSUMERS / CITIZENS, multilingual, free informationexchangeacrosstheworld PEAK of ColdWar and information control. Products & informationdirectedtoconsumers/ users / citizens 𝟓𝟎 BEGINNING of data resources. Internet. Accessabilitytoinformation 𝒍𝒂𝒕𝒆 𝟗𝟎𝒔 𝟔𝟎 − 𝟕𝟎 −𝟖𝟎𝐬 𝑨𝒍𝒑𝒂𝒄 𝒓𝒆𝒑𝒐𝒓𝒕

5. Insufficiently good output

6. Only internal production

7. EU Post-Editing Award

9. 00's of engine trials and language combinations

10. Open-Source to commercial

12. Empower Users

13. Glossary

14. Automated re-training

15. Transfer architecture and know-how to users

16. Compatibility with commercial formats (ttx, sdlxliff, itd)As of May 2009: 487 Billion gigabytes or 1,000,000,000 * 487,000,000,000 = 4,87 x 1020 Estimates Up 50% a year (Oracle) Doubles every 11 hours (IBM)

18. To provide High Q MT for Post-Editing and save time and cost. No Google-type broad TR but domain-specific, user-centric.

19. Lower entry level for MT. Bring democracy and affordability to MT. Bring it to the user, take away from programmer.

20. How? By fostering open-standard geared translation automation strategies

22. Own data

23. Sony (client donation)

24. (Manual) data gathering & alignment

25. Manual cleaning until some tools developed – limited SME resources

26. Resources getting smaller soon – need to build more

28. 8 Therushfor data (clean) <tusrclang="en-GB"> <tuvxml:lang="EN-GB"> <seg>A system for recovering the methane that is emitted from the manure so that it does not leak into the atmosphere.</seg> </tuv> <tuvxml:lang="FR-FR"> <seg>Systèmepermettant de r€ pérer le méthane qui se dégage de l'engrais naturel d'origineanimale de sortequ'il ne se dissipe pas dansl'atmosphère.</seg> </tuv> <tucreationdate="20090817T114430Z" creationid="APIACCESS" changedate="20110617T141159Z" changeid=“pat"> <tuvxml:lang="EN-US"> <seg>Overall heigtht –<bpt i="1">{43 </bpt> <ept i="1">}</ept>25&quot;; width –<bpt i="2">{43 </bpt> <ept i="2">}</ept>20.1&quot;.</seg> </tuv> <tuvxml:lang="ES-EM"> <seg><bpt i="1">{2 </bpt>Altura total - 25&quot;; anchura <ept i="1">}</ept>–<bpt i="2">{43 </bpt> <ept i="2">}</ept><bpt i="3">{2 </bpt>20,1&quot;.<ept i="3">}</ept></seg> </tuv> </tu> <tuvxml:lang=“EN-US"> <seg>On 22nd May we decided not to join the group.</seg> <tuvxml:lang=“DE-DE"> <seg>Am 22. </seg> cleaning More cleaning

30. Domain specific

31. Monolingual (for LM) and parallel crawling

32. Corpus normalization

33. (Semi) automated PoS tagging

35. OngoingWork :) - API integration + userdomainbuilding- Audiovisual integration- Releasethecodetousers-> create a community and flavourstoeachsituation; hybridate and create rules- Have more and more companies and institutions use PangeaMT as theirplatform and makeitgrown

36. 2009 2010 Predictions Tech. notthe realm of afew providers 2011 2012 2013 User empowerment 000's of customized MT systems 2014 2015 YEAR 2016 2016 2017 2018

37. 2009 2010 2018

39. Translator engagement challenge

40. Need for data has been addressed – still more work to be done.

42. Supra-engines??

43. World-knowledge?? …...suggestions....??? 2018

44. 15 Thankyou ! QUESTIONS ? mherranz@pangea.com.mt