Recommended
More Related Content
What's hot
What's hot (8)
Similar to Intento Enterprise MT Hub
Similar to Intento Enterprise MT Hub (20)
Recently uploaded
Recently uploaded (20)
Intento Enterprise MT Hub
- 1. 1 INTENTO INTENTO ENTERPRISE MT HUB Procure and deploy best-fit MT © Intento, Inc. / Confidential / July 2020
- 2. MACHINE TRANSLATION LANDSCAPE 2© Intento, Inc. / Confidential / July 2020
- 3. MT QUALITY VARIES ACROSS LANGUAGES AND DOMAINS 3 July 2018 January 2019 and changing fast! © Intento, Inc. / Confidential / July 2020
- 4. MT LEARNING CURVES VARY 4 Customization depends on data quality and volume © Intento, Inc. / Confidential / July 2020
- 5. THE RIGHT CHOICE DRIVES ROI 5 (English to German, Life Sciences) © Intento, Inc. / Confidential / July 2020
- 6. INTENTO MULTI-ENGINE APPROACH TO MT 6 Best-of-breed MT for every project — Future-proof ROI — Increasingly used by large LSP and enterprises © Intento, Inc. / Confidential / July 2020
- 7. CHALLENGES 7 • evaluation MT VendorsMT Consumers ? TMS CMS Support Sales IT Desk © Intento, Inc. / Confidential / July 2020
- 8. CHALLENGES 8 • evaluation • integration … MT Portfolio Stock MT Engines TMS CMS Support Sales IT Desk Custom MT Engines MT Consumers © Intento, Inc. / Confidential / July 2020
- 9. CHALLENGES 9 • evaluation • integration • orchestration • MT routing • limits, retries, failovers • usage & cost tracking • asset and model lifecycle mgmt. … MT Portfolio Stock MT Engines TMS CMS Support Sales IT Desk Custom MT Engines ! ! ! ! ! MT Consumers © Intento, Inc. / Confidential / July 2020
- 10. CHALLENGES 10 • evaluation • integration • orchestration • MT routing • limits, retries, failovers • usage & cost tracking • asset and model lifecycle mgmt. • maintenance … MT Portfolio Stock MT Engines TMS CMS Support Sales IT Desk Custom MT Engines ! ! ! ! ! MT Consumers © Intento, Inc. / Confidential / July 2020
- 11. INTENTO ENTERPRISE MT HUB 11 A single place to evaluate, access and manage MT portfolio MT Vendors INTENTO MT Scoring LQA integrations Data Cleaning © Intento, Inc. / Confidential / July 2020
- 12. INTENTO ENTERPRISE MT HUB 12 INTENTO … TMS CMS Support Sales IT Desk MT Consumers MT Portfolio Stock MT Engines Custom MT Engines Universal API Smart Routing with retries and failovers Segmenting and batching Universal connectors Single MT dashboard MT lifecycle management © Intento, Inc. / Confidential / July 2020
- 13. MULTI-PURPOSE ENTERPRISE MT OPTIMIZE MT FOR ALL SCENARIOS 13© Intento, Inc. / Confidential / July 2020 SUPPORT CHATS LEARNING CONTENT OFFICE TOOLS MT PORTALS INTRANET WEBSITES COMMUNITY CONTENT KNOWLEDGE BASESSUPPORT TICKETS POST-EDITING PRODUCT INFORMATION INTENTO MT HUB INTENTO
- 14. STEPS TO SUCCEED 14 EVALUATE. Build a portfolio of best-of-breed MT engines, selecting the best MT engine for every project, depending on the language pair, domain and training data available. — DEPLOY. Integrate with all in-house systems (TMS, Customer Support, Community Forums, CMS, etc), with routing MT requests to proper engines. — MANAGE. Setup performance monitoring and a feedback loop with model update / re-evaluation routine. 1 2 3 © Intento, Inc. / Confidential / July 2020
- 15. I. EVALUATE 15 BUILDING A PORTFOLIO OF MT ENGINES © Intento, Inc. / Confidential / July 2020
- 16. stock (pre-trained) NMT custom NMT SELECT CANDIDATE ENGINES BASED ON BUSINESS REQUIREMENTS 16 Google Cloud AutoML Translation IBM Cloud Language Translator v3 Microsoft Custom Translate v3 ModernMT Enterprise API Globalese Custom NMT SYSTRAN PNMT Alibaba Translate Amazon Translate Baidu Translate API DeepL API Google Cloud Translation API IBM Cloud Language Translator v3 Microsoft Translator Text API v3 ModernMT Enterprise API PROMT REST API SDL BeGlobal / ETS SYSTRAN PNMT Tencent TMT API Yandex Translate API © Intento, Inc. / Confidential / July 2020
- 17. MT EVALUATION - ACTIVITY 17 Training and statistically significant evaluation of NMT engines that bring the most cost and time reduction at the post- editing stage. — Support for BLEU, hLEPOR, TER, RIBES, ROUGE scores. — Using automatic quality scores to reduce amount of necessary Human LQA by a factor of 200 (from ~30,000 to 150 segments). — Selecting engines with the most perfect segments and least critical errors, ROI estimation. — Fast (3-4 weeks) and affordable. perfect segments minor severity medium severity major severity Dataset Cleaning Custom NMT Training Automated Scoring Samples for Review Final Choice Glossary Adaptation 1 2 3 4 5 6 © Intento, Inc. / Confidential / July 2020
- 18. MT EVALUATION DATA CLEANING 18 40-60% of real-life TM is useless for MT training. — Different MT engines has different data quality tolerance. — Linguistic glossaries need to be compiled for NMT use. — Different rules for proper nouns, acronyms, phrases — May take multiple iterations (clean-train-clean) © Intento, Inc. / Confidential / July 2020
- 19. MT EVALUATION DOMAIN ADAPTATION 19 NMT Training using TM — Custom Terminology — BLEU is not actionable — Analyze changes on segment level and iterate © Intento, Inc. / Confidential / July 2020
- 20. MT EVALUATION AUTOMATIC SCORING 20 Statistically significant (n=2000) — Analyze correlation of corpus- level scores — Identify top-running engines © Intento, Inc. / Confidential / July 2020
- 21. MT EVALUATION SAMPLES FOR HUMAN REVIEW 21 LQA: Focus expert attention on things that matter (30,000 => 300 segments) — Simulated post-editing: PE + tracking — Holistic evaluation: translation samples © Intento, Inc. / Confidential / July 2020
- 22. MT EVALUATION ROI FOR POST-EDITING 22 Blind comparison of top- running MT engines and Human Translation — Show cost-saving of reviewing MT vs HT — Evaluated by existing LSP vendors © Intento, Inc. / Confidential / July 2020
- 23. ESTIMATED PROJECT SCHEDULE UP TO 4 LANGUAGE PAIRS 23 C1. Client prepares and provides Intento TM and glossaries (if any) for each project ClientIntento contract signed I1. Data cleaning and preparation I2. Engine training and evaluation I3. Deliverables preparation C2. Human Review I4. Additional analysis and recommendations 1wk3-4wks © Intento, Inc. / Confidential / July 2020
- 24. MT EVALUATION - DELIVERABLES 24 Cleaned training and test datasets — Translations for test dataset along with sentence-level scores (hLEPOR, TER) — MT engine ranking based on corpus-level scores (hLEPOR, TER, BLEU, ROUGE, RIBES) — Samples of hard, controversial, and typical segments for human review — Cost of ownership analysis — Ready to use winning MT engines © Intento, Inc. / Confidential / July 2020
- 25. II. DEPLOY 25 - ENTERPRISE MT HUB - ADDITIONAL MODULES - TECHNICAL SUPPORT © Intento, Inc. / Confidential / July 2020
- 26. INTENTO ENTERPRISE MT HUB 26 INTENTO … TMS CMS Support Sales IT Desk MT Consumers MT Portfolio Stock MT Engines Custom MT Engines Universal API Smart Routing with retries and failovers Segmenting and batching Universal connectors Single MT dashboard MT lifecycle management © Intento, Inc. / Confidential / July 2020
- 27. MULTI-PURPOSE ENTERPRISE MT OPTIMIZE MT FOR ALL SCENARIOS 27© Intento, Inc. / Confidential / July 2020 SUPPORT CHATS LEARNING CONTENT OFFICE TOOLS MT PORTALS INTRANET WEBSITES COMMUNITY CONTENT KNOWLEDGE BASESSUPPORT TICKETS POST-EDITING PRODUCT INFORMATION INTENTO MT HUB INTENTO
- 28. SOLUTIONS: 1 Multi-engine translation for TMS 2 Corporate Translation Portal 3 On-the-fly website translation 4 Customer support translation 5 Cross-language information retrieval 6 Connectors and plugins 28 CORE MT HUB INTENTOConnectors and Plugins Language and Domain Detection MT Quality Monitoring MT Cache Feedback Management Terminology Management © Intento, Inc. / Confidential / July 2020
- 29. Smart Routing Smart Routing 29 PM CORE MT HUB INTENTO Enterprise TMS Intento XLIFF Connector Google AutoML, IBM Watson, Microsoft, ModernMT, PROMT, Systran PNMT, SDL ETS, Tilde, Yandex 9 Custom NMT Platforms Alibaba, Amazon, Baidu, CloudTranslate, DeepL, Google, GTCom, IBM, Kakao, Microsoft, ModernMT, Naver, PROMT, SAP, Systran, SDL, Tencent, Yandex 18 Pre-trained NMT Engines Intento MT engages after TM and before humans MT Requests are routed based on language pair and category MULTI-ENGINE MT FOR ANY TMS Post-editor document processing TM leverage Intento Post-editing Intento CAT/TMS Plugins Matecat © Intento, Inc. / Confidential / July 2020
- 30. Smart Routing EMPOWER EVERYONE IN THE COMPANY WITH SECURE CUSTOM MT 30 Users (3 langs) Corporate Translation Portal CORE MT HUB INTENTO Enterprise TMS Intento XLIFF Connector Internal Reviewers & External post-editors (LSP) Google AutoML, IBM Watson, Microsoft, ModernMT, PROMT, Systran PNMT, SDL ETS, Tilde, Yandex 9 Custom NMT Platforms Alibaba, Amazon, Baidu, CloudTranslate, DeepL, Google, GTCom, IBM, Kakao, Microsoft, ModernMT, Naver, PROMT, SAP, Systran, SDL, Tencent, Yandex 18 Pre-trained NMT Engines Raw MT goes directly to Intento Documents that require TM leverage and post- editing go to TMS first Intento MT engages after TM and before humans MT Requests are routed based on language pair and category Intento Language Detection (optional) Intento Category Detection (optional) texts & docs (62 langs) © Intento, Inc. / Confidential / July 2020
- 31. Smart Routing TRANSLATE COMMUNITY CONTENT ON-THE-FLY 31 Corporate Website (EN) CORE MT HUB INTENTOIntento Website Translator Intento MT Cache (optional) Google AutoML, IBM Watson, Microsoft, ModernMT, PROMT, Systran PNMT, SDL ETS, Tilde, Yandex Trained NMT engines with Custom Terminology to achieve the best quality Alibaba, Amazon, Baidu, CloudTranslate, DeepL, Google, GTCom, IBM, Kakao, Microsoft, ModernMT, Naver, PROMT, SAP, Systran, SDL, Tencent, Yandex Stock NMT Engines for long-tail content and rare language One-line JS snippet added to the website footer Cache translations to save on translating popular content Custom-tailored MT routing Visitors (9 langs) © Intento, Inc. / Confidential / July 2020
- 32. Operators submit quality ratings and suggested translations GLOBAL CUSTOMER SUPPORT IN LOCAL LANGUAGES 32 Support tickets CORE MT HUB INTENTOIntento Language Detection Amazon, Google v3, IBM Watson, Microsoft v3, ModernMT, Systran PNMT, Yandex Stock NMT engines with Custom Terminology to adhere to product names, acronyms and domain-specific terms Customer (20 langs) Support chat Support operator (EN, non-native 20 langs) Intento Feedback Mgmt Intento Glossary Mgmt Reviewers (20 langs) Translation Quality Feedback Reviewers use Feedback to improve glossaries and select MT engines Smart Routing © Intento, Inc. / Confidential / July 2020
- 33. CROSS-LANGUAGE INFORMATION RETRIEVAL 33 Massive data storage or stream (XX Mb - X Gb) OCR / ASR MT Entity Extraction Sentiment Analysis Keyword Search CORE MT HUB INTENTOIntento OCR Hub Intento Sentiment Analysis Hub Intento Custom Connector Google AutoML, IBM Watson, Microsoft, ModernMT, PROMT, Systran PNMT, SDL ETS, Tilde, Yandex 9 Custom NMT Platforms Smart Routing 10-20x speed up © Intento, Inc. / Confidential / July 2020
- 34. CONNECTORS AND PLUGINS 34 STANDARD PLUGINS STANDARD CONNECTORS SDK API WRAPPERS EXTENSION PLUGIN CLIENT & SERVER TRADOS WEBSITE TRANSLATOR XLIFF-BASED CONNECTORS CONNECTORS SOAP API CONNECTORS TO WORK WITH: OR ANY EXISTING MT CONNECTOR ADD-INS © Intento, Inc. / Confidential / July 2020
- 35. MT MIDDLEWARE COST DRIVERS 35 software license — reserved bandwidth — connectors and data formats — SLA — support package — deployment © Intento, Inc. / Confidential / July 2020
- 36. III. MANAGE 36 - ENTERPRISE MT HUB - ADDITIONAL MODULES - TECHNICAL SUPPORT © Intento, Inc. / Confidential / July 2020
- 37. 37 CORE MT HUB INTENTO MT Quality Monitoring MT Cache Feedback Management Terminology Management Receive feedback from end users and monitor MT quality score Manage Custom Terminology at different MT Engines via a slick UI Manage costs of the on-the-fly translation Automatically monitor third- party model updates affecting your content Single Invoice and Billing Single Usage Dashboard Single invoice and contract for hybrid AI solution Track MT management across all MT engines in a single place © Intento, Inc. / Confidential / July 2020
- 38. COST TRACKING 38 Detailed billing reports and invoices — Grouping: by MT engines, daily usage, language pairs — Per-project tracking: via different API keys — Exportable: CSV to integrate with other systems © Intento, Inc. / Confidential / July 2020
- 39. SINGLE MT DASHBOARD 39 Powerful MT Usage Charts — Translation Job History — MT Model Explorer — MT Credential Manager © Intento, Inc. / Confidential / July 2020
- 40. REACH US TO KNOW MORE hello@inten.to 40 Konstantin Savenkov, CEO ks@inten.to 2150 Shattuck Ave Berkeley CA 94705 INTENTO https://inten.to
- 41. CORE MT HUB 41 Without Intento: 4 systems x 5 MT providers = 20 complex integrations (~20 months) — With Intento Single API: 4 simple universal connectors (~1 month) — Scalable to 100M+ words per day — Batch processing and HTML support for all MT engines; other formats by request — x10-20 faster than direct integration due to segmentation request multi-threading — Unifies error reporting, retries and failover across all MT engines — Works both via Intento and your own contracts with 3rd-party services — Supports pre-trained and custom MT models, in the cloud or on premises. 25+ MT Stock and Custom MT Engines Microsoft, Google, IBM, Amazon, DeepL, Yandex, SDL… x20 CHEAPER AND FASTER TO LAUNCH VENDOR-AGNOSTIC (25+ MT PROVIDERS) WORKS ON FILES OF ANY SIZE AND FORMAT x20 FASTER THAN DIRECT INTEGRATION ELIMINATES SPOF FLEXIBLE TERMS AND DEPLOYMENT Enterprise MT Hub Module MT Accounts Management Smart Routing Language and Domain Detection Core MT Hub MT API Unification File format processing Pre-/post- processing Data segmentation Data packaging High Availability API Gateway Integration tools (SDK etc) Single Web UI Dashboard © Intento, Inc. / Confidential / July 2020
- 42. MT ENGINE SWITCHING 42 Switch between 20+ MT Engines instantly with no engineering effort — Manual Mode: Change provider parameter in the API call to use another engine — Retries: Retry translation requests if selected MT Engine temporarily failed — Failover Mode: Route to a different engine in case of persistent failure — Generic Smart-Routing: use Intento MT Benchmark to route requests to the best model for general-purpose content — Custom Smart-Routing: set up Custom MT Benchmark for special content domains, content types, language pairs or custom-trained models © Intento, Inc. / Confidential / July 2020
- 43. Custom routing table, e.g. custom.marketingCustom routing table, e.g. custom.marketingCustom routing table, e.g. custom.marketing MT SMART ROUTING 43 Language detection (optional) Text classification (optional) 1 2 3 General-purpose routing table (default) language pairrule 1 inline protection, block protectionpre-prc MT provider, account, model, glossarymain default MT provider, accountpre-trained model “”do not translate or rule N Intento Smart Routing feature encapsulates logic for routing MT request to a proper pre-trained or custom MT model, with optional language detection, text classification and fallback. Default smart-routing schema is based on the public Intento MT benchmark (https://bit.ly/stock_mt_jan2019). © Intento, Inc. / Confidential / July 2020 MT provider, account, model, glossaryfailover format conversionpost-pr
- 44. DATA PROTECTION 44 1.Amazon (protected, no trace) 2.Baidu (no 3rd party usage) 3.CloudTranslate (protected, private contract) 4.DeepL (protected) 5.Globalese (protected) 6.Google (protected, no trace) 7.IBM (protected) 8.Microsoft (protected, no trace) 8.ModernMT (protected, no trace) 9.PROMT (protected, private contract) 10.SDL (protected) 11.Systran (protected, private contract) 12.Tencent (protected) 13.Yandex (protected, check it) © Intento, Inc. / Confidential / July 2020