Intento Enterprise MT Hub

1
INTENTO
INTENTO
ENTERPRISE
MT HUB
Procure and
deploy best-fit MT
© Intento, Inc. / Conﬁdential / October 2019

MT QUALITY VARIES
ACROSS LANGUAGES AND DOMAINS
2
July 2018 January 2019
and
changing
fast!

MT LEARNING CURVES VARY
3
Customization
depends on
data quality
and volume

THE RIGHT CHOICE DRIVES ROI
4
(English to German, Life Sciences)

INTENTO
MULTI-ENGINE APPROACH TO MT
5
Best-of-breed MT for every project

—
Future-proof ROI

—
Increasingly used by large LSP and
enterprises

CHALLENGES
6
• evaluation MT VendorsMT Consumers
?
TMS
CMS
Support
Sales
IT Desk

CHALLENGES
7
• evaluation
• integration
…
MT Portfolio
Stock MT Engines
TMS
CMS
Support
Sales
IT Desk
Custom MT Engines
MT Consumers

CHALLENGES
8
• evaluation
• integration
• orchestration
• MT routing
• limits, retries,
failovers
• usage & cost
tracking
• asset and model
lifecycle mgmt. …
MT Portfolio
Stock MT Engines
TMS
CMS
Support
Sales
IT Desk
Custom MT Engines
!
!
!
!
!
MT Consumers

CHALLENGES
9
• evaluation
• integration
• orchestration
• MT routing
• limits, retries,
failovers
• usage & cost
tracking
• asset and model
lifecycle mgmt.
• maintenance …
MT Portfolio
Stock MT Engines
TMS
CMS
Support
Sales
IT Desk
Custom MT Engines
!
!
!
!
!
MT Consumers

INTENTO ENTERPRISE MT HUB
10
A single place
to evaluate,
access and
manage MT
portfolio
MT Vendors
INTENTO
MT Scoring
LQA
integrations
Data Cleaning

11
INTENTO
…
TMS
CMS
Support
Sales
IT Desk
MT Consumers MT Portfolio
Stock MT Engines
Custom MT Engines
Universal
API
Smart Routing
with retries
and failovers
Segmenting
and batching
Universal
connectors Single MT
dashboard
MT lifecycle
management

STEPS TO SUCCEED
12
EVALUATE. Build a portfolio of best-of-breed MT engines,
selecting the best MT engine for every project, depending
on the language pair, domain and training data available.
—
DEPLOY. Integrate with all in-house systems (TMS,
Customer Support, Community Forums, CMS, etc), with
routing MT requests to proper engines.
—
MANAGE. Setup performance monitoring and a feedback
loop with model update / re-evaluation routine.
1
2
3

I. EVALUATE
13
BUILDING A PORTFOLIO
OF MT ENGINES

stock
(pre-trained)
NMT
custom
NMT
SELECT CANDIDATE ENGINES
BASED ON BUSINESS REQUIREMENTS
14
Google Cloud
AutoML Translation
IBM Cloud
Language Translator v3
Microsoft
Custom Translate v3
ModernMT
Enterprise API
Globalese
Custom NMT
SYSTRAN
PNMT
Alibaba
Translate
Amazon
Translate
Baidu
Translate API
DeepL
API
Google Cloud
Translation API
IBM Cloud
Language Translator v3
Microsoft
Translator Text API v3
ModernMT
Enterprise API
PROMT
REST API
SDL
BeGlobal / ETS
SYSTRAN
PNMT
Tencent
TMT API
Yandex
Translate API

MT EVALUATION - ACTIVITY
15
Training and statistically significant
evaluation of NMT engines that bring the
most cost and time reduction at the post-
editing stage.
—
Support for BLEU, hLEPOR, TER, RIBES,
ROUGE scores.
—
Using automatic quality scores to reduce
amount of necessary Human LQA by a factor
of 200 (from ~30,000 to 150 segments).
—
Selecting engines with the most perfect
segments and least critical errors, ROI
estimation.
—
Fast (3-4 weeks) and affordable.
perfect segments minor severity
medium severity major severity
Dataset Cleaning
Custom NMT Training
Automated Scoring
Samples for Review
Final Choice
Glossary Adaptation
1
2
3
4
5
6

MT EVALUATION
DATA CLEANING
16
40-60% of real-life TM is useless for MT training.
—
Different MT engines has different data quality
tolerance.
—
Linguistic glossaries need to be compiled for NMT
use.
—
Different rules for proper nouns, acronyms, phrases
—
May take multiple iterations (clean-train-clean)

MT EVALUATION
DOMAIN ADAPTATION
17
NMT Training using TM
—
Custom Terminology
—
BLEU is not actionable
—
Analyze changes on segment level and
iterate

MT EVALUATION
AUTOMATIC SCORING
18
Statistically significant (n=2000)
—
Analyze correlation of corpus-
level scores
—
Identify top-running engines

MT EVALUATION
SAMPLES FOR HUMAN REVIEW
19
LQA: Focus expert attention
on things that matter
(30,000 => 300 segments)
—
Simulated post-editing:
PE + tracking
—
Holistic evaluation:
translation samples

MT EVALUATION
ROI FOR POST-EDITING
20
Blind comparison of top-
running MT engines and
Human Translation
—
Show cost-saving of
reviewing MT vs HT
—
Evaluated by existing LSP
vendors

ESTIMATED PROJECT SCHEDULE
UP TO 4 LANGUAGE PAIRS
21
C1. Client prepares and provides Intento
TM and glossaries (if any) for each project
ClientIntento
contract signed
I1. Data cleaning and preparation
I2. Engine training and evaluation
I3. Deliverables preparation
C2. Human Review
I4. Additional analysis and
recommendations
1wk3-4wks

MT EVALUATION - DELIVERABLES
22
Cleaned training and test datasets
—
Translations for test dataset along with sentence-level scores (hLEPOR, TER)
—
MT engine ranking based on corpus-level scores (hLEPOR, TER, BLEU, ROUGE,
RIBES)
—
Samples of hard, controversial, and typical segments for human review
—
Cost of ownership analysis
—
Ready to use winning MT engines

II. DEPLOY
23
- ENTERPRISE MT HUB
- ADDITIONAL MODULES
- TECHNICAL SUPPORT

24
INTENTO
…
TMS
CMS
Support
Sales
IT Desk
MT Consumers MT Portfolio
Stock MT Engines
Custom MT Engines
Universal
API
Smart Routing
with retries
and failovers
Segmenting
and batching
Universal
connectors Single MT
dashboard
MT lifecycle
management

SOLUTIONS:
1 Multi-engine translation for TMS
2 Corporate Translation Portal
3 On-the-ﬂy website translation
4 Customer support translation
5 Cross-language information
retrieval
6 Connectors and plugins
25
CORE MT
HUB
INTENTOConnectors
and
Plugins
Language
and Domain
Detection
MT Quality
Monitoring
MT Cache
Feedback
Management
Terminology
Management

Smart
Routing
Smart
Routing
26
PM
CORE MT
HUB
INTENTO
Enterprise TMS Intento
XLIFF
Connector
Google AutoML, IBM Watson,
Microsoft, ModernMT, PROMT,
Systran PNMT, SDL ETS, Tilde,
Yandex
9 Custom NMT Platforms
Alibaba, Amazon, Baidu,
CloudTranslate, DeepL, Google,
GTCom, IBM, Kakao, Microsoft,
ModernMT, Naver, PROMT,
SAP, Systran, SDL, Tencent,
Yandex
18 Pre-trained NMT Engines
Intento MT
engages after TM
and before humans
MT Requests are routed
based on language pair
and category
MULTI-ENGINE MT FOR ANY TMS
Post-editor
document
processing TM leverage Intento Post-editing
Intento
CAT/TMS
Plugins
Matecat

Smart
Routing
EMPOWER EVERYONE IN THE COMPANY
WITH SECURE CUSTOM MT
27
Users
(3 langs)
Corporate
Translation Portal
CORE MT
HUB
INTENTO
Enterprise TMS
Intento
XLIFF
Connector
Internal Reviewers &
External post-editors
(LSP)
Yandex
Yandex
18 Pre-trained NMT Engines
Raw MT goes
directly to Intento
Documents that require
TM leverage and post-
editing go to TMS ﬁrst
Intento MT
engages after TM
and before humans
MT Requests are routed
based on language pair
and category
Intento
Language
Detection
(optional)
Intento
Category
Detection
(optional)
texts
& docs
(62 langs)

Smart
Routing
TRANSLATE COMMUNITY CONTENT
ON-THE-FLY
28
Corporate
Website (EN)
CORE MT
HUB
INTENTOIntento
Website
Translator
Intento
MT Cache
(optional)
Yandex
Trained NMT engines with
Custom Terminology to
achieve the best quality
Yandex
Stock NMT Engines for
long-tail content and rare
language
One-line JS snippet added
to the website footer
Cache translations to save on
translating popular content
Custom-tailored
MT routing
Visitors
(9 langs)

Operators submit
quality ratings and
suggested
translations
GLOBAL CUSTOMER SUPPORT
IN LOCAL LANGUAGES
29© Intento, Inc. / Conﬁdential / October 2019
Support
tickets
CORE MT
HUB
INTENTOIntento
Language
Detection
Amazon, Google v3, IBM
Watson, Microsoft v3,
ModernMT, Systran PNMT,
Yandex
Stock NMT engines with
Custom Terminology to adhere
to product names, acronyms
and domain-speciﬁc terms
Customer
(20 langs)
Support
chat
Support
operator
(EN, non-native
20 langs)
Intento
Feedback
Mgmt
Intento
Glossary
Mgmt
Reviewers
(20 langs)
Translation Quality
Feedback
Reviewers use Feedback
to improve glossaries
and select MT engines
Smart
Routing

CROSS-LANGUAGE INFORMATION
RETRIEVAL
30
Massive
data storage
or stream
(XX Mb - X Gb)
OCR / ASR MT
Entity
Extraction
Sentiment
Analysis
Keyword
Search
CORE MT
HUB
INTENTOIntento
OCR
Hub
Intento
Sentiment
Analysis
Hub
Intento
Custom
Connector
Yandex
Smart
Routing
10-20x speed up

CONNECTORS AND PLUGINS
31
STANDARD PLUGINS STANDARD CONNECTORS
SDK
API WRAPPERS
EXTENSION
PLUGIN
CLIENT & SERVER
TRADOS
WEBSITE
TRANSLATOR
XLIFF-BASED
CONNECTORS
CONNECTORS
SOAP API
CONNECTORS
TO WORK WITH:
OR ANY EXISTING MT CONNECTOR
ADD-INS

MT MIDDLEWARE
COST DRIVERS
32
software license
—
reserved bandwidth
—
connectors and data formats
—
SLA
—
support package
—
deployment

III. MANAGE
33
- ENTERPRISE MT HUB
- ADDITIONAL MODULES
- TECHNICAL SUPPORT

34
CORE MT
HUB
INTENTO
MT Quality
Monitoring
MT Cache
Feedback
Management
Terminology
Management
Receive feedback from
end users and monitor
MT quality score
Manage Custom
Terminology at different MT
Engines via a slick UI
Manage costs of the
on-the-ﬂy translation
Automatically monitor third-
party model updates
affecting your content
Single
Invoice and
Billing
Single Usage
Dashboard
Single invoice and
contract for hybrid AI
solution
Track MT management
across all MT engines
in a single place

COST TRACKING
35
Detailed billing reports and
invoices
—
Grouping: by MT engines,
daily usage, language pairs
—
Per-project tracking: via
different API keys
—
Exportable: CSV to
integrate with other systems

SINGLE MT DASHBOARD
36
Powerful MT Usage
Charts
—
Translation Job
History
—
MT Model Explorer
—
MT Credential
Manager

REACH US TO KNOW MORE
hello@inten.to
37
Konstantin Savenkov, CEO

ks@inten.to

2150 Shattuck Ave

Berkeley CA 94705
INTENTO
https://inten.to

CORE MT HUB
38
Without Intento: 4 systems x 5 MT
providers = 20 complex integrations
(~20 months)
—
With Intento Single API: 4 simple
universal connectors (~1 month)
—
Scalable to 100M+ words per day
—
Batch processing and HTML support for
all MT engines; other formats by request
—
x10-20 faster than direct integration due
to segmentation request multi-threading
—
Unifies error reporting, retries and
failover across all MT engines
—
Works both via Intento and your own
contracts with 3rd-party services
—
Supports pre-trained and custom MT
models, in the cloud or on premises.
25+ MT Stock and Custom MT Engines
Microsoft, Google, IBM, Amazon, DeepL, Yandex, SDL…
x20 CHEAPER AND
FASTER TO LAUNCH
VENDOR-AGNOSTIC
(25+ MT PROVIDERS)
WORKS ON FILES
OF ANY SIZE AND
FORMAT
x20 FASTER THAN
DIRECT INTEGRATION
ELIMINATES
SPOF
FLEXIBLE
TERMS AND
DEPLOYMENT
Enterprise MT Hub Module
MT Accounts
Management
Smart Routing
Language and Domain
Detection
Core MT Hub
MT API Uniﬁcation
File format
processing
Pre-/post-
processing
Data
segmentation
Data
packaging
High Availability
API Gateway
Integration tools
(SDK etc)
Single Web UI
Dashboard

MT ENGINE SWITCHING
39
Switch between 20+ MT Engines instantly with no engineering effort
—
Manual Mode: Change provider parameter in the API call to use another
engine
—
Retries: Retry translation requests if selected MT Engine temporarily failed
—
Failover Mode: Route to a different engine in case of persistent failure
—
Generic Smart-Routing: use Intento MT Benchmark to route requests to the
best model for general-purpose content
—
Custom Smart-Routing: set up Custom MT Benchmark for special content
domains, content types, language pairs or custom-trained models

Custom routing table, e.g. custom.marketingCustom routing table, e.g. custom.marketingCustom routing table, e.g. custom.marketing
MT SMART ROUTING
40
Language detection
(optional)
Text classiﬁcation
(optional)
1 2 3
General-purpose routing table (default)
language pairrule 1 MT provider, account, model, glossarymain
MT provider, account, model, glossaryfailover
default
MT provider, accountpre-trained model
“”do not translate
or
rule N
Intento Smart Routing feature encapsulates logic for routing MT request to a proper pre-trained or custom MT model,
with optional language detection, text classiﬁcation and fallback. Default smart-routing schema is based on the public
Intento MT benchmark (https://bit.ly/stock_mt_jan2019).

DATA PROTECTION
41
1.Amazon (protected, no trace)
2.Baidu (no 3rd party usage)
3.CloudTranslate (protected,
private contract)
4.DeepL (protected)
5.Globalese (protected)
6.Google (protected, no trace)
7.IBM (protected)
8.Microsoft (protected, no trace)
8.ModernMT (protected, no trace)
9.PROMT (protected, private contract)
10.SDL (protected)
11.Systran (protected, private contract)
12.Tencent (protected)
13.Yandex (protected, check it)

Intento Enterprise MT Hub

Recommended

Recommended

More Related Content

Similar to Intento Enterprise MT Hub

Similar to Intento Enterprise MT Hub (20)

Recently uploaded

Recently uploaded (20)

Intento Enterprise MT Hub