This presentation is a part of the MosesCore project that encourages the development and usage of open source machine translation tools, notably the Moses statistical MT toolkit.
MosesCore is supported by the European Commission Grant Number 288487 under the 7th Framework Programme.
For the latest updates, follow us on Twitter - #MosesCore
Scaling API-first – The story of a global engineering organization
TAUS MT SHOWCASE, Hunnect’s Use Case, Sándor Sojnóczky, Hunnect, 10 April 2013
1. TAUS
MACHINE
TRANSLATION
SHOWCASE
Hunnect’s Use Case
15:50 – 16:10
Wednesday, 10 April 2013
Sándor Sojnóczky
Hunnect
2. Now You Got Your MT……
I. Background information
II. Challenges and tasks
1. Retraining
2. Pricing
3. Margin calculation and quality assessment
III. Immediate MT successes
IV. Product specific MT engines
V. Post-editing: success stories
VI. What is next?
3. Now You Got Your MT……
Background information
• MT implementation completed in 2010
• Language pair: English - Hungarian
• Over 100 MT projects
• Successful online training for post-editors
• Growing demand for our MT solutions
4. Now You Got Your MT……
Business Model – Timeframe
(based on a TEP project of 34,000 words / 26,000 no match)
Transla(on
Edi(ng
Proofing
(12
days)
(4
days)
(3
days)
C
o
MT
Post-‐edi(ng
Proofing
Free
(6
days)
s
(1
day)
(9
days)
(3
days)
32
%
saving
in
(me
t
MT
Post-‐edi(ng
Proofing
Free
(6,5
days)
(1
day)
(8
days)
(3,5
days)
35
%
saving
in
(me
Timeframe
5. Now You Got Your MT……
Business Model – Pricing (LSP)
TEP MT/PE Margin %
Margin 25% Margin 45% 50%
Proofing 5%
Bilingual
20%
editing
Biling. proofing 5% 9%
Post-editing 30%
33%
Translation 50%
Machine
trans.
20% 8%
6. Now You Got Your MT……
Business Model – Pricing (Post-editor)
TR PE plan PE actual
Daily
output 2,500 5,000 4,200
Unit paid
1.00 0.60 (-40%) 0.60 (-40%)
Total paid
2,500 3,000 2,520
(+20%) (+1%)
7. Now You Got Your MT……
Challenges and tasks
1. (Re)training
2. Pricing your MT projects
3. Margin calculation
4. Quality assessment
8. Now You Got Your MT……
Retraining activities
• Content selection
• Post-edited content
• New translated materials
• Frequency
• Build a routine
9. Now You Got Your MT……
Pricing your MT projects
§ Pricing matrix based on
• Raw MT output assessed (error typology)
• Post-editor’s feedback on
• Raw output
• Post-editing tasks
10. Now You Got Your MT……
Margin calculation and quality
assessment
• Margins
• Plan vs. actual margins
• The sliding scale (not for all)
• Quality assessment
11. Now You Got Your MT……
Immediate successes
• IT (software)
• Technical content
• Electronic equipment
• Controlled Language
12. Now You Got Your MT……
Further improvements
• Product vs. domain-specific MT engines
• Product-specific aids
• Retraining, retraining…
13. Now You Got Your MT……
Post-editing: success stories
• How to achieve targets?
• How we measure success?
17. Metrics
This slide may not be used or copied without permission from TAUS
18. Metrics:
Dynamic
Quality
Framework
• We need to go up and down in quality and the translation
industry’s use of quality evaluation models and metrics
needed to reflect this,
• We need industry benchmarking to strengthen and
improve the credibility of quality assurance processes,
• We need to lower cost of quality assurance at buyers and
providers.
" We achieve this through an industry shared
knowledge base and shared tools
for benchmarking.
23. Metrics:
Repor8ng
ü See
how
you
compare
against
peers
ü Drill
down
to
see
the
impact
of
individuals
ü Assess
correla(on
between
automated
metrics
and
human
evalua(on
ü Shared
learning
to
feed
fundamental
research
Apply
objec8ve
criteria
and
raise
the
credibility
of
transla8on
quality
assurance
func8on
across
the
industry