How to ensure quality for non-conventional content such as games, travel reviews and movies. How to define what’s relevant to QE for content that might have short life cycle within the product versus other aspects of the player or user experience which might be more critical? Let’s examine the role of traditional linguistic and functional quality testing vis-à-vis new approaches which focus on areas users might consider more important. How to balance quality - as we currently define it - with real expectations set by users, keeping in mind that user’s expectations might touch a variety of product areas and not include linguistic quality at all?

1. Translation “Quality”
& non-conventional content
Mike Dillinger
Staff Program Manager, Machine Translation
LinkedIn

2. LinkedIn
We help people connect with economic
opportunities.
Build your personal brand
Build your network
Find relevant opportunities
Find training to prep for the opportunities that you want
Find the right talent to build your products
Find the right people to buy your products
Almost 400 Million members around the globe
Content in 24 languages

3. One notion of “ translation quality”?!
Conventional Content
On-line support documents
Marketing documents
Interface strings
Email campaigns
Training materials
Legal materials
Client company descriptions
Non-conventional Content
Search queries
Support chat sessions
User-to-user comments
User-to-Company feedback,
complaints, requests
Social media
User generated headlines,
résumés, job descriptions
Relevance rankings
Classifications, clustering
Etc.

4. Translation quality
= “correctness” or
= adequacy + fluency
≈
Gourmet meal quality
= salt + pepper

5. ISO/TS-11669
Translation is the process of creating
target-language content that corresponds
to source content …
…according to agreed-upon
specifications. (see Melby, 2012, p. 6)
TAUS Dynamic Quality Framework
 Utility
 Time
 Sentiment

6. Quality = meet specifications
Translation Task Specifications (ISO/TS-11669)
Product parameters
Source characteristics, target characteristics (language, locale,
audience),
Process parameters
Tasks (preparation, translation, review, QA, etc.)
Project parameters
Technology (tools, data, security, etc.)
Stakeholders (copyrights, recognition, restrictions, deliverables,
compensation, deadlines, etc.)
Desired outcomes ~ Better User Experience
Increased traffic, engagement, revenue, …
Decreased delivery time, cost, headaches, effort,
support, …

7. MT? MT!
Conventional Content
On-line support documents
Marketing documents
Interface strings
Email campaigns
Training materials
Legal materials
Client company descriptions
Non-conventional Content
Search queries
Support chat sessions
User-to-user comments
User-to-Company feedback,
complaints, requests
Social media
User generated headlines,
résumés, job descriptions
Relevance rankings
Classifications, clustering
Desired outcomes ~ Better User Experience
Increased traffic, engagement, revenue, …
Decreased delivery time, cost, headaches, effort, support, …