How to boost your QA Productivity with Smart Sampling

1. SMART QA
HOW TO BOOST YOUR QA PRODUCTIVITY WITH SMART SAMPLING
FEBRUARY 2016
www.yamagata-europe.com

2. AGENDA
 Introduction to Yamagata Europe
 Why Smart QA?
 How does smart sampling work?
 Introduction to QA figures
 Criteria for Smart QA
 Full human traditional QA
 Human assisted automated QA
www.yamagata-europe.com 2

3. YAMAGATA EUROPE
www.yamagata-europe.com 3
EUROPE
INDIA USA
USA Sales
JAPAN
Southeast ASIA
CHINA

4. WHAT DO WE DO?
www.yamagata-europe.com 4
We write
We translate
We do the layout
We print
We package & ship
We create software

5. WHY SMART QA?
www.yamagata-europe.com 5

6. TRANSLATION SERVICE LEVELS
www.yamagata-europe.com 6
Translation
Translation
+
Proof
Translation
+
QA
Translation
+
Proof
+
QA

7. HOW DOES SMART SAMPLING WORK?
www.yamagata-europe.com 7
Several
parameters
Smartly selected
sections
QA approach
 target audience
 content type
 target language
 TM leverage
 vendor experience
 …
= indication of
overall quality

8. www.yamagata-europe.com 8
TO MEASURE IS TO KNOW

9. SOME QA FIGURES
www.yamagata-europe.com 9
Amount of mistakes
 per match rate
 per vendor
 per project
 per customer
 per language
Experience of the translator
Type of mistakes
 Omissions
 Formatting
 Inconsistencies
 Terminology
 Spelling
 Tags
Conclusions such as best
performers and worst performers

10. MISTAKES PER MATCH RATE
www.yamagata-europe.com 10
 Figures 2015 for a customer with 1,785,506 translated words
 Indication to reduce checks in a certain category
Match Rate Error %
100% 0,50%
High fuzzy matches
95-99% 8,00%
85-94% 6,50%
Low fuzzy matches
75-84% 7,00%
50-74% 2,50%
No match 75,50%

11. MISTAKES PER QA CATEGORY
QA Category Errors %
Quotes 36,81%
Terminology 14,94%
Pattern match 13,86%
Number formatting 6,60%
Inconsistent translation 5,24%
Consecutive spaces 4,68%
Number value 4,32%
Punctuation 2,92%
Capitalisation 1,69%
Corrupt character 1,52%
Search: match found 1,32%
Brackets 1,13%
Forgotten translation 1,10%
Punctuation spacing 1,07%
Partial forgotten translation 0,66%
Skipped translation 0,65%
Empty translation 0,58%
Incomplete translation 0,45%
Explicit Tab 0,26%
Leading/trailing spaces 0,16%
Word spacing 0,05%
www.yamagata-europe.com 11
 Figures 2015 for all jobs
 Indication to reduce checks for certain types of errors

12. MISTAKES PER VENDOR
 Figures 2015 (for vendors with > 10 QA reports / > 50,000 words)
 Indication to reduce checks for certain vendors
www.yamagata-europe.com 12
Best QA
Vendor % QA Errors
Vendor A 0,00%
Vendor B 0,00%
Vendor C 0,00%
Vendor D 0,00%
Vendor E 0,00%
Vendor F 0,00%
Vendor G 2,04%
Vendor H 3,09%
Vendor I 3,70%
Vendor J 5,11%
Vendor K 7,96%
Vendor L 12,20%
Vendor M 12,50%
Vendor N 13,16%
Vendor O 14,29%
Vendor P 14,91%
Vendor Q 15,38%
Vendor R 17,07%
Vendor S 17,24%
Vendor T 17,56%
Worst QA
Vendor % QA errors # Reports with errors
Vendor A‘ 100,00% 11
Vendor B‘ 92,86% 13
Vendor C‘ 89,66% 26
Vendor D‘ 85,71% 12
Vendor E‘ 85,00% 17
Vendor F‘ 81,82% 18
Vendor G‘ 81,82% 9
Vendor H‘ 76,00% 19
Vendor I‘ 75,00% 12
Vendor J‘ 75,00% 9
Vendor K‘ 75,00% 15
Vendor L‘ 73,91% 17
Vendor M‘ 73,08% 19
Vendor N‘ 72,00% 18
Vendor O‘ 71,43% 10
Vendor P‘ 70,27% 26
Vendor Q‘ 68,75% 22
Vendor R‘ 68,42% 26
Vendor S‘ 66,67% 8
Vendor T‘ 66,67% 16

13. CRITERIA FOR SMART QA
www.yamagata-europe.com 13
 measured QA figures
 target audience
 content type
 type of product
 target language
 vendor experience
 volume of the assignment
 leverage policy
 …

14. EXAMPLE 1
www.yamagata-europe.com 14
 Target audience:
internal communication
 Content type:
general
Sampling!
New vendor
No sampling!

15. EXAMPLE 2
www.yamagata-europe.com 15
 Content type:
highly technical
 Product:
medical device
No sampling!

16. EXAMPLE 3
 Content: camera user manual
 High word count
 Mostly full matches
 Same translator for years
Sampling!
www.yamagata-europe.com 16

17. APPROACH TO REVIEW
www.yamagata-europe.com 17
 Y-Score
Traditional linguistic review
 QA Distiller
Human assisted automated QA
 Y-Spell
Limited human assisted automated QA

18. TRADITIONAL LINGUISTIC REVIEW
www.yamagata-europe.com 18
Review by
second
linguist
Comments
in a PDF
In CAT tool
Review by the
customer
Comments
in a PDF
Bilingual
Word export
Online
solution:
Y-Proof
 In layout
 Faster
update of
files & TM
 Less
chance of
mistakes

19. Y-PROOF
www.yamagata-europe.com 19

20. Y-PROOF
www.yamagata-europe.com 20

21. QA DISTILLER
www.yamagata-europe.com 21
 First version developed by Yamagata Europe in 2003
 Standalone tool for checking bilingual files with default settings for
over 90 languages
 Automatic detection of formal errors in translations
 Allows checking of high text volumes within limited time frame
 Studies prove that results of QA Distiller check also give a good
indication of overall linguistic quality
 In the industry considered as a valid method to serve the 4-eyes-
principle

22. QAD USER INTERFACE
www.yamagata-europe.com 22
File info
List of
errors
Error details
Link to file

23. WHAT CAN QA DISTILLER CHECK?
 OMISSIONS
 INCONSISTENCIES
 FORMATTING
 TERMINOLOGY
 CUSTOM PATTERNS
www.yamagata-europe.com

24. OMISSIONS
 EMPTY & SKIPPED
 FORGOTTEN
 PARTIALLY FORGOTTEN
 TOO SHORT/LONG
Spacesornothing
Source=Target
Partsleftuntranslated
Percentage
www.yamagata-europe.com

25. INCONSISTENCIES
 TARGET LANGUAGE
 SOURCE LANGUAGE
SwitchtheunitON
hasbeentranslateddifferently
1time(s)asSchakelhettoestelaan
1time(s)asSchakelhettoesteluit
Schakelhettoestelaan
hasbeenusedfor2differentsourcesegments
1time(s)forSwitchtheunitON
1time(s)forSwitchtheunitOFF

26. FORMATTING
 SPACING ISSUES
 PUNCTUATION
 BRACKETS
 TABS
 CAPITALISATION
Double,extraleading,trailing
Double,endofsegment
Non-matchingpairs
Differentcount
Initial,entire
www.yamagata-europe.com

27. FORMATTING
 CORRUPT CHARACTERS
 SPACING
 NUMBERS
 QUOTATION MARKS
 MEASUREMENT
SYSTEM
Garbledletterslike� , ⃞
orinvalidforcertainlanguagelikeçinEnglish
Required,forbidden
Values,formatting
Non-matching,type
Type,conversion
www.yamagata-europe.com

28. TERMINOLOGY
 EXCEL
 OPEN OFFICE
 SDL MULTITERM 2009
 TERMWEB
ConverttoDICTusingQADistiller
Freeplug-intoexporttoTBX
ExporttoTBX
ExporttoTBX
www.yamagata-europe.com

29. TERMINOLOGY
www.yamagata-europe.com 29

30. CUSTOM PATTERNS
 SEARCH
 REGULAR
EXPRESSIONS
Sourceand/orTarget
Reportpatterns
Ignorepatterns
www.yamagata-europe.com
Make your own checks!

31. REGULAR EXPRESSIONS
www.yamagata-europe.com

32. LANGUAGE DEPENDENT REG EX
www.yamagata-europe.com

33. SMART SAMPLING WITH QAD
www.yamagata-europe.com 33
Based on profiles

34. SMART SAMPLING WITH QAD
www.yamagata-europe.com 34
Based on match rates

35. SMART SAMPLING WITH QAD
www.yamagata-europe.com 35
New feature: based on percentage of text

36. CREATE REPORTS
 Html or xls version to share with your vendor and/or customer
 Xml version: in our case to import into our database for measuring purposes
www.yamagata-europe.com 36

37. WHY NOT GIVE IT A TRY?
Download your Free Trial Version
http://www.qa-distiller.com/
www.yamagata-europe.com 37

38. Y-SPELL
www.yamagata-europe.com 38
 Standalone tool to easily batch check bilingual files
 Faster than existing built-in spellcheckers
 Possibility to create reports:
 To share with vendor and/or customer
 For measuring purposes

39. Analyse QA report
Pass or fail score
Pass?
Deliver to customer
Fail?
Restart full QA cycle
SCORING
www.yamagata-europe.com

40. ANY QUESTIONS?
www.yamagata-europe.com 40

41. CONTACT US
SIEN.ACCOU@YAMAGATA-EUROPE.COM
WWW.YAMAGATA-EUROPE.COM