Intento Machine Translation Benchmark, July 2017

•

7 likes•9,153 views

Evaluation of nine major Machine Translation providers: performance, quality, language coverage, latency, API update frequency.

Technology

Machine Translation
Benchmark
by Intento
July 2017

• New MT providers: Global Tone Communications
(best for English-to-Chinese so far)
• Improved MT quality: Google, Microsoft, Baidu
• Language coverage: no changes
• Added latency analytics (slide 8)
• Added API changes analytics (slide 9)
July 2017© Intento, Inc.
Changes since May 2017

Overview
• General Purpose Machine Translation Services with Public APIs
• IBM Watson Language Translator
• SDL Cloud Machine Translation
• Google Cloud Translation API
• Yandex Translate API
• Baidu Translate API
• Microsoft Translator Text API
• Systran REST Translation API
• PROMT Cloud API
• GTCom YeeCloud MT
• Benchmark Dimensions
• Performance vs. Price
• Language Coverage
• API Latency
• API Change frequency
May 2017© Intento, Inc.

Performance vs. Price
Dataset WMT2016-17
Domain: News
Pairs: ru-en, en-ru, de-en, en-de, cs-
en, en-cs, tr-en, en-tr, ﬁ-en, en-ﬁ, ro-en,
en-ro, en-zh, zh-en
Performance
Normalised hLEPOR score
aggregated across all
language pairs in the dataset
Affordability = 1/price
Using public volume-based
pricing tiers
Legend
• performance range
• price range
• average position
© Intento, Inc. July 2017

Language coverage
Unique
language
pairs -
supported
exclusively by
one provider
1
100
10000
Google Yandex Microsoft Baidu Systran SDL MT PROMT IBM Watson GTCom
22
4
1
154
906
1 246
3 094
3
20
84
104109
756
3 306
8 556
10 506
Total
Unique
Supported language pairs
© Intento, Inc. July 2017

Language groups by
web popularity*:
P1 - ≥ 2.0% websites
P2 - 0.5%-2% websites
P3 - 0.1-0.3% websites
P4 - <0.1% websites
100% 94% 64%
88%
30%
P1 P2 P3 P4
P1
P2
P3
P4
59%
100%
100%
94%
64%
100% 94%
94%
63%
63% 59%
Supported language pairs by popularity
* https://w3techs.com/technologies/overview/content_language/all© Intento, Inc.
Language coverage
44%
of possible
language pairs
July 2017

by service provider
Google Cloud
Translation API
Microsoft
Translator Text API
Yandex
Translate API
Systran
REST Translation API
SDL Cloud
Machine Translation
PROMT
Cloud API
IBM Watson
Language Translation
July 2017© Intento, Inc.
Language coverage
Baidu
Translate API

Based on 100
1-segment
requests for
en-de pair
Service latency
Latency,seconds
0,1
1
10
100
Google Microsoft PROMT Yandex SDL MT GTCom IBM Baidu Systran
75% 95% 99.9%
July 2017© Intento, Inc.

API & Documentation changes in July 2017:
Change frequency
SDL MT 27
IBM 14
Google 13
Baidu 3
July 2017© Intento, Inc.

$Discover the best service providers for your AI task Evaluate performance on your own data at a fraction of the potential cost saving Access any provider with no effort using to our Single API Intento Service Platform July 2017© Intento, Inc.$

Intento
https://inten.to
Konstantin Savenkov
CEO Intento, Inc.

<ks@inten.to>

What's hot

Talk by Konstantin Savenkov (Intento, Inc.) at Developer Week 2019 (Seattle: Cloud Edition). There are already hundreds of AI functions available via different APIs. Pick Machine Translation, Sentiment Analysis, Image Tagging or anything else - there's already a choice of 20-30 AI vendors to pick from. I will make a brief overview of what types of models are already available in the cloud, which of those enable customization and important things to look after when selecting the model (or a set of those) for a specific project. I will also touch AI API developer experience, to give an idea what a developer should be prepared for when choosing the API to work with. https://devweeksea2019.sched.com/event/OGSp/pro-talk-cloud-ai-landscape

Cloud Artificial Intelligence Landscape

Konstantin Savenkov

State of the Machine Translation by Intento (July 2018)

Konstantin Savenkov

We discuss the importance of evaluating pre-built and customizable MT engines towards different goals in Post-Edited Machine Translation (PEMT) and raw MT settings, as well as different approaches to those evaluations. We'll cover main pitfalls on the path to choose the right MT engine and possible workarounds. The primary focus is on reference-based assessment and how we run them at Intento. School of Advanced Technologies for Translators Friday 14 and Saturday 15 September 2018 - Milano (Italy) https://satt2018.fbk.eu/

EVALUATION IN USE: NAVIGATING THE MT ENGINE LANDSCAPE WITH THE INTENTO EVALUA...

Konstantin Savenkov

Machine Translation Insights

Konstantin Savenkov

This presentation covers our approach to building multi-purpose MT deployments. We talk about different enterprise use-cases for MT and the requirements of those use-cases. Since those requirements often have nothing to do with the objective linguistic quality, sometimes you don't want to select a specific MT engine just to meet them. Therefore, we provide some examples of how it's possible to fulfill those requirements by building NLP on top of your favorite Machine Translation black box.

Building Multi-Purpose MT Portfolio

Konstantin Savenkov

In this report, we have evaluated 6 modern domain-adaptive NMT engines on Biomedical dataset (English to German). ModernMT, Globalese, Google AutoML, IBM Custom NMT, Microsoft Custom Translate, and Tilde. We explored how they compare by performance (using reference-based scores, linguistic quality analysis and automatic quality estimation), total cost of ownership, dataset size requirements, training time, data protection policy and how to start using this advanced technology.

State of the Domain-Adaptive Machine Translation by Intento (November 2018)

Konstantin Savenkov

We all want to act locally while going global, and maintain an inclusive multilingual work environment for the international workforce. Every AI model has its linguistic, cultural, and geopolitical biases. Besides providing better linguistic quality for specific languages and domains, a particular Machine Translation system may not be fully compliant with local dialect, tone of voice, gender, and data locality rules. In this talk, we consider practical cases when those biases create obstacles in building a global presence and an inclusive multilingual work environment for an international company. We discuss how to dodge those biases by using multi-vendor international AI, and in some cases go further, by leveraging those biases to create more diverse and inclusive translations.

Dodging AI biases in future-proof Machine Translation solutions

Konstantin Savenkov

Intento Enterprise MT Hub

Konstantin Savenkov

Intento Enterprise MT Hub

TatianaDmitrieva8

Intento Enterprise MT Hub

TatianaDmitrieva8

Create Your Own Voice Assistant Using Watson and IBM Bluemix

Vidyasagar Machupalli

What's hot (11)

Cloud Artificial Intelligence Landscape

State of the Machine Translation by Intento (July 2018)

EVALUATION IN USE: NAVIGATING THE MT ENGINE LANDSCAPE WITH THE INTENTO EVALUA...

Machine Translation Insights

Building Multi-Purpose MT Portfolio

State of the Domain-Adaptive Machine Translation by Intento (November 2018)

Dodging AI biases in future-proof Machine Translation solutions

Intento Enterprise MT Hub

Create Your Own Voice Assistant Using Watson and IBM Bluemix

Similar to Intento Machine Translation Benchmark, July 2017

Panelists: Yoshiyasu Yamakawa (Intel), JP Barraza (Systran), Konstantin Dranch (Memsource), David Koot (TAUS) The focus of this session will be on predictions and risk management. What kind of things can you predict and how can you manage risks by by analyzing your translation data or monitoring your productivity and quality. Tracking translation data in different cycles of the translation process (translation, post-editing, review, proof-reading) offers tremendous value when it comes to predicting future trends or making informed choices. What type of data can be valuable and what kind of predictions can we make using this data? How can we make more efficient use of already available data? How can we use this type of data to improve machine translation, automatic QA, error-recognition, sampling or quality estimation? How can academia and industry work together towards a common goal?

Topic 4: The Magician's Hat: Turning Data into Business Intelligence (2)

TAUS - The Language Data Network

Microsoft - SEO - TAUS Tokyo Forum 2015

TAUS - The Language Data Network

Intento Enterprise MT Hub

TatianaDmitrieva8

Maximising Machine Translation Return on Investment (KantanMT/Medialocate)

kantanmt

In addition to the traditional languages such as COBOL, C++, and PL/I, there are multiple modern languages that are being adopted by developers worldwide. Java, C++, JavaScript, Go and Swift are enriching the server ecosystem, and they each offer different capabilities. This session will provide an overview of the trends in modern programing languages and how enterprise clients are using them. The discussion will focus on some of the newest languages: Go and Swift, and the efforts made by IBM to bring those languages to the server and cloud platforms. visit http://www-03.ibm.com/systems/z/solutions/enterprise-devops/

InterConnect 2017 : Programming languages in the enterprise: Which language s...

DevOps for Enterprise Systems

Hear from our executive team about: key developments in the industry focusing on data quality, internationalization, and business intelligence; recent accomplishments in Standards and key upcoming projects; IDW platform update including an outline of the next generation platform's new features, and the schedule for roll out; an introduction to the powerful features of the new IDX platform and transition schedule; and a summary of IDEA’s roadmap in the coming years.

IDEA 2020

IDEA (Industry Data Exchange Assc., Inc.)

MT providers claim that (customized) MT "helps you translate more words and grow your business". It "boosts productivity". And it can even "increase revenues" or "optimize customer service and support". What is the reality? Is MT improving or did we reach a plateau? Speakers at last year's QE Summit agreed: one of the main problems in the translation industry today is the lack of benchmarking. The output of MT engines cannot be compared to industry averages or standards because these are not yet available. Automated scores are meaningless outside the “laboratory”. At the same time, buyers of translation services are increasingly interested in translated content of different quality levels. They also want to know how the different engines are performing on different content types and in different language pairs. How do we know? Can we predict the output quality? Shouldn’t MT providers become more transparent to help buyers of these technologies make informed decisions? Session leader: Dag Schmidtke (Microsoft) Panelists: John Tinsley (Iconic), Olga Beregovaya (Welocalize), Olga Pospelova (eBay)

Machine Translation Quality - Are We There Yet? - Dag Schmidtke (Microsoft)

TAUS - The Language Data Network

Join Don and Dale for a preview of what’s coming in FME 2020.0. See how you can build Enterprise Integration Patterns using the upgraded FME Server Automations interface, plus learn about new deployment and licensing options that will help you get the most out of the FME Platform. Experience styled connection lines in Workbench, impressive new 3D rendering capabilities, unparalleled Revit support, and new machine learning connections. We’ll cover all of the exciting new formats, transformers, performance tune-ups, and interface upgrades!

FME 2020.0 Sneak Peek

Safe Software

How IBM and Dialogic Are Making Conferencing Smarter with AI

Dialogic Inc.

As per Stack Overflow, around 80,000 developers have shown their interest in using Python in 2021. Python is also among the top three programming languages this year. If you are looking to build scalable, well-integrated systems with a simple language, unlock the power of Python. We’ve rounded up some of the critical reasons why Python can be an excellent choice for your next web development project.

Top Reasons to Choose Python for Your Next Web Development Project

Capital Numbers

KantanMT Founder and Chief Architect, Tony O'Dowd and Technical Project Manager, Louise Faherty show you how to improve the translation productivity of your team, manage post-editing effort and translation project schedules better with powerful Machine Translation engines. You will learn: • How to deal with Translation challenges • About the necessity of Machine Translation to be competitive • How KantanMT.com can be integrated with existing Translation Management Systems

How to Improve Translation Productivity

kantanmt

A Research Study of Data Collection and Analysis of Semantics of Programming ...

IRJET Journal

[Japan Tech summit 2017] SPL 004

Microsoft Tech Summit 2017

Use Cases of the CPaaS.io project as presented at the first year review meeting in Tokyo on October 5, 2017. Disclaimer: This document has been produced in the context of the CPaaS.io project which is jointly funded by the European Commission (grant agreement n° 723076) and NICT from Japan (management number 18302). All information provided in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The user thereof uses the information at its sole risk and liability. For the avoidance of all doubts, the European Commission and NICT have no liability in respect of this document, which is merely representing the view of the project consortium. This document is subject to change without notice.

CPaaS.io Y1 Review Meeting - Use Cases

Stephan Haller

Resume_Dushiyant

Dushiyant Poptani

Tony O’Dowd takes us through some of the most innovative technologies offered on the KantanMT.com platform which are helping a growing community of KantanMT users to develop and self-manage custom Machine Translation engines in the cloud. Maxim Khalilov then illustrates bmmt’s journey with Machine Translation on KantanMT. He discusses what they have achieved so far in terms of MT engine development and showcases the value that his team is bringing to their growing international client base through the use of Machine Translation.

New Breakthroughs in Machine Transation Technology

kantanmt

APIdays 2015 - The State of Web API Languages

Jerome Louvel

APIdays 2015 - The State of Web API Languages

Restlet

Make your career with the best Python Training in Noida-1.pdf

Appwars Technologies

Blog post

praveen kumar

Similar to Intento Machine Translation Benchmark, July 2017 (20)

Topic 4: The Magician's Hat: Turning Data into Business Intelligence (2)

Microsoft - SEO - TAUS Tokyo Forum 2015

Intento Enterprise MT Hub

Maximising Machine Translation Return on Investment (KantanMT/Medialocate)

InterConnect 2017 : Programming languages in the enterprise: Which language s...

IDEA 2020

Machine Translation Quality - Are We There Yet? - Dag Schmidtke (Microsoft)

FME 2020.0 Sneak Peek

How IBM and Dialogic Are Making Conferencing Smarter with AI

Top Reasons to Choose Python for Your Next Web Development Project

How to Improve Translation Productivity

A Research Study of Data Collection and Analysis of Semantics of Programming ...

[Japan Tech summit 2017] SPL 004

CPaaS.io Y1 Review Meeting - Use Cases

Resume_Dushiyant

New Breakthroughs in Machine Transation Technology

APIdays 2015 - The State of Web API Languages

Make your career with the best Python Training in Noida-1.pdf

Blog post

More from Konstantin Savenkov

Over the last year, we see increasingly more performant Text Transformers models, such as GPT-3 from OpenAI, Turing from Microsoft, and T5 from Google. They are capable of transforming the text in very creative and unexpected ways, like generating a summary of an article, explaining complex concepts in a simple language, or synthesizing realistic datasets for AI training. Unlike more traditional Machine Learning models, they do not require vast training datasets and can start based on just a few examples. In this talk, we will make a short overview of such models, share the first experimental results and ask questions about the future of the content creation process. Are those models ready for prime time? What will happen to the professional content creators? Will they be able to compete against such powerful models? Will we see GPT post-editing similar to MT post-editing? We will share some answers we have based on the extensive experimenting and the first production projects that employ this new technology.

GPT and other Text Transformers: Black Swans and Stochastic Parrots

Konstantin Savenkov

Как выбрать и приручить машинный перевод / How to choose and tame the Machine...

Konstantin Savenkov

Сравнительный анализ систем машинного перевода

Konstantin Savenkov

Building a Data Driven Business

Konstantin Savenkov

Управление бизнесом на основе данных

Konstantin Savenkov

Messengers, Bots and Personal Assistants

Konstantin Savenkov

Краткий обзор видов рекомендательных систем (персонализированные/неперсонализированные, холодный старт, коллаборативная фильтрация тип) и способов их применения в B2C сервисах для улучшения бизнес-показателей: снижения стоимости привлечения пользователя, улучшения удержания и повышения маржинальности.

Рекомендательные системы: роль и оценка эффективности

Konstantin Savenkov

Measuring the agile process improvement

Konstantin Savenkov

Lean production для SAAS

Konstantin Savenkov

Driving Business Goals with Recommender Systems @ YAC/m 2015

Konstantin Savenkov

The Economics of Recommender Systems

Konstantin Savenkov

Recommender Systems in a nutshell

Konstantin Savenkov

More from Konstantin Savenkov (12)

GPT and other Text Transformers: Black Swans and Stochastic Parrots

Как выбрать и приручить машинный перевод / How to choose and tame the Machine...

Сравнительный анализ систем машинного перевода

Building a Data Driven Business

Управление бизнесом на основе данных

Messengers, Bots and Personal Assistants

Рекомендательные системы: роль и оценка эффективности

Measuring the agile process improvement

Lean production для SAAS

Driving Business Goals with Recommender Systems @ YAC/m 2015

The Economics of Recommender Systems

Recommender Systems in a nutshell

Recently uploaded

I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.

"Impact of front-end architecture on development cost", Viktor Turskyi

Fwdays

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Speed Wins: From Kafka to APIs in Minutes

confluent

ScyllaDB has the potential to deliver impressive performance and scalability. The better you understand how it works, the more you can squeeze out of it. But before you squeeze, make sure you know what to monitor! Watch our experienced Postgres developer work through monitoring and performance strategies that help him understand what mistakes he’s made moving to NoSQL. And learn with him as our database performance expert offers friendly guidance on how to use monitoring and performance tuning to get his sample Rust application on the right track. This webinar focuses on using monitoring and performance tuning to discover and correct mistakes that commonly occur when developers move from SQL to NoSQL. For example: - Common issues getting up and running with the monitoring stack - Using the CQL optimizations dashboard - Common issues causing high latency in a node - Common issues causing replica imbalance - What a healthy system looks like in terms of memory - Key metrics to keep an eye on This isn’t “Death-by-Powerpoint.” We’ll walk through problems encountered while migrating a real application from Postgres to ScyllaDB – and try to fix them live as well.

Optimizing NoSQL Performance Through Observability

ScyllaDB

Discover the essentials of performance testing in the IT sector with our concise guide. Learn about various testing types such as load, stress, endurance, spike, scalability, and volume testing. Understand key performance metrics like response time, throughput, CPU and memory utilization, and error rate. Explore top tools like Apache JMeter, LoadRunner, Gatling, Neoload, and BlazeMeter. Gain insights into best practices for defining objectives, creating realistic scenarios, automating tests, and optimizing performance to ensure user satisfaction, reliability, scalability, and cost efficiency. Ideal for developers, QA engineers, and IT professionals. Visit Expeed Software for more information. https://expeed.com/

In-Depth Performance Testing Guide for IT Professionals

Expeed Software

I'm excited to share my latest predictions on how AI, robotics, and other technological advancements will reshape industries in the coming years. The slides explore the exponential growth of computational power, the future of AI and robotics, and their profound impact on various sectors. Why this matters: The success of new products and investments hinges on precise timing and foresight into emerging categories. This deck equips founders, VCs, and industry leaders with insights to align future products with upcoming tech developments. These insights enhance the ability to forecast industry trends, improve market timing, and predict competitor actions. Highlights: ▪ Exponential Growth in Compute: How $1000 will soon buy the computational power of a human brain ▪ Scaling of AI Models: The journey towards beyond human-scale models and intelligent edge computing ▪ Transformative Technologies: From advanced robotics and brain interfaces to automated healthcare and beyond ▪ Future of Work: How automation will redefine jobs and economic structures by 2040 With so many predictions presented here, some will inevitably be wrong or mistimed, especially with potential external disruptions. For instance, a conflict in Taiwan could severely impact global semiconductor production, affecting compute costs and related advancements. Nonetheless, these slides are intended to guide intuition on future technological trends.

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl

Peter Udo Diehl

Key Trends Shaping the Future of Infrastructure.pdf

Cheryl Hung

We're living the AI revolution and Salesforce is adapting and bring new value to their customers. Einstein products are evolving rapidly and navigating their limitations, language support, and use cases can be challenging. Let's make review of what Einstein product are available currently, what are the capabilities and what can be used for in CEE region and how Rossie.ai can help to learn Salesforce speak Czech. We will explore the Einstein roadmap and I will make a short live demo (based on your vote) of some Einstein feature.

AI revolution and Salesforce, Jiří Karpíšek

CzechDreamin

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

IoT Analytics Company Presentation May 2024

IoTAnalytics

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx

Abida Shariff

This talk focuses on the practical aspects of integrating various telephony systems with Salesforce, drawing on examples from implementations in the Czech scene. It aims to inform attendees about the spectrum of telephony solutions available, from small to large scale, and their compatibility with Salesforce. The presentation will highlight key considerations for selecting a telephony provider that integrates smoothly with Salesforce, including important questions to support the decision-making process. It will also discuss methods for integrating existing telephony systems with Salesforce, aimed at companies contemplating or in the process of adopting this CRM platform. The discussion is designed to provide a straightforward overview of the steps and considerations involved in telephony and Salesforce integration, with an emphasis on functionality, compatibility, and the practical experiences of Czech companies.

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...

CzechDreamin

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Bits & Pixels using AI for Good.........

Alison B. Lowndes

Join us as we dive into the latest updates to the UiPath Orchestrator API, including new limits and features for 2024. Discover how these changes can enhance your automation projects and streamline your workflows. 📚 Overview of UiPath Orchestrator API 🔧 Recent changes to API limits 🛠️ How to adapt to new limits 📋 Best practices for using the Orchestrator API efficiently ❓ Q&A session

Exploring UiPath Orchestrator API: updates and limits in 2024 🚀

DianaGray10

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Thierry Lestable

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

How to differentiate Sales Cloud and CPQ on first glance might be tricky if you do not know where to look and what to look at. You will know :-) Managing the sales process within Salesforce is a common use case that can be managed with standart Sales Cloud. If you want to do entire quoting process you will find out Salesforce CPQ solution exists. What is then the difference if both can handle selling products? You will see comparison of 10 different features, which Sales Cloud and Salesforce CPQ handle differently. Simple question you will always remember if you should consider using Salesforce CPQ will be a cherry on top.

10 Differences between Sales Cloud and CPQ, Blanka Doktorová

CzechDreamin

Recently uploaded (20)

"Impact of front-end architecture on development cost", Viktor Turskyi

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Speed Wins: From Kafka to APIs in Minutes

Optimizing NoSQL Performance Through Observability

In-Depth Performance Testing Guide for IT Professionals

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl

Key Trends Shaping the Future of Infrastructure.pdf

AI revolution and Salesforce, Jiří Karpíšek

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

IoT Analytics Company Presentation May 2024

Essentials of Automations: Optimizing FME Workflows with Parameters

Mission to Decommission: Importance of Decommissioning Products to Increase E...

IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...

Connector Corner: Automate dynamic content and events by pushing a button

Bits & Pixels using AI for Good.........

Exploring UiPath Orchestrator API: updates and limits in 2024 🚀

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

10 Differences between Sales Cloud and CPQ, Blanka Doktorová

Intento Machine Translation Benchmark, July 2017

1. Machine Translation Benchmark by Intento July 2017

2. • New MT providers: Global Tone Communications (best for English-to-Chinese so far) • Improved MT quality: Google, Microsoft, Baidu • Language coverage: no changes • Added latency analytics (slide 8) • Added API changes analytics (slide 9) July 2017© Intento, Inc. Changes since May 2017

3. Overview • General Purpose Machine Translation Services with Public APIs • IBM Watson Language Translator • SDL Cloud Machine Translation • Google Cloud Translation API • Yandex Translate API • Baidu Translate API • Microsoft Translator Text API • Systran REST Translation API • PROMT Cloud API • GTCom YeeCloud MT • Benchmark Dimensions • Performance vs. Price • Language Coverage • API Latency • API Change frequency May 2017© Intento, Inc.

4. Performance vs. Price Dataset WMT2016-17 Domain: News Pairs: ru-en, en-ru, de-en, en-de, cs- en, en-cs, tr-en, en-tr, ﬁ-en, en-ﬁ, ro-en, en-ro, en-zh, zh-en Performance Normalised hLEPOR score aggregated across all language pairs in the dataset Affordability = 1/price Using public volume-based pricing tiers Legend • performance range • price range • average position © Intento, Inc. July 2017

5. Language coverage Unique language pairs - supported exclusively by one provider 1 100 10000 Google Yandex Microsoft Baidu Systran SDL MT PROMT IBM Watson GTCom 22 4 1 154 906 1 246 3 094 3 20 84 104109 756 3 306 8 556 10 506 Total Unique Supported language pairs © Intento, Inc. July 2017

6. Language groups by web popularity*: P1 - ≥ 2.0% websites P2 - 0.5%-2% websites P3 - 0.1-0.3% websites P4 - <0.1% websites 100% 94% 64% 88% 30% P1 P2 P3 P4 P1 P2 P3 P4 59% 100% 100% 94% 64% 100% 94% 94% 63% 63% 59% Supported language pairs by popularity * https://w3techs.com/technologies/overview/content_language/all© Intento, Inc. Language coverage 44% of possible language pairs July 2017

7. by service provider Google Cloud Translation API Microsoft Translator Text API Yandex Translate API Systran REST Translation API SDL Cloud Machine Translation PROMT Cloud API IBM Watson Language Translation July 2017© Intento, Inc. Language coverage Baidu Translate API

8. Based on 100 1-segment requests for en-de pair Service latency Latency,seconds 0,1 1 10 100 Google Microsoft PROMT Yandex SDL MT GTCom IBM Baidu Systran 75% 95% 99.9% July 2017© Intento, Inc.

9. API & Documentation changes in July 2017: Change frequency SDL MT 27 IBM 14 Google 13 Baidu 3 July 2017© Intento, Inc.

10. Discover the best service providers for your AI task Evaluate performance on your own data at a fraction of the potential cost saving Access any provider with no effort using to our Single API Intento Service Platform July 2017© Intento, Inc.

11. Intento https://inten.to Konstantin Savenkov CEO Intento, Inc. <ks@inten.to>

Intento Machine Translation Benchmark, July 2017

Recommended

Recommended

More Related Content

What's hot

What's hot (11)

Similar to Intento Machine Translation Benchmark, July 2017

Similar to Intento Machine Translation Benchmark, July 2017 (20)

More from Konstantin Savenkov

More from Konstantin Savenkov (12)

Recently uploaded

Recently uploaded (20)

Intento Machine Translation Benchmark, July 2017