Limecraft Flow is a workflow solution used by producers and post facilities of all sizes to automate production workflows. In this presentation, we explain how you can use machine transcription, automatic spotting and machine translation to automate the processes of same-language and language-to-language subtitling. By using Limecraft Flow, producers and distributors add different languages at marginal cost, thereby significantly increasing their potential audience while retaining all the rights over their content. Presented at CineEurope in Barcelona on June, 18th 2019.

1. © LIMECRAFT
connected creativity
Using Limecraft Flow for Automatic Subtitling and Localisation
Presented at EuroCinema in Barcelona, June 18th 2019

2. LIMECRAFT
connected creativity
000. About Limecraft
Limecraft
• Incorporated May 2010
• High-end Television and Film Production
• Customers : producers, post facilities and broadcasters
Industrialising media production
• Online platform for maximum collaboration
• Workflow control
• Automation of manual work (auto-tagging, logging, auto-cut, subtitling)
Business Case for Subtitling
• Reducing 75% of the cost
• Reduce the turn around time to minutes
• Adding different versions at marginal cost
Stay updated
• www.limecraft.com
• facebook.com/Limecraft.connected
• twitter.com/limecraft

3. LIMECRAFT
connected creativity
Copyright 2016 Limecraft , NV. Confidential – Distribution prohibited without permission
000. | About Limecraft
• Solution overview
• Use Case - Transcription
• Use Case: automatically turns audio into timed text
• Key feature: speech to text technology
• Business Case: cuts 75% of the cost
• Use Case - Subtitling
• Use Case: same-language captioning for accessibility
• Key feature: machine transcription and automatic spotting
• Business Case: cuts 75% of the cost
• Use Case - Localisation
• Use Case: created translated subtitles
• Key feature: machine translation and automatic timing template application
• Business Case: cuts 80% of the cost
Agenda

4. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
001. Solution Overview

5. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
LIMECRAFT
connected creativity
001. | State of the Art
State of the Art
• Manual transcription and “annotation”
• Unstructured ”meta” information
• Limited collaboration potential
Traditional methods don’t scale
• Increasing volumes of raw material
• Increasing post-production cost
• Several output versions versions

6. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
How Limecraft Flow addresses today’s Production
Challenges
Post-Production MasteringProduction
Conventional video production involves a lot of
manual work, copy-and-paste, excessive file
transfers. This is hard to scale.
Due to digitization, there’s a trend
• to process more material on the input side,
• to create more versions on the output side
Limecraft Flow : workflows to automate manual work and increase productivity
Dailies: process more material in less time
Output: create different versions at marginal cost
MASTERINGCOST
OUTPUT VERSIONS
PRODUCTIONCOST
RAW MATERIAL
conventional
conventional
Limecraft
Limecraft

7. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
Limecraft “Edge” – Ingest
• Backup one or more copies
• Captures all the metadata
• QC
• Encoding of proxies
• Transfer to flow and deep archive
Key benefits
• Secure your material in minutes
• A single tool for proxies creation and transfer material
• Overall control over the different versions and the master data
001. Solution Overview - Ingest

8. © LIMECRAFT
connected creativity
Using Limecraft Flow, shots are
automatically cut into scenes.
Limecraft Flow
• Integration with pre-production
• Cut in lo-res, conform in 4K
• Export to post-production
Key Benefits
• Avoids file-transfers
• Automatic transcoding and
rewrapping
• Offloads edit suites
Limecraft Flow
• Online platform for collaborative production
• Automatic logging, indexing, rough-cut
• Transfer back and forth post-production
• Access to subtitling and localisation features
• Publish online
Business Case
• 30% reduction of post-production cost
• 75% reduction the subtitling cost
• Less manual work, more creative output

9. How can we take advantage of
Artificial Intelligence (AI)?
– Which data?
– How to handle inaccuracy?
– What’s the benefit for production?

10. 003. Use Case 2 – Non-scripted

11. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
Limecraft uses ASR to
automatically turn audio into timed
text
• Machine transcription (122
languages)
• Computer Assisted Logging
• Ease of searching
• Text-based pre-cut (paper-edit)
Business Cases
• Saves 75% of the cost
compared to manual
transcription

12. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity

13. Centralized and structured transcription and logging of material
-> Faster cataloguing, better search and retrieval, more
efficient editing
– Supervised or unsupervised Machine transcription (ASR)
and Named Entity Recognigion
– Enable Search and Selection
• Feed the search index
• Add specific parts or subclips to the order or shopping basket
– Hand-over to Edit Workstation or Archive
• Compatible with Avid MC, Avid Interplay, Adobe Premiere
• Timed tekst, Named Entities, Faces

14. 004. Use Case 3 – Subtitling & Localisation

15. Automatic creation of subtitles
– Machine transcription
– Spotting rules
– Export in a variety of formats, including EBU-TT-D, SRT, STL, etc.
Key benefits
– 50% cost saving compared to manual subtitling
– Producers and distributors can create subtitles themselves
– Retain the rights of the subtitles

16. Generating subtitles is a bit of A.I. of itself
– Subtitles must be aligned
along the shot cuts
– Various timing rules make up
a complex algorithm
• Best score wins, but might
violate some constraints

17. 1. Auto-transcription of logging forms the basis
for the next step: assistance of localized
subtitling
• Together with BBC we’ve been working on
providing subtitling workflows to end users
– Journalists, content producers who typically have
no easy direct access or budget to subtitling

18. 1. Auto-transcription of logging forms the basis
for the next step: assistance of localized
subtitling
• Together with BBC we’ve been working on
providing subtitling workflows to end users
– Journalists, content producers who typically have
no easy direct access or budget to subtitling

19. Localisation
– Translating existing subtitles (the “Template”)
– Adding non-domestic subtitles at marginal cost
– Enabling producers and distributors to extend their reach
But: Machine Translation is a different ball game
– Using Machine translation (not Automatic Speech
Recognition)
– Not intended for the hard of hearing
– Maintain consistent timing

20. LIMECRAFT
connected creativity
#2 - A.I-assisted multi-language subtitling - Subtitlebot

21. LIMECRAFT
connected creativity
Summary
• Limecraft Flow
Asset Management and workflow automation
Specific workflow solutions for transcription, subtitling and localiation
• Same language subtitling (closed captioning)
Using speech recognition for automatic transcription (saving min. 50%)
Automatic spotting (saving 100%)
• Localisation
Uses Machine translation (saving 80%)
Add subtitles in other languages at marginal cost
-> Free trial available, we appreciate your feedback: www.limecraft.com