SlideShare a Scribd company logo
1 of 32
© LIMECRAFT
connected creativity
Practical Applications of AI in Media Production and
Broadcast
(Contact : info@limecraft.com)
LIMECRAFT
connected creativity
Copyright 2016 Limecraft , NV. Confidential – Distribution prohibited without permission
• Intro and Solution Overview
• Use Case 1 – Scripted and Unscripted Entertainment
• computer assisted logging, transcript-based edit, transfer to edit
• Key Feature: Automated processing of raw material, computer assisted logging
• Use Case 2 – Transcription and Archiving
• computer assisted logging, transcript-based edit, transfer to edit
• Key feature: AI (ASR, NER, deep captioning)
• Use Case 3 – Closed Captions
• same-language subtitling for accessibility purposes
• Key feature: automatic “spotting”
• Use Case 4 – Localisation
• Translated subtitles for localization of content
• Key feature: machine translation and timecode management
• About Limecraft• A
Agenda
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
000. Introduction and Solution Overview
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
LIMECRAFT
connected creativity
001. | State of the Art
State of the Art
• Manual transcription and “annotation”
• Unstructured ”meta” information
• Limited collaboration potential
Traditional methods don’t scale
• Increasing volumes of raw material
• Increasing post-production cost
• Several output versions versions
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
LIMECRAFT
connected creativity
COR
E
Editing
(Avid Media Composer/Adobe
Premiere/ Apple FC)
Transcoding/EDL Processing/Machine Transcription/Machine Translation/…
On Premise Media Asset
Management System
Customer or Cloud
infrastructure
Logging
(Flow)
Ingest
(Edge)
Subtitling
(Flow)
Editing
Gateway
(Edge)
Shoot
(ARRI, Sony, RED, Panasonic,
Canon)
Transcription
(Limecraft ‘Transcriber’)
Existing
Application
Landscape
Limecraft
Platform
Value
Added3rd
Partyapps
On Premise Media Asset
Management System
Customer or Cloud
infrastructure
Cloud Connector
3rd party Cloud
infrastructure
000. Limecraft Platform
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
Limecraft Flow is a cloud-based
Asset Management and Workflow
Automation platform
Key Features
• Cloud-based
• White labeled
• Turn-key integration with any existing
storage, tape and MAM solutions
• Flexibly Customisable Workflows
• API to access individual micro-
services
Using AI for automation
• Production: automate logging
• Post-production: computer assisted
edit
• Mastering: subtitling and localisation
Key Benefits to end user
• No loss of material or redundant
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
How can we take advantage of
Artificial Intelligence (AI)?
– Which data?
– How to handle inaccuracy?
– What’s the benefit for production?
001. Use Case 1 – Ingest and Transfer to Edit
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
LIMECRAFT
connected creativity
Limecraft automatically processes
dailies overnight.
Using speech-to-text, shots are
automatically cut into scenes.
Key Features
• 1000 files per day automatically
tagged
• Overall version control
• Local storage, online collaboration
Key Benefits
• No loss of material or redundant
copies
• Faster access for review and pre-cut
• Reduction of the turn around time
© LIMECRAFT
connected creativity
Limecraft “Edge” for on site processing
• Local Client for offload, dailies encoding
• Play-out of native formats
• Automated audio sync and colour grading
• Checksum verification after each transfer
• Transfer to Edit platform/PAM/MAM
Key benefits
• Ease of use – a single tool for offload, encoding of proxies and
ingest
• Multiple parallel transfers in a single operation
• Maximum protection against errors
001. Edge
LIMECRAFT
connected creativity
Copyright 2019 Limecraft , NV. Confidential – Distribution prohibited without permission
Raw Footage on Offline storage
Limecraft
Cloud Connector
Edge Client
Limecraft Flow
Headquarters
001. More complex Avid Integration
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
Case Study: ‘Un si grand soleil’ by France Télévisions
Format
• Daily soap
• Shot in Montpellier, cut in Paris
• 3 studios, Multi-cam, VFX on set
Challenges
• 8 files per “shot”, up to 1000 files per day
• High post-production rythm: 1 episode per day
• Deliver the master data to enable interactive output
Solution
• Integrate script and breakdown
• Automated transfer back and forth Avid Interplay, grading, VFX, Sound
• Delivers timed subtitles and master data without manual post processing
More info : https://www.limecraft.com/2020/02/16/case-study-the-sun-chronicles/
002. Use Case 2 – Transcription and Archiving
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
ASR automatically turns audio into
timed text in 122 languages.
Using complementary NLP and
NER, we can automatically tag and
categorize content fragments.
Use Cases
• Machine transcription
• Manual post-editing for 100%
accuracy
• Auto-tagging
• Ease of searching
• Text-based pre-cut (paper-edit)
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
LIMECRAFT
connected creativity
19.2 | Product Update: Named Entity Recognition
Centralized and structured transcription and logging of material
-> Faster cataloguing, better search and retrieval, offline edit
– Supervised or unsupervised Machine transcription (ASR)
and Named Entity Recognigion
– Manual Post-editing of the Transcript
• Correct segmentation and interpunction
• Correct recognition errors
– Search and Selection
• Every word is time-coded
• Pick specific parts or subclips to an order or shopping basket
– Hand-over to Edit Workstation or Archive
• Compatible with Avid MC, Avid Interplay, Adobe Premiere
003. Use Case 3 – Subtitling
Automatic creation of subtitles
– Machine transcription
– Spotting rules
– Delivered in a variety of formats, including EBU-TT-D, SRT, STL,
etc.
Key benefits
– 50% cost saving compared to manual subtitling
– Producers and distributors can create subtitles themselves
– Retain the rights of the subtitles
LIMECRAFT
connected creativity
003. Subtitling
Objective
• Shorter cycle time
• Significant cost reduction
Findings (Victoria Barlow, key user)
• I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do.
• It was super easy for me to tweak the words, the timings, placement,…
• Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips
back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius.
• Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to
manually check
Challenge
• Cut transcription into closed captions,
taking into account BBC style guide
Solution
• Full-featured subtitle editor
LIMECRAFT
connected creativity
004. Full Automation
LIMECRAFT
connected creativity
1. Auto-transcription of logging forms the basis
for the next step: assistance of localized
subtitling
• Together with BBC we’ve been working on
providing subtitling workflows to end users
– Journalists, content producers who typically have
no easy direct access or budget to subtitling
LIMECRAFT
connected creativity
004. Subtitling
Objective
• Shorter cycle time
• Significant cost reduction
Achieved (Victoria Barlow, key user)
• I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do.
• It was super easy for me to tweak the words, the timings, placement,…
• Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips
back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius.
• Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to
manually check
Challenge
• Cut transcription into closed captions,
taking into account BBC style guide
Solution
• Full-featured subtitle editor
004. Use Case 4 – Localisation
Localisation is a different ball game
– Using Machine translation (not Automatic Speech
Recognition)
– Not intended for the hard of hearing
– Maintain consistent timing
Using Machine Translation
– Translating existing subtitles (the “Template”)
– Adding non-domestic subtitles at marginal cost
– Enabling producers and distributors to extend their reach
LIMECRAFT
connected creativity
Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission
© LIMECRAFT
connected creativity
Business Case - Subtitling and localisation
Subtitling and localisation
• Translation of scripts and subtitles
• Supports >100 languages
• Automatic Spotting
Key features
• Secure online service – no downloads required
• Configurable spotting rules
• Computer Assisted QC
Business Case
• Saves up to 80% of the cost due to manual work
• Reduces the turn around time
Free try available : www.limecraft.com
005. About Limecraft
LIMECRAFT
connected creativity
Limecraft: The Company
• Incorporated May 2010, privately owned
• Market – Film, Television and Corporate Video
• Solution – Cloud-based Workflow Automation and Media Asset Management
Video Production worldwide: growing market with compelling opportunities
• Industry under pressure to move towards full digital transformation
• Government regulations invoke change and investments (subtitling)
• Rise of VOD Platforms results in massive demand of more and faster
productions
Limecraft’s Value Proposition disrupting the current production process
• 80% savings in direct production costs
• Increased efficiency cuts 30% of the post-production cost
• Creating alternative versions (outputs) at marginal cost
About Limecraft
LIMECRAFT
connected creativity
Media
Asset Mgnt
Limecraft Flow : From File-based Production to a more Scalable Industrial Process
 In the cloud where possible, local where necessary
 Replace paper documents by browser-based(!) applications
 Interconnect pre-existing Asset Management and Storage Services
 Metadata processing reduces turn-around times
 Maximum collaboration and re-use of content
31.
LIMECRAFT
connected creativity
Post-Production MasteringProduction
Conventional video production involves a lot of
manual work and excessive file transfers. This is
hard to scale.
Due to the rise of VOD platforms, there’s a
increasing demand
• to process more material on the input side
• to create more versions on the output side
Limecraft Flow: AI assisted workflows to INDUSTRIALISE media production
MASTERINGCOST
OUTPUT VERSIONS
PRODUCTIONCOST
RAW MATERIAL
conventional
conventional
Limecraft
Limecraft
reduce the cost of material intake
(400$>80$ per shooting day)
online collaboration offloads
30% of the edit suite capacity
different versions at marginal cost
(15$ > 1$ per minute)
80% SAVINGS 30% EFFICIENCY X10 PRODUCTIVITY
Business Case – how Limecraft Flow addresses today’s Production Challenges

More Related Content

Similar to Practical Applications of AI in Media Production and Broadcast

Cloud-enabled Video Production
Cloud-enabled Video ProductionCloud-enabled Video Production
Cloud-enabled Video ProductionMaarten Verwaest
 
Unlock the Power of Machine Translation
Unlock the Power of Machine TranslationUnlock the Power of Machine Translation
Unlock the Power of Machine TranslationRDC
 
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)Vizualsite LLC
 
4D Pubs - Distributed Dynamic Document Dsplay
4D Pubs - Distributed Dynamic Document Dsplay4D Pubs - Distributed Dynamic Document Dsplay
4D Pubs - Distributed Dynamic Document DsplayChris Despopoulos
 
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday SeasonG3 Communications
 
Content Strategy at Symantec (STC 2009)
Content Strategy at Symantec (STC 2009)Content Strategy at Symantec (STC 2009)
Content Strategy at Symantec (STC 2009)Tristan Bishop
 
LIVO Presentation by ENO
LIVO Presentation by ENOLIVO Presentation by ENO
LIVO Presentation by ENOTamer Taşdelen
 
From vagrant to production - Mark Eijsermans
From vagrant to production - Mark EijsermansFrom vagrant to production - Mark Eijsermans
From vagrant to production - Mark EijsermansDevopsdays
 
Tw Technology Radar Qtb Sep11
Tw Technology Radar Qtb Sep11Tw Technology Radar Qtb Sep11
Tw Technology Radar Qtb Sep11Adrian Treacy
 
HTML 5 & The Modern Web
HTML 5 & The Modern WebHTML 5 & The Modern Web
HTML 5 & The Modern WebJumping Bean
 
Sergata Ltd. - Innovative Software Development
Sergata Ltd. - Innovative Software DevelopmentSergata Ltd. - Innovative Software Development
Sergata Ltd. - Innovative Software DevelopmentTsvika Kleinman
 
Zero to ten million daily users in four weeks: sustainable speed is king
Zero to ten million daily users in four weeks: sustainable speed is kingZero to ten million daily users in four weeks: sustainable speed is king
Zero to ten million daily users in four weeks: sustainable speed is kingplumbee
 
Designing Learning #eldc2011
Designing Learning #eldc2011Designing Learning #eldc2011
Designing Learning #eldc2011Nick Floro
 
SIP/WebRTC load testing @ KamailioWorld 2017
SIP/WebRTC load testing @ KamailioWorld 2017SIP/WebRTC load testing @ KamailioWorld 2017
SIP/WebRTC load testing @ KamailioWorld 2017Lorenzo Miniero
 
6 GigaSpaces Principles to Survive Black Friday
6 GigaSpaces Principles to Survive Black Friday6 GigaSpaces Principles to Survive Black Friday
6 GigaSpaces Principles to Survive Black FridayAli Hodroj
 
DevOpsCon 2015 - DevOps in Mobile Games
DevOpsCon 2015 - DevOps in Mobile GamesDevOpsCon 2015 - DevOps in Mobile Games
DevOpsCon 2015 - DevOps in Mobile GamesAndreas Katzig
 
Gears: Hipster as a Service
Gears: Hipster as a ServiceGears: Hipster as a Service
Gears: Hipster as a ServiceIn The Pocket
 
Cerebro general overiew eng
Cerebro general overiew engCerebro general overiew eng
Cerebro general overiew engCineSoft
 

Similar to Practical Applications of AI in Media Production and Broadcast (20)

Cloud-enabled Video Production
Cloud-enabled Video ProductionCloud-enabled Video Production
Cloud-enabled Video Production
 
Unlock the Power of Machine Translation
Unlock the Power of Machine TranslationUnlock the Power of Machine Translation
Unlock the Power of Machine Translation
 
CGM versus SVG
CGM versus SVGCGM versus SVG
CGM versus SVG
 
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)
CGM (Computer Graphics Metafile) v SVG (Scalable Vector Graphic)
 
4D Pubs - Distributed Dynamic Document Dsplay
4D Pubs - Distributed Dynamic Document Dsplay4D Pubs - Distributed Dynamic Document Dsplay
4D Pubs - Distributed Dynamic Document Dsplay
 
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
5 Steps To Deliver The Fastest Mobile Shopping Experience This Holiday Season
 
Content Strategy at Symantec (STC 2009)
Content Strategy at Symantec (STC 2009)Content Strategy at Symantec (STC 2009)
Content Strategy at Symantec (STC 2009)
 
LIVO Presentation by ENO
LIVO Presentation by ENOLIVO Presentation by ENO
LIVO Presentation by ENO
 
From vagrant to production - Mark Eijsermans
From vagrant to production - Mark EijsermansFrom vagrant to production - Mark Eijsermans
From vagrant to production - Mark Eijsermans
 
Tw Technology Radar Qtb Sep11
Tw Technology Radar Qtb Sep11Tw Technology Radar Qtb Sep11
Tw Technology Radar Qtb Sep11
 
HTML 5 & The Modern Web
HTML 5 & The Modern WebHTML 5 & The Modern Web
HTML 5 & The Modern Web
 
Sergata Ltd. - Innovative Software Development
Sergata Ltd. - Innovative Software DevelopmentSergata Ltd. - Innovative Software Development
Sergata Ltd. - Innovative Software Development
 
Zero to ten million daily users in four weeks: sustainable speed is king
Zero to ten million daily users in four weeks: sustainable speed is kingZero to ten million daily users in four weeks: sustainable speed is king
Zero to ten million daily users in four weeks: sustainable speed is king
 
Automic Support Tips and Tricks
Automic Support Tips and TricksAutomic Support Tips and Tricks
Automic Support Tips and Tricks
 
Designing Learning #eldc2011
Designing Learning #eldc2011Designing Learning #eldc2011
Designing Learning #eldc2011
 
SIP/WebRTC load testing @ KamailioWorld 2017
SIP/WebRTC load testing @ KamailioWorld 2017SIP/WebRTC load testing @ KamailioWorld 2017
SIP/WebRTC load testing @ KamailioWorld 2017
 
6 GigaSpaces Principles to Survive Black Friday
6 GigaSpaces Principles to Survive Black Friday6 GigaSpaces Principles to Survive Black Friday
6 GigaSpaces Principles to Survive Black Friday
 
DevOpsCon 2015 - DevOps in Mobile Games
DevOpsCon 2015 - DevOps in Mobile GamesDevOpsCon 2015 - DevOps in Mobile Games
DevOpsCon 2015 - DevOps in Mobile Games
 
Gears: Hipster as a Service
Gears: Hipster as a ServiceGears: Hipster as a Service
Gears: Hipster as a Service
 
Cerebro general overiew eng
Cerebro general overiew engCerebro general overiew eng
Cerebro general overiew eng
 

More from Maarten Verwaest

Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...
Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...
Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...Maarten Verwaest
 
Future Media Production - on embedded metadata and semantic technologies
Future Media Production - on embedded metadata and semantic technologiesFuture Media Production - on embedded metadata and semantic technologies
Future Media Production - on embedded metadata and semantic technologiesMaarten Verwaest
 
From file-based production to real-time co-production
From file-based production to real-time co-productionFrom file-based production to real-time co-production
From file-based production to real-time co-productionMaarten Verwaest
 
Limecraft - Semantic Integration Platform
Limecraft - Semantic Integration PlatformLimecraft - Semantic Integration Platform
Limecraft - Semantic Integration PlatformMaarten Verwaest
 
Tablets and Television - How tablet PC's will impact the Nature of Television...
Tablets and Television - How tablet PC's will impact the Nature of Television...Tablets and Television - How tablet PC's will impact the Nature of Television...
Tablets and Television - How tablet PC's will impact the Nature of Television...Maarten Verwaest
 
Tape-less Workflow Applcation Architecture
Tape-less Workflow Applcation ArchitectureTape-less Workflow Applcation Architecture
Tape-less Workflow Applcation ArchitectureMaarten Verwaest
 
Digital Media Production - Future Internet
Digital Media Production - Future InternetDigital Media Production - Future Internet
Digital Media Production - Future InternetMaarten Verwaest
 
Presentation of Mediamap @Ebu Production Technology Seminar
Presentation of Mediamap @Ebu Production Technology SeminarPresentation of Mediamap @Ebu Production Technology Seminar
Presentation of Mediamap @Ebu Production Technology SeminarMaarten Verwaest
 
Presentation of Scoop @Ebu Production Technology Seminar
Presentation of Scoop @Ebu Production Technology SeminarPresentation of Scoop @Ebu Production Technology Seminar
Presentation of Scoop @Ebu Production Technology SeminarMaarten Verwaest
 
Workshop Digital Radio (03/27/2009)
Workshop Digital Radio (03/27/2009)Workshop Digital Radio (03/27/2009)
Workshop Digital Radio (03/27/2009)Maarten Verwaest
 

More from Maarten Verwaest (14)

Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...
Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...
Transcription Tutorial - Using Limecraft to accurately Transcribe Audio in Mi...
 
Future Media Production - on embedded metadata and semantic technologies
Future Media Production - on embedded metadata and semantic technologiesFuture Media Production - on embedded metadata and semantic technologies
Future Media Production - on embedded metadata and semantic technologies
 
From file-based production to real-time co-production
From file-based production to real-time co-productionFrom file-based production to real-time co-production
From file-based production to real-time co-production
 
Limecraft - Semantic Integration Platform
Limecraft - Semantic Integration PlatformLimecraft - Semantic Integration Platform
Limecraft - Semantic Integration Platform
 
Tablets and Television - How tablet PC's will impact the Nature of Television...
Tablets and Television - How tablet PC's will impact the Nature of Television...Tablets and Television - How tablet PC's will impact the Nature of Television...
Tablets and Television - How tablet PC's will impact the Nature of Television...
 
DMS-1, a Semantic View
DMS-1, a Semantic ViewDMS-1, a Semantic View
DMS-1, a Semantic View
 
Tape-less Workflow Applcation Architecture
Tape-less Workflow Applcation ArchitectureTape-less Workflow Applcation Architecture
Tape-less Workflow Applcation Architecture
 
Digital Media Production - Future Internet
Digital Media Production - Future InternetDigital Media Production - Future Internet
Digital Media Production - Future Internet
 
Presentation of Mediamap @Ebu Production Technology Seminar
Presentation of Mediamap @Ebu Production Technology SeminarPresentation of Mediamap @Ebu Production Technology Seminar
Presentation of Mediamap @Ebu Production Technology Seminar
 
Presentation of Scoop @Ebu Production Technology Seminar
Presentation of Scoop @Ebu Production Technology SeminarPresentation of Scoop @Ebu Production Technology Seminar
Presentation of Scoop @Ebu Production Technology Seminar
 
Digital Media Production
Digital Media ProductionDigital Media Production
Digital Media Production
 
Digital Media Production
Digital Media ProductionDigital Media Production
Digital Media Production
 
Ultimate Radio@Medianet
Ultimate Radio@MedianetUltimate Radio@Medianet
Ultimate Radio@Medianet
 
Workshop Digital Radio (03/27/2009)
Workshop Digital Radio (03/27/2009)Workshop Digital Radio (03/27/2009)
Workshop Digital Radio (03/27/2009)
 

Recently uploaded

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfngoud9212
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 

Recently uploaded (20)

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdf
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 

Practical Applications of AI in Media Production and Broadcast

  • 1. © LIMECRAFT connected creativity Practical Applications of AI in Media Production and Broadcast (Contact : info@limecraft.com)
  • 2. LIMECRAFT connected creativity Copyright 2016 Limecraft , NV. Confidential – Distribution prohibited without permission • Intro and Solution Overview • Use Case 1 – Scripted and Unscripted Entertainment • computer assisted logging, transcript-based edit, transfer to edit • Key Feature: Automated processing of raw material, computer assisted logging • Use Case 2 – Transcription and Archiving • computer assisted logging, transcript-based edit, transfer to edit • Key feature: AI (ASR, NER, deep captioning) • Use Case 3 – Closed Captions • same-language subtitling for accessibility purposes • Key feature: automatic “spotting” • Use Case 4 – Localisation • Translated subtitles for localization of content • Key feature: machine translation and timecode management • About Limecraft• A Agenda
  • 3. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission 000. Introduction and Solution Overview
  • 4. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity 001. | State of the Art State of the Art • Manual transcription and “annotation” • Unstructured ”meta” information • Limited collaboration potential Traditional methods don’t scale • Increasing volumes of raw material • Increasing post-production cost • Several output versions versions
  • 5. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity COR E Editing (Avid Media Composer/Adobe Premiere/ Apple FC) Transcoding/EDL Processing/Machine Transcription/Machine Translation/… On Premise Media Asset Management System Customer or Cloud infrastructure Logging (Flow) Ingest (Edge) Subtitling (Flow) Editing Gateway (Edge) Shoot (ARRI, Sony, RED, Panasonic, Canon) Transcription (Limecraft ‘Transcriber’) Existing Application Landscape Limecraft Platform Value Added3rd Partyapps On Premise Media Asset Management System Customer or Cloud infrastructure Cloud Connector 3rd party Cloud infrastructure 000. Limecraft Platform
  • 6. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Limecraft Flow is a cloud-based Asset Management and Workflow Automation platform Key Features • Cloud-based • White labeled • Turn-key integration with any existing storage, tape and MAM solutions • Flexibly Customisable Workflows • API to access individual micro- services Using AI for automation • Production: automate logging • Post-production: computer assisted edit • Mastering: subtitling and localisation Key Benefits to end user • No loss of material or redundant
  • 7. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity How can we take advantage of Artificial Intelligence (AI)? – Which data? – How to handle inaccuracy? – What’s the benefit for production?
  • 8. 001. Use Case 1 – Ingest and Transfer to Edit
  • 9. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity Limecraft automatically processes dailies overnight. Using speech-to-text, shots are automatically cut into scenes. Key Features • 1000 files per day automatically tagged • Overall version control • Local storage, online collaboration Key Benefits • No loss of material or redundant copies • Faster access for review and pre-cut • Reduction of the turn around time
  • 10. © LIMECRAFT connected creativity Limecraft “Edge” for on site processing • Local Client for offload, dailies encoding • Play-out of native formats • Automated audio sync and colour grading • Checksum verification after each transfer • Transfer to Edit platform/PAM/MAM Key benefits • Ease of use – a single tool for offload, encoding of proxies and ingest • Multiple parallel transfers in a single operation • Maximum protection against errors 001. Edge
  • 11. LIMECRAFT connected creativity Copyright 2019 Limecraft , NV. Confidential – Distribution prohibited without permission Raw Footage on Offline storage Limecraft Cloud Connector Edge Client Limecraft Flow Headquarters 001. More complex Avid Integration
  • 12. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Case Study: ‘Un si grand soleil’ by France Télévisions Format • Daily soap • Shot in Montpellier, cut in Paris • 3 studios, Multi-cam, VFX on set Challenges • 8 files per “shot”, up to 1000 files per day • High post-production rythm: 1 episode per day • Deliver the master data to enable interactive output Solution • Integrate script and breakdown • Automated transfer back and forth Avid Interplay, grading, VFX, Sound • Delivers timed subtitles and master data without manual post processing More info : https://www.limecraft.com/2020/02/16/case-study-the-sun-chronicles/
  • 13. 002. Use Case 2 – Transcription and Archiving
  • 14. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission ASR automatically turns audio into timed text in 122 languages. Using complementary NLP and NER, we can automatically tag and categorize content fragments. Use Cases • Machine transcription • Manual post-editing for 100% accuracy • Auto-tagging • Ease of searching • Text-based pre-cut (paper-edit)
  • 15. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity
  • 16. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission LIMECRAFT connected creativity 19.2 | Product Update: Named Entity Recognition
  • 17. Centralized and structured transcription and logging of material -> Faster cataloguing, better search and retrieval, offline edit – Supervised or unsupervised Machine transcription (ASR) and Named Entity Recognigion – Manual Post-editing of the Transcript • Correct segmentation and interpunction • Correct recognition errors – Search and Selection • Every word is time-coded • Pick specific parts or subclips to an order or shopping basket – Hand-over to Edit Workstation or Archive • Compatible with Avid MC, Avid Interplay, Adobe Premiere
  • 18. 003. Use Case 3 – Subtitling
  • 19. Automatic creation of subtitles – Machine transcription – Spotting rules – Delivered in a variety of formats, including EBU-TT-D, SRT, STL, etc. Key benefits – 50% cost saving compared to manual subtitling – Producers and distributors can create subtitles themselves – Retain the rights of the subtitles
  • 20. LIMECRAFT connected creativity 003. Subtitling Objective • Shorter cycle time • Significant cost reduction Findings (Victoria Barlow, key user) • I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do. • It was super easy for me to tweak the words, the timings, placement,… • Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius. • Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to manually check Challenge • Cut transcription into closed captions, taking into account BBC style guide Solution • Full-featured subtitle editor
  • 23. 1. Auto-transcription of logging forms the basis for the next step: assistance of localized subtitling • Together with BBC we’ve been working on providing subtitling workflows to end users – Journalists, content producers who typically have no easy direct access or budget to subtitling
  • 24. LIMECRAFT connected creativity 004. Subtitling Objective • Shorter cycle time • Significant cost reduction Achieved (Victoria Barlow, key user) • I never even read the instructions. So I just went straight in and it was easy to figure out what I needed to do. • It was super easy for me to tweak the words, the timings, placement,… • Small things, which could be easily overlooked, like when I tweaked some words then hit play, the video automatically skips back a couple of seconds so I hear and see what I did, without having to scroll back myself – genius. • Having he warnings pop up when my subtitle chunks were too long is a really nice learning tool, and saves me having to manually check Challenge • Cut transcription into closed captions, taking into account BBC style guide Solution • Full-featured subtitle editor
  • 25. 004. Use Case 4 – Localisation
  • 26. Localisation is a different ball game – Using Machine translation (not Automatic Speech Recognition) – Not intended for the hard of hearing – Maintain consistent timing Using Machine Translation – Translating existing subtitles (the “Template”) – Adding non-domestic subtitles at marginal cost – Enabling producers and distributors to extend their reach
  • 28. Copyright 2018 Limecraft , NV. Confidential – Distribution prohibited without permission © LIMECRAFT connected creativity Business Case - Subtitling and localisation Subtitling and localisation • Translation of scripts and subtitles • Supports >100 languages • Automatic Spotting Key features • Secure online service – no downloads required • Configurable spotting rules • Computer Assisted QC Business Case • Saves up to 80% of the cost due to manual work • Reduces the turn around time Free try available : www.limecraft.com
  • 30. LIMECRAFT connected creativity Limecraft: The Company • Incorporated May 2010, privately owned • Market – Film, Television and Corporate Video • Solution – Cloud-based Workflow Automation and Media Asset Management Video Production worldwide: growing market with compelling opportunities • Industry under pressure to move towards full digital transformation • Government regulations invoke change and investments (subtitling) • Rise of VOD Platforms results in massive demand of more and faster productions Limecraft’s Value Proposition disrupting the current production process • 80% savings in direct production costs • Increased efficiency cuts 30% of the post-production cost • Creating alternative versions (outputs) at marginal cost About Limecraft
  • 31. LIMECRAFT connected creativity Media Asset Mgnt Limecraft Flow : From File-based Production to a more Scalable Industrial Process  In the cloud where possible, local where necessary  Replace paper documents by browser-based(!) applications  Interconnect pre-existing Asset Management and Storage Services  Metadata processing reduces turn-around times  Maximum collaboration and re-use of content 31.
  • 32. LIMECRAFT connected creativity Post-Production MasteringProduction Conventional video production involves a lot of manual work and excessive file transfers. This is hard to scale. Due to the rise of VOD platforms, there’s a increasing demand • to process more material on the input side • to create more versions on the output side Limecraft Flow: AI assisted workflows to INDUSTRIALISE media production MASTERINGCOST OUTPUT VERSIONS PRODUCTIONCOST RAW MATERIAL conventional conventional Limecraft Limecraft reduce the cost of material intake (400$>80$ per shooting day) online collaboration offloads 30% of the edit suite capacity different versions at marginal cost (15$ > 1$ per minute) 80% SAVINGS 30% EFFICIENCY X10 PRODUCTIVITY Business Case – how Limecraft Flow addresses today’s Production Challenges

Editor's Notes

  1.  Skip to demo and mention this as walking through the demo!