Live Automatic Captioning Workshop

Live Auto Captioning
with 3Play Media
✋ Type questions in the Q&A window during the presentation
⏺ This webinar is being recorded & will be available for replay
💬 This webinar is live captioned
📱 www.3playmedia.com l @3playmedia l #a11y
John Slocum
3Play Media

On today’s agenda...
What is 3Play’s Live Auto Captioning solution? 🔬
How to add 3Play auto captions to live streams 💬
How it works 🔧
Accessibility laws & compliance ⚖
How captions benefit all users 👍
Quality of live auto captions 💯
Post-event video accessibility tips 🖥
Q&A

What is 3Play’s Live Auto
Captioning Solution?

3Play’s Live Auto Captioning
In real time
For live events like
webinars or meetings
Automatic
Best in class automatic
speech recognition (ASR)
technology
Integrations
Top live streaming
video and meeting
platforms
Wordlists
Glossary of terms to
improve visual accuracy
of the ASR
Upgrade Paths
Ensure a fully compliant,
99%+ accurate caption
file on the recording
Scheduling
Interface
Schedule upcoming
events & track past events

Poll: What do you want learn about
captioning live events?

So, how do I add 3Play
auto captions to my live
stream?

How it Works
Create a live event
Create a live event in any of our integrated live stream video platforms: Zoom,
YouTube, Brightcove, JW Player, Facebook, OR for any* standard RTMP/RTSP
stream.
Schedule 3Play auto captions
In the 3Play account system, schedule auto captions for your corresponding
live event.
Submit a Wordlist
Submit a glossary of terms, phrases, or acronyms to improve the visual
accuracy of the ASR on those words.
Start Streaming
Your captions will post back directly to your live stream.
Upgrade your Live Transcript
Access the live transcript immediately post-event for editing, downloading, or
upgrading to our full transcription service with human editing and review.

How it REALLY Works...
Behind the scenes...
For Zoom Meetings and Webinars...
ZOOM
CAPTIONS
GUESTS
HOST
3PLAY RT
ASR
WOWZA

For JW Player or any* standard RTMP/RTSP stream...
ENCODER PLATFORM PLAYER
CAPTIONS
EMBED
www.eventpage.com
RTM/SP
3PLAY RT
ASR
RTMP/RTSP
RTM/SP

For Brightcove...
ENCODER PLATFORM PLAYER
3PLAY RT
ASR
CAPTIONS
EMBED
www.eventpage.com
WOWZA

For Youtube...
ENCODER
3PLAY RT
ASR
WOWZA
YT LIVE
CAPTIONS

For Facebook - coming in June
ENCODER
3PLAY RT
ASR
WOWZA
FB LIVE
CAPTIONS
EMBED
www.eventpage.com
CAPTIONS

Why should you caption
live streams?

41% of videos are incomprehensible
without sound or captions.

Captions improve brand recall, verbal
memory, and behavioral intent.

Video accessibility also benefits students
98.6%
Of students find
captions helpful
65%
Of students use
captions to help
them focus
75%
Of students that
use captions said
they use them as
a learning aid

Poll: Why are you interested in live
captioning your events?

Laws Around
Live Captioning
Rehabilitation Act
Section 508
Americans with
Disabilities Act
Not a written requirement
WCAG
Live captions are a WCAG
2.0/2.1 AA guideline
FCC
Live captioning is required by
the FCC

Caption Quality
Matters
90%+ accurate
Ranges depending on ‘live’
environment
Latency
Live captions typically appear with a
slight latency between the spoken
words and the captioned output
No governing body for
live captioning

Best Practices for Live Captioning
Strong Network
Connection
Good Quality
Audio
Little to No
Background
Noise
No overlapping
speech
Clear Speech and
Pronunciation

Poll: What are you typically doing with
your live recordings post-event?

What should you do
post-event?

DIY
Your live transcript is available in
the 3Play account system
immediately after your event.
From there, you can edit the
transcript yourself, and download
in the appropriate caption format.
Upgrade in 3Play
Upgrade your live transcript to
3Play’s full transcription service
with human editing and human
review.
Upgrading ensures a fully
accessible, and compliant solution
with 99%+ accuracy.
Publish recorded
ASR?

Questions about Live? Contact us!
livecaptioning@3playmedia.com
Support Documentation to Get Started:
https://support.3playmedia.com/hc/en-us/categories/360001804494-Live-Auto-Captioning
Learn More on the Website:
https://www.3playmedia.com/solutions/services/liveautocaptioning/
Zoom How-To-Guide:
https://www.3playmedia.com/solutions/how-it-works/how-to-guides/zoom-live-auto-captions/
Youtube How-To-Guide
https://www.3playmedia.com/solutions/how-it-works/how-to-guides/youtube-live-auto-captio
ns/create-live-event/

✋ Type questions in the Q&A window during the presentation
⏺ This webinar is being recorded & will be available for replay
💬 This webinar is live captioned
📱 www.3playmedia.com l @3playmedia l #a11y
Georgia McGoldrick
Product Marketing | 3Play Media
Workshop:
Live Auto Captioning in Zoom

On today’s agenda...
Getting started with Zoom live captions ⚙
How to live caption Zoom meetings 📅
How to live caption Zoom webinars 🎙
Retrieving Captions after completion of a Zoom Event 🎞
Tips for live captioning 🎬
Benefits of captioning live events 👍
Q&A

Poll #1:
Are you currently using zoom?

Poll #2:
How are you using zoom?

Getting started with
Zoom live captions

Requirements to Get Started
Linked Zoom
Account
Paid, Pro Zoom account
linked to a 3Play project
Admin/Owner
privileges
Must be an admin or
owner in Zoom account
to link to 3Play
3Play Pro Account
Pro account with the Live
Auto Captioning module
turned ON

Zoom Integration Setup
1. Log into 3Play
2. Navigate to New Linked Account
3. Select Zoom
4. Sign in to Zoom and confirm to
authorize the installation of the 3Play
Media app within your Zoom account.
1 2
3 4

For Hosts (Meetings)
● Sign in to zoom and navigate to My
Account -> Settings -> In Meeting
(Advanced).
● Turn on “Allow live streaming the
meetings” and check “Custom Live
Streaming Service.” Then click Save.
Zoom Settings:
Meetings

For Hosts (Webinars)
● Sign in to zoom and navigate to My Account ->
Account Management -> Webinar Settings -> In
Webinar Settings ->Edit -> Allow Hosts to Live
Stream their Webinar.
● Make sure to also click “Custom Live Streaming
Service.” then click Save Changes.
Zoom Settings:
Webinars

For Participants (Meetings & Webinars)
● All hosts and participants must have the closed
captions button turned ON in order to set up or view
captions in Zoom events.
● This setting is turned on by default for all Zoom
users, and can also be found in My Account >
Settings > In Meeting (Advanced).
Zoom Settings:
All Participants

Discussion Topic:
How has COVID-19 changed your live
video needs in general?

How to Set Up Live Auto
Captions for Zoom
Meetings

Step 1: Schedule The Meeting Within the Zoom Web Client
● Login to zoom.us and schedule a meeting.
● Schedule the meeting for the right time, adding any other information and settings necessary.
○ Only the meeting ID will have an impact on the necessary steps to get live captions.
○ For example, there’s an additional step if “Personal Meeting ID” is selected rather than if
“Generate Automatically” is selected.

Step 2 (part one): Schedule the Live Auto Captioning
Event in 3Play
● Navigate to your 3Play Media account and click Live Auto Captioning in the top navigation bar.
● Under the Schedule New Event section on the right, select your Zoom integration.
● Click the dropdown menu and select the appropriate user.
● All of the scheduled meetings for that user will display. Check the box of the Zoom meeting that
needs Live Auto Captioning, enter a start time and date, and click Schedule.
● The time selected here will be the earliest that 3Play live auto captions can be used on this
meeting. It is best to schedule the 3Play captioning event 5 to 15 minutes before the scheduled
time of the Zoom meeting.

Step 2 (part two): Schedule the Live Auto Captioning
Event in 3Play
● If ‘Generate Automatically’ was the setting selected when setting up the Zoom Meeting in Step 1, you can skip to the
next slide.
○ After both the Zoom meeting and the 3Play Captioning event are scheduled, a Stream URL and a Stream Key
need to be added to the Zoom meeting in order to use live captions with a personal meeting ID.
○ The correct Stream URL and Stream Key can be found in the pending 3Play Live Auto Captioning Event.
● Next, navigate to the scheduled Zoom meeting in zoom.us. Navigate to My Account > Meetings and click on the
appropriate meeting.
● Navigate to the bottom of the meeting details and click Configure Live Stream Settings. Enter the Stream URL and
Stream Key into the window that appears.
● The Live streaming page URL is required by Zoom, but the value has no effect on the zoom meeting or the live captions.

Step 3: Starting the Zoom Meeting and Copying the API Token
● After both the Zoom meeting is scheduled and the 3Play captioning event is ready and the
time for the meeting has arrived, start the Zoom meeting.
● Once the Zoom meeting has begun, select the Closed Caption button.
● Click “Copy the API token“.

Step 4: Paste the Zoom API Token for the Zoom Meeting
into the 3Play Live Event
● You should now see this meeting under the Scheduled and In Progress Live Auto Captioning
Events section of the Live Auto Captioning page.
● Paste the API Token from Step 3 into the Zoom API Token field, then click Update.

Step 5: Begin Live Streaming the Meeting
● Return to your Zoom Meeting. On the bottom bar, click More > Live on Custom Live Streaming Service.
● This should be done at or shortly after the Live Event start time scheduled in 3Play.
● As a warning, going Live on Custom Live Streaming Service will open a web page to indicate that the meeting is in the
process of going live. The Zoom meeting will persist, and that window can be closed at any time after the meeting
has successfully gone live.
● Captions should now appear within 5-10 seconds.

Poll #3
Are you currently live captioning
zoom meetings or webinars?

Poll #4
How are you live captioning zoom
meetings or webinars?

How to Set Up Live Auto
Captions for Zoom
Webinars

Step 1: Schedule The Webinar Within the Zoom Web Client
● Login to zoom.us and schedule a webinar.
● Schedule the webinar for the right time, adding any other information and settings
necessary.

Step 2: Schedule the Live Auto Captioning
Event in 3Play
● Navigate to your 3Play Media account and click Live Auto Captioning in the top navigation bar.
● Under the Schedule New Event section on the right, select your Zoom integration.
● Click the dropdown menu and select the appropriate user.
● All of the scheduled webinars for that user will display. Check the box of the Zoom webinar that
needs Live Auto Captioning, enter a start time and date, and click Schedule.
● The time selected here will be the earliest that 3Play live auto captions can be used on this webinar.
It is best to schedule the 3Play captioning event 5 to 15 minutes before the scheduled time of the
Zoom webinar.

Step 3: Starting the Zoom Webinar and Copying the API Token
● After scheduling both the Zoom webinar and the 3Play Live Captioning Event, start the
webinar and click the CC Closed Caption button.
● Click “Copy the API token“.

Step 4: Paste the Zoom API Token for the Zoom Webinar
into the 3Play Live Event
● This webinar should appear under the Scheduled and In Progress Live Auto Captioning
Events section of the Live Auto Captioning page.
● Paste the API Token from Step 1 into the Caption Ingest URL field and click Update.

Step 5: Live Stream Webinar and Begin Captioning
● Once it’s time to begin the webinar, initialize the webinar in Zoom and once the client is
active, click More > Live on Custom Live Streaming Service.
● Important: You must do this at or shortly after the Live Event start time scheduled in 3Play. If
the event in 3Play is scheduled for 3:00 pm but you attempt to go live at 2:58 pm, the 3Play
live server will not be ready and the webinar will not be able to go live. Please wait until the
3Play Live captioning event start time to try again, and refer to the instructions in Step 2 of
this guide.

Step 6: Enter Live Stream Credentials When Prompted
● You will be prompted for a Stream URL and Stream Key, which can be found on your Live
Event Details page in your 3Play account. After going live, a web page will open up and ask
for these details, which can be found on the 3Play Live event in the 3Play account system.
For Live streaming page URL, enter 3playmedia.com or any website. This field is required by
zoom, but the value has no effect on the zoom webinar or the live captions.
● Captions should now appear within 5-10 seconds.

Poll #5
What do you do after your zoom
event ends?

Poll #6
If you caption zoom events, do you
retrieve captions after the event?

3 ways to retrieve a
caption file after a
meeting or webinar
Cloud Download from
Zoom
If a meeting or webinar was recorded
in the cloud, it will record to the host’s
device
From 3Play Media’s
account system
View, download, edit, or upgrade
the live auto captions to full
transcription
Local Download from
Zoom
If a meeting or webinar was recorded
locally, it will record to the host’s device

Local Download from Zoom
While scheduling a meeting or webinar, navigate to meeting/webinar options and record
the meeting/webinar automatically on the local computer.
After the conclusion of the meeting or webinar, a local download will be started that will
include an .mp4 of the meeting or webinar, an .m4a of the audio, a .txt of the chat text, a
.txt of the captions, and a .vtt of the captions.

Cloud Download from Zoom
While scheduling a meeting or webinar, navigate to meeting/webinar options and
record the meeting/webinar automatically in the cloud.
After the conclusion of the meeting, navigate to My Account > Recordings. Navigate to
the desired recording, and click the download button.

Download from 3Play’s
Account System
Once the Zoom events ends, navigate to the Live Auto Captioning page in the 3Play account
system, click previous Live Auto Captioning Events, then click view file.
From there, you can view the file, edit the transcript, download, or order more services on the
transcript.

Discussion Topic:
For those who are captioning, how has
your audience responded?

Best Practices for Live Captioning
Strong Network
Connection
Good Quality
Audio
Little to No
Background
Noise
Single Speaker
Clear Speech and
Pronunciation

Captions also benefit students
98.6%
Of students find
captions helpful
65%
Of students use
captions to help
them focus
75%
Of students that
use captions said
they use them as
a learning aid

Questions about Live? Contact us!
livecaptioning@3playmedia.com
Support Documentation to Get Started:
https://support.3playmedia.com/hc/en-us/categories/360001804494-Live-Auto-Captioning
Learn More on the Website:
https://www.3playmedia.com/solutions/services/liveautocaptioning/
Zoom How-To-Guide:
https://www.3playmedia.com/solutions/how-it-works/how-to-guides/zoom-live-auto-captions/

Live
Automatic
Captioning
www.3playmedia.com
@3playmedia

Agenda
● Why did 3Play build a live
captioning solution?
● What distinguishes 3Play from
other live (CART) solutions?
● Live event best practices
● Process: YouTube live
● Product demonstration
○ Upgrade to full 99% accurate
transcription post-event
● Q&A

I am Ryan Martinez
👨 Senior Implementation Specialist
✍ Design workﬂow solutions that
meet accessibility requirements
💻 I love working with customers!
I moved to CO for 3 years to chase
snow in the Rockies
Hello!

Why live? You’ve been talking and
we’ve been listening!
Over the past year, we focused on
building a “live” captioning solution
that suits your streaming needs. We
currently offer four out-of-the-box
options:
(coming soon)

Benefits:
Live > CART
1
H
igh
accuracy
In
an
idealrecording
environm
ent,in
w
hich
the
speakers
are
m
ic’d
up,
>80-90%
accuracy
is
entirely
attainable.
2
Inexpensive
vs.traditionalm
ethods
H
istorically,live
captions
require
hum
ans
to
physically
transcribe
contentand
hourly
rates
can
be
upw
ards
of$200
perhour.
3
Edits
&
upgrades
are
seam
less
The
3Play
accountsystem
m
akes
editing
yourraw
transcripts
easy
and
ifyou
need
99%
accuracy,the
upgrade
path
is
as
sim
ple
as
a
few
clicks.
4
Efﬁcient&
scalable
W
ith
bestin
class
A
SR
technology
and
custom
features,w
e’re
able
to
delivera
highly
efﬁcient,cost-effective
and
scalable
solution
forcaptioning
live
events
ofallsorts!

Live event best
practices
The demand for live online events has
increased substantially.
More than 67% of people globally have
streamed live video content and 47% say that
their consumption of live streaming has
increased in the past year.
As more people and organizations shift to
online platforms for live events, it’s important
to keep these best practices in mind in order
to achieve high-quality live captions.
❏ Strong network connection 💻
❏ Clear speech & pronunciation 💬
❏ High-quality audio 🎧
❏ Little to no background noise 🗣
❏ Single speaker, if possible 🎙
❏ Add wordlists ☑
❏ Upgrade to full transcription 💡

YouTube live solution
*In order to live caption YouTube
events, you’ll need an encoder that
accepts a RTMP URL/key, such as OBS.

Any questions?
Thank you for your time today! We’re happy you’re
interested in live captions and hope our tools can
help you meet your accessibility initiatives.
Please type questions in the Q&A menu in your
meeting controls. I’ll give you a minute before I
jump in and answer as many as I can.
Remember, 3Play’s ACCESS At Home is happening
all week! If you haven’t already, be sure to check
out some of the many upcoming sessions by
visiting 3playmedia.com/access/.

Live Auto
Captioning -
accuracy, wordlists,
and RTMP streams
Nick Moutis
www.3playmedia.com
@3playmedia

Agenda
● Brief overview of speech recognition
● What are wordlists?
● 3Play Live Auto Captioning event
scheduling walkthrough for RTMP streams

Who has used live
captions, or wants to
add them to their own
live events?
Question #1

Who has experienced
low-accuracy live
captions?
Question #2

Speech Recognition:
How does it work?
ASR ≅ acoustic modeling + language modeling
“I saw a van...”
“Eyes awe of an...”

Wordlists: What are they?
Wordlists allow you to inﬂuence what ASR
“expects to hear”
Lists of words!

Quick Example
“The I.R.S is responsible
for collecting taxes.”
“The iris is responsible
for collecting taxes.”

Wordlists: What to
include?
● Proper nouns
● Technical terms
● Multi-word phrases

Wordlists: What not to
include?
● Short words
● Multiple similar words

How does 3Play
incorporate wordlists?
● You can add a wordlist to any Live Auto
Captioning event
● 3Play may edit your wordlist to increase
accuracy

Walkthrough:
scheduling Live Auto
Captions in 3Play
● RTMP stream
● Event hosted on a webpage

Add captions embed to
your web page

At event time...
● Start your RTMP stream
● 3Play will start to caption your event

Live Automatic Captioning Workshop

More Related Content

What's hot

Similar to Live Automatic Captioning Workshop

More from 3Play Media

Recently uploaded

Live Automatic Captioning Workshop