The User Experience of
Captions
How Automation Can Save Time, Money
and Improve the Quality of Captions
Sam Cartsos & Sara...
Live captions provided through:


www.recapd.com

2	
  
The User Experience of
Captions
How Automation Can Save Time, Money
and Improve the Quality of Captions
Sam Cartsos & Sara...
Captioning

4	
  
User Experience	
The	
  Users	
  of	
  “User	
  
Experience”	
  
	
  
UX	
  of	
  Cap5ons	
  for	
  Online	
  
Video	
  
	...
No captions at all are
the WORST captions

6	
  
Quality	
  Transcrip%on	
  vs.	
  	
  
Automated	
  Transcrip%on	
  

7	
  
Cap%ons	
  are	
  not	
  accurate	
  
	
  
Only	
  shows	
  one	
  leQer	
  
	
  
Timing	
  is	
  not	
  relevant	
  
	
  ...
Cap%on	
  segment	
  is	
  too	
  
long	
  to	
  read	
  and	
  digest	
  	
  

9	
  
Areas	
  that	
  Affect	
  Cap%on	
  Quality	
  &	
  UX	
  

10	
  
Transcrip%on	
  is	
  manual	
  
Especially	
  quality	
  transcripts	
  
	
  
	
  
	
  
• 

Convey	
  the	
  informa%on	
...
Accurately Timed
Captions appear as the words
are spoken
	
  
	
  
	
  
	
  
12	
  
Segmentation

Chunking text into manageable bits
Too	
  much	
  text	
  

14	
  
Characters	
  per	
  line	
  
	
  
Mul%ple	
  speakers	
  

	
  
	
  
	
  

15	
  
16	
  
17	
  
18	
  
19	
  
Propor%onality	
  

	
  
More	
  difficult	
  to	
  read	
  with	
  one	
  long	
  line	
  
of	
  text,	
  and	
  one	
  ver...
Repeated action with precision
Detail orientated
Leads to better quality
	
  
21	
  
Triangle	
  shaped	
  
cap%ons	
  are	
  easier	
  to	
  
read	
  
	
  

Centered	
  text	
  
	
  

BoQom	
  of	
  the	
  ...
Key Features of Quality Captions
Centered	
  text	
  
BoQom	
  of	
  the	
  screen	
  
Black	
  drop	
  shadow	
  	
  
Whi...
 

Automation	

Do	
  not	
  automate	
  transcrip%on	
  
	
  
Pre-­‐process	
  %ming	
  
	
  
Word	
  level	
  alignment	...
25	
  
Hand	
  s%tching	
  
takes	
  longer,	
  and	
  
has	
  greater	
  
frequency	
  of	
  
irregulari%es	
  
	
  

Sewing	
  ...
What works for one user
is not always what every
user wants
SyncWords allows users
to tailor caption outputs
fitting specifi...
Automation Allows for
Customization in Styling	
Text	
  color	
  
	
  
Characters	
  per	
  line	
  and	
  number	
  of	
 ...
Using Technology to Fine Tune Timing

Set	
  cap%ons	
  a	
  few	
  
milliseconds	
  before	
  
dialogue	
  begins	
  

He...
30	
  
 

Machine
Learning
Algorithms 



Alignment & Chunking


•  Deep Neural
Networks


•  Natural Language
Processing (NLP)

...
Contact	
  Us	
  
Sam	
  Cartsos	
  
Senior	
  Partner	
  
scartsos@frameweld.com	
  
@scartsos	
  

Sarah	
  Murphy	
  
D...
Frameweld	
  
	
  
	
  

www.frameweld.com	
  
718-­‐408-­‐9190	
  
info@frameweld.com	
  
Tweet	
  @frameweld	
  
33	
  
Thank	
  you!	
  
Upcoming SlideShare
Loading in …5
×

The User Experience of Captioning Webinar

1,031 views
842 views

Published on

The User Experience of Captioning - And How Automation Improves Caption Quality While Saving Time and Money

Sam Cartsos and Sarah Murphy, of Frameweld, discuss the elements of captioning that lead to highly usable captions and positive user experiences. They also discuss how those principles informed Frameweld's work on SyncWords, a caption automation platform, and how automation can drive improved caption quality.

Webinar originally aired Dec. 12, 2013 at 1pm EST.

www.syncwords.com
www.frameweld.com

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,031
On SlideShare
0
From Embeds
0
Number of Embeds
510
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The User Experience of Captioning Webinar

  1. 1. The User Experience of Captions How Automation Can Save Time, Money and Improve the Quality of Captions Sam Cartsos & Sarah Murphy
  2. 2. Live captions provided through:
 www.recapd.com 2  
  3. 3. The User Experience of Captions How Automation Can Save Time, Money and Improve the Quality of Captions Sam Cartsos & Sarah Murphy
  4. 4. Captioning 4  
  5. 5. User Experience The  Users  of  “User   Experience”     UX  of  Cap5ons  for  Online   Video               S%ll  and  Cap%on  From  Annie  Hall   5  
  6. 6. No captions at all are the WORST captions 6  
  7. 7. Quality  Transcrip%on  vs.     Automated  Transcrip%on   7  
  8. 8. Cap%ons  are  not  accurate     Only  shows  one  leQer     Timing  is  not  relevant     Report  on  the  State  of  Closed    Cap%oning  of  Internet  Protocol  Delivered   Video  Programming  via  Electronic  Filing,  May  16,  2013   8  
  9. 9. Cap%on  segment  is  too   long  to  read  and  digest     9  
  10. 10. Areas  that  Affect  Cap%on  Quality  &  UX   10  
  11. 11. Transcrip%on  is  manual   Especially  quality  transcripts         •  Convey  the  informa%on   within  the  media   •  Remove  unnecessary  words   that  add  cluQer  like  “ums”   •  Conform  to  exis%ng  cap%on   style  guides    
  12. 12. Accurately Timed Captions appear as the words are spoken         12  
  13. 13. Segmentation Chunking text into manageable bits
  14. 14. Too  much  text   14  
  15. 15. Characters  per  line     Mul%ple  speakers         15  
  16. 16. 16  
  17. 17. 17  
  18. 18. 18  
  19. 19. 19  
  20. 20. Propor%onality     More  difficult  to  read  with  one  long  line   of  text,  and  one  very  short   20  
  21. 21. Repeated action with precision Detail orientated Leads to better quality   21  
  22. 22. Triangle  shaped   cap%ons  are  easier  to   read     Centered  text     BoQom  of  the  screen     22  
  23. 23. Key Features of Quality Captions Centered  text   BoQom  of  the  screen   Black  drop  shadow     White  or  bright  text   Wide  font   23  
  24. 24.   Automation Do  not  automate  transcrip%on     Pre-­‐process  %ming     Word  level  alignment  of  media  to  transcript     Manage  cap%on  formaang  and  segmenta%on     Ability  to  edit  by  hand,  automa%on  processes   edits  and  %mes  on  the  fly     SyncWords  scores  cap%on  factors  and  segments   cap%ons  based  on  the  best  possible  output   24  
  25. 25. 25  
  26. 26. Hand  s%tching   takes  longer,  and   has  greater   frequency  of   irregulari%es     Sewing   machines  make   quick  work  of   the  same  job   26  
  27. 27. What works for one user is not always what every user wants SyncWords allows users to tailor caption outputs fitting specific needs   27  
  28. 28. Automation Allows for Customization in Styling Text  color     Characters  per  line  and  number  of  lines     Pop-­‐on  cap%ons     Time  shid  to  show  cap%ons  just  before  words   are  spoken                 28  
  29. 29. Using Technology to Fine Tune Timing Set  cap%ons  a  few   milliseconds  before   dialogue  begins   Hermione’s Time Turner from Harry Potter 29  
  30. 30. 30  
  31. 31.   Machine Learning Algorithms Alignment & Chunking •  Deep Neural Networks •  Natural Language Processing (NLP) 31  
  32. 32. Contact  Us   Sam  Cartsos   Senior  Partner   scartsos@frameweld.com   @scartsos   Sarah  Murphy   Director  of  Business  Development   sarah@frameweld.com   @fw_sarah   32  
  33. 33. Frameweld       www.frameweld.com   718-­‐408-­‐9190   info@frameweld.com   Tweet  @frameweld   33  
  34. 34. Thank  you!  

×