Opened Captions

589 views

Published on

A presentation explaining the motivation behind Opened Captions, along with a few goals and planned visions.

Published in: Technology
1 Comment
1 Like
Statistics
Notes
  • To learn more about Opened Captions:

    The Code: https://github.com/slifty/opened-captions
    The Post: slifty.com/2012/10/introducing-opened-captions/
    The Video: https://vimeo.com/52178097
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
589
On SlideShare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
8
Comments
1
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • I’m actually only halfway through my fellowship, so I’ll just share a recent project called Opened Captions. This makes it really easy to build experiences around live TV by creating a hackable Closed Captioning stream. Your code knows every time a word is spoken.\n
  • I’m actually only halfway through my fellowship, so I’ll just share a recent project called Opened Captions. This makes it really easy to build experiences around live TV by creating a hackable Closed Captioning stream. Your code knows every time a word is spoken.\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Now you can create pages that react based on what’s being said on TV. Alving Chang built this quick hack using Opened Captions, called CardText, which augmented the presidential debates by showing extra information about people, places, and issues as they were being discussed on screen.\n
  • \n
  • \n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • \n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • I won’t get too geeky here, but every Opened Captions instance actually re-broadcasts its caption stream so that other servers can build from it. For instance maybe you want to translate it to another language.\n
  • \n
  • Opened Captions

    1. 1. OPENED CAPTIONSReal-time distributed closed captioning syndication Dan Schultz @slifty
    2. 2. But First...
    3. 3. My professional life in 30 seconds2005 2006 2007 2008 2009 2010 2011 2012 2013 Carnegie Mellon Information Systems
    4. 4. My professional life in 30 seconds2005 2006 2007 2008 2009 2010 2011 2012 2013 Carnegie Mellon Philly ColorQuick Speaker Text PBS
    5. 5. My professional life in 30 seconds2005 2006 2007 2008 2009 2010 2011 2012 2013 Carnegie Mellon Philly MIT Information Ecology Civic Media
    6. 6. My professional life in 30 seconds2005 2006 2007 2008 2009 2010 2011 2012 2013 Carnegie Mellon Philly MIT OpenNews The Boston Globe
    7. 7. Knight-Mozilla OpenNews isabout building an ecosystemto help journalism thrive onthe open web.mozillaopennews.org
    8. 8. Back to Opened Captions!
    9. 9. The Problem: Writing applications based on what’s happening on TV is damn near impossible.
    10. 10. http://www.guardian.co.uk/world/interactive/2012/nov/06/america-elect-graphic-novel
    11. 11. Step 1: Extract
    12. 12. OCR Audio Analysis Speech to Text Closed CaptioningVideo Analysis Face Recognition Fingerprinting
    13. 13. OCR Audio Analysis Speech to Text Closed CaptioningVideo Analysis Face Recognition Fingerprinting
    14. 14. Line 21 Decoding
    15. 15. Step 2: Distribute
    16. 16. Information FlowVideo Feed
    17. 17. Information Flow ExtractVideo Feed Opened Captions Server
    18. 18. Information Flow Distribute Extract Opened Captions ClientsVideo Feed Opened Captions Server
    19. 19. TRADITIONAL WEB INTERACTIONS Request Response
    20. 20. FOR INSTANCE.... Client Says Server RespondsShow me the front page of the NY Times Sure thing, enjoy reading glorious journalism!” Do I have any new emails? Here are your 423 new emails you popular netizenI DEMAND ANIMATED GIFS You got it, boss, I proudly present Obama slicing a salami with his hands
    21. 21. HOW WOULD YOU SAY... Let me know when... This is awkward. Keep me updated with... I was kind of thinking our relationship would be a “one time” deal. Push me a notice if...
    22. 22. POLLING The Younger Sibling ApproachDo you have any new tweets? How bout now? What about now? I don’t know if you knew this, but I’m looking for new tweets I’m betting there are some now. New tweets? You’ll never guess what I’m about to ask for. Holy crap. I’m gonna go shut down now. It’s been like 10 seconds you have to have some by now.
    23. 23. WEBSOCKETS Handshake Messages
    24. 24. Iteration 1: Hackable Easy to set up Easy to code against Easy to modify Iteration 2: Robust Reliable Scalable Iteration 3: Powerful Multiple Channels Metadata
    25. 25. Easy to Set Up
    26. 26. Easy to Code Against
    27. 27. Easy to Modify
    28. 28. Content ForkingVideo Feed
    29. 29. Content ForkingVideo Feed Opened Captions Server
    30. 30. Content Forking ClientsVideo Feed Opened Captions Server
    31. 31. Content Forking ClientsVideo Feed Opened Captions Server Content Fork
    32. 32. Content Forking ClientsVideo Feed Opened Captions Server Content Fork Clients
    33. 33. Content Forking English-speaking clientsVideo Feed Opened Captions Server Content Fork (Spanish Translation Mod) Spanish-speaking clients
    34. 34. Scalable
    35. 35. The Current Setup
    36. 36. The Current SetupVideo Feed (C-SPAN)
    37. 37. The Current Setup Globe Lab ComputerVideo Feed (The Boston Globe) (C-SPAN)
    38. 38. The Current Setup Globe Lab ComputerVideo Feed (The Boston Globe) Opened Captions Server (C-SPAN) (MIT)
    39. 39. The Current Setup Globe Lab ComputerVideo Feed (The Boston Globe) Opened Captions Server (C-SPAN) (MIT) Demo Clients
    40. 40. The Current Setup Globe Lab ComputerVideo Feed (The Boston Globe) Opened Captions Server (C-SPAN) (MIT) Content Forks Demo Clients
    41. 41. The Vision
    42. 42. The VisionVideo Feeds
    43. 43. The Vision Opened Captions Receiver (AWS)Video Feeds
    44. 44. The Vision Opened Captions Receiver (AWS)Video Feeds Relays (AWS)
    45. 45. The Vision Load Balancer (AWS) Opened Captions Receiver (AWS)Video Feeds Relays (AWS)
    46. 46. The Vision Load Balancer (AWS) Opened Captions Receiver (AWS)Video Feeds Relays (AWS) Clients and Content Forks
    47. 47. The Vision Load Balancer (AWS) Opened Captions Receiver (AWS)Video Feeds Relays (AWS) Clients and Content Forks
    48. 48. Dan Schultz @slifty

    ×