Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Multi-media Accessibility   Are we nearly there yet? <ul><ul><li>Nick Freear,  Web Developer </li></ul></ul><ul><ul><li>We...
I have a stammer <ul><ul><li>Ask me to repeat if you miss something.  </li></ul></ul><ul><li>  </li></ul><ul><ul><li>And p...
Agenda <ul><ul><li>What problems are we trying to solve? </li></ul></ul><ul><ul><li>Existing research and issues </li></ul...
Definitions <ul><ul><li>Captions  </li></ul></ul><ul><ul><ul><li>Also known as &quot;sub-titles&quot; in UK </li></ul></ul...
Definitions  (2) <ul><ul><li>Audio description </li></ul></ul><ul><ul><ul><li>Descriptions of the video inserted into spac...
Context <ul><li>&quot; Basic web accessibility is a known commodity now... </li></ul><ul><li>  </li></ul><ul><li>But nearl...
More context! ( Gratuitous logos ) iTunes U
Doesn’t YouTube do Captions? <ul><li>Yes, captions and annotations, since August 2008. However: </li></ul><ul><ul><li>Only...
What's the state of play? <ul><li>At the Open University: </li></ul><ul><ul><li>Course media is routinely transcribed (OU/...
Accessible Multimedia in E-Learning  (1) <ul><li>TILE Project: Adaptive Technology Resource Centre, University of Toronto ...
Mars Rover Mission Video <ul><li>Audio Descriptions provide an overview of the onscreen action, particularly that which is...
Accessible Multimedia in E-Learning  (2) <ul><li>EU4ALL Project.  UKOU, UNED, Atos Origin, York University (amongst many o...
Moodle video with Audio Description <ul><li>( http://eu4all.open.ac.uk/eu4all/mod/resource/view.php?id=75 ) </li></ul>
Other Accessible Multimedia Fun! <ul><li>Stretch Project (ATRC, University of Toronto)  http://stretch.atrc.utoronto.ca </...
Tools for Adding Captions and/or Audio Descriptions <ul><ul><li>CapScribe:  capscribe.snow.utoronto.ca </li></ul></ul><ul>...
How can we address the lack of captions & audio descriptions online? <ul><li>Multimedia Alternatives </li></ul><ul><li>the...
Big Principles <ul><li>Accessibility/usability  </li></ul><ul><li>Data portability/ content as a service/ connections </li...
Media player evaluation
dotSUB.com - transcribing
dotSUB.com    &quot;any video any language&quot; <ul><li>+ Transcription/ translation can be collaborative - Wiki-like </l...
Social production <ul><li>Wikipedia, Geocaching, Open street map, Project Gutenberg, Librivox, talking newspapers, open so...
View 'in-situ' - client-side (OLnet)
View 'in-situ' - server-side
Multi-layer web service <ul><li>Content-creator YOU </li></ul><ul><li>| </li></ul><ul><li><a  rel=”embed”  href=”http://yo...
A new player – uses oEmbed,  HTML / Javascript
YT player modified – user Javascript
Next Steps <ul><ul><li>Explore internal/ external funding </li></ul></ul><ul><ul><li>Conversations </li></ul></ul><ul><ul>...
We didn't have time for...
Flash 'wmode' is harmful <ul><li>wmode = 'window' (default) - OK. </li></ul><ul><li><object data=&quot;player.swf&quot;> <...
Next steps detail <ul><li>Roadmap: no money, no timescale! </li></ul><ul><li>Testing - <iframe>, screen readers, high cont...
Wordle - project  keywords
Upcoming SlideShare
Loading in …5
×

MALT Wiki Techshare 2009

2,919 views

Published on

A project for social-production of captions (sub-titles) and audio description to improve the accessibility of video and multimedia. Presentation at the RNIB Techshare 2009 conference, ExCeL London in September 2009.
http://maltwiki.org
Co-presented with Wendy Porch, also of the Open University.

Published in: Technology, Design
  • Be the first to comment

MALT Wiki Techshare 2009

  1. 1. Multi-media Accessibility Are we nearly there yet? <ul><ul><li>Nick Freear, Web Developer </li></ul></ul><ul><ul><li>Wendy Porch , Research Fellow </li></ul></ul><ul><ul><li>Institute of Educational Technology, The Open University </li></ul></ul><ul><ul><li>Techshare 2009 </li></ul></ul>
  2. 2. I have a stammer <ul><ul><li>Ask me to repeat if you miss something. </li></ul></ul><ul><li>  </li></ul><ul><ul><li>And please ask questions! </li></ul></ul>stammering.org
  3. 3. Agenda <ul><ul><li>What problems are we trying to solve? </li></ul></ul><ul><ul><li>Existing research and issues </li></ul></ul><ul><ul><li>How can we solve the existing problems? </li></ul></ul><ul><ul><li>Outline of project proposal </li></ul></ul><ul><ul><li>Key project principles </li></ul></ul><ul><ul><li>Some initial evaluations </li></ul></ul><ul><ul><li>Examples/demonstrations </li></ul></ul><ul><ul><li>Round-up, next steps & discussion </li></ul></ul>
  4. 4. Definitions <ul><ul><li>Captions </li></ul></ul><ul><ul><ul><li>Also known as &quot;sub-titles&quot; in UK </li></ul></ul></ul><ul><ul><ul><li>Text synchronised with video, timed text </li></ul></ul></ul><ul><ul><ul><li>Prefer styling to indicate speaker - position, colour </li></ul></ul></ul><ul><ul><ul><li>For deaf/hard of hearing </li></ul></ul></ul><ul><ul><li>Closed captions </li></ul></ul><ul><ul><ul><li>&quot;Captioning you have to turn on&quot;, broadcast </li></ul></ul></ul><ul><ul><li>Transcript </li></ul></ul><ul><ul><ul><li>Text, often without synchronisation </li></ul></ul></ul>
  5. 5. Definitions (2) <ul><ul><li>Audio description </li></ul></ul><ul><ul><ul><li>Descriptions of the video inserted into spaces in the audio track i.e. what’s happening on screen? </li></ul></ul></ul><ul><ul><ul><li>For blind/ low vision people </li></ul></ul></ul><ul><ul><ul><li>Can get it for some TV programs, videos, DVDs, live events </li></ul></ul></ul><ul><ul><ul><li>Hard to find for online videos </li></ul></ul></ul>
  6. 6. Context <ul><li>&quot; Basic web accessibility is a known commodity now... </li></ul><ul><li>  </li></ul><ul><li>But nearly ten years after specifications first required it, online captioning still pretty much does not exist.&quot; </li></ul><ul><li>  </li></ul><ul><li>Joe Clark, A List Apart , November 2008. </li></ul>
  7. 7. More context! ( Gratuitous logos ) iTunes U
  8. 8. Doesn’t YouTube do Captions? <ul><li>Yes, captions and annotations, since August 2008. However: </li></ul><ul><ul><li>Only the video owner can upload/ author </li></ul></ul><ul><ul><li>No editor </li></ul></ul><ul><ul><li>(Not portable/ embeddable) </li></ul></ul><ul><ul><li>Captions can not be styled </li></ul></ul><ul><ul><li>Not open content </li></ul></ul><ul><ul><li>Only approximately 0.5% of YouTube videos are captioned (automated analysis on small corpus of 34 words - more work). </li></ul></ul>
  9. 9. What's the state of play? <ul><li>At the Open University: </li></ul><ul><ul><li>Course media is routinely transcribed (OU/iTunes U 95%) </li></ul></ul><ul><ul><li>It is not routinely captioned or audio described. </li></ul></ul><ul><li>  </li></ul><ul><li>W3C Web Content Accessibility Guidelines: </li></ul><ul><ul><li>WCAG 1.0, 1999 - 1.4 : Level A - transcript is sufficient. </li></ul></ul><ul><ul><li>WCAG 2.0, Dec 2008 - Level A requires captions, not audio description. </li></ul></ul><ul><li>  </li></ul><ul><li>Vimler: annotation. </li></ul><ul><li>Moodle et al : </li></ul><ul><ul><li>No easy way to integrate captions </li></ul></ul><ul><li>Some R&D projects are looking at content personalisation in E-Learning </li></ul>
  10. 10. Accessible Multimedia in E-Learning (1) <ul><li>TILE Project: Adaptive Technology Resource Centre, University of Toronto ( http://inclusivelearning.ca ) </li></ul><ul><ul><li>Early implementation of content personalisation standards that map user preferences to content served . </li></ul></ul><ul><ul><li>Not held in a learning management system </li></ul></ul><ul><ul><li>Reusable Learning Object Repository for Educators  </li></ul></ul><ul><ul><li>Videos provided with captions and audio descriptions </li></ul></ul>
  11. 11. Mars Rover Mission Video <ul><li>Audio Descriptions provide an overview of the onscreen action, particularly that which is not mentioned in the narrative of the video. </li></ul><ul><li>(insert Mars rover example here) </li></ul>
  12. 12. Accessible Multimedia in E-Learning (2) <ul><li>EU4ALL Project. UKOU, UNED, Atos Origin, York University (amongst many others!)  </li></ul><ul><li>www.eu4all-project.eu </li></ul><ul><li> Content personalisation based on evolved standards related to user preferences. i.e. I'd prefer the video with the audio descriptions please! </li></ul><ul><li>Process for providing matching developed for dotLRN and Moodle learning environments </li></ul><ul><li>Alternatives for videos in the standards include captions, audio description, sign language interpretations, transcripts </li></ul>
  13. 13. Moodle video with Audio Description <ul><li>( http://eu4all.open.ac.uk/eu4all/mod/resource/view.php?id=75 ) </li></ul>
  14. 14. Other Accessible Multimedia Fun! <ul><li>Stretch Project (ATRC, University of Toronto) http://stretch.atrc.utoronto.ca </li></ul><ul><ul><li>Project 'stretched' perceptions of artists & art students to be more inclusive of people with disabilities  </li></ul></ul><ul><ul><li>Participants produced numerous examples of cultural works that include multiple sensory modalities & a gallery of works on the theme of inclusion </li></ul></ul><ul><ul><li>Provided tools to new media artists for adding descriptions, captions & alternative video </li></ul></ul>
  15. 15. Tools for Adding Captions and/or Audio Descriptions <ul><ul><li>CapScribe: capscribe.snow.utoronto.ca </li></ul></ul><ul><ul><li>NCAM's Magpie ncam.wgbh.org/webaccess/magpie </li></ul></ul><ul><ul><li>LiveDescribe: www.livedescribe.com </li></ul></ul><ul><ul><li>MovCaptioner: www.synchrimedia.com </li></ul></ul><ul><ul><li>YouTube CC: www.youtubecc.com </li></ul></ul><ul><ul><li>CaptionTube: captiontube.appspot.com </li></ul></ul><ul><ul><li>Accessify's YouTube Caption Creator: accessify.com/tools-and-wizards/... – http://is.gd/1yiVU </li></ul></ul><ul><ul><li>DotSub: dotsub.com </li></ul></ul>
  16. 16. How can we address the lack of captions & audio descriptions online? <ul><li>Multimedia Alternatives </li></ul><ul><li>the MALT Wiki Project </li></ul><ul><li>Collaborative production of alternative content </li></ul><ul><li>Web services to ease use </li></ul>
  17. 17. Big Principles <ul><li>Accessibility/usability </li></ul><ul><li>Data portability/ content as a service/ connections </li></ul><ul><li>Quality & learning design * </li></ul><ul><li>Open content </li></ul><ul><li>Software as a service </li></ul><ul><li>Free (open-source) software </li></ul><ul><li>Social production/ co-creation/ crowd-sourcing </li></ul><ul><li>Perpetual beta, hacking the Web, agile </li></ul>
  18. 18. Media player evaluation
  19. 19. dotSUB.com - transcribing
  20. 20. dotSUB.com   &quot;any video any language&quot; <ul><li>+ Transcription/ translation can be collaborative - Wiki-like </li></ul><ul><li>+ Captions are portable (W3C TT XML, Subrip SRT) </li></ul><ul><li>+  Ajax-based editor or import captions </li></ul><ul><li>+  Powerful search, including in RSS </li></ul><ul><li>+  Rich meta-data, including caption attribution </li></ul><ul><li>+  Creative Commons licenses are encouraged </li></ul><ul><li>-  Uploader must be owner/ permission of owner of video * </li></ul><ul><li>-  Connections with eg. YouTube not explicit </li></ul><ul><li>-  Captions don't indicate person - TT styling - retrofit? </li></ul><ul><li>-  Meta-data not exposed in RSS search or TT - YET </li></ul><ul><li>-  No comments, rating, user profile - not &quot;social&quot; YET </li></ul>
  21. 21. Social production <ul><li>Wikipedia, Geocaching, Open street map, Project Gutenberg, Librivox, talking newspapers, open source … </li></ul><ul><ul><li>What motivates? User scenarios ... </li></ul></ul><ul><li>Preece, Jennifer & Shneiderman, Ben (2009) </li></ul><ul><li>&quot;The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation &quot; </li></ul><ul><ul><li>4 stages – reader, commenter, contributor, leader </li></ul></ul>
  22. 22. View 'in-situ' - client-side (OLnet)
  23. 23. View 'in-situ' - server-side
  24. 24. Multi-layer web service <ul><li>Content-creator YOU </li></ul><ul><li>| </li></ul><ul><li><a rel=”embed” href=”http://youtube.com/watch?v=UnI”>Title</a> </li></ul><ul><li>| </li></ul><ul><li>Wordpress/ Drupal/ Moodle module/ filter </li></ul><ul><li>| </li></ul><ul><li>jquery.oembed.js </li></ul><ul><li>| </li></ul><ul><li>Oembed – YouTube , Slideshare, Flickr, Vimeo ... </li></ul><ul><li>| </li></ul><ul><li>Remote server </li></ul><ul><li>| </li></ul><ul><li>Player <object> + HTML + Javascript </li></ul>
  25. 25. A new player – uses oEmbed, HTML / Javascript
  26. 26. YT player modified – user Javascript
  27. 27. Next Steps <ul><ul><li>Explore internal/ external funding </li></ul></ul><ul><ul><li>Conversations </li></ul></ul><ul><ul><li>Work on player + personalisation </li></ul></ul><ul><ul><li>Caption/ AD editing/ discovery functions </li></ul></ul><ul><ul><li>A workshop (&quot;Scripting Enabled&quot;)  </li></ul></ul><ul><ul><li>Build a community – please help! </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><li>N.D.Freear@open.ac.uk – @nfreear </li></ul><ul><li>W.Porch@open.ac.uk </li></ul><ul><li>maltwiki.org </li></ul>
  28. 28. We didn't have time for...
  29. 29. Flash 'wmode' is harmful <ul><li>wmode = 'window' (default) - OK. </li></ul><ul><li><object data=&quot;player.swf&quot;> </li></ul><ul><li><param name=&quot; wmode &quot; value=&quot; window &quot; /> </li></ul><ul><li>... </li></ul><ul><li>wmode = 'opaque' or 'transparent' – inaccessible. </li></ul><ul><li><param name=&quot; wmode &quot; value=&quot; opaque &quot; /> </li></ul><ul><li>Answer - don't set wmode. </li></ul>
  30. 30. Next steps detail <ul><li>Roadmap: no money, no timescale! </li></ul><ul><li>Testing - <iframe>, screen readers, high contrast... </li></ul><ul><li>&quot;Complete&quot; the MALT/Flow player - volume, progress bars, theme, language (research Flow controlbar custom.) </li></ul><ul><li>Do MALT/YouTube/JS player - matching UI. </li></ul><ul><li>Personalization demo, </li></ul><ul><li>Plug-ins: Wordpress, Moodle, Drupal... </li></ul><ul><li>Audio Description - CapScribe, Java Web Start/JNLP? </li></ul><ul><li>Captioning – online/ desktop/ import/ export </li></ul><ul><li>Developer documentation. </li></ul><ul><li>Translation/ Localization, player - French, Chinese... </li></ul><ul><li>Wiki features, community building, talk talk...? </li></ul>
  31. 31. Wordle - project  keywords

×