Multi-media Accessibility   Are we nearly there yet? Nick Freear,  Web Developer Wendy Porch , Research Fellow Institute of Educational Technology, The Open University Techshare 2009
I have a stammer Ask me to repeat if you miss something.    And please ask questions! stammering.org
Agenda What problems are we trying to solve? Existing research and issues How can we solve the existing problems?  Outline of project proposal Key project principles Some initial evaluations Examples/demonstrations Round-up, next steps & discussion
Definitions Captions  Also known as "sub-titles" in UK Text synchronised with video, timed text  Prefer styling to indicate speaker - position, colour For deaf/hard of hearing Closed captions "Captioning you have to turn on", broadcast  Transcript Text, often without synchronisation
Definitions  (2) Audio description Descriptions of the video inserted into spaces in the audio track i.e. what’s happening on screen? For blind/ low vision people  Can get it for some TV programs, videos, DVDs, live events Hard to find for online videos
Context " Basic web accessibility is a known commodity now...   But nearly ten years after specifications first required it, online captioning still pretty much does not exist."   Joe Clark,  A List Apart , November 2008.
More context! ( Gratuitous logos ) iTunes U
Doesn’t YouTube do Captions? Yes, captions and annotations, since August 2008. However: Only the video owner can upload/ author No editor (Not portable/ embeddable) Captions can not be styled  Not open content Only approximately 0.5% of YouTube videos are captioned (automated analysis on small corpus of 34 words - more work).
What's the state of play? At the Open University: Course media is routinely transcribed (OU/iTunes U 95%) It is  not  routinely captioned or audio described.    W3C Web Content Accessibility Guidelines: WCAG 1.0, 1999 - 1.4 : Level A - transcript is sufficient. WCAG 2.0, Dec 2008 - Level A requires captions, not audio description.   Vimler: annotation. Moodle  et al : No easy way to integrate captions Some R&D projects are looking at content personalisation in E-Learning
Accessible Multimedia in E-Learning  (1) TILE Project: Adaptive Technology Resource Centre, University of Toronto ( http://inclusivelearning.ca ) Early implementation of content personalisation standards that  map user preferences to content served .  Not held in a learning management system Reusable Learning Object Repository for Educators  Videos provided with captions and audio descriptions
Mars Rover Mission Video Audio Descriptions provide an overview of the onscreen action, particularly that which is not mentioned in the narrative of the video. (insert Mars rover example here)
Accessible Multimedia in E-Learning  (2) EU4ALL Project.  UKOU, UNED, Atos Origin, York University (amongst many others!)  www.eu4all-project.eu  Content personalisation based on evolved standards related to user preferences. i.e. I'd prefer the video with the audio descriptions please! Process for providing matching developed for dotLRN and Moodle learning environments Alternatives for videos in the standards include captions, audio description, sign language interpretations, transcripts
Moodle video with Audio Description ( http://eu4all.open.ac.uk/eu4all/mod/resource/view.php?id=75 )
Other Accessible Multimedia Fun! Stretch Project (ATRC, University of Toronto)  http://stretch.atrc.utoronto.ca Project 'stretched' perceptions of artists & art students to be more inclusive of people with disabilities  Participants produced numerous examples of cultural works that include multiple sensory modalities & a gallery of works on the theme of inclusion Provided tools to new media artists for adding descriptions, captions & alternative video
Tools for Adding Captions and/or Audio Descriptions CapScribe:  capscribe.snow.utoronto.ca NCAM's Magpie  ncam.wgbh.org/webaccess/magpie LiveDescribe:  www.livedescribe.com  MovCaptioner:  www.synchrimedia.com   YouTube CC:  www.youtubecc.com CaptionTube:  captiontube.appspot.com Accessify's YouTube Caption Creator:  accessify.com/tools-and-wizards/...  –  http://is.gd/1yiVU  DotSub:  dotsub.com
How can we address the lack of captions & audio descriptions online? Multimedia Alternatives the MALT Wiki Project Collaborative production of alternative content Web services to ease use
Big Principles Accessibility/usability  Data portability/ content as a service/ connections Quality & learning design * Open content  Software as a service Free (open-source) software  Social production/ co-creation/ crowd-sourcing Perpetual beta, hacking the Web, agile
Media player evaluation
dotSUB.com - transcribing
dotSUB.com    "any video any language" + Transcription/ translation can be collaborative - Wiki-like + Captions are portable (W3C TT XML, Subrip SRT) +  Ajax-based editor or import captions +  Powerful search, including in RSS +  Rich meta-data, including caption attribution +  Creative Commons licenses are encouraged -  Uploader must be owner/ permission of owner of video * -  Connections with eg. YouTube not explicit -  Captions don't indicate person - TT styling - retrofit? -  Meta-data not exposed in RSS search or TT - YET -  No comments, rating, user profile -  not "social"  YET
Social production Wikipedia, Geocaching, Open street map, Project Gutenberg, Librivox, talking newspapers, open source … What motivates? User scenarios ... Preece, Jennifer & Shneiderman, Ben (2009)  "The Reader-to-Leader Framework:  Motivating Technology-Mediated Social Participation "  4 stages – reader, commenter, contributor, leader
View 'in-situ' - client-side (OLnet)
View 'in-situ' - server-side
Multi-layer web service Content-creator YOU | <a  rel=”embed”  href=”http://youtube.com/watch?v=UnI”>Title</a> | Wordpress/ Drupal/ Moodle module/ filter | jquery.oembed.js | Oembed  –  YouTube , Slideshare, Flickr, Vimeo ... | Remote server | Player  <object>  + HTML + Javascript
A new player – uses oEmbed,  HTML / Javascript
YT player modified – user Javascript
Next Steps Explore internal/ external funding Conversations Work on player + personalisation Caption/ AD editing/ discovery functions A workshop (&quot;Scripting Enabled&quot;)  Build a community – please help!     N.D.Freear@open.ac.uk  –  @nfreear W.Porch@open.ac.uk  maltwiki.org
We didn't have time for...
Flash 'wmode' is harmful wmode = 'window' (default) - OK. <object data=&quot;player.swf&quot;> <param name=&quot; wmode &quot; value=&quot; window &quot; /> ... wmode = 'opaque' or 'transparent' – inaccessible. <param name=&quot; wmode &quot; value=&quot; opaque &quot; /> Answer - don't set wmode.
Next steps detail Roadmap: no money, no timescale! Testing - <iframe>, screen readers, high contrast... &quot;Complete&quot; the MALT/Flow player - volume, progress bars, theme, language (research Flow controlbar custom.) Do MALT/YouTube/JS player - matching UI. Personalization demo, Plug-ins: Wordpress, Moodle, Drupal... Audio Description - CapScribe, Java Web Start/JNLP? Captioning – online/ desktop/ import/ export Developer documentation. Translation/ Localization, player - French, Chinese... Wiki features, community building, talk talk...?
Wordle - project  keywords

MALT Wiki Techshare 2009

  • 1.
    Multi-media Accessibility Are we nearly there yet? Nick Freear, Web Developer Wendy Porch , Research Fellow Institute of Educational Technology, The Open University Techshare 2009
  • 2.
    I have astammer Ask me to repeat if you miss something.   And please ask questions! stammering.org
  • 3.
    Agenda What problemsare we trying to solve? Existing research and issues How can we solve the existing problems? Outline of project proposal Key project principles Some initial evaluations Examples/demonstrations Round-up, next steps & discussion
  • 4.
    Definitions Captions Also known as &quot;sub-titles&quot; in UK Text synchronised with video, timed text Prefer styling to indicate speaker - position, colour For deaf/hard of hearing Closed captions &quot;Captioning you have to turn on&quot;, broadcast Transcript Text, often without synchronisation
  • 5.
    Definitions (2)Audio description Descriptions of the video inserted into spaces in the audio track i.e. what’s happening on screen? For blind/ low vision people Can get it for some TV programs, videos, DVDs, live events Hard to find for online videos
  • 6.
    Context &quot; Basicweb accessibility is a known commodity now...   But nearly ten years after specifications first required it, online captioning still pretty much does not exist.&quot;   Joe Clark, A List Apart , November 2008.
  • 7.
    More context! (Gratuitous logos ) iTunes U
  • 8.
    Doesn’t YouTube doCaptions? Yes, captions and annotations, since August 2008. However: Only the video owner can upload/ author No editor (Not portable/ embeddable) Captions can not be styled Not open content Only approximately 0.5% of YouTube videos are captioned (automated analysis on small corpus of 34 words - more work).
  • 9.
    What's the stateof play? At the Open University: Course media is routinely transcribed (OU/iTunes U 95%) It is not routinely captioned or audio described.   W3C Web Content Accessibility Guidelines: WCAG 1.0, 1999 - 1.4 : Level A - transcript is sufficient. WCAG 2.0, Dec 2008 - Level A requires captions, not audio description.   Vimler: annotation. Moodle et al : No easy way to integrate captions Some R&D projects are looking at content personalisation in E-Learning
  • 10.
    Accessible Multimedia inE-Learning (1) TILE Project: Adaptive Technology Resource Centre, University of Toronto ( http://inclusivelearning.ca ) Early implementation of content personalisation standards that map user preferences to content served . Not held in a learning management system Reusable Learning Object Repository for Educators  Videos provided with captions and audio descriptions
  • 11.
    Mars Rover MissionVideo Audio Descriptions provide an overview of the onscreen action, particularly that which is not mentioned in the narrative of the video. (insert Mars rover example here)
  • 12.
    Accessible Multimedia inE-Learning (2) EU4ALL Project. UKOU, UNED, Atos Origin, York University (amongst many others!)  www.eu4all-project.eu  Content personalisation based on evolved standards related to user preferences. i.e. I'd prefer the video with the audio descriptions please! Process for providing matching developed for dotLRN and Moodle learning environments Alternatives for videos in the standards include captions, audio description, sign language interpretations, transcripts
  • 13.
    Moodle video withAudio Description ( http://eu4all.open.ac.uk/eu4all/mod/resource/view.php?id=75 )
  • 14.
    Other Accessible MultimediaFun! Stretch Project (ATRC, University of Toronto) http://stretch.atrc.utoronto.ca Project 'stretched' perceptions of artists & art students to be more inclusive of people with disabilities  Participants produced numerous examples of cultural works that include multiple sensory modalities & a gallery of works on the theme of inclusion Provided tools to new media artists for adding descriptions, captions & alternative video
  • 15.
    Tools for AddingCaptions and/or Audio Descriptions CapScribe: capscribe.snow.utoronto.ca NCAM's Magpie ncam.wgbh.org/webaccess/magpie LiveDescribe: www.livedescribe.com MovCaptioner: www.synchrimedia.com YouTube CC: www.youtubecc.com CaptionTube: captiontube.appspot.com Accessify's YouTube Caption Creator: accessify.com/tools-and-wizards/... – http://is.gd/1yiVU DotSub: dotsub.com
  • 16.
    How can weaddress the lack of captions & audio descriptions online? Multimedia Alternatives the MALT Wiki Project Collaborative production of alternative content Web services to ease use
  • 17.
    Big Principles Accessibility/usability Data portability/ content as a service/ connections Quality & learning design * Open content Software as a service Free (open-source) software Social production/ co-creation/ crowd-sourcing Perpetual beta, hacking the Web, agile
  • 18.
  • 19.
  • 20.
    dotSUB.com   &quot;any video any language&quot; + Transcription/ translation can be collaborative - Wiki-like + Captions are portable (W3C TT XML, Subrip SRT) +  Ajax-based editor or import captions +  Powerful search, including in RSS +  Rich meta-data, including caption attribution +  Creative Commons licenses are encouraged -  Uploader must be owner/ permission of owner of video * -  Connections with eg. YouTube not explicit -  Captions don't indicate person - TT styling - retrofit? -  Meta-data not exposed in RSS search or TT - YET -  No comments, rating, user profile - not &quot;social&quot; YET
  • 21.
    Social production Wikipedia,Geocaching, Open street map, Project Gutenberg, Librivox, talking newspapers, open source … What motivates? User scenarios ... Preece, Jennifer & Shneiderman, Ben (2009) &quot;The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation &quot; 4 stages – reader, commenter, contributor, leader
  • 22.
    View 'in-situ' -client-side (OLnet)
  • 23.
    View 'in-situ' -server-side
  • 24.
    Multi-layer web serviceContent-creator YOU | <a rel=”embed” href=”http://youtube.com/watch?v=UnI”>Title</a> | Wordpress/ Drupal/ Moodle module/ filter | jquery.oembed.js | Oembed – YouTube , Slideshare, Flickr, Vimeo ... | Remote server | Player <object> + HTML + Javascript
  • 25.
    A new player– uses oEmbed, HTML / Javascript
  • 26.
    YT player modified– user Javascript
  • 27.
    Next Steps Exploreinternal/ external funding Conversations Work on player + personalisation Caption/ AD editing/ discovery functions A workshop (&quot;Scripting Enabled&quot;)  Build a community – please help!     N.D.Freear@open.ac.uk – @nfreear W.Porch@open.ac.uk maltwiki.org
  • 28.
    We didn't havetime for...
  • 29.
    Flash 'wmode' isharmful wmode = 'window' (default) - OK. <object data=&quot;player.swf&quot;> <param name=&quot; wmode &quot; value=&quot; window &quot; /> ... wmode = 'opaque' or 'transparent' – inaccessible. <param name=&quot; wmode &quot; value=&quot; opaque &quot; /> Answer - don't set wmode.
  • 30.
    Next steps detailRoadmap: no money, no timescale! Testing - <iframe>, screen readers, high contrast... &quot;Complete&quot; the MALT/Flow player - volume, progress bars, theme, language (research Flow controlbar custom.) Do MALT/YouTube/JS player - matching UI. Personalization demo, Plug-ins: Wordpress, Moodle, Drupal... Audio Description - CapScribe, Java Web Start/JNLP? Captioning – online/ desktop/ import/ export Developer documentation. Translation/ Localization, player - French, Chinese... Wiki features, community building, talk talk...?
  • 31.

Editor's Notes

  • #2 Introducing the Multimedia Alternatives – MALT Wiki project http://maltwiki.org
  • #3 The cartoon says “ John does NOT stammer and never HAS done!” Link for the British Stammering Association http://stammering.org Nick
  • #4 Nick or Wendy
  • #5 Wendy
  • #6 Wendy
  • #7 http://alistapart.com/articles/thisishowthewebgetsregulated/ (Nick)
  • #8 Logos: YouTube, iTunes U, Open University, Vimeo, Viddler, Tube Caption, Sign Tube, dot SUB, Caption First ... Wendy
  • #10 95% transcripts for OU podcasts sounds good, however we&apos;re currently bad at providing links to those transcripts, outside iTunes. Web Content Accessibility Guidelines 2.0, http://w3.org/TR/wcag20 Nick
  • #11 Wendy
  • #12 Wendy
  • #13 http://www.eu4all-project.eu Wendy
  • #14 Link to an example on a password protected site (Forth road bridge, OpenLearn). Wendy
  • #15 Stretch project, http://stretch.atrc.utoronto.ca Wendy
  • #16 Capscribe, http://capscribe.snow.utoronto.ca … Wendy
  • #17 Nick
  • #18 Nick
  • #19 Evaluation of 5 Flash players against 6-7 criteria YouTube: captions may be embeddable. Captions are portable. Only owner can transcribe/upload. Easy YouTube: HTML/ Javascript controls - v. easy! http://icant.co.uk/easy-youtube/ JwPlayer: The only player to allow Audio Description via external file (MP3). * wmode= &apos;window&apos; NCAM/ccFlash player: The most thoughtful pure Flash interface - separate play/pause, up/down volume. NCAM/ccFlash: &amp;quot;Advanced&amp;quot; captions - can be styled, colour, position. “ Aaron” player: OpenLaszlo-based – free software, potential. accessibility patch submitted. http://aaronwinborn.com . “ Aaron” player: OpenLaszlo/ Drupal – lots of potential! Flow player: &apos;Advanced&apos; captions, scriptable, themable, free software. An audio SWF plugin is available - needs JS integration. http://flowplayer.org
  • #20 A screen shot of the caption editor on the dotSUB multi-lingual captioning/subtitling web site, http://dotsub.com Nick
  • #21   +  Transcription/ translation can be collaborative - Wiki-like   +  Captions are portable (W3C TT XML, Subrip SRT)   +  Ajax-based editor or import captions   +  Powerful search, including in RSS   +  Rich meta-data, including caption attribution   +  Creative Commons licenses are encouraged   +  Business model - captions created for free/ fee * Nick   -  Uploader must be owner/ permission of owner of video **   -  Connections not explicit   -  Captions don&apos;t indicate person - TT styling - retrofit?   -  Meta-data not exposed in RSS search or TT - YET   -  No comments, rating, user profile - not &amp;quot;social&amp;quot; YET   ? Accessibility of site, player, editor
  • #22 Logos at the bottom Wikipedia Foundation, OpenStreetMap, Project Gutenberg, GNU Free Software Foundation. Nick
  • #23 A diagram representing the use of a browser plug-in or extension on a site like YouTube. Nick
  • #24 A diagram representing the use of a module/filter for Web software such as Wordpress (blog), Drupal (content management), Moodle (online learning). Nick
  • #25 At the top of this diagram is the content creator/author. There are then various layers – the simple markup you enter in for example a blog post, a plug-in for your blog software which converts this to an oEmbed Javascript call, and finally the “embed code” for the actual player. Nick
  • #26 A screen shot of the new MALT player showing captions and coloured buttons at the bottom. Inspired by Chris Heilmann&apos;s Easy YouTube player, http://icant.co.uk/easy-youtube Nick
  • #27 Screen shot of a page from YouTube. showing a modified player with a transcript in a scrollable block inserted by the user Javascript (Greasemonkey script) below the player. Nick
  • #28 The current alpha site is at, http://maltwiki.org (Soft-launch 19 October 2009. Was a demonstration at, iet-access.open.ac.uk/malt) http://twitter.com/nfreear
  • #30 I&apos;ve tested this, and can demonstrate with NVDA screen reader, and MSAA Inspect32... http://freear.org.uk/node/22 Nick
  • #31 Blog post about personalization demo, 12 October 2009, http://freear.org.uk/node/25
  • #32 Tags: co-create, subtitle, data portability, crowd source, alternative format, accessibility, annotate, usability, audio description, social production, podcast, multimedia, iTunesU, mentor, community, develop, YouTube, caption, open content, transcribe, Video, Wiki, plug-in, participate, free software, in-situ, web service, social-karma.