HTML5 multimedia - browser-native video, audio and canvas - meet.js Summit / Poznan / 14 January 2012

HTML5 multimediaBROWSER-NATIVE VIDEO, AUDIO AND CANVASPatrick H. Lauke / meet.js Summit / Poznań / 14 January 2011

Web Evangelist at Opera

making your site Fonzie compliant...

<video>

Adobe Flash currently most common video delivery mechanism

<video src="video.webm" controls autoplay muted loop preload="none|metadata|auto" poster="poster.jpg" width="320" height="240"> <a href="video.webm">Download movie</a></video>

video as native object● behaves like any other HTML element● keyboard accessibility out-of-the-box

people.opera.com/patrickl/experiments/webm/hover+transition

powerful (simple) API

controlling <video> with JavaScriptvar v = document.getElementById(player);v.play();v.pause();v.volume = … ;v.currentTime = … ;…

events fired by <video>var v = document.getElementById(player);v.addEventListener(loadeddata, function() { … }, true)v.addEventListener(play, function() { … }, true)v.addEventListener(pause, function() { … }, true)v.addEventListener(timeupdate, function() { … }, true)v.addEventListener(ended, function() { … }, true)…

www.w3.org/2010/05/video/mediaevents.html

people.opera.com/patrickl/experiments/webm/basic-controls

people.opera.com/patrickl/experiments/webm/fancy-controls

people.opera.com/patrickl/experiments/webm/fancy-swap

HTML5 means all yourold dHTML is cool again!

video formats the big debate?

HTML5 does not specify video container/codec (same as with images in HTML 4.01)

MP4/H.264 orOgg Theora orWebM/VP8

MP4 / H.264ubiquitous, patent encumbered, licensing/royalties

Ogg Theora free and open, no licensing feesnot many tools for it, not web optimised

WebM / VP8 open and royalty-free, web-optimisedsupport by hardware and software vendors

providing multiple sources<video controls width="…" height="…"> <source src="movie.mp4" type="video/mp4"> <source src="movie.webm" type="video/webm"> <source src="movie.ogv" type="video/ogg"> </video>

specifying codecs<video controls width="…" height="…"> <source … type=video/mp4; codecs="avc1.42E01E,mp4a.40.2"> <source … type=video/webm; codecs="vorbis,vp8"> <source … type=video/ogg; codecs="theora,vorbis"> </video>

feature-detection for codecsv.canPlayType(video/webm;codecs="vp8,vorbis") "probably" | "maybe" | ""

www.ffmpeg.org

www.mirovideoconverter.com

flash fallback for older browsers http://camendesign.com/code/video_for_everybody

<audio>

audio...exactly the same as video<audio src=”music.mp3” controls autoplay … ></audio><audio controls autoplay> <source src="music.mp3" type="audio/mpeg" /> <source src="music.oga" type="audio/ogg" /> </audio>formats: MP3 vs Ogg Vorbis (vs WAV)

people.opera.com/patrickl/experiments/audio/wilhelm

people.opera.com/patrickl/experiments/audio/windchime

no need for <audio> in your documentvar s = document.createElement(audio); s.src = aaargh.oga; s.play(); (same for video as well, if youre crazy...)

canvas = “scriptable images”<canvas width="…" height="…"></canvas>

canvas has standard API methods for drawingctx = canvas.getContext("2d");ctx.fillRect(x, y, width, height);ctx.beginPath();ctx.moveTo(x, y);ctx.lineTo(x, y);ctx.bezierCurveTo(x1, y1, x2, y2, c1, c2);…www.w3.org/TR/2dcontext

people.opera.com/patrickl/experiments/canvas/particle/3

mariuswatz.com/works/abstract01js

canvas drawing ready-made imagesctx = canvas.getContext("2d");var logo = new Image();logo.src = logo.png;ctx.drawImage(logo,x1,y1,w1,h1,x2,y2,w2,h2);or call in an existing image already on the page

www.splintered.co.uk/experiments/archives/paranoid_0.4

canvas access to image data arrayctx = canvas.getContext("2d");canvasData = ctx.getImageData(x,y,w,h);[R,G,B,A,R,G,B,A,R,G,B,A,R,G,B,A, … ]

www.splintered.co.uk/experiments/archives/canvas-ambilight

desandro.com/resources/close-pixelate

canvas also works with videoctx = canvas.getContext("2d");v = document.getElementById(player);ctx.drawImage(v,x1,y1,w1,h2,x2,y2,w2,h2);grab currently displayed frame (update as appropriate)

html5doctor.com/video-canvas-magic

media.chikuyonok.ru/ambilight

is it all safe to use, right now?

www.youtube.com/html5

dont do browser sniffing http://www.flickr.com/photos/timdorr/2096272747/

feature-detectionprogressive enhancement, graceful degradation diveintohtml5.info/everything.html

feature-detection for audio/videoif (!!document.createElement(video).canPlayType;) { … }if (!!document.createElement(audio).canPlayType;) { … }

sublimevideo.net

www.jplayer.org

www.textfiles.com/underconstruction

dev.w3.org/2011/webrtc/editor/webrtc.html

dev.w3.org/2011/webrtc/editor/getusermedia.html

camera accessnavigator.getUserMedia({video:true},success,error);

dev.opera.com/labs

people.opera.com/danield/html5/explode

neave.com/webcam/html5

HTML5 as Flashkiller?

not a question ofHTML5 replacing Flash...

giving developers a choice!

www.opera.com/developer patrick.lauke@opera.com

http://negativefoo.org	99
http://lanyrd.com	47
http://a0.twimg.com	5

HTML5 multimedia - browser-native video, audio and canvas - meet.js Summit / Poznan / 14 January 2012

by Patrick Lauke

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 151

Statistics

HTML5 multimedia - browser-native video, audio and canvas - meet.js Summit / Poznan / 14 January 2012 Presentation Transcript