Rich User Interaction with SVG

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    Favorites, Groups & Events

    Rich User Interaction with SVG - Presentation Transcript

    1. XML based user interaction through Rich Interfaces - SVG - MULTIMEDIA DOCUMENT Stéphane Sire (speaking)
    2. PLAN
      • Part 1
        • Rich User Interaction Style
      • Part 2
        • Iterative Design and supportive technologies
      • Part 3
        • SVG and alike
    3. PART 1 Rich User Interaction Style
    4. EVOLUTION OF USER GRAPHICAL INTERACTION STYLES Desktop Web Mobile Command Line Direct (1983) Manipulation Point & Click (hypertext) HTML Forms WAP Rich User Interaction WIMP Rich Desktop Application (RDA) Rich Internet Application (RIA) iPhone and alike (touch based)
    5. CHARACTERISTICS OF RICH USER INTERACTION
      • Better Graphics
      • Extensive use of Animations
      • Creative layout models
      • Borrowings from other interaction styles
      • Better feedback times (AJAX)
      A new vocabulary for design
    6. BETTER GRAPHICS (1)
      • Layers
        • Painter's model of rendering
        • Compositing operators
          • (Porter & Duff)
        • Clipping and masking
      • Applications
        • Layout based on layers (see later)
        • Non rectangular windows
          • Objects with holes
        • Layer's effects
      Source: Digistrip (CENA)
    7. BETTER GRAPHICS (2)
      • Color models
        • Alpha channel (RGBA)
        • Gradient colors
        • Texture filling
      • Applications
        • Light and shadows effects
        • Glossy effect
        • Reflection ( cow.neondragon.net/stuff/reflection/ )
        • etc
    8. BETTER GRAPHICS (3)
      • Shapes & lines
        • Stroke styles
          • Joints
          • extremities
        • B ézier paths
          • Very efficient algorithm to draw it (De Casteljeau algorithm)
      • Applications
        • Rounded shapes
    9. BETTER GRAPHICS (4)
      • Pixel Effects
        • Anti-aliasing
        • Filters (blur, bump mapping, etc.)
      Source www.corzo.com Source www.treebuilder.de
    10. EXTENSIVE USE OF ANIMATIONS User's guidance System state change Visual state transition Source www.joehewitt.com/iui/samples/music.html Source www.lemonde.fr (choose Journal Electronique) Source www.panic.com/goods/
    11. ANIMATION TRICKS
      • "Exageration"
      • Pace
      • Application: Kinetic Scrolling ( video on youTube)
      Author's made movie from www.laredoute.fr Author's made movie from www.youarethemodel.com
    12. NEW LAYOUT MODELS (1)
      • Layered information
      Source www.laredoute.fr Source www.natoora.com Source maps.google.com
    13. NEW LAYOUT MODELS (2)
      • Contraction/dilatation
        • Accordion
      • Continuous surfaces
        • Linear (ribbon) : www.gucci.com or www.christofle.com
        • Two dimensions : www.goruneasy.com
        • Unconventional : www.etsy.com (cf. Explore)
      Source www.goruneasy.com Source www.yomiuri.co.jp (site design has changed)
    14. NEW LAYOUT MODELS (3)
      • Fixed layout + Animation
        • Scrolling Ribbon
          • more information with constant space within the page
      • Layers + Animation
        • Drawer windows
        • Docks
      Source www.tf1.fr
    15. BORROWINGS FROM OTHER STYLES
      • Direct manipulation
        • Drag & drop but still marginal
      • Post-WIMP techniques
        • Bifocal menus
      • Video-games
        • Rotative menus
      Source www.amazon.com Source www.wat.tv
    16. BETTER FEEDBACK TIMES WITH AJAX
      • No more page reload and full page refresh
        • Increase reactivity
        • Requires special tricks to get user's attention
      • Applications
        • Auto-suggestion input field (see Google Autosuggest )
        • Dynamical queries
          • allows some forms with no "Submit" button
          • or allows to pre-filter results before submitting
      Source www.trivop.com Source www.darty.com/nav/achat/telephonie/telephonie_mobile/telephone_portable/guide.html (site design has changed)
    17. RICH USER INTERACTION (SUMMARY)
      • Graphical design
        • To increase intuitivity
        • To create emotions
        • Emotions increase perceived usability
          • See Don Norman last book "Emotional Design"
      • Requires multi-disciplinary teams
        • User experience (interaction) designer
        • Visual designer, Motion designer
        • Developers
        • etc
      ( video on youTube)
    18. PART 2 Iterative Design and Supportive Technologies
    19. PRODUCT DEVELOPMENT PROCESS Reprinted from "Sketching User Experiences" (Buxton, 2007)
    20. ITERATIVE DESIGN
    21. CLOSE TO AGILE SOFTWARE DEVELOPMENT
      • Agile Manigesto (source agilemanifesto.org )
        • Individuals and interactions over processes and tools
        • Working software over comprehensive documentation
        • Customer collaboration over contract negotiation
        • Responding to change over following a plan
      • See also Extreme Programming
      • Web version
        • the permanent Beta
    22. EXAMPLES Source: Nielsen Source: Hiser Source: Alex Poole
    23. CLASSICAL DEVELOPMENT CYCLE Users Sketches Storyboard Wireframes IA diagrams Programmers Interaction, Visual, Motion, … Designers Executable Code Browser Plugin Runtime Env. Feedback loop How to increase the number of iterations ?
    24. MODEL DRIVEN DEVELOPMENT CYCLE Users Sketches Storyboard Wireframes IA diagrams Programmers Interaction, Visual, Motion, … Designers Graphical models Animation models Other models… XML Browser, Plugin Runtime Env. Executable code
    25. HOW TO EDIT A MODEL ?
      • Specialized editors
        • Example for graphics: Adobe illustrator
      SVG File
    26. A SHORT EXAMPLE Interaction Designer Visual Designer Programmer: + Javascript Graphical Model File(s) Example from Adobe dev web site
    27. ADDING MORE MODELS…. Interaction Designer Visual Designer Graphical Model Behavior Modelling with State Machines Finite State Machine Models
    28. MODEL DRIVEN SUMMARY
      • Models
        • Specialized editors
        • Easy to move from one platform to another
      • Code
        • Programming skills
        • Hard to maintain
        • Less portable
      Models Models (XML) Code Code
    29. PART 3 Web Standards for Graphical Design: SVG and alike
    30. W3C STANDARDS (1)
      • Mainly "Models"
        • XML based languages
        • From "Draft" to "Recommendation" status
        • Models both for output and input modalities
        • HTML, XHTML, XForms, SMIL, MathML, VoiceXML, SCXML, InkML, EMMA, …, and SVG
      • Some "Code" too
        • Application Programming Interfaces (APIs)
        • DOM (3 levels)
          • API for manipulating models loaded into memory as trees
          • Many more APIs (events, load and save, progression, etc.)
        • XMLHttpRequest
          • Ajax programming
    31. WEB STANDARDS AND MDA Markup Only Code Behind Markup Behind Code Only XML XML Imperative Prog. Lang. Imperative Prog. Lang. Definition of Interactive Components Instantiation of Interactive Components Today Web applications Future of applications Today Desktop applications
    32. W3C AND RICH USER INTERACTION (*) simplified with specialized toolkits (scriptaculous, jQuery, etc) Characteristics Standard solution Better graphics SVG or CSS3 (with HTML) Animation SMIL/ SVG animation module DOM Manipulation with Javascript(*) Creative layout SVG or CSS (with HTML) DOM Manipulation with Javascript(*) Better feedback time XMLHttpRequest Cross domain XHR Borrowing from other styles All of the above
    33. SVG HISTORY
      • S calable V ector G raphic
      • Started in 1998
      • 1st draft: February 1999
      • SVG 1.1 recommendation 2003
        • http://www.w3.org/TR/SVG11/
      • SVG 1.2 Tiny candidate recommendation 2006
        • http://www.w3.org/TR/SVGMobile12/
        • SVG 1.2 Full to come later
      • Working Group with main software editors
        • Sun, Adobe, Apple, Microsoft, Corel, Ilog, HP, Canon, Autodesk, etc.
    34. SVG VS. FLASH (*) see http://www.w3.org/TR/SVG/minimize.html Property SWF SVG XML - Std W3C No Yes Metadata Yes, propietary Yes, RDF compatible Format Binary Text Size < SVG > SWF : but can be compressed with gzip by about 80% (*) Runtime Plugin (200K) Native (Opera, Safari , Firefox, … ) Source No Yes (text is searchable and selectable) Audio/Video Yes Yes (SVG 1.2 Tiny)
    35. AUTHORING TOOLS
      • Graphical Editors
        • Sodipodi, Illustrator, Corel Draw, OmniGraffle Pro, …
      • Specialized Editors
        • Ikivo Animator : animations
      • Automatic generation
        • Client-side Javascript generation
          • Example from http://www.destatis.de/
        • Client or server size XSLT generation
          • demo from www.treebuilder.de/default.asp?file=250484.xml
      • Automatic conversion from/to other formats
        • From MathML, AutoCAD, Visio, etc.
        • To PDF, PNG, etc.
      • Manual authoring :)
    36. PLAYERS
      • Adobe to stop its plugin support in 2009…
        • Adobe is switching to Flash/AIR
      • … but becoming native in Web browsers
        • Opera, Safari, Firefox, …
        • open source rendering libraries (Cairo)
      • Not directly available in IE…
        • Microsoft is switching to XAML/WVG with silverlight plugin
      • Standalone players
        • Batik (Java) - contains a useful utility to generate SVG fonts
      • SVG Tiny 1.2 on mobile phones
        • www.bitflash.com/mobile_primer.html
        • www.ikivo.com/02player_svg.html
        • And more…
      • See list of implementations www.svgi.org/
    37. DRAWING BASIC SHAPES
      • Shapes
        • Rectangles <rect>
        • Cercles <circle>
        • Ellipses <ellipse>
        • Lines <line>
        • Polylines <polyline>
        • Polygons <polygon>
        • Text <text>
      • Attributes
        • x, y, width, height, rx, ry
        • fill, stroke, stroke-linecap, stroke-linejoin, stroke-miterlimit, stroke-width, …
        • opacity, stroke-opacity, fill-opacity
        • ...
      <rect x=&quot;200&quot; y=&quot;300&quot; width=&quot;90&quot; height=&quot;40” fill=&quot;lime&quot; stroke=&quot;blue&quot; stroke-linejoin=&quot;bevel&quot; stroke-width=&quot;3&quot;/>
    38. DRAWING ARBITRARY SHAPES
      • Path <path d=&quot;path data&quot; >
        • outline of a shape which can be filled, stroked, used as a clipping path
        • defined by connected lignes, arcs and curves.
      • Base attribute
        • &quot;path data&quot; : complex vocabulary
        • &quot;,&quot; and EOL are allowed in &quot;path data&quot;, spaces are optional between a command and a number (to compress data)
      <path d=&quot;M 100 100 L 300 100 L 200 300 z&quot; fill=&quot;red&quot; stroke=&quot;blue&quot; stroke-width=&quot;1&quot; />
    39. PATH DATA VOCABULARY
      • Each command is named by a letter (M: moveto L: lineto, etc.) followed by a coordinate, either
        • Absolute if capital (e.g. &quot;M&quot;)
        • Relative to the previous point if lowercase (e.g. &quot;m&quot;)
      • M and m:
        • Move the point to the given coordinate
        • Create a new sub-path starting at the origin
        • Syntax: M|m (x y) (x y)*
        • The second group (x y)* is interpreted as lineto commands
        • Ex: M100 100 200 200
      • L and l:
        • Draw a line from the current point to the given coordinate and draw lines between subsequent given points
        • Syntax: L|l (x y) (x y)*
      • H and h (V and v):
        • Draw a horizontal line (vertical) from the current point to the current point incremented with the given number
        • Syntax: H|h (x) et V|v (y)
      • Z and z:
        • Close current subpath with the last point defined with M|m
      M 100,100 L 200, 200 x Cur point
    40. MORE PATH DATA VOCABULARY See details on http://www.w3.org/TR/SVG/paths.html Command Args (can be repeated)+ Description A, a rx ry x-axis-rotation direction sweep x y Elliptical arc C, c x1 y1 x2 y2 x y Cubic B ézier curve from current point to x y with control points x1 y2 and x2 y2 S, s x2 y2 x y Cubic B ézier curve with control point as the reflection of the reflection of second control point of a C, c command Q, q x1 y1 x y Quadratic B ézier curve from current point to x y with control point x1 y1 T, t x y Quadratic B ézier curve with control point as the reflection of previous control point of a Q, q command
    41. DEFINING REUSABLE GRAPHICAL COMPONENTS
      • Definition of a component
        • Group element: <g id=&quot;name&quot;>
        • Container element for grouping graphics elements
        • Can be nested
        • Its attributes are inherited by its descendants
      • Instantiation of a component
        • <use xlink:href=&quot;#name&quot;/>
      <g id=&quot;shape&quot; stroke=&quot;blue&quot;> <path width=&quot;1cm&quot; d=&quot;M 0 50 35 25 70 50 Z&quot; stroke-width=&quot;0.1cm&quot; fill=&quot;none&quot;/> <rect x=&quot;10&quot; y=&quot;50&quot; width=&quot;50&quot; height=&quot;1cm&quot; stroke-width=&quot;0.1cm&quot;/> </g> <use xlink:href=&quot;#shape&quot; x=&quot;140&quot; y=&quot;20&quot;/> <use xlink:href=&quot;#shape&quot; x=&quot;70&quot; y=&quot;60&quot;/>
    42. DECLARING GRAPHICAL COMPONENTS WITHOUT DRAWING THEM
      • Everything that appears in a <defs> section will not be drawn
        • It will be available to be reused in other parts
        • This is a way to group resources (at the beginning of the file)
      <defs> <g id=&quot;shape&quot; stroke=&quot;blue&quot;> <path width=&quot;1cm&quot; d=&quot;M 0 50 35 25 70 50 Z&quot; stroke-width=&quot;0.1cm&quot; fill=&quot;none&quot;/> <rect x=&quot;10&quot; y=&quot;50&quot; width=&quot;50&quot; height=&quot;1cm&quot; stroke-width=&quot;0.1cm&quot;/> </g> </defs> <use xlink:href=&quot;#shape&quot; x=&quot;140&quot; y=&quot;20&quot;/> <use xlink:href=&quot;#shape&quot; x=&quot;70&quot; y=&quot;60&quot;/>
    43. POSITIONING GRAPHICS
      • Most elements can be positioned with x and y within their parent container
      • Groups <g> are also used to apply transformations
        • <g transform=&quot; translate (x,y)&quot;>
        • Other transformations include rotate , skewX | Y , scale and matrix
        • This is equivalent to associating a transformation matrix with each group <g> (and to redefine a new coordinate system for the descendants)
      • Transformation are cumulative in nested groups
        • Current transformation matrix at each <g>
        • Obtained as the product of all transformation matrices up to the parent <g>
      <g transform=&quot;rotate(20, 200, 300)&quot;> <rect x=&quot;200&quot; y=&quot;300&quot; width=&quot;90&quot; height=&quot;40&quot; fill=&quot;lime&quot; stroke=&quot;blue&quot; stroke-width=&quot;3&quot;/> </g>
    44. PAINTING AND COLORING
      • Colors applies with different attributes to
        • Strokes (attribute &quot;stroke&quot;)
        • Shapes interior (attribute &quot;fill&quot;)
      • Colors are rendered by a paint server
        • The attribute URI reference selects a paint server
        • Solid colors (e.g. &quot;orange&quot; or &quot;#50A619&quot;)
        • Gradients or Patterns (e.g. &quot;url(#myGradient)&quot;)
      <defs> <linearGradient id=&quot;Gradient01&quot;> <stop offset=&quot;20%&quot; stop-color=&quot;#39F&quot; /> <stop offset=&quot;90%&quot; stop-color=&quot;#F3F&quot; /> </linearGradient> </defs> <rect x=&quot;200&quot; y=&quot;300&quot; width=&quot;90&quot; height=&quot;40” fill=&quot;url(#Gradient01)&quot; stroke=&quot;blue” stroke-width=&quot;3&quot;/>
    45. CLIPPING
      • clipPath element
        • any path, text or basic shape
        • defines an outline with inside/outside
      • clip-path attribute
        • attach clipPath to an element
      Clip layer Not visible Content layer Result <clipPath id=&quot;visContent&quot;> <text x=&quot;0&quot; y=&quot;80&quot; font-family=&quot;Verdana&quot; font-size=&quot;70&quot; fill=&quot;blue&quot; >Media</text> </clipPath> <g clip-path=&quot;url(#visContent)&quot;> <rect x=&quot;0&quot; y=&quot;0&quot; width=&quot;200&quot; height=&quot;100&quot; fill=&quot;url(#grad)&quot;/> </g>
    46. MASKING
      • Masking
        • Attribute
          • mask=&quot;url(#mask)&quot;
        • Draw #mask in an offscreen buffer
        • Convert it to gray level image
        • Composite with the masked layer
      Layer1 Layer2 Masked by Layer3 Result Layer3 Mask Not visible <g mask=&quot;url(#Mask)&quot;> <use xlink:href=&quot;#logo&quot; transform=&quot;scale(1 -1&quot;/> </g>
    47. ANIMATING GRAPHICS (1)
      • Each graphical attribute can be animated
        • animate element
        • Animation description based on SMIL2 (Synchronized Multimedia Integration Language level 2), W3C: http://www.w3.org/TR/smil20/
      • Animation describing
        • Trajectory
          • Attribute value variation
        • Pace
          • Time variation to produce effects such as slow-in
      <rect x=&quot;10&quot; y=&quot;10&quot; width=&quot;200&quot; height=&quot;20&quot;> < animate attributeName =&quot;width&quot; attributeType =&quot;XML&quot; from =&quot;200&quot; to =&quot;20&quot; begin =&quot;0s&quot; dur =&quot;5s&quot; fill =&quot;freeze&quot; /> </rect>
    48. ANIMATING GRAPHICS (2)
      • Other types of animation
        • Animation along a path (motion tweening)
          • animateMotion
        • Special instruction for color animation
          • animateColor
      • More advanced animation can be built with more programming (e.g. Morphing)
        • Exemple: Dragicevic, Artistic Resizing (UIST, 2005)
    49. METADATA
      • Images can be describe with
        • <desc>
          • Can contain any RDF data
        • <title>
          • Standard element to give a title
      • This can be useful for
        • Accessibility (screen readers, …)
        • Indexing image file (do not forget it's text files)
      • SVG 1.2 also introduces attributes for RDFa & microformats
      <g> < title > Company sales by region </ title > < desc > This is a bar chart which shows company sales by region. </ desc > <!-- Bar chart defined as vector data --> </g>
    50. HOW TO USE SVG
      • Within an SVG document (.svg : image/svg+xml)
        • You can nest several SVG fragments / views inside an SVG document
        • This is a way to define &quot;elastic&quot; layouts
          • Apply % values to x, y and width, height attributes
        • Don't forget viewBox attribute to scale to fit
      • Within an HTML document
        • By reference with <embed>, <object>, <iframe> or <img> tags
        • See www.carto.net/papers/svg/samples/svg_html.shtml
      • Within an XHTML document (.xhtml : text/xhtml+xml)
        • Using the namespace inclusion mechanism
        • Must be parsed as XML by the browser
        • For a local file &quot;.xhtml&quot; is a way to force it
    51. EXTRA FEATURES
      • Pixel filters
      • Markers
      • Glyphs
      • Text along a path
      • Adding Interactivity with Javascript Programming
        • SVG APIs
          • SVG DOM API: for scripted interactivity
          • SVG Micro DOM (for SVG 1.2 Tiny)
      • Much more … explore by yourself
        • Mozilla SVG home: developer.mozilla.org/en/docs/SVG
        • Lot of fascinating examples: www.treebuilder.de/
        • SVG-Wiki: wiki.svg.org/
        • W3C SVG Home: www.w3.org/Graphics/SVG/
    52. CONCLUSION: RIA STANDARDS AND TECHNOLOGIES X11 1987 1992 1994 2002 2004 Shockwave HTML HTML 4.0 Flash/SWF X-HTML SVG Javascript DOM XMLHttpRequest Ajax CSS IFrame 1990 1996 1998 2000 2006 OpenGL PDF Direct 3D OpenGL 2.0 Mosaic Netscape IE Firefox Konfabulator AIR Silverlight XAML Flex/MXML XUL WVG
    53. CREDITS
      • Web sources indicated directly on the slides, otherwise (many thanks to them):
      • Illustrations
      • p7 CENA Digistrip www.tls.cena.fr/divisions/PII/toccata/composants/digistrips.html
      • Demos
      • p10 SVG Slot Machine – www.treebuilder.de
      • p30 Adobe Airbus A321 Panel demo – www.adobe.com/svg/demos/main.html
      • Book
      • Sketching User Experience, Bill Buxton, Morgan Kaufman by Elsevier inc. 2007 – www.billbuxton.com
      • Article
      • Combining SVG and models of interaction to build highly interactive user interfaces,
      • S. Chatty, A. Lemort, S. Sire, J-L. Vinot, SVGOpen 2005 – www.svgopen.org/2005/papers/CombiningSVGModelsBuildInteractiveUserInterfaces/
    54. EXTRA SLIDES
    55. COMPLETE SVG FILE EXAMPLE <?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?> <!DOCTYPE svg [ <!-- entities etc. here --> ]> <svg version=&quot;1.1&quot; baseProfile=&quot;full&quot; xmlns=&quot;http://www.w3.org/2000/svg&quot; xmlns:xlink=&quot;http://www.w3.org/1999/xlink&quot; width=&quot;8cm&quot; height=&quot;6cm&quot;> <defs> <!-- resources to be reused --> <linearGradient id=&quot;Gradient01&quot;> <stop offset=&quot;20%&quot; stop-color=&quot;#39F&quot; /> <stop offset=&quot;90%&quot; stop-color=&quot;#F3F&quot; /> </linearGradient> <rect id=&quot;shape&quot; width=&quot;1cm&quot; height=&quot;1cm&quot; stroke=&quot;blue&quot; stroke-width=&quot;0.1cm&quot;/> </defs> <!-- content --> <rect x=&quot;.1cm&quot; y=&quot;.1cm&quot; width=&quot;7.9cm&quot; height=&quot;5.9cm&quot; fill=&quot;none&quot; stroke=&quot;black&quot; stroke-width=&quot;1px&quot; /> <use x=&quot;1cm&quot; y=&quot;1cm&quot; xlink:href=&quot;#shape&quot; fill=&quot;#BBB&quot;/> <use x=&quot;4cm&quot; y=&quot;1cm&quot; xlink:href=&quot;#shape&quot; fill=&quot;url(#Gradient01)&quot;/> <use x=&quot;1cm&quot; y=&quot;4cm&quot; xlink:href=&quot;#shape&quot; fill=&quot;url(#Gradient01)&quot;/> <use x=&quot;4cm&quot; y=&quot;4cm&quot; xlink:href=&quot;#shape&quot; fill=&quot;blue&quot;/> </svg>
    SlideShare Zeitgeist 2009

    + stsirestsire Nominate

    custom

    135 views, 0 favs, 1 embeds more stats

    Part of a course on multimedia document engineering more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 135
      • 134 on SlideShare
      • 1 from embeds
    • Comments 0
    • Favorites 0
    • Downloads 2
    Most viewed embeds
    • 1 views on http://graaasp.epfl.ch

    more

    All embeds
    • 1 views on http://graaasp.epfl.ch

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories