Grasping data Multimedia Course 2010/11, KU Leuven Till Nagel, FH Potsdam, 12/2010
Natural User Interface
Computer’s image of human beings Dan O‘Sullivan und Tom Igoe, Physical Computing, 2004
If you can only manipulate one point […] you are restricted to the gestural vocabulary of a fruit fly. “ Bill Buxton
Gesture recognition on a Palm
From: Bill Buxton, Designing Gestural Interfaces Change of paradigm
mt4j.org Multitouch Gestures
Parameters <ul><li>presence </li></ul><ul><li>position </li></ul><ul><li>orientation </li></ul><ul><li>duration </li></ul>...
Microsoft Surface User Experience Guidelines, http://bit.ly/fV5nfN
Microsoft Surface User Experience Guidelines, http://bit.ly/fV5nfN
mæve Venice Biennale of Architecture, 2008
 
 
 
 
 
Prototyping
 
 
 
 
http://portal.mace-project.eu/maeve
 
 
 
mæve  http://portal.mace-project.eu/maeve FH Potsdam, 2008
mæve  FH Potsdam, 2008
mæve  FH Potsdam, 2008
Venice Unfolding Combining multitouch with tangible interaction
Urban transformation of the City of Venice <ul><li>116 architectural projects </li></ul><ul><li>Metadata and media files <...
Interactive tabletop Jula Lakritz, Nadine Patzig, Stefan Rechsteiner, Martin Schissler, Stephan Thiel
Map of Venetian region
 
Polyhedron to explore faceted data
 
Display of facets
Tilt to select facet
Rotate to select term
Lock term to highlight matching results
Video: Venice Unfolding http://vimeo.com/11526474
Browse through background information
Browse through media files
Eye-tracking study Sabine Richter, Sebastian Schwinkendorf
Eye-tracking study
Muse Visualizing the origins and connections of institutions based on co-authorship of publications
Muse Visualizing Scientific Collaboration
Stacked Donut Evolution
Muse Visualizing Scientific Collaboration
Interactions Pan Rotate Select
Hints for non-obvious interactions
Muse
Muse Visualizing Scientific Collaboration
Lit. Processing / Java map library
lit. Location based literary research Jan-Erik Stange and Sebastian Meier
lit. http://literarymap.sebastianmeier.eu/
 
 
 
Natural User Interface
 
cf: August de los Reyes, Surface Computing
from: http://designnotes.info/?p=2584
 
 
 
Everything is best for something and worst for something else. “ Bill Buxton
Donald Norman,  Jacob Nielsen .  Gestural  Interfaces: A Step Backwards in Usability , in  ACM Interactions , 2010 http://...
Thank you! Questions? Till Nagel, FH Potsdam, 12/2010 nagel@fh-potsdam.de  –  twitter: @tillnm
Upcoming SlideShare
Loading in...5
×

KUL Multimedia - Grasping Data

2,245

Published on

Guest lecture at the KU Leuven, Multimedia course with Prof Erik Duval

1 Comment
4 Likes
Statistics
Notes
No Downloads
Views
Total Views
2,245
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
1
Likes
4
Embeds 0
No embeds

No notes for slide
  • how interactive maps and geo visualization help to explore and communicate multivariate data
  • A computer’s image of human beings is reflected by its input and output devices. In the case of most desktop computers, this means a mouse, a keyboard, a monitor, and speakers. To such a computer we might look like a hand with one finger, one eye, and two ears. To change how the computer reacts to use, we have to change how it sees us.&amp;quot; Physical Computing, Dan O’Sullivan and Tom Igoe (2004)
  • non standard interaction elements
  • non-standard
  • Koolhaas
  • Paper cards Interactive surface
  • Paper prototyping
  • information display is governed by an underlying metadata structure in the form of a concept network, which is based on characteristics of the exhibits
  • The co-occurrences in such metadata define the visual connections among exhibits.
  • Place physical cards (with fiducials) on table
  • Mæve shows a way of providing new browsing experience by combining tangible interaction, complex visualization and collaborative data examination By inspecting conceptual relations on the table, visitors can find other significant works, or understand how their interests connect to information shared between exhibits. The simplicity of placing a card on the table imposes a low barrier to start interacting with the system. The visualization aesthetics and feedback invites users to explore both interaction mechanisms and displayed information without demanding great amount of concentration.
  • 1,0 x 0,9 m , Full HD, 30 ppi
  • OpenStreetMap, reduced style. Give a rough idea on spatial location (for citizens knowing the area)
  • Physical object acts as tangible input device and can be used to select various faceted data and filter the projects In the design of the object we opted for a shape signifying the interaction possibility to select different facets, hinting to the literal meaning of a “facet”, to make it crystal-clear.
  • Unfold the object, unfold the data
  • Unfolding
  • http://vimeo.com/11526474
  • First results suggest the tangible interaction with the polyhedron reduces the barrier between the physical world and virtual data, and eases the understanding of faceted geographical data. Thus enabling urban planners and citizens alike to participate in the discovery and analysis of information referring to the physical world.
  • Other issues Large-scale tabletop display Connections between projects
  • Lots of visualizations Country list with sparkline
  • Subtle, yet noticeable - Teaches the user a concept, thus - Helps flatten the learning curve
  • CLI: Statisch Getrennt, Erinnerung, Schnell/Experten &gt; Text GUI: Responsiv, Indirekt Erkennung &gt; Grafik NUI: Evokativ/Bewirkend, Direkt Intuitiv &gt; Körper / Objekte
  • CLI: Statisch Getrennt, Erinnerung, Schnell/Experten &gt; Text GUI: Responsiv, Indirekt Erkennung &gt; Grafik NUI: Evokativ/Bewirkend, Direkt Intuitiv &gt; Körper / Objekte
  • CLI: Statisch Getrennt, Erinnerung, Schnell/Experten &gt; Text GUI: Responsiv, Indirekt Erkennung &gt; Grafik NUI: Evokativ/Bewirkend, Direkt Intuitiv &gt; Körper / Objekte
  • The trick is knowing what is what, for what, when, for whom, where, and most importantly, why. Those who try the replace the mouse play a fool’s game. The mouse is great for many things. Just not everything. - Was sind die sinnvollen Einsatzmöglichkeiten von big scale gesture interfaces? (multitouch, tangible, ...)? - Wie kann angemessen erweitert werden?
  • KUL Multimedia - Grasping Data

    1. 1. Grasping data Multimedia Course 2010/11, KU Leuven Till Nagel, FH Potsdam, 12/2010
    2. 2. Natural User Interface
    3. 3. Computer’s image of human beings Dan O‘Sullivan und Tom Igoe, Physical Computing, 2004
    4. 4. If you can only manipulate one point […] you are restricted to the gestural vocabulary of a fruit fly. “ Bill Buxton
    5. 5. Gesture recognition on a Palm
    6. 6. From: Bill Buxton, Designing Gestural Interfaces Change of paradigm
    7. 7. mt4j.org Multitouch Gestures
    8. 8. Parameters <ul><li>presence </li></ul><ul><li>position </li></ul><ul><li>orientation </li></ul><ul><li>duration </li></ul><ul><li>sequence </li></ul><ul><li>movement pattern </li></ul>
    9. 9. Microsoft Surface User Experience Guidelines, http://bit.ly/fV5nfN
    10. 10. Microsoft Surface User Experience Guidelines, http://bit.ly/fV5nfN
    11. 11. mæve Venice Biennale of Architecture, 2008
    12. 17. Prototyping
    13. 22. http://portal.mace-project.eu/maeve
    14. 26. mæve http://portal.mace-project.eu/maeve FH Potsdam, 2008
    15. 27. mæve FH Potsdam, 2008
    16. 28. mæve FH Potsdam, 2008
    17. 29. Venice Unfolding Combining multitouch with tangible interaction
    18. 30. Urban transformation of the City of Venice <ul><li>116 architectural projects </li></ul><ul><li>Metadata and media files </li></ul><ul><li>Selected terms from an architecture taxonomy </li></ul>
    19. 31. Interactive tabletop Jula Lakritz, Nadine Patzig, Stefan Rechsteiner, Martin Schissler, Stephan Thiel
    20. 32. Map of Venetian region
    21. 34. Polyhedron to explore faceted data
    22. 36. Display of facets
    23. 37. Tilt to select facet
    24. 38. Rotate to select term
    25. 39. Lock term to highlight matching results
    26. 40. Video: Venice Unfolding http://vimeo.com/11526474
    27. 41. Browse through background information
    28. 42. Browse through media files
    29. 43. Eye-tracking study Sabine Richter, Sebastian Schwinkendorf
    30. 44. Eye-tracking study
    31. 45. Muse Visualizing the origins and connections of institutions based on co-authorship of publications
    32. 46. Muse Visualizing Scientific Collaboration
    33. 47. Stacked Donut Evolution
    34. 48. Muse Visualizing Scientific Collaboration
    35. 49. Interactions Pan Rotate Select
    36. 50. Hints for non-obvious interactions
    37. 51. Muse
    38. 52. Muse Visualizing Scientific Collaboration
    39. 53. Lit. Processing / Java map library
    40. 54. lit. Location based literary research Jan-Erik Stange and Sebastian Meier
    41. 55. lit. http://literarymap.sebastianmeier.eu/
    42. 59. Natural User Interface
    43. 61. cf: August de los Reyes, Surface Computing
    44. 62. from: http://designnotes.info/?p=2584
    45. 66. Everything is best for something and worst for something else. “ Bill Buxton
    46. 67. Donald Norman, Jacob Nielsen . Gestural Interfaces: A Step Backwards in Usability , in ACM Interactions , 2010 http://interactions.acm.org/content/?p=1401 Reading recommendation
    47. 68. Thank you! Questions? Till Nagel, FH Potsdam, 12/2010 nagel@fh-potsdam.de – twitter: @tillnm

    ×