This document summarizes Dr. Everardo Reyes-Garcia's presentation on explorations in media visualization. It discusses the history of data visualization from Euclid to modern tools. It also reviews techniques like pixelation, image averaging, and slicing used to analyze media. Experimental projects are presented that disrupt 3D models, use handmade approaches, or explore 4D and non-Euclidean geometry. The document concludes by questioning if current work focuses more on workflows than new inventions and more on representing space than time.

1. Explorations in Media
Visualization
Dr. Everardo Reyes-Garcia
Université de Paris 13
!
PUC Santiago de Chile, September 1, 2014.
Datawiz 2014 | Data Visualization Workshop | ACM Hypertext

2. Part 1.
Brief review of dataviz

3. visual models

4. Cartesian
Networks
Infographics
Experimental

5. Network diagrams
Visual Complexity, Manuel Lima
http://linkd.in/1lDsVbm

6. 180+ links on dataviz | La liste des listes... de graphiques
Claude-Henri Meledo, Visual Decision, 2011-2014
http://linkd.in/1lDsVbm

7. kinds of data

8. metadata
social records
transactions
preferences
hours
locations
connections
texts
… media

9. tools & software

10. D3.js
Two.js
Three.js
Processing.js
CartoDB
Quadrigram
RAW
Tableau
Vega
AntiType
CodeCity
Gephi
http://d3js.org/
http://jonobr1.github.io/two.js/
http://threejs.org/
http://processingjs.org/
http://cartodb.com/
http://www.quadrigram.com/
http://raw.densitydesign.org/
http://www.tableausoftware.com/
http://trifacta.github.io/vega/
http://www.anitype.com/
http://www.inf.usi.ch/phd/wettel/codecity.html
https://gephi.github.io/

12. Part 2.
Historical Review of Dataviz

13. graphical representation of movement

14. Development of Mathematics and Geometry
Euclid, The Elements, c. 300 BC

15. First Representation of Movement
Nicolas Oresme, Tractatus de configurationibus qualitatum et motuum, c. 1360

16. Geometry and Algebra: Cartesian Plane
René Descartes, La Géométrie, 1637

17. capture of movement

18. Myograph
Étienne-Jules Marey, La méthode graphique, 1876

19. Myograph
Étienne-Jules Marey, La méthode graphique, 1876

20. Sequence of Photographs
Eadweard Muybridge, The Horse in motion, 1878

21. From Image to its Abstraction
Étienne-Jules Marey, Movement, 1895

22. Chronophotograph
Étienne-Jules Marey, 1896

23. Precise Capture of Movement
Frank Gilbreth, cyclographs, 1912

24. models of movement

25. Sculpture of Seagull in Successive Attitudes
Étienne-Jules Marey, 1880

26. Cyclograph Constructed of Wire
Frank Gilbreth, 1912

27. art and movement

28. Forms Appear Side by Side or Overlapping
Marcel Duchamp, Nu descendant un escalier, 1912

29. Form of Movement Becomes of an Object of Expression
Paul Klee, Blumen Mythos, 1918

30. Abstraction and Symbolism of Forms
Wassily Kandinsky, Composition VIII, 1923

31. Representación artística de movimiento
Joan Miró, Harlequin's Carnival, 1925

32. Part 3.
Media Visualization

33. principles & objectives

34. • an idea originated in 2005
• currently developed by the Software Studies Initiative
• analyzing visual media through visual media
• takes advantage of visual analytics and image processing
techniques to construct visual spaces of the information analyzed

35. some techniques

36. Pixelation from the Cover of Nevermind
Music Performed by Nirvana. Produced by Butch Vig, 1991
E. Reyes, 2013

37. Image Averaging of the Video Clip Smells Like Teen Spirit
Performed by Nirvana. Directed by S. Bayer, 1991
E. Reyes, 2013

38. Image Mosaic of the Video Clip Smells Like Teen Spirit
Performed by Nirvana. Directed by S. Bayer, 1991
E. Reyes, 2013

39. Several Image Slicing Visualizations
Music Performed by Nirvana. Directors: S. Bayer and K. Kerslake, 1991-1992
E. Reyes, 2013

40. Image Plot of the 2000 Rock Albums
Data from AllMusic.com, E. Reyes, 2013

41. Interactive Explorations
Hybrid Media Visualization, E. Reyes, 2013

42. Interactive Explorations
Software Studies Initiative, 2014

43. related work

44. • Pixelation: Pixel art, Goldberg and Flegal, 1982
• Averaging: Eigenfaces, Sirovich and Kirby, 1987
• Slicing: Slit-scan photographs, William Larson, 1967- 1970
• Slicing: Cinema Redux, Brendan Dawes, 2004

45. tools & software

46. • plotting and measuring: scripts for ImageJ
• plotting: scripts for MathLab
• analyzing: VisualSense
• analyzing: QtImageProcessing
• data handling: Mondrian (statistical operations)
• data handling and management: OpenRefine
• representation: custom tools with development tools
(Processing, Max/MSP, NodeBox, etc.)

47. Part 4.
Explorations in Media
Visualization

48. see how other domains use images

49. Video segmentation
Video Object Segmentation with Shortest Path
Zhang, Zao & Cao, 2012

50. Video traces
Sequence from 2001: A Space Odyssey (Kubrick, 1968)
MovieBarCode

51. Video summarization
Video summarization using singular value decomposition
Gong & Liu, 2000

52. Video annotation
Software application Lignes de Temps
IRI Centre Pompidou, Paris, 2009

53. Video cubes
Fels & Mase, 1999

54. 3D visualization & models

55. The RGB Color Space
Image from Wikipedia

56. Simulation of the Rayleigh-Taylor instability
Lawrence Livermore National Laboratory, 2007

57. Webforager
Stuart Card et al, 1996

58. 3D Hyperbolic Tree
Tamara Munzner, 1997

59. XanaduSpace
Ted Nelson, 2005

60. OntoSphere3D
Alesio Bosca, 2008

61. The Lava Visualization Tool
Stéfan Sinclair, 2010
http://voyeurtools.org/tool/Lava/

62. The invisible shape of things past
Art+Com, 1997

63. Field-Works
Masaki Fujihata, 2000

64. Post Mémoires
Fred Murie, 2011
http://www.fredmurie.net/travaux/2011/post-memoires1/face/

65. CLOUDS
James George & Jonathan Minard, 2012-2013

66. motion structures

67. VFX in the Film Inception (Nolan, 2010)
E. Reyes, 2011

68. Game of Thrones (Benioff & Weiss, 2011-2014)
E. Reyes, 2011

69. Game of Thrones (Benioff & Weiss, 2011-2014)
E. Reyes, 2011

70. Game of Thrones (Benioff & Weiss, 2011-2014)
E. Reyes, 2011

71. Charles Csuri, Hummingbird, 1967
E. Reyes, 2011

72. Charles Csuri, Hummingbird, 1967
E. Reyes, 2011

73. Peter Weibel, Endless Sandwich, 1969
E. Reyes, 2011

74. Bill Viola, Acceptance, 2008
E. Reyes, 2011

75. Game of Thrones (Benioff & Weiss, 2011-2014)
E. Reyes, 2011

76. 3D Print of Motion Structure
E. Reyes, 2011

77. disruptions

78. Disrupting 3D Models
E. Reyes, 2013

79. handmade & analog

80. Decomposing Parts. Exploded Views and Visual Ontography
Damián Ortega, Cosmic Thing, 2002

81. Hand-drawn Architectural Structures
François Blanciak, Siteless, 2008

82. Printed Text. Cut and Pasted According to Words
Ruecker et al, 2008

83. 4D & non-euclidean geometry

84. Elliptic and Hyperbolic Geometry

85. Kinetic Geometry (Hyperboloids of 2 and 1 Faces)

86. Polytopes, polyhedra, polychorons, tesselations

87. Manifolds

88. Rotation in 4D and Sphere Eversion

89. examples from art

90. Construction de l’espace-temps III
Theo van Doesburg, 1929

91. Composición Cósmica
Oscar Domínguez, 1938

92. Relativity
M.C. Escher, 1953

93. L'étang de No
Matta Echaurren, 1958

94. Museo Soumaya, México DF
Fernando Romero, 2011

95. examples of experimental projects

96. Messages vers le Futur
E. Reyes, 2012

97. Experimental Media Visualizations
E. Reyes, 2014

98. Miegakure
Marc Ten Bosch, 2014

99. Let’s imagine Miegakure + Oculus Rift.
Virtual Worlds allow to rethink, disrupt and experiment
the representation of reality as it has been perceived
by our senses so far

100. Conclusions

101. • close relationship between art, science and technology in
the evolution of data representation in graphical forms
!
• are we more interested in developing workflows rather than
new inventions, as it happened in early 20th Century?
!
• are we becoming more interested in representing space
rather than time?

102. Gracias por su atención
Dr. Everardo Reyes
Université de Paris 13
!
// ereyes.net