Explorations in media visualization

Explorations in Media Visualization

Dr. Everardo Reyes-Garcia

Université de Paris 13

!

PUC Santiago de Chile, September 1, 2014.

Datawiz 2014 | Data Visualization Workshop | ACM Hypertext

Part 1.

Brief review of dataviz

visual models

Cartesian

Networks

Infographics

Experimental

Network diagrams Visual Complexity, Manuel Lima

http://linkd.in/1lDsVbm

180+ links on dataviz | La liste des listes... de graphiques Claude-Henri Meledo, Visual Decision, 2011-2014

http://linkd.in/1lDsVbm

kinds of data

metadata

social records

transactions

preferences

hours

locations

connections

texts

… media

tools & software

D3.js

Two.js

Three.js

Processing.js

CartoDB

Quadrigram

RAW

Tableau

Vega

AntiType

CodeCity

Gephi

http://d3js.org/

http://jonobr1.github.io/two.js/

http://threejs.org/

http://processingjs.org/

http://cartodb.com/

http://www.quadrigram.com/

http://raw.densitydesign.org/

http://www.tableausoftware.com/

http://trifacta.github.io/vega/

http://www.anitype.com/

http://www.inf.usi.ch/phd/wettel/codecity.html

https://gephi.github.io/

Part 2.

Historical Review of Dataviz

graphical representation of movement

Development of Mathematics and Geometry Euclid, The Elements, c. 300 BC

First Representation of Movement Nicolas Oresme, Tractatus de configurationibus qualitatum et motuum, c. 1360

Geometry and Algebra: Cartesian Plane René Descartes, La Géométrie, 1637

capture of movement

Myograph Étienne-Jules Marey, La méthode graphique, 1876

Myograph Étienne-Jules Marey, La méthode graphique, 1876

Sequence of Photographs Eadweard Muybridge, The Horse in motion, 1878

From Image to its Abstraction Étienne-Jules Marey, Movement, 1895

Chronophotograph Étienne-Jules Marey, 1896

Precise Capture of Movement Frank Gilbreth, cyclographs, 1912

models of movement

Sculpture of Seagull in Successive Attitudes Étienne-Jules Marey, 1880

Cyclograph Constructed of Wire Frank Gilbreth, 1912

art and movement

Forms Appear Side by Side or Overlapping Marcel Duchamp, Nu descendant un escalier, 1912

Form of Movement Becomes of an Object of Expression Paul Klee, Blumen Mythos, 1918

Abstraction and Symbolism of Forms Wassily Kandinsky, Composition VIII, 1923

Representación artística de movimiento Joan Miró, Harlequin's Carnival, 1925

Part 3.

Media Visualization

principles & objectives

• an idea originated in 2005

• currently developed by the Software Studies Initiative

• analyzing visual media through visual media

• takes advantage of visual analytics and image processing

techniques to construct visual spaces of the information analyzed

some techniques

Pixelation from the Cover of Nevermind Music Performed by Nirvana. Produced by Butch Vig, 1991

E. Reyes, 2013

Image Averaging of the Video Clip Smells Like Teen Spirit Performed by Nirvana. Directed by S. Bayer, 1991

E. Reyes, 2013

Image Mosaic of the Video Clip Smells Like Teen Spirit Performed by Nirvana. Directed by S. Bayer, 1991

E. Reyes, 2013

Several Image Slicing Visualizations Music Performed by Nirvana. Directors: S. Bayer and K. Kerslake, 1991-1992

E. Reyes, 2013

Image Plot of the 2000 Rock Albums Data from AllMusic.com, E. Reyes, 2013

Interactive Explorations Hybrid Media Visualization, E. Reyes, 2013

Interactive Explorations Software Studies Initiative, 2014

related work

• Pixelation: Pixel art, Goldberg and Flegal, 1982

• Averaging: Eigenfaces, Sirovich and Kirby, 1987

• Slicing: Slit-scan photographs, William Larson, 1967- 1970

• Slicing: Cinema Redux, Brendan Dawes, 2004

tools & software

• plotting and measuring: scripts for ImageJ

• plotting: scripts for MathLab

• analyzing: VisualSense

• analyzing: QtImageProcessing

• data handling: Mondrian (statistical operations)

• data handling and management: OpenRefine

• representation: custom tools with development tools

(Processing, Max/MSP, NodeBox, etc.)

Part 4.

Explorations in Media Visualization

see how other domains use images

Video segmentation Video Object Segmentation with Shortest Path

Zhang, Zao & Cao, 2012

Video traces Sequence from 2001: A Space Odyssey (Kubrick, 1968)

MovieBarCode

Video summarization Video summarization using singular value decomposition

Gong & Liu, 2000

Video annotation Software application Lignes de Temps

IRI Centre Pompidou, Paris, 2009

Video cubes Fels & Mase, 1999

3D visualization & models

The RGB Color Space Image from Wikipedia

Simulation of the Rayleigh-Taylor instability Lawrence Livermore National Laboratory, 2007

Webforager Stuart Card et al, 1996

3D Hyperbolic Tree Tamara Munzner, 1997

XanaduSpace Ted Nelson, 2005

OntoSphere3D Alesio Bosca, 2008

The Lava Visualization Tool Stéfan Sinclair, 2010

http://voyeurtools.org/tool/Lava/

The invisible shape of things past Art+Com, 1997

Field-Works Masaki Fujihata, 2000

Post Mémoires Fred Murie, 2011

http://www.fredmurie.net/travaux/2011/post-memoires1/face/

CLOUDS James George & Jonathan Minard, 2012-2013

motion structures

VFX in the Film Inception (Nolan, 2010) E. Reyes, 2011

Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011

Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011

Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011

Charles Csuri, Hummingbird, 1967 E. Reyes, 2011

Charles Csuri, Hummingbird, 1967 E. Reyes, 2011

Peter Weibel, Endless Sandwich, 1969 E. Reyes, 2011

Bill Viola, Acceptance, 2008 E. Reyes, 2011

Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011

3D Print of Motion Structure E. Reyes, 2011

disruptions

Disrupting 3D Models E. Reyes, 2013

handmade & analog

Decomposing Parts. Exploded Views and Visual Ontography Damián Ortega, Cosmic Thing, 2002

Hand-drawn Architectural Structures François Blanciak, Siteless, 2008

Printed Text. Cut and Pasted According to Words Ruecker et al, 2008

4D & non-euclidean geometry

Elliptic and Hyperbolic Geometry

Kinetic Geometry (Hyperboloids of 2 and 1 Faces)

Polytopes, polyhedra, polychorons, tesselations

Manifolds

Rotation in 4D and Sphere Eversion

examples from art

Construction de l’espace-temps III Theo van Doesburg, 1929

Composición Cósmica Oscar Domínguez, 1938

Relativity M.C. Escher, 1953

L'étang de No Matta Echaurren, 1958

Museo Soumaya, México DF Fernando Romero, 2011

examples of experimental projects

Messages vers le Futur E. Reyes, 2012

Experimental Media Visualizations E. Reyes, 2014

Miegakure Marc Ten Bosch, 2014

Let’s imagine Miegakure + Oculus Rift.

Virtual Worlds allow to rethink, disrupt and experiment

the representation of reality as it has been perceived

by our senses so far

Conclusions

• close relationship between art, science and technology in

the evolution of data representation in graphical forms

!

• are we more interested in developing workflows rather than

new inventions, as it happened in early 20th Century?

!

• are we becoming more interested in representing space

rather than time?

Gracias por su atenciónDr. Everardo Reyes

Université de Paris 13

!// ereyes.net