SlideShare a Scribd company logo
The Sound of the City
Virtual city viewed in real-time. The camera moves according to the viewer’s voice.
Presentation of
Digital Design Projects
Projects created and produced by Jean-Marc Gauthier
All Rights Reserved 2015
The Brain Project
Interactive navigation inside the brain
This interactive visualization is designed for a neurosurgeon in the operating room.
The viewer can navigate the virtual brain in any direction using head movements
regardless of the orientation of the original slices of the MRI.
A web browser allows 3D navigation inside a brain using a cloud of voxels, or pixels located in space. Since the imag-
es of the brain are displayed in space, they can be visited from many angles, including new angles that could not be
viewed in the original pictures.
Link to the website tinkering.net/brain/
Dust
3D animation transferred to 35mm film
Created for Melvin Motti’s installation “From Dust to Dust”
Link to the website
Click on the image to watch the video Click on the image to watch the video
BeCity
Illustrations for a children book and animations
“Be City” is an animation and transmedia project selected by the festival
“Anthropologie Numerique 2014”, France. The adaptation of the story includes a
traditional children’s book, an app with interactive illustrations and short animations on the web.
Click on this image to view the website Click on this image to view the animation
Link to the interactive illustrations
Readers can use the app to associate pictures of the book with animations stored on the device.
Scenes of the journey back in time to 1937 Berlin.
The bottom picture shows the compositing of a 3D character on top of the hand drawn illustration.
BeCity
Illustrations for a children book, app and animations
Click on this image for the interactive scenes in 1937 BerlinClick on this image to view the web animation
The time travel scenes use a cinematic look and feel and lighting inspired by film noir.
The outdoor scenes combine the look and feel of a sketchbook, watercolor drawings and
renderings of 3D models designed for the time travel expedition.
Click on this image to view the web animation
On the top, digital oil paint brushes and 3D print.
On the right, digital oil paint brushes were used for the renderings of the city.
BeCity
Illustrations for a children book, app and animations
BeCity
Character design
3D print rendering of 3D model with painted texture digital watercolor
3D print
Rendering and post-production
Ink pen
Link to the interactive illustrations
Digital markers, tablet, Procreate
Hommage a Jean-Claude Forest,
Personal research
Character Design
Crayon Conte
The Krokos
Character Design
Ink pen
“Now my life is going to be different.”
...Your wife and I. It was love at first sight. Monaco, the balcony of the Grand Hotel.
That’s ok. I forgive you.
Both of us will miss little Suzy.
Poor Kroko,
I am never going to tell him that
I meet Suzy tonight in Monaco..
“Kroko, my friend. This is terrible news that Suzy left you.
I have a story to tell you...”
The Krokos
Character Design
Ink pen
Gicle prints for an exhibition
New York City, 1997
IRIS prints, hand drawn sketches, color pencils, markers, frames from videos
Medical illustrations and interactive animations
NYU School of MedicineIllustrations for a book about virtual spaces.
ITP website
Web design and code
Tisch School of the Arts, New York City.
Birds Project
Jean-Marc Gauthier and Mark Young Stoeckle from The Barcode of Life project, The Rockefeller University, created a 3D
interactive visualization tool showing world bird species in 27 orders. The visualization includes names, texts, pictures, 3D
models and animations. Link to the website.
Crosswalk
Joint project with Dr Lei Liu
Client: Lei Liu, Phd, UAB- Vision Science Research Center, University of
Alabama, USA
More at http://www.tinkering.net/portfolio2014/page2/index5.html
What they wrote: Testimonial from Professor Lei Liu, PhD
“We credit our success to the high-quality and excellent performance of the virtual reality simulator
and street intersection scenarios that you built.
The virtual reality simulator and street intersection scenarios have the high visual resolution, wide
field of view and high contrast we need. The car and pedestrian traffic is very smooth and traffic
rules are strictly followed.
The street intersections are true 3D models, which allow us to set up a wide range of street
crossing scenarios by moving the virtual cameras around.
This is a very powerful research tool, an envy of many of my fellow researchers.”
Click on the image to see the webpage
Lake
Procedural animation and visualization project
Procedural animations recreate a digital painting of a lake with atmospheric effects: clouds,
waves and reflections. The painting changes according to the data received from live video and
the web.
0 s
20 s
40 s
60 s
In the case of Crosswalk, the simulator is designed to be operated by anyone.
It has a visual user interface, a menu, which allows to make choices and to
change the parameters of the scene. It can save a user profile in order to
repeat a session. The maintenance was done remotely.
We designed a robust system that does not break during long sessions with
many different users. We designed a custom built single PC with several
video cards that could manage all the screens and the sound. This was
created in order to cut latency and to improve the overall speed of the whole
system. In other words, we were interested in the speed of the whole system
from the point of view of the viewer’s eyes and ears. This may be much slower
than the speed of the hardware because of long wiring, the refresh speed of
the video projector, the location of speakers in the room.
We chose a system that allowed to develop one version of the content that
could be used on various media: web browser/tablet based application, in
addition to the simulator.
Click on the image to watch the video
The display is a very important part of the viewers experience of an
installation. Crosswalk uses an immersive 3 screens display technology
that allows seamless visuals between the screens. This is an important
element of suspension of disbelief for the viewer or the user.
The visuals on the 3 screens are captured by a node of three virtual
cameras located inside the virtual world. The virtual cameras are centered
on the user standing inside the physical space. The main innovation has
been to achieve a 15 ms synchronization between moving images of the
cars and the moving sound nodes attached to the engines of the cars.
Top view of the installation showing the projectors and the screen. This display
will provide a front and peripheral vision which are accurate for the viewer.
This ongoing project offers an interactive experience of a car(s) connected to pedestrians and the
space around them. What about a connected car that reacts to people and to its environment?
The goal of the installation is to present a digital road and a connected car that send messages
and display information when pedestrians are in the vicinity of the
car. The surface of the road and some of the car body panels display real time visual
communication between pedestrians and the connected vehicle.
Interactive installation for connected cars
The connected car project is an interactive installation showing a car that reacts to the presence
of pedestrians. The connected car and the visitors of the installation are
on top of a digital floor that reacts in real time with visuals and sounds when they walk towards
the car.
3D map with dynamic behaviours = a traffic simulator
Brief: Show me the traffic in real time
Goal: Finding information using a dynamic 3D map
Design: An interactive camera shows a global view of the traffic during a 24 hour period.
Interactive Urban Simulator Jean-Marc Gauthier
Click on the images to watch the videos
Password jmg
City viewed through a spherical virtual camera
3D map for smartphonesInteractive installations at FMX Stuttgard
(Germany), Daegu (South Korea)
On top, this is the 3D model of Manhattan used for this project. All the sperical projections where
done in camera and in real-time. The viewer can navigate inside a 3D map of Manhattan (New
York) without the need to scroll the map. The background of the map is made of personal pictures
stored on the phone.
Click on the image to watch the video
3D map for smartphonesInteractive installations at FMX Stuttgard
(Germany), Daegu (South Korea)
Infinite City Virtual reality installation with J. Tunick and M. Kirov,
Convergence, Chelsea Art Museum, NYC, USA
1. Refers to a collective memory
of the shape of the city.
3D map for mobile phones
Request: “Show me Bryant Park.”
Answer comes in three interactive steps.
2. Reduce Urban Complexity 3. A personal interactive experience
Design of a motion capture pod using a markerless system with Organic
Motion technology. Sony Wonder, New York, USA
See a project using Organic Motion at
http://www.tinkering.net/portfolio2013/siggraph2010.pdf
Watch video at http://vimeo.com/60890086
Organic Motion has a markerless mocap system that offers a lot of flexibility. It
captures the movements of the viewer walking freely inside of a 3D volume. This
system is compatible with video projections on screens.
Design and setup of a Motion Capture Lab markerless system using
Organic Motion technology.
ANDA, Tisch School of the Arts Asia, New York University, Singapore
Recapturing Life Class Instructors Jean-Marc Gauthier and Chris Bregler
Click on the image to watch the video
Artistic and technical details of the Virtual Garden (Kinect) installation at ArtScience
Museum, Marina Bay Sands, Singapore, 2013
Based on the concept of the 3D storyboard, I created this example of one-on-one
interaction between a viewer and a virtual world projected on the screen. Using
motion capture, the actor holds a sphere that tracks the right hand. This technique
is useful in expressing the interaction and the ‘look and feel’ of touching virtual
objects.
Virtual Garden Jean-Marc Gauthier
installation at ArtsScience Museum, Marina Bay Sands, Singapore 2013
Crayons
interactive installation, Affordable Art Fair, Singapore
Virtual Garden
interactive installation, ArtScience Museum, Marina Bay, Singapore
Motion capture performance allows animators to create scenes from a story.
Animators can map a three-dimensional scene of a story inside the motion
capture volume. This offers the possibility for the study of the interactions
between actors, animated characters and the elements of a scene.
Read about “Virtual Flowers” an interactive installation using Kinect
http://www.tinkering.net/portfolio2014/flower.pdf
Nighthawks
Urban 3D game installation, Festival 1ier Contact, Issy, France
Link to the website.
What they wrote:
Noa Steimatsky, Phd,
Associate Professor of the History of Art and Film Studies, Yale University
“He understands better than many theoreticians, I think, the imaginary dimensions
of actual space and, at the same time, the practial implications and responsibilities
of virtual space.”
“Jean-Marc’s analysis helped me ask myself some old questions in new ways:
on optics and mental process which are so often used as metaphors for each
other, on how cinemas’s mode of articulation- camera, movement, framing,
editing - informs us about viewing habits generally, and about how those may be
subverted.”

More Related Content

What's hot

Virtual reality report
Virtual reality reportVirtual reality report
Virtual reality report
Sumit Kumar Sharma
 
Reach into the computer & grab a pixel
Reach into the computer & grab a pixelReach into the computer & grab a pixel
Reach into the computer & grab a pixel
KIIT University
 
COSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARCOSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARMark Billinghurst
 
Google Cardboard Virtual Reality
Google Cardboard Virtual RealityGoogle Cardboard Virtual Reality
Google Cardboard Virtual RealityVicky VikRanth
 
Hi tech courses
Hi tech coursesHi tech courses
Hi tech courses
Hi-Tech Animation
 
Augmented Reality: The Next 20 Years
Augmented Reality: The Next 20 YearsAugmented Reality: The Next 20 Years
Augmented Reality: The Next 20 Years
Mark Billinghurst
 
Prayas session cgi & cga by – soumalya nandy
Prayas session cgi & cga by – soumalya nandyPrayas session cgi & cga by – soumalya nandy
Prayas session cgi & cga by – soumalya nandy
Tenet Systems Pvt Ltd
 
Green Robot Studio Malaysia
Green Robot Studio Malaysia  Green Robot Studio Malaysia
Green Robot Studio Malaysia
Zappy Production Sdn Bhd
 
Visualizing a New Christchurch
Visualizing a New ChristchurchVisualizing a New Christchurch
Visualizing a New Christchurch
Mark Billinghurst
 
animation
animationanimation
animation
trisha_pineda05
 
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
Junie Kwon
 
Experience Design for Mobile Augmented Reality
Experience Design for Mobile Augmented RealityExperience Design for Mobile Augmented Reality
Experience Design for Mobile Augmented RealityLightning Laboratories
 
Nicolae_Denut_Theses
Nicolae_Denut_ThesesNicolae_Denut_Theses
Nicolae_Denut_ThesesNicolae Denut
 
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
Nancy Amoroso
 
CGI technology in movie
CGI technology in movieCGI technology in movie
CGI technology in movie
Soumyajit Adhya
 
ARCONA AUGMENTED REALITY METAVERSE
ARCONA AUGMENTED REALITY METAVERSE ARCONA AUGMENTED REALITY METAVERSE
ARCONA AUGMENTED REALITY METAVERSE
Ilia Korguzalov
 
The creative internet: 106 things
The creative internet: 106 things The creative internet: 106 things
The creative internet: 106 things Shane Smith
 
Cg film and animation presentation
Cg film and animation presentationCg film and animation presentation
Cg film and animation presentationMeng Eu
 

What's hot (20)

Virtual reality report
Virtual reality reportVirtual reality report
Virtual reality report
 
Reach into the computer & grab a pixel
Reach into the computer & grab a pixelReach into the computer & grab a pixel
Reach into the computer & grab a pixel
 
COSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to ARCOSC 426 Lect. 1 - Introduction to AR
COSC 426 Lect. 1 - Introduction to AR
 
Google Cardboard Virtual Reality
Google Cardboard Virtual RealityGoogle Cardboard Virtual Reality
Google Cardboard Virtual Reality
 
Hi tech courses
Hi tech coursesHi tech courses
Hi tech courses
 
Holographic
HolographicHolographic
Holographic
 
Augmented Reality: The Next 20 Years
Augmented Reality: The Next 20 YearsAugmented Reality: The Next 20 Years
Augmented Reality: The Next 20 Years
 
Prayas session cgi & cga by – soumalya nandy
Prayas session cgi & cga by – soumalya nandyPrayas session cgi & cga by – soumalya nandy
Prayas session cgi & cga by – soumalya nandy
 
Green Robot Studio Malaysia
Green Robot Studio Malaysia  Green Robot Studio Malaysia
Green Robot Studio Malaysia
 
Visualizing a New Christchurch
Visualizing a New ChristchurchVisualizing a New Christchurch
Visualizing a New Christchurch
 
animation
animationanimation
animation
 
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
[Publication] Creative Social VR Practices in Connected Environments: The 5G ...
 
Experience Design for Mobile Augmented Reality
Experience Design for Mobile Augmented RealityExperience Design for Mobile Augmented Reality
Experience Design for Mobile Augmented Reality
 
Nicolae_Denut_Theses
Nicolae_Denut_ThesesNicolae_Denut_Theses
Nicolae_Denut_Theses
 
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
Cognitive Systems Institute Group Speaker Series - Virtual Reality, Game Desi...
 
CGI technology in movie
CGI technology in movieCGI technology in movie
CGI technology in movie
 
ARCONA AUGMENTED REALITY METAVERSE
ARCONA AUGMENTED REALITY METAVERSE ARCONA AUGMENTED REALITY METAVERSE
ARCONA AUGMENTED REALITY METAVERSE
 
Ms2
Ms2Ms2
Ms2
 
The creative internet: 106 things
The creative internet: 106 things The creative internet: 106 things
The creative internet: 106 things
 
Cg film and animation presentation
Cg film and animation presentationCg film and animation presentation
Cg film and animation presentation
 

Viewers also liked

Vikkie_Chen_Portfolio2015_web_spread
Vikkie_Chen_Portfolio2015_web_spreadVikkie_Chen_Portfolio2015_web_spread
Vikkie_Chen_Portfolio2015_web_spreadVikkie Chen
 
Real-Time Non-Photorealistic Shadow Rendering
Real-Time Non-Photorealistic Shadow RenderingReal-Time Non-Photorealistic Shadow Rendering
Real-Time Non-Photorealistic Shadow Rendering
Tamás Martinec
 
Junior Year Portfolio
Junior Year PortfolioJunior Year Portfolio
Junior Year Portfolio
Andrew Foy
 
Portfolio
PortfolioPortfolio
Portfolio
Andrew Foy
 
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
Adlib - The PDF Experts
 
CS 354 Vector Graphics & Path Rendering
CS 354 Vector Graphics & Path RenderingCS 354 Vector Graphics & Path Rendering
CS 354 Vector Graphics & Path Rendering
Mark Kilgard
 
2010 Interior Design Portfolio
2010 Interior Design Portfolio2010 Interior Design Portfolio
2010 Interior Design Portfolio
Charissa.Williams
 

Viewers also liked (8)

HA1 Task 1 - Technical File
HA1 Task 1 - Technical FileHA1 Task 1 - Technical File
HA1 Task 1 - Technical File
 
Vikkie_Chen_Portfolio2015_web_spread
Vikkie_Chen_Portfolio2015_web_spreadVikkie_Chen_Portfolio2015_web_spread
Vikkie_Chen_Portfolio2015_web_spread
 
Real-Time Non-Photorealistic Shadow Rendering
Real-Time Non-Photorealistic Shadow RenderingReal-Time Non-Photorealistic Shadow Rendering
Real-Time Non-Photorealistic Shadow Rendering
 
Junior Year Portfolio
Junior Year PortfolioJunior Year Portfolio
Junior Year Portfolio
 
Portfolio
PortfolioPortfolio
Portfolio
 
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
WEBINAR PRESENTATION: Controlling critical documents with Dassault Systemes E...
 
CS 354 Vector Graphics & Path Rendering
CS 354 Vector Graphics & Path RenderingCS 354 Vector Graphics & Path Rendering
CS 354 Vector Graphics & Path Rendering
 
2010 Interior Design Portfolio
2010 Interior Design Portfolio2010 Interior Design Portfolio
2010 Interior Design Portfolio
 

Similar to Gauthier_digitaldesign_portfolios

Hihihihihihihivivivirtual reality.ppt.pptx
Hihihihihihihivivivirtual reality.ppt.pptxHihihihihihihivivivirtual reality.ppt.pptx
Hihihihihihihivivivirtual reality.ppt.pptx
fijomiy607
 
virtual reality Barkha manral seminar on augmented reality.ppt
virtual reality Barkha manral seminar on augmented reality.pptvirtual reality Barkha manral seminar on augmented reality.ppt
virtual reality Barkha manral seminar on augmented reality.ppt
Barkha Manral
 
Virtual environments in design education
Virtual environments in design educationVirtual environments in design education
Virtual environments in design educationShubh Cheema
 
Motion & Gesture Interactions in the digital age
Motion & Gesture Interactions in the digital ageMotion & Gesture Interactions in the digital age
Motion & Gesture Interactions in the digital age
Antonio De Pasquale
 
Codemotion2013depasquale
Codemotion2013depasqualeCodemotion2013depasquale
Codemotion2013depasquale
Vera Kovaleva
 
COMUTER GRAPHICS NOTES
COMUTER GRAPHICS NOTESCOMUTER GRAPHICS NOTES
COMUTER GRAPHICS NOTESho58
 
Cg notes
Cg notesCg notes
Cg notes
Singston_Albert
 
Virtual Art Gallery
Virtual Art GalleryVirtual Art Gallery
Virtual Art Gallery
IRJET Journal
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
Kshitij Mittal
 
T E L E I M M E R S I O N
T E L E  I M M E R S I O NT E L E  I M M E R S I O N
T E L E I M M E R S I O N
ronak patel
 
Tele immersion
Tele immersionTele immersion
Tele immersion
ronak patel
 
Rp2 published
Rp2 publishedRp2 published
Rp2 publishedAman Jain
 
Augmented Reality
Augmented Reality Augmented Reality
Augmented Reality Kiran Kumar
 
Elec Virtual Reality PPT.pptx
Elec Virtual Reality PPT.pptxElec Virtual Reality PPT.pptx
Elec Virtual Reality PPT.pptx
Josepheapan
 
Sixth Sense Technology
Sixth Sense Technology Sixth Sense Technology
Sixth Sense Technology
Arjun R Krishna
 
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
Jan Groenefeld
 
IRJET-Space Invaders: An Educational Game in Virtual Reality
IRJET-Space Invaders: An Educational Game in Virtual RealityIRJET-Space Invaders: An Educational Game in Virtual Reality
IRJET-Space Invaders: An Educational Game in Virtual Reality
IRJET Journal
 
Design in motion. The new frontier of interaction design
Design in motion. The new frontier of interaction designDesign in motion. The new frontier of interaction design
Design in motion. The new frontier of interaction design
Antonio De Pasquale
 

Similar to Gauthier_digitaldesign_portfolios (20)

Hihihihihihihivivivirtual reality.ppt.pptx
Hihihihihihihivivivirtual reality.ppt.pptxHihihihihihihivivivirtual reality.ppt.pptx
Hihihihihihihivivivirtual reality.ppt.pptx
 
virtual reality Barkha manral seminar on augmented reality.ppt
virtual reality Barkha manral seminar on augmented reality.pptvirtual reality Barkha manral seminar on augmented reality.ppt
virtual reality Barkha manral seminar on augmented reality.ppt
 
Virtual environments in design education
Virtual environments in design educationVirtual environments in design education
Virtual environments in design education
 
Motion & Gesture Interactions in the digital age
Motion & Gesture Interactions in the digital ageMotion & Gesture Interactions in the digital age
Motion & Gesture Interactions in the digital age
 
Codemotion2013depasquale
Codemotion2013depasqualeCodemotion2013depasquale
Codemotion2013depasquale
 
COMUTER GRAPHICS NOTES
COMUTER GRAPHICS NOTESCOMUTER GRAPHICS NOTES
COMUTER GRAPHICS NOTES
 
Cg notes
Cg notesCg notes
Cg notes
 
Virtual Art Gallery
Virtual Art GalleryVirtual Art Gallery
Virtual Art Gallery
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
T E L E I M M E R S I O N
T E L E  I M M E R S I O NT E L E  I M M E R S I O N
T E L E I M M E R S I O N
 
Tele immersion
Tele immersionTele immersion
Tele immersion
 
Rp2 published
Rp2 publishedRp2 published
Rp2 published
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
Augmented Reality
Augmented Reality Augmented Reality
Augmented Reality
 
Elec Virtual Reality PPT.pptx
Elec Virtual Reality PPT.pptxElec Virtual Reality PPT.pptx
Elec Virtual Reality PPT.pptx
 
CMPE- 280-Research_paper
CMPE- 280-Research_paperCMPE- 280-Research_paper
CMPE- 280-Research_paper
 
Sixth Sense Technology
Sixth Sense Technology Sixth Sense Technology
Sixth Sense Technology
 
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
TestingTime - Guest Article - let’s save the world—democracy, inclusion and s...
 
IRJET-Space Invaders: An Educational Game in Virtual Reality
IRJET-Space Invaders: An Educational Game in Virtual RealityIRJET-Space Invaders: An Educational Game in Virtual Reality
IRJET-Space Invaders: An Educational Game in Virtual Reality
 
Design in motion. The new frontier of interaction design
Design in motion. The new frontier of interaction designDesign in motion. The new frontier of interaction design
Design in motion. The new frontier of interaction design
 

Gauthier_digitaldesign_portfolios

  • 1. The Sound of the City Virtual city viewed in real-time. The camera moves according to the viewer’s voice. Presentation of Digital Design Projects Projects created and produced by Jean-Marc Gauthier All Rights Reserved 2015
  • 2. The Brain Project Interactive navigation inside the brain This interactive visualization is designed for a neurosurgeon in the operating room. The viewer can navigate the virtual brain in any direction using head movements regardless of the orientation of the original slices of the MRI. A web browser allows 3D navigation inside a brain using a cloud of voxels, or pixels located in space. Since the imag- es of the brain are displayed in space, they can be visited from many angles, including new angles that could not be viewed in the original pictures. Link to the website tinkering.net/brain/ Dust 3D animation transferred to 35mm film Created for Melvin Motti’s installation “From Dust to Dust” Link to the website Click on the image to watch the video Click on the image to watch the video
  • 3. BeCity Illustrations for a children book and animations “Be City” is an animation and transmedia project selected by the festival “Anthropologie Numerique 2014”, France. The adaptation of the story includes a traditional children’s book, an app with interactive illustrations and short animations on the web. Click on this image to view the website Click on this image to view the animation Link to the interactive illustrations
  • 4. Readers can use the app to associate pictures of the book with animations stored on the device. Scenes of the journey back in time to 1937 Berlin. The bottom picture shows the compositing of a 3D character on top of the hand drawn illustration. BeCity Illustrations for a children book, app and animations Click on this image for the interactive scenes in 1937 BerlinClick on this image to view the web animation
  • 5. The time travel scenes use a cinematic look and feel and lighting inspired by film noir. The outdoor scenes combine the look and feel of a sketchbook, watercolor drawings and renderings of 3D models designed for the time travel expedition. Click on this image to view the web animation
  • 6. On the top, digital oil paint brushes and 3D print. On the right, digital oil paint brushes were used for the renderings of the city. BeCity Illustrations for a children book, app and animations
  • 7. BeCity Character design 3D print rendering of 3D model with painted texture digital watercolor 3D print Rendering and post-production Ink pen Link to the interactive illustrations
  • 8. Digital markers, tablet, Procreate Hommage a Jean-Claude Forest, Personal research Character Design Crayon Conte
  • 9. The Krokos Character Design Ink pen “Now my life is going to be different.” ...Your wife and I. It was love at first sight. Monaco, the balcony of the Grand Hotel. That’s ok. I forgive you. Both of us will miss little Suzy. Poor Kroko, I am never going to tell him that I meet Suzy tonight in Monaco.. “Kroko, my friend. This is terrible news that Suzy left you. I have a story to tell you...” The Krokos Character Design Ink pen
  • 10. Gicle prints for an exhibition New York City, 1997 IRIS prints, hand drawn sketches, color pencils, markers, frames from videos
  • 11. Medical illustrations and interactive animations NYU School of MedicineIllustrations for a book about virtual spaces.
  • 12. ITP website Web design and code Tisch School of the Arts, New York City. Birds Project Jean-Marc Gauthier and Mark Young Stoeckle from The Barcode of Life project, The Rockefeller University, created a 3D interactive visualization tool showing world bird species in 27 orders. The visualization includes names, texts, pictures, 3D models and animations. Link to the website.
  • 13. Crosswalk Joint project with Dr Lei Liu Client: Lei Liu, Phd, UAB- Vision Science Research Center, University of Alabama, USA More at http://www.tinkering.net/portfolio2014/page2/index5.html What they wrote: Testimonial from Professor Lei Liu, PhD “We credit our success to the high-quality and excellent performance of the virtual reality simulator and street intersection scenarios that you built. The virtual reality simulator and street intersection scenarios have the high visual resolution, wide field of view and high contrast we need. The car and pedestrian traffic is very smooth and traffic rules are strictly followed. The street intersections are true 3D models, which allow us to set up a wide range of street crossing scenarios by moving the virtual cameras around. This is a very powerful research tool, an envy of many of my fellow researchers.” Click on the image to see the webpage Lake Procedural animation and visualization project Procedural animations recreate a digital painting of a lake with atmospheric effects: clouds, waves and reflections. The painting changes according to the data received from live video and the web. 0 s 20 s 40 s 60 s
  • 14. In the case of Crosswalk, the simulator is designed to be operated by anyone. It has a visual user interface, a menu, which allows to make choices and to change the parameters of the scene. It can save a user profile in order to repeat a session. The maintenance was done remotely. We designed a robust system that does not break during long sessions with many different users. We designed a custom built single PC with several video cards that could manage all the screens and the sound. This was created in order to cut latency and to improve the overall speed of the whole system. In other words, we were interested in the speed of the whole system from the point of view of the viewer’s eyes and ears. This may be much slower than the speed of the hardware because of long wiring, the refresh speed of the video projector, the location of speakers in the room. We chose a system that allowed to develop one version of the content that could be used on various media: web browser/tablet based application, in addition to the simulator. Click on the image to watch the video The display is a very important part of the viewers experience of an installation. Crosswalk uses an immersive 3 screens display technology that allows seamless visuals between the screens. This is an important element of suspension of disbelief for the viewer or the user. The visuals on the 3 screens are captured by a node of three virtual cameras located inside the virtual world. The virtual cameras are centered on the user standing inside the physical space. The main innovation has been to achieve a 15 ms synchronization between moving images of the cars and the moving sound nodes attached to the engines of the cars. Top view of the installation showing the projectors and the screen. This display will provide a front and peripheral vision which are accurate for the viewer.
  • 15. This ongoing project offers an interactive experience of a car(s) connected to pedestrians and the space around them. What about a connected car that reacts to people and to its environment? The goal of the installation is to present a digital road and a connected car that send messages and display information when pedestrians are in the vicinity of the car. The surface of the road and some of the car body panels display real time visual communication between pedestrians and the connected vehicle. Interactive installation for connected cars The connected car project is an interactive installation showing a car that reacts to the presence of pedestrians. The connected car and the visitors of the installation are on top of a digital floor that reacts in real time with visuals and sounds when they walk towards the car. 3D map with dynamic behaviours = a traffic simulator Brief: Show me the traffic in real time Goal: Finding information using a dynamic 3D map Design: An interactive camera shows a global view of the traffic during a 24 hour period. Interactive Urban Simulator Jean-Marc Gauthier Click on the images to watch the videos Password jmg
  • 16. City viewed through a spherical virtual camera 3D map for smartphonesInteractive installations at FMX Stuttgard (Germany), Daegu (South Korea) On top, this is the 3D model of Manhattan used for this project. All the sperical projections where done in camera and in real-time. The viewer can navigate inside a 3D map of Manhattan (New York) without the need to scroll the map. The background of the map is made of personal pictures stored on the phone. Click on the image to watch the video 3D map for smartphonesInteractive installations at FMX Stuttgard (Germany), Daegu (South Korea)
  • 17. Infinite City Virtual reality installation with J. Tunick and M. Kirov, Convergence, Chelsea Art Museum, NYC, USA 1. Refers to a collective memory of the shape of the city. 3D map for mobile phones Request: “Show me Bryant Park.” Answer comes in three interactive steps. 2. Reduce Urban Complexity 3. A personal interactive experience
  • 18. Design of a motion capture pod using a markerless system with Organic Motion technology. Sony Wonder, New York, USA See a project using Organic Motion at http://www.tinkering.net/portfolio2013/siggraph2010.pdf Watch video at http://vimeo.com/60890086 Organic Motion has a markerless mocap system that offers a lot of flexibility. It captures the movements of the viewer walking freely inside of a 3D volume. This system is compatible with video projections on screens. Design and setup of a Motion Capture Lab markerless system using Organic Motion technology. ANDA, Tisch School of the Arts Asia, New York University, Singapore Recapturing Life Class Instructors Jean-Marc Gauthier and Chris Bregler Click on the image to watch the video
  • 19. Artistic and technical details of the Virtual Garden (Kinect) installation at ArtScience Museum, Marina Bay Sands, Singapore, 2013 Based on the concept of the 3D storyboard, I created this example of one-on-one interaction between a viewer and a virtual world projected on the screen. Using motion capture, the actor holds a sphere that tracks the right hand. This technique is useful in expressing the interaction and the ‘look and feel’ of touching virtual objects. Virtual Garden Jean-Marc Gauthier installation at ArtsScience Museum, Marina Bay Sands, Singapore 2013
  • 20. Crayons interactive installation, Affordable Art Fair, Singapore Virtual Garden interactive installation, ArtScience Museum, Marina Bay, Singapore Motion capture performance allows animators to create scenes from a story. Animators can map a three-dimensional scene of a story inside the motion capture volume. This offers the possibility for the study of the interactions between actors, animated characters and the elements of a scene. Read about “Virtual Flowers” an interactive installation using Kinect http://www.tinkering.net/portfolio2014/flower.pdf
  • 21. Nighthawks Urban 3D game installation, Festival 1ier Contact, Issy, France Link to the website. What they wrote: Noa Steimatsky, Phd, Associate Professor of the History of Art and Film Studies, Yale University “He understands better than many theoreticians, I think, the imaginary dimensions of actual space and, at the same time, the practial implications and responsibilities of virtual space.” “Jean-Marc’s analysis helped me ask myself some old questions in new ways: on optics and mental process which are so often used as metaphors for each other, on how cinemas’s mode of articulation- camera, movement, framing, editing - informs us about viewing habits generally, and about how those may be subverted.”