Q. What is Clayvision?
It is a new quasi-immersive urban navigation
system that rethinks the design convention of
existing Augmented Reality (AR) applications.
Instead of “information bubbles” onto the urban
scenery, ClayVision communicates through realtime 3D transformations and video feed of the city
In other words, the system reassembles the city into
a better-designed copy of the original, that is both
easier to navigate and tailored to suit the user’s
needs and preferences.
There were many experimental systems built in the
mid 1990s ,which were marked by their bulky
setups and low frame rates.
Later on, due to the devices lacking the graphical
capabilities had to send camera images to the server
for each frame and increased computational burden.
The further developed AR technique lacks accuracy.
“Information bubble” display , the bubbles do not
have any absolute, exact positions within the 3-D
Speed Wireless Internet Connection.
Device having Camera and Display
-part of system.
-handles graphical simulation and interfaces.
3-D Graphics Engine
API is API ?
-protocol used as interface by
-routine , data structure, obj.
-libraries in c++ ,java API
Application Programming Interface
Q. What is API ?
-protocol used as interface by software for
-routine , data structure, objects,Class etc.
-libraries in c++ ,java etc.
OpenGL –Graphics Library.
OpenGL is used for graphics routine and other
Widely used in industry.
What is GLUT?
GLUT is OpenGL Utility Toolkit
◦ Not part of OpenGL.
◦ “GLUT is designed for constructing small to
medium sized OpenGL programs.”
DEVICE USED AS
DATA IS DISPLAYED
DATA IS SENT TO
USE OF 3-D
DATA SENT TO
Image processing of the video feed is done using
SIFT, which outputs a set of feature points and other
data used to determine the relative position of the
Scale-invariant feature transform (or SIFT) is an
algorithm in computer vision to detect and describe
local features in images.
Output is used to compare the video feed to the
database of pictures and the template pictures are
transformed based on the device’s specifications to
produce the correct pose.
After localization, projection and modelview
matrices are calculated to map 3D building models
onto the feed.
These models are then textured using information
from the feed and transformed to communicate
information to the user.
Texturing is done correctly by altering the image
background with template picture information in a
way that doesn’t disrupt the video and allows for
transformations that don’t cause excessive errors.
Each frame of the real-time video feed is compared
to a collection of photos, shot from the same
location using a device.
Attributes such as building shapes , colours ,
materials are modified so that they represent useful
information, thus increase the efficiency of visual
This is the approach taken by ClayVision.
In Model Mapping, The 3-D model of the required
sector is generated.
Buildings can be emphasized by strategically
changing their visual attributes.
Attaching fake facades , enhancing the height ,
adding false saturation levels can make us find the
given targeted building more quickly.
It is will be very useful in the fields of urban
planning and design.
Navigation systems can be upgraded to a new
level using clayvision technology.
3-D Model Mapping is implemented using
This design attracts a significant part of the user’s
attention, which may result in the user becoming
less attentive to other pedestrians, cars, etc., creating
a serious safety risk.
Slowdowns may occur, especially because of
Panorama creation: It can converge all major city
elements into a single screen.
Straightening streets: There are streets crooked,
extending in seemingly random directions. Clay
vision provides a clear view of what can be found
further down the road.
Manual interaction: Tapping or drawing on the
screen can be implemented for example cutting a
hole in a building to see what lies beyond.
Thus ClayVision is a novel vision-based augmented
reality system that offers the experience of real-time
urban design. It is a set of techniques to enable
freeform transformations of built elements in the
city, and discussed a range of transformation
operations and their implications on the urban
Yuichiro Takeuchi and Ken Perlin-Works on Clay
vision technology(IEEE Paper)