ClayVision is a new augmented reality system that transforms elements of a city in real-time based on a user's needs for navigation or information. It uses image processing and 3D modeling to map a live video feed onto virtual 3D models of buildings and streets. This allows the system to strategically modify visual attributes of models to emphasize certain areas or buildings to aid navigation. ClayVision offers advantages for urban planning and design over traditional augmented reality by manipulating the virtual environment rather than just overlaying information. Potential applications include improved navigation aids, panoramic city views, and manual interactions with models.

1. Presentation on
ClayVision:The Elastic Image of the City
By,
Darshan Mehta
3/8/2014
1

2. Contents










Introduction.
History.
Requirements.
Working.
Applications.
Advantages.
Disadvantages.
Future Scope.
Conclusion.
References.
3/8/2014
2

3. Introduction
Q. What is Clayvision?

It is a new quasi-immersive urban navigation
system that rethinks the design convention of
existing Augmented Reality (AR) applications.

Instead of “information bubbles” onto the urban
scenery, ClayVision communicates through realtime 3D transformations and video feed of the city
elements.
3/8/2014
3

4. 
In other words, the system reassembles the city into
a better-designed copy of the original, that is both
easier to navigate and tailored to suit the user’s
needs and preferences.
3/8/2014
4

5. History

There were many experimental systems built in the
mid 1990s ,which were marked by their bulky
setups and low frame rates.

Later on, due to the devices lacking the graphical
capabilities had to send camera images to the server
for each frame and increased computational burden.
3/8/2014
5

6. Contd..

The further developed AR technique lacks accuracy.
“Information bubble” display , the bubbles do not
have any absolute, exact positions within the 3-D
space.
3/8/2014
6

7. Requirements
 High
Speed Wireless Internet Connection.
 Hardware
Device having Camera and Display
Screen.
 A 3-D
Graphics Engine
-part of system.
-handles graphical simulation and interfaces.
3/8/2014
7

8. 3-D Graphics Engine
API is API ?
 What
-protocol used as interface by
software
for comm.
OpenGL ?
-routine , data structure, obj.
class….etc
GLUT ?
-libraries in c++ ,java API
3/8/2014
8

9. Application Programming Interface
Q. What is API ?
-protocol used as interface by software for
communication.
-routine , data structure, objects,Class etc.
-libraries in c++ ,java etc.
3/8/2014
9

10. OpenGL

OpenGL –Graphics Library.

OpenGL is used for graphics routine and other
coding.


OS independent.
Widely used in industry.
3/8/2014
10

11. What is GLUT?
GLUT is OpenGL Utility Toolkit
◦ Not part of OpenGL.
◦ “GLUT is designed for constructing small to
medium sized OpenGL programs.”
3/8/2014
11

12. OVERALL FLOW:
HARDWARE
DEVICE USED AS
INPUT
DATA IS DISPLAYED
IMAGE CAPTURING
DATA IS SENT TO
HARDWARE
DEVICE
IMAGE
PROCESSING
USE OF 3-D
GRAPHICS ENGINE
DATA SENT TO
SATELLITE
CORRELATION OF
CO-ORDINATES
3/8/2014
12

13. Image Processing:



Image processing of the video feed is done using
SIFT, which outputs a set of feature points and other
data used to determine the relative position of the
entire frame.
Scale-invariant feature transform (or SIFT) is an
algorithm in computer vision to detect and describe
local features in images.
Output is used to compare the video feed to the
database of pictures and the template pictures are
transformed based on the device’s specifications to
produce the correct pose.
3/8/2014
13

14. Contd..

After localization, projection and modelview
matrices are calculated to map 3D building models
onto the feed.

These models are then textured using information
from the feed and transformed to communicate
information to the user.

Texturing is done correctly by altering the image
background with template picture information in a
way that doesn’t disrupt the video and allows for
transformations that don’t cause excessive errors.
3/8/2014
14

15. Working

Each frame of the real-time video feed is compared
to a collection of photos, shot from the same
location using a device.

Attributes such as building shapes , colours ,
materials are modified so that they represent useful
information, thus increase the efficiency of visual
communication.

This is the approach taken by ClayVision.
3/8/2014
15

16. Applications:
In Model Mapping, The 3-D model of the required
sector is generated.
3-DMODEL MAPPING
3/8/2014
16

17. Navigation:

Buildings can be emphasized by strategically
changing their visual attributes.

Attaching fake facades , enhancing the height ,
adding false saturation levels can make us find the
given targeted building more quickly.
3/8/2014
17

18. Contd..

Navigation Comparisons:
3/8/2014
18

19. Advantages

It is will be very useful in the fields of urban
planning and design.

Navigation systems can be upgraded to a new
level using clayvision technology.

3-D Model Mapping is implemented using
Clayvision Technology
3/8/2014
19

20. Disadvantages

This design attracts a significant part of the user’s
attention, which may result in the user becoming
less attentive to other pedestrians, cars, etc., creating
a serious safety risk.

Slowdowns may occur, especially because of
network speed.
3/8/2014
20

21. Future Scope

Panorama creation: It can converge all major city
elements into a single screen.

Straightening streets: There are streets crooked,
extending in seemingly random directions. Clay
vision provides a clear view of what can be found
further down the road.

Manual interaction: Tapping or drawing on the
screen can be implemented for example cutting a
hole in a building to see what lies beyond.
3/8/2014
21

22. Conclusion

Thus ClayVision is a novel vision-based augmented
reality system that offers the experience of real-time
urban design. It is a set of techniques to enable
freeform transformations of built elements in the
city, and discussed a range of transformation
operations and their implications on the urban
experience.
3/8/2014
22

23. References

Yuichiro Takeuchi and Ken Perlin-Works on Clay
vision technology(IEEE Paper)
3/8/2014
23

24. Thank You
3/8/2014
24