Presentation on
ClayVision:The Elastic Image of the City

By,

Darshan Mehta

3/8/2014

1
Contents












Introduction.
History.
Requirements.
Working.
Applications.
Advantages.
Disadvantages.
Futu...
Introduction
Q. What is Clayvision?


It is a new quasi-immersive urban navigation
system that rethinks the design conven...


In other words, the system reassembles the city into
a better-designed copy of the original, that is both
easier to nav...
History


There were many experimental systems built in the
mid 1990s ,which were marked by their bulky
setups and low fr...
Contd..



The further developed AR technique lacks accuracy.
“Information bubble” display , the bubbles do not
have any ...
Requirements
 High

Speed Wireless Internet Connection.

 Hardware

Device having Camera and Display

Screen.
 A 3-D

G...
3-D Graphics Engine

API is API ?
 What
-protocol used as interface by
software
for comm.
OpenGL ?
-routine , data struct...
Application Programming Interface
Q. What is API ?
-protocol used as interface by software for
communication.

-routine , ...
OpenGL


OpenGL –Graphics Library.



OpenGL is used for graphics routine and other
coding.





OS independent.
Widel...
What is GLUT?
GLUT is OpenGL Utility Toolkit
◦ Not part of OpenGL.
◦ “GLUT is designed for constructing small to
medium si...
OVERALL FLOW:
HARDWARE
DEVICE USED AS
INPUT

DATA IS DISPLAYED

IMAGE CAPTURING

DATA IS SENT TO
HARDWARE
DEVICE

IMAGE
PR...
Image Processing:






Image processing of the video feed is done using
SIFT, which outputs a set of feature points an...
Contd..


After localization, projection and modelview
matrices are calculated to map 3D building models
onto the feed.

...
Working


Each frame of the real-time video feed is compared
to a collection of photos, shot from the same
location using...
Applications:

In Model Mapping, The 3-D model of the required
sector is generated.

3-DMODEL MAPPING

3/8/2014

16
Navigation:


Buildings can be emphasized by strategically
changing their visual attributes.



Attaching fake facades ,...
Contd..


Navigation Comparisons:

3/8/2014

18
Advantages


It is will be very useful in the fields of urban
planning and design.



Navigation systems can be upgraded...
Disadvantages


This design attracts a significant part of the user’s
attention, which may result in the user becoming
le...
Future Scope


Panorama creation: It can converge all major city
elements into a single screen.



Straightening streets...
Conclusion


Thus ClayVision is a novel vision-based augmented
reality system that offers the experience of real-time
urb...
References


Yuichiro Takeuchi and Ken Perlin-Works on Clay
vision technology(IEEE Paper)

3/8/2014

23
Thank You

3/8/2014

24
Upcoming SlideShare
Loading in …5
×

Clayvision-Yuichiro Takeuchi and Ken Perlin-Works

281 views

Published on

It is a ppt based on the works of Yuichiro Takeuchi and Ken Perlin-Works of Clayvision Technology

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
281
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Clayvision-Yuichiro Takeuchi and Ken Perlin-Works

  1. 1. Presentation on ClayVision:The Elastic Image of the City By, Darshan Mehta 3/8/2014 1
  2. 2. Contents           Introduction. History. Requirements. Working. Applications. Advantages. Disadvantages. Future Scope. Conclusion. References. 3/8/2014 2
  3. 3. Introduction Q. What is Clayvision?  It is a new quasi-immersive urban navigation system that rethinks the design convention of existing Augmented Reality (AR) applications.  Instead of “information bubbles” onto the urban scenery, ClayVision communicates through realtime 3D transformations and video feed of the city elements. 3/8/2014 3
  4. 4.  In other words, the system reassembles the city into a better-designed copy of the original, that is both easier to navigate and tailored to suit the user’s needs and preferences. 3/8/2014 4
  5. 5. History  There were many experimental systems built in the mid 1990s ,which were marked by their bulky setups and low frame rates.  Later on, due to the devices lacking the graphical capabilities had to send camera images to the server for each frame and increased computational burden. 3/8/2014 5
  6. 6. Contd..  The further developed AR technique lacks accuracy. “Information bubble” display , the bubbles do not have any absolute, exact positions within the 3-D space. 3/8/2014 6
  7. 7. Requirements  High Speed Wireless Internet Connection.  Hardware Device having Camera and Display Screen.  A 3-D Graphics Engine -part of system. -handles graphical simulation and interfaces. 3/8/2014 7
  8. 8. 3-D Graphics Engine API is API ?  What -protocol used as interface by software for comm. OpenGL ? -routine , data structure, obj. class….etc GLUT ? -libraries in c++ ,java API 3/8/2014 8
  9. 9. Application Programming Interface Q. What is API ? -protocol used as interface by software for communication. -routine , data structure, objects,Class etc. -libraries in c++ ,java etc. 3/8/2014 9
  10. 10. OpenGL  OpenGL –Graphics Library.  OpenGL is used for graphics routine and other coding.   OS independent. Widely used in industry. 3/8/2014 10
  11. 11. What is GLUT? GLUT is OpenGL Utility Toolkit ◦ Not part of OpenGL. ◦ “GLUT is designed for constructing small to medium sized OpenGL programs.” 3/8/2014 11
  12. 12. OVERALL FLOW: HARDWARE DEVICE USED AS INPUT DATA IS DISPLAYED IMAGE CAPTURING DATA IS SENT TO HARDWARE DEVICE IMAGE PROCESSING USE OF 3-D GRAPHICS ENGINE DATA SENT TO SATELLITE CORRELATION OF CO-ORDINATES 3/8/2014 12
  13. 13. Image Processing:    Image processing of the video feed is done using SIFT, which outputs a set of feature points and other data used to determine the relative position of the entire frame. Scale-invariant feature transform (or SIFT) is an algorithm in computer vision to detect and describe local features in images. Output is used to compare the video feed to the database of pictures and the template pictures are transformed based on the device’s specifications to produce the correct pose. 3/8/2014 13
  14. 14. Contd..  After localization, projection and modelview matrices are calculated to map 3D building models onto the feed.  These models are then textured using information from the feed and transformed to communicate information to the user.  Texturing is done correctly by altering the image background with template picture information in a way that doesn’t disrupt the video and allows for transformations that don’t cause excessive errors. 3/8/2014 14
  15. 15. Working  Each frame of the real-time video feed is compared to a collection of photos, shot from the same location using a device.  Attributes such as building shapes , colours , materials are modified so that they represent useful information, thus increase the efficiency of visual communication.  This is the approach taken by ClayVision. 3/8/2014 15
  16. 16. Applications: In Model Mapping, The 3-D model of the required sector is generated. 3-DMODEL MAPPING 3/8/2014 16
  17. 17. Navigation:  Buildings can be emphasized by strategically changing their visual attributes.  Attaching fake facades , enhancing the height , adding false saturation levels can make us find the given targeted building more quickly. 3/8/2014 17
  18. 18. Contd..  Navigation Comparisons: 3/8/2014 18
  19. 19. Advantages  It is will be very useful in the fields of urban planning and design.  Navigation systems can be upgraded to a new level using clayvision technology.  3-D Model Mapping is implemented using Clayvision Technology 3/8/2014 19
  20. 20. Disadvantages  This design attracts a significant part of the user’s attention, which may result in the user becoming less attentive to other pedestrians, cars, etc., creating a serious safety risk.  Slowdowns may occur, especially because of network speed. 3/8/2014 20
  21. 21. Future Scope  Panorama creation: It can converge all major city elements into a single screen.  Straightening streets: There are streets crooked, extending in seemingly random directions. Clay vision provides a clear view of what can be found further down the road.  Manual interaction: Tapping or drawing on the screen can be implemented for example cutting a hole in a building to see what lies beyond. 3/8/2014 21
  22. 22. Conclusion  Thus ClayVision is a novel vision-based augmented reality system that offers the experience of real-time urban design. It is a set of techniques to enable freeform transformations of built elements in the city, and discussed a range of transformation operations and their implications on the urban experience. 3/8/2014 22
  23. 23. References  Yuichiro Takeuchi and Ken Perlin-Works on Clay vision technology(IEEE Paper) 3/8/2014 23
  24. 24. Thank You 3/8/2014 24

×