Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Teleimmersion

2,840 views

Published on

Tele-Immersion is a new technology that enables a user to share a virtual space with remote participants.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Teleimmersion

  1. 1. Internet-Wide Multi-Party Tele-Immersion Framework for Remote 3D Collaboration RINU MARKS.P REG NO.73023 [email_address]
  2. 2. <ul><li>Tele-Immersion is a new technology that enables a user to share a virtual space with remote participants. </li></ul>WHAT IS TELE-IMMERSION ???
  3. 3. Existing System <ul><li>Video conferencing. </li></ul><ul><li>Fails to keep eye to eye contact. </li></ul><ul><li>User interaction is limitted. </li></ul><ul><li>When no. of persons conferencing increases it will be hard to concentrate on person who is actually talking. </li></ul>
  4. 4. site 3 site 1 site 2 BASIC CONCEPT
  5. 5. <ul><li>Not merely the 3D reproduction of the human body. </li></ul><ul><li>It also allows us to interact with virtual objects in the shared virtual environment </li></ul>
  6. 6. Interaction with virtual objects
  7. 7. <ul><li>Tele-immersion reconstructs the objects in the real world in real-time, and mixes the real objects with the virtual environment </li></ul>
  8. 8. Remote Controller Function(wii)
  9. 9. <ul><li>Various operations on 3d virtual objects such as “move”, “rotate”, “select”, “change texture”, “expand”, “shrink”, “highlight” </li></ul><ul><li>Helps in eye to eye communication in multi party enironment. </li></ul>
  10. 10. <ul><li>ARRANGEMENTS </li></ul>
  11. 11. ARRANGEMENTS <ul><li>B&W cameras are for stereo construction. </li></ul><ul><li>The color camera is for extracting the appearance </li></ul>
  12. 12. ARRANGEMENT
  13. 13. 3D IMAGE CONSTRUCTION
  14. 14. 3D image construction
  15. 15. Stages in 3D conversion <ul><li>Acquisition stage </li></ul><ul><li>Reconstruction stage </li></ul>
  16. 16. Acquisition stage <ul><li>capture a variable amount of camera feeds . </li></ul><ul><li>image-based calculations and color silhouette extraction. </li></ul><ul><li>Image compression. </li></ul>
  17. 17. Sterio based reconstruction stage
  18. 18. Sterio based reconstruction <ul><li>1. Calculate initial matching cost </li></ul><ul><li>and are the color intensities in the left and right images </li></ul><ul><li>d is the disparity hypothesis. </li></ul><ul><li>denotes pixel in the left image and denotes pixel in the right image </li></ul>
  19. 19. <ul><li>2. Construct a square window of predefined size with p as centre. </li></ul><ul><li>3. For each pixel q in window calculate adaptive support weight. </li></ul><ul><li>and denotes the color and euclidean distance between p and q. </li></ul><ul><li>are constants. </li></ul>
  20. 20. <ul><li>4. Calculate aggregated cost of each support window. </li></ul><ul><li>5. By using optimization technique we calculate depth of discontinuous areas and reconstruct the body. </li></ul>
  21. 21. The user whole body is extracted by taking the difference between the current video frame and the registered background image. BACK GROUND SUBTRACTION
  22. 22. Real time compression <ul><li>Reconstructed 3d model is very large in size. </li></ul><ul><li>Real-time compression is essential for real-time delivery. </li></ul><ul><li>Modified jpeg compression. </li></ul>
  23. 23. JPEG COMPRESSION Each block is defined as M[x,y] ( i -1) * d <= x < i * d , 0 <= i < w ( j -1) * d <= y < j * d , 0 <= j < h d is the size w width and h height.
  24. 24. For each M[i , j] <ul><li>If all M[x, y] == 0 , then M '[i, j] = N . </li></ul><ul><li>If all M[x, y] == 1, then M '[i, j] = A . </li></ul><ul><li>If exists any M[x, y] == 0 and any M[x, y] == 1 , then M '[i, j] = B </li></ul>
  25. 25. Multi-Party Tele-Immersion using internet
  26. 26. Server side <ul><li>The TI server provides a virtual environment and room model to divide the users into groups. </li></ul><ul><li>The system information such as user login/logout and their manipulations are written in database. </li></ul><ul><li>The portal provides user login and real-time status display through web browsers with the help of database </li></ul>
  27. 27. Communication model
  28. 28. Hardware Requirements <ul><li>4-core Intel Xeon W3530 processor </li></ul><ul><li>6GB DDR3 RAM </li></ul><ul><li>2*500GB 7200rpm SATA Hard disk </li></ul><ul><li>NVIDIA Geforce GTX 470 display card </li></ul>
  29. 29. Time delays
  30. 30. Time cost of 3D reconstruction & encoding
  31. 31. Time cost of decoding & rendering
  32. 32. Remote interaction delay on 3D objects
  33. 33. Bandwidth requirement
  34. 34. Applications <ul><ul><li>Remote medical diagnosis and therapy. </li></ul></ul><ul><ul><li>Remote and distributed education. </li></ul></ul><ul><ul><li>Distributed artistic performance and interaction. </li></ul></ul><ul><ul><li>Virtual travel and tourism. </li></ul></ul><ul><ul><li>Automobile Engineering </li></ul></ul>
  35. 35. Challenges <ul><li>Quality of transmission affected by high packet loss </li></ul><ul><li>Very Expensive </li></ul><ul><li>High bandwidth requirement. </li></ul><ul><li>High speed internet is required (min of 60 MBPS) </li></ul>
  36. 36. CONCLUSION <ul><li>Still in its early stages of development. </li></ul><ul><li>Challenges are need to be met. </li></ul><ul><li>3d reconstruction technology needs to be improved since the reproduced images are jittering. </li></ul><ul><li>Tele immersion technology can surely lead to great developments in the field of communication. </li></ul>
  37. 37. References <ul><li>Proposal of Multimodal Communications System Using Tele-Immersion Technology ; IEEE Conference </li></ul><ul><li>Tele-Immersion Environment for Video Avatar Based CVE ; IEEE Conference </li></ul><ul><li>Distance Learning in Tele-Immersion Environment; IEEE Conference </li></ul><ul><li>http://tele-immersion.citris-uc.org </li></ul><ul><li>http://graphics.cs.brown.edu/research/telei </li></ul>
  38. 38. <ul><li>THANK YOU </li></ul>

×