Tele-immersion is a technology that uses 3D video conferencing to allow users in different locations to interact in a simulated holographic environment as if they are together in person. It was first proposed in 1997 and involves using arrays of cameras to capture 3D environments and people, transmitting the compressed 3D video streams over high-bandwidth networks, and displaying the streams so participants appear life-like and co-located. While challenging due to bandwidth and rendering needs, tele-immersion has applications for remote education, medical training, teleconferencing, and entertainment by reducing travel while enabling face-to-face style interactions from anywhere.
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
Tele-Immersion: A Positive Future Alternative
1. AS a positive alternative of the Future.
TELE-IMMERSION
Presented By
Vrindha Sajikumar
602031
Guided By
Dr. Juby Mathew
Associate Professor
2. Introduction
Tele-immersion is a technology that will be implemented with
internet2 it will enable users in different geographic locations to come
together and interact in a simulated holographic environment.
Users will feel as if they are actually looking, talking and meeting with
each other face to face in the same place, even though they may be
miles apart physically.
It is an integration of 3D audio and video conferencing
3. History
The idea of Tele-immersion was proposed by Jaron Lanier , the
head of Advanced Networks and Services in 1997. National
Tele-Immersion Initiative (NTII) was formed to implement
this.
In May 2000, researchers at University of North Carolina (UNC),
the University of Pennsylvania and Advanced Networks and
Services developed this technology.
A user sitting in office at UNC was able to see life like 3D images
of his colleagues hundreds of mile away.
4. Requirements of Tele-immersion
3D Environment scanning
Reconstruction in a holographic environment
Projective & display technologies
Audio technologies
Tracking technologies
Robotics and Haptics
Powerful networking
Computational needs
5.
6. 2D To 3D
Image Acquisition
3D Reconstruction
3D Video Transmission
7. 2D To 3D
Scene Capture Reconstruction
Point Generation/
Meshing
Rendering Stereo Display
images
3D depth and Color Images
3D Points /Triangles with
color textures
images
8. Overview of Tele-Immersion
It has three levels:-
1. Capturing Level:- It consists of a set 3D cameras.
2. Transmission Level:- This sending & receives the
compressed 3D video streams.
3. Displaying Level:- It displays the 3D video streams.
9. Working of Tele-imersion
An array of cameras views people and their surroundings from
different angle . Each camera generates an image from its point of
view many times in a second
it uses cluster of cameras each of this having 4 cameras ( 3-black and
white & one-colour ).
They had it's own dedicated high-end computer to perform the
image rectification, pixel correlation, and triangulation needed to
recover depth values from the sets of images produced.
Capturing Level
10. Working of Tele-imersion
3D Video Transmission
3D data is transmitted in compressed form using Modern Driven
compression algorithm.
System which generates 640x480 pixel depths color maps from 10
camera clusters in a rate of 15 frames per second (fps), requires 220
mbps bandwidth.
Around 1.2 gbps is necessary for high quality effect.
3D CONSTRUCTION OF IMAGE
This reconstruction uses Trinocular Stereo Algorithm.
After constructing the disparity map, apply median filtering to
remove a few outliers in the disparity map.
Then the median filtered disparity map is combined with a
registered color texture to reconstruct a 3D point cloud.
13. Application
Interacting with peoples miles away in a simulated
environment
Tele-immersion also finds its application in the field of
education for distance learning.
Tele-immersion can be of immense use in medical
industry like surgery-cal training and diagnosis
Use in offices for Teleconferencing.
Entertainment
14. Challenges
Quality of transmitting multimedia and Tele-immersion data
streams over the internet is affected by high packets loss rates.
Expensive
High bandwidth requirement.
Non-availability of high speed networks.
Rendering challenges
15. CONCLUSION
Tele-Immersion is a fast developing technology and it is going to
benefit the common people. It helps in many fields, it reduces the
travelling time in business other fields .It is the way for humans,
interact with each other . Although it is as good as "being there", it
might be good enough for business meetings, professional
consultations, training sessions, etc.
Tele-Immersion is a technology that is certainly going to bring a
new revolution in the world.
Editor's Notes
3D Environment scanning
Image processing
1.shared table approach
2.incomplete 3d approach
Reconstruction in a holographic environment
Projective & display technologies
Tracking technologies
Moving sculptures
Audio technologies
There are about 7-15 cameras clusters each contain 4 cameras out of which 3 are black and white and one is color.
B&W cameras are for stereo construction .
The color camera is for extracting the appearance.
Each camera is synchronized to other camera.
Each camera is connected to workstation.
The realization of Tele-Immersion is
Critical today due to:-