Tele-immersion is a technology that allows users in different locations to collaborate in real-time as if they are in the same room. It uses cameras, displays, and tracking systems to reconstruct 3D scenes and environments. The idea was proposed in 1997 and researchers have since developed systems using multiple cameras, 3D modeling, and compression algorithms to transmit immersive virtual experiences over networks. However, challenges remain around bandwidth requirements, data transmission quality, and cost.

1. Tele-immersionPresented by:Himanshu Sharma1207185

2. ContentsIntroductionHistoryTele-conferencing vs. Tele-immersion WorkingApplicationsChallenges

3. IntroductionTele-immersion is an emerging technology that will enable users at geographically distributed sites to collaborate in real time in a shared, simulated environment as if they are in the same physical room. This is achieved through realistic reconstruction of the scenes in virtual space.

5. HistoryThe idea of Tele-immersion was proposed by Jaron Lanier , the head of Advanced Networks and Services in 1997. National Tele-Immersion Initiative (NTII) was formed to implement this.In May 2000, researchers at University of North Carolina (UNC), the University of Pennsylvania and Advanced Networks and Services developed this technology.A user sitting in office at UNC was able to see lifelike 3D images of his colleagues hundreds of mile away.

6. Artistic expression as proposed by Jaron in 1997

7. Tele-conference vs. Tele-immersion Tele-immersion differs significantly from conventional video Tele-conferencing in that the user’s view of the remote environment changes dynamically as he moves his head.Tele-conferencingTele-immersion

8. WORKING

9. Immersive Virtual EnvironmentAudio SynthesizerUserEnvironmenthead-mounteddisplay orprojectiondisplaysystemVirtualEnvironmentGeneratorAudio LocalizercommandsSpeechRecognizerDisplayElectronicsgraphicseye positionHead/Eye/HandTrackingElectronicshead positionhand positionHaptic/Tactilekinaestheticssystem

10. 2D to 3D…

11. Image Acquisition Bank of digital cameras capture participants from a variety of angels.

12. There are about 7-15 cameras clusters each contain 4 cameras out of which 3 are black and white and one is color.

13. B&W cameras are for stereo construction .

14. The color camera is for extracting the appearance. A camera cluster of 3 BW and 1 color cameras

15. Camera clusters

16. Each camera is synchronized to other camera.Each camera is connected to workstation.

17. 3D Constructioncomputation

18. This reconstruction uses Trinocular Stereo Algorithm. After constructing the disparity map, apply median filtering to remove a few outliers in the disparity map.Then the median filtered disparity map is combined with a registered color texture to reconstruct a 3D point cloud.

19. 3D Video Transmission 3D data is transmitted in compressed form using Modern Driven compression algorithm.System which generates 640x480 pixel depth color maps from 10 camera clusters in a rate of 15 frames per second (fps), requires 220 mbps bandwidth.Around 1.2 gbps is necessary for high quality effect.

20. ApplicationsRemote medical training and diagnosis.

21. Automobile engineering.

22. Remote and distributed education.Virtual travel and tourism.Art and Entertainment.

23. ChallengesQuality of transmitting multimedia and Tele-immersion data streams over the internet is affected by high packets loss rates.ExpensiveHigh bandwidth requirement.

24. Thank youQueries??