Contents Introduction History Tele-conferencing vs. Tele-immersion Working Applications Challenges
Introduction Tele-immersion is an emerging technology that will enable users at geographically distributed sites to collaborate in real time in a shared, simulated environment as if they are in the same physical room. This is achieved through realistic reconstruction of the scenes in virtual space.
History The idea of Tele-immersion was proposed by Jaron Lanier , the head of Advanced Networks and Services in 1997. National Tele-Immersion Initiative (NTII) was formed to implement this. In May 2000, researchers at University of North Carolina (UNC), the University of Pennsylvania and Advanced Networks and Services developed this technology. A user sitting in office at UNC was able to see lifelike 3D images of his colleagues hundreds of mile away.
Artistic expression as proposed by Jaron in 1997
Tele-conference vs. Tele-immersion Tele-immersion differs significantly from conventional video Tele-conferencing in that the user’s view of the remote environment changes dynamically as he moves his head. Tele-conferencing Tele-immersion
Immersive Virtual Environment Audio Synthesizer User Environment head- mounted display or projection display system Virtual Environment Generator Audio Localizer commands Speech Recognizer Display Electronics graphics eye position Head/Eye/Hand Tracking Electronics head position hand position Haptic/Tactile kinaesthetics system
This reconstruction uses Trinocular Stereo Algorithm. After constructing the disparity map, apply median filtering to remove a few outliers in the disparity map. Then the median filtered disparity map is combined with a registered color texture to reconstruct a 3D point cloud.
3D Video Transmission 3D data is transmitted in compressed form using Modern Driven compression algorithm. System which generates 640x480 pixel depth color maps from 10 camera clusters in a rate of 15 frames per second (fps), requires 220 mbps bandwidth. Around 1.2 gbps is necessary for high quality effect.
Applications Remote medical training and diagnosis.