3d Video Conferencing: Opportunities and Pitfalls

302 views

Published on

Keynote Session by TrueConf CTO, Stass Soldatov, at ISE 2017.

3D and stereo technology, 3D video capture and display, as well as some ideas on the prospects of 3D technology on the video conferencing market.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
302
On SlideShare
0
From Embeds
0
Number of Embeds
283
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

3d Video Conferencing: Opportunities and Pitfalls

  1. 1. 3D Video Conferencing: Opportunities and Pitfalls Stass Soldatov CTO
  2. 2. Photo © Alicia Nijdam 2D image lacks some important info: size and distance. Not a big deal on this example, though.
  3. 3. Photo © Dr. Sharadh Sampath But crucial here.
  4. 4. TrueConf Mad Scientist Ivan Knows 3D Inside Out
  5. 5. 3D Video Conferencing Issues of Today You have to wear glasses Suffer headache OR
  6. 6. 1.Capture Challenges 3. Display Challenges 2. Transmission -- OK
  7. 7. A proper camera for 3D VC still doesn’t exist. 1.CaptureChallenges
  8. 8. ● poor resolution ● poor precision ● correction N/A ● too narrow FOV ● not suitable for roomsMinoru 3D — first stereo USB camera Back in 2011... 1.CaptureChallenges
  9. 9. Consumer Stereo Cameras ● Limited DSP access ● Only for recording ● No drivers/interface Sony HDR-TD10E 1.CaptureChallenges
  10. 10. 1.CaptureChallenges Kinect and Similar 2D+Depth Cameras
  11. 11. ● Low res depth <320p ● Low fps for depth map Works for gestures not applicable for VC yet.
  12. 12. 1.CaptureChallenges We started to make hardware ourselves
  13. 13. 1.CaptureChallenges ● 2x PointGrey 5Mp sensors ● Self-written drivers ● Self-made chassis ● GPU-driven processing ● No autofocus and bulky And Made 3D 2K+2K Camera :)
  14. 14. 1.CaptureChallenges 2016: New Wave & New Stereo Cams
  15. 15. In ideal camera sensors are in parallel. Equally focused. And synchronized.
  16. 16. In real life software correction required. Brain do it for our vision all the time.
  17. 17. We need a way to find and measure errors for calibration.
  18. 18. 2.Transmission ● Multi stream synchronization is an essential part of multipoint video conferencing, which was solved many years ago by all vendors. ● Stereo video content is just a special case of it. ● Network bandwidth could be an issue for multiview (>2) 3D content. Not for stereo.
  19. 19. 3.DisplayChallenges Photo © LG Electronics 3D Effect Expectations Pitfall
  20. 20. Head is Static. Stereo 3D will do.
  21. 21. Head is moving. 3D VR could help.
  22. 22. Autostereoscopic Glasses Free Displays 3.DisplayChallenges Holografika HoloVision Philips / Dimenco from our lab
  23. 23. Multiview Processing is a VC Problem 3.DisplayChallenges Left Eye Stream Right Eye Stream N streams
  24. 24. https://graphics.stanford.edu/projects/array/
  25. 25. We’ve to Wear Glasses for 3D VC 3.DisplayChallenges ● Passive ● Our choice ● Active ● Battery inside ● Transmitter required
  26. 26. https://www.youtube.com/watch?v=Uef17zOCDb8
  27. 27. Passive technology: polarized 3D glasses
  28. 28. 3D video conferencing and streaming exists for years. For very specific cases. Time to bring 3D to a new areas!
  29. 29. Thank you. Questions? Stass Soldatov CTO

×