Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Video Conferencing Experiences with UltraGrid:


Published on

  • Be the first to comment

  • Be the first to like this

Video Conferencing Experiences with UltraGrid:

  1. 1. Video Conferencing Experiences with UltraGrid: A High Definition Video Conferencing and Distribution System Ladan Gharai ....……University of Southern California/ISI Colin Perkins .........................…….. University of Glasgow
  2. 2. Outline <ul><li>Overview </li></ul><ul><li>System Design </li></ul><ul><ul><li>Architectural Overview </li></ul></ul><ul><ul><li>AccessGrid Integration </li></ul></ul><ul><li>Nuts and bolts </li></ul><ul><ul><li>UltraGrid Nodes </li></ul></ul><ul><ul><li>Cameras and Displays </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Lab Experiments </li></ul></ul><ul><ul><li>Network Experiments </li></ul></ul><ul><li>Technology Transfer </li></ul><ul><li>Summary </li></ul>
  3. 3. The UltraGrid System <ul><li>UltraGrid is ultra-high quality video conferencing tool </li></ul><ul><ul><li>Supports uncompressed High Definition TV video formats </li></ul></ul><ul><ul><ul><li>Operates in two modes: </li></ul></ul></ul><ul><ul><ul><ul><li>Under 1Gbps, for environments limited to 1 Gbps transport </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Over 1.2 Gbps, for full rate uncompressed HDTV </li></ul></ul></ul></ul><ul><ul><li>Standard definition video codecs: </li></ul></ul><ul><ul><ul><li>Digital Video (DV) </li></ul></ul></ul><ul><ul><ul><li>Motion JPEG </li></ul></ul></ul><ul><ul><li>Incurs minimum latency </li></ul></ul><ul><li>Not solely a video conferencing tool: </li></ul><ul><ul><li>HDTV distribution system for editing purposes </li></ul></ul><ul><ul><li>A general purpose SMPTE292M-over-IP system </li></ul></ul><ul><ul><li>High-definition visualization and remote steering applications </li></ul></ul>
  4. 4. The UltraGrid System <ul><li>HD video conferencing </li></ul><ul><li>Remote Visualization </li></ul><ul><li>SPMTE 292M over IP transport </li></ul>LDK-6000 SONY HDC-X300 IP Network SMPTE 292M RTP/UDP/IP 1.485 Gbps RTP/UDP/IP UltraGrid node UltraGrid node UltraGrid node UltraGrid node
  5. 5. Outline <ul><li>Overview </li></ul><ul><li>System Design </li></ul><ul><ul><li>Architectural Overview </li></ul></ul><ul><ul><li>AccessGrid Integration </li></ul></ul><ul><li>Nuts and bolts </li></ul><ul><ul><li>UltraGrid Nodes </li></ul></ul><ul><ul><li>Cameras and Displays </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Lab Experiments </li></ul></ul><ul><ul><li>Network Experiments </li></ul></ul><ul><li>Technology Transfer </li></ul><ul><li>Summary </li></ul>
  6. 6. UltraGrid: Architectural Overview <ul><li>An open and flexible architecture with “plug-in” support for codecs and transport protocols: </li></ul><ul><li>Codec Support: </li></ul><ul><ul><li>DV, R FC 3189 </li></ul></ul><ul><ul><li>M-JPEG, RFC 2435 </li></ul></ul><ul><ul><li>H.261, RFC 2032 </li></ul></ul><ul><li>Transport protocols: </li></ul><ul><ul><li>RTP/RTCP </li></ul></ul><ul><ul><li>RFC 3550 </li></ul></ul><ul><li>Congestion Control: </li></ul><ul><ul><li>TCP Friendly Rate Control (TFRC), RFC 3448 </li></ul></ul>decoder encoder display grabber Playout buffer Packetization Transport + Congestion Control rat UltraGrid Node
  7. 7. UltraGrid: Architectural Overview Display HDTV/DV camera Frame Grabber Grabber thread Transmit thread Video Codec RTP Framing Congestion Control RTP Sender Send buffer Network RTP Receiver RTCP Playout buffer RTP Framing Video Codec Colour Conversion Display Receive thread Display thread
  8. 8. AccessGrid Integration <ul><li>UltraGrid’s video transmission mechanisms can be added to AccessGrid: </li></ul><ul><ul><li>Use the Node Manager to add the services: </li></ul></ul><ul><ul><ul><li>UltraGrid Receiver </li></ul></ul></ul><ul><ul><ul><li>UltraGrid Sender </li></ul></ul></ul><ul><ul><li>Created as part of UltraGrid: </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><ul><ul><li> </li></ul></ul></ul>
  9. 9. AccessGrid Integration
  10. 10. Video Packetization and IP Transport <ul><li>UltraGrid RTP packetization is based on: </li></ul><ul><ul><li>``RTP Payload Format for Uncompressed Video’’, RFC 4175 </li></ul></ul><ul><ul><li>Ladan Gharai and Colin Perkins </li></ul></ul><ul><li>RFC 4175 covers packetization of various video formats: </li></ul><ul><ul><li>Supports range of formats including standard & high definition video </li></ul></ul><ul><ul><li>Interlaced and progressive </li></ul></ul><ul><ul><li>RGB, RGBA, BGR, BGRA, YUV </li></ul></ul><ul><ul><li>Various color sub-sampling: 4:4:4, 4:2:2, 4:2:0, 4:1:1 </li></ul></ul>
  11. 11. Outline <ul><li>Overview </li></ul><ul><li>System Design </li></ul><ul><ul><li>Architectural Overview </li></ul></ul><ul><ul><li>AccessGrid Integration </li></ul></ul><ul><li>Nuts and bolts </li></ul><ul><ul><li>UltraGrid Nodes </li></ul></ul><ul><ul><li>Cameras and Displays </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Lab Experiments </li></ul></ul><ul><ul><li>Network Experiments </li></ul></ul><ul><li>Technology Transfer </li></ul><ul><li>Summary </li></ul>
  12. 12. UltraGrid Nodes <ul><li>UltraGrid nodes are built from commercially available hardware. Key elements are: </li></ul><ul><li>Network interface card : </li></ul><ul><ul><li>For nodes sending at over 1 Gbps rate, a 10 Gigabit Ethernet NIC: </li></ul></ul><ul><ul><ul><ul><li>T110 10GbE from Chelsio : </li></ul></ul></ul></ul><ul><ul><ul><ul><li>133Mhz/PCI-X </li></ul></ul></ul></ul><ul><ul><li>Otherwise standard 1 Gbps NICs suffice </li></ul></ul><ul><li>HDTV capture card: </li></ul><ul><ul><li>For nodes sending and receiving uncompressed HDTV: </li></ul></ul><ul><ul><ul><li>Centaurus or HDstation HDTV capture card from www. dvs .de </li></ul></ul></ul><ul><ul><li>For nodes only receiving uncompressed HDTV, software display is an option. This requires: </li></ul></ul><ul><ul><ul><li>xvideo extensions support by OS and video card; or </li></ul></ul></ul><ul><ul><ul><li>The Simple DirectMedia Layer library, SDL </li></ul></ul></ul>
  13. 13. The Centaurus vs. HDstation Card <ul><li>Centaurus HDTV capture Card: www. dvs .de </li></ul><ul><ul><li>Linux 2.4, 2.6 Kernels </li></ul></ul><ul><ul><li>100Mhz/PCI-X card </li></ul></ul><ul><ul><li>DVI connector </li></ul></ul><ul><ul><li>Supports common SD, HD and 2K format: </li></ul></ul><ul><ul><ul><li>HSDL: 2048x1556@ 15psF,18psF </li></ul></ul></ul><ul><ul><ul><li>2K: 2048x1556@ 24p,24psF,48i </li></ul></ul></ul><ul><ul><li>Price: $9000K </li></ul></ul><ul><li>Hdstation HDTV capture card: www. dvs .de </li></ul><ul><ul><li>Linux 2.4 Kernel </li></ul></ul><ul><ul><li>64 bit PCI card </li></ul></ul><ul><ul><li>Supports common SD and HD formats </li></ul></ul><ul><ul><li>Price: $15000k </li></ul></ul>
  14. 14. Total Cost <ul><li>UltraGrid node sending full-rate uncompressed HDTV: </li></ul><ul><li>Dual Xeon EM64T Power Station </li></ul><ul><ul><li>SuperMicro mother board </li></ul></ul><ul><ul><li>5 programmable PCI-X slots </li></ul></ul><ul><ul><li>32bit Fedora Core3 - Linux 2.6 Kernel </li></ul></ul>PC system …………………………….……………… $5500 Centaurus Card……………………………………………… $ 9,000 Single-link HD/SD PCI-X board Centaurus-Audio08 …………………………………………. $ 1,000 10 GigE NIC ….………………………………………….$2500 Total cost $18000
  15. 15. Cameras and Displays <ul><li>A variety of HDTV cameras are now available : </li></ul><ul><ul><li>Broadcast cameras: </li></ul></ul><ul><ul><ul><li>Generally expensive, at least over $20000. For SC2005: </li></ul></ul></ul><ul><ul><ul><ul><li>Panasonic AJ-HDC27F </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Thomson LDK 6000 </li></ul></ul></ul></ul><ul><ul><ul><li>Have SMPTE 292M output and can be directly connected to an UltraGrid node. </li></ul></ul></ul><ul><ul><li>Consumer grade cameras: </li></ul></ul><ul><ul><ul><li>Price is in the $3000 to $5000 range, examples: </li></ul></ul></ul><ul><ul><ul><ul><ul><li>Sony HVR-Z1E, HDR-FX1 </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>JVC GY-HD-100U HDV Pro </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Do not have a SMPTE 292M output, an AD converter is needed to generate an HD-SDI signal. (Ex: AJA HD10A) </li></ul></ul></ul><ul><li>Displays need to be able to accommodate: </li></ul><ul><ul><li>HDTV 16:9 aspect ratio </li></ul></ul><ul><ul><li>In the case of progressive HDTV, support progressive scanning </li></ul></ul>
  16. 16. Outline <ul><li>Overview </li></ul><ul><li>System Design </li></ul><ul><ul><li>Architectural Overview </li></ul></ul><ul><ul><li>AccessGrid Integration </li></ul></ul><ul><li>Nuts and bolts </li></ul><ul><ul><li>UltraGrid Nodes </li></ul></ul><ul><ul><li>Cameras and Displays </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Lab Experiments </li></ul></ul><ul><ul><li>Network Experiments </li></ul></ul><ul><li>Technology Transfer </li></ul><ul><li>Summary </li></ul>
  17. 17. Performance Testing <ul><li>Back to back lab test </li></ul><ul><li>Local area tests </li></ul><ul><ul><li>DRAGON ring in the DC metropolitan area </li></ul></ul><ul><li>Wide area tests </li></ul><ul><ul><li>Conducted during SuperComputing 2005 over Internet2: </li></ul></ul><ul><ul><ul><ul><li>Best effort IP path </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Hybrid/Optical Packet Infrastructure (HOPI) </li></ul></ul></ul></ul><ul><li>Measured: </li></ul><ul><ul><li>Throughput </li></ul></ul><ul><ul><li>Packet loss and reordering </li></ul></ul><ul><ul><li>Frame inter-display times </li></ul></ul><ul><ul><li>Packet interarrival times at sender and receiver </li></ul></ul>
  18. 18. Lab Tests Centaurus 10 GigE UltraGrid Sender UltraGrid Receiver LDK-6000 PDP-502MX 1.485 Gbps RTP/UDP/IP SMPTE 292M SMPTE 292M <ul><li>Back-2-back tests: </li></ul><ul><ul><li>Video: 720p </li></ul></ul><ul><ul><li>Duration: 10 min </li></ul></ul><ul><ul><li>RTT: 70 µs </li></ul></ul><ul><ul><li>MTU: 8800 bytes </li></ul></ul><ul><li>Results: </li></ul><ul><ul><li>No loss or reordering </li></ul></ul><ul><ul><li>1198.03 Mbps throughput </li></ul></ul><ul><ul><li>Total 10,178,098 packets sent and received </li></ul></ul>Centaurus 10 GigE
  19. 19. Local Area Tests <ul><li>Our local area tests were conducted over a metropolitan network in the Washington D.C. area, known as the DRAGON network. </li></ul><ul><li>DRAGON is a GMPLS based multiservice WDM network and provides transport at multiple network layers including layer3, layer2 and below. </li></ul><ul><li>DRAGON allows the dynamic creation of “Application Specific Topologies” in direct response to application requirements. </li></ul><ul><li>Our Ultragrid testing was conducted over the DRAGON metropolitan ethernet service connecting: </li></ul><ul><ul><li>University of Southern California Information Sciences Institute (USC/ISI) East (Arlington, Virginia); and </li></ul></ul><ul><ul><li>University of Maryland (UMD) Mid-Atlantic Crossroads (MAX) in College Park, Maryland. </li></ul></ul>
  20. 20. UltraGrid over DRAGON Network <ul><li>Network tests: </li></ul><ul><ul><li>720p video </li></ul></ul><ul><ul><li>Duration: 10 min </li></ul></ul><ul><ul><li>RTT: 570 µs </li></ul></ul><ul><ul><li>MTU: 8800 bytes </li></ul></ul><ul><li>Results: </li></ul><ul><ul><li>No loss or reordering </li></ul></ul><ul><ul><li>1198.03 Mbps throughput </li></ul></ul><ul><ul><li>Total 10,178,119 packets sent and received </li></ul></ul>HOPI / NLR CLPK ARLG MCLN MIT Haystack Observatory (HAYS) UMD MAX Goddard Space Flight Center GSFC) National Computational Science Alliance (NCSA) ACCESS USC/ISI East DCNE DCNE ATDNet Optical switching element Optical edge device DRAGON
  21. 21. Wide Area Tests <ul><li>Our wide area tests were conducted over Internet2 during Super Computing 2005 </li></ul><ul><li>Set up a video conferencing session between ISI-east and the Super Computing exhibit floor </li></ul><ul><li>Tests were conducted over Internet2’s: </li></ul><ul><ul><li>Best effort IP paths; and </li></ul></ul><ul><ul><li>Hybrid Optical Packet Infrastructure (HOPI) </li></ul></ul><ul><li>Each UltraGrid node was connected: </li></ul><ul><ul><li>via a 1 Gbps interface to best effort IP path; and </li></ul></ul><ul><ul><li>via a 10 Gbps interface to HOPI </li></ul></ul>
  22. 22. Wide Area Tests UG sender UG receiver UG sender UG receiver Los Angeles 10 Gbs Ethernet SC 2005 Seattle, WA Chicago Houston ISI-East Arlington, VA OC192 SONET/SDH LDK 6000 AJ-HDC27F
  23. 27. Wide Area Tests: Performance Results <ul><li>HOPI: </li></ul><ul><ul><li>As expected we did not record any packet loss for test runs over the HOPI provisioned paths. </li></ul></ul><ul><li>Best effort IP: </li></ul><ul><ul><li>We recorded between 0 to 0.04% packet loss </li></ul></ul><ul><ul><li>Clearly, 0 to 0.04% only indicates the level of congestion for each particular test run </li></ul></ul><ul><li>At 0.04% loss the video quality did suffer: </li></ul><ul><ul><li>However this is with no error correction or concealment at work </li></ul></ul>
  24. 28. Inter-packet Intervals: HOPI <ul><li>Packets traversing HOPI paths maintain similar distribution and inter-arrival times as at the sender </li></ul>Sender IPI - 10 Gbps NIC Receiver IPI - Internet2 HOPI path
  25. 29. Inter-packet Intervals: Best effort IP <ul><li>Packets traversing the best effort IP path experience a long tail and more dispersion </li></ul>Sender IPI - 1 Gbps NIC Receiver IPI - Internet2 best effort path
  26. 30. Outline <ul><li>Overview </li></ul><ul><li>System Design </li></ul><ul><ul><li>Architectural Overview </li></ul></ul><ul><ul><li>AccessGrid Integration </li></ul></ul><ul><li>Nuts and bolts </li></ul><ul><ul><li>UltraGrid Nodes </li></ul></ul><ul><ul><li>Cameras and Displays </li></ul></ul><ul><li>Performance Testing </li></ul><ul><ul><li>Lab Experiments </li></ul></ul><ul><ul><li>Network Experiments </li></ul></ul><ul><li>Technology Transfer </li></ul><ul><li>Summary </li></ul>
  27. 31. Groups using UltraGrid <ul><li>HDTV group at KAIST: </li></ul><ul><ul><li>Added features to UltraGrid: </li></ul></ul><ul><ul><ul><li>Playback from disk </li></ul></ul></ul><ul><ul><ul><li>Bonded NIC support </li></ul></ul></ul><ul><ul><li> </li></ul></ul><ul><li>Networked Media Lab at GIST, in collaboration with KISTI: </li></ul><ul><ul><li>Added features to UltraGrid: </li></ul></ul><ul><ul><ul><li>Support for AJA XENA capture card </li></ul></ul></ul><ul><ul><ul><li>Embedded audio support </li></ul></ul></ul><ul><li>Masaryk University in Brno with CESNET (Czech NREN operator): </li></ul><ul><ul><li>Conducted multipoint HD demos with UltraGird at : </li></ul></ul><ul><ul><ul><li>iGrid 2005 </li></ul></ul></ul><ul><ul><ul><li>SuperComputing in 2005 </li></ul></ul></ul><ul><ul><li> </li></ul></ul>
  28. 32. Summary <ul><li>Full rate uncompressed HDTV video conferencing is available today, with current network and end-system technologies. </li></ul><ul><li>Approximate cost UltraGrid nodes are: </li></ul><ul><ul><ul><li>Hardware: ~$18000 </li></ul></ul></ul><ul><ul><ul><li>Software: open source code </li></ul></ul></ul><ul><ul><ul><li>Camera’s and display are extra </li></ul></ul></ul><ul><li>It is paramount to be able to adapt to differing network technologies and conditions: </li></ul><ul><ul><li>Full rate 1.2Gbps flows on dedicated networks </li></ul></ul><ul><ul><li>Network friendly flows on IP best effort networks </li></ul></ul>
  29. 33. Further Information… <ul><li>UltraGrid project web-site: http: //ultragrid .east. isi . edu/ </li></ul><ul><ul><li>Latest UltraGrid release available for download </li></ul></ul><ul><ul><li>UltraGrid-users mailing list subscription information </li></ul></ul><ul><li>DRAGON project web-site : http://dragon.east. isi . edu/ </li></ul>DRAGON