Design and Implementation of Audio/Video Collaboration System Based on Publish/subscribe Event Middleware PTLIU Laboratory...
A/V Collaboration Systems <ul><li>H323 </li></ul><ul><li>H.323 is defined as an umbrella standard specifying the component...
XGSP Collaboration Framework  <ul><li>To integrate heterogeneous systems into one collaboration system </li></ul><ul><ul><...
Group Communication in Collaboration <ul><li>Collaboration applications usually need a group communication service for bot...
Narada Broker Network Resource Broker Broker Broker Broker Broker Broker Software multicast (P2P) Community (P2P) Communit...
Narada Brokering <ul><li>Narada Brokering from the Community Grid Labs is adopted as a general event brokering middleware ...
Narada Brokering <ul><li>Covers the heterogeneity of network transportation and provides unified multipoint transportation...
A/V Collaboration over publish/subscribe Middleware   <ul><li>video streams (VS) VS {v 1 , v 2 , … v m  }  </li></ul><ul><...
Publish/subscribe of A/V  <ul><li>A stream in VS and AS is regarded as a “topic”  </li></ul><ul><li>Each RTP packet from t...
Major Events for each stream topic The stream resumed sending RTP packet  Passive-To-Active The stream has stopped sending...
A/V Collaboration Architecture
RTP packets encapsulation   <ul><li>RTPLink: RTP Packets ~ Narada Brokering Event </li></ul><ul><li>Every legacy A/V clien...
Audio Mixer, Video Mixer, Image Grabber   <ul><li>Audio Mixing </li></ul><ul><ul><li>The audio mixer creates a mixed audio...
H.323, SIP Gateway Servers, A/V Session Server   <ul><li>H.323 and SIP gateway transform these protocol specific messages ...
Implementation <ul><li>Java Media Framework (JMF) :  </li></ul><ul><li>Openh323 is basis of H323 Gateway </li></ul><ul><li...
Demo Pics ( I )
Demo Pics ( II )
Demo Pics ( III )
Thank you! Please watch our demo at 5:30 PM !
Upcoming SlideShare
Loading in...5
×

7/12/10 uri="http://www.globalmmcs.org" email="gcf@indiana.edu"

575

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
575
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

7/12/10 uri="http://www.globalmmcs.org" email="gcf@indiana.edu"

  1. 1. Design and Implementation of Audio/Video Collaboration System Based on Publish/subscribe Event Middleware PTLIU Laboratory for Community Grids Geoffrey Fox, Wenjun Wu, Ahmet Uyar, Hasan Bulut Computer Science Department Indiana University, Bloomington IN 47404 http://w ww.globalmmcs.org [email_address] CTS04 San Diego 19 January 2004
  2. 2. A/V Collaboration Systems <ul><li>H323 </li></ul><ul><li>H.323 is defined as an umbrella standard specifying the components to be used within an H.323-based environment. </li></ul><ul><li>SIP </li></ul><ul><li>The Session Initiation Protocol (SIP) defines how to establish, maintain and terminate Internet sessions including multimedia conferences </li></ul><ul><li>Access Grid </li></ul><ul><li>enhanced Mbone A/V tools ( VIC, RAT ) </li></ul><ul><li>Internet 2 network ( Multicast support ) </li></ul>
  3. 3. XGSP Collaboration Framework <ul><li>To integrate heterogeneous systems into one collaboration system </li></ul><ul><ul><li>A unified, scalable, robust “overlay” network is needed to support A/V and data group communication over heterogeneous networking environments. </li></ul></ul><ul><ul><li>A common A/V signaling protocol has to be designed to support interactions between different A/V collaboration endpoints. </li></ul></ul><ul><ul><li>Different A/V endpoints should collaborate in the same collaboration session. </li></ul></ul>
  4. 4. Group Communication in Collaboration <ul><li>Collaboration applications usually need a group communication service for both multipoint data and control information delivery </li></ul><ul><ul><li>Centralized conferencing systems usually depend upon a single conference server </li></ul></ul><ul><ul><li>Distributed conferencing systems use IP multicast </li></ul></ul><ul><ul><li>Access Grid uses Internet2 multicast for audio/video transmission. </li></ul></ul><ul><ul><li>Problems: </li></ul></ul><ul><ul><li>Centralized conferencing systems don’t have good scalability </li></ul></ul><ul><ul><li>IP multicast has not become ubiquitously available </li></ul></ul>
  5. 5. Narada Broker Network Resource Broker Broker Broker Broker Broker Broker Software multicast (P2P) Community (P2P) Community For message/events service (P2P) Community (P2P) Community Data base
  6. 6. Narada Brokering <ul><li>Narada Brokering from the Community Grid Labs is adopted as a general event brokering middleware </li></ul><ul><ul><li>supports publish-subscribe messaging model with a dynamic collection of brokers </li></ul></ul><ul><ul><li>provides services for TCP, UDP, Multicast, SSL and raw RTP clients </li></ul></ul><ul><ul><li>Supports the communication through firewalls and proxies </li></ul></ul><ul><ul><li>operate either in a client-server mode like JMS or in a completely distributed JXTA-like peer-to-peer mode. </li></ul></ul>
  7. 7. Narada Brokering <ul><li>Covers the heterogeneity of network transportation and provides unified multipoint transportation API </li></ul><ul><ul><li>Software multicast </li></ul></ul><ul><ul><li>Communication over firewalls and proxy boundaries </li></ul></ul><ul><ul><li>Communication over multiple transports </li></ul></ul><ul><ul><li>Application level Quality of Service </li></ul></ul><ul><ul><ul><li>Filter messages to slow (collaborative/real-time) clients </li></ul></ul></ul><ul><li>Provides robust, scalable and high efficient multipoint transportation services </li></ul><ul><ul><li>Availability and scalability </li></ul></ul><ul><ul><li>Efficient routing and bandwidth utilizations </li></ul></ul>
  8. 8. A/V Collaboration over publish/subscribe Middleware <ul><li>video streams (VS) VS {v 1 , v 2 , … v m } </li></ul><ul><li>audio streams (AS) AS { a 1 , a 2 , … a n } </li></ul><ul><li>A/V endpoints: E 1 , E 2 , … E n </li></ul><ul><li>Each endpoint may send a single or multiple video streams, but only send an audio stream </li></ul><ul><li>Different types of A/V endpoints have different collaboration capabilities. </li></ul><ul><ul><li>Multicast endpoints are able to receive multiple video and audio streams, display all the video streams in their screens, and mix all the audio streams by themselves </li></ul></ul><ul><ul><li>Unicast endpoints like Polycom Via Video can only receive and play a single video and audio stream </li></ul></ul>
  9. 9. Publish/subscribe of A/V <ul><li>A stream in VS and AS is regarded as a “topic” </li></ul><ul><li>Each RTP packet from this stream is regarded as an “event” for this topic </li></ul><ul><li>Only the sender of this stream can “publish” A/V events to this topic </li></ul><ul><li>Other endpoints need to subscribe to this topic in order to receive the stream data </li></ul><ul><li>Create mixed video and audio stream topics for unicast endpoints </li></ul>
  10. 10. Major Events for each stream topic The stream resumed sending RTP packet Passive-To-Active The stream has stopped sending RTP packet Active-To-Passive This stream has not send any RTCP packet for a long time, indicating it may have left the session TimeOutEvent The stream gives a BYE RTCP packet, indicating it has left the session ByeEvent This stream has been created NewStreamEvent Change in the stream Event Name
  11. 11. A/V Collaboration Architecture
  12. 12. RTP packets encapsulation <ul><li>RTPLink: RTP Packets ~ Narada Brokering Event </li></ul><ul><li>Every legacy A/V client needs one corresponding RTPLink to be set up at a broker within broker network. </li></ul><ul><li>Unicast RTPLink: </li></ul><ul><ul><li>Integer Topic Numbers for RTP and RTCP </li></ul></ul><ul><li>Multicast RTPLink: </li></ul><ul><li>A reflector between NaradaBrokers and multicast groups, encapsulating raw RTP packets from a multicast IP address to RTP events, publishing these events to NaradaBrokers, and forwarding the data it receives from broker network on the same IP address </li></ul>
  13. 13. Audio Mixer, Video Mixer, Image Grabber <ul><li>Audio Mixing </li></ul><ul><ul><li>The audio mixer creates a mixed audio stream from all the audio streams in the session </li></ul></ul><ul><li>Video Mixing </li></ul><ul><ul><li>Video mixing makes the unicast users watch the pictures of multiple participants in a meeting through one video stream </li></ul></ul><ul><li>Video Thumbnail </li></ul><ul><li>visualize the VS set in the session, embedded into the control panel of each endpoint, which </li></ul><ul><li>Image grabbers capture video streams and save them as static JPEG files. </li></ul><ul><li>All the media processing components can be distributed among the pool of the media servers connected to NaradaBrokering infrastructures. </li></ul>
  14. 14. H.323, SIP Gateway Servers, A/V Session Server <ul><li>H.323 and SIP gateway transform these protocol specific messages into XGSP signaling messages so that H.323 and SIP A/V endpoints could communicate with the XGSP A/V session server </li></ul><ul><li>The session server implements session management logics </li></ul><ul><ul><li>creating/destroying A/V sessions </li></ul></ul><ul><ul><li>allowing endpoints to join/leave session </li></ul></ul><ul><ul><li>Allowing users to make audio/video selection, managing A/V application components </li></ul></ul>
  15. 15. Implementation <ul><li>Java Media Framework (JMF) : </li></ul><ul><li>Openh323 is basis of H323 Gateway </li></ul><ul><li>NIST SIP stack is basis of SIP Gateway </li></ul><ul><li>NaradaBrokering is open source messaging from Indiana </li></ul>
  16. 16. Demo Pics ( I )
  17. 17. Demo Pics ( II )
  18. 18. Demo Pics ( III )
  19. 19. Thank you! Please watch our demo at 5:30 PM !
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×