Research Group Multimedia Communication (MMC)

7,527
-1

Published on

Research Group Multimedia Communication (MMC), Department of Information Technology (ITEC)
Klagenfurt University (UNIKLU), Austria

Published in: Technology, Business
2 Comments
2 Likes
Statistics
Notes
No Downloads
Views
Total Views
7,527
On Slideshare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
0
Comments
2
Likes
2
Embeds 0
No embeds

No notes for slide
  • 06.06.09 TODO: MM Buch lesen Antrag lesen MPEG 7 Überblick erarbeiten / Standard ansehen
  • Research Group Multimedia Communication (MMC)

    1. 1. Research Group Multimedia Communication (MMC) Prof. Hermann Hellwagner Department of Information Technology (ITEC) Klagenfurt University (UNIKLU), Austria December 2008
    2. 2. Staff <ul><li>Group Leader </li></ul><ul><ul><li>Prof. DI Dr. Hermann Hellwagner </li></ul></ul><ul><li>Secretary </li></ul><ul><ul><li>Angelika Rossak </li></ul></ul><ul><li>Assistant Professor </li></ul><ul><ul><li>DI Dr. Christian Timmerer </li></ul></ul><ul><li>University Assistants </li></ul><ul><ul><li>DI Janine Lachner </li></ul></ul><ul><ul><li>DI Ingo Kofler </li></ul></ul><ul><li>System Engineers </li></ul><ul><ul><li>Andreas Griesser </li></ul></ul><ul><ul><li>Markus Waltl </li></ul></ul><ul><li>Project Assistants </li></ul><ul><ul><li>DI Dr. Michael Ransburg </li></ul></ul><ul><ul><li>DI Robert Kuschnig </li></ul></ul><ul><ul><li>DI Bernhard Reiterer </li></ul></ul><ul><ul><li>DI Michael Eberhard </li></ul></ul><ul><li>Project Staff Members </li></ul><ul><ul><li>Michael Sablatschan </li></ul></ul><ul><ul><li>Christian Raffelsberger </li></ul></ul><ul><ul><li>Mario Jonke </li></ul></ul>
    3. 3. Research Areas <ul><li>Multimedia Communication and Adaptation </li></ul><ul><ul><li>Adaptive video streaming (with a focus on SVC), protocols </li></ul></ul><ul><ul><li>Ambient, personalized, user-centric multimedia (UMA) </li></ul></ul><ul><ul><li>Knowledge-based multimedia adaptation </li></ul></ul><ul><li>MPEG-21 Standardization </li></ul><ul><ul><li>Digital Item Adaptation (DIA) </li></ul></ul><ul><ul><li>Metadata compression (MPEG-B) and streaming, file format </li></ul></ul><ul><ul><li>Reference software </li></ul></ul><ul><li>Distributed MPEG-21 Infrastructure and QoS Provisioning </li></ul><ul><ul><li>Metadata streaming, compressed processing </li></ul></ul><ul><ul><li>Distributed adaptation, cross-layer QoS mapping </li></ul></ul><ul><li>Prototype Adaptive Multimedia Tools and Services </li></ul>
    4. 4. Research Projects (and Funding) <ul><li>Industry (partial funding): </li></ul><ul><ul><li>MPEG-21 standardization: in cooperation with Siemens CT IC 2, Munich </li></ul></ul><ul><ul><li>SVC adaptation: in cooperation with ST Microelectronics, Milano </li></ul></ul><ul><li>European Commission (IST FP6): </li></ul><ul><ul><li>DANAE (STREP; 01/2004 – 06/2006): “ Dynamic and distributed Adaptation of scalable multimedia coNtent in a context-Aware Environment “ </li></ul></ul><ul><ul><li>ENTHRONE II (IP; 09/2006 – 11/2008): “End-to-End QoS through Integrated Management of Content, Networks and Terminals“ </li></ul></ul><ul><ul><li>INTERMEDIA (NoE; 10/2006 – 09/2010): “Interactive Media with Personal Networked Devices“ </li></ul></ul><ul><ul><li>P2P-Next (IP; 01/2008 – 12/2011): “Next Generation Peer-to-Peer Content Delivery Platform“ </li></ul></ul><ul><li>Austria Science Fund (FWF) – Basic Research: </li></ul><ul><ul><li>Quality Adaptive Video Caching and Transport (QAVCT) </li></ul></ul><ul><ul><li>Adaptive Streaming of Secure Scalable Wavelet-based Video (ASSSV) </li></ul></ul><ul><ul><li>Scalable Video Based Provisioning of TV and VoD Services over the Internet (SCALIPTV) </li></ul></ul><ul><li>FWF and Austrian Network for E-Tourism (ANET): </li></ul><ul><ul><li>Context-Aware Multimedia Services (CAMUS), Mobile Tour Guide </li></ul></ul><ul><li>Klagenfurt University: </li></ul><ul><ul><li>Independent PhD Theses </li></ul></ul>
    5. 5. Example of Previous Work (DANAE) DANAE Objectives <ul><li>DANAE: IST FP6 STREP project (01/2004 – 06/2006) </li></ul><ul><li>“ Dynamic and distributed Adaptation of scalable multimedia coNtent in a context-Aware Environment “ </li></ul><ul><li>Major objectives: </li></ul><ul><ul><li>Development of an advanced MPEG-21 infrastructure focusing on end-to-end QoS support, personalization, DIA, and DI Processing, as well as integrating MPEG-4 and MPEG-7 tools </li></ul></ul><ul><ul><li>Development of efficient scalable video coding tools (including contributions to standardization) and further adaptability means </li></ul></ul><ul><li>General information: </li></ul><ul><ul><li>http://danae.rd.francetelecom.com/ </li></ul></ul>
    6. 6. Example of Previous Work (DANAE) Vision: Adaptive MM Information in a Museum <ul><li>Application and demo in Museon, Den Haag (http://www.museon.nl) </li></ul><ul><li>Visitor should be able to receive ... </li></ul><ul><ul><li>Multimedia content (images, video, audio, text, virtual character, interactives) ... </li></ul></ul><ul><ul><li>On mobile device (PDA) ... </li></ul></ul><ul><ul><li>Location-aware (specific to current zone/theme/sub-theme/object of the exhibition) ... </li></ul></ul><ul><ul><li>Personalized (e.g., acc. to age, thematic interests, expert level) ... </li></ul></ul><ul><ul><li>Adapted to current usage environment (e.g., network conditions) </li></ul></ul><ul><li>Fully compliant to MPEG-21 and integrating other standards </li></ul><ul><li>Technically, a great success Yet, museum installation did not work out as expected </li></ul>
    7. 7. Example of Previous Work (DANAE) Our Contributions <ul><li>1. Context collection and aggregation </li></ul><ul><li>2. (MPEG-21) metadata streaming </li></ul><ul><li>3. Semantic adaptation </li></ul><ul><li>4. Distributed adaptation framework </li></ul>
    8. 8. Example of Previous Work Personal Live Video Server (PLVS) <ul><li>DVB-based Live Content Acquisition, Adaptation, and Streaming </li></ul>
    9. 9. Example of Previous Work (CAMUS, ANET) Multimedia-based Tour Guide System
    10. 10. Example of Previous Work (CAMUS, ANET) Reference Application “MultiMundus“
    11. 11. Example of Current Work (ENTHRONE II) End-to-End QoS for MM Content and Services <ul><li>Cross-network/provider, cross-layer interactions, MPEG-21 based adaptation </li></ul>
    12. 12. Example of Current Work (ENTHRONE II) ENTHRONE Integrated Management Supervisor Integrated Management of Content (Digital Items) Integrated Management of Services Content- and Context-aware Digital Item Service Management Integrated Management of Connectivity Services of Heterogeneous Networks Integrated Management of Heterogeneous Terminals
    13. 13. Example of Current Work (INTERMEDIA) Vision: User-centric Multimedia Convergence <ul><li>People are using a variety of heterogeneous devices and systems for their daily activities, with increasing involvement of multimedia </li></ul><ul><li>INTERMEDIA is an interdisciplinary research project aiming at </li></ul><ul><ul><li>natural, automatic connection with any information device and provision of personalized multimedia content, considering fixed, public, and mobile/personal devices </li></ul></ul><ul><ul><li>reducing human effort for usage of multimedia </li></ul></ul><ul><ul><li>increasing mobility and allow for seamless continuation of users‘ activities across locations, networks, and devices </li></ul></ul><ul><li>Our contributions: content adaptation and management </li></ul><ul><ul><li>Adaptation of content and presentations to users and their environment </li></ul></ul><ul><ul><li>Convenient sharing of multimedia content </li></ul></ul><ul><ul><li>Effective usage of metadata for personalized media access </li></ul></ul>
    14. 14. Example of Current Work (P2P-Next) Objectives, Key Characteristics, and WP Overview <ul><li>Objective </li></ul><ul><ul><li>P2P-Next develops an open source , efficient , trusted , personalized , user-centric , and participatory television plus media delivery mechanism with social and collaborative connotation using the emerging Peer-to-Peer (P2P) paradigm, which takes into account the existing EU legal framework . </li></ul></ul><ul><li>Key characteristics </li></ul><ul><ul><li>Live streaming and (progressive) downloading </li></ul></ul><ul><ul><li>Enables horizontal market solutions </li></ul></ul><ul><ul><li>Facilitates social networking </li></ul></ul><ul><ul><li>User-driven development through living lab </li></ul></ul>
    15. 15. Example of Current Work (ASSSV) <ul><li>Focus on in-network adaptation of secured H.264/SVC and wavelet-based scalable video </li></ul><ul><li>RTP-compliant adaptation on Media-Aware Network Element (MANE) </li></ul><ul><li>Analysis of partial and selective encryption schemes </li></ul>
    16. 16. Example of Current Work H.264/SVC Adaptation on WiFi Router <ul><li>Design and Development of an Adaptation Proxy </li></ul><ul><ul><li>Stateful approach , intercepts RTSP sessions </li></ul></ul><ul><ul><li>SVC adaptation by utilizing the dedicated RTP payload format </li></ul></ul><ul><ul><li>Supports adaptation in different dimensions ( SNR , spatial , temporal ) </li></ul></ul><ul><ul><li>SOAP interface for monitoring and control purposes </li></ul></ul><ul><ul><li>Interface to traffic control mechanisms on IP layer (allows bandwidth reservation for each session) </li></ul></ul><ul><li>Platform </li></ul><ul><ul><li>Linksys WRT54GL router , 200 MHz RISC CPU, 16 MB RAM </li></ul></ul><ul><ul><li>OpenWrt, Linux -based, Kernel 2.4.x </li></ul></ul><ul><ul><li>Proxy implementation in ANSI C </li></ul></ul><ul><ul><li>Maximum throughput of current implementation ~ 10 Mbps (e.g. 4 streams with 2.5 Mbps each ) </li></ul></ul>
    17. 17. Example of Current Work (SCALIPTV) <ul><li>Objectives </li></ul><ul><ul><li>... to design, implement, and evaluate an SVC-based IPTV architecture . </li></ul></ul><ul><ul><li>... to enable users to consume the media contents at the best possible quality regardless of their specific network and device. </li></ul></ul><ul><ul><li>... to closely work together with an Austrian industry partner in order to evaluate the novel IPTV architecture in a real-world setting . </li></ul></ul><ul><ul><li>... to integrate results with the international SCALNET project of the CELTIC initiative. </li></ul></ul>Forecasts for IPTV Subscribers / Revenue by the Multimedia Research Group, http://www.mrgco.com
    18. 18. Recent MPEG Standardization Activities <ul><li>MPEG-4 ISO Base File Format </li></ul><ul><ul><li>Timed metadata </li></ul></ul><ul><li>MPEG-21 Multimedia Framework (2002 – 2007) </li></ul><ul><ul><li>Major contributions to Digital Item Adaptation + served as editor </li></ul></ul><ul><ul><li>Various contributions to Vision, Technologies and Strategy, Digital Item Declaration, File Format, Reference Software, Conformance, Event Reporting, and Binary Format </li></ul></ul><ul><li>Representation of Sensory Effects: RoSE (2007 – now) </li></ul><ul><ul><li>Editor of the standard </li></ul></ul><ul><ul><li>Sensory Effect Description Language (SEDL) + reference implementation </li></ul></ul><ul><li>Multimedia Extensible Middleware: MXM (2008 – now) </li></ul><ul><ul><li>Co-editor of the standard </li></ul></ul><ul><ul><li>Contributions related to adaptation of multimedia content according to the usage environment context </li></ul></ul><ul><li>Head of the Austrian Delegation </li></ul>http://www-itec.uni-klu.ac.at/~timse/research/mpeg-contributions.html > 150
    19. 19. Most Relevant Recent Publications Books and Book Chapters <ul><li>D. Jannach, C. Timmerer, and H. Hellwagner, “Knowledge-based Multimedia Adaptation Decision-Taking”, long article, in: Borko Furht (ed.), Encyclopedia of Multimedia , 2nd edition, Springer, pp. 391-394, October 2008. </li></ul><ul><li>I. Kofler, C. Timmerer, and H. Hellwagner, “Optimization-based Multimedia Adaptation Decision-Taking”, long article, in: Borko Furht (ed.), Encyclopedia of Multimedia , 2nd edition, Springer, pp. 699-704, October 2008. </li></ul><ul><li>C. Timmerer, A. Vetro, and H. Hellwagner, “MPEG-21 Digital Item Adaptation”, long article, in: Borko Furht (ed.), Encyclopedia of Multimedia , 2nd edition, Springer, pp. 457-463, October 2008. </li></ul><ul><li>C. Timmerer and H. Hellwagner, “MPEG-21 Multimedia Framework”, long article, in: Borko Furht (ed.), Encyclopedia of Multimedia , 2nd edition, Springer, pp. 463-469, October 2008. </li></ul><ul><li>C. Timmerer, M. Ransburg, and H. Hellwagner, “Generic Multimedia Content Adaptation”, long article, in: Borko Furht (ed.), Encyclopedia of Multimedia , 2nd edition, Springer, pp. 263-271, October 2008. </li></ul><ul><li>C. Timmerer, Generic Adaptation of Scalable Multimedia Resources , VDM Verlag, May 2008. </li></ul><ul><li>H. Hellwagner: “Challenges toward Adaptive Behavior of Distributed Multimedia Systems”, In: G. E. Lasker and J. Pfalzgraf (Eds.), Advances in Multiagent Systems, Robotics and Cybernetics: Theory and Practice (Volume II) . 2008. </li></ul><ul><li>A. Vetro, C. Timmerer, and S. Devillers: “Digital Item Adaptation - Tools for Universal Multimedia Access”, in: I. Burnett, F. Pereira, R. Van de Walle, and R. Koenen (eds.), The MPEG-21 Book , John Wiley and Sons Ltd, pp. 243-281, 2006. </li></ul><ul><li>C. Timmerer, S. Devillers, and A. Vetro: “Digital Item Adaptation - Coding Format Independence”, in: I. Burnett, F. Pereira, R. Van de Walle, and R. Koenen (eds.), The MPEG-21 Book , John Wiley and Sons Ltd, pp. 282-331, 2006. </li></ul><ul><li>H. Hellwagner: “Arbeitsspeicher- und Bussysteme”, in: P. Rechenberg and G. Pomberger (Hrsg.): Informatik-Handbuch . 4. Auflage, Hanser Verlag 2005. </li></ul><ul><li>A. Bode and H. Hellwagner: “Leistungsbewertung und Fehlertoleranz”, in: P. Rechenberg and G. Pomberger (Hrsg.): Informatik-Handbuch . 4. Auflage, Hanser Verlag 2005. </li></ul>
    20. 20. Most Relevant Recent Publications International Journals <ul><li>I. Kofler, J. Seidl, C. Timmerer, H. Hellwagner, I. Djama, and T. Ahmed, “Using MPEG-21 for cross-layer multimedia content adaptation”, Journal on Signal, Image and Video Processing (SIVP) , vol.2, no. 4, pp. 355-370, December 2008. </li></ul><ul><li>M. Sidibé, H. Koumaras, I. Kofler, A. Mehaoua, A. Kourtis, and C. Timmerer, “A novel monitoring architecture for media services adaptation based on network QoS to perceived QoS mapping”, Journal on Signal, Image and Video Processing (SIVP) , vol.2, no. 4, pp. 307-320, December 2008. </li></ul><ul><li>Robert Kuschnig, Ingo Kofler, Michael Ransburg, Hermann Hellwagner, “Design Options and Comparison of In-network H.264/SVC Adaptation ”, EURASIP Journal of Visual Communication and Image Representation ( Special Issue on Adaptive Video Streaming), 2008. </li></ul><ul><li>Martin Prangl, Tibor Szkaliczki, Hermann Hellwagner, “A Framework for Utility-based Multimedia Adaptation”, IEEE Transactions on Circuits and Systems for Video Technology , June 2007. </li></ul><ul><li>P. Schojer, L. Böszörmenyi, H. Hellwagner, “QBIX-G  A Transcoding Multimedia Proxy“, ACM/Springer Multimedia Systems Journal , March 2007. </li></ul><ul><li>R. De Sutter, S. Lerouge, P. De Neve, C. Timmerer, H. Hellwagner, R. Van de Walle, “Comparison of XML serializations: cost benefit vs. complexity”, ACM/Springer Multimedia Systems Journal , Oct. 2006. </li></ul><ul><li>Dietmar Jannach, Klaus Leopold, Christian Timmerer, Hermann Hellwagner, “A Know-ledge-Based Framework for Multimedia Adaptation”, Applied Intelligence , April 2006. </li></ul><ul><li>Anthony Vetro, Christian Timmerer, “Digital Item Adaptation: Overview of Standardization and Research Activities”, IEEE Transactions on Multimedia (Special Issue on MPEG-21), June 2005. </li></ul><ul><li>Sylvain Devillers, Christian Timmerer, Jörg Heuer, Hermann Hellwagner, “Bitstream Syntax Description-based Adaptation in Streaming and Constrained Environments”, IEEE Transactions on Multimedia (Special Issue on MPEG-21), June 2005. </li></ul><ul><li>Christian Timmerer, Hermann Hellwagner, “Interoperable Adaptive Multimedia Communication”, IEEE Multimedia Magazine , January-March 2005. </li></ul><ul><li>Gabriel Panis, Andreas Hutter, Jörg Heuer, Hermann Hellwagner, Harald Kosch, Christian Timmerer, Sylvain Devillers, Myriam Amielh, “Bitstream Syntax Description: A Tool for Multimedia Resource Adaptation within MPEG-21”, EURASIP Signal Processing: Image Communication Journal (Special Issue on Multimedia Adaptation), Sept. 2003. </li></ul>
    21. 21. Most Relevant Recent Publications International Conferences <ul><li>C. Timmerer, M. T. Andrade, P. Carvalho, D. Rogai, and G. Cordara, “The Semantics of MPEG-21 Digital Items Revisited”, Proceedings of ACM Multimedia 2008 2nd International Workshop on the Many Faces of Multimedia Semantics , Vancouver, Canada, October 27 - November 1, 2008. </li></ul><ul><li>M. Eberhard, L. Celetto, C. Timmerer, E. Quacchio, H. Hellwagner, F. Rovati, “An Interoperable Multimedia Delivery Framework for Scalable Video Coding based on MPEG-21 Digital Item Adaptation”, Proc. IEEE Int’l. Conf. on Multimedia and Expo 2008 (ICME’08), Hannover, Germany, June 2008. </li></ul><ul><li>Ingo Kofler, Martin Prangl, Robert Kuschnig, Hermann Hellwagner, “An H.264/SVC-based adaptation proxy on a WiFi router”, Proc. 18th Int’l. Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2008), Braunschweig, Germany, May 2008. </li></ul><ul><li>Martin Prangl, Roland Bachlechner, Hermann Hellwagner, “A Hybrid Recommender Strategy for Personalized Utility-based Cross-modal Multimedia Adaptation ” , Proc. IEEE Int‘l. Conf. on Multimedia and Expo (ICME 2007) , July 2007. </li></ul><ul><li>Martin Prangl, Hermann Hellwagner, Tibor Szkaliczki, “Fast adaptation decision taking for cross-modal multimedia content adaptation“, Proc. IEEE Int‘l. Conf. on Multimedia and Expo (ICME 2006) , Toronto, Canada, July 2006 . </li></ul><ul><li>Peter Schojer, Laszlo Böszörmenyi, Hermann Hellwagner, “QBIX-G – A Transcoding Multimedia Proxy“, Proc. 13th SPIE Annual Electronic Imaging Conference – Multimedia Computing and Networking (MMCN 2006) , San Jose, CA, USA, January 2006 . </li></ul><ul><li>Michael Kropfberger, Hermann Hellwagner, “Combining Stream Switching with Fine-grained Intra-stream Adaptation for Adaptive Video Streaming“, Proc. IEEE Int‘l. Work-shop on Multimedia Signal Processing (MMSP 2005) , Shanghai, China, Oct./Nov. 2005. </li></ul><ul><li>Andreas Hutter, Peter Amon, Gabriel Panis, Eric Delfosse, Michael Ransburg, Hermann Hellwagner, “Automatic Adaptation of Streaming Multimedia Content in a Dynamic and Distributed Environment“, Proc. Int‘l. Conf. on Image Processing (ICIP 2005) , Genova, Italy, September 2005. </li></ul><ul><li>Dietmar Jannach, Klaus Leopold, Christian Timmerer, Hermann Hellwagner, “Toward Semantic Web Services for Multimedia Adaptation“, Proc. 5th Int‘l. Conf. on Web Information Systems Engineering (WISE 2004) , Brisbane, Australia, November 2004. </li></ul><ul><li>Peter Schojer, Laszlo Böszörmenyi, Hermann Hellwagner, Bernhard Penz, Stefan Podlipnig, “Architecture of a Quality Based Intelligent Proxy (QBIX) for MPEG-4 Videos“, Proc. ACM World Wide Web Conference (WWW 2003) , Budapest, Hungary, May 2003. </li></ul>

    ×