Mobile Multimedia Cloud Computing and the Web


Published on

Mobile multimedia services are in high demand, but their development comes at high costs. The emergent computing paradigm cloud computing has great potential to embrace these issues. In fact, we are at the early stage of the coalescence of cloud computing, mobile multimedia and the Web. Motivated by the tremendous success story of the Web based on its simplicity principles, we argue for a comprehensive review on current practices of web and mobile multimedia cloud computing techniques for avoiding frictions. We draw on experience from the development of advanced collaborative multimedia web applications utilizing multimedia metadata standards like MPEG-7 and real-time communication protocols like XMPP. We propose our i5CLoud, a hybrid cloud architecture, which serves as a substrate for scalable and fast time-to-market mobile multimedia services. This paper demonstrates the applicability of emerging cloud computing concepts for mobile multimedia.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Mobile Multimedia Cloud Computing and the Web

  1. 1. MMC Workshop on Multimedia on the Web Mobile Multimedia Cloud Computing and the Web Dejan Kovachev, Yiwei Cao & Ralf Klamma September 8th, 2011 Informatik 5 (Information Systems), RWTH Aachen University & Bonn-Aachen International Center for Applied Information Technology Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-1 Graz, Austria
  2. 2. Motivation    “By 2013, mobile phones will surpass PCs as the way most people hop onto the Web” [Gartner report 2010] “…two-thirds of the world's mobile data traffic will be video by 2015” [Cisco Visual Networking Index 2010] Mobile and web networks converge – Asymmetry in multimedia material production and consumption  User/Community/Social Computing – Movement from business-oriented to user/community-centric applications  Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-2 Increased exploration of the potential of cloud computing by organizations and individuals
  3. 3. Agenda Motivation  Experiences from previous works  Perspectives on mobile multimedia cloud computing  – Technology – Mobile multimedia – User and community perspective I5 Multimedia cloud architecture  Use cases  Discussion and future work  Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-3
  4. 4. Previous works: LAS Server & Applications  Lightweight Application Server (LAS) [Spaniol et al. 2006] – Community Middleware – Platform for (Web-)Services – Currently: ~30 Services – E.g.: Usermanager, MPEG-7 Services  Applications using LAS: – – – – – Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-4  YouTell (Web) SeViAnno (Web) AnViAnno (Android) Mobile Campfire (iPhone) NMV (Desktop) More recently: LAS XMPP Extension
  5. 5. Previous works: SeViAnno  Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-5 Interactive semantic annotation of videos [Cao et al. 2010]
  6. 6. Experiences from Building Multimedia Web Applications  Design and implementation of alternative architecture Factors Next-generation Mobile Web Services Performance Low response time independent of requests Scalability Scalable and distributed access to services Development cost Enabling of a single person to design and run web-scale multimedia applications Availability Available services from anywhere at anytime Interoperability Various mobile platforms Protocols and Cloud-based multimedia framework using emerging protocols standards and standards like XMPP and HTML5 Reduced data Improved mobile multimedia service quality communication Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-6
  7. 7. Mobile Multimedia Cloud Computing: Technology Perspective  Data management – Big data and NoSQL cloud storage for multimedia artifacts – Amazon S3, Google BigTable, Hadoop HBase – Traditional relational DBMS for metadata storage  Communication – The mobile broadband Internet offers improved QoE, more interactive applications – Protocols like XMPP or SIP offer integrated social structures application-level routing, resource discovery, extensibility, etc.  Computation – Client server model and Web Services – Automatic offloading of computation tasks into the cloud or using nearby resources (home servers, base stations, kiosks) Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-7
  8. 8. Mobile Multimedia Perspective  Multimedia formats and transcoding – Interoperability and adaptation via transcoding services for different platforms  Multimedia semantics – Analysis of low-level features  Multimedia modeling – Multimedia context (coming from the multimedia semantics) – Mobile context inferred using sensors on devices – Metadata standards and ontologies for knowledge representation and processing Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-8
  9. 9. User and Community Perspective  Sharing and collaboration – Driving force for mobile devices improvement  Ubiquitous multimedia services – Accessibility on heterogeneous mobile and desktop devices – Seamless multimedia experience  Privacy and security – Holistic trust models of devices, applications, communication channels and cloud service providers Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-9
  10. 10. I5 Multimedia Cloud Architecture Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-10
  11. 11. I5 Cloud Resource Usage Monitoring Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-11
  12. 12. Use Case: Collaborative Metadata Management and Multimedia Sharing XMPP is the main communication protocol to support real-time collaboration 1- images and videos 2- tag basic metadata Documentation Expert Architecture Expert Metadata Captured time Taken location Creation time Provenance …. Local Workforce Collaborative Multimedia Cloud Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-12 Historian Third party Metadata Repository
  13. 13. Use Case: Mobile and Web Video Integration Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-13
  14. 14. Use Case: Improving UX of Mobile Video Media Using Cloud Services  Mobile video browsing tedious - Only time point as position clue - Takes long time until preview image available Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-14  Improvement of mobile video browsing - Segment-dependent - Metadata-dependent Improving user experience for mobile video by intelligent and fast video processing cloud services
  15. 15. Discussion   Mobile networks are part of the Web now Augmentation of resource-poor mobile devices through cloud services Perspective Technology Multi-platform video transcoding, MPEG-7 based metadata, intelligent video adaptation User/Community I5-KCKl-0911-15 XMPP, Video streaming, Deltacloud API Mobile multimedia Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke Use cases’ features Enhanced mobile video UX, collaborative multimedia services via metadata creation and sharing in real-time
  16. 16. Future Work  The XMPP protocol for metadata synchronization as XEP extension – Real-time collaboration and sharing of XML documents (i.e. metadata documents)  Interoperability between MPEG-7 and other metadata standards – W3C Media Annotations Ontology and API  Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-16 Three-tier cyber-foraging using offloading to nearby (cloudlet) and remote resources (cloud) – Reduced latency – better interactivity – Goal-Cost-Metrics based model for resources scheduling
  17. 17. Feedback? Questions? Thank You! @dkovachev Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KCKl-0911-17