Towards Socially Intelligent Media Computing
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Towards Socially Intelligent Media Computing

on

  • 230 views

Towards Socially Intelligent Media Computing ...

Towards Socially Intelligent Media Computing
Keynote at KESS 2nd International Symposium on
Intelligent Interactive Multimedia Systems and Services, IIMSS09
Mogliano Veneto, Venice, Italy, organized by University of Milan, July 2009

Statistics

Views

Total Views
230
Views on SlideShare
230
Embed Views
0

Actions

Likes
0
Downloads
5
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Towards Socially Intelligent Media Computing Presentation Transcript

  • 1. Towards Socially Intelligent Media Computing Keynote at KESS 2nd International Symposium on Intelligent Interactive Multimedia Systems and Services, IIMSS09Mogliano Veneto, Venice, Italy, organized by University of Milan, July 2009 Paolo Nesi DISIT-DSI, Distributed Systems and Internet Technology Lab Department of Systems and Informatics, University of Florence nesi@dsi.unifi.it, paolo.nesi@unifi.it http://www.dsi.unifi.it/~nesi, http://www.disit.dsi.unifi.it version 2.7e 1
  • 2. OverviewO AXMEDIS aims and complexityO AXMEDIS model and toolsO AXMEDIS DRMO Automated back office toolsO Distribution ScenariosO Exploitation Activities 2
  • 3. Project GoalsO Costs Reduction for content production and distribution for multichannelO Better integration along the value chainO Interoperability among channels/devices taking into account DRM and formatsO Large range of different scenarios:  From VOD to DVB  From mobile to TV  From B2B to B2C  trials, take ups actions, ..O Along the social network growing, UGC, UGE 3
  • 4. Partners 4
  • 5. Automating Content/Metadata Life-Cycle x multichannel customizations languages DVB (T, S.. GRID Internet Fingerprint Packaging P2P P2P Active Search MPEG-21 Mobile processing OMA Gathering CMS Protection Social Net workflow Adaptation UGC flexibility Ingestion Data Collect. plug-ins Storage Reporting tools Enrichment Cross media Interop. DRM databases Authoring Profiling Statistics standards Metadata Licensing Players webservices Content Accounting optimisation 5
  • 6. Major points of complexityO Modeling a flexible framework with  Different content formats/models  Different distribution formats/models  Different devices, platforms, players,..  Different distribution protocols: streaming, download, progressive download, multipath streaming DIS, P2P, progressive P2P, …  Different business and transactions models  Different standards along the several aspects  Different life cycles and best practices for back office  Etc. 6
  • 7. Mapping Main AXTools on Life-Cycle customizations languages DVB (T, S..GRID solutions Internet P2PP2P sharing Mobileprocessing Social Net workflow UGCflexibilityplug-ins toolsdatabases standardswebservices optimisation 7
  • 8. Points of ComplexityO Content formats vs players  high production costs for authoring tools and players  Lack of intelligence on players  Custom vs standard, limited vs interoperable  Large variety of platforms, mobile foot printO Protection, DRM along the value chain, B2B2C  Number of licenses processed for objects: O(MN)  Millions of users are licensed for millions of objects !!  Managing life cycle rights and business models/transactionsO Automated content production  Production on demand, real time processing on user needs  Dynamic and static profiling  Dynamic content adaptation and formatting (layouting)  Processing profiles and descriptors in real time  Management of UGC and professional contentO Multichannel production vs distribution  Flexibility in refactoring/scaling up the back office  Processing in real time, managing multichannel back office  Huge costs of integration, business models, trans. Models… 8
  • 9. AXMEDIS Technical Architecture User Interaction and/or Automated Control via WSs Multidev. Player & Plugins AXMEDIS (CP) AXMEDIS Authoring Tools AXMEDIS manual and AXMEDIS MPEG-21 Administrative Tools Content Processing autom. content sharing AXMEDIS DRM Metadata Resources Reporting Tools and Distribution Tools AXMEDIS Script Editor X& Multimedia Styles AXEPTool B2B P2P and Debug Plug-ins DRM Licenses ….. AXMEDIA B2C P2P AXCP GRID Scheduler Protection information Programme and Pub Plug in DRM Protection Content Query Workflow Content Manager Support Support Adaptation Support Support Descriptors Content Packaging Content Content Database Communic Metadata Crawling Support Processing Formatting Support Support Support AXMEDIS Model Supports and Plug-ins including support for XML, XSLT, WSDL, OS, etc. WS, https, AXMEDIS, Traditional and P2P AXMEDIS FTP, Webdav, MPEG-21 Distribution etc. DRM Servers Channels and servers CMSs Databases 9
  • 10. OverviewO AXMEDIS aims and complexityO AXMEDIS model and tools  Lack of intelligence on players  Custom vs standard, limited vs interoperable  Large variety of platforms, mobile foot print  High complexity of authoring tools and player  High production costsO AXMEDIS DRMO Automated back office toolsO Distribution ScenariosO Exploitation Activities 10
  • 11. Interactive and intelligent Final users Browse, searchO New content formats User generatedO New TV formats proactiveO integrated media info MultichannelO proactive with the usersO attractive experience User generatedO personalizedO multichannel Saving experience interoperableO device interoperable 11
  • 12. Examples: Intelligent ContentO Single Files:  audio, video, documenti, immages, etc..O Interactive Content:  HTML or SMIL as technology of User interaction  Guids, games, etc.  Valoriz. of Cultural Heritage content  Educational ContentO Proactive Wizard:  Video messg. Recording, UGC  Assisted upload  Production of licenses  User profile processing  Taking decision  Local indexing/searching  Local assistant  …. 12
  • 13. AXMEDIS Object/Package Model unique mandatory content description identification special B2B metadata AxOID + …. AxInfo AxDublinCore AxMetadata AxMetadata AxMetadata AxObject AxMetadata AxMetadata AxContent AxResource MPEG21 AxMetadata Digital Item AxMetadata AxMethods AxObject resource embedding AxReferred hierarchical composition Object external content referencing Intelligent, logic & behaviour AxMethods 13
  • 14. An example to wrap it all up Music Album Backstage AxInfo DublinCore Q Rights Owner Q Title Q Other Video Descriptions Q Producer Q Genre Q Rights Owner Q Video (e.g. MPEG7) Q Distributor Q Authors Q Producer Q Genre Album Cover Bonus Q Distributor Q Authors Q Rights Owner Q Image Resource video Q Producer Q Author Q Subtitles Languages Q Distributor Q Size JPG image Playing time Referred Q Object Resolution Album Lyrics (printable) Q Q Doc Resource Q Q Rights Owner Producer Q Authors Resource Q Distributor Q Format PDF MPEG2 Video Album Tracks track track track track track Q… Q… Q… Q… Q… Q Rights Owner Q Audio collection O Metadata will be Q Producer Q Time mp3 mp3 mp3 mp3 mp3 always accessible Q Distributor length for indexing and querying 14
  • 15. AXMEDIS Cross Media ContentO Any content inside a package:  Mix of: HTML, SMIL, MPEG-4, video, audio, text, Documents, images, actions, games, animations, etc.  Additional content and interactivity for the end users  compliant and extending MPEG-21O AXMEDIS Intelligent content allow user/producers to  create content for other devices: ringtones, mobiles, …  support social activity  annotations  user generated content  personal collections  internal query  customized for culture and language 15
  • 16. Interoperable Players 16
  • 17. OverviewO AXMEDIS aims and complexityO AXMEDIS model and toolsO AXMEDIS DRM  Standards de facto, lack of acceptance, …  Millions of users are licensed for millions of objects !!  Number of licenses processed for objects: O(MN)  Managing life cycle rights and business models/transactions  Lack of agreements about the meaning of rights and ontologyO Automated back office toolsO Distribution ScenariosO Exploitation Activities 17
  • 18. market solutions viz AXMEDISBusiness Models Larger number of Business ModelsB2C DRM B2B, B2C, B2B2C DRM solutionProprietary / Standard DRM and model Standard DRM: MPEG-21, OMA, etc.Non interoperable DRM Allowed Interoperable DRM: MPEG-21, OMA, etc.Fixed/Flexible Protection Model Any Protection Model, key, algorithms, etc.Separation among Content and license Separation among Content and licenseSigned Content Header Signed Content AXINFO, any MetadataChannel distribution Multichannel with the same licensePlayers and Devices Players and Devices: PC MS-Windows, PDA Windows Mobile, STB, Linux OS, Apple MAC (in progress), Java MobilesLicense Proprietary: Licenses MPEG-21 REL: Expandable dictionary, any type ofnumber of rights, domainss rights, licenses OMA, domainsAuthentication of Player Authentication of device, user, domain, etc.Revocation per Player Revocation per device, user, etc,Revocation per license Revocation per licenseSource code non accessible Source Code AccessibleLimited Metadata Any metadata, custom metdata, any ID, any DescriptorMedia content, simple content, not intelligent Any digital format, of any type: audio, video, image, games, doc, and Cross media: SMIL, HTML, MPEG-4,… INTELLIGENT contentCustomizable Tools Customizable Tools: servers and player clients 18
  • 19. Managing License Chain, B2B and B2C Carl ALICE BOBO Alice states, “Bob has the right to issue a license to anyone to print the book in Italy”O Bob states, “Carl has the right to print the book in Italy”O To solve the SubSubLicense for Carl all the connected Licenses are neededO Licenses have to be accessible on Processing EngineO Alice can revoke the license to Bob 19
  • 20. Cross media content and compositionO AXMEDIS objects can be used as components for creating other added values AXMEDIS objects  Allowing the production added value object for composition or integration of protected content Who is composing can add its own prot. and licensing  Allowing the Rights Management of Composition, in the digital world similarly at what is performed in the physical world  The shares along the value chain are de facto formalized 20
  • 21. Managing License Chain and Protection Information Protection Protection Protection Protection Info Info Info Info Action log database Certifier and Supervisor Store Key License Server, Protection Manager Support DRM Processor use use Produce use License Produce Right Produce Produce Auth. License Auths to License Auth to License Content integrate distribute Digital provider Protected Content Content Metadata Integrator Distributor Resource Content Integrated Digital provider Digital Protected Protected Content Content 21
  • 22. DRM and Domain ManagementO Users are strongly interested in acquiring a content to be used in their domain in which they have their  Home devices, cars, mobiles, etc.O Media Centers and/or Home Servers are going to manage content and licenses for the whole domain  One license for all devices and people ADSL Domain Server 22
  • 23. OverviewO AXMEDIS aims and complexityO AXMEDIS model and toolsO AXMEDIS DRMO Automated back office tools  Flexibility and scalability of back office,  thousands of features, complex media processing language, programming grid  Processing profiles and descriptors in real time  Production on demand, real time processing on user needs  Management of UGC and professional content  Dynamic and static profiling  Dynamic content adaptation and formatting (layouting)O Distribution ScenariosO Exploitation Activities 23
  • 24. Enabling massive content production and processing Author Producer / Aggregator / Distributor / Facilitator User AX Editors AX P2P AXCP Tools AX PlayersO AXMEDIS GRID language and tools for  Automated Content Ingestion and Gathering  Automated Content Query and Retrieval  Automated Content Load and Storage: databases and files  Automated Content and Metadata Processing, enrichment  Automated Content and Data processing  Automated Content Filtering and Repurposing  Automated Content Composition, Formatting  Automated Content Protection and Licensing  Automated Content Publication/Download on/from any channel  Automated Content Distribution via Multichannel  Automated Profiles management and processing  Automated Production of Content on Demand  Automated semantic processing, recc, taking decisions, etc..  ….. 24
  • 25. AXMEDIS Content Processing GRID Workflow AXCP Front end Front end manager Visual Designer servers, servers, VOD, prod VOD, prod on demand on demand AXMEDIS Visual Elements Rule Editor and Rules AXCP Quick Scheduler Starter AXCP GRID Rules AXCP nodes Plug-in for content processing WS, FTP, Distribution AXMEDIS Channels etc. Your CMSs Database and servers 25
  • 26. Some Snapshots from the examples shown 26
  • 27. AXCP Visual Designer 27
  • 28. AXCP for empowering Media Portals Users AXMEDIS Rule Editor User and Device profile Distributor front end Server Few Ready to Add use rules info Activate Rule Content Databases Scheduler Personalized Content on AXCP GRID DemandContent: Search, Selection, Acquisition, Production, Adaptation, Transcoding, Formatting, Packaging, Protection, AXMEDISPublication and Licensing on Demand DRM APPLICATIONS: balancing, Other DRMUGC, repurposing, publication, YouTube, .. recommendations, integration P2P, ….with SN, redistribution, crawling 28
  • 29. Cross media Content Adptation 29
  • 30. Automated Formatting Engine 30
  • 31. Examples of Cross media Adapation 31
  • 32. OverviewO AXMEDIS aims and complexityO AXMEDIS model and toolsO AXMEDIS DRMO Automated back office toolsO Distribution Scenarious  Large range of possible applications: 3-play, 4-play, Multichannel, CH applications, mobile, etc.  Flexibility in refactoring/scaling up the back office  Processing in real time, managing multichannel back office  Huge costs of integration, business models, transaction Models…O Exploitation Activities 32
  • 33. Multichannel DistributionO VOD, Video or Content on Demand:  Internet P2P, PC, mobile, IPTV streaming: STB Motorola  Streaming of AXMEDIS MPEG-21, audio/video  Progressive download of AXMEDIS MPEG-21, audio/videoO Satellite data broadcast  Distribution in Push, STB/PVRO DVB-T  EPG + recording + intelligent content  HD protection in streamO PDA and Kiosks  Push on Kiosks, Download on PDAO Mobiles  Interoperable MPEG-21 and OMA DRM production  AXMEDIS/MPEG-21 player for mobiles  Download and progressive download on mobiles, javaO UGC, user generated or posted content  Automated production, transcoding, licensing, etc.  Multichannel support for social network  XMF, social network, ..O P2P as support for the above channels  B2B and/or B2C networks
  • 34. AXMEDIS P2P network architecture AXMEDIA P2P Metadata Query Support AXTracker AXMEDIS DRM AXEPTool P2P AXEPTool AXCP P2P Control Distributor AXEPTool Download Distributor AXCP P2P Control AXEPTool AXEPTool AXMEDIS P2P Network 34
  • 35. and VOD on PC with P2P Cross media Content, from video, audio to complex content Media Club Sale and CRM Accounting and service reporting Portal AXMEDIS issue license DRM Controlled P2P network 35
  • 36. Push Distribution and AXMEDIS Technology AXMEDIS Content Processing AXMEDIS DRM EUTELSAT Broadcast Server Sale Manager 36
  • 37. Content Production on the Consumer Side Cross media Cross media Content, Content, from from video, audio to complex content video, audio to complex content Added value content via ADSL Recording, added TV free value Content on air Package on site production and domain BBC Broadcasting management DVB-T Free on air transmission Accounting and reporting AXMEDIS DRM 37
  • 38. Examples Content from AX4HOME 38
  • 39. OverviewO AXMEDIS aims and complexityO AXMEDIS model and toolsO AXMEDIS DRMO Automated back office toolsO Distribution ScenariosO Exploitation Activities  DRM B2C solution for complex content  Intelligent proactive content with DRM  Cultural heritage content repurposing and distribution  Social networking  Smart mobile social enabled content, personal recommendations 39
  • 40. Content Enrichment with final users O http://www.variazioniproject.org O Content Enrichment  produced and reproduced on demand  production with DRM  AXMEDIS web player 40
  • 41. Access to Open Archive resources In collaboration with FRD, Italy 41
  • 42. AXMEDIS DRM withO AXMEDIS  Hiding complexityO AXMEDIS AXCP  protection packagerO AXMEDIS  Active X PlayerO AXMEDIS DRM  registration  License servers  AXCS 42
  • 43. Distribution of cultural content, AV guides O At MUSA: instrument museum at Accademia Nazionale di Santa Cecialia, Roma O Usable for AV guides, even with RFID O Production of content for continous formation, in medical area or for other interactive guides O Monitoring of the user activities AXCP Editors AXCP Quick Start, Your tools commands, Workflow systems,… AXCP GRID databases AXCP Scheduler WEB Server FTP, WS, etc. AXCP Node AX P2P Servers 43
  • 44. DC Store, DC ChannelO Distribution of large objects ISO of CD, DVD, etc. as protected intelligent contentO Distribution via P2P, protection via AXDRMO The intelligent content played into the AXMEDIS player helps the user to make registration, certification …O The Intelligent content extract the ISO on the disk AXCP Quick Start, AXMEDIS Your tools commands, Workflow systems,… DRM Servers AXCP GRID databases AXCP Scheduler WEB Server FTP, WS, etc. AXCP Node AX P2P Servers 44
  • 45. Mobile Medicine Social Network •PC….., i-Phone, Java,Back office Windows Media, ….automatico •MEDIA + flow, interactive, calculators, etc. Obj prof 45
  • 46. Multichannel social integration AXCP GRID Content: Search, Selection, Acquisition, Production, Adaptation, Transcoding, Formatting, Packaging, Protection, Publication and Licensing on Demand User generated content Personalized Content on Demand 46
  • 47. Recommendations: UU, OU, OO, ..
  • 48. Personal Mobile Social Intelligence AxObjectFinder HTML & CSS Based Presentation Engine AxPDAPlayer Media Player Download/updateM Search Engine Local Browser User Behavior File Explorer PDF player information Contextual Taxonomy collection Browser anager ….. player Content Indexer, semantic ingestion/processing Local PDA SQLite DB files 48
  • 49. O Thanks!O Tools can be download from web sites and on shareware sitesO http://www.axmedis.org  Tools, docs, etc.O http://mobmed.axmedis.org  Mobile Medicine Social networkO http://xmf.axmedis.org  ….O …. 49