OMNIMEDIA “Intelligent Rich Media  Search Platform”
Searchable Media for E-Learning <ul><li>As multimedia are being used to facilitate and enhance teaching and creative learn...
Solution <ul><li>The solution is a community-based, video information-editing web platform, exposes and associates descrip...
Technology <ul><li>The technology is disruptive because a knowledge-sharing model for rich-media content management reduce...
OMNIMedia Innovation <ul><li>Artificial (Machine + Human) </li></ul><ul><li>Collective Intelligence Media search </li></ul...
Why better? Accuracy Hand inserted metadata Cost effectiveness Machine learning / Computer Vision OMNIMedia  Platform
Features highlights <ul><li>Searchable video stream </li></ul><ul><li>Non-linear video content access </li></ul><ul><li>Cr...
Example: MLB.com
  Object detection Cardeal.com Bookmark the  Info without Leaving the  video
Youtube Video NYC  Tiffany Bookmark the  Info without Leaving the  video
Object detection Great Sushi from Porter Sq, Cambridge Bookmark the  Info without Leaving the  video
Technology & Product
Image Recognition Input image Texture Based Classification Tree / Not-Tree Classification Feature Vector Decision Input Im...
Image Recognition Performance Biological Model
Auto-tagging for photographs <ul><li>Landscape </li></ul><ul><li>Group Shot </li></ul><ul><li>Couple </li></ul><ul><li>Por...
Tagging assist
Clustering – add contextual info http://eigencluster.csail.mit.edu/
Interdisciplinary framework  (hybrid solution) OMNIMedia Cluster Algorithm OMNIMedia platform Auto-generate Initial  Metad...
Online Content Delivery Stack MySpace Operating System Browser ??? MLB.com YouTube etc G o o g l e WWW Internet
Online Content Delivery Stack Semantic Web / Metadata layer Internet OS (Browser and OS converge) Search www Internet G o ...
Technology Diffusion Web 2.0 services -> applications on InternetOS Data-driven G o o g l e OMNIMedia
Value Chain
Upcoming SlideShare
Loading in...5
×

Elearning - Rich Media Search

457

Published on

As multimedia are being used to facilitate and enhance teaching and creative learning, making rich media including images and videos searchable are critical in today and future elearning platform and management system. Traditionally, it's a difficult challenge. Some of the team members have invented an interdisciplinary framework which integrates the state-of-the-art image recognition technology and brain science research from MIT, intelligent cluster algorithm and patentable digital “tagging” technology

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
457
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Searchable video stream Non-linear video content access Crawlable - Video content -&gt; text -&gt; publish to web and crawled by search engine such as Google (and use Search Optimization technique) Dynamic - insert Ad (use image detection to detect sponsor images (e.g. ketchup) and dynamically insert link inside the video) Linkable - insert link (from one region of a frame in a clip to another frame in another clip – hypermedia) Unobtrusive - insert Text Ads to the clip on the side instead of a short clip at the opening
  • Elearning - Rich Media Search

    1. 1. OMNIMEDIA “Intelligent Rich Media Search Platform”
    2. 2. Searchable Media for E-Learning <ul><li>As multimedia are being used to facilitate and enhance teaching and creative learning, making rich media including images and videos searchable are critical in today and future e-learning platform and management system. Traditionally, it's a difficult challenge. Some of the team members have invented an interdisciplinary framework which integrates the state-of-the-art image recognition technology and brain science research from MIT, intelligent cluster algorithm and patentable digital “tagging” technology. </li></ul>
    3. 3. Solution <ul><li>The solution is a community-based, video information-editing web platform, exposes and associates descriptive and searchable text with any digital video file. It is diverging from the traditional closed-environment manual-labor model and the fully artificial intelligent approach to metadata content generation. Instead, our solution is focusing on an automated solution to metadata generation through open, collaborative solutions. </li></ul>
    4. 4. Technology <ul><li>The technology is disruptive because a knowledge-sharing model for rich-media content management reduces maintenance costs and achieves higher production efficiency for metadata generation. The platform simultaneously captures users and learners activities and preferences on the content provider’s own website. It also facilitates incremental and collaborative learning through a open community. </li></ul>
    5. 5. OMNIMedia Innovation <ul><li>Artificial (Machine + Human) </li></ul><ul><li>Collective Intelligence Media search </li></ul><ul><li>Why? </li></ul><ul><li>Search strategy: User-centered approach, </li></ul><ul><ul><li>High accuracy </li></ul></ul><ul><ul><li>More relevance (to user) </li></ul></ul><ul><ul><li>User added business value </li></ul></ul><ul><ul><li>Google gets it! (PageRank algorithm leverages user contribution) </li></ul></ul><ul><li>Web Strategy: Ubiquitous </li></ul>
    6. 6. Why better? Accuracy Hand inserted metadata Cost effectiveness Machine learning / Computer Vision OMNIMedia Platform
    7. 7. Features highlights <ul><li>Searchable video stream </li></ul><ul><li>Non-linear video content access </li></ul><ul><li>Crawlable by Search engine e.g. Google </li></ul><ul><li>Dynamic in video advertisement (use image detection to detect sponsor images) </li></ul><ul><li>Linkable - insert link (from one region of a frame in a clip to another frame in another clip) </li></ul><ul><li>Unobtrusive - Text or bubble Ads to the clip </li></ul>
    8. 8. Example: MLB.com
    9. 9. Object detection Cardeal.com Bookmark the Info without Leaving the video
    10. 10. Youtube Video NYC Tiffany Bookmark the Info without Leaving the video
    11. 11. Object detection Great Sushi from Porter Sq, Cambridge Bookmark the Info without Leaving the video
    12. 12. Technology & Product
    13. 13. Image Recognition Input image Texture Based Classification Tree / Not-Tree Classification Feature Vector Decision Input Image Shape Based Classification car car ped Biological Model Feature Extraction Car / Not-Car Classification Feature Vector Decision
    14. 14. Image Recognition Performance Biological Model
    15. 15. Auto-tagging for photographs <ul><li>Landscape </li></ul><ul><li>Group Shot </li></ul><ul><li>Couple </li></ul><ul><li>Portrait </li></ul>
    16. 16. Tagging assist
    17. 17. Clustering – add contextual info http://eigencluster.csail.mit.edu/
    18. 18. Interdisciplinary framework (hybrid solution) OMNIMedia Cluster Algorithm OMNIMedia platform Auto-generate Initial Metadata Add contextual Info to further enhance metadata User enriched Media content Metadata – fine Tune the image Recognition engine Computer Vision (Image recognition)
    19. 19. Online Content Delivery Stack MySpace Operating System Browser ??? MLB.com YouTube etc G o o g l e WWW Internet
    20. 20. Online Content Delivery Stack Semantic Web / Metadata layer Internet OS (Browser and OS converge) Search www Internet G o o g l e OMNIMedia MySpace MLB.com YouTube etc ?
    21. 21. Technology Diffusion Web 2.0 services -> applications on InternetOS Data-driven G o o g l e OMNIMedia
    22. 22. Value Chain

    ×