The Future of Multimedia !
      Retrieval Research      !
   The Good, The Bad, !
      and The Ugly        !
         To...
A two decade old dream …!
         Search, and retrieve multimedia content
          as easily as for text!




COST 292 ...
The
     Good!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Good!
         Text (keyword) based multimedia search
          works to some extent!
              Searching based ...
The Good!
         Tremendous progress in the performance of
          multimedia content analysis during the past
      ...
The Good!
         Increasing efforts in standardization!
              MPEG-7 in MPEG!
              JPSearch in JPEG!...
JPSearch in a nutshell!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
OSI Layers!
     Structure!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch
  Architecture!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch
     Structure
     and Parts!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Workplan!
              Part   Title                                       WD      PDTR            DTR     TR

  ...
JPSearch Part 1!
         Part-1: Framework and system components: !
                  This is a technical report which ...
JPSearch Part 2!
         Part-2: Schema and ontology registration and
          identification: !
                  Thi...
JPSearch Part 3!
       Part-3: JPSearch query format: !
                This part provides three standardized functiona...
JPSearch Part 4!
         Part-4: Metadata embedded in image data (JPEG-1
          and JPEG-2000) file format: !
       ...
JPSearch Part 5!
         Part-5: Data interchange format between image
          repositories: !
                  This...
Further information!
         Last meeting: October 2008 in Busan,
          South Korea!
         Next meeting: January...
The Bad!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Bad!
        The semantic gap is still here and won’t close
         any soon!
        Virtually all big success sto...
Theserious ! and successful application based on
      No
          Bad
         MPEG-7 after eight years since its
     ...
The !
       Ugly!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Ugly!
         Privacy issues in multimedia search and
          retrieval!
         Content rights issues in multim...
Thank you for your attention!
     And looking forward to a fruitful discussion!




COST 292 Workshop!
November 28th, 200...
Upcoming SlideShare
Loading in …5
×

Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch

876 views

Published on

This is a one year old keynote I gave on my thoughts about challenges in multimedia search and a high level description of JPSearch standard. JPSearch has been progressing further since then, but responding to frequent and popular demands, I am sharing these with you!

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
876
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch

  1. 1. The Future of Multimedia ! Retrieval Research ! The Good, The Bad, ! and The Ugly ! Touradj Ebrahimi! Multimedia Signal Processing Group! EPFL! Touradj.Ebrahimi@epfl.ch! COST 292 Workshop! November 28th, 2008, Lyon, France!
  2. 2. A two decade old dream …!   Search, and retrieve multimedia content as easily as for text! COST 292 Workshop! November 28th, 2008, Lyon, France!
  3. 3. The Good! COST 292 Workshop! November 28th, 2008, Lyon, France!
  4. 4. The Good!   Text (keyword) based multimedia search works to some extent!   Searching based on text around images on the Web!   Social tagging! COST 292 Workshop! November 28th, 2008, Lyon, France!
  5. 5. The Good!   Tremendous progress in the performance of multimedia content analysis during the past decade!   TRECVID!   Huge financial incentives !   Video surveillance for security!   Business models around search and retrieval on the web! COST 292 Workshop! November 28th, 2008, Lyon, France!
  6. 6. The Good!   Increasing efforts in standardization!   MPEG-7 in MPEG!   JPSearch in JPEG!   CB-Search in MPEG! COST 292 Workshop! November 28th, 2008, Lyon, France!
  7. 7. JPSearch in a nutshell! COST 292 Workshop! November 28th, 2008, Lyon, France!
  8. 8. OSI Layers! Structure! COST 292 Workshop! November 28th, 2008, Lyon, France!
  9. 9. JPSearch Architecture! COST 292 Workshop! November 28th, 2008, Lyon, France!
  10. 10. JPSearch Structure and Parts! COST 292 Workshop! November 28th, 2008, Lyon, France!
  11. 11. JPSearch Workplan! Part Title WD PDTR DTR TR 1 System framework and components 05/07 06/07 07/04 07/07 Part Title WD CD FCD FDIS IS Schema and ontology registration and 2 08/07 09/01 09/07 09/10 10/04 identification 3 JPSearch Query Format -- 08/07 08/10 09/04 09/07 4 Metadata embedded in image data (JPEG and 08/03 08/07 09/04 09/10 10/04 JPEG 2000) file format 5 Data interchange format between image 08/03 09/01 09/07 09/10 10/04 repositories (following ISO procedures - WD: Working Draft; PDTR: Proposed Draft Technical Report; DTR: Draft Technical Report; TR: Technical Report; CD: Committee Draft; FCD: Final Committee Draft; FDIS: Final Draft International Standard; IS: International Standard)! COST 292 Workshop! November 28th, 2008, Lyon, France!
  12. 12. JPSearch Part 1!   Part-1: Framework and system components: !   This is a technical report which provides a global view of JPSearch. In particular, it describes a number of use cases to identify user needs and requirements. It then introduces the JPSearch architecture. Finally, the technical report outlines the organization of the JPSearch specification!   Status: ! " " "Technical Report issued in July 2007! COST 292 Workshop! November 28th, 2008, Lyon, France!
  13. 13. JPSearch Part 2!   Part-2: Schema and ontology registration and identification: !   This part standardizes a platform-independent format for the import, export and exchange of ontologies. It also defines a registry of ontologies which can be imported into a JPSearch compliant system.!   Status:! " " "Working Draft issued in July 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  14. 14. JPSearch Part 3!   Part-3: JPSearch query format: !   This part provides three standardized functionalities between users and image repositories: to allow users to express their search criteria, to describe the aggregated return result sets for user presentation or machine consumption, and to define query management processes such as relevance feedback. !   Status: ! " " "Final Committee Draft issue in October 2008! " " "Final Draft International Standard planned in April 2009 ! COST 292 Workshop! November 28th, 2008, Lyon, France!
  15. 15. JPSearch Part 4!   Part-4: Metadata embedded in image data (JPEG-1 and JPEG-2000) file format: !   This part specifies image data exchange format with associated metadata to accelerate the re-use of metadata. It supports two functionalities, namely the mobility of metadata and the persistent association of metadata with image.!   Status:! " " "Committee Draft issued in July 2008! " " "Final Committee Draft planned in April 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  16. 16. JPSearch Part 5!   Part-5: Data interchange format between image repositories: !   This part standardizes a format for the exchange of image collections and respective metadata between JPSearch compliant repositories. It enables the synchronization of repositories in order to facilitate simple and fully interoperable exchange across different devices and platforms. !   Status: ! " " "Working Draft issued in March 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  17. 17. Further information!   Last meeting: October 2008 in Busan, South Korea!   Next meeting: January 2009 in San Francisco, USA!   Website: http://www.jpeg.org! COST 292 Workshop! November 28th, 2008, Lyon, France!
  18. 18. The Bad! COST 292 Workshop! November 28th, 2008, Lyon, France!
  19. 19. The Bad!   The semantic gap is still here and won’t close any soon!   Virtually all big success stories in multimedia search and retrieval are based on text (keyword)!   Performance of low level multimedia content analysis is still often immature for prime time applications!   People tagging in google’s Picasa! COST 292 Workshop! November 28th, 2008, Lyon, France!
  20. 20. Theserious ! and successful application based on   No Bad MPEG-7 after eight years since its standardization!   Has MPEG-7 failed because it standardized too little, too deep, too early ?!   Will JPSearch approach be more successful?!   Major search and retrieval companies are uninterested in standardization of multimedia retrieval solutions!   To avoid competition?! COST 292 Workshop! November 28th, 2008, Lyon, France!
  21. 21. The ! Ugly! COST 292 Workshop! November 28th, 2008, Lyon, France!
  22. 22. The Ugly!   Privacy issues in multimedia search and retrieval!   Content rights issues in multimedia search and retrieval!   Will the major search companies redefine and steer the future of culture and information in society?!  No or too little research in technologies to counter these side effects ! COST 292 Workshop! November 28th, 2008, Lyon, France!
  23. 23. Thank you for your attention! And looking forward to a fruitful discussion! COST 292 Workshop! November 28th, 2008, Lyon, France!

×