Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch
•
1 like•299 views
This is a one year old keynote I gave on my thoughts about challenges in multimedia search and a high level description of JPSearch standard. JPSearch has been progressing further since then, but responding to frequent and popular demands, I am sharing these with you!
Recommended
Recommended
More Related Content
Similar to Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch
Similar to Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch (20)
More from Touradj Ebrahimi
More from Touradj Ebrahimi (20)
Recently uploaded
Recently uploaded (20)
Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch
- 1. The Future of Multimedia ! Retrieval Research ! The Good, The Bad, ! and The Ugly ! Touradj Ebrahimi! Multimedia Signal Processing Group! EPFL! Touradj.Ebrahimi@epfl.ch! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 2. A two decade old dream …! Search, and retrieve multimedia content as easily as for text! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 3. The Good! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 4. The Good! Text (keyword) based multimedia search works to some extent! Searching based on text around images on the Web! Social tagging! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 5. The Good! Tremendous progress in the performance of multimedia content analysis during the past decade! TRECVID! Huge financial incentives ! Video surveillance for security! Business models around search and retrieval on the web! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 6. The Good! Increasing efforts in standardization! MPEG-7 in MPEG! JPSearch in JPEG! CB-Search in MPEG! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 7. JPSearch in a nutshell! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 8. OSI Layers! Structure! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 9. JPSearch Architecture! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 10. JPSearch Structure and Parts! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 11. JPSearch Workplan! Part Title WD PDTR DTR TR 1 System framework and components 05/07 06/07 07/04 07/07 Part Title WD CD FCD FDIS IS Schema and ontology registration and 2 08/07 09/01 09/07 09/10 10/04 identification 3 JPSearch Query Format -- 08/07 08/10 09/04 09/07 4 Metadata embedded in image data (JPEG and 08/03 08/07 09/04 09/10 10/04 JPEG 2000) file format 5 Data interchange format between image 08/03 09/01 09/07 09/10 10/04 repositories (following ISO procedures - WD: Working Draft; PDTR: Proposed Draft Technical Report; DTR: Draft Technical Report; TR: Technical Report; CD: Committee Draft; FCD: Final Committee Draft; FDIS: Final Draft International Standard; IS: International Standard)! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 12. JPSearch Part 1! Part-1: Framework and system components: ! This is a technical report which provides a global view of JPSearch. In particular, it describes a number of use cases to identify user needs and requirements. It then introduces the JPSearch architecture. Finally, the technical report outlines the organization of the JPSearch specification! Status: ! " " "Technical Report issued in July 2007! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 13. JPSearch Part 2! Part-2: Schema and ontology registration and identification: ! This part standardizes a platform-independent format for the import, export and exchange of ontologies. It also defines a registry of ontologies which can be imported into a JPSearch compliant system.! Status:! " " "Working Draft issued in July 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 14. JPSearch Part 3! Part-3: JPSearch query format: ! This part provides three standardized functionalities between users and image repositories: to allow users to express their search criteria, to describe the aggregated return result sets for user presentation or machine consumption, and to define query management processes such as relevance feedback. ! Status: ! " " "Final Committee Draft issue in October 2008! " " "Final Draft International Standard planned in April 2009 ! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 15. JPSearch Part 4! Part-4: Metadata embedded in image data (JPEG-1 and JPEG-2000) file format: ! This part specifies image data exchange format with associated metadata to accelerate the re-use of metadata. It supports two functionalities, namely the mobility of metadata and the persistent association of metadata with image.! Status:! " " "Committee Draft issued in July 2008! " " "Final Committee Draft planned in April 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 16. JPSearch Part 5! Part-5: Data interchange format between image repositories: ! This part standardizes a format for the exchange of image collections and respective metadata between JPSearch compliant repositories. It enables the synchronization of repositories in order to facilitate simple and fully interoperable exchange across different devices and platforms. ! Status: ! " " "Working Draft issued in March 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 17. Further information! Last meeting: October 2008 in Busan, South Korea! Next meeting: January 2009 in San Francisco, USA! Website: http://www.jpeg.org! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 18. The Bad! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 19. The Bad! The semantic gap is still here and won’t close any soon! Virtually all big success stories in multimedia search and retrieval are based on text (keyword)! Performance of low level multimedia content analysis is still often immature for prime time applications! People tagging in google’s Picasa! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 20. Theserious ! and successful application based on No Bad MPEG-7 after eight years since its standardization! Has MPEG-7 failed because it standardized too little, too deep, too early ?! Will JPSearch approach be more successful?! Major search and retrieval companies are uninterested in standardization of multimedia retrieval solutions! To avoid competition?! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 21. The ! Ugly! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 22. The Ugly! Privacy issues in multimedia search and retrieval! Content rights issues in multimedia search and retrieval! Will the major search companies redefine and steer the future of culture and information in society?! No or too little research in technologies to counter these side effects ! COST 292 Workshop! November 28th, 2008, Lyon, France!
- 23. Thank you for your attention! And looking forward to a fruitful discussion! COST 292 Workshop! November 28th, 2008, Lyon, France!