SlideShare a Scribd company logo
The Future of Multimedia !
      Retrieval Research      !
   The Good, The Bad, !
      and The Ugly        !
         Touradj Ebrahimi!
Multimedia Signal Processing Group!
               EPFL!
     Touradj.Ebrahimi@epfl.ch!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
A two decade old dream …!
         Search, and retrieve multimedia content
          as easily as for text!




COST 292 Workshop!
November 28th, 2008, Lyon, France!
The
     Good!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Good!
         Text (keyword) based multimedia search
          works to some extent!
              Searching based on text around
               images on the Web!
              Social tagging!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Good!
         Tremendous progress in the performance of
          multimedia content analysis during the past
          decade!
              TRECVID!
         Huge financial incentives !
              Video surveillance for security!
              Business models around search and retrieval on
               the web!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Good!
         Increasing efforts in standardization!
              MPEG-7 in MPEG!
              JPSearch in JPEG!
              CB-Search in MPEG!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch in a nutshell!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
OSI Layers!
     Structure!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch
  Architecture!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch
     Structure
     and Parts!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Workplan!
              Part   Title                                       WD      PDTR            DTR     TR

              1      System framework and components             05/07   06/07           07/04   07/07

              Part   Title                                       WD      CD      FCD     FDIS    IS

                     Schema and ontology registration and
              2                                                  08/07   09/01   09/07   09/10   10/04
                     identification

              3      JPSearch Query Format                       --      08/07   08/10   09/04   09/07

              4      Metadata embedded in image data (JPEG and   08/03   08/07   09/04   09/10   10/04
                     JPEG 2000) file format
              5      Data interchange format between image       08/03   09/01   09/07   09/10   10/04
                     repositories

 (following ISO procedures - WD: Working Draft; PDTR: Proposed Draft Technical Report; DTR: Draft
Technical Report; TR: Technical Report; CD: Committee Draft; FCD: Final Committee Draft; FDIS: Final
                     Draft International Standard; IS: International Standard)!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Part 1!
         Part-1: Framework and system components: !
                  This is a technical report which provides a global view of
                   JPSearch. In particular, it describes a number of use cases to
                   identify user needs and requirements. It then introduces the
                   JPSearch architecture. Finally, the technical report outlines
                   the organization of the JPSearch specification!
                  Status: !
               "         "       "Technical Report issued in July 2007!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Part 2!
         Part-2: Schema and ontology registration and
          identification: !
                  This part standardizes a platform-independent format for the
                   import, export and exchange of ontologies. It also defines a
                   registry of ontologies which can be imported into a JPSearch
                   compliant system.!
                  Status:!
               "         "       "Working Draft issued in July 2008!
               "         "       "Committee Draft planned in January 2009!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Part 3!
       Part-3: JPSearch query format: !
                This part provides three standardized functionalities between users
                 and image repositories: to allow users to express their search criteria,
                 to describe the aggregated return result sets for user presentation or
                 machine consumption, and to define query management processes
                 such as relevance feedback. !
                Status: !
             "         "        "Final Committee Draft issue in October 2008!
             "         "        "Final Draft International Standard planned in
                 April 2009 !


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Part 4!
         Part-4: Metadata embedded in image data (JPEG-1
          and JPEG-2000) file format: !
                  This part specifies image data exchange format with
                   associated metadata to accelerate the re-use of metadata. It
                   supports two functionalities, namely the mobility of
                   metadata and the persistent association of metadata with
                   image.!
                  Status:!
               "         "        "Committee Draft issued in July 2008!
               "         "        "Final Committee Draft planned in April 2009!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
JPSearch Part 5!
         Part-5: Data interchange format between image
          repositories: !
                  This part standardizes a format for the exchange of image
                   collections and respective metadata between JPSearch
                   compliant repositories. It enables the synchronization of
                   repositories in order to facilitate simple and fully
                   interoperable exchange across different devices and platforms. !
                  Status: !
               "         "        "Working Draft issued in March 2008!
               "         "        "Committee Draft planned in January 2009!


COST 292 Workshop!
November 28th, 2008, Lyon, France!
Further information!
         Last meeting: October 2008 in Busan,
          South Korea!
         Next meeting: January 2009 in San
          Francisco, USA!
         Website: http://www.jpeg.org!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Bad!



COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Bad!
        The semantic gap is still here and won’t close
         any soon!
        Virtually all big success stories in multimedia
         search and retrieval are based on text (keyword)!
        Performance of low level multimedia content
         analysis is still often immature for prime time
         applications!
             People tagging in google’s Picasa!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
Theserious ! and successful application based on
      No
          Bad
         MPEG-7 after eight years since its
         standardization!
             Has MPEG-7 failed because it standardized too little, too
              deep, too early ?!
             Will JPSearch approach be more successful?!

        Major search and retrieval companies are
         uninterested in standardization of multimedia
         retrieval solutions!
             To avoid competition?!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
The !
       Ugly!

COST 292 Workshop!
November 28th, 2008, Lyon, France!
The Ugly!
         Privacy issues in multimedia search and
          retrieval!
         Content rights issues in multimedia search and
          retrieval!
         Will the major search companies redefine and
          steer the future of culture and information in
          society?!
      No or too little research in technologies to counter
       these side effects !
COST 292 Workshop!
November 28th, 2008, Lyon, France!
Thank you for your attention!
     And looking forward to a fruitful discussion!




COST 292 Workshop!
November 28th, 2008, Lyon, France!

More Related Content

Similar to Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch

Standardization Activities: ISO/IEC JTC1 SC36
Standardization Activities: ISO/IEC JTC1 SC36Standardization Activities: ISO/IEC JTC1 SC36
Standardization Activities: ISO/IEC JTC1 SC36
openforum
 
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
IPTC
 
PERICLES Information Embedding Techniques
PERICLES Information Embedding TechniquesPERICLES Information Embedding Techniques
PERICLES Information Embedding Techniques
PERICLES_FP7
 
Mpeg 7 slides
Mpeg 7 slides Mpeg 7 slides
Mpeg 7 slides
rahul kundu
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!
EDINA, University of Edinburgh
 
Mpeg 7
Mpeg 7Mpeg 7
Mpeg 7
Aditi Sharma
 
Vidivideo and IM3I
Vidivideo and IM3IVidivideo and IM3I
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
SCAPE Project
 
Extract the Audio from Video by using python
Extract the Audio from Video by using pythonExtract the Audio from Video by using python
Extract the Audio from Video by using python
IRJET Journal
 
Video Compression Techniques
Video Compression TechniquesVideo Compression Techniques
Video Compression Techniques
cnssources
 
An explanation of video compression techniques.
An explanation of video compression techniques.An explanation of video compression techniques.
An explanation of video compression techniques.
Axis Communications
 
A Study on FFmpeg Multimedia Framework
A Study on FFmpeg Multimedia FrameworkA Study on FFmpeg Multimedia Framework
A Study on FFmpeg Multimedia Framework
ijtsrd
 
U-Boot community analysis
U-Boot community analysisU-Boot community analysis
U-Boot community analysis
xulioc
 
Digital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the PondDigital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the Pond
ULB - Bibliothèques
 
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the PondDigital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Benoit Pauwels
 
2009.06.09 chris poppe - public PhD defense
2009.06.09   chris poppe - public PhD defense2009.06.09   chris poppe - public PhD defense
2009.06.09 chris poppe - public PhD defense
Chris Poppe
 
KITE Network Instrumentation: Advanced WebRTC Testing
KITE Network Instrumentation: Advanced WebRTC TestingKITE Network Instrumentation: Advanced WebRTC Testing
KITE Network Instrumentation: Advanced WebRTC Testing
Alexandre Gouaillard
 
Automatic Subtitle Generation For Sound In Videos
Automatic Subtitle Generation For Sound In VideosAutomatic Subtitle Generation For Sound In Videos
Automatic Subtitle Generation For Sound In Videos
Asia Smith
 
Mpeg7
Mpeg7Mpeg7
Automatic Subtitle Generation for Sound in Videos
Automatic Subtitle Generation for Sound in VideosAutomatic Subtitle Generation for Sound in Videos
Automatic Subtitle Generation for Sound in Videos
IRJET Journal
 

Similar to Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch (20)

Standardization Activities: ISO/IEC JTC1 SC36
Standardization Activities: ISO/IEC JTC1 SC36Standardization Activities: ISO/IEC JTC1 SC36
Standardization Activities: ISO/IEC JTC1 SC36
 
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
IPTC NewsCodes - Controlled Vocabularies for the News Media (EBU MDN Workshop...
 
PERICLES Information Embedding Techniques
PERICLES Information Embedding TechniquesPERICLES Information Embedding Techniques
PERICLES Information Embedding Techniques
 
Mpeg 7 slides
Mpeg 7 slides Mpeg 7 slides
Mpeg 7 slides
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!
 
Mpeg 7
Mpeg 7Mpeg 7
Mpeg 7
 
Vidivideo and IM3I
Vidivideo and IM3IVidivideo and IM3I
Vidivideo and IM3I
 
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
Scape information day at BL - Using Jpylyzer and Schematron for validating JP...
 
Extract the Audio from Video by using python
Extract the Audio from Video by using pythonExtract the Audio from Video by using python
Extract the Audio from Video by using python
 
Video Compression Techniques
Video Compression TechniquesVideo Compression Techniques
Video Compression Techniques
 
An explanation of video compression techniques.
An explanation of video compression techniques.An explanation of video compression techniques.
An explanation of video compression techniques.
 
A Study on FFmpeg Multimedia Framework
A Study on FFmpeg Multimedia FrameworkA Study on FFmpeg Multimedia Framework
A Study on FFmpeg Multimedia Framework
 
U-Boot community analysis
U-Boot community analysisU-Boot community analysis
U-Boot community analysis
 
Digital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the PondDigital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the Pond
 
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the PondDigital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the Pond
 
2009.06.09 chris poppe - public PhD defense
2009.06.09   chris poppe - public PhD defense2009.06.09   chris poppe - public PhD defense
2009.06.09 chris poppe - public PhD defense
 
KITE Network Instrumentation: Advanced WebRTC Testing
KITE Network Instrumentation: Advanced WebRTC TestingKITE Network Instrumentation: Advanced WebRTC Testing
KITE Network Instrumentation: Advanced WebRTC Testing
 
Automatic Subtitle Generation For Sound In Videos
Automatic Subtitle Generation For Sound In VideosAutomatic Subtitle Generation For Sound In Videos
Automatic Subtitle Generation For Sound In Videos
 
Mpeg7
Mpeg7Mpeg7
Mpeg7
 
Automatic Subtitle Generation for Sound in Videos
Automatic Subtitle Generation for Sound in VideosAutomatic Subtitle Generation for Sound in Videos
Automatic Subtitle Generation for Sound in Videos
 

More from Touradj Ebrahimi

An overview of fake media and its evolution
An overview of fake media and its evolutionAn overview of fake media and its evolution
An overview of fake media and its evolution
Touradj Ebrahimi
 
An overview of recent and ongoing JPEG standardisation activities
An overview of recent and ongoing JPEG standardisation activitiesAn overview of recent and ongoing JPEG standardisation activities
An overview of recent and ongoing JPEG standardisation activities
Touradj Ebrahimi
 
The next generation JPEG standards
The next generation JPEG standardsThe next generation JPEG standards
The next generation JPEG standards
Touradj Ebrahimi
 
ICIP2016 Panel on "Is compression dead or are we wrong again?"
ICIP2016 Panel on "Is compression dead or are we wrong again?"ICIP2016 Panel on "Is compression dead or are we wrong again?"
ICIP2016 Panel on "Is compression dead or are we wrong again?"
Touradj Ebrahimi
 
ICIP2016 image compression grand challenge
ICIP2016 image compression grand challengeICIP2016 image compression grand challenge
ICIP2016 image compression grand challenge
Touradj Ebrahimi
 
Realization of Enhanced Reality Mobile Communication
Realization of Enhanced Reality  Mobile CommunicationRealization of Enhanced Reality  Mobile Communication
Realization of Enhanced Reality Mobile Communication
Touradj Ebrahimi
 
JPEG PLENO - Towards a New Standard for Plenoptic Image Compression
JPEG PLENO - Towards a New Standard for Plenoptic Image CompressionJPEG PLENO - Towards a New Standard for Plenoptic Image Compression
JPEG PLENO - Towards a New Standard for Plenoptic Image Compression
Touradj Ebrahimi
 
JPEG emerging standards
JPEG emerging standardsJPEG emerging standards
JPEG emerging standards
Touradj Ebrahimi
 
Globally Networked Cameras - The Good, the Bad and The Ugly
Globally Networked Cameras - The Good, the Bad and The UglyGlobally Networked Cameras - The Good, the Bad and The Ugly
Globally Networked Cameras - The Good, the Bad and The Ugly
Touradj Ebrahimi
 
Reversible visual privacy protection
Reversible visual privacy protectionReversible visual privacy protection
Reversible visual privacy protection
Touradj Ebrahimi
 
Overview of JPEG standardization committee activities
Overview of JPEG standardization committee activitiesOverview of JPEG standardization committee activities
Overview of JPEG standardization committee activities
Touradj Ebrahimi
 
A manifesto on the future of image coding - JPEG Pleno
A manifesto on the future of image coding - JPEG PlenoA manifesto on the future of image coding - JPEG Pleno
A manifesto on the future of image coding - JPEG Pleno
Touradj Ebrahimi
 
Beyond Quality of Experience
Beyond Quality of ExperienceBeyond Quality of Experience
Beyond Quality of Experience
Touradj Ebrahimi
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Touradj Ebrahimi
 
Quality of Experience in emerging visual communications
Quality of Experience in emerging visual communicationsQuality of Experience in emerging visual communications
Quality of Experience in emerging visual communications
Touradj Ebrahimi
 
Privacy protection of visual information
Privacy protection of visual informationPrivacy protection of visual information
Privacy protection of visual information
Touradj Ebrahimi
 
Subjective quality evaluation of the upcoming HEVC video compression standard
Subjective quality evaluation of the upcoming HEVC video compression standard Subjective quality evaluation of the upcoming HEVC video compression standard
Subjective quality evaluation of the upcoming HEVC video compression standard
Touradj Ebrahimi
 
Security and Trust in social media networks
Security and Trust in social media networksSecurity and Trust in social media networks
Security and Trust in social media networks
Touradj Ebrahimi
 
Towards 3D visual quality assessment for future multimedia
Towards 3D visual quality assessment for future  multimediaTowards 3D visual quality assessment for future  multimedia
Towards 3D visual quality assessment for future multimedia
Touradj Ebrahimi
 
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
Touradj Ebrahimi
 

More from Touradj Ebrahimi (20)

An overview of fake media and its evolution
An overview of fake media and its evolutionAn overview of fake media and its evolution
An overview of fake media and its evolution
 
An overview of recent and ongoing JPEG standardisation activities
An overview of recent and ongoing JPEG standardisation activitiesAn overview of recent and ongoing JPEG standardisation activities
An overview of recent and ongoing JPEG standardisation activities
 
The next generation JPEG standards
The next generation JPEG standardsThe next generation JPEG standards
The next generation JPEG standards
 
ICIP2016 Panel on "Is compression dead or are we wrong again?"
ICIP2016 Panel on "Is compression dead or are we wrong again?"ICIP2016 Panel on "Is compression dead or are we wrong again?"
ICIP2016 Panel on "Is compression dead or are we wrong again?"
 
ICIP2016 image compression grand challenge
ICIP2016 image compression grand challengeICIP2016 image compression grand challenge
ICIP2016 image compression grand challenge
 
Realization of Enhanced Reality Mobile Communication
Realization of Enhanced Reality  Mobile CommunicationRealization of Enhanced Reality  Mobile Communication
Realization of Enhanced Reality Mobile Communication
 
JPEG PLENO - Towards a New Standard for Plenoptic Image Compression
JPEG PLENO - Towards a New Standard for Plenoptic Image CompressionJPEG PLENO - Towards a New Standard for Plenoptic Image Compression
JPEG PLENO - Towards a New Standard for Plenoptic Image Compression
 
JPEG emerging standards
JPEG emerging standardsJPEG emerging standards
JPEG emerging standards
 
Globally Networked Cameras - The Good, the Bad and The Ugly
Globally Networked Cameras - The Good, the Bad and The UglyGlobally Networked Cameras - The Good, the Bad and The Ugly
Globally Networked Cameras - The Good, the Bad and The Ugly
 
Reversible visual privacy protection
Reversible visual privacy protectionReversible visual privacy protection
Reversible visual privacy protection
 
Overview of JPEG standardization committee activities
Overview of JPEG standardization committee activitiesOverview of JPEG standardization committee activities
Overview of JPEG standardization committee activities
 
A manifesto on the future of image coding - JPEG Pleno
A manifesto on the future of image coding - JPEG PlenoA manifesto on the future of image coding - JPEG Pleno
A manifesto on the future of image coding - JPEG Pleno
 
Beyond Quality of Experience
Beyond Quality of ExperienceBeyond Quality of Experience
Beyond Quality of Experience
 
Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...Comparison of compression efficiency between HEVC and VP9 based on subjective...
Comparison of compression efficiency between HEVC and VP9 based on subjective...
 
Quality of Experience in emerging visual communications
Quality of Experience in emerging visual communicationsQuality of Experience in emerging visual communications
Quality of Experience in emerging visual communications
 
Privacy protection of visual information
Privacy protection of visual informationPrivacy protection of visual information
Privacy protection of visual information
 
Subjective quality evaluation of the upcoming HEVC video compression standard
Subjective quality evaluation of the upcoming HEVC video compression standard Subjective quality evaluation of the upcoming HEVC video compression standard
Subjective quality evaluation of the upcoming HEVC video compression standard
 
Security and Trust in social media networks
Security and Trust in social media networksSecurity and Trust in social media networks
Security and Trust in social media networks
 
Towards 3D visual quality assessment for future multimedia
Towards 3D visual quality assessment for future  multimediaTowards 3D visual quality assessment for future  multimedia
Towards 3D visual quality assessment for future multimedia
 
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
Rate distortion performance of VP8 (WebP and WebM) when compared to standard ...
 

Recently uploaded

20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
Federico Razzoli
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 

Recently uploaded (20)

20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 

Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch

  • 1. The Future of Multimedia ! Retrieval Research ! The Good, The Bad, ! and The Ugly ! Touradj Ebrahimi! Multimedia Signal Processing Group! EPFL! Touradj.Ebrahimi@epfl.ch! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 2. A two decade old dream …!   Search, and retrieve multimedia content as easily as for text! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 3. The Good! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 4. The Good!   Text (keyword) based multimedia search works to some extent!   Searching based on text around images on the Web!   Social tagging! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 5. The Good!   Tremendous progress in the performance of multimedia content analysis during the past decade!   TRECVID!   Huge financial incentives !   Video surveillance for security!   Business models around search and retrieval on the web! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 6. The Good!   Increasing efforts in standardization!   MPEG-7 in MPEG!   JPSearch in JPEG!   CB-Search in MPEG! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 7. JPSearch in a nutshell! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 8. OSI Layers! Structure! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 9. JPSearch Architecture! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 10. JPSearch Structure and Parts! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 11. JPSearch Workplan! Part Title WD PDTR DTR TR 1 System framework and components 05/07 06/07 07/04 07/07 Part Title WD CD FCD FDIS IS Schema and ontology registration and 2 08/07 09/01 09/07 09/10 10/04 identification 3 JPSearch Query Format -- 08/07 08/10 09/04 09/07 4 Metadata embedded in image data (JPEG and 08/03 08/07 09/04 09/10 10/04 JPEG 2000) file format 5 Data interchange format between image 08/03 09/01 09/07 09/10 10/04 repositories (following ISO procedures - WD: Working Draft; PDTR: Proposed Draft Technical Report; DTR: Draft Technical Report; TR: Technical Report; CD: Committee Draft; FCD: Final Committee Draft; FDIS: Final Draft International Standard; IS: International Standard)! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 12. JPSearch Part 1!   Part-1: Framework and system components: !   This is a technical report which provides a global view of JPSearch. In particular, it describes a number of use cases to identify user needs and requirements. It then introduces the JPSearch architecture. Finally, the technical report outlines the organization of the JPSearch specification!   Status: ! " " "Technical Report issued in July 2007! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 13. JPSearch Part 2!   Part-2: Schema and ontology registration and identification: !   This part standardizes a platform-independent format for the import, export and exchange of ontologies. It also defines a registry of ontologies which can be imported into a JPSearch compliant system.!   Status:! " " "Working Draft issued in July 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 14. JPSearch Part 3!   Part-3: JPSearch query format: !   This part provides three standardized functionalities between users and image repositories: to allow users to express their search criteria, to describe the aggregated return result sets for user presentation or machine consumption, and to define query management processes such as relevance feedback. !   Status: ! " " "Final Committee Draft issue in October 2008! " " "Final Draft International Standard planned in April 2009 ! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 15. JPSearch Part 4!   Part-4: Metadata embedded in image data (JPEG-1 and JPEG-2000) file format: !   This part specifies image data exchange format with associated metadata to accelerate the re-use of metadata. It supports two functionalities, namely the mobility of metadata and the persistent association of metadata with image.!   Status:! " " "Committee Draft issued in July 2008! " " "Final Committee Draft planned in April 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 16. JPSearch Part 5!   Part-5: Data interchange format between image repositories: !   This part standardizes a format for the exchange of image collections and respective metadata between JPSearch compliant repositories. It enables the synchronization of repositories in order to facilitate simple and fully interoperable exchange across different devices and platforms. !   Status: ! " " "Working Draft issued in March 2008! " " "Committee Draft planned in January 2009! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 17. Further information!   Last meeting: October 2008 in Busan, South Korea!   Next meeting: January 2009 in San Francisco, USA!   Website: http://www.jpeg.org! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 18. The Bad! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 19. The Bad!   The semantic gap is still here and won’t close any soon!   Virtually all big success stories in multimedia search and retrieval are based on text (keyword)!   Performance of low level multimedia content analysis is still often immature for prime time applications!   People tagging in google’s Picasa! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 20. Theserious ! and successful application based on   No Bad MPEG-7 after eight years since its standardization!   Has MPEG-7 failed because it standardized too little, too deep, too early ?!   Will JPSearch approach be more successful?!   Major search and retrieval companies are uninterested in standardization of multimedia retrieval solutions!   To avoid competition?! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 21. The ! Ugly! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 22. The Ugly!   Privacy issues in multimedia search and retrieval!   Content rights issues in multimedia search and retrieval!   Will the major search companies redefine and steer the future of culture and information in society?!  No or too little research in technologies to counter these side effects ! COST 292 Workshop! November 28th, 2008, Lyon, France!
  • 23. Thank you for your attention! And looking forward to a fruitful discussion! COST 292 Workshop! November 28th, 2008, Lyon, France!