Large Scale Processing for Multimedia Analysis - Introduction
Upcoming SlideShare
Loading in...5
×
 

Large Scale Processing for Multimedia Analysis - Introduction

on

  • 691 views

Slides for the Introductory lecture of the master seminar 'Large Scape Processing for Multimedia Analysis', Fall semester 2011/12, Hasso-Plattner-Institute, University of Potsdam, 18.10.2011

Slides for the Introductory lecture of the master seminar 'Large Scape Processing for Multimedia Analysis', Fall semester 2011/12, Hasso-Plattner-Institute, University of Potsdam, 18.10.2011

Statistics

Views

Total Views
691
Views on SlideShare
689
Embed Views
2

Actions

Likes
0
Downloads
15
Comments
0

1 Embed 2

http://paper.li 2

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Large Scale Processing for Multimedia Analysis - Introduction Large Scale Processing for Multimedia Analysis - Introduction Presentation Transcript

    • 24 24 24 24 24 24 24 4 24 24 2 Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 Dr. Harald Sack, Dr. Peter Tröger Jörg Waitelonis, Christian Hentschel, Bernhard Quehl, Haojin Yang, Magnus Knuth Hasso-Plattner-Institut for IT-Systems Engineering University of PotsdamDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 24 2424 24 24 24 (1) Dozenten (2) Organisatorisches (3) Worum geht es überhaupt (4) nächste SchritteLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Semantic Technologies & Multimedia Retrieval ■ Research Topics □ Semantic Web Technologies □ Ontological Engineering □ Information Retrieval □ Multimedia Analysis & Retrieval □ Social Networking □ Data/Information Visualization ■ Research ProjectsLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Dr. Harald Sack ■ Senior Researcher am Hasso Plattner Institut □ Leiter der Forschungsgruppe ,Semantische Technologien & Multimedia Retrieval‘ □ Research ProjectsLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Dr. Peter Tröger ■ Seit Februar 2010 Senior Researcher am HPI im Bereich „Verlässliche Many-Core Systeme“ ■ Forschungsschwerpunkte: □ Verlässliche Systeme, Fehlervorhersage □ Skalierbare Programmierung paralleler Systeme ■ Intel Single Chip Cloud Computer (SCC) ■ CiteMaster.net MC3 MC1 L2$1 IA-32 256KB Core1 Router MPB 16B MC2 MC0 16KB L2$0 IA-32 256KB Core0 VRC System Interface Router Tile 2 core clusters in 6x4 2-D meshLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 24 2424 24 24 24 (1) Dozenten (2) Organisatorisches (3) Worum geht es überhaupt (4) nächste SchritteLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 Administratives: □ Semesterwochenstunden: 4 □ ECTS: 6 □ Leistungsfeststellung: □ Schriftliche Ausarbeitung zum Vortragsthema (Umfang ca. 20 Seiten) □ Umsetzung einer vorgegebenen Implementierungsaufgabe im Team □ Präsentation der Ergebnisse (Zwischenpräsentation, Endpräsentation, Wochenbesprechungen) □ Projektteams mit je 2-3 Studenten bearbeiten eine AufgabenstellungLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 Termine: □ Wöchentliches Seminargruppentreffen □Termin nach Vereinbarung □ Zwischenpräsentation der Projektergebnisse □ Abschlusspräsentation der Ergebnisse □Termin in der letzten SemesterwocheLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 Blog zum Seminar: □ http://lsp4mat2011.blogspot.com/Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 24 2424 24 24 24 (1) Dozenten (2) Organisatorisches (3) Worum geht es überhaupt (4) nächste SchritteLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Google Multimedia SearchLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How does Google find Multimedia?Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How does Google find Multimedia?Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How does Google find Multimedia? ... <a href="/mission_pages/shuttle/shuttlemissions/sts134/ multimedia/index.html"> <IMG WIDTH="100" ALT="Close-up view of Endeavours crew cabin prior to docking with the International Space Station" TITLE="Close-up view of Endeavours crew cabin prior to docking with the International Space Station" SRC="/images/ content/549665main_2011-05-18_1600_100-75.jpg" HEIGHT="75" ALIGN="Bottom" BORDER="0" /> </a> <p><a href="/mission_pages/shuttle/shuttlemissions/sts134/ multimedia/index.html">&rsaquo;&nbsp;STS-134 Multimedia</a></ p> ... ‣Google Multimedia Search relies on link contextLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How do you find something in an audiovisual archive?Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How to Search in Multimedia Archives? Step 1: Digitalization of analog data Step 2: Annotation with (textbased) metadataLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How to Search in Multimedia Archives? • manual anotation with text-based descriptive metadataLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • How to Search in Multimedia Archives? • manual anotation with text-based descriptive metadata ...how to extract metadata in an automated way?Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia AnalysisLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia AnalysisLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia AnalysisLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Face DetectionLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Genre Analysis Classification: Studio Indoor News Show Face DetectionLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Genre Analysis Classification: Studio Indoor overlay News Show Face text DetectionLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Genre Analysis Classification: Studio Indoor overlay News Show Face text Detection scene textLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Genre Analysis Classification: Studio Indoor overlay News Show Face Logo text Detection Detection scene textLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis Genre Analysis Classification: Studio Indoor overlay News Show Face Logo text Detection Detection scene text Audio-Mining structural Automated speaker analysis Speech identification RecognitionLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis • Visual Analysis • Audio Analysis • Structural Analysis • Structural Analysis • Intelligent Character • Speaker Detection Recognition (ICR) • Automated Speech • Character/Logo Recognition (ASR) Detection • Character Filtering • Character Recognition • Genre Analysis & Categorization • Face / Body / Object •Detection •Tracking •ClusteringLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Structural Analysis • Decomposition of time-based media into meaningful media fragments of coherent content that can be used as basic element for indexing and classification videoLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Structural Analysis • Decomposition of time-based media into meaningful media fragments of coherent content that can be used as basic element for indexing and classification video scenesLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Structural Analysis • Decomposition of time-based media into meaningful media fragments of coherent content that can be used as basic element for indexing and classification video scenes shotsLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Structural Analysis • Decomposition of time-based media into meaningful media fragments of coherent content that can be used as basic element for indexing and classification video scenes shots subshotsLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Structural Analysis • Decomposition of time-based media into meaningful media fragments of coherent content that can be used as basic element for indexing and classification video scenes shots subshots frames key framesLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Intelligent Character Recognition • Preprocessing • Character Identification • Text Preprocessing • Text Filtering • Adaption of script geometry (Deskew) • Image quality enhancement • Optical Character Recognition (OCR) • Standard OCR software (OCRopus) • Postprocessing • Lexical analysis • Statistical / context based filtering Ermittlungen nach BombenfundenLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Automated Multimedia Analysis • Result: Video segments with time-based metadata annotations timeMetadata Extraction • Metadata consist of combined low level / high level feature descriptors • Metadata serve as a basis for traditional and semantic retrievalLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Semantic Multimedia Analysis Video Analysis / time Metadata Extraction Entity Recognition/ Mapping e.g., person xy location yz event abc e.g., bibliographical data, geographical data, encyclopedic data, ..Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Anwendungsbeispiele:Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • http://www.yovisto.com/Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • yovisto 2.029 http://mediaglobe.yovisto.com:8080Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • http://bit.ly/SeMEXLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 24 2424 24 24 24 (1) Dozenten (2) Organisatorisches (3) Worum geht es überhaupt (4) nächste SchritteLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 nächste Woche: □Kickstart - Einführung in die zugrundeliegende Technologie □Finden/Organisation der studentischen Arbeitsgruppen □Ausgabe/Zuweisung der Arbeitsthemen □Aufbereitung/Ausgabe der notwendigen Materialien in 14 Tagen: □Treffen mit den einzelnen Arbeitsgruppen nach Vereinbarung □Einarbeitung, etc...Large Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11
    • Large Scale Processing for Multimedia Analysis Master Seminar, WIntersemester 2011/2012 24 2424 24 24 24 (1) Dozenten (2) Organisatorisches (3) Worum geht es überhaupt or (4) nächste Schritte ou f Th an k y tio n! At ten yo urLarge Scale Processing for Multimedia Analysis, Master Seminar, WS 2011/2012, Harald Sack, Peter TrögerDienstag, 18. Oktober 11