Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Video Browser Showdown 2018

2,872 views

Published on

These slides were presented as an introduction to the 7th Video Browser Showdown (VBS 2018) on February 5th, 2018, at the MMM 2018 in Bangkok, Thailand.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Video Browser Showdown 2018

  1. 1. 1 Werner Bailer, Cathal Gurrin, Jakub Lokoč, Klaus Schoeffmann
  2. 2.  Video search competition (annually at MMM)  Demonstrates and evaluates state-of-the-art interactive video retrieval tools  Participating teams solve retrieval tasks  Systems are connected to the VBS Server  Presents tasks in live manner  Evaluates submitted results of teams (penalty for false submissions)
  3. 3.  HTW: Kai Uwe Barthel, Nico Hezel and Klaus Jung. “Fusing keyword search and visual exploration for untagged videos“  ITEC1: Manfred Jürgen Primus, Bernd Münzer, Andreas Leibetseder and Klaus Schoeffmann. “The ITEC Collaborative Video Search System at the VBS 2018“  ITEC2: Andreas Leibetseder, Sabrina Kletz and Klaus Schoeffmann. “Sketch-based Similarity Search for Collaborative Feature Maps“  NECTEC: Sitapa Rujikietgumjorn, Nattachai Watcharapinchai and Sanparith Marukatat. “Sloth Search System“  SIRET: Jakub Lokoc, Gregor Kovalcik andTomas Soucek. “Revisiting SIRETVideo RetrievalTool“ 3Video browser showdown 2018, Bangkok
  4. 4.  VERGE: Anastasia Moumtzidou, Stelios Andreadis, Foteini Markatopoulou, Damianos Galanopoulos, Ilias Gialampoukidis, StefanosVrochidis,Vasileios Mezaris, Ioannis Kompatsiaris and Ioannis Patras. “VERGE inVBS 2018“  VIREO: Phuong Anh Nguyen,Yi-Jie Lu, Hao Zhang, Chong-Wah Ngo. “Enhanced VIREO KIS atVBS 2018“  VITRIVR: Luca Rossetto, Ivan Giangreco, Ralph Gasser, Heiko Schuldt. “Competitive Video Retrieval with vitrivr“  VNU:Thanh-DatTruong,Vinh-Tiep Nguyen, Minh-Triet Tran,Van- Tien Do,Trang-VinhTrieu,Thanh Duc Ngo and Duy-Dinh Le. “Video Search Based On Semantic Extraction And Locally Regional Object Proposal“ 4Video browser showdown 2018, Bangkok
  5. 5.  IACC.3 -TRECVID (2016-2017)  144 GB  4593 video files  Low visual quality  600 hours of content  Each ~6-10 minutes  > 300.000 shots
  6. 6. Single target (20 secs)
  7. 7. “Steve’s cutting a drawing into his block of wood.You can see his hands, a cutter, and flower symbols.” Single target (20 secs)
  8. 8. “A person playing guitar outdoors” 8Video browser showdown 2018, Bangkok Multiple targets (shots)
  9. 9.  Expert Run  5 textual KIS tasks  5 visual KIS tasks  5 AVS tasks  Novice Run  5 visual KIS tasks  5 AVS tasks 9Video browser showdown 2018, Bangkok Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points  Overall score = AVERAGE
  10. 10. 10Video browser showdown 2018, Bangkok Textual KIS
  11. 11. 11Video browser showdown 2018, Bangkok AVS
  12. 12. 12Video browser showdown 2018, Bangkok
  13. 13.  VISUAL KIS  Video scene in the loop –VBS participant knows the known-item  Problem – photographic memory not realistic -> THE SCENE GETS BLURRED  TEXTUAL KIS  Difficult task - only 3 solved in 2017 -> more text appears in time  AVSTASKS  The same settings 13Video browser showdown 2018, Bangkok
  14. 14. previous new 14Video browser showdown 2018, Bangkok Time penalty Wrong submission penalty 𝑇𝑃 max(1, |𝑊𝑆| − 1) 𝑇𝑃 − 𝑊𝑆 ∗ 𝑐 Time limit for visual tasks 5 minutes and textual KIS 7 minutes No wrong submission for free
  15. 15.  Precision/recall based measure, time limit 5 minutes  Normalization  Novice RUNS  Each team can select and train a bit some novice user  Novice runs only for visual KIS andAVS (existingTRECVid ones) 15Video browser showdown 2018, Bangkok
  16. 16.  Let‘s thank the local organizers of MMM for making this session happen! 17Video browser showdown 2018, Bangkok

×