Indexing Videos in Solr for Search and Recommendations
•
1 like•561 views
This document summarizes Gary Sieling's presentation on indexing historic videos in Solr. The presentation covered crawling videos from various sources, extracting metadata using tools like Cheerio.js, and solving challenges like handling propaganda, detecting years, aligning captions, and providing related content suggestions. The goal is to build a searchable platform for historical videos similar to Street View for exploring events from the past.
Recommended
Recommended
More Related Content
More from Lucidworks
More from Lucidworks (20)
Recently uploaded
Recently uploaded (20)
Indexing Videos in Solr for Search and Recommendations
- 1. Indexing Videos in Solr Gary Sieling (@garysieling) Lead Software Engineer Wingspan, a QuintilesIMS Company
- 2. FindLectures.com Case Study on Indexing Historic Videos @findlectures
- 3. Demo
- 4. Agenda • Demo • Crawling • Search Use Cases • Machine Learning
- 5. 5 01 Lunch and Learn Discover Quality Material: • Conference Talks • Interviews • Lectures • Speeches
- 7. 7 01 Goal: Street View for History
- 8. 8 01 History of Recording Formats • 1857: Earliest Audio Recordings • 1877: Gramophone • 1912: First Presidential Speech • 1895-1936: Silent Films • 1962: Cassette Tapes • 1976: VHS Tapes • 2005: Youtube
- 10. 10 01 Crawling - Developer Tools
- 12. 12 01 Years talk_year_i = ($) => $('.sidebar-block-header') .text() .match('bddddb')[0] }
- 13. 13 01 Cheerio.js Command line jQuery const attrs = { description_s: () => $('.copy p').text(), title_s: () => $('#title').text(), ... } const $ = require('cheerio').load(str);
- 14. 14 01 Data Sources gresham.ac.uk ["gresham.ac.uk/.../queen-elizabeth-ii", ...] [{ title: "Queen Elizabeth II", collection: "Gresham College", speaker: "...", description: "...", audio_url: "..." }, ...] youtube.com/user/GreshamCollege [{ title: "Queen Elizabeth II", video_url: "...", auto_transcript: "...", length: ...}] [[{ categories: ["History, ...]}]] [[{ clipping: 2% }]] [[{ status: 200 OK }]]
- 15. 15 01 Problem: Default User Experience • Discover New Topics • Lunch Time Video • High-Quality
- 16. 16 01 Solution: Default Ranking • List of good publishers • De-rank "bad" talks (too technical or heavy topics) • Daily randomization (compare to Reddit) • Embeddable video
- 17. 17 01 Solution: Quality Score • Is Keynote • Keynote Level Speaker • NSFW • Language • # Recommendations • Channel Balance • Audio Noise • # Ums • Age
- 18. 18 01 Outcome: Ranking for User Experience
- 19. 19 01 Problem: Search by Time Period Example: Talks from 1985 • 1985 • 1980s • 80s • 1900s • 20th century • Reagan Era
- 20. 20 01 Problem: Search By Category IBM Watson Taxonomy (1,000+ tags)
- 21. 21 01 Creating New Categories Entity Recognition - Medical Terms
- 22. 22 01 Problem: Propaganda In Primary Source Documents • "Communist China" • "Soviet Russia" • "Nazi Germany"
- 23. 23 01 Problem: Propaganda In Primary Source Documents • "Axis of Evil" • "America First"
- 24. 24 01 Example: "Axis of Evil"
- 25. 25 01 Problem: Propaganda Caption Storage 00:13:20 world states like these and their 00:13:23 terrorist allies constitute an axis of evil 00:13:27 arming to threaten the Peace of the world
- 26. 26 01 Problem: Missing Captions Smith-Waterman Alignment 00:40:32 push again and I'll say to them read my 00:40:37 lips - - - - push again, and I'll say to them, "Read my - lips: no new taxes." 00:40:32 push again, and I'll say to them, "Read my 00:40:37 lips: no new taxes."
- 27. 27 01 Problem: Propaganda Caption Analyzer Configuration <analyzer type="index"> <analyzer class="org.apache.lucene.analysis.PatternCaptureGroupFilterFactory" pattern="^dd:dd:dd(.*)$" preserve_original="true" /> ... </analyzer>
- 28. 28 01 Outcome for "America First"
- 30. 30 01 Outcome: Search within video
- 32. 32 01 Problem: Suggestions By the next search?
- 35. 35 01 Solution: Word2Vec + DBPedia Entries
- 36. 36 01 Example: Gloria Steinem - Person + Ideology ~= • Marxist Feminism • Radical Feminism • Feminist Movement • Feminist Theory
- 37. 37 01 Solution: Word2Vec + DBPedia Entries
- 38. 38 01 DBPedia: Filter Entities with SPARQL select ?property ?value where { <http://dbpedia.org/resource/Vietnam_War> <http://www.w3.org/2000/01/rdf-schema#label> ?value . <http://dbpedia.org/resource/Vietnam_War> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dbpedia.org/ontology/Person> FILTER( LANG(?value) = "" || LANGMATCHES(LANG(?value), "en")) }
- 39. 39 01 Outcome: Speakers + "Martin Luther King, Jr." • Martin Luther King III • Martin Luther • Ralph Abernathy • James Bevel • Malcolm X • Fred Shuttlesworth • Stokely Carmichael
- 40. 40 01 Outcome: Topics + "Vietnam War" • South Vietnam • North Vietnam • Military history of Australia during the Vietnam War • Laotian Civil War • Republic of Vietnam • First Indochina War • Cold War
- 41. 41 01 Storing Recommendations Solr Core: Suggestions Term: Ron Chernow Suggestions: "['Joseph Ellis', 'Gordon S. Wood', 'Kevin Phillips', 'David Brion Davis', 'David Levering Lewis', 'Paul Collier', 'James B. Stewart', 'Ron Rosenbaum', 'Jean Edward Smith', 'Gordon A. Craig']"
- 42. 42 01 Outcome: People Mentioned In The Same Article
- 43. 43 01 Resources • "Relevant Search" • Cheerio.js • Deeplearning4j • Gensim • Semantic UI • SearchKit (for ElasticSearch)
- 44. 44 01 FindLectures.com Weekly Emails with Lunch and Learn Suggestions http://findlectures.com/emails @findlectures