![Who am I? ,[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-2-2048.jpg?cb=1669869721)
![Who are Sourcesense? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-3-2048.jpg?cb=1669869721)
![Committers and Contributors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-4-2048.jpg?cb=1669869721)
![Who is the customer? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-5-2048.jpg?cb=1669869721)
![Their story? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-6-2048.jpg?cb=1669869721)
![The Solution: Apache Solr ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-8-2048.jpg?cb=1669869721)
![How Solr Works ,[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-9-2048.jpg?cb=1669869721)
![How Solr Works ,[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-10-2048.jpg?cb=1669869721)
![How Solr Works ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-11-2048.jpg?cb=1669869721)
![How Solr Works ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-12-2048.jpg?cb=1669869721)
![How Solr Distributes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-20-2048.jpg?cb=1669869721)
![Solr at The Customer ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-26-2048.jpg?cb=1669869721)
![Solr: a Java web application ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-28-2048.jpg?cb=1669869721)
![#2: Garbage collection ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-35-2048.jpg?cb=1669869721)
![#3: Profiling ,[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-36-2048.jpg?cb=1669869721)
![Managing So Many Hosts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-37-2048.jpg?cb=1669869721)
![Content Archiving ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-43-2048.jpg?cb=1669869721)
![Being Dynamic ,[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-44-2048.jpg?cb=1669869721)
![Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-50-2048.jpg?cb=1669869721)
![thank you [email_address]](https://image.slidesharecdn.com/onlineinformation2010facetedsearch-101214064338-phpapp01/75/faceted-search-the-120-million-documents-story-51-2048.jpg?cb=1669869721)
Faceted Search – the 120 Million Documents Story
•5 likes•2,279 views
Report
Share
Upayavira's presentation at Online Information 2010 in London: the case study of an Enterprise-critical migration from custom Lucene indexes to Apache Solr, with a significant focus on scalability. The solution needed to providing search against rapidly changing data-sets and multi-million document indexes, enabling complex queries with sub second responses and maintaining high availability.
Recommended
More Related Content
Viewers also liked
Viewers also liked(20)
Similar to Faceted Search – the 120 Million Documents Story
Similar to Faceted Search – the 120 Million Documents Story(20)
More from Sourcesense
More from Sourcesense(9)
Recently uploaded
Recently uploaded(20)
Faceted Search – the 120 Million Documents Story
- 1. Faceted Search – the 120 Million Documents Story
- 13. How Solr Works Index
- 14. How Solr Works Index Index Snapshot Active Index Reader Searches
- 15. How Solr Works Index Index Snapshot Active Index Reader Searches New Content Active Index Writer
- 16. How Solr Works Index Index Snapshot Active Index Reader Searches New Content Active Index Writer commit
- 17. How Solr Works Index Index Snapshot Index Snapshot Index Reader Active Index Reader Searches New Content Active Index Writer
- 18. How Solr Works Index Index Snapshot Index Snapshot Index Reader Active Index Reader Searches New Content Active Index Writer
- 19. How Solr Works Index Index Snapshot Index Reader Searches New Content Active Index Writer
- 21. Solr Host Configuration shard 1 shard 2 shard 3 searches
- 22. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator
- 23. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer
- 24. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator
- 25. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator
- 29. How Solr Works Index Index Snapshot Searches New Content Active Index Writer Active Index Reader
- 30. How Solr Works Index Index Snapshot Searches New Content Active Index Writer cache Active Index Reader
- 31. How Solr Works Index Index Snapshot Index Snapshot Index Reader Searches New Content cache Active Index Reader cache commit Active Index Writer
- 32. How Solr Works Index Index Snapshot Index Snapshot Index Reader Searches New Content Active Index Writer cache Active Index Reader cache
- 33. How Solr Works Index Index Snapshot Index Reader Searches New Content Active Index Writer cache
- 34. Optimisation #1: autowarm < listener event = "newSearcher" class = "solr.QuerySenderListener" > < arr name = "queries" > < lst > < str name = "q" > solr </ str > < str name = "relf" > 4 </ str > < str name = "facet.field" > sourceCountryCS </ str > < str name = "facet.field" > entityCSPerson </ str > < str name = "facet.field" > entityCSCompany </ str > < str name = "facet.field" > entityCSProduct </ str > < str name = "facet.field" > sourceCS </ str > < str name = "facet.field" > authorCS </ str > < str name = "facet.field" > stockTickerCS </ str > < str name = "facet.field" > feedClassCS </ str > < str name = "facet.field" > entityCSOrganization </ str > < str name = "facet.field" > platformCS </ str > < str name = "facet.field" > eventOrFactCS </ str > < str name = "facet.field" > sourceRank </ str > < str name = "facet" > true </ str > < str name = "facet.date" > harvestDate </ str > < str name = "facet.date.start" > NOW-1MONTH </ str > < str name = "facet.date.end" > NOW </ str > < str name = "facet.date.gap" > +24HOURS </ str > < str name = "qt" > /duplicate </ str > < str name = "duplicateOrder" > latest </ str > < str name = "collapseFields" > duplicateGroup titleForDuplicates </ str > </ lst > </ arr > </ listener >
- 38. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer
- 39. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator
- 40. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator 35Gb 35Gb 35Gb
- 41. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator
- 42. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator Entire row: 40 minutes
- 45. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator
- 46. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator shard 1 shard 2 shard 3 co-ordinator
- 47. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator shard 1 shard 2 shard 3 co-ordinator archive ingestion
- 48. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator shard 1 shard 2 shard 3 co-ordinator
- 49. Solr Host Configuration shard 1 shard 2 shard 3 co-ordinator load balancer shard 1 shard 2 shard 3 co-ordinator