Analytics in Search Many companies including Lucidworks have embraced the Kibana open source code to add visualization and analytics to enhance search management. Ravi Krishnamurthy , VP of Professional Services at Lucidworks, will show Silk, Lucid's implementation of Kibana, which provides all the capabilities of the open source code but adds enterprise-critical capabilities like authentication and security to protect restricted content.

2. Scalable Search and Analytics
Ravi Krishnamurthy, VP Technical
Services, ravi@lucidworks.com
Yann Yu, Systems Engineer,
yann.yu@lucidworks.com

3. • Motivation: Why Search AND Analytics?
• Apache Solr and Lucidworks SILK
• Solution Architectures
• Demo(s)
• Q & A
• Resources
Agenda

4. Why Search AND Analytics?
AnalysisData Insight Action Value

5. Search is more than just a box.

6. personal.
contextual.
actionable.
Search makes data

7. Search is
everywhere.
ecommerce
log analysis
site search
compliance
enterprise apps

8. Secure access to all your data through one interface, empowering
everyone in your organization to access the data they need.
Search is the key to unlocking big data.
vSearch anything.

9. query
Traditional enterprise search
was all about the query.

10. Search can be smarter.
location search history query permissions context
Personal, contextual, relevant results: consumer-
like simplicity and power in the enterprise.

11. Solr in a nutshell
8M+ total
downloads
Solr is both established & growing
250,000+
monthly downloads
Largest community of developers.
2500+open Solr jobs.
Solr most widely used search
solution on the planet.
Lucidworks
Unmatched Solr expertise.
1/3
of the active
committers
70%
of the open source
code is committed
Lucene/Solr Revolution
world’s largest open source user
conference dedicated to Lucene/Solr.
Solr has tens of thousands
of applications in production.
You use
Solr everyday.

12. • Search-first NoSQL store
• Distributed, Horizontally Scalable
• Stable and Robust
• Deep Paging
• Accurate Facets and Stats
• Stats on Pivots (5.0)
• Easier to start-up; run as a service on Linux (5.0)
• Your Content, Your Way (5.0)
Solr and Analytics

13. • Solr - Logstash - Kibana
• http://lucidworks.com/product/
integrations/silk/
• Open source at:
• https://github.com/LucidWorks/
banana
• https://github.com/LucidWorks/
solrlogmanager
SiLK

14. data enrichment
your business
your app
your data
machine learning
recommendations landing pages
relevancytuning
security
connectorframework
signal processing
api
reportingadmin
Lucidworks Fusion
Everything your team needs to rapidly design
and deploy next-generation search apps to
your entire organization.

15. Enterprise Search
Lucidworks connectors
processes documents and
sends to SolrCloud
Standard document storage and search

16. Log record search
Machine generated log records
are sent to Flume.
Flume forwards raw log record
to Hadoop for archiving.
Flume simultaneously parses out
data in record into a Solr document,
forwarding resulting document to Solr
Lucidworks SiLK exposes real-time
statistics and analytics to end-users,
as well as full-text search
High volume indexing of many small records

17. Co-existence with other NoSQL solutions

18. eCommerce: Search is Recommendation
Catalog
Signals
Pipeline
Your
App
Fusion

19. http://github.com/lucidworks/solr-for-datascience

20. • Solr: http://lucene.apache.org/solr
• Company: http://www.lucidworks.com
• Our blog: http://www.lucidworks.com/blog
• Blog on stats and facets: http://lucidworks.com/blog/you-got-stats-in-my-
facets/
• Fusion: http://www.lucidworks.com/products/fusion
• Solr for Data Science code: http://github.com/lucidworks/solr-for-datascience
• Email: ravi@lucidworks.com; yann.yu@lucidworks.com
Resources