The document discusses current and upcoming trends in search and AI. It notes that large datasets are less important than actionable intelligence. Assistive search using personalization, voice, images, conversations, context and providing answers and actions rather than just links is the new paradigm. The future of search and AI involves driving relevant interactions and experiences for customers through digital moments.

1. The Future of Search & AI
Trey Grainger
SVP of Engineering, Lucidworks
@treygrainger
#Activate18 #ActivateSearch

2. 612ATTENDEES
39COUNTRIES
70SESSIONS

4. So what are the current and
upcoming trends in Search & AI?

7. Big Data?

13. We need big answers.
Because we don’t need “big data.”

18. Solr leads the way
on Learning to Rank

20. And that mass adoption of LTR looks like this..

21. But what about all the other aspects
of Search beyond AI?

22. relevance, scale, bm25, user experience, learning to rank,
autoscaling, sys admin, server provisioning, lemmatization/stemming,
cloud, docker, aws, natural language processing, etl, entity extraction,
tf-idf, phrase detection, semantic search, query pipelines, connectors,
web crawling, signals, real-time recommendations, personalization,
question answering, request handlers, search components,
autocomplete, spell checking, synonyms, stop words, query-log
mining, probabilistic query parsing, boolean queries, geo-spatial
queries, image search, voice search, classification models, bi-
directional cross-datacenter replication, semantic knowledge graphs,
ontology management, merchandizing, entity type detection, query
classification, word embeddings, query parsers, highlighting, analyzers,
tokenization, streaming expressions, faceting, concept clustering,
more like this, insight engine, apache lucene/solr, lucidworks fusion,
some kind of crazy magic, that white box with the magnifying glass...
What Is Search?

23. There are a LOT of skillsets required to
deliver a world-class Search experience

24. Scaling search can be really hard

25. Ease of operations, scaling, and
performance are a top priority

26. We're drastically improving ease of operations

27. Time factors
•
And making the cluster aware of its own needs
Size factors Budget factors
• Scaling Policies
• Server Metrics
• Event Triggers
• Disk Space Free
• Prioritizing Traffic
• CPU Too High
• Traffic Increasing
• Need more Nodes
• Shards out of balance
• Back Pressure
• Traffic Increasing
• Server Lost

28. or.
How I indexed *.
... and lived to tell the tale ....
* simulated.
1.000.000.000.000
documents.

29. Final Thoughts

30. There is an ongoing shift away from "big data"
and toward actionable intelligence

31. Assistive Search is the new paradigm
•Requires personalization
•Voice
•Image Search
•Conversational
•Contextual (location, last search)
•Beyond links and information to
Answers and Action

32. ... and Search is now the de-facto user interface for
digital interaction with your customers

33. The future of business success hinges on the
outcomes of billions of digital moments
FIND
the correct
product
CONNECT
to the right
person KNOW
exactly what
to do next
DRIVE
relevant
conversations
RESOLVE
a problem

34. The Future of Search & AI
Starts Now.

35. Thank you!
@treygrainger
#Activate18 #ActivateSearch