The document discusses the importance of search analytics for improving search quality. It provides examples of search analytics reports that can help identify issues like zero hit queries, low click-through rates, and high latency. The document emphasizes that analytics allows organizations to measure, monitor and fix search failures and optimize the user experience.
Chris Hart of Lindex was the speaker for MnSearch's 1st Quarter 2014 Marquee Event. He had a great presentation describing some of the SEO Tools of the Trade. Here is his presentation.
Content Auditing: Unearthing the Substance of Your BrandRachel Lovinger
I gave this talk at Content Marketing World 2014. It talks about a content strategy practice - content auditing - and how it can benefit content marketing efforts. It includes links to some useful tools and resources.
It is very important to understand SEO before you embark on Paid advertising and PayPerClick (PPC) campaigns. The presentation helps you if:
- You struggle with the understanding SEO?
- You wonder how SEO affects your business and your site?
Lucas Parker, Sr Software Development Engineer of Research & Development at Visible Technologies, presents his perspective on data mining and engineering.
Who wouldn't want to overtake their competitors in the search engines? You'll learn 4 specific tips and you'll have the opportunity to ask any SEO questions you may have as well.
Search is not just the place your users go to when they are lost or have something specific to find. It is also a place where your users go to to have a conversation about their needs. Avinash Kaushik remind us that search is the only place that gets used more than 10% of the time. So, how are we designing this conversation? In this presenation for the IXDA Singapore community, I share a framework to design the search experience.
Sviluppare applicazioni voice-first con AWS e Amazon AlexaAmazon Web Services
Come possiamo sviluppare applicazioni che siano allo stesso tempo scalabili, manutenibili, cost-effective, intelligenti e voice-first? La suite di servizi AWS basati su Machine Learning e Deep Learning offre ad ogni sviluppatore la possibilità di integrare funzionalità avanzate di riconoscimento vocale, comprensione del linguaggio naturale, rendering audio e traduzione automatica.
In questo webinar, Alex ed Arianna discuteranno le tecniche e le best practice per implementare interfacce vocali tramite i servizi AWS. Arianna, technical evangelist per Amazon Alexa, introdurrà Alexa e mostrerà come sviluppare esperienze vocali per quest’ultima.
Introduction to Growth Hacking:
- Principles
- Examples (from US and from #FrenchTech)
- Theory
- AARRR / Metrics
- Tools
- Must read stuff
And plenty other things!
Conversion Models: A Systematic Method of Building Learning to Rank Training ...Lucidworks
When using user signals to improve relevance, what should you use? Clicks are more frequent, but really only correspond to a search result looking attractive. A conversion is a powerful signal of true relevance but occurs less frequently. Can we combine shallow "this looks interesting" click events along with strong, but rare conversion signals in a robust fashion to generate learning to rank training data? In this talk, we introduce click models, an industry-proven way of measuring search result attractiveness from clicks, and propose a systematic way of incorporating conversion data into click models. Whether your industry is conversion heavy (like e-commerce), or lacking in any clear conversion signal (like publishing) you'll take away from this talk a system for turning any search analytics into robust judgments and training data. Because, after all, there is no AI-based Search without good training data!
Doug Turnbull, OpenSource Connections
Slides from a recent workshop @Found.ation:
"How to create a successful e-shop"
“Track your competitors and adjust your strategy”
George Giannakeas
Marketing and Product Director e-FOOD.gr
george@e-food.gr
@gioris
Chris Hart of Lindex was the speaker for MnSearch's 1st Quarter 2014 Marquee Event. He had a great presentation describing some of the SEO Tools of the Trade. Here is his presentation.
Content Auditing: Unearthing the Substance of Your BrandRachel Lovinger
I gave this talk at Content Marketing World 2014. It talks about a content strategy practice - content auditing - and how it can benefit content marketing efforts. It includes links to some useful tools and resources.
It is very important to understand SEO before you embark on Paid advertising and PayPerClick (PPC) campaigns. The presentation helps you if:
- You struggle with the understanding SEO?
- You wonder how SEO affects your business and your site?
Lucas Parker, Sr Software Development Engineer of Research & Development at Visible Technologies, presents his perspective on data mining and engineering.
Who wouldn't want to overtake their competitors in the search engines? You'll learn 4 specific tips and you'll have the opportunity to ask any SEO questions you may have as well.
Search is not just the place your users go to when they are lost or have something specific to find. It is also a place where your users go to to have a conversation about their needs. Avinash Kaushik remind us that search is the only place that gets used more than 10% of the time. So, how are we designing this conversation? In this presenation for the IXDA Singapore community, I share a framework to design the search experience.
Sviluppare applicazioni voice-first con AWS e Amazon AlexaAmazon Web Services
Come possiamo sviluppare applicazioni che siano allo stesso tempo scalabili, manutenibili, cost-effective, intelligenti e voice-first? La suite di servizi AWS basati su Machine Learning e Deep Learning offre ad ogni sviluppatore la possibilità di integrare funzionalità avanzate di riconoscimento vocale, comprensione del linguaggio naturale, rendering audio e traduzione automatica.
In questo webinar, Alex ed Arianna discuteranno le tecniche e le best practice per implementare interfacce vocali tramite i servizi AWS. Arianna, technical evangelist per Amazon Alexa, introdurrà Alexa e mostrerà come sviluppare esperienze vocali per quest’ultima.
Introduction to Growth Hacking:
- Principles
- Examples (from US and from #FrenchTech)
- Theory
- AARRR / Metrics
- Tools
- Must read stuff
And plenty other things!
Conversion Models: A Systematic Method of Building Learning to Rank Training ...Lucidworks
When using user signals to improve relevance, what should you use? Clicks are more frequent, but really only correspond to a search result looking attractive. A conversion is a powerful signal of true relevance but occurs less frequently. Can we combine shallow "this looks interesting" click events along with strong, but rare conversion signals in a robust fashion to generate learning to rank training data? In this talk, we introduce click models, an industry-proven way of measuring search result attractiveness from clicks, and propose a systematic way of incorporating conversion data into click models. Whether your industry is conversion heavy (like e-commerce), or lacking in any clear conversion signal (like publishing) you'll take away from this talk a system for turning any search analytics into robust judgments and training data. Because, after all, there is no AI-based Search without good training data!
Doug Turnbull, OpenSource Connections
Slides from a recent workshop @Found.ation:
"How to create a successful e-shop"
“Track your competitors and adjust your strategy”
George Giannakeas
Marketing and Product Director e-FOOD.gr
george@e-food.gr
@gioris
1. Site
Search
Analy.cs
Search
Quality
Ma/ers
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
1!
2. About
me
Stefan
Thies
stefan.thies@sematext.com
Twi:er:
@se.321
DevOps
Evangelist
@sematext
Copyright 2014 Sematext Group Inc. - All rights reserved.!
! 2!
3. About
Sematext
!
3!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
Performance monitoring, !
anomaly detection and alerting!
Log management!
Site Search Analytics!
Consulting & Support !
for Solr and Elasticsearch!
4. Implemen.ng
Big
Data
&
Search
Systems
!
4!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
Know-‐How
Tools
5. Agenda
l What
is
Search
Analy.cs
and
why
it
ma:ers
l Example
reports
and
their
value
!
5!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
6. Why
!
6!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
search
users
search
providers
search
experience
!
This search sucks!!
It takes 17 tries to find anything here!!
F!?@#$%^&?!?!
!
!
Cool, the latest search tweaks !
made our site really sticky!!
Awesome!!
!
7. Fill
in
the
Missing
Piece
!
7!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
Performance
Monitoring
Quality Assurance
Tuning UI!
8. Blind
Leading
the
Blind
!
8!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
9. Analy.cs
as
Compass
Search
logs
are
your
Map
Search
Analy2cs
is
your
Compass
!
9!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
10. The
Bo:om
Line
Why
l Measure
and
monitor
everything.
l Supports
(re)design,
naviga.on
choices
l Helps
with
content
acquisi.on
&
enhancement
l Improve
search
experience
!
10!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
11. The
Moment
of
Truth
• Ques.on
for
the
audience
#1
What
do
you
use
for
Search
Analy.cs?
a)
Home
grown
stuff
b)
Google
Analy.cs
c)
Other
d)
Nothing
!
11!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
12. Search
Analy.cs
Basics
l Collect:
queries
&
clicks
&
interac.ons
&
...
l Analyze:
ac.ons
/
conversions
l Output:
reports
–
over
.me
l Output++:
feedback
loop
l The
means,
not
the
goal
l Ongoing,
not
one-‐off
!
12!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
remember
this
13. Search
vs.
Web
Analy.cs
l User
intent
and
informa.on
needs
vs.
inferring
l Hand
in
hand
l Ideally
you
can
relate
data
from
both
or
even
unify
it
!
13!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
14. Report
Types
l Failures
vs.
non-‐failures
l Ac.onable
vs.
non-‐ac.onable
!
14!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
15. Failures
vs.
Non-‐Failures
l Zero
hits
l Low
CTR
l Low
MRR
l High
bounce
rate
l Low
conversion
rate
l Deep
paging
l Deep
clicking
l High
latency
!
15!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
l Query rate
l Query volume
l Top seen & clicked
docs
l Top queries
l Terms per query
l Search sessions
l Search users
l Distinct queries
16. Value
of
Failure
Fixes
l Zero
hits
l Low
CTR
l Low
MRR
l High
bounce
rate
l Low
conversion
rate
l Deep
paging
l Deep
clicking
l High
latency
Performance Tuning!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
Re-search
Findability
Relevance Tuning
17. Measure,
then
Fix
If
you
can't
measure,
it
you
can't
fix
it!
!
17!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
18. Metrics
–
e.g.
Mean
Reciprocal
Rank
18!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
Wikipedia - MRR!
19. Relevance
A/B
Tes.ng
!
19!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
20. Tracking
Zero
Hits
20!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
21. Report:
Zero
Hit
Queries
• Overall
pct.
(not
raw
count)
vs.
Popular
queries
• Misspellings?
• Synonyms?
• No
matching
content?
• Need
different
tagging?
• Bad
analysis/mapping?
• Mul.lingual
issues?
!
21!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
22. Tracking
Zero
Hits
22!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
23. Frequency
of
Zero
Hit
23!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
24. Minimize:
#
of
Zero
Hit
Queries
• Use
Query
Spellchecker
(DYM)
• Use
Autocomplete
• Using
DYM
ReSearcher,
Query
Relaxer,
Related
Search
• Check
Mapping,
Analyzers,
Queries
• Indexing
process
– Lost
items
while
bulk
indexing?
• Design
a
‚No
Result‘
page
!
24!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
28. more
search
metrics
...
28!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
!
29. Search
Analy.cs
&
Measuring
!
29!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
If you can't measure it, you can't fix it!
You can't measure it if you don't have Analytics
30. Ac.onable
vs.
Non-‐Ac.onable
l Zero
hits
l Low
CTR
l Low
MRR
l High
bounce
rate
l Low
conversion
rate
l Deep
paging
l Deep
clicking
l High
latency
!
30!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
l Query rate
l Query volume
l Top seen & clicked docs
l Top queries
l Terms per query
l Search sessions
l Search users
l Distinct queries
31. More
Fixin'
l Query
rate
l Query
volume
l Search
sessions
l Search
users
l Top
seen
&
clicked
docs
l Top
queries
l Terms
per
query
l Dis.nct
queries
!
31!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
Navigation & Design
Results Shuffling
Diversification,
Recommendations
AutoComplete!
Search box size!
32. Output++:
Data
is
Power
l AutoComplete
-‐
$MM
improvement
l Be:er
DYM
Spellchecker
l Related
Searches
l Recommenda.ons
l Relevance
Feedback
l ...
!
32!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
33. Closing
the
Loop
!
33!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
search
users
search
providers
search
experience
34. Resources
!
34!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
http://rosenfeldmedia.com/
books/searchanalytics/
Search Analytics for Your Site
Louis Rosenfeld
l http://blog.sematext.com/tag/analytics/
l http://www.slideshare.net/lucenerevolution/gospodnetic-otis-ppt-
search-analytics-what-why-how
35. Key
Take-‐aways
l Without
Analy5cs
you
are
blind
l If
you
can't
measure
it,
you
can't
fix
it
l Use
Search
Analy5cs
to
understand,
measure
and
improve
search
l Using
Search
Analy5cs
means
having
a
compe55ve
advantage
!
35!
Copyright 2014 Sematext Group Inc. - All rights reserved. !
36. Dig
Search?
Dig
Analy.cs?
Dig
Big
Data?
Dig
Performance?
Dig
Logging?
Dig
working
with
open
–
source?
• We‘re
hiring
planet
-‐
wide!
h/p://www.sematext.com/about/jobs.html
We are hiring ...!
Copyright 2014 Sematext Group Inc. - All rights reserved.!
! 36!