Apache Solr for Newbies

1. Apache Solr
for Newbies
Olivier Dobberkau
dkd Internet Service GmbH
Certifuncation 2018

2. Agenda 1/2
● What is Apache Solr?
● How TYPO3 got its Solr Extension?
● What is in the Box?
● Beyond Search
2

3. Agenda 2/2
● Demo
○ Install and Index
○ Search Box
○ Results List
○ Facets
● Q & A
3

4. Solr is the popular, blazing-fast,
open source enterprise search
platform built on Apache Lucene™.
http://lucene.apache.org/solr/
4

5. What is Apache Solr?
● Solr is highly reliable, scalable and fault tolerant,
● It provides distributed indexing, replication and load-
balanced querying
● Offering automated failover and recovery, centralized
configuration and more
● Solr powers the search and navigation features of many of
the world's largest internet sites
5

6. Apache Solr Features
● Advanced Full-Text Search Capabilities
● Faceted Search and Filtering
● Advanced Configurable Text Analysis
● Query Suggestions, Spelling and More
● Rich Document Parsing
● Flexible and Adaptable with easy configuration
● Standards Based Open Interfaces - XML, JSON and HTTP
● and much more
6

7. How TYPO3 got its Apache Solr
Extension?
● In 2009 we at dkd hit the limits of TYPO3 built-in search
Indexed Search
● Servers kept stopping responding while users using the
search
● Customers complaining about not finding the right stuff
● We investigated different options and found Apache Solr
7

8. How TYPO3 got its Apache Solr
Extension?
● The idea to program a TYPO3 Extension was born
● So we started to ask around? Who would join us?
● We collected funds to integrate a first version
● Goal: Act as Indexed Search, but using a Solr Index
● We wrote white paper and a calculation for a first MVP
● Can you believe how far we got?
8

9. EXT:solr Facts
● over 50 Releases
● over 400 Partners financing
● 96 Contributors
● 97 Github Stars
● 105 801 Installations via packagist
● 31,587 Installations via TER
9

10. EXT:solr Facts
Total Physical Source Lines of Code (SLOC) = 38,174
Development Effort Estimate, Person-Years (Person-Months) = 9.16 (109.92)
(Basic COCOMO model, Person-Months = 2.4 * (KSLOC**1.05))
Schedule Estimate, Years (Months) = 1.24 (14.91)
(Basic COCOMO model, Months = 2.5 * (person-months**0.38))
Estimated Average Number of Developers (Effort/Schedule) = 7.37
Total Estimated Cost to Develop = $ 1,237,365
(average salary = $56,286/year, overhead = 2.40).
SLOCCount, Copyright (C) 2001-2004 David A. Wheeler
10

11. EXT:solr Facts
● Current Version
○ EXT:solr 8.1 for TYPO3 v 8
○ EXT:solr 6.5 for TYPO3 v 7
● We support the two latest LTS Versions
○ TYPO3 v 7 LTS
○ TYPO3 v 8 LTS
● Developer friendliness
○ Master should work with latest and greatest
11

12. EXT:solr Facts
● Every quarter we release either a Feature or Bugfix
release
● Great Community of Developers helping us
● Around 500 Solr Friends on Slack #ext-solr
● Over 400 Partners in more than 9 years
● Around 100 Partners per Year
● 800 hours of sponsored development
12

13. The Apache Solr Team @dkd_de
● Timo Hund (Developer)
● Rafael Kähm (Developer)
● Markus Friedrich (Developer)
● Thomas Janke (Management / Sales / Support)
● Olivier Dobberkau (Management / Sales)
● Ingo Renner (The first Developer, Friendly Ghost, Living
the American Dream)
13

14. What is in the box?
TYPO3
EXT:solr
- Indexing of pages and records into Apache Solr
- Highly integrated into TYPO3
- Powerful FLUID based Frontend
- Search
- Faceting
- Sorting
- Highlighting
14

15. Beyond Search
TYPO3
EXT:solr
EXT:solrfal EXT:solrfluidgrouping EXT:solrconsole EXT:solrdebugtools EXT:tikaEXT:solrmlt
- Several public and private addons
- Allowing to build solr based web applications. e.g.:
- Solr based list views
- Downloadcenter (file search with EXT:solr and solrfal)
- Did you know that extensions.typo3.org is powered by ext:solr?
15

16. Demo
● How to configure solr?
● How to add the search into your TYPO3 system?
● How to index content?
● (Manager Alert! I am not a dev!)
16

17. 17

18. Demo: Setup
● Create domain record
● Include default TypoScript & configure Solr server
● Enable indexing & configure search markers
● Initialize “Solr Connections”
● Check the TYPO3 report
18

19. 19

20. Demo: Add search plugin
● Add the Solr Search Box to a “Search Page”
20

21. 21

22. Demo: Indexing & Results
● Initialize the index queue
● Run indexer
● Check results in Frontend
22

23. 23

24. Tidbits
You can use our dev-box
https://github.com/TYPO3-Solr/solr-typo3-devbox
Need a Solr Docker box?
https://github.com/TYPO3-Solr/ext-
solr/blob/master/Dockerfile
Roadmap:
https://blog.dkd.de/apache-solr-for-typo3-roadmap-2018/
24

25. Questions
& Answers
25

26. Thank you!
We would like to thank you!
Additionally we would thanks our Sponsors that make the
development, maintenance and motivation happen!
Please find them here:
https://www.typo3-solr.com/en/sponsors/our-sponsors/
26

27. Contact
Olivier Dobberkau <olivier.dobberkau@dkd.de>
Twitter: @T3RevNeverEnd
Our Website: https://www.typo3-solr.com
dkd Internet Service GmbH
Kaiserstrasse 73
D-60329 Frankfurt am Main
Tel: +49 69 2475218-0
27