Presentation held at Apache Lucene EuroCon 2010 (http://lucene-eurocon.org/)

1. Bringing Solr to Drupal 1 A General and a Library-Specific Use CaseKirály PétereXtensible Catalog

2. Two ways of using Solr in Drupal 2 General solution: Apache Solr Search Integration and related modules: Stats, Autocomplete, Multisite, Ajax, Biblio, Attachments, Übercart (e-commerce integration), Views, Multilingual, Geospatial and many othersFits for the overall needs, uses predefined fields Library specific solution: eXtensible Catalog modulesFits for library needs, uses dynamic fields

3. Part 1 – the general solution 3 General solution: Apache Solr Search Integration and related modules: Stats, Autocomplete, Multisite, Ajax, Biblio, Attachments, Übercart (e-commerce integration), Views, Multilingual, Geospatial and many othersFits for the overall needs, uses predefined fields Library specific solution: eXtensible Catalog modulesFits for library needs, uses dynamic fields This part of the presentation is based on the works and previous presentations of Robert Douglass.

4. Drupal architecture 4 Relational databasefor storage Solr index for search

5. Purposes 5 Creating a general insfrastructure which is usable in every Drupal installation Core module, and additional module for covering specific Solr functionalities (statistics, autocomplete etc.) Replace the original (and still default) MySQL-based search feature

6. 6 sort Facet 1 Facet 2

7. 7 List of modules page sort module search API version categories

8. Advanced search: issues 8

9. Whitehouse.gov on Drupal & Solr 9 sort facets

10. Boosting by Drupal specific properties 10

11. Boosting and ignoring by document type 11

12. Boosting by fields/ HTML tags 12

13. More like this implementation 13

14. Solrin Views integration 14 Views is a very popular module, helps creating interactive DB queries andresult pages. Now it can handle Apache Solr as data source.

15. Part of the Views admin page 15 You can specify fields, sorting, filters, layout, arguments, behaviours and more

16. Using Tika: file search 16

17. Indexing/searching multiple sites 17

18. Search in comments 18

19. CCK date searching 19 Content Construction Kit: popular module to create document and field types. CCK date is a special field type handling dates.

20. statistics 20 impressive numbers – that’s why welove Solr…

21. Statistics of facet usage 21

22. autocomplete 22

23. Future plans 23 Crawling with Nutch Geospatial search eDismax (Solr 1.5) Drupal 7 API changes Improving documentation

24. People behind these modules 24 Robert Douglass(DE) http://drupal.org/user/5449 Alejandro Garza (MX) http://drupal.org/user/153120 Peter Wolanin (US) http://drupal.org/user/49851 James McKinney (CA) http://drupal.org/user/472460 Scott Reynolds (US) http://drupal.org/user/60009 Mike O'Connor (US) http://drupal.org/user/104525 Markus Kalkbrenner (DE) http://drupal.org/user/124705 and others…

25. Links 25 apachesolr http://drupal.org/project/apachesolr (this is the best starting point) content recommendation patchhttp://drupal.org/node/372767 views integration http://drupal.org/project/apachesolr_views, http://acquia.com/node/911667 file search http://drupal.org/project/apachesolr_attachments, http://acquia.com/node/1129446 date facet for CCK fieldhttp://drupal.org/node/558160 statisticshttp://drupal.org/project/apachesolr_stats multisitehttp://drupal.org/project/apachesolr_multisitesearch autocompletehttp://drupal.org/project/apachesolr_autocomplete

26. Part 2 – Library specific solution 26 General solution: Apache Solr Search Integration and related modules: Stats, Autocomplete, Multisite, Ajax, Biblio, Attachments, Übercart (e-commerce integration), Views, Multilingual, Geospatial and many othersFits for the overall needs, uses predefined fields Library specific solution: eXtensible Catalog modulesFits for library needs, uses dynamic fields

27. About eXtensible Catalog 27 a project creating an open source next generation library ‘discovery interface’ and an FRBR-based metadata platform started in 2007 driven by new theories of library science, cultural anthropology and the practice of web 2.0, library 2.0 Universities of Rochester, Notre Dame, Cornell, North Carolina at Charlotte, Rochester Institute of Technology and CARLI consortium

28. Architecture 28 Drupal CMS MARC Normalization DCNormalization XC DrupalToolkit Transformation Aggregation XC Metadata Services Toolkit circulation data XC NCIPToolkit XC OAI Toolkit Integrated Library System Repository

29. Purposes of XC Drupal Toolkit 29 integrate library data into a popular content management system customizable functionalities customizable interface(s) internationalization, localization 5000+ custom modules, 20+ library specific modules wide range on mashup options all features are available through user interfaces

30. Search results 30 bibliographical data cover images highlighted terms facets availability information

31. Customized interface (Kyushu University) 31

32. Similar documents 32

33. XML attribute handling 33 subject=„History” and subject_OCLC=„History”subject_OCLC=„History”subject=„History” and subject_type=„OCLC”none <subject type="OCLC">History</subject> could be indexed as…

34. Mapping schema fields to Solr types 34

35. Setup a facet 35 Aggregating values ofdifferent fields into onefacet specifySolr type custom PHP code to modify field values(conditions)

36. Custom PHP code for displaying title 36

37. Getting records into Drupal: OAI harvesting 37 List of scheduled harvests Harvest is running

38. Data flow between components 38 OAI-PMHprovider Drupal batch delete/insert documents creating nodes MySQL Solr

39. Creating a ‘more like this’ parameter set 39 Saving parameters for ‘More like this’ functionality

40. Creating highlighter 40 wrapper around the highlighter’s parameters

41. Setting up field and date facet properties 41 Date facet properties Field facet properties

42. Putting facets together: ‘facet group’ 42 General properties List of facets, and their type

43. Reordering facets 43 Just drag and drop You haven’t saved changes!

44. Using facet term list in search form 44 dropdown fullfilled withlanguagefacet terms dropdown definition

45. Adding widgets to UI: navigation bar 45 definition of navigation bar navigation bar in action

46. Links 46 Project page http://eXtensibleCatalog.org XC Drupal Toolkit http://drupal.org/project/xc Metadata Services Toolkit http://code.google.com/p/xcmetadataservicestoolkit OAI Toolkit http://code.google.com/p/xcoaitoolkit NCIP Toolkit http://code.google.com/p/xcnciptoolkit Developers: Mlen-Too Wesley(GH) http://drupal.org/user/318924 Király Péter (H) http://drupal.org/user/352587, http://twitter.com/kiru