Sharded Solr setup with master

[object Object],Documents indexed into manually selected master. ,[object Object],[object Object],Documents For indexing

[object Object],replication Replication duplicates indexes to two slaves each ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],Each shard host has two webapps a co-ordinator and a shard ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],All search requests come in via a load balancer ,[object Object],[object Object],[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],Load balancer has three VIPs, public search and two shard VIPs ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],Public requests balanced between co-ordinator webapps ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],Co-ordinator forwards requests to all shard VIPs ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],(it will then aggregates the results to return to the user) ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],Shard VIP balances between each slave for that shard ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],Masters need replication too, so... ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard

[object Object],We replicate to backup masters replication replication ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard ,[object Object],[object Object]

[object Object],Upon failure of master2, we switch to the backup replication ,[object Object],[object Object]

disabled Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard ,[object Object],[object Object]

[object Object],And start indexing to the new master replication indexing ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard ,[object Object],[object Object],documents

[object Object],And establish the old master, once functioning, as a new backup replication replication ,[object Object],[object Object],Public VIP Shard 1 VIP Shard 2 VIP ,[object Object],Public ,[object Object],[object Object],[object Object],[object Object],co-ordinator shard co-ordinator shard co-ordinator shard co-ordinator shard ,[object Object],[object Object]

Sharded Solr setup with master

Recommended

Recommended

More Related Content

What's hot

What's hot (17)

More from Sourcesense

More from Sourcesense (9)

Recently uploaded

Recently uploaded (20)

Sharded Solr setup with master