Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solr testing #420

Merged
merged 14 commits into from
Mar 16, 2022
Merged

Solr testing #420

merged 14 commits into from
Mar 16, 2022

Conversation

nickumia-reisys
Copy link
Contributor

@nickumia-reisys nickumia-reisys commented Feb 9, 2022

Related to GSA/data.gov#2701

Important Points:

  • Only use one shard since we can afford the disk space now
    • This reduces our 10 node configuration to 5 nodes.
  • Only use NRT solr replicas
  • Fix read timeout issue caused by CKAN, not NGINX.

@nickumia-reisys nickumia-reisys marked this pull request as ready for review March 3, 2022 17:47
@nickumia-reisys nickumia-reisys temporarily deployed to development March 3, 2022 18:16 Inactive
@nickumia-reisys nickumia-reisys temporarily deployed to development March 3, 2022 20:25 Inactive
The official guidance is to minimize the number of shards as much as possible and since there's no need for us to have two shards, it would help our performance if solr did not have to reconcile data from two shards during queries
even if we decrease it to one, we still need to specify it haha.. duh.. haha..
Occasionally, there is a read timeout after an index fails because it puts solr in a weird state.  This would help ckan recover solr in that state
@nickumia-reisys nickumia-reisys requested a review from a team March 16, 2022 15:50
@nickumia-reisys nickumia-reisys merged commit 340e20f into main Mar 16, 2022
@nickumia-reisys nickumia-reisys deleted the solr-testing branch March 16, 2022 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants