Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase mongo performance #365

Closed
JoranAngevaare opened this issue Dec 8, 2020 · 0 comments · Fixed by #375
Closed

Increase mongo performance #365

JoranAngevaare opened this issue Dec 8, 2020 · 0 comments · Fixed by #375
Assignees

Comments

@JoranAngevaare
Copy link
Contributor

JoranAngevaare commented Dec 8, 2020

Change the following lines:
Change this line https://github.com/AxFoundation/strax/blob/master/strax/storage/mongo.py#L112 to read 'chunk_i':{"$ge":0} for this we need to create a 'chunk_i'== - 1 when we create a metadata entry

See if we can update this op. https://github.com/AxFoundation/strax/blob/master/strax/storage/mongo.py#L281

Further we should also do the following:

  • collection.delete_many(query) before inserting the new meta-data document. Only one copy of the metadata should be allowed
  • add a provides_metadata field to query against. This solves using slow operations as in Temp fix query for md queries #374.
@JoranAngevaare JoranAngevaare self-assigned this Dec 8, 2020
@JoranAngevaare JoranAngevaare linked a pull request Jan 4, 2021 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant