Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCS allows only 1 write/s per key #5211

Open
trinity-1686a opened this issue Jul 10, 2024 · 1 comment
Open

GCS allows only 1 write/s per key #5211

trinity-1686a opened this issue Jul 10, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@trinity-1686a
Copy link
Contributor

trinity-1686a commented Jul 10, 2024

Per GCS documentation, we may not write an object more than once a second. For most objects, we never write more than once, but for the metastore, we may update it more frequently than that, which causes errors. We should make sure we retry in this case, and that we don't increment error metrics if the retry succeeded

@trinity-1686a trinity-1686a added the bug Something isn't working label Jul 10, 2024
@trinity-1686a trinity-1686a self-assigned this Jul 10, 2024
@trinity-1686a trinity-1686a moved this from In progress to In review in Quickwit 0.9 Sep 4, 2024
@trinity-1686a
Copy link
Contributor Author

retry is now implemented. Keeping the ticket opened there for a future where we may batch metastore writes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant