Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some keys are missing after autoscale on Kubernetes #60

Closed
buraksezer opened this issue Oct 4, 2020 · 1 comment
Closed

Some keys are missing after autoscale on Kubernetes #60

buraksezer opened this issue Oct 4, 2020 · 1 comment
Assignees
Labels
bug Something isn't working help wanted Extra attention is needed investigation olric Distributed cache and in-memory key/value store release-blocker
Milestone

Comments

@buraksezer
Copy link
Owner

Olric losts a relatively small number of keys after autoscaling in the Kubernetes environment.

Reproduce & observe:

1- Create a deployment with replicas: 1
2- Configure HPA and metrics server: https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale-walkthrough/
3- Assign an external IP to the deployment
4- Autoscale the deployment: kubectl autoscale deployment olricd --cpu-percent=50 --min=1 --max=10
5- Run olric-load on your host system: olric-load -a 10.98.198.52:3320 -c put -k 1000000 -s msgpack
6- It should run and scale up seamlessly.
7- Check all the keys: olric-load -a 10.98.198.52:3320 -c get-k 1000000 -s msgpack
8- Some keys are missing: [ERROR] Failed to call Get command for 209813: key not found

@buraksezer buraksezer added bug Something isn't working help wanted Extra attention is needed olric Distributed cache and in-memory key/value store investigation release-blocker labels Oct 4, 2020
@buraksezer buraksezer added this to the 0.3.0 milestone Oct 4, 2020
@buraksezer buraksezer self-assigned this Oct 4, 2020
@buraksezer
Copy link
Owner Author

Done d6af61f

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed investigation olric Distributed cache and in-memory key/value store release-blocker
Projects
None yet
Development

No branches or pull requests

1 participant