Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace /rclone/sync/movedir with /storage_service/backup to use scylla streaming #4143

Open
karol-kokoszka opened this issue Dec 2, 2024 · 0 comments

Comments

@karol-kokoszka
Copy link
Collaborator

Current effort on core side is expected to bring the feature where the data is send to AWS S3 (to be validated what about GCS and Azure) directly by Scylla server.
Scylla Manager is currently using RClone under the hood to send the data to S3.

This issue expects Scylla Manager to start using /storage_service/backup endpoint of Scylla server instead of the RClone one. https://docs.google.com/document/d/1d-nJnn5n2gqzRXvP5xpOis0fWxIzYkf-u9X1xrIAG_c/edit?tab=t.0#bookmark=id.9g3y3uw716bc

PR cannot be merged to master, we just want to keep it on feature branch until there is a green light that all corner cases are covered and we finally can get rid of RClone.

Michal-Leszczynski added a commit that referenced this issue Dec 16, 2024
Michal-Leszczynski added a commit that referenced this issue Dec 17, 2024
This commit adds code for using Scylla backup API.
Luckily for us, handling pause/resume and progress
is analogous to the Rclone API handling.

Fixes #4143
Fixes #4138
Fixes #4141
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant