Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy container with rclone in test cluster #378

Closed
skoulouzis opened this issue Dec 12, 2022 · 6 comments · Fixed by #386
Closed

Deploy container with rclone in test cluster #378

skoulouzis opened this issue Dec 12, 2022 · 6 comments · Fixed by #386
Assignees
Milestone

Comments

@skoulouzis
Copy link
Member

From https://github.com/QCDIS/NaaVRE/tree/datamesh build and deploy the container with rclone

@skoulouzis skoulouzis self-assigned this Dec 12, 2022
@skoulouzis skoulouzis added this to the Data Mesh milestone Dec 12, 2022
@JustinMingo
Copy link

No luck. When I launch a terminal it can't find rclone.

Utrecht university has it: https://utrechtuniversity.github.io/research-engineering/manuals/install-rclone/

I get the following errors when I try that (something with privileges?):

jovyan@jupyter-justinmingo:~$ rclone config
bash: rclone: command not found

jovyan@jupyter-justinmingo:~$ curl https://rclone.org/install.sh | sudo bash

sudo: effective uid is not 0, is /usr/bin/sudo on a file system with the 'nosuid' option set or an NFS file system without root privileges?
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 4669 100 4669 0 0 27427 0 --:--:-- --:--:-- --:--:-- 27627
curl: (23) Failure writing output to destination

jovyan@jupyter-justinmingo:~$ rclone version
bash: rclone: command not found

@skoulouzis
Copy link
Member Author

Will try to install with apt and rebuild the image

@skoulouzis
Copy link
Member Author

We can also use : conda install -c conda-forge rclone

@JustinMingo
Copy link

Rclone works, S3 I think also:

Current remotes:

Name Type
==== ====
test s3

@JustinMingo
Copy link

JustinMingo commented Dec 15, 2022

  • Check if we can move files from and to S3.

@skoulouzis
Copy link
Member Author

rclone from apt installs 1.50.2
rclone from conda installs 1.60.1

skoulouzis added a commit that referenced this issue Dec 19, 2022
@skoulouzis skoulouzis linked a pull request Dec 19, 2022 that will close this issue
skoulouzis added a commit that referenced this issue Dec 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants