DVC remotes provide a location to store arbitrarily large files and directories.
First, you need to create a new folder on our Google Drive, navigate to the new folder and copy the last part of the URL.
You can now add a DVC remote to our project:
From web
Update .dvc/config
:
https://github.com/iterative/workshop-uncool-mlops-solution/blob/main/.dvc/config
[core]
remote = myremote
['remote "myremote"']
url = gdrive://{COPY PASTED GDRIVE URL}
From CLI
dvc remote add --default gdrive://{COPY PASTED GDRIVE URL}
More info: https://dvc.org/doc/command-reference/remote/add#description
The results of the pipeline can now be shared with others by using dvc push and dvc pull.
You will be prompted for Google Drive credentials the first time you run dvc push/pull
.
# Researcher A
# Updates hparam
dvc repro
git add . git commit -m "Updated hparam"
git push && dvc push
# Researcher B
git pull && dvc pull
# Receives changes
This commands works the same regardless of the remote type. See all the available remotes:
https://dvc.org/doc/command-reference/remote/add#supported-storage-types