OSDF Origin Push/Pull Support added #182
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related Issues / Pull Requests
Add support for reading and writing to OSDF Origin Remotes
Description
Enable Artifact Pushing/Pull from OSDF Origin
bearer token in the header before any push/pull to a OSDF HTTP Remote.
cmf init osdfremote
with newcmflib/commands/init/osdfremote.py
core.remote==osdf
through dvc_push exceptthat it updates
core.remote.password
in .dvc/config before doing soin utils/helper_functions.py. This uses scitokens and cryptography
packages. This reads supplied private key, receives token from issuer and
formats it as "Bearer + token".
storage_backends/osdf_artifacts.py
. This works with requests packagecommands/artifacts/pull.py
has new handling forcore.remote==osdf
which updates
core.remote.password
in .dvc/config and passes thenewly generated dynamic password to download_artifacts() to use.
function properly. Also bumped ml-metadata to 1.15.0 which is needed for
compatibility. External packages scitokens and cryptography also added
as dependencies.
What changes are proposed in this pull request?
examples in this repository need to be updated too).
Checklist:
uses Google-style formatting and any other formatting that is supported by mkdocs and plugins this project
uses.