-
Notifications
You must be signed in to change notification settings - Fork 394
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- follow-up to #3329 - see #3299 (comment)
- Loading branch information
Showing
6 changed files
with
47 additions
and
47 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -81,7 +81,7 @@ $ wget https://example.com/path/to/data.csv | |
|
||
<details> | ||
|
||
### Click for Amazon S3 example | ||
### Amazon S3 | ||
|
||
This command will copy an S3 object into the current working directory with the | ||
same file name: | ||
|
@@ -108,7 +108,7 @@ configuration, you can use the parameters described in `dvc remote modify`. | |
|
||
<details> | ||
|
||
### Click for Google Cloud Storage example | ||
### Google Cloud Storage | ||
|
||
```dvc | ||
$ dvc get-url gs://bucket/path file | ||
|
@@ -120,7 +120,7 @@ The above command downloads the `/path` file (or directory) into `./file`. | |
|
||
<details> | ||
|
||
### Click for SSH example | ||
### SSH | ||
|
||
```dvc | ||
$ dvc get-url ssh://[email protected]/path/to/data | ||
|
@@ -133,7 +133,7 @@ directory). | |
|
||
<details> | ||
|
||
### Click for HDFS example | ||
### HDFS | ||
|
||
```dvc | ||
$ dvc get-url hdfs://[email protected]/path/to/file | ||
|
@@ -143,7 +143,7 @@ $ dvc get-url hdfs://[email protected]/path/to/file | |
|
||
<details> | ||
|
||
### Click for HTTP example | ||
### HTTP | ||
|
||
> Both HTTP and HTTPS protocols are supported. | ||
|
@@ -155,7 +155,7 @@ $ dvc get-url https://example.com/path/to/file | |
|
||
<details> | ||
|
||
### Click for WebHDFS example | ||
### WebHDFS | ||
|
||
```dvc | ||
$ dvc get-url webhdfs://[email protected]/path/to/file | ||
|
@@ -165,7 +165,7 @@ $ dvc get-url webhdfs://[email protected]/path/to/file | |
|
||
<details> | ||
|
||
### Click and expand for a local example | ||
### local | ||
|
||
```dvc | ||
$ dvc get-url /local/path/to/data | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -90,7 +90,7 @@ The following are the types of remote storage (protocols) supported: | |
|
||
<details> | ||
|
||
### Click for Amazon S3 | ||
### Amazon S3 | ||
|
||
> 💡 Before adding an S3 remote, be sure to | ||
> [Create a Bucket](https://docs.aws.amazon.com/AmazonS3/latest/gsg/CreatingABucket.html). | ||
|
@@ -115,7 +115,7 @@ methods that are performed by DVC (`list_objects_v2` or `list_objects`, | |
|
||
<details> | ||
|
||
### Click for S3-compatible storage | ||
### S3-compatible storage | ||
|
||
For object storage that supports an S3-compatible API (e.g. | ||
[Minio](https://min.io/), | ||
|
@@ -143,7 +143,7 @@ they're effective depends on each storage platform. | |
|
||
<details> | ||
|
||
### Click for Microsoft Azure Blob Storage | ||
### Microsoft Azure Blob Storage | ||
|
||
```dvc | ||
$ dvc remote add -d myremote azure://mycontainer/path | ||
|
@@ -165,7 +165,7 @@ To use a custom authentication method, use the parameters described in | |
|
||
<details> | ||
|
||
### Click for Google Drive | ||
### Google Drive | ||
|
||
To start using a GDrive remote, first add it with a | ||
[valid URL format](/doc/user-guide/setup-google-drive-remote#url-format). Then | ||
|
@@ -199,7 +199,7 @@ modified. | |
|
||
<details> | ||
|
||
### Click for Google Cloud Storage | ||
### Google Cloud Storage | ||
|
||
> 💡 Before adding a GC Storage remote, be sure to | ||
> [Create a storage bucket](https://cloud.google.com/storage/docs/creating-buckets). | ||
|
@@ -221,7 +221,7 @@ parameters, use the parameters described in `dvc remote modify`. | |
|
||
<details> | ||
|
||
### Click for Aliyun OSS | ||
### Aliyun OSS | ||
|
||
First you need to set up OSS storage on Aliyun Cloud. Then, use an S3 style URL | ||
for OSS storage, and configure the | ||
|
@@ -263,7 +263,7 @@ $ export OSS_ACCESS_KEY_SECRET='mysecret' | |
|
||
<details> | ||
|
||
### Click for SSH | ||
### SSH | ||
|
||
```dvc | ||
$ dvc remote add -d myremote ssh://[email protected]/path | ||
|
@@ -281,7 +281,7 @@ Please check that you are able to connect both ways with tools like `ssh` and | |
|
||
<details> | ||
|
||
### Click for HDFS | ||
### HDFS | ||
|
||
⚠️ Using HDFS with a Hadoop cluster might require additional setup. Our | ||
assumption is that the client is set up to use it. Specifically, [`libhdfs`] | ||
|
@@ -303,7 +303,7 @@ $ dvc remote add -d myremote hdfs://[email protected]/path | |
|
||
<details> | ||
|
||
### Click for WebHDFS | ||
### WebHDFS | ||
|
||
⚠️ Using WebHDFS requires to enable REST API access in the cluster: set the | ||
config property `dfs.webhdfs.enabled` to `true` in `hdfs-site.xml`. | ||
|
@@ -331,7 +331,7 @@ active kerberos session. | |
|
||
<details> | ||
|
||
### Click for HTTP | ||
### HTTP | ||
|
||
```dvc | ||
$ dvc remote add -d myremote https://example.com/path | ||
|
@@ -343,7 +343,7 @@ $ dvc remote add -d myremote https://example.com/path | |
|
||
<details> | ||
|
||
### Click for WebDAV | ||
### WebDAV | ||
|
||
```dvc | ||
$ dvc remote add -d myremote \ | ||
|
@@ -364,7 +364,7 @@ $ dvc remote add -d myremote \ | |
|
||
<details> | ||
|
||
### Click for local remote | ||
### local remote | ||
|
||
A "local remote" is a directory in the machine's file system. Not to be confused | ||
with the `--local` option of `dvc remote` (and other config) commands! | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.