Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

guide: Basic Operations (Data Mgmt) #4053

Closed
wants to merge 39 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
3df841e
guide: add DM/ Basic Ops intro + struct
jorgeorpinel Oct 19, 2022
6e5450e
guide: Tracking data guide and
jorgeorpinel Oct 19, 2022
9a8ce22
guide: Traking updates, intros for Sync and Version (Data Mgmt)
jorgeorpinel Oct 19, 2022
afb38ee
guide: complete Sync inc. figure (Data Mgmt)
jorgeorpinel Oct 19, 2022
9fc77a9
Merge branch 'main' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 20, 2022
314c953
guide" fixes and import/update flow to DM/Sync
jorgeorpinel Oct 20, 2022
a86325e
guide: More Data Versioning info. and
jorgeorpinel Oct 20, 2022
bc07653
guide: complete Versioning info (DM/ Basic Ops)
jorgeorpinel Oct 20, 2022
ac0a555
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 20, 2022
baf97cc
guide: typo fix
jorgeorpinel Oct 20, 2022
766f329
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 20, 2022
fe3208c
ref: simplify remote index (move to guide)
jorgeorpinel Oct 21, 2022
83834cd
ref: link from remote index to DM/ Ops/ Sync and
jorgeorpinel Oct 21, 2022
a45c9d6
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
561ff06
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
39e2965
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
e77f5f1
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
c1ed918
guide: rename DM/ TSV -> TSVD and
jorgeorpinel Oct 22, 2022
69f7de5
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
ec7f2c1
guide: DM/ TSVD - data codification
jorgeorpinel Oct 22, 2022
032cfef
guide: remove comment
jorgeorpinel Oct 22, 2022
903632a
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
5335be2
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 22, 2022
1430354
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 24, 2022
af6fec3
ref: roll back changes to remote index which
jorgeorpinel Oct 24, 2022
664f68a
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Oct 27, 2022
13ba7ae
guide: don't call `checkout` "plumbing"
jorgeorpinel Oct 27, 2022
dba203e
guide: don't call remote storage "additional"
jorgeorpinel Oct 27, 2022
e6a9ebf
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Feb 18, 2023
2916cf3
nav: remove unexistent page (per previous merge)
jorgeorpinel Feb 18, 2023
e2fdc09
typo
jorgeorpinel Feb 18, 2023
6115f72
guide: Basic Ops/ Tracking Data
jorgeorpinel Feb 18, 2023
315cf47
Remove unrelated changes...
jorgeorpinel Feb 18, 2023
272bc07
guide: Data Mgmt/ Basic Ops/ Sync
jorgeorpinel Feb 18, 2023
8fa58bc
fix link
jorgeorpinel Feb 18, 2023
d0ac5b9
guide: Data Mgmt/ Versioning + mention ML models more
jorgeorpinel Feb 20, 2023
5397f46
guide: link from Remote Storage to Basic Ops/ Sync
jorgeorpinel Feb 20, 2023
2c38ee4
Merge branch 'guide/data-mgmt-flows' into guide/data-mgmt/basic-ops
jorgeorpinel Feb 21, 2023
4a11e04
guide: more links to cache/remote sync
jorgeorpinel Feb 21, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
guide" fixes and import/update flow to DM/Sync
jorgeorpinel committed Oct 20, 2022
commit 314c953d3fca49d128bc7c503e393d92e55e56b7
17 changes: 8 additions & 9 deletions content/docs/user-guide/data-management/track-sync-version.md
Original file line number Diff line number Diff line change
@@ -83,15 +83,15 @@ unexpected errors occur (e.g. cache corruption).
To enable additional storage locations, you can configure [DVC remotes] with the
`dvc remote add` and `dvc remote modify` commands (see `dvc remote` for more
options). Once this is done, use the `dvc push` and `dvc pull` commands to
transfer data from between project and remote storage. This is the main
mechanism to share and back up your work.
transfer data between the project and remote storage. This is the main mechanism
to share and back up your work.

![Sync ops among locations](/img/sync-ops-locations.png) _Data sync operations
among locations_

<admon type="tip">

The `dvc fetch` transfers files downstream halfway, from remote storage to the
`dvc fetch` transfers files downstream halfway -- from remote storage to the
<abbr>cache</abbr>. This can be useful to make sure that some data is available
for checkout later.

@@ -104,17 +104,16 @@ external devices or network locations, and remote servers or cloud platforms.

</admon>

<!--
+ update
? ### Access
list, get, imports & update
-->
It's also possible to access and synchronize data assets one way from misc.
locations or from other DVC projects (e.g. [data registry] pattern). `dvc list`,
`dvc import` or `dvc import-url`, and `dvc update` are the main commands for
this.

[codify your data]: /doc/use-cases/versioning-data-and-models
[cache directory]: /doc/user-guide/data-management#the-data-cache
[protected]: /doc/command-reference/unprotect
[dvc remotes]: /doc/user-guide/data-management#remote-storage
[data registry]: /doc/use-cases/data-registry

## Versioning data