Skip to content

Commit

Permalink
Fix download script in laion-high-resolution docs (#351)
Browse files Browse the repository at this point in the history
* Fix download script in lain-high-resolution docs

The current script produces invalid urls due to the padding not being kept in the for loop

* Cleanup
  • Loading branch information
BitPhinix authored Oct 8, 2023
1 parent 4608958 commit 32e5de3
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions dataset_examples/laion-high-resolution.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,8 +11,12 @@ A good use case is to train a superresolution model.
Download from https://huggingface.co/datasets/laion/laion-high-resolution

```
mkdir laion-high-resolution && cd laion-high-resolution
for i in {00000..00127}; do wget https://huggingface.co/datasets/laion/laion-high-resolution/resolve/main/part-$i-5d6701c4-b238-4c0a-84e4-fe8e9daea963-c000.snappy.parquet; done
mkdir -p laion-high-resolution && cd laion-high-resolution
for i in {0..127}; do
wget "https://huggingface.co/datasets/laion/laion-high-resolution/resolve/main/part-$(printf "%05d" $i)-5d6701c4-b238-4c0a-84e4-fe8e9daea963-c000.snappy.parquet"
done
cd ..
```

Expand Down

0 comments on commit 32e5de3

Please sign in to comment.