Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about building the tfds #13

Open
Jason-Chi-xx opened this issue Jun 1, 2023 · 3 comments
Open

Question about building the tfds #13

Jason-Chi-xx opened this issue Jun 1, 2023 · 3 comments

Comments

@Jason-Chi-xx
Copy link

I have a question in building the new tfds. For example, the command "cd celeb_a_hq_custom ” “tfds build --register_checksums" are to setup celeb_a_hq_custom dataset as tfds.
However, when I run the test_celeb_a_hq.py, it just threw out the error :
"tensorflow_datasets.core.load.DatasetNotFoundError: Dataset celeb_a_hq_custom not found."
Why did celeb_a_hq_custom fail to be added as the new tfds?

@hyunjik11
Copy link
Collaborator

Apologies for the late reply.
Hmm you shouldn't be seeing this error. I've just tried following the instructions from scratch in a new venv and the test runs fine for me. Have you tried deleting the celeb_a_hq_custom dataset (i.e. deleting the directory /{PARENT_PATH}/tensorflow_datasets/celeb_a_hq_custom - the PARENT_PATH can be found out by running tfds build --register_checksums in the celeb_a_hq_custom directory), and regenerating the dataset using tfds build --register_checksums, before running the test? When you try regenerating the dataset, let me know if you were able to successfully create the dataset i.e. whether you see the message:

Dataset celeb_a_hq_custom downloaded and prepared to /{PARENT_PATH}/tensorflow_datasets/celeb_a_hq_custom/1.0.0. Subsequent calls will reuse this data.
INFO[build.py]: Dataset generation complete...

If you do, then you should be able to run test_celeb_a_hq.py.

@Dieuwertje97
Copy link

Hi! Hopping on to this issue, since I tried to reproduce your results based on your codebase, but experience issues with the tfds build --register_checksums command. It seems the link to the zip file on Google Drive is broken, do you know if the file was removed or did it move somewhere else?
Thank you in advance!

@Hyunmin-jasper-Cho
Copy link

Hi! Hopping on to this issue, since I tried to reproduce your results based on your codebase, but experience issues with the tfds build --register_checksums command. It seems the link to the zip file on Google Drive is broken, do you know if the file was removed or did it move somewhere else? Thank you in advance!

I've got the same issue, and I found that this Kaggle link provides the same files. Its naming convention of the directory looks the same as Functa's code. (data128x128).
And I am able to make TFDS dataset through a bit of modification of the celeb_a_hq_custom.py code.
I'm NOT an official author, so it may differ from the original one, but I hope this Kaggle data does not affect reproducibility.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants