Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How big is your ImageNet dataset size? #1

Open
concerttttt opened this issue Apr 14, 2021 · 1 comment
Open

How big is your ImageNet dataset size? #1

concerttttt opened this issue Apr 14, 2021 · 1 comment

Comments

@concerttttt
Copy link

I see in your code you're directly loading ImageNet dataset into a numpy array, does it mean you have a super large memory server, say 256GB? As to my knowledge ImageNet data is around 150GB large. Can you share why you're using .cvs form of imagenet data?

Appreciate for any response.
Thank you.

@rlatjcj
Copy link
Member

rlatjcj commented Jun 14, 2021

@concerttttt Sorry for my late response. 🙏🏻
I recorded absolute paths of ImageNet images with csv format before training. So I loaded mini-batch images using generator (tf.data) during training, NOT loading whole images.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants