Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weird same prediction with large dataset #15

Closed
shinu335 opened this issue Jun 30, 2022 · 2 comments
Closed

Weird same prediction with large dataset #15

shinu335 opened this issue Jun 30, 2022 · 2 comments

Comments

@shinu335
Copy link

Thank you for your wonderful project!

I have been doing research with your C-Tran project, and conducting training with several autonomous driving dataset, such as nuScenes and METEOR.

It seems that when the number of images is larger than 100,000, all of the images tend to have almost same predictions. For example, [car: 0.96, pedestrian: 0.01, truck: 0.48] for all of the images, even though labels of different images are different. However, when I shrink the number of images to 3000 or less, different images will have different predictions of labels.

May I ask why this problem happens? Is it because I failed to apply your network correctly, or because the network with Transformers struggled to output satisfying predictions with large data?

Thank you for your reading, and I look forward to your reply.

@jacklanchantin
Copy link
Collaborator

Are you seeing the same results on the datasets from our experiments? If not, it's likely something wrong with your data.

@shinu335
Copy link
Author

shinu335 commented Jul 4, 2022

Are you seeing the same results on the datasets from our experiments? If not, it's likely something wrong with your data.

Thank you for your reply.

I have not conducted training with datasets from your experiments.

With regards to my data, including nuScenes and METEOR, weird same results are output only when number of data is large. It can output normal predictions when number of data is small.

Anyway I am going to check my experiment again. Thank you again for your reply.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants