Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can not reproduce the results #3

Open
kristine-li opened this issue Oct 20, 2021 · 4 comments
Open

can not reproduce the results #3

kristine-li opened this issue Oct 20, 2021 · 4 comments

Comments

@kristine-li
Copy link

Hi, Thanks for your great work. I enjoyed reading your paper! And really thanks for sharing your code and model checkpoint.
When running main_stablenet.py, I experience no reproducibility of the results。
Example:

Dataset:PACS(unbalanced(5:1:1) | PACS | C,S,P | art_painting | ResNet18) ,and we also use the dataset split files you provided。
The best results which we reproduce:
image

Do you have a clue why that is the case?
Thanks in advance!

@xxgege
Copy link
Owner

xxgege commented Dec 14, 2021

Hi,
Thank you for your interest in our work! As mentioned in readme, many hyper-parameters can affect the performance (such as lrbl, epochb, lambdap), which can vary among different tasks/environments/software/hardware/random seeds, and thus carefully tunning is required. You may need to tune them according to your environment and software.
We are sorry for this problem and trying to address it in future work.

@xioahua
Copy link

xioahua commented Oct 14, 2022

Hi, Thanks for your great work. I enjoyed reading your paper! And really thanks for sharing your code and model checkpoint. When running main_stablenet.py, I experience no reproducibility of the results。 Example:

Dataset:PACS(unbalanced(5:1:1) | PACS | C,S,P | art_painting | ResNet18) ,and we also use the dataset split files you provided。 The best results which we reproduce: image

Do you have a clue why that is the case? Thanks in advance!

Hi, could you provide the same dataset split files for me? thank you.

@1424163067
Copy link

Hi, Thanks for your great work. I enjoyed reading your paper! And really thanks for sharing your code and model checkpoint.
When running main_stablenet.py, some questions have arisen that I would like to ask you.
Example:
XTY7N1} TG(J61S 4)$5TRX
I have created a directory and put the dataset under the directory as required by the error, but still report this error.
ZNY(~NNHGAZ3$~V%7@IFE`V
image
Do you have a clue why that is the case?
Thanks in advance!

@allenwang2333
Copy link

May be try change default path in ops/config.py of data directory

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants