EViT-DeiT-S Finetune-30 Reproduce

[BWLONG]

Thanks for your open source work.

Following the finetune.sh configuration, I just use the batch_size of 8x256=2048, but the accuracy is only 79.35%.

[youweiliang]

Hi, which checkpoint did you use for finetuning? Did you modify any hyperparameters? I checked it twice for reproducibility and there should be no problem in getting 79.5% accuracy.

[BWLONG]

I used the batch_size of 8x256=2048 and the checkpoint=deit_small_patch16_224-cd65a155.pth , the other hyperparameters followed the finetune.sh configuration.