Is there any tricks for training

[leochli]

Hi @shicai ,
I followed Resnet policy for training Densenet-121 yet get 72% for top1, I'd be appreciated if there is any tricks to share to reach the paper acc.
Btw due to the GPU limit, I could only train with a batchsize 64.
Thx!

[shicai]

It is not difficult to train DenseNet.
Just make sure your settings are exactly the same as those in the paper.
If training with a mini-batch of 64 images, you'd better change your initial lr from 0.1 to 0.025.