Loss oscillation in pretraining on NTU60

[ikramkourbane]

Hi, thank you for this great work.

I tried the pretraining model on the NTU60 following the setup instructions. The training loss is highly oscillating, would you please explain this behavior? the loss starts at 0.265 and goes to ~0.24 minimum, I wonder if this is normal? and what checkpoint should we take for the downstream task?

Thank you.

[maoyunyao]

The last checkpoint (399).