MSVD ACC decrease after stage3

[Deaddawn]

Hi, there. I have experimented on the MSVD QA using llama-vid-7b-full-224-video-fps-1 and llama-vid-7b-full-224-long-video. The latter acc decrease, does that make sense to you?

[Deaddawn]

decrease about 0.2

[yanwei-li]

Hi, this could happen when tuning long videos. And performance of the MSVD QA could also have variant results because of the GPT evaluation.

[Deaddawn]

Hi, this could happen when tuning long videos. And performance of the MSVD QA could also have variant results because of the GPT evaluation.

got it, tks