Training T5

[yejh123]

Hello, I attempt to train a T5 model, but I cannot run the code. Where is the file trainer_seq2seq_t5 in run_maxtokens_translation.py?

[li-aolong]

The file trainer_seq2seq_t5 is in my local environment. It is same as the trainer_seq2seq.
Just replace from transformers.trainer_seq2seq_t5 import Seq2SeqTrainer with from transformers.trainer_seq2seq import Seq2SeqTrainer.

[yejh123]

I got it. But if I use the default Seq2SeqTrainer, how can I train models using SortishSampler with max_token?

[li-aolong]

Sorry, I don't know about SortishSampler. It can be set True in Seq2SeqTrainingArguments.

[yejh123]

I mean I want to train with max_token, not with batch_size. But if I use the default Seq2SeqTrainer, it will train the model with batch_size. Would you please tell me how to train with max_token since it seems to be helpful to speed up the training?

[li-aolong]

I before tried to train with max_token with run_maxtokens_translation.py, but it was still with batch_size. So I don't konw, too.

[yejh123]

Anyway, thanks for answering.