Quick question on the need for KeywordsStoppingCriteria

[sramakintel]

Hello Team,

First off, thanks for your work! It is truly a great project!

Quick question on the KeywordsStoppingCriteria implementation. I see that it is a custom stopping criteria appended to other forms like EOSTokenCriteria,MaxLengthCriteria etc..

As far as I understood, The EOSTokenCriteria used here looks if the predicted token is an EOS token which is 151645 which I believe is the same as the KeywordsStoppingCriteria functionality where the ['<|im_end|>'] is tokenized as 151645. I feel they do the same thing. Return True if the predicted token is 151645.

I tried passing None to stopping_criteria here and it did not change the behavior. Is there a reason we need both?