You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, i'm having this issue when trying to segmentation then send every sentence to extract, i don't use --split because i have to reuse those sentences later.
Help!
The text was updated successfully, but these errors were encountered:
Hi, i got a quick fix. Bascially batch your data and skip the line it is showing the error on. make the process sleep a little and it will restart to give you the results except on the line the error occured.
In my case, this error is caused by empty lines or sentences with only one letter. You can add some special tokens at the end of the sentence to allow the model to continue processing, such as: sentence = str(sentence + ' a b. ')
or: sentence = str(sentence + ' <sentence end>. ')
Hello, i'm having this issue when trying to segmentation then send every sentence to extract, i don't use --split because i have to reuse those sentences later.
Help!
The text was updated successfully, but these errors were encountered: