encoding/decoding error

[WilliamTambellini]

Hi @m-popovic
Just an encoding/decoding error on windows:

Traceback (most recent call last):
  File "python-3.8.0\test\chrF++.py", line 232, in <module>
    main()
  File "python-3.8.0\test\chrF++.py", line 219, in main
    totalF, averageTotalF, totalPrec, totalRec = computeChrF(rtxt, htxt, args.nworder, args.ncorder, args.beta, sentence_level_scores)
  File "python-3.8.0\test\chrF++.py", line 124, in computeChrF
    for hline, rline in zip(fpHyp, fpRef):
  File "python-3.8.0\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 19: character maps to <undefined> 

It s just because you dont specify the encoding when opening the source files so windows defaults to cp1252 instead of utf8.
Specifying the utf-8 encoding does resolve the issue.
Do you consider PullRequest ?
Best