extractText() doesn't work on Chinese PDF

[zxteloiv]

As I have tested, pure English content in a PDF can be extracted without problem.
But nothing readable could be extracted for a Chinese page.

I guess it's caused by the encoding.
I tried to modify the following line to below
https://github.com/mstamy2/PyPDF2/blob/master/PyPDF2/utils.py#L246

def u_(s):
    if sys.version_info[0] < 3:
        return unicode(s, encoding='utf-8')
    else:
        return s

But it doesn't work.

My environment:

• Python 2.7.10
• OS X El Capitan
• PyPDF2 version 1.25.1

Thank you.

[joewong826]

I have the same problem too. It spitted out total gibberish when it came to Chinese characters.

[jtn-ms]

extractText() function needs some modification. Main problem is from handling ByteStringObjects. Is there somebody who solved this? (https://github.com/mstamy2/PyPDF2/blob/master/PyPDF2/pdf.py)

def extractText(self):
    """
    Locate all text drawing commands, in the order they are provided in the
    content stream, and extract the text.  This works well for some PDF
    files, but poorly for others, depending on the generator used.  This will
    be refined in the future.  Do not rely on the order of text coming out of
    this function, as it will change if this function is made more
    sophisticated.

    :return: a unicode string object.
    """
    # Note: we check all strings are TextStringObjects.  ByteStringObjects
    # are strings where the byte->string encoding was unknown, so adding
    # them to the text here would be gibberish.

[MartinThoma]

Using the latest version in the main branch, extracing Chinese characters seems to work fine.

As here is not PDF to check, I assume that #924 has fixed this issue. I'll release the new PyPDF2==2.1.0 today.