Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERR_STRING_TOO_LONG for huge JSON file #33

Open
mainzelM opened this issue Jul 29, 2021 · 0 comments
Open

ERR_STRING_TOO_LONG for huge JSON file #33

mainzelM opened this issue Jul 29, 2021 · 0 comments

Comments

@mainzelM
Copy link

I did my own crawl with the tracker-radar-collector and tried to apply the detector on the result. This gave me the following error:

Error: Cannot create a string longer than 0x1fffffe8 characters
    at Buffer.utf8Slice (<anonymous>)
    at Object.slice (node:buffer:592:37)
    at Buffer.toString (node:buffer:810:14)
    at readFileHandle (node:internal/fs/promises:371:36)
    at async JSONFileDataReader.iterator (/somewhere/tracker-radar-detector/src/trackers/helpers/readers.js:31:19)
    at async processCrawl (/somewhere/tracker-radar-detector/src/trackers/process-crawl.js:48:26) {
  code: 'ERR_STRING_TOO_LONG'

I added some debug output and guess that the problem is the JSON file created for www.huya.com: it has a size of about 530MB.
Is this a known issue? Do you need more information to reproduce this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant