Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Site Bug] 8chan.moe pulls from the Disclaimer page #5868

Closed
Donny-Pandairaz opened this issue Jul 19, 2024 · 1 comment
Closed

[Site Bug] 8chan.moe pulls from the Disclaimer page #5868

Donny-Pandairaz opened this issue Jul 19, 2024 · 1 comment

Comments

@Donny-Pandairaz
Copy link

Donny-Pandairaz commented Jul 19, 2024

[gallery-dl][debug] Starting DownloadJob for 'https://8chan.moe/v/res/986377.html'
[8chan][debug] Using _8chanThreadExtractor for 'https://8chan.moe/v/res/986377.html'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): 8chan.moe:443
[urllib3.connectionpool][debug] https://8chan.moe:443 "GET /v/res/986377.json HTTP/11" 302 0
[urllib3.connectionpool][debug] https://8chan.moe:443 "GET /.static/pages/disclaimer.html HTTP/11" 200 1701
[8chan][error] Unable to download data:  JSONDecodeError: Expecting value: line 1 column 1 (char 0)
[8chan][debug]
Traceback (most recent call last):
  File "requests\models.py", line 971, in json
  File "json\__init__.py", line 346, in loads
  File "json\decoder.py", line 337, in decode
  File "json\decoder.py", line 355, in raw_decode
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "gallery_dl\job.py", line 151, in run
  File "gallery_dl\extractor\8chan.py", line 73, in items
  File "requests\models.py", line 975, in json
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

It would appear that 8chan.moe links are getting cockblocked by the disclaimer, or at least it is part of the problem. Link in example is SFW. Tested using the generic extractor and it always downloads the logo.png explicitly from the Disclaimer page and nothing else.

@mikf
Copy link
Owner

mikf commented Jul 19, 2024

Seems like the TOS cookie name changed. It is now TOS20240718. Not sure if this new name is static or if its date changes each day. I'll wait until tomorrow before committing a fix.

For now, -o cookies.TOS20240718=\"1\" should make it work again.
(\" are necessary and might need to be ^" in cmd.exe)

mikf added a commit that referenced this issue Jul 20, 2024
@mikf mikf closed this as completed Jul 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants