Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Google Scholar: Add delays between consecutive network requests. #3043

Merged
merged 22 commits into from
Sep 23, 2023
Merged

Google Scholar: Add delays between consecutive network requests. #3043

Changes from 20 commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
e3a259a
Google Scholar: Add delays between consecutive network requests.
zoe-translates Jun 4, 2023
70f7a49
Google Scholar: Better emulation of page navigation.
zoe-translates Jun 5, 2023
e2427e5
Google Scholar: Further add delays between requests; refactors.
zoe-translates Jun 5, 2023
0168955
Google Scholar: [Minor] Revert the change from `==` to `===`.
zoe-translates Jun 5, 2023
e5b17ba
Google Scholar: Further emulation of in-browser navigation.
zoe-translates Jun 6, 2023
4af6a9e
Google Scholar: [Minor] Add explanation about single-item scraping.
zoe-translates Jun 7, 2023
86ffc32
Google Scholar: Use external services (DOI and ArXiv API) when possible.
zoe-translates Jun 12, 2023
abaedc0
Google Scholar: Concurrency and error-handling improvements.
zoe-translates Jun 13, 2023
2ce126a
Google Scholar: [Minor] Update test case for Article View page.
zoe-translates Jun 13, 2023
fadb5e1
Google Scholar: [Minor] Properly encode space character in referrer.
zoe-translates Jun 13, 2023
e2db733
Google Scholar: Ensure that URL is added to the translated item.
zoe-translates Jun 14, 2023
d59b297
Google Scholar: Make the return value of pipeline work function consi…
zoe-translates Jun 14, 2023
4cabcb7
Google Scholar: Minor pattern-matching fixes for external identifiers.
zoe-translates Jun 14, 2023
86eab41
Google Scholar: Add attachments for items saved by DOI search.
zoe-translates Jun 14, 2023
e3ed00f
Google Scholar: Multiple stylistic fixes.
zoe-translates Jun 15, 2023
b02acb3
Google Scholar: Adjustments to attachment-saving
zoe-translates Jun 27, 2023
eff689d
Google Scholar: More accurate name for saved article
zoe-translates Jun 30, 2023
39a342a
Google Scholar: Add slash (/) as a possible file-extension separator
zoe-translates Jun 30, 2023
694d778
Google Scholar: Create pipeline job-completion synchronization method.
zoe-translates Jul 3, 2023
0cd720c
Google Scholar: Code readability fixes
zoe-translates Jul 5, 2023
47957c8
[WIP] Google Scholar: Convert the code to a more approachable style
zoe-translates Jul 11, 2023
504c50e
Google Scholar: Some concurrency improvements.
zoe-translates Jul 11, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading