Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle "if_page_contains" for "next_page_link" #193

Merged
merged 1 commit into from
Jan 22, 2019

Conversation

j0k3r
Copy link
Owner

@j0k3r j0k3r commented Jan 22, 2019

single_page_link has priority over next_page_link when both are defined the site config file and if_page_contains rules are defined.

Problem appear when you want to fetch the homepage of rollingstone.com for example (yeah bad idea anyway). The source contains the next_page_link defined in the site config. But as graby doesn't handle if_page_contains for next_page_link it started to fetch endlessly all pages from rollingstone homepage. Gasp.

Following #190

`single_page_link` has priority over `next_page_link` when both are defined the site config file and `if_page_contains` rules are defined.
@coveralls
Copy link

Coverage Status

Coverage increased (+0.01%) to 97.764% when pulling 1b271a4 on feature/page-contains-next-page-link into 802d22d on master.

@j0k3r j0k3r merged commit c9e85d2 into master Jan 22, 2019
@j0k3r j0k3r deleted the feature/page-contains-next-page-link branch January 22, 2019 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants