-
-
Notifications
You must be signed in to change notification settings - Fork 416
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding a spider for AP Macapá #254
Conversation
I opted to perform one request per day, since lots of the entries on the website do not carry a date specification anywhere on the HTML body. I also noticed that the URL path (which includes a date) is not always a good representation for the actual date for that gazette. This will result in much more requests, but it's the way I found to assure that dates will be consistent, and no results will be skipped due to the lack of a date. See my comment on #217 |
320eec0
to
7c9e1bf
Compare
Sorry! I unwillingly closed this trying to rebase my branch. Reopened. |
This is my proposed solution for #180.
I know @rennerocha commented on that issue, PR #217 is already under review for this spider, but by the time I saw that comment, the code was already written, so I figured I should submit it anyway. At least I can get some comments and learn something.