Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid duplicated records from cross-set fetching #215

Merged
merged 2 commits into from
Jan 23, 2018

Conversation

david-caro
Copy link
Contributor

@david-caro david-caro commented Jan 23, 2018

We fetch set-by-set to allow per-set 'last harvest', so you can
harvest individual sets from the last time that set was harvested,
as opposed to the last time any set was.

  • I have all the information that I need (if not, move to RFC and look for it).
  • I linked the related issue(s) in the corresponding commit logs.
  • I wrote good commit log messages.
  • My code follows the code style of this project.
  • I've added any new docs if API/utils methods were added.
  • I have updated the existing documentation accordingly.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@ghost ghost assigned david-caro Jan 23, 2018
@ghost ghost added in progress labels Jan 23, 2018
@david-caro david-caro force-pushed the fetch_all_sets_together branch from 2a27e1f to cb85cc8 Compare January 23, 2018 20:22
@david-caro david-caro merged commit 25a441b into inspirehep:master Jan 23, 2018
@david-caro david-caro deleted the fetch_all_sets_together branch January 23, 2018 20:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant