Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indexer/visitor pattern for data utils #296

Closed
michael-conway opened this issue Apr 16, 2018 · 3 comments
Closed

Indexer/visitor pattern for data utils #296

michael-conway opened this issue Apr 16, 2018 · 3 comments
Assignees

Comments

@michael-conway
Copy link
Collaborator

Update data utils to create a visitor based framework to build indexers off of..

  • represent a directory from current back up to parent
  • cache metadata at each level to allow rollups
  • respect a 'noindex' or other signal for stopping a search (e.g. add a pluggable no-robots detector)
  • allow cache of metadata at each level
@michael-conway michael-conway self-assigned this Apr 16, 2018
@michael-conway
Copy link
Collaborator Author

This will remove deprecated visitor stuff in data utils...

@michael-conway
Copy link
Collaborator Author

michael-conway added a commit that referenced this issue Apr 26, 2018
michael-conway added a commit that referenced this issue Apr 26, 2018
michael-conway added a commit that referenced this issue Apr 30, 2018
michael-conway added a commit that referenced this issue Apr 30, 2018
michael-conway added a commit that referenced this issue Apr 30, 2018
michael-conway added a commit that referenced this issue May 2, 2018
michael-conway added a commit that referenced this issue May 2, 2018
michael-conway added a commit that referenced this issue May 2, 2018
michael-conway added a commit that referenced this issue May 2, 2018
pateldes pushed a commit that referenced this issue May 3, 2018
pateldes pushed a commit that referenced this issue May 7, 2018
@michael-conway
Copy link
Collaborator Author

Initial impl done...

michael-conway added a commit that referenced this issue May 29, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant