Allow downloading more content from a webpage and index it #215 #265
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Extracted out functions to silently delete assets and to update them after crawling Generalized the mapping of assets to bookmark fields to make extending them easier
Introduced an enum to have better type safety cleaned up the code and based some code on the type directly
…p#215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation
…p#215 Rebased onto master replaced redis queue with new db queue fixed some async/await issues
kamtschatka
force-pushed
the
more-content
branch
from
ce70a43 to
1a5f1bd
Compare
…p#215 fixed additional async/await issues
|
declining for now, to add a state to the database and allow recrawling from the admin page |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added a worker that allows downloading videos depending on the environment variables
refactored the code a bit
added new video asset
updated documentation
Depends on #256