Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to just crawl images using this package? #52

Open
FritzAgency opened this issue Mar 24, 2018 · 1 comment
Open

Is it possible to just crawl images using this package? #52

FritzAgency opened this issue Mar 24, 2018 · 1 comment

Comments

@FritzAgency
Copy link

Was wondering if it is possible to crawl the web for just images using this package. If possible, please how?

@amoilanen
Copy link
Owner

amoilanen commented Mar 26, 2018

Unfortunately now there is no special API for getting image urls from a given page and during crawling binary content such as images will be omitted by the crawler, instead a placeholder '<<...binary content (omitted by js-crawler)...>>' will be included into the response instead of the actual content.

In the future it might make sense to provide a special flag to crawl/report in the callbacks only binary content such as images. This will be a new feature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants