Skip to content

Issues: amoilanen/js-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 25 Closed
21 Open 25 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Link crawling gets stuck in Wordpress sites
#61 opened May 11, 2020 by sandysh
Crawler completes then cancels the output of "crawledUrls"?
#60 opened May 4, 2020 by sbr2567
Crawler stopped without reason and any error
#59 opened Apr 16, 2020 by rafaelwdornelas
1
Crawler stopped without reason and any error
#58 opened Sep 8, 2019 by pittersnider
How to deal with basic auth?
#57 opened Aug 26, 2019 by pittersnider
1
Crawler is not a function
#56 opened Feb 14, 2019 by atomixstar
3
freeze and defrost for saving and resuming a big crawl? enhancement enhancement
#55 opened Sep 20, 2018 by Shane-Neeley
5
Is it possible to just crawl images using this package? enhancement question
#52 opened Mar 24, 2018 by FritzAgency
1
knownUrls processing logic is incorrectly using underscore bug question
#50 opened Jan 2, 2018 by Nysosis
@amoilanen
3
Pair js-crawler with PhantomJS question
#49 opened Aug 9, 2017 by Tynael
@amoilanen
1
How to deal with ETIMEDOUT error and pending forever? bug question
#47 opened May 5, 2017 by fanzijian
@amoilanen
5
How to deal with shortened URLs question
#45 opened Apr 14, 2017 by lukasIO
@amoilanen
3
Follow redirects question
#44 opened Apr 7, 2017 by roccomuso
@amoilanen
1
robots.txt enhancement
#43 opened Feb 22, 2017 by Muneem
@amoilanen
1
stop crawling enhancement question
#42 opened Feb 20, 2017 by Muneem
@amoilanen
5
Evaluate selectors enhancement question
#34 opened Jan 29, 2017 by BrunoQuaresma
@amoilanen
3
Can we promisfy js-crawler enhancement question
#27 opened Aug 9, 2016 by shekarls
@amoilanen
2
How to assign encoding of response content? question
#26 opened Aug 4, 2016 by winglight
@amoilanen
6
Getting every type of url from the page source enhancement question
#25 opened Jul 20, 2016 by shekarls
@amoilanen
1
Feature to crawl up to a limited number of pages enhancement
#22 opened Mar 30, 2016 by ArielAleksandrus
@amoilanen
1
Would be awesome to apply a selector to limit scope of crawled links enhancement
#15 opened Oct 31, 2015 by duggi
@amoilanen
1
ProTip! Follow long discussions with comments:>50.