一个python爬虫项目,在scrapy框架下编写了对微博,微信公众号文章,豆瓣小组,知乎专栏,rss订阅源的爬取,并保存到mysql数据库 使用时,通过spidermanager的search输入想要爬取的信息源名称,得到要爬取的连接,通过crawl方法爬取该连接
-
Notifications
You must be signed in to change notification settings - Fork 0
zyznull/spidermanager
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published