Skip to content

zyznull/spidermanager

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spidermanager

一个python爬虫项目,在scrapy框架下编写了对微博,微信公众号文章,豆瓣小组,知乎专栏,rss订阅源的爬取,并保存到mysql数据库 使用时,通过spidermanager的search输入想要爬取的信息源名称,得到要爬取的连接,通过crawl方法爬取该连接

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages