heartfly/ajax_crawler

A flexible web crawler based on Scrapy for fetching most of Ajax or other various types of web pages. Easy to use: To customize a new web crawler-You just need to write a config file and run.

语言：Python · GitHub 星标：44 · Fork：13

在 GitHub 上查看原仓库