odie5533/WarcMiddleware

WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.

语言：Python · GitHub 星标：48 · Fork：9

在 GitHub 上查看原仓库