casual-silva/NewsCrawl

狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑 an enterprise-grade public opinion news crawler project: supports one-click operation of any number of crawlers, scheduled crawler tasks, batch deletion of crawlers; one-click deployment of crawlers

语言：Python · GitHub 星标：690 · Fork：159

话题：apscheduler · docker · python · scrapy · scrapy-crawler · scrapyd · scrapydweb · script

在 GitHub 上查看原仓库