ArchiveTeam/wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

语言：C · GitHub 星标：139 · Fork：19

话题：archiveteam · archiving · crawl · crawler · crawlers · crawling · downloader · ftp

在 GitHub 上查看原仓库