hueristiq/xcrawl3r

A command-line tool for recursively spidering webpages for URLs. It works by actively traversing websites, following links embedded in webpages, and parsing files (including sitemaps & robots.txt), to uncover every URL.

语言：Go · GitHub 星标：110 · Fork：8

话题：bug-bounty · bug-bounty-tools · contentdiscovery · crawler · ethical-hacking · ethical-hacking-tools · go · golang

在 GitHub 上查看原仓库