postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

语言：Ruby · GitHub 星标：836 · Fork：104

话题：crawler · ruby · scraper · spider · spider-links · web · web-crawler · web-scraper

在 GitHub 上查看原仓库