psq/spider

Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.

语言：Ruby · GitHub 星标：27 · Fork：8

在 GitHub 上查看原仓库