1
0
mirror of https://github.com/lorien/awesome-web-scraping.git synced 2025-02-17 13:40:53 +02:00

Add Spidr

This commit is contained in:
m.b 2018-01-07 13:46:21 +01:00 committed by GitHub
parent b31f06d9f0
commit bed8724f69
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -47,6 +47,7 @@ This list contains ruby libraries related to web scraping and data processing
* [upton](https://github.com/propublica/upton) - A batteries-included framework for easy web-scraping
* [Wombat](https://github.com/felipecsl/wombat) - Web scraper with an elegant DSL that parses structured data from web pages.
* [Anemone](https://github.com/chriskite/anemone) - web spider framework that can spider a domain and collect useful information about the pages it visits
* [Spidr](https://github.com/postmodern/spidr) - versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
## HTML/XML Parsing