mirror of
https://github.com/lorien/awesome-web-scraping.git
synced 2024-11-24 08:32:19 +02:00
List of libraries, tools and APIs for web scraping and data processing.
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
.gitignore | ||
console_tools.md | ||
CONTRIBUTING.md | ||
LICENSE | ||
Makefile | ||
php.md | ||
python.md | ||
README.md | ||
ruby.md | ||
web_services.md |
Web Scraping
The list of tools, programming libraries and APIs used in web-scraping.
Programming languages
- Python
- PHP
- Ruby
- Feel free to add list for your favourite language. You can use already existing language as template.
Other stuff
Contributing
Make this list better! Your contributions are always welcome! See contributing how-to
List of lists
- lists - List of useful, silly and awesome lists curated on GitHub
Credits
This list partially contains data from these sources:
- awesome-python by vinta / CC BY 4.0
- awesome-php by ziadoz
- awesome-ruby by markets
- ruby-nlp by diasks2