mirror of
https://github.com/lorien/awesome-web-scraping.git
synced 2024-11-24 08:32:19 +02:00
List of libraries, tools and APIs for web scraping and data processing.
captcha-bypasscaptcha-recaptchacrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolscrapingscraping-frameworkscraping-pythonscraping-toolspiderweb-scrapingwebscraping
.gitignore | ||
console_tools.md | ||
CONTRIBUTING.md | ||
LICENSE | ||
Makefile | ||
php.md | ||
python.md | ||
README.md | ||
ruby.md | ||
web_services.md |
Web Scraping
The list of tools, programming libraries and APIs used in web-scraping.
- Python
- PHP
- Ruby
- Feel free to add your favourite language. You can use already existing language as template.
- Web Services
- Console tools
Other Awesome List Projects
- lists - List of useful, silly and awesome lists curated on GitHub
- HeadlessBrowsers - a list of (almost) all headless web browsers in existence
Contributing
Make this list better! Your contributions are always welcome! See contributing how-to
Credits
This list partially contains data from these sources:
- awesome-python by vinta / CC BY 4.0
- awesome-php by ziadoz
- awesome-ruby by markets
- ruby-nlp by diasks2