1
0
mirror of https://github.com/lorien/awesome-web-scraping.git synced 2024-11-24 08:32:19 +02:00
List of libraries, tools and APIs for web scraping and data processing.
Go to file
2018-09-05 15:02:54 +03:00
.gitignore Initial commit 2015-08-13 02:27:49 +06:00
books.md Update book.md 2018-08-05 10:29:42 +02:00
console_tools.md Update console_tools.md 2015-08-15 01:15:19 +05:00
CONTRIBUTING.md New stuff 2015-08-13 02:49:22 +06:00
golang.md add colly scraper framework 2017-11-15 19:58:47 +01:00
java.md Added Java language 2017-10-19 13:27:33 -04:00
javascript.md Add puppeteer to Browser automation tools 2018-04-06 13:46:11 +03:00
LICENSE Initial commit 2015-08-13 02:27:49 +06:00
Makefile New stuff 2015-08-13 02:49:22 +06:00
new_language_template.md Create new_language_template.md 2015-08-21 21:17:28 +05:00
perl.md add more packages to list by copy from github.com/avelino/awesome-go 2017-05-16 00:42:40 +08:00
php.md Added new HTML parsing library 2017-10-08 01:13:38 +03:00
proxy_services.md Update proxy_services.md 2018-07-16 22:38:34 +03:00
python.md Update python.md 2018-09-05 15:02:54 +03:00
README.md Update README.md 2017-09-04 01:23:36 +03:00
ruby.md Add Spidr 2018-01-07 13:46:21 +01:00
web_services.md Adds ProxyCrawl 2018-07-16 19:12:25 +02:00

Web Scraping

The list of tools, programming libraries and APIs used in web-scraping.

Other Awesome List Projects

  • lists - List of useful, silly and awesome lists curated on GitHub
  • HeadlessBrowsers - a list of (almost) all headless web browsers in existence

Contributing

Make this list better! Your contributions are always welcome! See contributing how-to

Credits

This list partially contains data from these sources: