1
0
mirror of https://github.com/lorien/awesome-web-scraping.git synced 2024-11-24 08:32:19 +02:00
List of libraries, tools and APIs for web scraping and data processing.
Go to file
Gregory Petukhov d64da3145f
Merge pull request #49 from andriyor/master
Update mechanize URL
2018-04-03 03:45:34 +03:00
.gitignore Initial commit 2015-08-13 02:27:49 +06:00
books.md Adding Learning Scrapy Book to collection 2017-05-25 15:43:44 -03:00
console_tools.md Update console_tools.md 2015-08-15 01:15:19 +05:00
CONTRIBUTING.md New stuff 2015-08-13 02:49:22 +06:00
golang.md add colly scraper framework 2017-11-15 19:58:47 +01:00
java.md Added Java language 2017-10-19 13:27:33 -04:00
javascript.md Fix CSS parse categogy 2017-09-25 17:05:26 +03:00
LICENSE Initial commit 2015-08-13 02:27:49 +06:00
Makefile New stuff 2015-08-13 02:49:22 +06:00
new_language_template.md Create new_language_template.md 2015-08-21 21:17:28 +05:00
perl.md add more packages to list by copy from github.com/avelino/awesome-go 2017-05-16 00:42:40 +08:00
php.md Added new HTML parsing library 2017-10-08 01:13:38 +03:00
proxy_services.md Update proxy_services.md 2016-11-17 22:37:01 +03:00
python.md Add requests-html 2018-03-26 16:50:31 +03:00
README.md Update README.md 2017-09-04 01:23:36 +03:00
ruby.md Add Spidr 2018-01-07 13:46:21 +01:00
web_services.md Add more Web Services 2018-01-28 13:57:45 +00:00

Web Scraping

The list of tools, programming libraries and APIs used in web-scraping.

Other Awesome List Projects

  • lists - List of useful, silly and awesome lists curated on GitHub
  • HeadlessBrowsers - a list of (almost) all headless web browsers in existence

Contributing

Make this list better! Your contributions are always welcome! See contributing how-to

Credits

This list partially contains data from these sources: