mirror of https://github.com/lorien/awesome-web-scraping.git synced 2025-02-19 19:00:10 +02:00

Go to file

Merge pull request #42 from vladyslavstartsev/patch-2

Added new HTML parsing library

2017-12-13 16:38:16 +03:00

.gitignore

Initial commit

2015-08-13 02:27:49 +06:00

books.md

Adding Learning Scrapy Book to collection

2017-05-25 15:43:44 -03:00

console_tools.md

Update console_tools.md

2015-08-15 01:15:19 +05:00

CONTRIBUTING.md

New stuff

2015-08-13 02:49:22 +06:00

golang.md

add colly scraper framework

2017-11-15 19:58:47 +01:00

java.md

Added Java language

2017-10-19 13:27:33 -04:00

javascript.md

fix duplicate bracket

2016-08-17 09:38:04 -04:00

LICENSE

Initial commit

2015-08-13 02:27:49 +06:00

Makefile

New stuff

2015-08-13 02:49:22 +06:00

new_language_template.md

Create new_language_template.md

2015-08-21 21:17:28 +05:00

perl.md

add more packages to list by copy from github.com/avelino/awesome-go

2017-05-16 00:42:40 +08:00

php.md

Added new HTML parsing library

2017-10-08 01:13:38 +03:00

proxy_services.md

Update proxy_services.md

2016-11-17 22:37:01 +03:00

python.md

Add selectolax

2017-12-02 19:48:49 +03:00

README.md

Update README.md

2017-09-04 01:23:36 +03:00

ruby.md

Indentation fixes in ruby.md

2017-04-28 18:54:28 +03:00

web_services.md

Merge pull request #22 from barrycarton/patch-2

2016-11-03 02:11:56 +03:00

README.md

Web Scraping

The list of tools, programming libraries and APIs used in web-scraping.

Python
PHP
Ruby
JavaScript
Golang
- Feel free to add your favourite language. Use new_language_template.md as start point.
Proxy Services
Web Services
Console tools
Books

Other Awesome List Projects

lists - List of useful, silly and awesome lists curated on GitHub
HeadlessBrowsers - a list of (almost) all headless web browsers in existence

Contributing

Make this list better! Your contributions are always welcome! See contributing how-to

Credits

This list partially contains data from these sources: