awesome-web-scraping/README.md

# Awesome Web Scraping

The list of tools, programming libraries and web services used for web scraping and data processing.

Feel free to give feedback or ask web scraping questions in Telegram groups:  [@grablab](https://t.me/grablab) (English) and [@grablab_ru](https://t.me/grablab_ru) (Russian).

## Programming Libraries

* [Python](https://github.com/lorien/web-scraping/blob/master/python.md)
* [PHP](https://github.com/lorien/web-scraping/blob/master/php.md)
* [Ruby](https://github.com/lorien/web-scraping/blob/master/ruby.md)
* [JavaScript](https://github.com/lorien/web-scraping/blob/master/javascript.md)
* [Go](https://github.com/lorien/web-scraping/blob/master/golang.md)

## Other Things

* [Learning Web Scraping](https://github.com/lorien/learning-web-scraping) - list of articles and books teaching web scraping
* [Web Scraping Services](https://github.com/lorien/web-scraping/blob/master/web_services.md)
* [Console tools](https://github.com/lorien/web-scraping/blob/master/console_tools.md)
* [dhamaniasad / HeadlessBrowsers](https://github.com/dhamaniasad/HeadlessBrowsers) - a list of (almost) all headless web browsers in existence
* [DNS over HTTPS providers](https://github.com/curl/curl/wiki/DNS-over-HTTPS) - list of DNS over HTTPs providers

## Captcha Solving Services

These two links point to same captcha service, it is just a different language versions

* [2captcha.com](https://2captcha.com/?from=3019071) - English UI language
* [rucaptcha.com](https://rucaptcha.com/?from=3019071) - Russian UI language

## Contributing

See [Contributing](https://github.com/lorien/web-scraping/blob/master/CONTRIBUTING.md) document.

## Credits

The list is based initially on some data from these sources [awesome-python](https://github.com/vinta/awesome-python), [awesome-php](https://github.com/ziadoz/awesome-php), [awesome-ruby](https://github.com/markets/awesome-ruby), [ruby-nlp](https://github.com/diasks2/ruby-nlp), [awesome-javascript](https://github.com/sorrycc/awesome-javascript)
Update README.md 2022-11-14 17:50:01 +02:00			`# Awesome Web Scraping`
Update README.md 2017-03-21 18:19:25 +02:00
Update README.md 2022-11-14 17:48:33 +02:00			`The list of tools, programming libraries and web services used for web scraping and data processing.`
Update README.md 2020-05-12 23:42:55 +02:00
Update README.md 2022-12-31 15:49:13 +02:00			`Feel free to give feedback or ask web scraping questions in Telegram groups: [@grablab](https://t.me/grablab) (English) and [@grablab_ru](https://t.me/grablab_ru) (Russian).`

Update front page 2019-11-22 03:34:56 +02:00			`## Programming Libraries`
Initial commit 2015-08-12 22:27:49 +02:00
Update README.md 2022-12-28 15:52:45 +02:00			`* [Python](https://github.com/lorien/web-scraping/blob/master/python.md)`
			`* [PHP](https://github.com/lorien/web-scraping/blob/master/php.md)`
			`* [Ruby](https://github.com/lorien/web-scraping/blob/master/ruby.md)`
			`* [JavaScript](https://github.com/lorien/web-scraping/blob/master/javascript.md)`
			`* [Go](https://github.com/lorien/web-scraping/blob/master/golang.md)`
Update front page 2019-11-22 03:34:56 +02:00
			`## Other Things`
Update README.md 2019-06-21 12:17:30 +02:00
Update README.md 2022-12-28 15:52:45 +02:00			`* [Learning Web Scraping](https://github.com/lorien/learning-web-scraping) - list of articles and books teaching web scraping`
			`* [Web Scraping Services](https://github.com/lorien/web-scraping/blob/master/web_services.md)`
			`* [Console tools](https://github.com/lorien/web-scraping/blob/master/console_tools.md)`
Update README.md 2020-05-12 23:40:38 +02:00			`* [dhamaniasad / HeadlessBrowsers](https://github.com/dhamaniasad/HeadlessBrowsers) - a list of (almost) all headless web browsers in existence`
add dns over https providers list 2020-06-28 12:05:07 +02:00			`* [DNS over HTTPS providers](https://github.com/curl/curl/wiki/DNS-over-HTTPS) - list of DNS over HTTPs providers`
Update README.md 2019-11-23 22:17:11 +02:00
Update README.md 2020-05-12 23:41:45 +02:00			`## Captcha Solving Services`

Update README.md 2021-05-10 15:38:55 +02:00			`These two links point to same captcha service, it is just a different language versions`
Update README.md 2021-05-10 15:37:37 +02:00
			`* [2captcha.com](https://2captcha.com/?from=3019071) - English UI language`
			`* [rucaptcha.com](https://rucaptcha.com/?from=3019071) - Russian UI language`
Update README.md 2020-05-12 23:41:45 +02:00
Update README.md 2020-09-11 19:40:30 +02:00			`## Contributing`
New stuff 2015-08-12 22:49:22 +02:00
Update README.md 2020-09-11 19:42:12 +02:00			`See [Contributing](https://github.com/lorien/web-scraping/blob/master/CONTRIBUTING.md) document.`
Update README.md 2020-09-11 19:40:30 +02:00
			`## Credits`
Update front page 2019-11-22 03:34:56 +02:00
Update README.md 2019-11-23 22:15:31 +02:00			`The list is based initially on some data from these sources [awesome-python](https://github.com/vinta/awesome-python), [awesome-php](https://github.com/ziadoz/awesome-php), [awesome-ruby](https://github.com/markets/awesome-ruby), [ruby-nlp](https://github.com/diasks2/ruby-nlp), [awesome-javascript](https://github.com/sorrycc/awesome-javascript)`