# Awesome Web Scraping

The list of tools, programming libraries and web services used in web scraping and data processing.

Web scraping chats: [@grablab](https://t.me/grablab) (English) and [@grablab_ru](https://t.me/grablab_ru) (Russian)

## Programming Libraries

* [Python](http://github.com/lorien/web-scraping/blob/master/python.md)
* [PHP](http://github.com/lorien/web-scraping/blob/master/php.md)
* [Ruby](http://github.com/lorien/web-scraping/blob/master/ruby.md)
* [JavaScript](http://github.com/lorien/web-scraping/blob/master/javascript.md)
* [Go](http://github.com/lorien/web-scraping/blob/master/golang.md)

## Other Things

* [Web Scraping Services](http://github.com/lorien/web-scraping/blob/master/web_services.md)
* [Console tools](http://github.com/lorien/web-scraping/blob/master/console_tools.md)
* [dhamaniasad / HeadlessBrowsers](https://github.com/dhamaniasad/HeadlessBrowsers) - a list of (almost) all headless web browsers in existence
* [DNS over HTTPS providers](https://github.com/curl/curl/wiki/DNS-over-HTTPS) - list of DNS over HTTPs providers

## Captcha Solving Services

* [2captcha.com](https://2captcha.com/?from=3019071) - 2captcha.com
* [anti-gate.com](http://getcaptchasolution.com/ijykrofoxz) - anti-gate.com

## Contributing

See [Contributing](https://github.com/lorien/web-scraping/blob/master/CONTRIBUTING.md) document.

## Credits

The list is based initially on some data from these sources [awesome-python](https://github.com/vinta/awesome-python), [awesome-php](https://github.com/ziadoz/awesome-php), [awesome-ruby](https://github.com/markets/awesome-ruby), [ruby-nlp](https://github.com/diasks2/ruby-nlp), [awesome-javascript](https://github.com/sorrycc/awesome-javascript)