# Web Scraping

The list of tools, programming libraries and APIs used in web-scraping.

* [Python](http://github.com/lorien/web-scraping/blob/master/python.md)
* [PHP](http://github.com/lorien/web-scraping/blob/master/php.md)
* [Ruby](http://github.com/lorien/web-scraping/blob/master/ruby.md)
* [JavaScript](http://github.com/lorien/web-scraping/blob/master/javascript.md)
* [Golang](http://github.com/lorien/web-scraping/blob/master/golang.md)
  * Feel free to add your favourite language. Use [new_language_template.md](http://github.com/lorien/web-scraping/blob/master/new_language_template.md) as start point.
* [Proxy Services](http://github.com/lorien/web-scraping/blob/master/proxy_services.md)
* [Web Services](http://github.com/lorien/web-scraping/blob/master/web_services.md)
* [Console tools](http://github.com/lorien/web-scraping/blob/master/console_tools.md)
* [Books](http://github.com/lorien/web-scraping/blob/master/books.md)

## Other Awesome List Projects
* [lists](https://github.com/jnv/lists) - List of useful, silly and awesome lists curated on GitHub
* [HeadlessBrowsers](https://github.com/dhamaniasad/HeadlessBrowsers) - a list of (almost) all headless web browsers in existence

## Contributing

Make this list better! Your contributions are always welcome! See [contributing how-to](https://github.com/lorien/web-scraping/blob/master/CONTRIBUTING.md)

## Credits
This list partially contains data from these sources:
* [awesome-python](https://github.com/vinta/awesome-python) by [vinta](https://github.com/vinta) / [CC BY 4.0](http://creativecommons.org/licenses/by/4.0/)
* [awesome-php](https://github.com/ziadoz/awesome-php) by [ziadoz](https://github.com/ziadoz)
* [awesome-ruby](https://github.com/markets/awesome-ruby) by [markets](https://github.com/markets)
* [ruby-nlp](https://github.com/diasks2/ruby-nlp) by [diasks2](https://github.com/diasks2)
* [awesome-javascript](https://github.com/sorrycc/awesome-javascript) by [sorrycc](https://github.com/sorrycc)