awesome/awesome-web-scraping
1
0
Fork 0
mirror of https://github.com/lorien/awesome-web-scraping.git synced 2025-01-20 02:59:55 +02:00
Code Issues Releases Activity

Update console_tools.md

Browse Source
This commit is contained in:
Gregory Petukhov 2015-08-15 01:15:19 +05:00
parent 377427d3bd
commit 6128881be0
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
console_tools.md
View File

@ -2,6 +2,15 @@
Console tools related to web scraping and data processing
* [Console Tools](#console-tools)
* [HTTP Clients](#http-clients)
* [Specific Formats Processing](#specific-formats-processing)
## HTTP Clients
* [curl](https://github.com/bagder/curl) - supports SSL certificates, HTTP POST, HTTP PUT, FTP uploading, HTTP form based upload, proxies, HTTP/2, cookies, user+password authentication (Basic, Plain, Digest, CRAM-MD5, NTLM, Negotiate and Kerberos), file transfer resume, proxy tunneling and more.
* [httpie](https://github.com/jkbrzt/httpie) - sending arbitrary HTTP requests using a simple and natural syntax, and displays colorized output. HTTPie can be used for testing, debugging, and generally interacting with HTTP servers.
* [wget](http://www.gnu.org/software/wget/) - package for retrieving files using HTTP, HTTPS and FTP, the most widely-used Internet protocols. It is a non-interactive commandline tool, so it may easily be called from scripts, cron jobs, terminals without X-Windows support, etc.
## Specific Formats Processing
* Office