1
0
mirror of https://github.com/kellyjonbrazil/jc.git synced 2025-06-17 00:07:37 +02:00
Files
jc/docs/parsers/url.md

150 lines
3.4 KiB
Markdown
Raw Normal View History

2022-07-19 13:02:09 -07:00
[Home](https://kellyjonbrazil.github.io/jc/)
<a id="jc.parsers.url"></a>
# jc.parsers.url
jc - JSON Convert URL string parser
2022-07-20 17:09:09 -07:00
This parser will work with naked and wrapped URL strings:
- `scheme://host/path`
- `URL:scheme://host/path`
- `<scheme://host/path>`
- `<URL:scheme://host/path>`
Two query representations are available and documented in the schema.
Normalized quoted and unquoted versions of the original URL are also
included.
2022-07-19 13:02:09 -07:00
Usage (cli):
$ echo "http://example.com/test/path?q1=foo&q2=bar#frag" | jc --url
Usage (module):
import jc
result = jc.parse('url', url_string)
Schema:
{
2022-07-20 17:09:09 -07:00
"quoted": string,
'unquoted": string,
2022-07-19 13:02:09 -07:00
"scheme": string,
"netloc": string,
"path": string or null,
2022-07-20 17:09:09 -07:00
"path_list": [ array or null
string
],
"query": { object or null
<query-key>: [ array or null
<query-value> string # [0]
]
2022-07-19 13:02:09 -07:00
},
2022-07-20 17:09:09 -07:00
"query_list": [ array or null
[
<query-key> string, # [1]
<query-value> string
]
],
2022-07-19 13:02:09 -07:00
"fragment": string or null,
"username": string or null,
"password": string or null,
"hostname": string or null,
"port": integer or null
}
2022-07-20 17:09:09 -07:00
[0] Duplicate query-keys will have their values consolidated into the
array of query-values
[1] The first array value is the query-key and the second value is the
query-value
2022-07-19 13:02:09 -07:00
Examples:
2022-07-20 17:09:09 -07:00
% echo "http://example.com/test/path?q1=foo&q1=bar&q2=baz#frag" \\
| jc --url -p
2022-07-19 13:02:09 -07:00
{
2022-07-20 17:09:09 -07:00
"quoted": "http://example.com/test/path?q1%3Dfoo%26q1%3Dbar%26q2%3Dbaz#frag",
"unquoted": "http://example.com/test/path?q1=foo&q1=bar&q2=baz#frag",
2022-07-19 13:02:09 -07:00
"scheme": "http",
"netloc": "example.com",
"path": "/test/path",
2022-07-20 17:09:09 -07:00
"path_list": [
"test",
"path"
],
2022-07-19 13:02:09 -07:00
"query": {
2022-07-20 17:09:09 -07:00
"q1": [
"foo",
"bar"
],
"q2": [
"baz"
]
2022-07-19 13:02:09 -07:00
},
2022-07-20 17:09:09 -07:00
"query_list": [
[
"q1",
"foo"
],
[
"q1",
"bar"
],
[
"q2",
"baz"
]
],
2022-07-19 13:02:09 -07:00
"fragment": "frag",
"username": null,
"password": null,
"hostname": "example.com",
"port": null
}
$ echo "ftp://localhost/filepath" | jc --url -p
{
2022-07-20 17:09:09 -07:00
"quoted": "ftp://localhost/filepath",
"unquoted": "ftp://localhost/filepath",
2022-07-19 13:02:09 -07:00
"scheme": "ftp",
"netloc": "localhost",
"path": "/filepath",
2022-07-20 17:09:09 -07:00
"path_list": [
"filepath"
],
2022-07-19 13:02:09 -07:00
"query": null,
2022-07-20 17:09:09 -07:00
"query_list": null,
2022-07-19 13:02:09 -07:00
"fragment": null,
"username": null,
"password": null,
"hostname": "localhost",
"port": null
}
<a id="jc.parsers.url.parse"></a>
### parse
```python
def parse(data: str, raw: bool = False, quiet: bool = False) -> Dict
```
Main text parsing function
Parameters:
data: (string) text data to parse
raw: (boolean) unprocessed output if True
quiet: (boolean) suppress warning messages if True
Returns:
Dictionary. Raw or processed structured data.
### Parser Information
Compatibility: linux, darwin, cygwin, win32, aix, freebsd
Version 1.0 by Kelly Brazil (kellyjonbrazil@gmail.com)