mirror of
https://github.com/rclone/rclone.git
synced 2025-01-13 20:38:12 +02:00
azureblob: raise --azureblob-upload-concurrency to 16 by default
After speed testing it was discovered that upload speed goes up pretty much linearly with upload concurrency. This patch changes the default from 4 to 16 which means that rclone will use 16 * 4M = 64M per transfer which is OK even for low memory devices. This adds a note that performance may be increased by increasing upload concurrency. See: https://forum.rclone.org/t/performance-of-rclone-vs-azcopy/27437/9
This commit is contained in:
parent
fbc4c4ad9a
commit
df07964db3
@ -157,7 +157,7 @@ raise this to 64. Note that this will use more memory.
|
|||||||
Note that chunks are stored in memory and there may be up to
|
Note that chunks are stored in memory and there may be up to
|
||||||
"--transfers" * "--azureblob-upload-concurrency" chunks stored at once
|
"--transfers" * "--azureblob-upload-concurrency" chunks stored at once
|
||||||
in memory.`,
|
in memory.`,
|
||||||
Default: 4,
|
Default: 16,
|
||||||
Advanced: true,
|
Advanced: true,
|
||||||
}, {
|
}, {
|
||||||
Name: "list_chunk",
|
Name: "list_chunk",
|
||||||
|
@ -81,6 +81,14 @@ key. It is stored using RFC3339 Format time with nanosecond
|
|||||||
precision. The metadata is supplied during directory listings so
|
precision. The metadata is supplied during directory listings so
|
||||||
there is no overhead to using it.
|
there is no overhead to using it.
|
||||||
|
|
||||||
|
### Performance
|
||||||
|
|
||||||
|
When uploading large files, increasing the value of
|
||||||
|
`--azureblob-upload-concurrency` will increase performance at the cost
|
||||||
|
of using more memory. The default of 16 is set quite conservatively to
|
||||||
|
use less memory. It maybe be necessary raise it to 64 or higher to
|
||||||
|
fully utilize a 1 GBit/s link with a single file transfer.
|
||||||
|
|
||||||
### Restricted filename characters
|
### Restricted filename characters
|
||||||
|
|
||||||
In addition to the [default restricted characters set](/overview/#restricted-characters)
|
In addition to the [default restricted characters set](/overview/#restricted-characters)
|
||||||
|
Loading…
Reference in New Issue
Block a user