Nick Craig-Wood 0427177857 azureblob: implement OpenChunkWriter and multi-thread uploads #7056 ...

This implements the OpenChunkWriter interface for azureblob which
enables multi-thread uploads.

This makes the memory controls of the s3 backend inoperative; they are
replaced with the global ones.

    --azureblob-memory-pool-flush-time
    --azureblob-memory-pool-use-mmap

By using the buffered reader this fixes excessive memory use when
uploading large files as it will share memory pages between all
readers.

2023-08-24 12:39:27 +01:00

944 B

Raw Blame History

View Raw