go/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2025-01-24 12:56:36 +02:00
Code Issues Releases Activity
rclone/fs
History
Nick Craig-Wood a5700a4a53 operations: rework rcat so that it doesn't call the --metadata-mapper twice 
The --metadata-mapper was being called twice for files that rclone
needed to stream to disk,

This happened only for:
- files bigger than --upload-streaming-cutoff
- on backends which didn't support PutStream

This also meant that these were being logged as two transfers which
was a little strange.

This fixes the problem by not using operations.Copy to upload the file
once it has been streamed to disk, instead using the Put method on the
backend.

This should have no effect on reliability of the transfers as we retry
Put if possible.

This also tidies up the Rcat function to make the different ways of
uploading the data clearer and make it easy to see that it gets
verified on all those paths.

See #7848
2024-05-20 18:16:54 +01:00
..
accounting
build: fix linting issues reported by golangci-lint on windows
2024-04-22 19:29:12 +02:00
asyncreader
Replace deprecated ioutil
2022-11-07 11:41:47 +00:00
cache
fs/cache: add PutErr to add an fs.Fs with an fs.ErrorIsFile error to the cache
2024-02-29 16:21:41 +00:00
chunkedreader
build: add package comments to silence revive linter
2022-08-28 13:43:51 +02:00
chunksize
azureblob,b2,s3: fix chunksize calculations producing too many parts
2022-08-09 12:57:38 +01:00
config
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
dirtree
dirtree: fix performance with large directories of directories and --fast-list
2023-07-03 14:09:21 +01:00
driveletter
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
filter
fs: add more detailed logging for file includes/excludes
2024-01-22 16:46:26 +00:00
fserrors
build: fix linting issues reported by running golangci-lint with different GOOS
2024-04-22 19:29:12 +02:00
fshttp
fs/fshttp: fix --contimeout being ignored
2023-11-24 17:53:33 +00:00
fspath
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
hash
hash: allow runtime configuration of supported hashes for testing
2023-11-24 11:19:58 +00:00
list
fs: allow Metadata calls to be called with Directory or Object
2024-02-27 10:56:19 +00:00
log
log: fix lint issue SA1019: syscall.Syscall has been deprecated since Go 1.18: Use SyscallN instead.
2024-04-22 19:29:12 +02:00
logger
build: fix linting issues reported by running golangci-lint with different GOOS
2024-04-22 19:29:12 +02:00
march
march: Fix excessive parallelism when using --no-traverse
2023-11-20 17:36:31 +00:00
object
operations: ensure SrcFsType is set correctly when using --metadata-mapper
2024-05-20 18:16:54 +01:00
operations
operations: rework rcat so that it doesn't call the --metadata-mapper twice
2024-05-20 18:16:54 +01:00
rc
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
sync
sync: remove now superfluous copyEmptyDirectories function
2024-05-03 12:29:18 +01:00
walk
fs: add more detailed logging for file includes/excludes
2024-01-22 16:46:26 +00:00
backend_config_test.go
fs: add --all to rclone config create/update to ask all the config questions #3455
2021-05-14 14:07:44 +01:00
backend_config.go
fs: fix typos found by codespell
2023-03-25 12:51:04 +01:00
bits_test.go
fs: add IsSet convenience method to Bits
2023-10-23 15:43:42 +01:00
bits.go
fs: fix docs for Bits
2023-10-23 15:43:55 +01:00
bwtimetable_test.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
bwtimetable.go
build: reformat comments to pass go1.19 vet
2022-08-05 16:35:41 +01:00
config_list_test.go
fs: fix tests for *SepList
2018-08-21 10:58:59 +01:00
config_list.go
Make flags show up with their proper names, eg SizeSuffix rather than int
2019-02-07 11:57:26 +00:00
config_test.go
build: add lint ignore comment required for golangci-staticcheck in addition to stand-alone staticcheck
2023-03-26 14:28:15 +02:00
config.go
fs: Implement --no-update-dir-modtime to disable setting modification times on dirs
2024-03-07 17:20:24 +00:00
configmap.go
config: fix in memory config not saving on the fly backend config
2021-07-20 12:09:38 +01:00
countsuffix_test.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
countsuffix.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
cutoffmode_test.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
cutoffmode.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
daemon_other.go
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
daemon_unix.go
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
deletemode.go
Break the fs package up into smaller parts.
2018-01-15 17:51:14 +00:00
dir_wrapper.go
combine: fix CopyDirMetadata error on upstream root
2024-03-07 11:09:07 +00:00
dir.go
fs: allow Metadata calls to be called with Directory or Object
2024-02-27 10:56:19 +00:00
direntries_test.go
build: fix up package paths after repo move
2019-07-28 18:47:38 +01:00
direntries.go
fs: Allow sync of a file and a directory with the same name
2019-06-09 15:57:05 +01:00
dump_test.go
fs: re-implement DumpMode with Bits
2023-10-03 15:24:09 +01:00
dump.go
fs: implement --metadata-mapper to transform metatadata with a user supplied program
2023-11-18 17:49:35 +00:00
enum_test.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
enum.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
features.go
fs: add Directory Metadata flags for backends and interfaces
2024-02-27 10:56:19 +00:00
fingerprint_test.go
mockfs: make it so it can be registered as an Fs
2023-04-28 14:31:05 +01:00
fingerprint.go
fs: add Fingerprint to detect changes in an object
2020-06-30 12:01:36 +01:00
fs_test.go
rclone config redacted: implement support mechanism for showing redacted config
2023-07-07 16:25:14 +01:00
fs.go
sync: update docs and error messages to reflect fixes to overlap checks
2022-07-13 16:04:53 +01:00
log_test.go
fs: fix a typo in a comment
2023-11-16 17:15:00 +00:00
log.go
onedrive: fix --metadata-mapper called twice if writing permissions
2024-04-02 14:57:43 +01:00
metadata_mapper_code.go
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
metadata_test.go
fs: implement --metadata-mapper to transform metatadata with a user supplied program
2023-11-18 17:49:35 +00:00
metadata.go
fs: allow Metadata calls to be called with Directory or Object
2024-02-27 10:56:19 +00:00
mimetype.go
fs: allow Metadata calls to be called with Directory or Object
2024-02-27 10:56:19 +00:00
mount_helper_test.go
rclone.mount: ignore _netdev mount argument - FIxes #5808
2022-05-12 20:27:13 +01:00
mount_helper.go
build: reformat comments to pass go1.19 vet
2022-08-05 16:35:41 +01:00
newfs_test.go
mount: fix mount failure on macOS with on the fly remote
2023-06-23 14:12:03 +01:00
newfs.go
mount: fix mount failure on macOS with on the fly remote
2023-06-23 14:12:03 +01:00
open_options_test.go
fs: add --metadata-set flag to specify metadata for uploads
2022-06-29 14:29:36 +01:00
open_options.go
fs: add MetadataAsOpenOptions
2024-03-07 14:44:45 +00:00
override_dir_test.go
fs: add OverrideDirectory for overriding path of directory
2023-05-14 11:22:57 +01:00
override_dir.go
fs: add OverrideDirectory for overriding path of directory
2023-05-14 11:22:57 +01:00
override_test.go
fs: move operations.NewOverrideRemote to fs.NewOverrideRemote
2022-11-21 08:02:09 +00:00
override.go
fs: when creating new fs.OverrideRemotes don't layer overrides if not needed
2023-05-09 16:28:10 +01:00
pacer.go
pacer: fix b2 deadlock by defaulting max connections to unlimited
2023-10-01 12:30:26 +01:00
parseduration_test.go
fs: improve JSON Unmarshalling for Duration
2024-03-13 18:08:59 +00:00
parseduration.go
fs: improve JSON Unmarshalling for Duration
2024-03-13 18:08:59 +00:00
parsetime_test.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
parsetime.go
rc: fix output of Time values in options/get
2023-05-04 15:04:11 +01:00
registry.go
config: add ending period on description option help text
2024-03-29 17:11:21 +01:00
sizesuffix_test.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
sizesuffix.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
terminalcolormode_test.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
terminalcolormode.go
fs: re-implement CutoffMode, LogLevel, TerminalColorMode with Enum
2023-10-03 15:14:24 +01:00
tristate_test.go
fs: fix option types printing incorrectly for backend flags
2023-10-03 11:23:58 +01:00
tristate.go
fs: fix tristate conversion to JSON
2023-03-27 16:17:49 +01:00
types.go
fs: define the optional interface SetMetadata and implement it in wrapping backends
2024-05-14 12:51:03 +01:00
version.go
Configurable version suffix independent of version number
2022-05-17 12:10:01 +01:00
versioncheck.go
build: remove build constraint syntax for go 1.16 and older
2024-04-18 16:53:55 +02:00
versionsuffix.go
Configurable version suffix independent of version number
2022-05-17 12:10:01 +01:00
versiontag.go
Start v1.67.0-DEV development
2024-03-10 12:14:00 +00:00