db/pgbackrest
1
0
Fork 0
mirror of https://github.com/pgbackrest/pgbackrest.git synced 2024-12-14 10:13:05 +02:00
Code Issues Releases Activity
2a9ba877e1
pgbackrest/test/expect/archive-stop-005.log

271 lines
36 KiB
Plaintext
Raw Normal View History

Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
run 005 - rmt 1, cmp 1, error version
=====================================
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
stanza-create db - create required data for stanza (backup host)
> [CONTAINER-EXEC] backup [BACKREST-BIN] --config=[TEST_PATH]/backup/pgbackrest.conf --stanza=db --log-level-console=detail --no-online stanza-create
------------------------------------------------------------------------------------------------------------------------------------
P00 INFO: stanza-create command begin [BACKREST-VERSION]: --config=[TEST_PATH]/backup/pgbackrest.conf --db-cmd=[BACKREST-BIN] --db-config=[TEST_PATH]/db-master/pgbackrest.conf --db-host=db-master --db-path=[TEST_PATH]/db-master/db/base --db-user=[USER-1] --lock-path=[TEST_PATH]/backup/repo/lock --log-level-console=detail --log-level-file=trace --log-path=[TEST_PATH]/backup/repo/log --no-online --repo-path=[TEST_PATH]/backup/repo --stanza=db
P00 INFO: stanza-create command end: completed successfully
+ supplemental file: [TEST_PATH]/backup/repo/backup/db/backup.info
------------------------------------------------------------------
[backrest]
backrest-checksum="[CHECKSUM]"
backrest-format=5
backrest-version="[VERSION-1]"
[db]
db-catalog-version=201409291
db-control-version=942
db-id=1
db-system-id=6353949018581704918
db-version="9.4"
[db:history]
1={"db-catalog-version":201409291,"db-control-version":942,"db-system-id":6353949018581704918,"db-version":"9.4"}
+ supplemental file: [TEST_PATH]/backup/repo/archive/db/archive.info
--------------------------------------------------------------------
[backrest]
backrest-checksum="[CHECKSUM]"
backrest-format=5
backrest-version="[VERSION-1]"
[db]
db-id=1
db-system-id=6353949018581704918
db-version="9.4"
[db:history]
1={"db-id":6353949018581704918,"db-version":"9.4"}
Rename test paths for clarity. This was worked out as part of the test suite refactor [c8f806a] but not committed with it because of the large number of expect logs changes involved. Keeping them separate made it easier to audit the changes in the refactor.
2016-06-24 16:54:31 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db archive-push [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000001
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --spool-path=[TEST_PATH]/db-master/spool --stanza=db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: push WAL segment [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000001 asynchronously
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->push(): bAsync = true, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000001
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/db-master/spool, strStanza = db
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = false, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 000000010000000100000001, strDestinationPathType = backup:archive:out, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000001, strSourcePathType = db:absolute, strUser = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockAcquire(): bFailOnNoLock = false, bRemote = <false>, iProcessIdx = [undef], strLockType = archive-push
P00 DEBUG: Common::Lock::lockAcquire=>: bResult = true
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->process: no fork on archive local for TESTING
P00 DEBUG: Archive::ArchivePush->process: start async archive-push
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = backup
P00 DEBUG: Protocol::Protocol::protocolGet: create (cached) remote protocol
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 DEBUG: Protocol::RemoteMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = [BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote, strCommandSSH = ssh, strHost = backup, strRemoteType = backup, strUser = [USER-2]
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = ssh -o LogLevel=error -o Compression=no -o PasswordAuthentication=no backrest@backup '[BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote', strId = backup, strName = remote, strRemoteType = backup
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: WAL segments to archive: total = 1, size = 16MB
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: bArchiveFile = true, bDestinationCompress = true, bSourceCompressed = false, strFile = 000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strWalSegment = 000000010000000100000001, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck=>: strArchiveId = 9.4-1, strChecksum = [undef]
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = true, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 9.4-1/000000010000000100000001.gz, strDestinationPathType = backup:archive, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strSourcePathType = db:absolute, strUser = [undef]
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer=>: lFileTotal = 1
P00 DEBUG: Archive::ArchivePush->process: transferred 1 WAL segment, calling Archive->xfer() again
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: no WAL segments to archive
P00 DEBUG: Archive::ArchivePush->process: transfer found 0 WAL segments - exiting
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = <true>
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = 0, oException = [undef], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = true, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy: found cached protocol: iRemoteIdx = 1, strRemoteType = backup
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->close=>: iExitStatus = 0
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: completed successfully
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 0
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
Rename test paths for clarity. This was worked out as part of the test suite refactor [c8f806a] but not committed with it because of the large number of expect logs changes involved. Keeping them separate made it easier to audit the changes in the refactor.
2016-06-24 16:54:31 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db archive-push [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000002
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --spool-path=[TEST_PATH]/db-master/spool --stanza=db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: push WAL segment [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000002 asynchronously
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->push(): bAsync = true, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000002
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/db-master/spool, strStanza = db
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = false, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 000000010000000100000002, strDestinationPathType = backup:archive:out, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000002, strSourcePathType = db:absolute, strUser = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockAcquire(): bFailOnNoLock = false, bRemote = <false>, iProcessIdx = [undef], strLockType = archive-push
P00 DEBUG: Common::Lock::lockAcquire=>: bResult = true
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->process: no fork on archive local for TESTING
P00 DEBUG: Archive::ArchivePush->process: start async archive-push
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = backup
P00 DEBUG: Protocol::Protocol::protocolGet: create (cached) remote protocol
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 DEBUG: Protocol::RemoteMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = [BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote, strCommandSSH = ssh, strHost = backup, strRemoteType = backup, strUser = [USER-2]
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = ssh -o LogLevel=error -o Compression=no -o PasswordAuthentication=no backrest@backup '[BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote', strId = backup, strName = remote, strRemoteType = backup
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: WAL segments to archive: total = 1, size = 16MB
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: bArchiveFile = true, bDestinationCompress = true, bSourceCompressed = false, strFile = 000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strWalSegment = 000000010000000100000002, ullDbSysId = 6353949018581704918
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
P00 ERROR: [119]: raised on backup host: WAL segment version 9.4 does not match archive version 8.0
Change spacing in expect logs to accommodate DETAIL level.
2016-04-14 00:55:34 +02:00
HINT: are you archiving to the correct stanza?
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = [undef], oException = [object], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = false, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy: found cached protocol: iRemoteIdx = 1, strRemoteType = backup
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->close=>: iExitStatus = 0
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: aborted with exception [119]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 119
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
Rename test paths for clarity. This was worked out as part of the test suite refactor [c8f806a] but not committed with it because of the large number of expect logs changes involved. Keeping them separate made it easier to audit the changes in the refactor.
2016-06-24 16:54:31 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db archive-push [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000003
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --spool-path=[TEST_PATH]/db-master/spool --stanza=db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: push WAL segment [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000003 asynchronously
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->push(): bAsync = true, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000003
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/db-master/spool, strStanza = db
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = false, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 000000010000000100000003, strDestinationPathType = backup:archive:out, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000003, strSourcePathType = db:absolute, strUser = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockAcquire(): bFailOnNoLock = false, bRemote = <false>, iProcessIdx = [undef], strLockType = archive-push
P00 DEBUG: Common::Lock::lockAcquire=>: bResult = true
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->process: no fork on archive local for TESTING
P00 DEBUG: Archive::ArchivePush->process: start async archive-push
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = backup
P00 DEBUG: Protocol::Protocol::protocolGet: create (cached) remote protocol
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 DEBUG: Protocol::RemoteMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = [BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote, strCommandSSH = ssh, strHost = backup, strRemoteType = backup, strUser = [USER-2]
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = ssh -o LogLevel=error -o Compression=no -o PasswordAuthentication=no backrest@backup '[BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote', strId = backup, strName = remote, strRemoteType = backup
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 INFO: WAL segments to archive: total = 2, size = 32MB
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: bArchiveFile = true, bDestinationCompress = true, bSourceCompressed = false, strFile = 000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strWalSegment = 000000010000000100000002, ullDbSysId = 6353949018581704918
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
P00 ERROR: [119]: raised on backup host: WAL segment version 9.4 does not match archive version 8.0
Change spacing in expect logs to accommodate DETAIL level.
2016-04-14 00:55:34 +02:00
HINT: are you archiving to the correct stanza?
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 ERROR: [199]: local archive queue has exceeded limit of 24MB - WAL segments will be discarded until the stop file ([TEST_PATH]/db-master/spool/stop/db-archive.stop) is removed
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = [undef], oException = [object], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = false, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy: found cached protocol: iRemoteIdx = 1, strRemoteType = backup
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->close=>: iExitStatus = 0
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: aborted with exception [119]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 119
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
Rename test paths for clarity. This was worked out as part of the test suite refactor [c8f806a] but not committed with it because of the large number of expect logs changes involved. Keeping them separate made it easier to audit the changes in the refactor.
2016-06-24 16:54:31 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db archive-push [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000004
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --spool-path=[TEST_PATH]/db-master/spool --stanza=db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 ERROR: [199]: discarding 000000010000000100000004 due to the archive store max size exceeded - remove the archive stop file ([TEST_PATH]/db-master/spool/stop/db-archive.stop) to resume archiving and be sure to take a new backup as soon as possible
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = 0, oException = [undef], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = true, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: completed successfully
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 0
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
> ls -1R [TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001
Fix for issue #83: Provide more helpful error message during archive-stop situations. Fix for issue #84: archive-async in combination with archive-max-mb doesn't work as documented. Unit tests for archive stop.
2015-05-28 19:17:34 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
[TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001:
000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db --no-archive-async archive-push [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --no-archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --stanza=db
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
P00 INFO: push WAL segment [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->push(): bAsync = false, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = backup
P00 DEBUG: Protocol::Protocol::protocolGet: create (cached) remote protocol
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 DEBUG: Protocol::RemoteMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = [BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote, strCommandSSH = ssh, strHost = backup, strRemoteType = backup, strUser = [USER-2]
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = ssh -o LogLevel=error -o Compression=no -o PasswordAuthentication=no backrest@backup '[BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote', strId = backup, strName = remote, strRemoteType = backup
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005, strWalSegment = 000000010000000100000005, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck=>: strArchiveId = 9.4-1, strChecksum = [undef]
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = true, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 9.4-1/000000010000000100000005.gz, strDestinationPathType = backup:archive, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/db/base/pg_xlog/000000010000000100000005, strSourcePathType = db:absolute, strUser = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = 0, oException = [undef], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = true, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy: found cached protocol: iRemoteIdx = 1, strRemoteType = backup
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->close=>: iExitStatus = 0
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: completed successfully
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 0
Implement issue #90: Move archive-max-mb archive-stop checks to end of archive-push.
2015-05-29 17:41:19 +02:00
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
> ls -1R [TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
[TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001:
000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
000000010000000100000005-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
> [CONTAINER-EXEC] db-master [BACKREST-BIN] --config=[TEST_PATH]/db-master/pgbackrest.conf --archive-max-mb=24 --no-fork --stanza=db archive-push
Implement issue #90: Move archive-max-mb archive-stop checks to end of archive-push.
2015-05-29 17:41:19 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 INFO: archive-push command begin [BACKREST-VERSION]: --archive-async --archive-max-mb=24 --backup-cmd=[BACKREST-BIN] --backup-config=[TEST_PATH]/backup/pgbackrest.conf --backup-host=backup --backup-user=[USER-2] --config=[TEST_PATH]/db-master/pgbackrest.conf --db-path=[TEST_PATH]/db-master/db/base --no-fork --lock-path=[TEST_PATH]/db-master/spool/lock --log-level-console=debug --log-level-file=trace --log-level-stderr=off --log-path=[TEST_PATH]/db-master/spool/log --repo-path=[TEST_PATH]/backup/repo --spool-path=[TEST_PATH]/db-master/spool --stanza=db
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockAcquire(): bFailOnNoLock = false, bRemote = <false>, iProcessIdx = [undef], strLockType = archive-push
P00 DEBUG: Common::Lock::lockAcquire=>: bResult = true
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->process: start async archive-push
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = backup
P00 DEBUG: Protocol::Protocol::protocolGet: create (cached) remote protocol
Improved stanza-create command so that it can repair broken repositories in most cases and is robust enough to be made mandatory. Contributed by Cynthia Shang.
2016-12-20 23:52:20 +02:00
P00 DEBUG: Protocol::RemoteMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = [BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote, strCommandSSH = ssh, strHost = backup, strRemoteType = backup, strUser = [USER-2]
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->new(): iBufferMax = 4194304, iCompressLevel = 6, iCompressLevelNetwork = 3, iProtocolTimeout = 1830, strCommand = ssh -o LogLevel=error -o Compression=no -o PasswordAuthentication=no backrest@backup '[BACKREST-BIN] --buffer-size=4194304 --command=archive-push --compress-level=6 --compress-level-network=3 --config=[TEST_PATH]/backup/pgbackrest.conf --protocol-timeout=1830 --repo-path=[TEST_PATH]/backup/repo --stanza=db --type=backup remote', strId = backup, strName = remote, strRemoteType = backup
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
P00 INFO: WAL segments to archive: total = 2, size = 32MB
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: bArchiveFile = true, bDestinationCompress = true, bSourceCompressed = false, strFile = 000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strWalSegment = 000000010000000100000002, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck=>: strArchiveId = 9.4-1, strChecksum = [undef]
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = true, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 9.4-1/000000010000000100000002.gz, strDestinationPathType = backup:archive, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strSourcePathType = db:absolute, strUser = [undef]
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: bArchiveFile = true, bDestinationCompress = true, bSourceCompressed = false, strFile = 000000010000000100000003-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo(): strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000003-72b9da071c13957fb4ca31f05dbd5c644297c2f7
P00 DEBUG: Archive::ArchivePush->walInfo=>: strDbVersion = 9.4, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck(): bPartial = false, oFile = [object], strDbVersion = 9.4, strWalFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000003-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strWalSegment = 000000010000000100000003, ullDbSysId = 6353949018581704918
P00 DEBUG: Archive::ArchivePush->pushCheck=>: strArchiveId = 9.4-1, strChecksum = [undef]
File copy protocol now accepts a function that can do additional processing on the copy buffers and return a result to the calling process.
2016-12-13 01:47:17 +02:00
P00 DEBUG: File->copy(): bAppendChecksum = true, bDestinationCompress = true, bDestinationPathCreate = true, bIgnoreMissingSource = <false>, bPathSync = true, bSourceCompressed = false, lModificationTime = [undef], strDestinationFile = 9.4-1/000000010000000100000003.gz, strDestinationPathType = backup:archive, strExtraFunction = [undef], strGroup = [undef], strMode = <0640>, strSourceFile = [TEST_PATH]/db-master/spool/archive/db/out/000000010000000100000003-72b9da071c13957fb4ca31f05dbd5c644297c2f7, strSourcePathType = db:absolute, strUser = [undef]
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer=>: lFileTotal = 2
P00 DEBUG: Archive::ArchivePush->process: transferred 2 WAL segments, calling Archive->xfer() again
P00 DEBUG: Archive::ArchivePush->xfer(): strArchivePath = [TEST_PATH]/db-master/spool/archive/db/out, strStopFile = [TEST_PATH]/db-master/spool/stop/db-archive.stop
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolGet(): iRemoteIdx = <1>, oParam = [undef], strRemoteType = none
P00 DEBUG: Protocol::Protocol::protocolGet: create local protocol
Refactor File module to improve test coverage.
2016-12-23 15:30:34 +02:00
P00 DEBUG: File->new(): oProtocol = [object], strDefaultFileMode = <0640>, strDefaultPathMode = <0750>, strRepoPath = [TEST_PATH]/backup/repo, strStanza = db
Simplified the result hash of File->manifest(), Db->tablespaceMapGet(), and Db->databaseMapGet().
2016-11-30 21:36:39 +02:00
P00 DEBUG: File->manifest(): strPath = [TEST_PATH]/db-master/spool/archive/db/out, strPathType = db:absolute
Split the archive-get and archive-push commands into separate modules.
2017-01-11 02:59:32 +02:00
P00 DEBUG: Archive::ArchivePush->xfer: no WAL segments to archive
P00 DEBUG: Archive::ArchivePush->process: transfer found 0 WAL segments - exiting
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = <true>
P00 DEBUG: Common::Exit::exitSafe(): iExitCode = 0, oException = [undef], strSignal = [undef]
Fixed timeout issues. * Fixed an issue where local processes were not disconnecting when complete and could later timeout. (Reported by Todd Vernick.) * Fixed an issue where the protocol layer could timeout while waiting for WAL segments to arrive in the archive. (Reported by Todd Vernick.)
2016-09-14 23:37:07 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy(): bComplete = true, iRemoteIdx = [undef], strRemoteType = [undef]
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy: found cached protocol: iRemoteIdx = 1, strRemoteType = backup
Refactor process IO and process master/minion code out from the common protocol code.
2017-01-27 17:06:16 +02:00
P00 DEBUG: Protocol::CommandMaster->close=>: iExitStatus = 0
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Protocol::Protocol::protocolDestroy=>: iExitStatus = 0
P00 DEBUG: Common::Lock::lockRelease(): bFailOnNoLock = false
Added a predictable log entry to signal that a command has completed successfully. For example a backup ends successfully with: INFO: backup command end: completed successfully.
2016-12-04 21:44:53 +02:00
P00 INFO: archive-push command end: completed successfully
Show Process ID in log output instead of filtering it out with the timestamp.
2016-09-14 23:30:57 +02:00
P00 DEBUG: Common::Exit::exitSafe=>: iExitCode = 0
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
> ls -1R [TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001
Fixed an issue where asynchronous archiving was transferring one file per execution instead of transferring files in batches. This regression was introduced in v1.09 and affected efficiency only, all WAL segments were correctly archived in asynchronous mode. Reported by Stephen Frost.
2016-11-17 16:39:21 +02:00
------------------------------------------------------------------------------------------------------------------------------------
Update control and wal test files to 9.4 with matching system identifiers. Contributed by Cynthia Shang.
2016-12-01 16:33:14 +02:00
[TEST_PATH]/backup/repo/archive/db/9.4-1/0000000100000001:
000000010000000100000001-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
000000010000000100000002-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
000000010000000100000003-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
000000010000000100000005-72b9da071c13957fb4ca31f05dbd5c644297c2f7.gz
Reference in New Issue Copy Permalink