David Steele
5fd4f3bd5b
Improvements to log testing.
...
Replaced tokens are now numbered to give a more accurate rendition of the logs.
Some formatting improvements.
2015-05-29 14:39:43 -04:00
David Steele
3083e5fc7e
Fix for issue #83 : Provide more helpful error message during archive-stop situations.
...
Fix for issue #84 : archive-async in combination with archive-max-mb doesn't work as documented.
Unit tests for archive stop.
2015-05-28 13:17:34 -04:00
David Steele
ca0c866d3b
Implement issue #71 : log a message when waiting for a checkpoint
...
Some other log improvements
2015-05-26 12:26:59 -04:00
David Steele
5c43e7035a
Implement issue #79 : Support comment characters in config file
2015-05-26 11:36:03 -04:00
David Steele
d5335b40e8
Fix for issue #80 : enabling archive-copy causes failing differential & incremental backups
2015-05-22 14:49:14 -04:00
David Steele
a0d985b7ad
Fixed an issue where an absolute path was not written into recovery.conf when the restore was run with a relative path.
2015-05-07 17:37:25 -05:00
David Steele
328c2ca5c0
Much better resume:
...
1) Re-checksums files that have checksums in the manifest
2) Recopies files that do not have a checksum
3) Saves the manifest at regular intervals to preserve checksums
4) Unit tests for all cases (that I can think of)
2015-05-06 18:24:34 -06:00
David Steele
56588f6fdd
Log testing can now be enabled for certain deterministic tests. This works by comparing the generated logs against a previous copy. Currently only enabled for the backup/synthetic tests.
2015-05-05 11:08:48 -06:00
David Steele
43d86e64a4
First pass at tests comparing rsync to backrest. Decent results, but room for improvement.
...
All tests local over SSH with rsync default compression, 4 threads and default compression on backrest. Backrest default is gzip = 6, assuming rsync is the same.
On a 1GB DB:
rsync time = 32.82
backrest time = 19.48
backrest is 171% faster.
On a 5GB DB:
rsync time = 171.16
backrest time = 86.97
backrest is 196% faster.
2015-04-07 18:36:59 -04:00
David Steele
3f651a8ce8
Unit tests will now work across all installed versions of Postgres.
...
Created a function to list all supported versions. Now used for all version checking.
2015-04-02 22:07:23 -04:00
David Steele
984fceea67
Moved archive functions from pg_backrest.pl and Backup.pl to Archive.pm.
...
Moved Remote code from pg_backrest.pl to Config.pm.
Added version specific code to regression tests and Db.pm.
archive-push checks for duplicate WAL in the archive.
archive-push reads the db sys id to match up WAL to the correct archive.
2015-04-01 15:58:33 -04:00
David Steele
a998119cba
Various option and unit test fixes.
2015-03-24 18:50:14 -04:00
David Steele
58d6c37f4a
Changed permission to mode in manifest.
2015-03-23 17:17:43 -04:00
David Steele
66c474abe2
A few unit test fixes.
2015-03-23 15:45:25 -04:00
David Steele
882f068254
All config options can now be provided on the command-line.
...
Lots of name changes, but more thought needed there.
Still needs cleanup.
2015-03-12 12:15:19 -04:00
David Steele
7509b01e22
Added format to manifest to identify a manifest/dir structure version.
2015-03-03 21:21:07 -05:00
David Steele
3d0d308a98
Made all warnings FATAL.
...
Fixed one bug that was exposed.
2015-03-03 00:57:20 -05:00
David Steele
7ede058b45
Backup checksums are no longer optional.
2015-02-28 20:31:56 -05:00
David Steele
e524c4dd1a
Timeline unit tests are working.
...
Options from config file are being written to recovery.conf.
Fixed issue with .history files not being picked up by archive-xfer.
2015-01-31 13:48:09 -05:00
David Steele
11c257296a
In the end it was a single non-undefed reference holding up the show. The Backup file should be split into Archive, Backup, Expire, and made into objects. That would cut down on this kind of nastiness.
2015-01-30 20:16:21 -05:00
David Steele
50e015a838
Revert "Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes."
...
This reverts commit e95631f82a
.
2015-01-30 18:58:49 -05:00
David Steele
e95631f82a
Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes.
2015-01-30 14:55:55 -05:00
David Steele
19e455afc1
Some fixes in unit tests - more needed.
2015-01-28 16:25:38 -05:00
David Steele
e1c5f7f8ed
Now able to check for specific errors in unit tests - as long as they are raised with an error code.
2015-01-23 18:28:39 -05:00
David Steele
a3b3f98f66
Fixed some issues with remote backups after restore (unit test bugs only).
2015-01-22 20:55:16 -05:00
David Steele
21c715b25c
Restore tablespace remaps are working.
2015-01-22 20:11:33 -05:00
David Steele
df4b50b977
Restore with base path remap working.
2015-01-22 19:04:55 -05:00
David Steele
82969eb497
Wrote some helper functions to make backup unit tests simpler.
...
Fixed an issue with checksum generation in resume.
2015-01-22 17:43:19 -05:00
David Steele
b53cb9f64e
Unit tests for backup resume.
...
Improved warning message when a backup cannot be resumed.
2015-01-22 10:54:02 -05:00
David Steele
fc2838d60f
All references to old-style manifest eliminated (hopefully).
2015-01-21 18:37:49 -05:00
David Steele
2449d7384c
Wrote a new test to check rsync collisions.
2015-01-03 12:56:44 -05:00
David Steele
9f8f33f957
Working on restore options and integration with unit tests.
2014-12-23 18:52:38 -05:00
David Steele
9086728b73
Restore removes paths/files/links and recreated paths/links.
2014-12-21 10:11:17 -05:00
David Steele
6124558347
Moved config functions to a new file.
2014-12-15 22:20:42 +00:00
David Steele
602db70d6a
More backup unit tests.
2014-10-20 11:44:36 -04:00
David Steele
66a5da6fd1
More work on backup unit tests - added tablespace tests.
2014-10-19 16:30:16 -04:00
David Steele
1d43c63326
Working on better backup unit tests.
2014-10-18 13:25:20 -04:00
David Steele
ed5777101f
Changes in how paths are removed.
2014-10-16 13:22:34 -04:00
David Steele
5c216c93d5
Working on backup unit tests.
2014-10-15 19:11:09 -04:00
David Steele
3d86adadb5
Remote object now using ProcessAsync for de/compression.
...
Removed dependency on Moose from Remote.
2014-10-08 13:54:31 -04:00
David Steele
991afe3b16
Merge from dev-0.30.
...
Squashed commit of the following:
commit f3a012eb86702297ac06c9ae7c3da6a2eae41136
Author: David Steele <david@pgmasters.net>
Date: Wed Oct 1 19:05:57 2014 -0400
Fixed an issue where archive-get was not returning 1 if the archive directory did not exist. This happens when it is trying to retrieve archive log 00 and that has not been pushed from the master yet.
2014-10-02 10:55:38 -04:00
David Steele
7ed6587c42
ISSUE-11: Added --no-start-stop and --force options.
2014-09-19 17:51:51 -04:00
David Steele
d3238daf7e
Using ' instead of " where appropriate.
2014-09-18 11:28:23 -04:00
David Steele
6b4a8fbc21
Unit tests now working on Ubuntu 12.04
2014-08-10 21:22:17 -04:00
David Steele
0298e8dd16
Created unit tests for files deleted by the db during backup.
2014-08-10 15:02:14 -04:00
David Steele
09e2351ae8
Test log mode is working.
2014-08-09 18:35:55 -04:00
David Steele
2d9f027e3a
Cleanup, work on test framework.
2014-07-27 18:13:23 -04:00
David Steele
a849f2d2fd
Removed remaining decencies on Config::IniFiles
2014-07-27 14:26:07 -04:00
David Steele
6f4310db42
Changes for testing - finished changing config to local implementation.
2014-07-27 14:03:21 -04:00
David Steele
5d39b4f646
Local backups are now completely local.
2014-07-16 20:07:50 -04:00