David Steele
43d86e64a4
First pass at tests comparing rsync to backrest. Decent results, but room for improvement.
...
All tests local over SSH with rsync default compression, 4 threads and default compression on backrest. Backrest default is gzip = 6, assuming rsync is the same.
On a 1GB DB:
rsync time = 32.82
backrest time = 19.48
backrest is 171% faster.
On a 5GB DB:
rsync time = 171.16
backrest time = 86.97
backrest is 196% faster.
2015-04-07 18:36:59 -04:00
David Steele
3f651a8ce8
Unit tests will now work across all installed versions of Postgres.
...
Created a function to list all supported versions. Now used for all version checking.
2015-04-02 22:07:23 -04:00
David Steele
984fceea67
Moved archive functions from pg_backrest.pl and Backup.pl to Archive.pm.
...
Moved Remote code from pg_backrest.pl to Config.pm.
Added version specific code to regression tests and Db.pm.
archive-push checks for duplicate WAL in the archive.
archive-push reads the db sys id to match up WAL to the correct archive.
2015-04-01 15:58:33 -04:00
David Steele
a998119cba
Various option and unit test fixes.
2015-03-24 18:50:14 -04:00
David Steele
58d6c37f4a
Changed permission to mode in manifest.
2015-03-23 17:17:43 -04:00
David Steele
66c474abe2
A few unit test fixes.
2015-03-23 15:45:25 -04:00
David Steele
882f068254
All config options can now be provided on the command-line.
...
Lots of name changes, but more thought needed there.
Still needs cleanup.
2015-03-12 12:15:19 -04:00
David Steele
7509b01e22
Added format to manifest to identify a manifest/dir structure version.
2015-03-03 21:21:07 -05:00
David Steele
3d0d308a98
Made all warnings FATAL.
...
Fixed one bug that was exposed.
2015-03-03 00:57:20 -05:00
David Steele
7ede058b45
Backup checksums are no longer optional.
2015-02-28 20:31:56 -05:00
David Steele
e524c4dd1a
Timeline unit tests are working.
...
Options from config file are being written to recovery.conf.
Fixed issue with .history files not being picked up by archive-xfer.
2015-01-31 13:48:09 -05:00
David Steele
11c257296a
In the end it was a single non-undefed reference holding up the show. The Backup file should be split into Archive, Backup, Expire, and made into objects. That would cut down on this kind of nastiness.
2015-01-30 20:16:21 -05:00
David Steele
50e015a838
Revert "Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes."
...
This reverts commit e95631f82a
2015-01-30 18:58:49 -05:00
David Steele
e95631f82a
Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes.
2015-01-30 14:55:55 -05:00
David Steele
19e455afc1
Some fixes in unit tests - more needed.
2015-01-28 16:25:38 -05:00
David Steele
e1c5f7f8ed
Now able to check for specific errors in unit tests - as long as they are raised with an error code.
2015-01-23 18:28:39 -05:00
David Steele
a3b3f98f66
Fixed some issues with remote backups after restore (unit test bugs only).
2015-01-22 20:55:16 -05:00
David Steele
21c715b25c
Restore tablespace remaps are working.
2015-01-22 20:11:33 -05:00
David Steele
df4b50b977
Restore with base path remap working.
2015-01-22 19:04:55 -05:00
David Steele
82969eb497
Wrote some helper functions to make backup unit tests simpler.
...
Fixed an issue with checksum generation in resume.
2015-01-22 17:43:19 -05:00
David Steele
b53cb9f64e
Unit tests for backup resume.
...
Improved warning message when a backup cannot be resumed.
2015-01-22 10:54:02 -05:00
David Steele
fc2838d60f
All references to old-style manifest eliminated (hopefully).
2015-01-21 18:37:49 -05:00
David Steele
2449d7384c
Wrote a new test to check rsync collisions.
2015-01-03 12:56:44 -05:00
David Steele
9f8f33f957
Working on restore options and integration with unit tests.
2014-12-23 18:52:38 -05:00
David Steele
9086728b73
Restore removes paths/files/links and recreated paths/links.
2014-12-21 10:11:17 -05:00
David Steele
6124558347
Moved config functions to a new file.
2014-12-15 22:20:42 +00:00
David Steele
602db70d6a
More backup unit tests.
2014-10-20 11:44:36 -04:00
David Steele
66a5da6fd1
More work on backup unit tests - added tablespace tests.
2014-10-19 16:30:16 -04:00
David Steele
1d43c63326
Working on better backup unit tests.
2014-10-18 13:25:20 -04:00
David Steele
ed5777101f
Changes in how paths are removed.
2014-10-16 13:22:34 -04:00
David Steele
5c216c93d5
Working on backup unit tests.
2014-10-15 19:11:09 -04:00
David Steele
3d86adadb5
Remote object now using ProcessAsync for de/compression.
...
Removed dependency on Moose from Remote.
2014-10-08 13:54:31 -04:00
David Steele
991afe3b16
Merge from dev-0.30.
...
Squashed commit of the following:
commit f3a012eb86702297ac06c9ae7c3da6a2eae41136
Author: David Steele <david@pgmasters.net>
Date: Wed Oct 1 19:05:57 2014 -0400
Fixed an issue where archive-get was not returning 1 if the archive directory did not exist. This happens when it is trying to retrieve archive log 00 and that has not been pushed from the master yet.
2014-10-02 10:55:38 -04:00
David Steele
7ed6587c42
ISSUE-11: Added --no-start-stop and --force options.
2014-09-19 17:51:51 -04:00
David Steele
d3238daf7e
Using ' instead of " where appropriate.
2014-09-18 11:28:23 -04:00
David Steele
6b4a8fbc21
Unit tests now working on Ubuntu 12.04
2014-08-10 21:22:17 -04:00
David Steele
0298e8dd16
Created unit tests for files deleted by the db during backup.
2014-08-10 15:02:14 -04:00
David Steele
09e2351ae8
Test log mode is working.
2014-08-09 18:35:55 -04:00
David Steele
2d9f027e3a
Cleanup, work on test framework.
2014-07-27 18:13:23 -04:00
David Steele
a849f2d2fd
Removed remaining decencies on Config::IniFiles
2014-07-27 14:26:07 -04:00
David Steele
6f4310db42
Changes for testing - finished changing config to local implementation.
2014-07-27 14:03:21 -04:00
David Steele
5d39b4f646
Local backups are now completely local.
2014-07-16 20:07:50 -04:00
David Steele
9d9dae418b
Added archive-put unit tests.
...
Lots of other unit test improvements.
2014-07-15 22:32:41 -04:00
David Steele
8d398e4bff
Starting on archive unit tests.
2014-07-13 10:37:16 -04:00
David Steele
375545320d
Added tests for large files (16MB archive log).
...
Fixed a sync error in binary_xfer().
2014-07-13 09:13:19 -04:00
David Steele
353cdb6b31
Local archiving is working again.
2014-07-12 19:03:39 -04:00
David Steele
e36a785b1b
Fixed execute function - now only displays output when there is an error.
2014-07-12 10:26:51 -04:00
David Steele
7f4c4e13d2
Back to Open3.
2014-07-02 19:15:21 -04:00
David Steele
fead7aa5f1
Not loving IPC::Run, but saving my work just in case.
2014-07-02 18:58:38 -04:00
David Steele
d0ca69d433
Integrating IPC::Run - IPC::Open3 is out.
2014-06-30 18:35:05 -04:00
