1
0
mirror of https://github.com/pgbackrest/pgbackrest.git synced 2024-12-16 10:20:02 +02:00
Commit Graph

162 Commits

Author SHA1 Message Date
David Steele
df4b50b977 Restore with base path remap working. 2015-01-22 19:04:55 -05:00
David Steele
82969eb497 Wrote some helper functions to make backup unit tests simpler.
Fixed an issue with checksum generation in resume.
2015-01-22 17:43:19 -05:00
David Steele
b53cb9f64e Unit tests for backup resume.
Improved warning message when a backup cannot be resumed.
2015-01-22 10:54:02 -05:00
David Steele
fc2838d60f All references to old-style manifest eliminated (hopefully). 2015-01-21 18:37:49 -05:00
David Steele
c33bc1e899 More migration to manifest object. 2015-01-20 18:00:03 -05:00
David Steele
92c9ed8963 Added checksum to manifest to detect corruption. 2015-01-20 16:05:15 -05:00
David Steele
84abcd7d61 Minor fixes. 2015-01-11 11:53:03 -05:00
David Steele
131d910906 New structure for --delta and --force params. 2015-01-08 15:43:43 -05:00
David Steele
d6d57e654e Fixed the way wait was done after the manifest is created. Previously, waits were done for base and each tablespace which is not very efficient. Now one wait is done after the entire manifest is built. Also storing the exact time that copy began. 2015-01-06 13:08:56 -05:00
David Steele
43098086af Implemented timestamp last modified to record the time of the last modified file in the backup. Also added timestamp-db-start and timestamp-db-stop to for more info. timestamp-db-start can be used for PITR. 2015-01-03 16:49:26 -05:00
David Steele
91b06bef47 File->manifest detects files that are modified in the future. 2015-01-03 14:22:59 -05:00
David Steele
2449d7384c Wrote a new test to check rsync collisions. 2015-01-03 12:56:44 -05:00
David Steele
2e080eedb8 Added an optional delay after manifest build so that files are not copied in the same second that the manifest is built. This can result in (admittedly unlikely) race conditions that can produce an invalid backup. I was also able to reduce the sleep types when waiting for thread termination - so unit test times are improved by almost 100%. 2015-01-02 14:18:07 -05:00
David Steele
32b37335a1 Trying to find realistic conditions where a file can be changed without the timestamp changing between backups. So far, this is the only case I can make work - it looks like adding a 1 second pause after creation of the manifest would cover this case. 2014-12-31 19:03:03 -05:00
David Steele
59e901684d Working on improved backup/restore unit tests. 2014-12-31 14:59:33 -05:00
David Steele
9f8f33f957 Working on restore options and integration with unit tests. 2014-12-23 18:52:38 -05:00
David Steele
2db71e91ad Basic restore functionality is working. 2014-12-22 11:24:32 -05:00
David Steele
9086728b73 Restore removes paths/files/links and recreated paths/links. 2014-12-21 10:11:17 -05:00
David Steele
1557327d2b Restore cleans out missing files and some basic unit tests. 2014-12-19 17:49:56 +00:00
David Steele
1dc00c9d4b Starting on restore functionality, finally. 2014-12-18 16:42:54 +00:00
David Steele
1a3c5cd9db Added latest link so it is easy to get to the last backup. 2014-12-18 16:14:30 +00:00
David Steele
7d19504d3a Removed some tests in full that were redundant with the tests in backup. 2014-12-18 14:58:07 +00:00
David Steele
6124558347 Moved config functions to a new file. 2014-12-15 22:20:42 +00:00
David Steele
6dd9e881dc Added reminder. 2014-11-27 14:07:09 +00:00
David Steele
602db70d6a More backup unit tests. 2014-10-20 11:44:36 -04:00
David Steele
9765b4e20b Backup unit test - more work on tablespaces and references. 2014-10-19 17:41:11 -04:00
David Steele
66a5da6fd1 More work on backup unit tests - added tablespace tests. 2014-10-19 16:30:16 -04:00
David Steele
4de1d9aa5a Backup unit tests are working. 2014-10-19 11:46:01 -04:00
David Steele
1d43c63326 Working on better backup unit tests. 2014-10-18 13:25:20 -04:00
David Steele
ed5777101f Changes in how paths are removed. 2014-10-16 13:22:34 -04:00
David Steele
b6e0bb2ae5 Small unit test changes. 2014-10-16 08:58:11 -04:00
David Steele
5c216c93d5 Working on backup unit tests. 2014-10-15 19:11:09 -04:00
David Steele
b19dd9b552 Changes to the aborted backups code. 2014-10-14 15:44:50 -04:00
David Steele
3a54eaf9de Last backup type is now checked - still need a unit test for it. 2014-10-14 08:27:50 -04:00
David Steele
2c173ba53e Removed moose from File object. 2014-10-10 15:13:28 -04:00
David Steele
3d86adadb5 Remote object now using ProcessAsync for de/compression.
Removed dependency on Moose from Remote.
2014-10-08 13:54:31 -04:00
David Steele
122dc65351 Added compress and checksum settings to backup manifest. 2014-10-03 09:31:23 -04:00
David Steele
4cbc6c650a File->hash now works on compressed files. 2014-10-02 13:54:26 -04:00
David Steele
991afe3b16 Merge from dev-0.30.
Squashed commit of the following:

commit f3a012eb86702297ac06c9ae7c3da6a2eae41136
Author: David Steele <david@pgmasters.net>
Date:   Wed Oct 1 19:05:57 2014 -0400

    Fixed an issue where archive-get was not returning 1 if the archive directory did not exist.  This happens when it is trying to retrieve archive log 00 and that has not been pushed from the master yet.
2014-10-02 10:55:38 -04:00
David Steele
bdbdaf39d3 Work in progress - new hash method. 2014-09-29 19:08:08 -04:00
David Steele
7ed6587c42 ISSUE-11: Added --no-start-stop and --force options. 2014-09-19 17:51:51 -04:00
David Steele
a5f09caff7 Using ' instead of " where appropriate. 2014-09-18 12:37:14 -04:00
David Steele
3ab81752c0 Using ' instead of " where appropriate. 2014-09-18 11:50:27 -04:00
David Steele
d3238daf7e Using ' instead of " where appropriate. 2014-09-18 11:28:23 -04:00
David Steele
06ad947102 Using ' instead of " where appropriate. 2014-09-16 11:22:55 -04:00
David Steele
4551a2d089 Docs and unit test fix. 2014-09-14 13:12:37 -04:00
David Steele
679005e537 Some cleanup of the diff/incr code. 2014-08-14 09:40:20 -04:00
David Steele
34cb57f925 Using checkpoint command instead of pg_switch_xlog. 2014-08-12 18:36:38 -04:00
David Steele
6b4a8fbc21 Unit tests now working on Ubuntu 12.04 2014-08-10 21:22:17 -04:00
David Steele
0298e8dd16 Created unit tests for files deleted by the db during backup. 2014-08-10 15:02:14 -04:00
David Steele
09e2351ae8 Test log mode is working. 2014-08-09 18:35:55 -04:00
David Steele
2d9f027e3a Cleanup, work on test framework. 2014-07-27 18:13:23 -04:00
David Steele
a849f2d2fd Removed remaining decencies on Config::IniFiles 2014-07-27 14:26:07 -04:00
David Steele
6f4310db42 Changes for testing - finished changing config to local implementation. 2014-07-27 14:03:21 -04:00
David Steele
06b5ee3f75 Working on new config load/save functions and unit tests. 2014-07-16 23:38:38 -04:00
David Steele
f6e01de7ce Improved backup::full unit test. 2014-07-16 20:28:47 -04:00
David Steele
5d39b4f646 Local backups are now completely local. 2014-07-16 20:07:50 -04:00
David Steele
9ad1d79f00 Unit tests for archive-get. 2014-07-16 19:15:56 -04:00
David Steele
9d9dae418b Added archive-put unit tests.
Lots of other unit test improvements.
2014-07-15 22:32:41 -04:00
David Steele
8d398e4bff Starting on archive unit tests. 2014-07-13 10:37:16 -04:00
David Steele
375545320d Added tests for large files (16MB archive log).
Fixed a sync error in binary_xfer().
2014-07-13 09:13:19 -04:00
David Steele
353cdb6b31 Local archiving is working again. 2014-07-12 19:03:39 -04:00
David Steele
e36a785b1b Fixed execute function - now only displays output when there is an error. 2014-07-12 10:26:51 -04:00
David Steele
7f4c4e13d2 Back to Open3. 2014-07-02 19:15:21 -04:00
David Steele
fead7aa5f1 Not loving IPC::Run, but saving my work just in case. 2014-07-02 18:58:38 -04:00
David Steele
d0ca69d433 Integrating IPC::Run - IPC::Open3 is out. 2014-06-30 18:35:05 -04:00
David Steele
934b7dbe9b De/compression is now done in threads instead of forked processes. 2014-06-29 17:23:34 -04:00
David Steele
c85413ec68 Lots of improvements to unit tests. A few bug fixes. 2014-06-29 10:53:39 -04:00
David Steele
f9ec149ffe Working on unit tests. 2014-06-28 14:32:34 -04:00
David Steele
97b9560e5c Fixed binary_xfer() issue. Now seems to work in all cases. 2014-06-28 11:47:21 -04:00
David Steele
e1829bb2d2 First fully working backup in a while. 2014-06-23 18:54:00 -04:00
David Steele
88bbbb4222 Fighting with a relative path issue in archive logging. 2014-06-22 20:19:13 -04:00
David Steele
5d01aac92e Working on backup - mostly working except for the last archive step. 2014-06-22 16:05:00 -04:00
David Steele
f91dce259f Working on backup unit tests. 2014-06-22 14:51:28 -04:00
David Steele
8fff74ccfb Backup unit test able to create and drop clusters. 2014-06-22 11:56:01 -04:00
David Steele
3c748c4b10 More work on unit tests. 2014-06-22 10:54:31 -04:00
David Steele
0b597d8da9 Working on getting backup running again. 2014-06-22 10:30:17 -04:00
David Steele
0dd15dd216 Cleanup. 2014-06-21 20:08:49 -04:00
David Steele
753fa11b5d remove() and hash() now working. 2014-06-21 19:16:55 -04:00
David Steele
7c161be995 manifest() and list() are working. 2014-06-21 18:19:37 -04:00
David Steele
53f1d3c78e path_create() working. 2014-06-21 15:46:26 -04:00
David Steele
7bc464a44b Working on BackRest::File methods. 2014-06-21 15:17:09 -04:00
David Steele
936b8d0db0 move() is working. 2014-06-21 14:19:03 -04:00
David Steele
80206a28e9 Ignore missing source in copy() working. 2014-06-21 12:22:25 -04:00
David Steele
4a113cae66 Better error handling for missing source file in copy(). 2014-06-21 10:05:49 -04:00
David Steele
3af5239800 Various compression options working in copy(). 2014-06-21 08:42:30 -04:00
David Steele
0b3b743f5a Stupid compress issue was in the unit test - but did tighten up the code a bit. 2014-06-15 19:18:26 -04:00
David Steele
d162ce203d Trying to get various compression options working in copy(). 2014-06-15 18:32:43 -04:00
David Steele
adf654edb3 In-stream compression now working in copy. 2014-06-15 15:56:45 -04:00
David Steele
f51c06119c copy() works through multiple runs an multiple remotes. 2014-06-15 09:32:11 -04:00
David Steele
d568b6525b copy() works with remote in either direction. 2014-06-14 20:47:32 -04:00
David Steele
79f85fe6c4 Finally a working copy() with new protocol. 2014-06-14 19:50:54 -04:00
David Steele
3a32363a56 Working on copy. 2014-06-12 21:56:20 -04:00
David Steele
166318d00d Moved remaining libraries and other files. 2014-06-07 16:25:20 -04:00
David Steele
31b05eaab3 Moved pg_backrest_utility. 2014-06-07 16:13:41 -04:00
David Steele
ea1a158d82 Improved logging. 2014-06-07 15:30:13 -04:00
David Steele
e07a6b4e3f Cleaner remote implementation. 2014-06-07 13:15:55 -04:00
David Steele
ae130229ef Working on remote protocol. 2014-06-06 21:16:24 -04:00
David Steele
e44cd6c1ca More paths through copy() working. 2014-06-05 22:42:47 -04:00
David Steele
ca6b435c4f June Hackathon: copy_in and copy_out functions written, some paths through File->copy() working, basic unit tests setup. 2014-06-05 16:40:05 -04:00