David Steele
df4b50b977
Restore with base path remap working.
2015-01-22 19:04:55 -05:00
David Steele
82969eb497
Wrote some helper functions to make backup unit tests simpler.
...
Fixed an issue with checksum generation in resume.
2015-01-22 17:43:19 -05:00
David Steele
b53cb9f64e
Unit tests for backup resume.
...
Improved warning message when a backup cannot be resumed.
2015-01-22 10:54:02 -05:00
David Steele
fc2838d60f
All references to old-style manifest eliminated (hopefully).
2015-01-21 18:37:49 -05:00
David Steele
ade9ad78b4
Allow file keys to be validated on remove.
2015-01-21 13:57:58 -05:00
David Steele
ba7a939798
More migration to manifest object.
2015-01-21 10:44:08 -05:00
David Steele
a938813c01
More migration to manifest object.
2015-01-20 19:04:45 -05:00
David Steele
c33bc1e899
More migration to manifest object.
2015-01-20 18:00:03 -05:00
David Steele
26c568b7bc
Manifest checksum failure shows expected value to allow manual fix - though not recommended.
2015-01-20 16:20:27 -05:00
David Steele
92c9ed8963
Added checksum to manifest to detect corruption.
2015-01-20 16:05:15 -05:00
David Steele
44fad1f4a4
Improvements to manifest save.
2015-01-20 14:42:22 -05:00
David Steele
8a7ee1bb1f
Integration of new Manifest object.
2015-01-20 14:13:35 -05:00
David Steele
425e9485aa
Re-added File-hash() - accidentally deleted it when working on owner().
2015-01-08 16:36:45 -05:00
David Steele
131d910906
New structure for --delta and --force params.
2015-01-08 15:43:43 -05:00
David Steele
2e09df2cec
More work on new manifest object.
2015-01-08 12:04:56 -05:00
David Steele
0085e88966
Added File-owner()
2015-01-07 12:58:21 -05:00
David Steele
4f5ad8496d
Integrating new manifest object.
2015-01-07 10:59:43 -05:00
David Steele
d6d57e654e
Fixed the way wait was done after the manifest is created. Previously, waits were done for base and each tablespace which is not very efficient. Now one wait is done after the entire manifest is built. Also storing the exact time that copy began.
2015-01-06 13:08:56 -05:00
David Steele
43098086af
Implemented timestamp last modified to record the time of the last modified file in the backup. Also added timestamp-db-start and timestamp-db-stop to for more info. timestamp-db-start can be used for PITR.
2015-01-03 16:49:26 -05:00
David Steele
91b06bef47
File->manifest detects files that are modified in the future.
2015-01-03 14:22:59 -05:00
David Steele
2e080eedb8
Added an optional delay after manifest build so that files are not copied in the same second that the manifest is built. This can result in (admittedly unlikely) race conditions that can produce an invalid backup. I was also able to reduce the sleep types when waiting for thread termination - so unit test times are improved by almost 100%.
2015-01-02 14:18:07 -05:00
David Steele
297b22cb2b
Added INFO level logging when paths/files/links are removed during the clean phase of restore deltas.
2015-01-02 14:15:15 -05:00
David Steele
fb948de559
Fixed some minor issues in ownership code found by unit tests.
2014-12-31 12:28:16 -05:00
David Steele
7e083e8749
Restore as root is now working.
2014-12-31 11:20:46 -05:00
David Steele
0805055d4b
More work on restore ownership code.
2014-12-30 15:41:43 -05:00
David Steele
46ba3a18df
Ownership code runs through - may not work for all cases.
2014-12-30 11:59:57 -05:00
David Steele
9f8f33f957
Working on restore options and integration with unit tests.
2014-12-23 18:52:38 -05:00
David Steele
a96b83beb8
Restore can now remap base/tablespace locations.
...
Made Restore more modular.
2014-12-23 15:03:06 -05:00
David Steele
653ab486af
All restore module variables are now object local.
2014-12-23 12:48:25 -05:00
David Steele
51544edc70
Some cleanup in restore.
2014-12-23 11:48:51 -05:00
David Steele
2db71e91ad
Basic restore functionality is working.
2014-12-22 11:24:32 -05:00
David Steele
9086728b73
Restore removes paths/files/links and recreated paths/links.
2014-12-21 10:11:17 -05:00
David Steele
1557327d2b
Restore cleans out missing files and some basic unit tests.
2014-12-19 17:49:56 +00:00
David Steele
161a73159e
Added some constants.
2014-12-18 22:05:06 +00:00
David Steele
1dc00c9d4b
Starting on restore functionality, finally.
2014-12-18 16:42:54 +00:00
David Steele
1a3c5cd9db
Added latest link so it is easy to get to the last backup.
2014-12-18 16:14:30 +00:00
David Steele
c76a8d64d0
Moved more config logic to Config.pm
2014-12-16 17:41:54 +00:00
David Steele
6124558347
Moved config functions to a new file.
2014-12-15 22:20:42 +00:00
David Steele
66a5da6fd1
More work on backup unit tests - added tablespace tests.
2014-10-19 16:30:16 -04:00
David Steele
4de1d9aa5a
Backup unit tests are working.
2014-10-19 11:46:01 -04:00
David Steele
1d43c63326
Working on better backup unit tests.
2014-10-18 13:25:20 -04:00
David Steele
0ba838cd3e
Checksums seem to be working again - still waiting on the new backup unit tests to confirm.
2014-10-14 21:44:42 -04:00
David Steele
b19dd9b552
Changes to the aborted backups code.
2014-10-14 15:44:50 -04:00
David Steele
3a54eaf9de
Last backup type is now checked - still need a unit test for it.
2014-10-14 08:27:50 -04:00
David Steele
c8aeadce8e
Comments.
2014-10-11 00:16:34 -04:00
David Steele
aafc0fef69
Removed Moose from the Db object.
2014-10-10 16:03:33 -04:00
David Steele
2c173ba53e
Removed moose from File object.
2014-10-10 15:13:28 -04:00
David Steele
c1d6890c60
More Moose removal.
2014-10-09 16:01:06 -04:00
David Steele
3d86adadb5
Remote object now using ProcessAsync for de/compression.
...
Removed dependency on Moose from Remote.
2014-10-08 13:54:31 -04:00
David Steele
de35cedc27
Working on getting async process thread into Remote.pl
2014-10-05 18:52:05 -04:00
David Steele
122dc65351
Added compress and checksum settings to backup manifest.
2014-10-03 09:31:23 -04:00
David Steele
fbc2ae1325
Fixed function names in comments.
2014-10-02 14:34:58 -04:00
David Steele
4cbc6c650a
File->hash now works on compressed files.
2014-10-02 13:54:26 -04:00
David Steele
991afe3b16
Merge from dev-0.30.
...
Squashed commit of the following:
commit f3a012eb86702297ac06c9ae7c3da6a2eae41136
Author: David Steele <david@pgmasters.net>
Date: Wed Oct 1 19:05:57 2014 -0400
Fixed an issue where archive-get was not returning 1 if the archive directory did not exist. This happens when it is trying to retrieve archive log 00 and that has not been pushed from the master yet.
2014-10-02 10:55:38 -04:00
David Steele
168398e58a
Merge from dev-0.30.
...
Squashed commit of the following:
commit 2e90e165f5717ffef932996e00227dc78d47f23a
Author: David Steele <david@pgmasters.net>
Date: Tue Sep 30 15:50:07 2014 -0400
Removed outdated conf sample.
commit d32f7690ca99c98bc8cef5011de29f4b3a05bf90
Author: David Steele <david@pgmasters.net>
Date: Tue Sep 30 15:44:25 2014 -0400
Suppress error message from being logged when a file is removed by the db during the backup. The exception was being caught and the backup was successful, but the error message was being logged to stdout and the log file which is confusing.
commit 9ea52d9703da833aa3c215dbadfee60472ffad2a
Author: David Steele <david@pgmasters.net>
Date: Tue Sep 30 11:13:55 2014 -0400
File->manifest now ignores missing files and paths while running.
2014-09-30 15:51:08 -04:00
David Steele
5f30ae3c46
Merge branch 'dev-0.30' of https://github.com/dwsteele/pg_backrest into dev
2014-09-29 19:51:51 -04:00
David Steele
bdbdaf39d3
Work in progress - new hash method.
2014-09-29 19:08:08 -04:00
David Steele
82b0bc0e72
Fixed relative path issue in archive-get.
2014-09-29 22:51:02 +00:00
David Steele
7ed6587c42
ISSUE-11: Added --no-start-stop and --force options.
2014-09-19 17:51:51 -04:00
David Steele
07801a9a3c
Changed timestamp keys to be more consistent.
2014-09-19 11:22:26 -04:00
David Steele
7b1039dbe2
Fixed error message.
2014-09-18 17:39:24 -04:00
David Steele
535f32c827
Removed old unit tests.
2014-09-18 17:24:40 -04:00
David Steele
6ac124493d
Added prior backup label to backup.manifest
2014-09-18 16:42:13 -04:00
David Steele
82f22dd9fe
Documentation for config functions.
2014-09-18 16:41:36 -04:00
David Steele
fd12299ecd
Some fixes in test logging.
2014-09-18 15:18:52 -04:00
David Steele
06ad947102
Using ' instead of " where appropriate.
2014-09-16 11:22:55 -04:00
David Steele
65f89bd643
Using ' instead of " where appropriate.
2014-09-16 08:55:40 -04:00
David Steele
4d8c97eb55
Using ' instead of " where appropriate.
2014-09-16 08:21:29 -04:00
David Steele
48b0e0d461
Using ' instead of " where appropriate.
2014-09-16 08:15:49 -04:00
David Steele
b9b038b328
Added docs and fixed spaces.
2014-09-14 20:06:45 -04:00
David Steele
ab7323711f
Fixed issue in archive extension.
2014-09-14 17:07:44 -04:00
David Steele
cfe8851174
A few more fixes for differential.
2014-09-14 16:48:33 -04:00
David Steele
c0d81f0d10
Fixed issues in differential expiration.
2014-09-14 16:30:53 -04:00
David Steele
9555775d72
Retention defaults, single-quotes.
2014-09-14 15:55:27 -04:00
David Steele
6315d326ea
Fixed a few issues in manifest.
2014-09-14 15:31:56 -04:00
David Steele
679005e537
Some cleanup of the diff/incr code.
2014-08-14 09:40:20 -04:00
David Steele
3798071c5f
Added backup.manifest change to last commit.
2014-08-12 20:01:36 -04:00
David Steele
e8e7c82b14
pg_backrest.pl returns version.
...
Version is also stored in the backup path in the version and backup.manifest files.
Merged the two date string functions.
2014-08-12 20:00:52 -04:00
David Steele
b48a7e6cc2
The backup label (and path name) are now created at the end of the backup instead of the beginning. This makes selecting a backup for PITR much easier.
2014-08-12 19:17:16 -04:00
David Steele
672c6b2ccb
Backup start/stop timestamp now stored in backup.manifest
2014-08-12 19:04:46 -04:00
David Steele
6b4a8fbc21
Unit tests now working on Ubuntu 12.04
2014-08-10 21:22:17 -04:00
David Steele
0298e8dd16
Created unit tests for files deleted by the db during backup.
2014-08-10 15:02:14 -04:00
David Steele
09e2351ae8
Test log mode is working.
2014-08-09 18:35:55 -04:00
David Steele
2d9f027e3a
Cleanup, work on test framework.
2014-07-27 18:13:23 -04:00
David Steele
6f4310db42
Changes for testing - finished changing config to local implementation.
2014-07-27 14:03:21 -04:00
David Steele
06b5ee3f75
Working on new config load/save functions and unit tests.
2014-07-16 23:38:38 -04:00
David Steele
9ad1d79f00
Unit tests for archive-get.
2014-07-16 19:15:56 -04:00
David Steele
8d398e4bff
Starting on archive unit tests.
2014-07-13 10:37:16 -04:00
David Steele
375545320d
Added tests for large files (16MB archive log).
...
Fixed a sync error in binary_xfer().
2014-07-13 09:13:19 -04:00
David Steele
353cdb6b31
Local archiving is working again.
2014-07-12 19:03:39 -04:00
David Steele
d0ca69d433
Integrating IPC::Run - IPC::Open3 is out.
2014-06-30 18:35:05 -04:00
David Steele
934b7dbe9b
De/compression is now done in threads instead of forked processes.
2014-06-29 17:23:34 -04:00
David Steele
c85413ec68
Lots of improvements to unit tests. A few bug fixes.
2014-06-29 10:53:39 -04:00
David Steele
f9ec149ffe
Working on unit tests.
2014-06-28 14:32:34 -04:00
David Steele
97b9560e5c
Fixed binary_xfer() issue. Now seems to work in all cases.
2014-06-28 11:47:21 -04:00
David Steele
9c160a03e3
Some refinements to compression.
2014-06-23 19:08:36 -04:00
David Steele
e1829bb2d2
First fully working backup in a while.
2014-06-23 18:54:00 -04:00
David Steele
88bbbb4222
Fighting with a relative path issue in archive logging.
2014-06-22 20:19:13 -04:00
David Steele
5d01aac92e
Working on backup - mostly working except for the last archive step.
2014-06-22 16:05:00 -04:00
David Steele
f91dce259f
Working on backup unit tests.
2014-06-22 14:51:28 -04:00