db/pgbackrest
1
0
Fork 0
mirror of https://github.com/pgbackrest/pgbackrest.git synced 2024-12-14 10:13:05 +02:00
Code Issues Releases Activity
509 Commits 4 Branches 113 Tags 103 MiB
ae6bdecfaf
Commit Graph

180 Commits

Author SHA1 Message Date
David Steele
ae6bdecfaf Split command-line parameter processing out into a separate file. This is in preparation allowing all parameters to be specified/overridden on the command line, with pg_backrest.conf being option. 2015-03-08 13:26:09 -04:00
David Steele
d19baefdb9 Removed db-timestamp-start and stop from manifest. Better to get these values from 2015-03-03 22:33:41 -05:00
David Steele
7509b01e22 Added format to manifest to identify a manifest/dir structure version. 2015-03-03 21:21:07 -05:00
David Steele
f5761a41c1 Modules cleanup. 2015-03-03 10:03:55 -05:00
David Steele
3d0d308a98 Made all warnings FATAL. 
Fixed one bug that was exposed.
 2015-03-03 00:57:20 -05:00
David Steele
c0ec62b131 Fixed bug in File->hash() and removed improper last statements from do loops. 2015-03-02 23:42:55 -05:00
David Steele
7dbb11e8b8 Added buffer-size param and added config validation improvements. 2015-03-02 22:58:32 -05:00
David Steele
8e8f2f3c77 New config options compress-level and compress-level-network to control compression levels. 2015-03-02 20:36:12 -05:00
David Steele
49112eb6d3 Better compression window settings. 2015-03-02 09:46:11 -05:00
David Steele
d874e122aa Optimized compression to disable headers/crc when the source and destination are both uncompressed. 
Set different compression levels based on usage.
 2015-03-01 23:41:01 -05:00
David Steele
0df1b7c473 Changed file sizes are now detected and stored in the manifest. 
Remove thread file minimums - they are unrealistic for a real db and hinder unit tests.
 2015-03-01 22:43:32 -05:00
David Steele
23102f19e5 All copy() cases generate checksums during copy. 
Unit tests for bAppendChecksum option for copy().
 2015-03-01 22:23:52 -05:00
David Steele
76391dde90 Archive checksums are not calculated in stream. 2015-03-01 16:42:27 -05:00
David Steele
393525d280 Full refactor of binary_xfer. 
Compression now uses Compress::Raw::Zlib.
 2015-03-01 15:17:57 -05:00
David Steele
77bc4238dc ZLib stuff starting to look good. All references removed from File and using binary_xfer for all de/compression. 2015-03-01 13:41:35 -05:00
David Steele
7ede058b45 Backup checksums are no longer optional. 2015-02-28 20:31:56 -05:00
David Steele
28326d6b4c File->copy now returns hash and size in all cases, though the local copies are not optimal. They just call hash_size(). 2015-02-28 19:07:29 -05:00
David Steele
260a6cb8f1 Working on calculating hash and file size in binary_xfer(). 2015-02-28 15:54:49 -05:00
David Steele
0f94476a1f Changed buffer sizes. 2015-02-28 12:10:50 -05:00
David Steele
f6b9ab7326 Minor param fix. 2015-02-28 10:28:25 -05:00
David Steele
f93c6caec2 Backup/restore copy will be run in the main process when thread-max=1. I've resisted this change because it adds complexity, but I have to accept that threads are not stable on all platforms. Or maybe any platform. 2015-02-28 10:23:33 -05:00
David Steele
d6205d9501 Looks like all unit tests pass - now for a long test run to see if that is really true. And to see if the old lockup is gone. 2015-02-27 23:31:39 -05:00
David Steele
25442655c8 Hash of compressed file is working. 
Something still broken in binary_xfer because some 0 length archive files are showing up.  Investigating.
 2015-02-27 18:42:28 -05:00
David Steele
53f783d3fe binary_xfer compress/decompression working without threads. All unit tests passing. Hooray. 2015-02-27 16:36:40 -05:00
David Steele
c18c629878 Compress looks good, back to decompress. 2015-02-27 14:11:59 -05:00
David Steele
bd44b2c471 Making binary xfer more modular. 2015-02-27 13:48:29 -05:00
David Steele
2506bbb21a Working on decompression. 2015-02-26 19:12:22 -05:00
David Steele
64e1b1cea7 Simple compression case is working. 
Still need to implement decompress, handle flags, and do checksum decompression.
 2015-02-26 14:16:12 -05:00
David Steele
b9378d94a2 Working on removing threads from instream compress/decompression. 2015-02-26 09:22:05 -05:00
David Steele
d2602a5c07 Tracking down a lockup in the restore threads. It doesn't happen in backup - they are the same except that restore uses the ThreadGroup object. I'm beginning to think that threads and objects don't play together very nicely. Objects in threads seems OK, but threads in objects, not so much. 2015-02-03 20:33:33 -05:00
David Steele
d4aae88bec Try non-blocking dequeue in backup. 2015-02-02 20:11:32 -05:00
David Steele
d93b246a69 Empty restore queues in a non-blocking way. 2015-02-02 19:34:34 -05:00
David Steele
7f38461c68 Remove ThreadQueue->end(). Not supported on all platforms. 2015-02-02 18:48:33 -05:00
David Steele
bde8943517 Fixes to restore compare unit tests. 2015-02-02 18:33:11 -05:00
David Steele
a6d3b7e1a9 Working on checking restores against the manifest. Current issue is that the manifest does not always record the final size of the file - it may change while the file is being copied. This is fine in principal but makes testing a pain. 2015-01-31 23:04:24 -05:00
David Steele
018a2afaca Moved bNoStartStop tablespace mapping to Manifest object. 2015-01-31 18:23:37 -05:00
David Steele
d7b669d560 Moved manifest build to manifest object. 2015-01-31 18:15:08 -05:00
David Steele
267efbd71d Fixed restore::thread-max 2015-01-31 15:37:59 -05:00
David Steele
0c9da6a5ab Removed version file - redundant to the version in backup.manifest. 2015-01-31 15:06:53 -05:00
David Steele
e524c4dd1a Timeline unit tests are working. 
Options from config file are being written to recovery.conf.
Fixed issue with .history files not being picked up by archive-xfer.
 2015-01-31 13:48:09 -05:00
David Steele
cd9df8b4f8 Renamed uninit to cleanup. 2015-01-31 09:05:05 -05:00
David Steele
11c257296a In the end it was a single non-undefed reference holding up the show. The Backup file should be split into Archive, Backup, Expire, and made into objects. That would cut down on this kind of nastiness. 2015-01-30 20:16:21 -05:00
David Steele
50e015a838 Revert "Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes." 
This reverts commit e95631f82a.
 2015-01-30 18:58:49 -05:00
David Steele
e95631f82a Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes. 2015-01-30 14:55:55 -05:00
David Steele
499d6c8422 Added tests for all --delta --force combinations. 
Added error check for postmaster running.
Added error check for path not empty.
 2015-01-28 13:14:46 -05:00
David Steele
60550cd45b Archive async now works local, but there is a pending bug to make sure archive::path != backup::path. 
Added code to be sure that restore will not try to log into the backup path unless it is local.
 2015-01-28 00:28:21 -05:00
David Steele
b98b2df9f8 Fixed wait_for_file() so that it will not error if the path does not yet exist. 2015-01-28 00:26:20 -05:00
David Steele
a59bd8c328 Restores except for type=none are mostly working. There are some failing unit tests to fix. 2015-01-27 22:59:59 -05:00
David Steele
13544d51bf Recovery is working for none and default, but unit tests are not complete. 2015-01-27 11:44:23 -05:00
David Steele
f59aae101d Ready to start writing recovery unit tests. 2015-01-26 14:59:58 -05:00