David Steele
|
7509b01e22
|
Added format to manifest to identify a manifest/dir structure version.
|
2015-03-03 21:21:07 -05:00 |
|
David Steele
|
f5761a41c1
|
Modules cleanup.
|
2015-03-03 10:03:55 -05:00 |
|
David Steele
|
3d0d308a98
|
Made all warnings FATAL.
Fixed one bug that was exposed.
|
2015-03-03 00:57:20 -05:00 |
|
David Steele
|
c0ec62b131
|
Fixed bug in File->hash() and removed improper last statements from do loops.
|
2015-03-02 23:42:55 -05:00 |
|
David Steele
|
7dbb11e8b8
|
Added buffer-size param and added config validation improvements.
|
2015-03-02 22:58:32 -05:00 |
|
David Steele
|
8e8f2f3c77
|
New config options compress-level and compress-level-network to control compression levels.
|
2015-03-02 20:36:12 -05:00 |
|
David Steele
|
49112eb6d3
|
Better compression window settings.
|
2015-03-02 09:46:11 -05:00 |
|
David Steele
|
d874e122aa
|
Optimized compression to disable headers/crc when the source and destination are both uncompressed.
Set different compression levels based on usage.
|
2015-03-01 23:41:01 -05:00 |
|
David Steele
|
0df1b7c473
|
Changed file sizes are now detected and stored in the manifest.
Remove thread file minimums - they are unrealistic for a real db and hinder unit tests.
|
2015-03-01 22:43:32 -05:00 |
|
David Steele
|
23102f19e5
|
All copy() cases generate checksums during copy.
Unit tests for bAppendChecksum option for copy().
|
2015-03-01 22:23:52 -05:00 |
|
David Steele
|
83658a4778
|
Docs for checksum option being removed.
|
2015-03-01 16:43:54 -05:00 |
|
David Steele
|
76391dde90
|
Archive checksums are not calculated in stream.
|
2015-03-01 16:42:27 -05:00 |
|
David Steele
|
393525d280
|
Full refactor of binary_xfer.
Compression now uses Compress::Raw::Zlib.
|
2015-03-01 15:17:57 -05:00 |
|
David Steele
|
77bc4238dc
|
ZLib stuff starting to look good. All references removed from File and using binary_xfer for all de/compression.
|
2015-03-01 13:41:35 -05:00 |
|
David Steele
|
7ede058b45
|
Backup checksums are no longer optional.
|
2015-02-28 20:31:56 -05:00 |
|
David Steele
|
28326d6b4c
|
File->copy now returns hash and size in all cases, though the local copies are not optimal. They just call hash_size().
|
2015-02-28 19:07:29 -05:00 |
|
David Steele
|
260a6cb8f1
|
Working on calculating hash and file size in binary_xfer().
|
2015-02-28 15:54:49 -05:00 |
|
David Steele
|
0f94476a1f
|
Changed buffer sizes.
|
2015-02-28 12:10:50 -05:00 |
|
David Steele
|
f6b9ab7326
|
Minor param fix.
|
2015-02-28 10:28:25 -05:00 |
|
David Steele
|
f93c6caec2
|
Backup/restore copy will be run in the main process when thread-max=1. I've resisted this change because it adds complexity, but I have to accept that threads are not stable on all platforms. Or maybe any platform.
|
2015-02-28 10:23:33 -05:00 |
|
David Steele
|
5d10a18b25
|
Added thread-max parameter to test.pl to allow backup threads to be specified.
|
2015-02-28 10:21:36 -05:00 |
|
David Steele
|
d6205d9501
|
Looks like all unit tests pass - now for a long test run to see if that is really true. And to see if the old lockup is gone.
|
2015-02-27 23:31:39 -05:00 |
|
David Steele
|
25442655c8
|
Hash of compressed file is working.
Something still broken in binary_xfer because some 0 length archive files are showing up. Investigating.
|
2015-02-27 18:42:28 -05:00 |
|
David Steele
|
53f783d3fe
|
binary_xfer compress/decompression working without threads. All unit tests passing. Hooray.
|
2015-02-27 16:36:40 -05:00 |
|
David Steele
|
c18c629878
|
Compress looks good, back to decompress.
|
2015-02-27 14:11:59 -05:00 |
|
David Steele
|
bd44b2c471
|
Making binary xfer more modular.
|
2015-02-27 13:48:29 -05:00 |
|
David Steele
|
2506bbb21a
|
Working on decompression.
|
2015-02-26 19:12:22 -05:00 |
|
David Steele
|
64e1b1cea7
|
Simple compression case is working.
Still need to implement decompress, handle flags, and do checksum decompression.
|
2015-02-26 14:16:12 -05:00 |
|
David Steele
|
b9378d94a2
|
Working on removing threads from instream compress/decompression.
|
2015-02-26 09:22:05 -05:00 |
|
David Steele
|
d2602a5c07
|
Tracking down a lockup in the restore threads. It doesn't happen in backup - they are the same except that restore uses the ThreadGroup object. I'm beginning to think that threads and objects don't play together very nicely. Objects in threads seems OK, but threads in objects, not so much.
|
2015-02-03 20:33:33 -05:00 |
|
David Steele
|
7bee43372d
|
Increase timeout.
|
2015-02-02 21:10:44 -05:00 |
|
David Steele
|
d4aae88bec
|
Try non-blocking dequeue in backup.
|
2015-02-02 20:11:32 -05:00 |
|
David Steele
|
850c978240
|
All restore compares no-start-stop for now.
|
2015-02-02 19:56:48 -05:00 |
|
David Steele
|
d93b246a69
|
Empty restore queues in a non-blocking way.
|
2015-02-02 19:34:34 -05:00 |
|
David Steele
|
7f38461c68
|
Remove ThreadQueue->end(). Not supported on all platforms.
|
2015-02-02 18:48:33 -05:00 |
|
David Steele
|
bde8943517
|
Fixes to restore compare unit tests.
|
2015-02-02 18:33:11 -05:00 |
|
David Steele
|
8abcf6caf1
|
For no just ignore sizes in the tests since they are normal and do not indicate a bad backup.
|
2015-02-02 08:28:37 -05:00 |
|
David Steele
|
a6d3b7e1a9
|
Working on checking restores against the manifest. Current issue is that the manifest does not always record the final size of the file - it may change while the file is being copied. This is fine in principal but makes testing a pain.
|
2015-01-31 23:04:24 -05:00 |
|
David Steele
|
018a2afaca
|
Moved bNoStartStop tablespace mapping to Manifest object.
|
2015-01-31 18:23:37 -05:00 |
|
David Steele
|
d7b669d560
|
Moved manifest build to manifest object.
|
2015-01-31 18:15:08 -05:00 |
|
David Steele
|
cd500484a2
|
Revert "Working on doc formatting."
This reverts commit a0559799fd.
|
2015-01-31 17:37:55 -05:00 |
|
David Steele
|
a0559799fd
|
Working on doc formatting.
|
2015-01-31 17:36:25 -05:00 |
|
David Steele
|
682d419d08
|
Fixed file list.
|
2015-01-31 17:32:16 -05:00 |
|
David Steele
|
1ba176285e
|
Work on restore/recovery docs.
|
2015-01-31 17:10:19 -05:00 |
|
David Steele
|
f94812932a
|
Working on operations docs.
|
2015-01-31 16:27:32 -05:00 |
|
David Steele
|
267efbd71d
|
Fixed restore::thread-max
|
2015-01-31 15:37:59 -05:00 |
|
David Steele
|
0c9da6a5ab
|
Removed version file - redundant to the version in backup.manifest.
|
2015-01-31 15:06:53 -05:00 |
|
David Steele
|
e524c4dd1a
|
Timeline unit tests are working.
Options from config file are being written to recovery.conf.
Fixed issue with .history files not being picked up by archive-xfer.
|
2015-01-31 13:48:09 -05:00 |
|
David Steele
|
cd9df8b4f8
|
Renamed uninit to cleanup.
|
2015-01-31 09:05:05 -05:00 |
|
David Steele
|
11c257296a
|
In the end it was a single non-undefed reference holding up the show. The Backup file should be split into Archive, Backup, Expire, and made into objects. That would cut down on this kind of nastiness.
|
2015-01-30 20:16:21 -05:00 |
|