David Steele
6ef2167e97
Fixed an issue retrieving WAL for old database versions.
...
After a stanza-upgrade it should still be possible to restore backups from the previous version and perform recovery with archive-get. However, archive-get only checked the most recent db version/id and failed.
Also clean up some issues when the same db version/id appears multiple times in the history.
Fixed by Cynthia Shang.
Reported by Clinton Adams.
2017-11-16 17:18:51 -05:00
David Steele
550d4fb9c5
Fix incorrect WAL offset for 32-bit architectures.
...
Fixed by Javier Wilson.
2017-11-16 16:53:49 -05:00
David Steele
1cb11a582d
Fix flapping protocol timeout test.
...
It only matters that the correct error code is returned, so disable logging to prevent message ordering from failing the expect test.
2017-11-15 13:17:57 -05:00
Cynthia Shang
bc8543494a
Add template to improve initial information gathered for issue submissions.
...
Contributed by Cynthia Shang.
2017-11-15 11:59:27 -05:00
David Steele
22fe684b1f
Only check expect logs on CentOS 7.
...
Variations in distros cause false negatives in tests but don't add much value.
2017-11-14 17:16:39 -05:00
David Steele
3ee269c099
Add encryption to features list.
2017-11-14 17:07:22 -05:00
David Steele
b8746f368d
Inflate performance improvement for gzip filter and full unit test coverage.
2017-11-14 15:12:31 -05:00
David Steele
04e55fe71b
Fixed an issue that could cause copying large manifests to fail during restore.
...
Reported by Craig A. James.
2017-11-14 14:48:44 -05:00
David Steele
cf7da546a3
Simplify try..catch..finally names.
2017-11-13 21:22:13 -05:00
David Steele
bcdfc7d0b5
Enable additional warnings for C builds.
2017-11-06 22:55:34 -05:00
Cynthia Shang
b03c26968a
Repository encryption support.
...
Contributed by Cynthia Shang.
2017-11-06 12:51:12 -05:00
David Steele
f07d2a3d0d
Add eof to S3 file driver (required for encryption support).
2017-11-06 12:40:54 -05:00
David Steele
8d6a08a32b
Library code for repository encryption support.
2017-11-03 13:57:58 -04:00
David Steele
ac542788da
Convert configuration definitions from auto-generated functions to auto-generated data structures.
2017-11-02 08:14:13 -04:00
Cynthia Shang
2be93036f1
Clarify usage of the archive-timeout option.
...
Also describe how it is distinct from the PostgreSQL archive_timeout setting.
Contributed by Cynthia Shang.
Suggested by Keith Fiske.
2017-10-30 14:18:05 -04:00
David Steele
55f68ef013
Remove configurable option hints.
...
db-path was the only option with a hint so the feature seemed wasteful. All missing stanza options now output the same hint without needing configuration.
2017-10-30 10:58:04 -04:00
David Steele
1ef27ec8c2
Add list type for options.
...
The hash type was being used for lists with an additional flag (`value-hash`) to indicate that it was not really a hash.
2017-10-30 10:50:35 -04:00
David Steele
f57e376c44
Update Debian/Ubuntu containers to download lastest version of pip.
2017-10-30 09:29:46 -04:00
David Steele
85b35f30a4
v1.25: S3 Performance Improvements
...
Bug Fixes:
* Fix custom settings for compress-level option being ignored. (Reported by Jens Wilke.)
* Remove error when overlapping timelines are detected. Overlapping timelines are valid in many Point-in-Time-Recovery (PITR) scenarios. (Reported by blogh.)
* Fix instances where database-id was not rendered as an integer in JSON info output. (Fixed by Cynthia Shang. Reported by Jason O'Donnell.)
Features:
* Improve performance of list requests on S3. Any beginning literal portion of a filter expression is used to generate a search prefix which often helps keep the request small enough to avoid rate limiting. (Suggested by Mihail Shvein.)
2017-10-24 17:36:21 -04:00
David Steele
8674a4f7ae
Allow functions with sensitive options to be logged at debug level with redactions.
...
Previously, functions with sensitive options had to be logged at trace level to avoid exposing them. Trace level logging may still expose secrets so use with caution.
2017-10-24 12:35:36 -04:00
David Steele
b2cc65d886
Improve performance of test code.
...
Wait when all tests have been assigned to reduce CPU load.
2017-10-24 10:35:42 -04:00
David Steele
d989cf8ac2
Replace dynamically built class hierarchies in I/O layer with fixed parent() calls.
2017-10-22 19:07:17 -04:00
David Steele
d82fe88031
Fix custom settings for compress-level option being ignored.
...
Reported by Jens Wilke.
2017-10-22 18:05:46 -04:00
David Steele
3553ccae44
Add I/O performance tests.
2017-10-22 13:27:47 -04:00
David Steele
9b98c2e7d6
Run all tests on tempfs rather than local disk.
2017-10-22 13:11:03 -04:00
David Steele
e1cb9ae86a
Improve labeling for errors in helper processes.
2017-10-21 14:40:14 -04:00
David Steele
44c7c0475a
Improve protocol error handling.
...
In particular, "stop" errors are no longer reported as "unexpected".
2017-10-21 14:11:33 -04:00
David Steele
1f120f3fce
Improve performance of list requests on S3.
...
Any beginning literal portion of a filter expression is used to generate a search prefix which often helps keep the request small enough to avoid rate limiting.
Suggested by Mihail Shvein.
2017-10-20 14:10:16 -04:00
David Steele
f4524aeaa9
Add base64 encode/decode.
2017-10-18 11:14:26 -04:00
Cynthia Shang
2d56de00fc
Fix instances where database-id was not rendered as an integer in JSON info output.
...
Fixed by Cynthia Shang.
Reported by Jason O'Donnell.
2017-10-18 08:42:32 -04:00
David Steele
b1efd598cf
Add PostgreSQL versions to Debian VMs for testing.
2017-10-16 18:21:47 -04:00
David Steele
c94e52f697
Remove error when overlapping timelines are detected.
...
Overlapping timelines are valid in many Point-in-Time-Recovery (PITR) scenarios.
Reported by blogh.
2017-10-16 14:34:44 -04:00
David Steele
583a76f605
Add C memory contexts.
2017-10-16 11:25:49 -04:00
David Steele
6f5186f9e6
Convert config tests into C unit tests.
2017-10-16 11:13:51 -04:00
David Steele
9d78948a14
Improvements to page checksum module and tests:
...
* Page checksum module uses new C error handler.
* Convert page checksum tests into C unit tests.
2017-10-16 11:03:06 -04:00
David Steele
80758f0023
Add test macros for C results and errors.
2017-10-16 10:54:35 -04:00
David Steele
904b83747c
Perl error handler recognizes errors thrown from the C library.
2017-10-16 10:47:31 -04:00
David Steele
f1e739b4aa
Add C error handler.
...
Basic try ... catch ... finally pattern to simplify error handling in C.
2017-10-16 10:09:56 -04:00
David Steele
10dfbd90b5
Add C unit test infrastructure.
2017-10-12 12:55:48 -04:00
David Steele
08d6f14603
Add LibC.template.pm to simplify LibC module generation.
2017-10-10 18:21:44 -04:00
David Steele
abea4d1fd5
Remove Debian test repo after PostgreSQL 10 release.
2017-10-05 12:33:13 -04:00
David Steele
d89b7d5862
Warnings in C builds treated as errors.
2017-09-30 10:48:25 -04:00
David Steele
8efcc38304
Improvements in C codebase:
...
* Update C naming conventions.
* Use int datatype wherever possible.
* Better separation of C source from Perl interface.
2017-09-30 10:44:03 -04:00
David Steele
d0bf946857
v1.24: New Backup Exclusions
...
Bug Fixes:
* Fixed an issue where warnings were being emitted in place of lower priority log messages during backup from standby initialization. (Reported by Uspen.)
* Fixed an issue where some db-* options (e.g. db-port) were not being passed to remotes. (Reported by Uspen.)
Features:
* Exclude contents of pg_snapshots, pg_serial, pg_notify, and pg_dynshmem from backup since they are rebuilt on startup.
* Exclude pg_internal.init files from backup since they are rebuilt on startup.
2017-09-28 19:06:41 -04:00
David Steele
40a85e34f1
Improve C library smart build.
...
Ignore changes outside of /lib/pgBackRest/Config.
2017-09-20 19:57:05 -04:00
David Steele
4d6c56b4d7
Open log file after async process is completely separated from the main process.
...
This prevents the main process from also logging to the file.
Suggested by Jens Wilke.
2017-09-20 08:08:36 -04:00
David Steele
266c9ddcc1
Fixed an issue where some db-* options (e.g. db-port) were not being passed to remotes.
2017-09-19 10:14:18 -04:00
David Steele
c857015a38
Fixed an issue where warnings were being emitted in place of lower priority log messages during backup from standby initialization.
2017-09-19 10:03:53 -04:00
David Steele
d36c52271f
Break up LibC.xs into separate module files.
2017-09-17 15:52:19 -04:00
David Steele
20af8ecf50
Dynamically generate list of files for C library build.
2017-09-17 14:49:23 -04:00