161 Commits

Author	SHA1	Message	Date
David Steele	e524c4dd1a	Timeline unit tests are working. ... Options from config file are being written to recovery.conf. Fixed issue with .history files not being picked up by archive-xfer.	2015-01-31 13:48:09 -05:00
David Steele	11c257296a	In the end it was a single non-undefed reference holding up the show. The Backup file should be split into Archive, Backup, Expire, and made into objects. That would cut down on this kind of nastiness.	2015-01-30 20:16:21 -05:00
David Steele	50e015a838	Revert "Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes." ... This reverts commit e95631f82a.	2015-01-30 18:58:49 -05:00
David Steele	e95631f82a	Abortive attempt at cleaning up some thread issues - I realized the issue is in mixing threads and objects too liberally. Trying another approach but want to keep this code for historical and reference purposes.	2015-01-30 14:55:55 -05:00
David Steele	fb934ecce9	Allow immediate stops when discarding data at end of unit test. Makes the shutdowns faster.	2015-01-30 14:54:08 -05:00
David Steele	19e455afc1	Some fixes in unit tests - more needed.	2015-01-28 16:25:38 -05:00
David Steele	499d6c8422	Added tests for all --delta --force combinations. ... Added error check for postmaster running. Added error check for path not empty.	2015-01-28 13:14:46 -05:00
David Steele	16dd271794	Added an incremental backup to vary the unit tests.	2015-01-28 11:12:21 -05:00
David Steele	139b1cf872	Fixed small race condition in cleanup - the archiver was recreating paths after they had been deleted. Put in a loop to make sure it gets done.	2015-01-28 10:29:29 -05:00
David Steele	60550cd45b	Archive async now works local, but there is a pending bug to make sure archive::path != backup::path. ... Added code to be sure that restore will not try to log into the backup path unless it is local.	2015-01-28 00:28:21 -05:00
David Steele	a59bd8c328	Restores except for type=none are mostly working. There are some failing unit tests to fix.	2015-01-27 22:59:59 -05:00
David Steele	13544d51bf	Recovery is working for none and default, but unit tests are not complete.	2015-01-27 11:44:23 -05:00
David Steele	f59aae101d	Ready to start writing recovery unit tests.	2015-01-26 14:59:58 -05:00
David Steele	ac22c314a9	Working on plumbing for recovery options.	2015-01-26 11:01:24 -05:00
David Steele	6db49e1083	Cleaned up some time functions.	2015-01-25 12:20:12 -05:00
David Steele	9069c34e34	Added more tablespace changes to backup unit tests.	2015-01-24 11:05:26 -05:00
David Steele	e1c5f7f8ed	Now able to check for specific errors in unit tests - as long as they are raised with an error code.	2015-01-23 18:28:39 -05:00
David Steele	c6dad12748	Using usleep for more resolution,	2015-01-23 14:12:53 -05:00
David Steele	d3763908e7	Added longer sleep to show how big an issue this can be.	2015-01-22 21:20:49 -05:00
David Steele	a3b3f98f66	Fixed some issues with remote backups after restore (unit test bugs only).	2015-01-22 20:55:16 -05:00
David Steele	21c715b25c	Restore tablespace remaps are working.	2015-01-22 20:11:33 -05:00
David Steele	df4b50b977	Restore with base path remap working.	2015-01-22 19:04:55 -05:00
David Steele	82969eb497	Wrote some helper functions to make backup unit tests simpler. ... Fixed an issue with checksum generation in resume.	2015-01-22 17:43:19 -05:00
David Steele	b53cb9f64e	Unit tests for backup resume. ... Improved warning message when a backup cannot be resumed.	2015-01-22 10:54:02 -05:00
David Steele	fc2838d60f	All references to old-style manifest eliminated (hopefully).	2015-01-21 18:37:49 -05:00
David Steele	c33bc1e899	More migration to manifest object.	2015-01-20 18:00:03 -05:00
David Steele	92c9ed8963	Added checksum to manifest to detect corruption.	2015-01-20 16:05:15 -05:00
David Steele	e20f93ef1b	Cleaned up test usage.	2015-01-12 09:05:26 -05:00
David Steele	84abcd7d61	Minor fixes.	2015-01-11 11:53:03 -05:00
David Steele	34116d3816	Added usage to test.pl and automatic search for psql-bin.	2015-01-11 11:52:16 -05:00
David Steele	131d910906	New structure for --delta and --force params.	2015-01-08 15:43:43 -05:00
David Steele	d6d57e654e	Fixed the way wait was done after the manifest is created. Previously, waits were done for base and each tablespace which is not very efficient. Now one wait is done after the entire manifest is built. Also storing the exact time that copy began.	2015-01-06 13:08:56 -05:00
David Steele	43098086af	Implemented timestamp last modified to record the time of the last modified file in the backup. Also added timestamp-db-start and timestamp-db-stop to for more info. timestamp-db-start can be used for PITR.	2015-01-03 16:49:26 -05:00
David Steele	91b06bef47	File->manifest detects files that are modified in the future.	2015-01-03 14:22:59 -05:00
David Steele	2449d7384c	Wrote a new test to check rsync collisions.	2015-01-03 12:56:44 -05:00
David Steele	2e080eedb8	Added an optional delay after manifest build so that files are not copied in the same second that the manifest is built. This can result in (admittedly unlikely) race conditions that can produce an invalid backup. I was also able to reduce the sleep types when waiting for thread termination - so unit test times are improved by almost 100%.	2015-01-02 14:18:07 -05:00
David Steele	32b37335a1	Trying to find realistic conditions where a file can be changed without the timestamp changing between backups. So far, this is the only case I can make work - it looks like adding a 1 second pause after creation of the manifest would cover this case.	2014-12-31 19:03:03 -05:00
David Steele	59e901684d	Working on improved backup/restore unit tests.	2014-12-31 14:59:33 -05:00
David Steele	9f8f33f957	Working on restore options and integration with unit tests.	2014-12-23 18:52:38 -05:00
David Steele	2db71e91ad	Basic restore functionality is working.	2014-12-22 11:24:32 -05:00
David Steele	9086728b73	Restore removes paths/files/links and recreated paths/links.	2014-12-21 10:11:17 -05:00
David Steele	1557327d2b	Restore cleans out missing files and some basic unit tests.	2014-12-19 17:49:56 +00:00
David Steele	1dc00c9d4b	Starting on restore functionality, finally.	2014-12-18 16:42:54 +00:00
David Steele	1a3c5cd9db	Added latest link so it is easy to get to the last backup.	2014-12-18 16:14:30 +00:00
David Steele	7d19504d3a	Removed some tests in full that were redundant with the tests in backup.	2014-12-18 14:58:07 +00:00
David Steele	6124558347	Moved config functions to a new file.	2014-12-15 22:20:42 +00:00
David Steele	6dd9e881dc	Added reminder.	2014-11-27 14:07:09 +00:00
David Steele	602db70d6a	More backup unit tests.	2014-10-20 11:44:36 -04:00
David Steele	9765b4e20b	Backup unit test - more work on tablespaces and references.	2014-10-19 17:41:11 -04:00
David Steele	66a5da6fd1	More work on backup unit tests - added tablespace tests.	2014-10-19 16:30:16 -04:00