1
0
mirror of https://github.com/postgrespro/pg_probackup.git synced 2025-01-10 23:29:34 +02:00
Commit Graph

87 Commits

Author SHA1 Message Date
stalkerg
188bbdd593 Rename project to pg_probackup. 2016-11-16 20:34:21 +03:00
stalkerg
0f16f1f01e Fix wrong error message. 2016-11-16 18:14:29 +03:00
stalkerg
4ceb771b96 Detect if ptrack_enable = off 2016-11-15 16:23:53 +03:00
stalkerg
a742f2b04e Stop backup if we can't connect by stream protocol with --stream option. 2016-11-14 18:10:02 +03:00
stalkerg
24c840392f Use --stream option only for backup. Add STREAM to show command. 2016-11-01 17:25:46 +03:00
stalkerg
9f2ad9d822 Remove date range and start use base36 from start_time as backup ID. 2016-10-31 18:19:11 +03:00
stalkerg
b0a63b6790 Add -S, --slot option for backup with --stream 2016-10-25 20:21:27 +03:00
stalkerg
6ea5df1ca0 Fix detect tablespace oid. 2016-10-25 17:22:11 +03:00
stalkerg
af0e674cbb Add automatic detect of replica and remove same option. 2016-10-25 14:38:51 +03:00
stalkerg
8daffeeb6d Detect ptrack support and remove disable ptrack option. 2016-10-18 16:25:13 +03:00
stalkerg
65bb8b5902 Try make stream replication right. 2016-10-13 17:25:53 +03:00
stalkerg
c67832583e Add backup_label to file_database.txt for all checks. 2016-09-29 19:44:59 +03:00
stalkerg
9f038eeb5e Add support backup from replica. 2016-09-29 17:33:21 +03:00
stalkerg
e01d84e9aa Fix check digit chars. 2016-09-09 19:01:36 +03:00
stalkerg
f69e780d37 Fix checksums for segno > 0 2016-09-06 16:30:54 +03:00
stalkerg
55686d33c7 Don't use partial xlog. 2016-09-06 14:06:09 +03:00
stalkerg
3491b43404 Add lock free algorithm for load balancing. 2016-09-02 20:38:39 +03:00
stalkerg
6ce7163a8a Add simple progress bar with option --progress. 2016-09-02 20:16:00 +03:00
stalkerg
02ac17bb6b Add load balance for backup threads. 2016-09-02 19:31:49 +03:00
stalkerg
23f4eaa8e5 Add --disable-ptrack-clear for postgres without ptrack. 2016-09-01 18:29:13 +03:00
stalkerg
a0fb3912a8 Add support postgres 9.6. 2016-08-30 17:21:02 +03:00
stalkerg
356ebd3728 Add checksums database support. 2016-07-07 18:38:56 +03:00
stalkerg
9471875b15 Add stream mode for save WAL during backup process. 2016-05-26 15:56:32 +03:00
stalkerg
ccd4f48017 Fix check ptrack control file. 2016-05-12 12:51:36 +03:00
stalkerg
075c37ba68 Fix backup if we do full backup. 2016-05-11 21:49:26 +03:00
stalkerg
e3b0f4485b Add support get ptrack from SQL for atomic. 2016-05-11 19:35:14 +03:00
stalkerg
091fe0ada2 Fix backup many segments of relation (big relations) with ptrack.
Add fail test for show problem in lost pages in backup process.
2016-05-01 22:05:18 +03:00
stalkerg
5698515521 Did not forget some page in full backup. But it is not solution for
ptrack backup. We have big issue.
2016-04-29 16:26:40 +03:00
stalkerg
71ed1e53a7 Small logic fix. 2016-04-15 16:03:06 +03:00
stalkerg
7c64f0396a Fix ptrack clear. Need run pg_ptrack_clear for every db. 2016-04-15 15:58:58 +03:00
stalkerg
558d4a3427 Remove noisy NOTICE messages when calling pg_stop_backup
Those per se are not that annoying, but the random messages generated
by the backend while pg_arman is waiting for segments to be archived
are annoying. This commit gets rid of them by using client_min_messages
set to warning on the connection used.

Report by Yury Zhuravlev.
2016-03-28 13:47:49 +03:00
Zhuravlev Uriy aka stalkerg
30845bf4a6 Check ptrack control file. 2016-03-10 17:40:33 +03:00
Zhuravlev Uriy aka stalkerg
633b4b5c55 Clear after FULL BACKUP too. 2016-03-09 13:55:24 +03:00
Zhuravlev Uriy aka stalkerg
4f163d8b86 Make pg_control file optional for restore. 2016-03-02 20:50:33 +03:00
Zhuravlev Uriy aka stalkerg
375d915647 Try fix size. 2016-03-02 16:16:50 +03:00
Zhuravlev Uriy aka stalkerg
c9c943b2fb Relax version test. 2016-03-02 12:11:25 +03:00
Zhuravlev Uriy aka stalkerg
fed13c298e Add multithread beckup. 2016-02-29 20:23:48 +03:00
Zhuravlev Uriy aka stalkerg
6d51bb10d9 Fix copy bitmap. 2016-02-28 02:10:27 +03:00
Zhuravlev Uriy aka stalkerg
9c475eccbf First version of ptrack support. 2016-02-27 21:07:55 +03:00
Michael Paquier
5c37daca69 Sanitize error checks
All the ERROR_* fields are removed in favor of a more simple layer
made of ERROR, FATAL, PANIC. The two last ones are not actually used
yet, thought there should be some code paths that would need more
polishing on this matter.

The error message emitted before leaving should be fine to let the
user know what is happening.
2016-01-19 12:41:30 +09:00
Michael Paquier
04834e73c7 Page-level backup using block tracking in WAL records
This commit improves the performance of page-level, or differential
backup, by not having to scan anymore all the pages of a relation file,
something that can be very long on large data sets, but by scanning the
list of blocks changed by WAL records since the last full or differential
backup.

As a restriction and to avoid potential data corruption should hint-bit
updates occur on a page, backups can only be taken from a server that has
wal_log_hints or data checksums enabled.

Base patch by Yury Zhuravlev, heavily modified by me.
2016-01-15 23:47:38 +09:00
Michael Paquier
ea89ca3145 Remove remaining LVM-snapshot logic
Extracted from a patch by Yury Zhuravlev, and visibly this portion was
missed in last cleanup that occurred in b92d722.
2016-01-15 15:26:05 +09:00
Michael Paquier
e2bbf69403 Remove code duplication to get a node's current timeline
The same code was duplicated between restore and backup. At the same
time this commit introduces routines to fetch the control data file.
2016-01-15 14:09:31 +09:00
Michael Paquier
a5a76c14c5 Fix one-off error when waiting for necessary segment to be archived
The .ready flag file of the segment forcibly switched to when stopping the
backup needs to be tracked, and not the next one.
2016-01-15 13:37:20 +09:00
Michael Paquier
f94c5ab447 Sanitize logging facility
--debug and --verbose had actually the same meaning as they were aimed
at giving to the user information regarding how the process is running,
hence both options are merged into --verbose and use elog(LOG) to decide
if a given message should be printed out depending on the verbosity of
the call. This makes a couple of routines more readable as they do not
depend on any boolean checks.

The "_()" have been removed from the code, those are aimed at being used
for translation but having them mandatorily in each log message is just
useless noise. If needed, pgut.c should be updated in consequence to
have a more portable facility.

At the same time this commit takes care of putting into correct shape
some code paths more in-line with PostgreSQL policy. There are surely
more of this kind of ugly stuff but at this stage things are more simple
and more manageable.
2016-01-14 16:36:39 +09:00
Michael Paquier
3ac6d13329 Remove --compress-data/-Z
Performance of compression is quite questionable on many objects like
that and makes the routines aimed at managing file copy, backup and restore
more complicated than they should be.

This commit results in a largely simplified code in data.c, which will
be helpful when integrating differential backup using WAL file lookup.
2016-01-14 15:19:38 +09:00
Michael Paquier
9f1424bc87 Remove use of xlog_fname in code
Let's rely on Postgres stuff instead.

Based on a patch by YUriy Zhuravlev for the backup part, updated by
me for the restore part.
2016-01-13 16:28:51 +09:00
Michael Paquier
db249c800e Replace incremental backup by page-level differential backup
This will allow the introduction of file-level differential backup.
2014-01-30 15:58:55 +09:00
Michael Paquier
c8ebcc9c41 Rename project to pg_arman
This is officially a fork!
2014-01-27 12:02:56 +09:00
Michael Paquier
820485d225 Strip off archive backup mode
This mode is not actually necessary if we consider that the core of
pg_rman is the obtention of differential and full backups, the server
being afterwards in charge to recover necessary WAL segments from the
archive.

Regression tests and documentation are updated in accordance to the
changes.
2014-01-24 22:37:55 +09:00