mirror of
https://github.com/pgbackrest/pgbackrest.git
synced 2024-12-14 10:13:05 +02:00
761 lines
41 KiB
XML
761 lines
41 KiB
XML
<?xml version="1.0" encoding="UTF-8"?>
|
|
<!DOCTYPE doc SYSTEM "doc.dtd">
|
|
<doc title="User Guide">
|
|
<intro>
|
|
<text></text>
|
|
</intro>
|
|
|
|
<install title="Installation">
|
|
<text><backrest/> is written entirely in Perl. Some additional modules will need to be installed depending on the OS.</text>
|
|
|
|
<install-system-list>
|
|
<install-system title="Ubuntu 12.04/14.04 Setup">
|
|
<text>* Install required Perl modules:
|
|
<code-block>
|
|
apt-get install libdbd-pg-perl
|
|
</code-block></text>
|
|
</install-system>
|
|
|
|
<install-system title="CentOS 6 Setup">
|
|
<text>* Install Perl and required modules:
|
|
<code-block>
|
|
yum install perl perl-Time-HiRes perl-IO-String perl-parent perl-JSON perl-Digest-SHA perl-DBD-Pg
|
|
</code-block></text>
|
|
</install-system>
|
|
|
|
<install-system title="CentOS 7 Setup">
|
|
<text>* Install Perl and required modules:
|
|
<code-block>
|
|
yum install perl perl-IO-String perl-Thread-Queue perl-JSON-PP perl-Digest-SHA perl-DBD-Pg
|
|
</code-block></text>
|
|
</install-system>
|
|
|
|
<install-system title="Software Installation">
|
|
<text><backrest/> can be installed by downloading the most recent release:
|
|
|
|
https://github.com/pgmasters/backrest/releases
|
|
|
|
<backrest/> can be installed anywhere but it's best (though not required) to install it in the same location on all systems.</text>
|
|
</install-system>
|
|
|
|
<install-system title="Regression Test Setup">
|
|
<text>* Create the backrest user
|
|
|
|
The backrest user must be created on the same system and in the same group as the user you will use for testing (which can be any user you prefer). For example:
|
|
<code-block>
|
|
adduser -g <test-user-group> backrest
|
|
</code-block>
|
|
* Setup password-less SSH login between the test user and the backrest user
|
|
|
|
The test user should be able to `ssh backrest@127.0.0.1` and the backrest user should be able to `ssh <testuser>@127.0.0.1` without requiring any passwords. This article (http://archive.oreilly.com/pub/h/66) has details on how to accomplish this. Do the logons both ways at the command line before running regression tests.
|
|
|
|
* Give group read and execute permissions to <path>~/backrest/test</path>:
|
|
|
|
Usually this can be accomplished by running the following as the test user:
|
|
<code-block>
|
|
chmod 750 ~
|
|
</code-block>
|
|
* Running regression:
|
|
|
|
Running the full regression suite is generally not necessary. Run the following first:
|
|
<code-block>
|
|
./test.pl --module=backup --test=full --db-version=all --thread-max=<# threads>
|
|
</code-block>
|
|
This will run full backup/restore regression with a variety of options on all installed versions of <postgres/>. If you are only interested in one version then modify the <setting>db-version</setting> setting to X.X (e.g. 9.4). <setting>--thread-max</setting> can be omitted if you are running single-threaded.
|
|
|
|
If there are errors in this test then run full regression to help isolate problems:
|
|
<code-block>
|
|
./test.pl --db-version=all --thread-max=<# threads>
|
|
</code-block>
|
|
Report regression test failures at https://github.com/pgmasters/backrest/issues.</text>
|
|
</install-system>
|
|
</install-system-list>
|
|
</install>
|
|
|
|
<config title="Configuration">
|
|
<text><backrest/> can be used entirely with command-line parameters but a configuration file is more practical for installations that are complex or set a lot of options. The default location for the configuration file is <file>/etc/pg_backrest.conf</file>.
|
|
|
|
Each system where <backrest/> is installed should have a repository owned by the user that will be running <backrest/> on that system. Normally this will be the <id>postgres</id> user on a database server and the <id>backrest</id> user on a backup server. See [repo-path](USERGUIDE.md#repo-path-key) for more information on how repositories are used.</text>
|
|
|
|
<config-example-list title="Examples">
|
|
<config-example title="Confguring Postgres for Archiving">
|
|
<text>Modify the following settings in <file>postgresql.conf</file>:
|
|
<code-block>
|
|
wal_level = archive
|
|
archive_mode = on
|
|
archive_command = '/path/to/backrest/bin/<exe/> --stanza=db archive-push %p'
|
|
</code-block>
|
|
Replace the path with the actual location where <backrest/> was installed. The stanza parameter should be changed to the actual stanza name for your database cluster.</text>
|
|
</config-example>
|
|
|
|
<config-example title="Minimal Configuration">
|
|
<text>The absolute minimum required to run <backrest/> (if all defaults are accepted) is the database cluster path.
|
|
|
|
<file>/etc/pg_backrest.conf</file>:
|
|
<code-block>
|
|
[main]
|
|
db-path=/data/db
|
|
</code-block>
|
|
The <setting>db-path</setting> option could also be provided on the command line, but it's best to use a configuration file as options tend to pile up quickly.</text>
|
|
</config-example>
|
|
|
|
<config-example title="Simple Single Host Configuration">
|
|
<text>This configuration is appropriate for a small installation where backups are being made locally or to a remote file system that is mounted locally. A number of additional options are set:
|
|
<ul>
|
|
<li><setting>db-port</setting> - Custom port for <postgres/>.</li>
|
|
<li><setting>compress</setting> - Disable compression (handy if the file system is already compressed).</li>
|
|
<li><setting>repo-path</setting> - Path to the <backrest/> repository where backups and WAL archive are stored.</li>
|
|
<li><setting>log-level-file</setting> - Set the file log level to debug (Lots of extra info if something is not working as expected).</li>
|
|
<li><setting>hardlink</setting> - Create hardlinks between backups (but never between full backups).</li>
|
|
<li><setting>thread-max</setting> - Use 2 threads for backup/restore operations.</li>
|
|
</ul>
|
|
<file>/etc/pg_backrest.conf</file>:
|
|
<code-block>
|
|
[global:general]
|
|
compress=n
|
|
repo-path=/path/to/db/repo
|
|
|
|
[global:log]
|
|
log-level-file=debug
|
|
|
|
[global:backup]
|
|
hardlink=y
|
|
thread-max=2
|
|
|
|
[main]
|
|
db-path=/data/db
|
|
db-port=5555
|
|
</code-block></text>
|
|
</config-example>
|
|
|
|
<config-example title="Simple Multiple Host Configuration">
|
|
<text>This configuration is appropriate for a small installation where backups are being made remotely. Make sure that postgres@db-host has trusted ssh to backrest@backup-host and vice versa. This configuration assumes that you have <exe/> in the same path on both servers.
|
|
|
|
<file>/etc/pg_backrest.conf</file> on the db host:
|
|
<code-block>
|
|
[global:general]
|
|
repo-path=/path/to/db/repo
|
|
repo-remote-path=/path/to/backup/repo
|
|
|
|
[global:backup]
|
|
backup-host=backup.mydomain.com
|
|
backup-user=backrest
|
|
|
|
[global:archive]
|
|
archive-async=y
|
|
|
|
[main]
|
|
db-path=/data/db
|
|
</code-block>
|
|
<file>/etc/pg_backrest.conf</file> on the backup host:
|
|
<code-block>
|
|
[global:general]
|
|
repo-path=/path/to/backup/repo
|
|
|
|
[main]
|
|
db-host=db.mydomain.com
|
|
db-path=/data/db
|
|
db-user=postgres
|
|
</code-block></text>
|
|
</config-example>
|
|
</config-example-list>
|
|
|
|
<config-section-list title="Setttings">
|
|
<!-- CONFIG - COMMAND SECTION -->
|
|
<config-section id="command">
|
|
<text>The <setting>command</setting> section defines the location of external commands that are used by <backrest/>.</text>
|
|
|
|
<config-key-list>
|
|
<!-- CONFIG - COMMAND SECTION - CMD-REMOTE KEY -->
|
|
<config-key id="cmd-remote">
|
|
<text>Defines the location of <cmd>pg_backrest_remote.pl</cmd>.
|
|
|
|
Required only if the path to <cmd>pg_backrest_remote.pl</cmd> is different on the local and remote systems. If not defined, the remote path will be assumed to be the same as the local path.</text>
|
|
|
|
<default>same as local</default>
|
|
<example>/usr/lib/backrest/bin/pg_backrest_remote.pl</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - LOG -->
|
|
<config-section id="log">
|
|
<text>The <setting>log</setting> section defines logging-related settings. The following log levels are supported:
|
|
<ul>
|
|
<li><id>off</id> - No logging at all (not recommended)</li>
|
|
<li><id>error</id> - Log only errors</li>
|
|
<li><id>warn</id> - Log warnings and errors</li>
|
|
<li><id>info</id> - Log info, warnings, and errors</li>
|
|
<li><id>debug</id> - Log debug, info, warnings, and errors</li>
|
|
<li><id>trace</id> - Log trace (very verbose debugging), debug, info, warnings, and errors</li>
|
|
</ul></text>
|
|
|
|
<!-- CONFIG - LOG SECTION - LEVEL-FILE KEY -->
|
|
<config-key-list>
|
|
<config-key id="log-level-file">
|
|
<text>Sets file log level.</text>
|
|
|
|
<example>debug</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - LOG SECTION - LEVEL-CONSOLE KEY -->
|
|
<config-key id="log-level-console">
|
|
<text>Sets console log level.</text>
|
|
|
|
<example>error</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - GENERAL -->
|
|
<config-section id="general">
|
|
<text>The <setting>general</setting> section defines settings that are shared between multiple operations.</text>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - BUFFER-SIZE KEY -->
|
|
<config-key-list>
|
|
<config-key id="buffer-size">
|
|
<text>Set the buffer size used for copy, compress, and uncompress functions. A maximum of 3 buffers will be in use at a time per thread. An additional maximum of 256K per thread may be used for zlib buffers.</text>
|
|
|
|
<allow>16384 - 8388608</allow>
|
|
<example>32768</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - COMPRESS -->
|
|
<config-key id="compress">
|
|
<text>Enable gzip compression. Backup files are compatible with command-line gzip tools.</text>
|
|
|
|
<example>n</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - COMPRESS-LEVEL KEY -->
|
|
<config-key id="compress-level">
|
|
<text>Sets the zlib level to be used for file compression when <setting>compress=y</setting>.</text>
|
|
|
|
<allow>0-9</allow>
|
|
<example>9</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - COMPRESS-LEVEL-NETWORK KEY -->
|
|
<config-key id="compress-level-network">
|
|
<text>Sets the zlib level to be used for protocol compression when <setting>compress=n</setting> and the database cluster is not on the same host as the backup. Protocol compression is used to reduce network traffic but can be disabled by setting <setting>compress-level-network=0</setting>. When <setting>compress=y</setting> the <setting>compress-level-network</setting> setting is ignored and <setting>compress-level</setting> is used instead so that the file is only compressed once. SSH compression is always disabled.</text>
|
|
|
|
<allow>0-9</allow>
|
|
<example>1</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - NEUTRAL-UMASK -->
|
|
<config-key id="neutral-umask">
|
|
<text>Sets the umask to 0000 so modes in the repository as created in a sensible way. The default directory mode is 0750 and default file mode is 0640. The lock and log directories set the directory and file mode to 0770 and 0660 respectively.
|
|
|
|
To use the executing user's umask instead specify <setting>neutral-umask=n</setting> in the config file or <setting>--no-neutral-umask</setting> on the command line.</text>
|
|
|
|
<example>n</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - REPO-PATH KEY -->
|
|
<config-key id="repo-path">
|
|
<text>Path to the backrest repository where WAL segments, backups, logs, etc are stored.
|
|
|
|
The repository serves as both storage and working area for pgBackRest. In a simple installation where the backups are stored locally to the database server there will be only one repository which will contain everything: backups, archives, logs, locks, etc.
|
|
|
|
If the backups are being done remotely then the backup server's repository will contain backups, archives, locks and logs while the database server's repository will contain only locks and logs. However, if asynchronous archving is enabled then the database server's repository will also contain a spool directory for archive logs that have not yet been pushed to the remote repository.
|
|
|
|
Each system where <backrest/> is installed should have a repository directory configured. Storage requirements vary based on usage. The main backup repository will need the most space as it contains both backups and WAL segments for whatever retention you have specified. The database repository only needs significant space if asynchronous archiving is enabled and then it will act as an overflow for WAL segments and might need to be large depending on your database activity.
|
|
|
|
If you are new to backup then it will be difficult to estimate in advance how much space you'll need. The best thing to do it take some backups then record the size of different types of backups (full/incr/diff) and measure the amount of WAL generated per day. This will give you a general idea of how much space you'll need, though of course requirements will change over time as your database evolves.
|
|
</text>
|
|
|
|
<example>/data/db/backrest</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - GENERAL SECTION - REPO-REMOTE-PATH KEY -->
|
|
<config-key id="repo-remote-path">
|
|
<text>Path to the remote backrest repository where WAL segments, backups, logs, etc are stored.
|
|
|
|
The remote repository is relative to the current installation of <backrest/>. On a database server the backup server will be remote and visa versa for the backup server where the database server will be remote. This option is only required if the remote repository is in a different location than the local repository.</text>
|
|
|
|
<example>/backup/backrest</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - BACKUP -->
|
|
<config-section id="backup">
|
|
<text>The <setting>backup</setting> section defines settings related to backup.</text>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - BACKUP-HOST KEY -->
|
|
<config-key-list>
|
|
<config-key id="backup-host">
|
|
<text>Sets the backup host when backup up remotely via SSH. Make sure that trusted SSH authentication is configured between the db host and the backup host.
|
|
|
|
When backing up to a locally mounted network filesystem this setting is not required.</text>
|
|
|
|
<example>backup.domain.com</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - BACKUP-USER KEY -->
|
|
<config-key id="backup-user">
|
|
<text>Sets user account on the backup host.</text>
|
|
|
|
<example>backrest</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - DB-TIMEOUT KEY -->
|
|
<config-key id="db-timeout">
|
|
<text>Sets the timeout for operations against the database during the backup. This includes the <code>pg_start_backup()</code> and <code>pg_stop_backup()</code> functions which can each take a substantial amount of time. Because of this the timeout should be kept high unless you know that these functions will return quickly (i.e. if you have set <setting>startfast=y</setting> and you know that the database cluster will not generate many WAL segments during the backup).</text>
|
|
|
|
<example>600</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - STOP-AUTO -->
|
|
<config-key id="stop-auto">
|
|
<text>Automatically stops a prior failed backup when a new backup is run. This will only be done if an exclusive advisory lock can be acquired to demonstrate that the prior failed backup process has really stopped.
|
|
|
|
This feature relies on pg_is_in_backup() so only works on <postgres/> >= <id>9.3</id>.
|
|
|
|
The setting is disabled by default because it assumes that <backrest/> is the only process doing exclusive online backups. It depends on an advisory lock that only <backrest/> sets so it may abort other processes that do exclusive online backups. Note that <cmd>base_backup</cmd> and <cmd>pg_dump</cmd> are safe to use with this setting because they do not call <code>pg_start_backup()</code> so are not exclusive.
|
|
</text>
|
|
|
|
<example>y</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - START-FAST -->
|
|
<config-key id="start-fast">
|
|
<text>Forces a checkpoint (by passing <id>true</id> to the <id>fast</id> parameter of <code>pg_start_backup()</code>) so the backup begins immediately. Otherwise the backup will start after the next regular checkpoint.
|
|
|
|
This feature only works in <postgres/> <= <id>8.3</id>.</text>
|
|
|
|
<example>y</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - HARDLINK -->
|
|
<config-key id="hardlink">
|
|
<text>Enable hard-linking of files in differential and incremental backups to their full backups. This gives the appearance that each backup is a full backup. Be careful, though, because modifying files that are hard-linked can affect all the backups in the set.</text>
|
|
|
|
<example>y</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - MANIFEST-SAVE-THRESHOLD -->
|
|
<config-key id="manifest-save-threshold">
|
|
<text>Defines how often the manifest will be saved during a backup (in bytes). Saving the manifest is important because it stores the checksums and allows the resume function to work efficiently. The actual threshold used is 1% of the backup size or <setting>manifest-save-threshold</setting>, whichever is greater.</text>
|
|
|
|
<example>5368709120</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - RESUME -->
|
|
<config-key id="resume">
|
|
<text>Defines whether the resume feature is enabled. Resume can greatly reduce the amount of time required to run a backup after a previous backup of the same type has failed. It adds complexity, however, so it may be desirable to disable in environments that do not require the feature.</text>
|
|
|
|
<example>false</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - THEAD-MAX -->
|
|
<config-key id="thread-max">
|
|
<text>Defines the number of threads to use for backup or restore. Each thread will perform compression and transfer to make the backup run faster, but don't set <setting>thread-max</setting> so high that it impacts database performance during backup.</text>
|
|
|
|
<example>4</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - THEAD-TIMEOUT -->
|
|
<config-key id="thread-timeout">
|
|
<text>Maximum amount of time (in seconds) that a backup thread should run. This limits the amount of time that a thread might be stuck due to unforeseen issues during the backup. Has no affect when <setting>thread-max=1</setting>.</text>
|
|
|
|
<example>3600</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - ARCHIVE-CHECK -->
|
|
<config-key id="archive-check">
|
|
<text>Checks that all WAL segments required to make the backup consistent are present in the WAL archive. It's a good idea to leave this as the default unless you are using another method for archiving.</text>
|
|
|
|
<example>n</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - BACKUP SECTION - ARCHIVE-COPY -->
|
|
<config-key id="archive-copy">
|
|
<text>Store WAL segments required to make the backup consistent in the backup's pg_xlog path. This slightly paranoid option protects against corruption or premature expiration in the WAL segment archive. PITR won't be possible without the WAL segment archive and this option also consumes more space.
|
|
|
|
Even though WAL segments will be restored with the backup, <postgres/> will ignore them if a <file>recovery.conf</file> file exists and instead use <setting>archive_command</setting> to fetch WAL segments. Specifying <setting>type=none</setting> when restoring will not create <file>recovery.conf</file> and force <postgres/> to use the WAL segments in pg_xlog. This will get the database cluster to a consistent state.</text>
|
|
|
|
<example>y</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - ARCHIVE -->
|
|
<config-section id="archive">
|
|
<text>The <setting>archive</setting> section defines parameters when doing async archiving. This means that the archive files will be stored locally, then a background process will pick them and move them to the backup.</text>
|
|
|
|
<config-key-list>
|
|
<!-- CONFIG - ARCHIVE SECTION - ARCHIVE-ASYNC KEY -->
|
|
<config-key id="archive-async">
|
|
<text>Archive WAL segments asynchronously. WAL segments will be copied to the local repo, then a process will be forked to compress the segment and transfer it to the remote repo if configured. Control will be returned to <postgres/> as soon as the WAL segment is copied locally.</text>
|
|
|
|
<example>y</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - ARCHIVE SECTION - ARCHIVE-MAX-MB KEY -->
|
|
<config-key id="archive-max-mb">
|
|
<text>Limits the amount of archive log that will be written locally when <setting>archive-async=y</setting>. After the limit is reached, the following will happen:
|
|
<ol>
|
|
<li><backrest/> will notify Postgres that the archive was successfully backed up, then DROP IT.</li>
|
|
<li>An error will be logged to the console and also to the Postgres log.</li>
|
|
<li>A stop file will be written in the lock directory and no more archive files will be backed up until it is removed.</li>
|
|
</ol>
|
|
If this occurs then the archive log stream will be interrupted and PITR will not be possible past that point. A new backup will be required to regain full restore capability.
|
|
|
|
The purpose of this feature is to prevent the log volume from filling up at which point Postgres will stop completely. Better to lose the backup than have <postgres/> go down.
|
|
|
|
To start normal archiving again you'll need to remove the stop file which will be located at <file>${repo-path}/lock/${stanza}-archive.stop</file> where <code>${repo-path}</code> is the path set in the <setting>general</setting> section, and <code>${stanza}</code> is the backup stanza.</text>
|
|
|
|
<example>1024</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - RESTORE -->
|
|
<config-section id="restore">
|
|
<text>The <setting>restore</setting> section defines settings used for restoring backups.</text>
|
|
|
|
<config-key-list>
|
|
<!-- CONFIG - RESTORE SECTION - TABLESPACE KEY -->
|
|
<config-key id="tablespace">
|
|
<text>Defines whether tablespaces will be be restored into their original (or remapped) locations or stored directly under the <path>pg_tblspc</path> path. Disabling this setting produces compact restores that are convenient for development, staging, etc. Currently these restores cannot be backed up as <backrest/> expects only links in the <path>pg_tblspc</path> path. If no tablespaces are present this this setting has no effect.</text>
|
|
|
|
<example>n</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - EXPIRE -->
|
|
<config-section id="expire">
|
|
<text>The <setting>expire</setting> section defines how long backups will be retained. Expiration only occurs when the number of complete backups exceeds the allowed retention. In other words, if full-retention is set to 2, then there must be 3 complete backups before the oldest will be expired. Make sure you always have enough space for retention + 1 backups.</text>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - FULL-RETENTION KEY -->
|
|
<config-key-list>
|
|
<config-key id="retention-full">
|
|
<text>Number of full backups to keep. When a full backup expires, all differential and incremental backups associated with the full backup will also expire. When not defined then all full backups will be kept.</text>
|
|
|
|
<example>2</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DIFFERENTIAL-RETENTION KEY -->
|
|
<config-key id="retention-diff">
|
|
<text>Number of differential backups to keep. When a differential backup expires, all incremental backups associated with the differential backup will also expire. When not defined all differential backups will be kept.</text>
|
|
|
|
<example>3</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - ARCHIVE-RETENTION-TYPE KEY -->
|
|
<config-key id="retention-archive-type">
|
|
<text>Type of backup to use for archive retention (full or differential). If set to full, then <backrest/> will keep archive logs for the number of full backups defined by <setting>retention-archive</setting>. If set to differential, then <backrest/> will keep archive logs for the number of differential backups defined by <setting>retention-archive</setting>.
|
|
|
|
If not defined then archive logs will be kept indefinitely. In general it is not useful to keep archive logs that are older than the oldest backup, but there may be reasons for doing so.</text>
|
|
|
|
<example>diff</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - ARCHIVE-RETENTION KEY -->
|
|
<config-key id="retention-archive">
|
|
<text>Number of backups worth of archive log to keep. If this is set less than your backup retention then be sure you set <setting>archive-copy=y</setting> or you won't be able to restore some older backups.
|
|
|
|
For example, if <setting>retention-archive=2</setting> and <setting>retention-full=4</setting>, then any backups older than the most recent two full backups will not have WAL segments in the archive to make them consistent. To solve this, set <setting>archive-copy=y</setting> and use <setting>type=none</setting> when restoring. This issue will be addressed in a future release but for now be careful with this setting.</text>
|
|
|
|
<example>2</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
|
|
<!-- CONFIG - STANZA -->
|
|
<config-section id="stanza">
|
|
<text>A stanza defines the backup configuration for a specific <postgres/> database cluster. The stanza section must define the database cluster path and host/user if the database cluster is remote. Also, any global configuration sections can be overridden to define stanza-specific settings.</text>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DB-HOST KEY -->
|
|
<config-key-list>
|
|
<config-key id="db-host">
|
|
<text>Define the database cluster host. Used for backups where the database cluster host is different from the backup host.</text>
|
|
|
|
<example>db.domain.com</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DB-USER KEY -->
|
|
<config-key id="db-user">
|
|
<text>Defines the logon user when <setting>db-host</setting> is defined. This user will also own the remote <backrest/> process and will initiate connections to <postgres/>. For this to work correctly the user should be the <postgres/> database cluster owner which is generally <id>postgres</id>, the default.</text>
|
|
|
|
<example>test_user</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DB-PATH KEY -->
|
|
<config-key id="db-path">
|
|
<text>Path to the db data directory (data_directory setting in postgresql.conf).</text>
|
|
|
|
<example>/data/db</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DB-PORT KEY -->
|
|
<config-key id="db-port">
|
|
<text>Port that <postgres/> is running on. This usually does not need to be specified as most database clusters run on the default port.</text>
|
|
|
|
<example>6543</example>
|
|
</config-key>
|
|
|
|
<!-- CONFIG - RETENTION SECTION - DB-SOCKET-PATH KEY -->
|
|
<config-key id="db-socket-path">
|
|
<text>The unix socket directory that was specified when <postgres/> was started. <backrest/> will automatically look in the standard location for your OS so there usually no need to specify this setting unless the socket directory was explicily modified with the <setting>unix_socket_directory</setting> setting in <file>postgressql.conf</file>.</text>
|
|
|
|
<example>/var/run/postgresql</example>
|
|
</config-key>
|
|
</config-key-list>
|
|
</config-section>
|
|
</config-section-list>
|
|
</config>
|
|
|
|
<operation title="Commands">
|
|
<operation-general title="General Options">
|
|
<text>These options are either global or used by all commands.</text>
|
|
|
|
<option-list>
|
|
<!-- OPERATION - GENERAL - CONFIG OPTION -->
|
|
<option id="config">
|
|
<text>By default <backrest/> expects the its configuration file to be located at `/etc/pg_backrest.conf`. Use this option to specify another location.</text>
|
|
|
|
<example>/var/lib/backrest/pg_backrest.conf</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - GENERAL - STANZA OPTION -->
|
|
<option id="stanza">
|
|
<text>Defines the stanza for the command. A stanza is the configuration for a <postgres/> database cluster that defines where it is located, how it will be backed up, archiving options, etc. Most db servers will only have one Postgres database cluster and therefore one stanza, whereas backup servers will have a stanza for every database cluster that needs to be backed up.
|
|
|
|
Examples of how to configure a stanza can be found in the `configuration examples` section.</text>
|
|
|
|
<example>main</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - GENERAL - HELP OPTION -->
|
|
<option id="help">
|
|
<text>Displays the <backrest/> help.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - GENERAL - VERSION OPTION -->
|
|
<option id="version">
|
|
<text>Displays the <backrest/> version.</text>
|
|
</option>
|
|
</option-list>
|
|
</operation-general>
|
|
|
|
<command-list title="Commands">
|
|
<!-- OPERATION - BACKUP COMMAND -->
|
|
<command id="backup">
|
|
<text>Perform a database cluster backup. <backrest/> does not have a built-in scheduler so it's best to run it from cron or some other scheduling mechanism.</text>
|
|
|
|
<option-list>
|
|
<!-- OPERATION - BACKUP COMMAND - TYPE OPTION -->
|
|
<option id="type">
|
|
<text>The following backup types are supported:
|
|
<ul>
|
|
<li><id>full</id> - all database cluster files will be copied and there will be no dependencies on previous backups.</li>
|
|
<li><id>incr</id> - incremental from the last successful backup.</li>
|
|
<li><id>diff</id> - like an incremental backup but always based on the last full backup.</li>
|
|
</ul></text>
|
|
|
|
<example>full</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - BACKUP COMMAND - NO-START-STOP OPTION -->
|
|
<option id="no-start-stop">
|
|
<text>This option prevents <backrest/> from running <code>pg_start_backup()</code> and <code>pg_stop_backup()</code> on the database cluster. In order for this to work <postgres/> should be shut down and <backrest/> will generate an error if it is not.
|
|
|
|
The purpose of this option is to allow cold backups. The <path>pg_xlog</path> directory is copied as-is and <setting>archive-check</setting> is automatically disabled for the backup.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - BACKUP COMMAND - FORCE OPTION -->
|
|
<option id="force">
|
|
<text>When used with <param>--no-start-stop</param> a backup will be run even if <backrest/> thinks that <postgres/> is running. <b>This option should be used with extreme care as it will likely result in a bad backup.</b>
|
|
|
|
There are some scenarios where a backup might still be desirable under these conditions. For example, if a server crashes and the database cluster volume can only be mounted read-only, it would be a good idea to take a backup even if <file>postmaster.pid</file> is present. In this case it would be better to revert to the prior backup and replay WAL, but possibly there is a very important transaction in a WAL segment that did not get archived.</text>
|
|
</option>
|
|
</option-list>
|
|
|
|
<command-example-list>
|
|
<command-example title="Full Backup">
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db --type=full backup
|
|
</code-block>
|
|
Run a <id>full</id> backup on the <id>db</id> stanza. <param>--type</param> can also be set to <id>incr</id> or <id>diff</id> for incremental or differential backups. However, if no <id>full</id> backup exists then a <id>full</id> backup will be forced even if <id>incr</id> or <id>diff</id> is requested.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
|
|
<!-- OPERATION - ARCHIVE-PUSH COMMAND -->
|
|
<command id="archive-push">
|
|
<text>Archive a WAL segment to the repository.</text>
|
|
|
|
<command-example-list>
|
|
<command-example>
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db archive-push %p
|
|
</code-block>
|
|
Accepts a WAL segment from <postgres/> and archives it in the repository defined by <setting>repo-path</setting>. <param>%p</param> is how <postgres/> specifies the location of the WAL segment to be archived.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
|
|
<!-- OPERATION - ARCHIVE-GET COMMAND -->
|
|
<command id="archive-get">
|
|
<text>Get a WAL segment from the repository.</text>
|
|
|
|
<command-example-list>
|
|
<command-example>
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db archive-get %f %p
|
|
</code-block>
|
|
Retrieves a WAL segment from the repository. This command is used in <file>recovery.conf</file> to restore a backup, perform PITR, or as an alternative to streaming for keeping a replica up to date. <param>%f</param> is how <postgres/> specifies the WAL segment it needs and <param>%p</param> is the location where it should be copied.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
|
|
<!-- OPERATION - EXPIRE COMMAND -->
|
|
<command id="expire">
|
|
<text><backrest/> does backup rotation, but is not concerned with when the backups were created. So if two full backups are configured for retention, <backrest/> will keep two full backups no matter whether they occur, two hours apart or two weeks apart.</text>
|
|
|
|
<command-example-list>
|
|
<command-example>
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db expire
|
|
</code-block>
|
|
Expire (rotate) any backups that exceed the defined retention. Expiration is run automatically after every successful backup, so there is no need to run this command separately unless you have reduced retention, usually to free up some space.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND -->
|
|
<command id="restore">
|
|
<text>Perform a database cluster restore. This command is generally run manually, but there are instances where it might be automated.</text>
|
|
<option-list>
|
|
<!-- OPERATION - RESTORE COMMAND - SET OPTION -->
|
|
<option id="set">
|
|
<text>The backup set to be restored. <id>latest</id> will restore the latest backup, otherwise provide the name of the backup to restore.</text>
|
|
<example>20150131-153358F_20150131-153401I</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - DELTA OPTION -->
|
|
<option id="delta">
|
|
<text>By default the <postgres/> data and tablespace directories are expected to be present but empty. This option performs a delta restore using checksums.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - FORCE OPTION -->
|
|
<option id="force">
|
|
<text>By itself this option forces the <postgres/> data and tablespace paths to be completely overwritten. In combination with <param>--delta</param> a timestamp/size delta will be performed instead of using checksums.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TYPE OPTION -->
|
|
<option id="type">
|
|
<text>The following recovery types are supported:
|
|
<ul>
|
|
<li><id>default</id> - recover to the end of the archive stream.</li>
|
|
<li><id>name</id> - recover the restore point specified in <param>--target</param>.</li>
|
|
<li><id>xid</id> - recover to the transaction id specified in <param>--target</param>.</li>
|
|
<li><id>time</id> - recover to the time specified in <param>--target</param>.</li>
|
|
<li><id>preserve</id> - preserve the existing <file>recovery.conf</file> file.</li>
|
|
<li><id>none</id> - no <file>recovery.conf</file> file is written so <postgres/> will attempt to achieve consistency using WAL segments present in <path>pg_xlog</path>. Provide the required WAL segments or use the <setting>archive-copy</setting> setting to include them with the backup.</li>
|
|
</ul></text>
|
|
<example>xid</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TARGET OPTION -->
|
|
<option id="target">
|
|
<text>Defines the recovery target when <param>--type</param> is <id>name</id>, <id>xid</id>, or <id>time</id>.</text>
|
|
<example>2015-01-30 14:15:11 EST</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TARGET-EXCLUSIVE OPTION -->
|
|
<option id="target-exclusive">
|
|
<text>Defines whether recovery to the target would be exclusive (the default is inclusive) and is only valid when <param>--type</param> is <id>time</id> or <id>xid</id>. For example, using <param>--target-exclusive</param> would exclude the contents of transaction <id>1007</id> when <param>--type=xid</param> and <param>--target=1007</param>. See <param>recovery_target_inclusive</param> option in the <postgres/> docs for more information.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TARGET-RESUME OPTION -->
|
|
<option id="target-resume">
|
|
<text>Specifies whether recovery should resume when the recovery target is reached. See <setting>pause_at_recovery_target</setting> in the <postgres/> docs for more information.</text>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TARGET-TIMELINE OPTION -->
|
|
<option id="target-timeline">
|
|
<text>Recovers along the specified timeline. See <setting>recovery_target_timeline</setting> in the <postgres/> docs for more information.</text>
|
|
<example>3</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - RECOVERY-SETTING OPTION -->
|
|
<option id="recovery-setting">
|
|
<text>Recovery settings in recovery.conf options can be specified with this option. See http://www.postgresql.org/docs/X.X/static/recovery-config.html for details on recovery.conf options (replace X.X with your <postgres/> version). This option can be used multiple times.
|
|
|
|
Note: <setting>restore_command</setting> will be automatically generated but can be overridden with this option. Be careful about specifying your own <setting>restore_command</setting> as <backrest/> is designed to handle this for you. Target Recovery options (recovery_target_name, recovery_target_time, etc.) are generated automatically by <backrest/> and should not be set with this option.
|
|
|
|
Recovery settings can also be set in the <setting>restore:recovery-setting</setting> section of pg_backrest.conf. For example:
|
|
<code-block>
|
|
[restore:recovery-setting]
|
|
primary_conn_info=db.mydomain.com
|
|
standby_mode=on
|
|
</code-block>
|
|
Since <backrest/> does not start <postgres/> after writing the <file>recovery.conf</file> file, it is always possible to edit/check <file>recovery.conf</file> before manually restarting.</text>
|
|
<example>primary_conninfo=db.mydomain.com</example>
|
|
</option>
|
|
|
|
<!-- OPERATION - RESTORE COMMAND - TABLESPACE-MAP OPTION -->
|
|
<option id="tablespace-map">
|
|
<text>Moves a tablespace to a new location during the restore. This is useful when tablespace locations are not the same on a replica, or an upgraded system has different mount points.
|
|
|
|
Since <postgres/> 9.2 tablespace locations are not stored in pg_tablespace so moving tablespaces can be done with impunity. However, moving a tablespace to the <setting>data_directory</setting> is not recommended and may cause problems. For more information on moving tablespaces http://www.databasesoup.com/2013/11/moving-tablespaces.html is a good resource.</text>
|
|
<example>ts_01=/db/ts_01</example>
|
|
</option>
|
|
</option-list>
|
|
|
|
<command-example-list>
|
|
<command-example title="Restore Latest">
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db --type=name --target=release restore
|
|
</code-block>
|
|
Restores the latest database cluster backup and then recovers to the <id>release</id> restore point.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
|
|
<!-- OPERATION - INFO COMMAND -->
|
|
<command id="info">
|
|
<text>Retrieve information about backups for a single stanza or for all stanzas. Text output is the default and gives a human-readable summary of backups for the stanza(s) requested. This format is subject to change with any release.
|
|
|
|
For machine-readable output use <setting>--output=json</setting>. The JSON output contains far more information than the text output, however <b>this feature is currently experimental so the format may change between versions</b>.</text>
|
|
|
|
<option-list>
|
|
<!-- OPERATION - INFO COMMAND - OUTPUT OPTION -->
|
|
<option id="output">
|
|
<text>The following output types are supported:
|
|
<ul>
|
|
<li><id>text</id> - Human-readable summary of backup information.</li>
|
|
<li><id>json</id> - Exhaustive machine-readable backup information in JSON format.</li>
|
|
</ul></text>
|
|
|
|
<example>json</example>
|
|
</option>
|
|
</option-list>
|
|
|
|
<command-example-list>
|
|
<command-example title="Information for a single stanza">
|
|
<text><code-block>
|
|
/path/to/<exe/> --stanza=db --output=json info
|
|
</code-block>
|
|
|
|
Get information about backups in the <id>db</id> stanza.</text>
|
|
</command-example>
|
|
|
|
<command-example title="Information for all stanzas">
|
|
<text><code-block>
|
|
/path/to/<exe/> --output=json info
|
|
</code-block>
|
|
|
|
Get information about backups for all stanzas in the repository.</text>
|
|
</command-example>
|
|
</command-example-list>
|
|
</command>
|
|
</command-list>
|
|
</operation>
|
|
</doc>
|