1
0
mirror of https://github.com/postgrespro/pg_probackup.git synced 2025-03-27 22:41:59 +02:00

3528 Commits

Author SHA1 Message Date
Yura Sokolov
25e63c5a7c raw strings in python regex; ignore generated transation files
Author: Sergey Fukanchik
2022-12-08 07:44:12 +03:00
Victor Spirin
15c304ad6c [PBCKP-375] Prepared for moving RelFileNode to RelFileLocator in the PG16. 2022-12-07 14:21:50 +03:00
Daniel Shelepanov
3bc0fc4b81 Documentation hot fix 2022-12-07 13:35:25 +03:00
Yura Sokolov
29a9efb4d4 [PBCKP-325] refix test_issue_231
to make two backups in one second we have to fail them.
Therefore we have to fetch backup_id from log in exception's message.

Retry for 20 seconds to have a chance to start in one second.
If we couldn't, lets skip the test.
2022-12-06 14:17:04 +03:00
Yura Sokolov
bef73b8ba6 more usages for table_checksum 2022-12-06 01:59:14 +03:00
Yura Sokolov
6bd71d866d [PBCKP-382] and another one Pg15 pg_backup_stop() 2022-12-06 01:51:22 +03:00
Yuriy Sokolov
f032861577 Merge branch 'PBCKP-382-bug_15_compat' into 'REL_2_5'
[PBCKP-382] version 15 compatibility bug

See merge request eepbk/pg_probackup_ee!13
2022-12-06 01:50:00 +03:00
Yura Sokolov
3109634ecb [PBCKP-325] change test_issue_231 to check backup id are different 2022-12-05 15:49:12 +03:00
Daniel Shelepanov
c42f68ecca [PBCKP-382] version 15 compatibility bug 2022-12-05 11:21:19 +03:00
Yura Sokolov
0f7e01b7f3 try travis without docker 2022-12-04 14:16:02 +03:00
Yura Sokolov
f2f47f7734 get rid of plpython usage 2022-12-04 05:33:52 +03:00
Yura Sokolov
fc50cf0ddf tests: fix
travis uses old image with python3.5
2022-12-04 04:24:55 +03:00
Yura Sokolov
02e3fb0477 tests: table_checksum needs no sorting in fact
since we are compare table content exactly
2022-12-04 04:15:55 +03:00
Yura Sokolov
8d8a92c1d1 tests: more usages for table_checksum
and reduce batch twice for sanity
2022-12-02 16:56:54 +03:00
Yura Sokolov
9bcefb2569 [PBCKP-327] test_ptrack_multiple_segments: try to avoid memory consumption 2022-12-02 15:10:22 +03:00
Alexander Burtsev
744c2858e9
Merge pull request #578 from postgrespro/REL-2_5_PBCKP-320
[DOC] {PBCKP-320] Remove duplicate descriptions of backup/catchup mod…
2022-12-01 15:11:36 +03:00
Yura Sokolov
619816012a fix ArchiveTest.test_pgpro434_4 for Pg15 2022-11-30 21:50:20 +03:00
Yura Sokolov
8fa063f688 travis: and backup_test 2022-11-30 16:34:00 +03:00
Elena Indrupskaya
7e59a19df1 [DOC] {PBCKP-320] Remove duplicate descriptions of backup/catchup modes [skip-travis] 2022-11-30 15:56:41 +03:00
Yura Sokolov
3b2efe63a2 and again try fix travis tests.init_test 2022-11-30 14:58:36 +03:00
Yura Sokolov
e2dd78a99e Merge branch 'REL_2_5-PBCKP-360' into REL_2_5 2022-11-29 20:17:46 +03:00
Yura Sokolov
3b72dd66af fix github tests.init_test 2022-11-29 16:24:49 +03:00
Yura Sokolov
0a5fc87dbd [PBCKP-360] fix exception check in test_validate_corrupt_page_header_map
zlib decompression could mark error either as "data error" or
"buffer error". One of check did consider it, other didn't.

Make them same.

And use `assertRaises` for good (requires python 3.2 at least)
2022-11-29 15:13:34 +03:00
Yura Sokolov
887fb82a2c Merge branch 'master' into REL_2_5 2022-11-29 11:56:40 +03:00
Yura Sokolov
15a5c5dad7 [PBCKP-354] Pg15: continue reading if error "missing contrecord" is met.
Pg15 now reports if it didn't met expected contrecord. Absence of this
message was long standing bug in previous postgres versions.

This situation could happen if WAL segment was rewritten after restart.

It causes "tests.validate.ValidateTest.test_validate_wal_unreal_values"
to hang but (looks like) for other reason: test tries to read "in future".

Probably we should stop reading logs here. But since we always did
continue here, lets continue as well.
2022-11-29 11:12:20 +03:00
Yura Sokolov
be949fd91e fix memory leak in config_get_opt 2022-11-25 16:23:56 +03:00
Viktoria Shepard
0e1227b29f Merge branch 'REL_2_5-PBCKP-306-test-report' into 'REL_2_5'
PBCKP-306 add '_test' to test files

See merge request eepbk/pg_probackup_ee!2
2022-11-25 12:57:44 +03:00
Viktoria Shepard
d049466287 PBCKP-306 add '_test' to test files 2022-11-25 12:57:43 +03:00
Yura Sokolov
440441dc6f ... fix names 2022-11-25 11:26:54 +03:00
Yura Sokolov
1617eb34ec tests: prettify pgdata_content and compare_pgdata 2022-11-25 11:03:52 +03:00
Yura Sokolov
20667e9594 tests: better directory collection in pgdata_content
There is no need to walk pgdata twice.
We could delete parent directories instead of skipping them.
2022-11-25 08:31:00 +03:00
Yura Sokolov
19a7c5b01f tests: do not read whole file at once for digest. Iterate instead. 2022-11-25 07:59:14 +03:00
Yura Sokolov
7eab6e3463 [PBCKP-358] sort directories to not skip 'base/1' because of 'base/12699'
Looks like os.walk may yield dirs unsorted.
This way "check if directory already here as part of larger directory"
man mistakenly skip short 'base/1' as "part of" 'base/12699'
2022-11-25 07:58:08 +03:00
Yura Sokolov
b7a183081e [PBCKP-357] fix UnicodeDecodeError
Got in some tests:
```
Traceback (most recent call last):
  File "pg_probackup/tests/replica.py", line 625, in test_replica_stop_lsn_null_offset
    gdb_checkpointer = self.gdb_attach(bgwriter_pid)
  File "pg_probackup/tests/helpers/ptrack_helpers.py", line 1984, in gdb_attach
    return GDBobj([str(pid)], self, attach=True)
  File "pg_probackup/tests/helpers/ptrack_helpers.py", line 2054, in __init__
    line = self.get_line()
  File "pg_probackup/tests/helpers/ptrack_helpers.py", line 2065, in get_line
    line = self.proc.stdout.readline()
  File "/usr/lib/python3.10/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd0 in position 189: invalid continuation byte
```
Fixed with `errors='replace'`
2022-11-25 06:40:07 +03:00
Yura Sokolov
73cce507c2 [PBCKP-358] fix CatchupTest.test_unclean_(delta|ptrack)_catchup
and BugTest.test_minrecpoint_on_replica as well

Tests were broken with introduction of "startness" handling in
    9924ab014 [PBCKP-304] extended testgres.PosgresNode to ...
since tests uses os.kill directly.
2022-11-25 04:20:29 +03:00
Yura Sokolov
e674202eac test_backup_via_unprivileged_user - test with ptrack correctly 2022-11-24 14:42:12 +03:00
Yura Sokolov
8488b289ba fix test_backup_via_unprivileged_user with ptrack enabled
It is garbage remained from old ptrack version support.
2022-11-24 14:23:45 +03:00
Yura Sokolov
08557855e2 fix error
During refactoring base36enc it were mistakenly changed from
current_backup->start_time to current_backup->parent_backup
2022-11-24 12:30:25 +03:00
v.shepard
4c09debe6f Revert "PBCKP-306 add '_test' to tests files"
This reverts commit 2b8a1532350af09eed827f3024f8f4a30baf04fb.
2022-11-24 10:26:35 +01:00
v.shepard
2b8a153235 PBCKP-306 add '_test' to tests files 2022-11-24 10:23:59 +01:00
Yura Sokolov
87dd3f2021 base36enc(backup->backup_id) -> backup_id_of(backup)
Here we assume backup_id == start_time.
It is really so at the moment, but could change in future.

Well, it almost always same. Sometime backup_id is set
while start_time is not set yet (backup creation). And
we had to fix places where start_time were changed without
change of backup_id.
2022-11-23 20:51:20 +03:00
Yura Sokolov
44fef8894e a bit more backup_id_of 2022-11-23 17:50:51 +03:00
Yura Sokolov
71f8ccf4cd replace base36enc(backup->start_time) with helper backup_id_of(backup)
Lazily store encoded backup_id in backup itself.
2022-11-23 17:21:31 +03:00
Yura Sokolov
20e12edc80 fix one of backup_id output. 2022-11-23 17:21:31 +03:00
Yura Sokolov
22e6c408fe base36enc: abuse C99 compound literals lifetime.
C99 introduced compound literals (`(char[14]){0}` - literal of array).
Compound literals have same lifetime as block local variable, ie till
the end of block. There for it is save to initiate several of them in
same block and assume they are all live.

This way we may rewrite base36enc into macros which uses compound
literal instead of static variable to extend its result lifetime.
2022-11-23 17:21:31 +03:00
Ivan Lazarev
eed28135b9 hotfix: cfs_restore.py decorated to postgres enterprise only 2022-11-23 13:47:26 +03:00
Victor Spirin
8f20e7eb58 Fixed link in README.md file [ci skip] 2022-11-17 18:50:17 +03:00
Yura Sokolov
97f3e70edb asyncio.sleep -> time.sleep 2022-11-17 12:55:15 +03:00
Yura Sokolov
4c823b3930 ... 2022-11-16 16:14:32 +03:00
Yura Sokolov
516d325a11 Merge branch 'REL_2_5' into REL_2_5-PBCKP-304 2022-11-16 16:12:10 +03:00