Commit Graph
3854 Commits
Author SHA1 Message Date
Yura Sokolov ac4e509a82 [PBCKP-395] use pioOpenRewrite in pioLocalDrive_pioWriteFile 2022-12-14 08:12:13 +03:00
Yura Sokolov 85dc5c09a0 [PBCKP-395] use pioOpenRewrite in write_backup_filelist 2022-12-14 08:12:13 +03:00
Yura Sokolov 5021a99657 [PBCKP-395] use pioOpenWrite in send_pages 2022-12-14 08:12:13 +03:00
Yura Sokolov 19fcad262e [PBCKP-395] implement remote pioOpenRewrite
pioRemoteWriteFile uses async api exclusively.
2022-12-14 08:12:13 +03:00
Yura Sokolov 096a8f9fe0 [PBCKP-395] introduce pioLocalDrive_pioOpenRewrite
This is "only streaming write" file abstraction with support for
atomicity. It uses temporary file and rename on-disk storage.
2022-12-14 08:12:13 +03:00
Yura Sokolov 156419422c expose pioDBDrive more 2022-12-14 08:12:13 +03:00
Yura Sokolov c516fcb7b9 change pioSeek signature 2022-12-14 07:36:45 +03:00
Yura Sokolov 3e3178e567 ... pioWrite will return error if it writes lesser. 2022-12-14 07:36:45 +03:00
Yura Sokolov 698824e581 file.c: regularize remote handle handling 2022-12-14 06:53:57 +03:00
Yura Sokolov 7866628420 fo_obj.h: improve debug-ability by making method entry function static 2022-12-13 19:17:34 +03:00
Alexey Savchkov b90273fe14 Increment the expected test version 2022-12-13 22:50:17 +07:00
Yura Sokolov 1d2faa383b fo_obj: hide warnings in $iref/$iunref 2022-12-13 16:56:34 +03:00
Yura Sokolov 38f59c6567 fix pioWriteFilter_pioWriteFinish 2022-12-13 16:23:10 +03:00
Yura Sokolov 10ac3c9918 [PBCKP-402] bound check for abortedRecPtr to Pg15
It is not really needed in previous versions.
It doesn't harm, but we want to reduce tests amount.
2022-12-13 13:09:34 +03:00
Yura Sokolov 24f12d98d9 [PBCKP-402,PBCKP-354] refix "missing contrecord" detection.
Error message is translated according to current locale. So we can't
compare it as a string. But `abortedRecPtr` exists exactly for this case,
so we can rely on it.
2022-12-13 02:52:18 +03:00
Alexey Savchkov 9391a1b676 Increment the version 2022-12-13 00:01:03 +07:00
Alexey Savchkov b74ec9046d Update Readme 2022-12-12 22:31:14 +07:00
Sofia Kopikova 076e3fdae9 [PBCKP-394] skip creating partitioned index on < 11 versions on test_checkdb_amcheck_only_sanity 2022-12-12 15:46:17 +03:00
Yura Sokolov e683cf8a5c fix compilation for < PG12 2022-12-12 12:49:20 +03:00
Daniel ShelepanovandYuriy Sokolov 3d7d28ecd1 [PBCKP-373] Got rid of the fio_access function
fio_access calls have either been removed or replaced by pioExists
2022-12-10 13:43:31 +00:00
Sergey FukanchikandYuriy Sokolov 52a42a856b PBCKP-390 Освобождать PGresult в get_database_map 2022-12-10 13:35:53 +00:00
Yura Sokolov 77b47e20d7 remove fetch.c because functions defined here are unused 2022-12-10 16:29:30 +03:00
Yura Sokolov 36ff719717 and another one unused function 2022-12-09 10:21:42 +03:00
Yura Sokolov 6898075741 remove some already unused functions 2022-12-09 10:15:38 +03:00
Yura Sokolov e3c322a926 buffer for pioLocalPagesIterator 2022-12-09 10:08:57 +03:00
Yura Sokolov 5dfb164d2a send_pages: simplify headers handling 2022-12-09 00:55:26 +03:00
Yura Sokolov 2b387ed853 remove datapagemap_iterator and optimize datapatemap_first 2022-12-09 00:42:05 +03:00
Yura Sokolov f5616ea04c get rid of fio_pread
btw, it is not accurate about error
2022-12-08 23:13:15 +03:00
Yura Sokolov 3b86b76dbe [PBCKP-338] use n_blocks returned by pages iterator.
pages iterator could actually be more accurate.
In future, we could read till the end of file instead of setting n_blocks
at iteration start.
2022-12-08 22:49:52 +03:00
Yura Sokolov 8be1417ee9 [PBCKP-338] pioIteratePages: rename 'strict' parameter to 'just_validate'
And don't send actual content for validation.
2022-12-08 22:46:42 +03:00
Yura Sokolov 218e78468c [PBCKP-338] move pioIteratePages to separate pioDBDrive.
Looks like it is beginning of separation of db-aware drives.
2022-12-08 22:45:41 +03:00
Yura Sokolov 23dff59564 [PBCKP-338] simpler iterate pages signature
- add pioIteratePages2 with simpler signature.
  In fact, it is pretty close to fio_send_request used in fio_send_pages/
  fio_copy_pages.

  to parse conditioned parameters, doIteratePages introduced

- rename back pioIteragePages2 -> pioIteratePages

- remove fio_send_pages, fio_copy_pages
2022-12-08 22:45:16 +03:00
Yura Sokolov b765af4059 [PBCKP-338] Some simplifications
- format pioLocalPagesIterator allocation
- reduce prepare_page signature
- simplify send_pages and its usage
- same for copy_pages
- simplify iterator initialization
2022-12-08 21:23:20 +03:00
Yura Sokolov 1cb72dc320 [PBCKP-338] move prepare_page to file.c, since it is single call place. 2022-12-08 21:17:50 +03:00
Yura Sokolov 9c0dd85c1f [PBCKP-338] simplify backup_page and its usage.
And use pioCRC32Counter to calculate crc32
2022-12-08 21:17:50 +03:00
Sergey FukanchikandYura Sokolov f1e89a26d7 [PBCKP-338] page iterator 2022-12-08 21:12:12 +03:00
Yura Sokolov 4fa34c61f7 [PBCKP-336] calculate CRC32 inplace 2022-12-08 21:08:25 +03:00
Yura Sokolov b6e8f1ebf5 fu_util: assert on method missing 2022-12-08 21:07:33 +03:00
Daniel Shelepanov 822fbbfe50 [PBCKP-326] regex fixed in test_missing_replication_permission_1
Everything between WARNING and FATAL sections is now handled with the [\s\S]*? regex:
* [\s\S] is a group that handles any whitespace and non-whitespace character including new lines which are important in this case.
* "*" quantifier means zero or more characters. There may as well be nothing between these two sections.
* "?" quantifies in this case means greedy search so that we don't match more than we need.
2022-12-08 13:53:51 +03:00
Yura Sokolov a1c2e91bd3 Merge branch 'REL_2_5' into REL_2_6 2022-12-08 08:05:27 +03:00
Sergey FukanchikandYura Sokolov 153b0cf04c some valgrind cleanup 2022-12-08 08:03:23 +03:00
Yura Sokolov 25e63c5a7c raw strings in python regex; ignore generated transation files
Author: Sergey Fukanchik
2022-12-08 07:44:12 +03:00
Yura Sokolov 89bf39c5dd pioCopy: return to single pioRead in loop and style cleanup 2022-12-08 07:31:37 +03:00
Sofia KopikovaandYura Sokolov 95e439f310 change ft_bytes_move prototype to size_t 2022-12-07 17:01:25 +03:00
Sofia KopikovaandYura Sokolov a68963ce75 [PBCKP-363] CRC32 WIP 2022-12-07 17:01:25 +03:00
Victor SpirinandYura Sokolov 15c304ad6c [PBCKP-375] Prepared for moving RelFileNode to RelFileLocator in the PG16. 2022-12-07 14:21:50 +03:00
Daniel Shelepanov 3bc0fc4b81 Documentation hot fix 2022-12-07 13:35:25 +03:00
Yura Sokolov 29a9efb4d4 [PBCKP-325] refix test_issue_231
to make two backups in one second we have to fail them.
Therefore we have to fetch backup_id from log in exception's message.

Retry for 20 seconds to have a chance to start in one second.
If we couldn't, lets skip the test.
2022-12-06 14:17:04 +03:00
Yura Sokolov 5730021094 externalize readBackupControlFile 2022-12-06 02:15:29 +03:00
Yura Sokolov 9d2bd161c0 Merge branch 'REL_2_5' into REL_2_6 2022-12-06 02:02:33 +03:00