db/pgbackrest
1
0
Fork 0
mirror of https://github.com/pgbackrest/pgbackrest.git synced 2024-12-14 10:13:05 +02:00
Code Issues Releases Activity
a0a5f2300c
pgbackrest/test/Dockerfile

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

39 lines
1.7 KiB
Docker
Raw Normal View History

Update CI to use Ubuntu 22.04 and Fedora 36. Both have newer gcc and OpenSSL 3. Fedora 36 runs horribly slow with valgrind enabled so run the valgrind tests on Ubuntu 22.04. Fedora 36 has a newer gcc so it is still worth testing on.
2022-06-06 22:32:20 +02:00
# export PGB=pgbackrest;export PGB_IMAGE=$PGB/test:u22-main;PGB_REPO=~/Documents/Code/$PGB
Update test container OS versions. Update Ubuntu 12.04 to 16.04. Version 16.04 is recently EOL but testing on an old version is beneficial. Update Ubuntu 18.04 to 20.04. Update Fedora 32 to 33. Version 34 would have been preferred but there were some build issues, i.e. the default shell did not work with configure, and after ksh was installed configure locked up. Add --no-install-recommends to apt-get commands to save a bit of time and space. Update test Dockerfile to run in multiple steps. This makes the container larger but also makes rebuilding after changes faster. The --squash option may be used to keep the container small. Remove obsolete casts in protocol/parallel module. These casts were included in the original migration because Ubuntu 12.04 32-bit gcc required them, but Ubuntu 16.04 32-bit gcc complains. There is no production issue here since at this point in the code the file descriptors are guaranteed to be >= 0.
2021-07-18 23:29:20 +02:00
# docker build --squash -f $PGB_REPO/test/Dockerfile -t $PGB_IMAGE .
Use vagrant user in the Docker container. This is a bit of legacy from the current Vagrant environment used to do the release, but since it is not as easy to change the user in Vagrant, just make the Docker environment conform. This allows documentation to be built in a Vagrant environment (or any environment with the same user name) and to be deployed in a Docker environment.
2022-02-26 21:50:30 +02:00
# docker run --privileged -itd --name $PGB-test -h $PGB-test -v $PGB_REPO:/home/vagrant/$PGB $PGB_IMAGE
Use uncrustify for code formatting. The code is not completely reflowed yet so there are some cases that uncrustify will not catch. The formatting will be improved over time. Some block of code require special formatting so have been surrounded with the {uncrustify-off}/{uncrustify-on} markers. These exceptions should be kept to a minimum. Add --code-format (to reformat code) and --code-format-check (to check formatting) to test.pl. Add a CI test that will check code formatting. Code must be correctly formatted before it can be merge to integration. Add documentation to the coding standards for code formatting.
2023-01-30 07:22:41 +02:00
#
# When running test.pl --code-format permissions may get munged. Run this from the pgbackrest/test path to fix them:
# find .. | grep "\.[ch]$" | xargs xattr -rc && find .. | grep "\.[ch]$" | xargs chmod -x
Update CI to use Ubuntu 22.04 and Fedora 36. Both have newer gcc and OpenSSL 3. Fedora 36 runs horribly slow with valgrind enabled so run the valgrind tests on Ubuntu 22.04. Fedora 36 has a newer gcc so it is still worth testing on.
2022-06-06 22:32:20 +02:00
FROM ubuntu:jammy
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
# Install packages
Update test container OS versions. Update Ubuntu 12.04 to 16.04. Version 16.04 is recently EOL but testing on an old version is beneficial. Update Ubuntu 18.04 to 20.04. Update Fedora 32 to 33. Version 34 would have been preferred but there were some build issues, i.e. the default shell did not work with configure, and after ksh was installed configure locked up. Add --no-install-recommends to apt-get commands to save a bit of time and space. Update test Dockerfile to run in multiple steps. This makes the container larger but also makes rebuilding after changes faster. The --squash option may be used to keep the container small. Remove obsolete casts in protocol/parallel module. These casts were included in the original migration because Ubuntu 12.04 32-bit gcc required them, but Ubuntu 16.04 32-bit gcc complains. There is no production issue here since at this point in the code the file descriptors are guaranteed to be >= 0.
2021-07-18 23:29:20 +02:00
RUN apt-get update
RUN DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y \
sudo vim htop jq rsync sysstat curl \
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
libdbd-pg-perl libxml-checker-perl libyaml-perl \
devscripts build-essential lintian git cloc txt2man debhelper libssl-dev zlib1g-dev libperl-dev libxml2-dev liblz4-dev \
Migrate coverage testing to C and remove dependency on lcov. lcov does not seem to be very well maintained and is often not compatible with the version of gcc it ships with until a few months after a new distro is released. In any case, lcov is that not useful for us because it generates reports on all coverage while we are mainly interested in missing coverage during development. Instead use the JSON output generated by gcov to generate our minimal coverage report and metrics for the documentation. There are some slight differences in the metrics. The difference in the common module was due to a bug in the old code -- build/common was being added into common as well as being reported separately. The source of the two additional branches in the backup module is unknown but almost certainly down to how exclusions are processed with regular expressions. Since there is additional coverage rather than coverage missing this seems fine. Since this was pretty much a rewrite it was also a good time to migrate to C.
2024-05-31 06:52:07 +02:00
liblz4-tool libpq-dev autoconf-archive zstd libzstd-dev bzip2 libbz2-dev pkg-config libyaml-dev libc6-dbg wget meson \
SFTP support for repository storage.
2023-05-13 18:16:16 +02:00
ccache valgrind tzdata uncrustify libssh2-1-dev
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
# Install Docker
Update test container OS versions. Update Ubuntu 12.04 to 16.04. Version 16.04 is recently EOL but testing on an old version is beneficial. Update Ubuntu 18.04 to 20.04. Update Fedora 32 to 33. Version 34 would have been preferred but there were some build issues, i.e. the default shell did not work with configure, and after ksh was installed configure locked up. Add --no-install-recommends to apt-get commands to save a bit of time and space. Update test Dockerfile to run in multiple steps. This makes the container larger but also makes rebuilding after changes faster. The --squash option may be used to keep the container small. Remove obsolete casts in protocol/parallel module. These casts were included in the original migration because Ubuntu 12.04 32-bit gcc required them, but Ubuntu 16.04 32-bit gcc complains. There is no production issue here since at this point in the code the file descriptors are guaranteed to be >= 0.
2021-07-18 23:29:20 +02:00
RUN groupadd -g5000 docker
RUN curl -fsSL https://get.docker.com | sh
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
Use vagrant user in the Docker container. This is a bit of legacy from the current Vagrant environment used to do the release, but since it is not as easy to change the user in Vagrant, just make the Docker environment conform. This allows documentation to be built in a Vagrant environment (or any environment with the same user name) and to be deployed in a Docker environment.
2022-02-26 21:50:30 +02:00
# Create vagrant user
RUN adduser --ingroup=docker -uid=5000 --disabled-password --gecos \"\" vagrant
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
Test Dockerfile improvements. Add tzdata package so timezone tests in command/restore work correctly. Mark default git path as safe. This is a security fix that is not applicable in this environment, but must be set. Also remove package cleanup, which is inconvenient when new packages need to be installed. It makes sense for containers that will be downloaded from Dockerhub but not so much for a locally-maintained container.
2022-07-22 01:27:58 +02:00
# Mark git path as safe
RUN sudo -u vagrant git config --global --add safe.directory /home/vagrant/pgbackrest
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
# Configure sudo
Update test container OS versions. Update Ubuntu 12.04 to 16.04. Version 16.04 is recently EOL but testing on an old version is beneficial. Update Ubuntu 18.04 to 20.04. Update Fedora 32 to 33. Version 34 would have been preferred but there were some build issues, i.e. the default shell did not work with configure, and after ksh was installed configure locked up. Add --no-install-recommends to apt-get commands to save a bit of time and space. Update test Dockerfile to run in multiple steps. This makes the container larger but also makes rebuilding after changes faster. The --squash option may be used to keep the container small. Remove obsolete casts in protocol/parallel module. These casts were included in the original migration because Ubuntu 12.04 32-bit gcc required them, but Ubuntu 16.04 32-bit gcc complains. There is no production issue here since at this point in the code the file descriptors are guaranteed to be >= 0.
2021-07-18 23:29:20 +02:00
RUN echo '%docker ALL=(ALL) NOPASSWD: ALL' >> /etc/sudoers
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
Use vagrant user in the Docker container. This is a bit of legacy from the current Vagrant environment used to do the release, but since it is not as easy to change the user in Vagrant, just make the Docker environment conform. This allows documentation to be built in a Vagrant environment (or any environment with the same user name) and to be deployed in a Docker environment.
2022-02-26 21:50:30 +02:00
# Mount tmpfs at /home/vagrant/test for faster testing
RUN sudo -u vagrant mkdir -m 770 /home/vagrant/test
RUN echo 'tmpfs /home/vagrant/test tmpfs size=4096M 0 1' >> /etc/fstab
Update test container OS versions. Update Ubuntu 12.04 to 16.04. Version 16.04 is recently EOL but testing on an old version is beneficial. Update Ubuntu 18.04 to 20.04. Update Fedora 32 to 33. Version 34 would have been preferred but there were some build issues, i.e. the default shell did not work with configure, and after ksh was installed configure locked up. Add --no-install-recommends to apt-get commands to save a bit of time and space. Update test Dockerfile to run in multiple steps. This makes the container larger but also makes rebuilding after changes faster. The --squash option may be used to keep the container small. Remove obsolete casts in protocol/parallel module. These casts were included in the original migration because Ubuntu 12.04 32-bit gcc required them, but Ubuntu 16.04 32-bit gcc complains. There is no production issue here since at this point in the code the file descriptors are guaranteed to be >= 0.
2021-07-18 23:29:20 +02:00
Use vagrant user in the Docker container. This is a bit of legacy from the current Vagrant environment used to do the release, but since it is not as easy to change the user in Vagrant, just make the Docker environment conform. This allows documentation to be built in a Vagrant environment (or any environment with the same user name) and to be deployed in a Docker environment.
2022-02-26 21:50:30 +02:00
USER vagrant
WORKDIR /home/vagrant
Basic multi-architecture support for test containers. The tests worked fine on multiple architectures, but would only run "bare metal", i.e. tests that required containers could not be run. Enable basic multi-architecture support by allowing containers to be built using whatever architecture the host supports. Also allow cached containers to be defined for multiple architectures in container.yaml. Add a Dockerfile which can be used as a container for other containers to provide a consistent development environment. The primary goal is to allow development on Mac M1 but other architectures should find these improvements useful.
2021-05-03 22:31:27 +02:00
ENTRYPOINT sudo rm -f /var/run/docker.pid && sudo mount -a && sudo dockerd
Reference in New Issue Copy Permalink