revi-archive/xz-archive
1
0
Fork 0
mirror of https://git.tukaani.org/xz.git synced 2024-04-04 12:36:23 +02:00
Code Activity
xz-archive/.github/workflows/ci.yml

161 lines
6.9 KiB
YAML
Raw Normal View History

Add SPDX license identifier into 0BSD source code files.
2024-02-12 16:09:10 +01:00
# SPDX-License-Identifier: 0BSD
CI/CD: Create initial version of CI/CD workflow. The CI/CD workflow will only execute on Ubuntu and MacOS latest version. The workflow will attempt to build with autotools and CMake and execute the tests. The workflow will run for all pull requests and pushes done to the master branch.
2022-12-22 17:34:48 +01:00
#############################################################################
#
# Author: Jia Tan
#
#############################################################################
name: CI
on:
# Triggers the workflow on push or pull request events but only for the master branch
push:
branches: [ master ]
pull_request:
branches: [ master ]
# Allows running workflow manually
workflow_dispatch:
jobs:
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
POSIX:
strategy:
matrix:
os: [ubuntu-latest, macos-latest]
build_system: [autotools, cmake]
runs-on: ${{ matrix.os }}
CI/CD: Create initial version of CI/CD workflow. The CI/CD workflow will only execute on Ubuntu and MacOS latest version. The workflow will attempt to build with autotools and CMake and execute the tests. The workflow will run for all pull requests and pushes done to the master branch.
2022-12-22 17:34:48 +01:00
steps:
CI: Bump and ref actions by commit SHA in ci.yml Referencing actions by commit SHA in GitHub workflows guarantees you are using an immutable version. Actions referenced by tags and branches are more vulnerable to attacks, such as the tag being moved to a malicious commit or a malicious commit being pushed to the branch. It's important to make sure the SHA's are from the original repositories and not forks. For reference: https://github.com/actions/checkout/releases/tag/v4.1.0 https://github.com/actions/checkout/commit/8ade135a41bc03ea155e62e844d188df1ea18608 https://github.com/actions/upload-artifact/releases/tag/v3.1.3 https://github.com/actions/upload-artifact/commit/a8a3f3ad30e3422c9c7b888a15615d19a852ae32 Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>
2023-09-26 16:35:08 +02:00
- uses: actions/checkout@8ade135a41bc03ea155e62e844d188df1ea18608 #v4.1.0
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
########################
# Install Dependencies #
########################
# Install Autotools on Linux
CI/CD: Create initial version of CI/CD workflow. The CI/CD workflow will only execute on Ubuntu and MacOS latest version. The workflow will attempt to build with autotools and CMake and execute the tests. The workflow will run for all pull requests and pushes done to the master branch.
2022-12-22 17:34:48 +01:00
- name: Install Dependencies
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
CI: Add apt update command before installing dependencies. Without the extra command, all of the CI tests were automatically failing because the Ubuntu servers could not be reached properly.
2023-06-06 18:18:30 +02:00
run: |
sudo apt-get update
CI: Test musl libc builds on Ubuntu runner.
2023-11-22 14:20:12 +01:00
sudo apt-get install -y autoconf automake build-essential po4a autopoint gcc-multilib doxygen musl-tools
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
# Install Autotools on Mac
- name: Install Dependencies
if: ${{ matrix.os == 'macos-latest' && matrix.build_system == 'autotools' }}
run: brew install autoconf automake libtool po4a doxygen
# Install CMake on Linux
- name: Install Dependencies
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'cmake' }}
CI: Add apt update command before installing dependencies. Without the extra command, all of the CI tests were automatically failing because the Ubuntu servers could not be reached properly.
2023-06-06 18:18:30 +02:00
run: |
sudo apt-get update
CI: Test musl libc builds on Ubuntu runner.
2023-11-22 14:20:12 +01:00
sudo apt-get install -y build-essential cmake musl-tools
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
# Install CMake on Mac
- name: Install Dependencies
if: ${{ matrix.os == 'macos-latest' && matrix.build_system == 'cmake' }}
run: brew install cmake
##################
# Build and Test #
##################
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
# -b specifies the build system to use.
# -p specifies the phase (build or test) to help narrow down an error
# if one occurs.
CI: Reorder 32-bit build first for Linux autotool builds. The 32-bit build needs to be first so the configure cache only needs to be reset one time. The 32-bit build sets the CFLAGS env variable, so any build using that flag after will fail unless the cache is reset.
2023-01-18 15:11:05 +01:00
#
CI: Add test with -fsanitize=address,undefined. ci_build.sh was updated to accept disabling of __attribute__ ifunc and CLMUL. This will allow -fsanitize=address to pass because ifunc is incompatible with -fsanitize=address. The CLMUL implementation has optimizations that potentially read past the buffer and mask out the unwanted bytes. This test will only run on Autotools Linux.
2023-06-28 15:01:22 +02:00
# The first two builds/tests are only run on Autotools Linux and
# affect the CFLAGS. Resetting the CFLAGS requires clearing the
# config cache between runs, so the tests that require CFLAGS are
# done first.
CI: Reorder 32-bit build first for Linux autotool builds. The 32-bit build needs to be first so the configure cache only needs to be reset one time. The 32-bit build sets the CFLAGS env variable, so any build using that flag after will fail unless the cache is reset.
2023-01-18 15:11:05 +01:00
- name: Build 32-bit
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
CI: Reorder 32-bit build first for Linux autotool builds. The 32-bit build needs to be first so the configure cache only needs to be reset one time. The 32-bit build sets the CFLAGS env variable, so any build using that flag after will fail unless the cache is reset.
2023-01-18 15:11:05 +01:00
run: ./build-aux/ci_build.sh -b autotools -p build -f "-m32"
- name: Test 32-bit
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
CI: Reorder 32-bit build first for Linux autotool builds. The 32-bit build needs to be first so the configure cache only needs to be reset one time. The 32-bit build sets the CFLAGS env variable, so any build using that flag after will fail unless the cache is reset.
2023-01-18 15:11:05 +01:00
run: |
CI: Upload test logs as artifacts if a test fails.
2023-02-01 14:36:22 +01:00
./build-aux/ci_build.sh -b autotools -p test -f "-m32" -n 32_bit
CI: Reorder 32-bit build first for Linux autotool builds. The 32-bit build needs to be first so the configure cache only needs to be reset one time. The 32-bit build sets the CFLAGS env variable, so any build using that flag after will fail unless the cache is reset.
2023-01-18 15:11:05 +01:00
cd ../xz_build && make distclean
CI: Enable CLMUL in address sanitization test. The crc64_clmul() function should be ignored by the address sanitizer now so these builds should still pass.
2023-09-14 15:13:23 +02:00
# ifunc must be disabled for this test because __attribute__ ifunc is
# incompatible with -fsanitize=address.
CI: Disable sandboxing in fsanitize=address,undefined job. The sandboxing on Linux now supports Landlock, which restricts all supported filesystem actions after xz opens the files it needs. The sandbox is only enabled when one file is input and we are writing to standard out. With fsanitize=address,undefined, the instrumentation needs to read additional files after the sandbox is in place. This forces all xz based test to fail, so the sandbox must instead be disabled.
2023-10-23 18:50:08 +02:00
#
# The sandbox must also be disabled because it will prevent access to
# the /proc/ filesystem on Linux, which is used by the sanitizer's
# instrumentation.
CI: Add test with -fsanitize=address,undefined. ci_build.sh was updated to accept disabling of __attribute__ ifunc and CLMUL. This will allow -fsanitize=address to pass because ifunc is incompatible with -fsanitize=address. The CLMUL implementation has optimizations that potentially read past the buffer and mask out the unwanted bytes. This test will only run on Autotools Linux.
2023-06-28 15:01:22 +02:00
- name: Build with -fsanitize=address,undefined
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
CI: Disable sandboxing in fsanitize=address,undefined job. The sandboxing on Linux now supports Landlock, which restricts all supported filesystem actions after xz opens the files it needs. The sandbox is only enabled when one file is input and we are writing to standard out. With fsanitize=address,undefined, the instrumentation needs to read additional files after the sandbox is in place. This forces all xz based test to fail, so the sandbox must instead be disabled.
2023-10-23 18:50:08 +02:00
run: ./build-aux/ci_build.sh -b autotools -p build -f "-fsanitize=address,undefined" -d ifunc,sandbox
CI: Add test with -fsanitize=address,undefined. ci_build.sh was updated to accept disabling of __attribute__ ifunc and CLMUL. This will allow -fsanitize=address to pass because ifunc is incompatible with -fsanitize=address. The CLMUL implementation has optimizations that potentially read past the buffer and mask out the unwanted bytes. This test will only run on Autotools Linux.
2023-06-28 15:01:22 +02:00
- name: Test with -fsanitize=address,undefined
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
run: |
CI: Disable sandboxing in fsanitize=address,undefined job. The sandboxing on Linux now supports Landlock, which restricts all supported filesystem actions after xz opens the files it needs. The sandbox is only enabled when one file is input and we are writing to standard out. With fsanitize=address,undefined, the instrumentation needs to read additional files after the sandbox is in place. This forces all xz based test to fail, so the sandbox must instead be disabled.
2023-10-23 18:50:08 +02:00
./build-aux/ci_build.sh -b autotools -p test -f "-fsanitize=address,undefined" -d ifunc,sandbox
CI: Add test with -fsanitize=address,undefined. ci_build.sh was updated to accept disabling of __attribute__ ifunc and CLMUL. This will allow -fsanitize=address to pass because ifunc is incompatible with -fsanitize=address. The CLMUL implementation has optimizations that potentially read past the buffer and mask out the unwanted bytes. This test will only run on Autotools Linux.
2023-06-28 15:01:22 +02:00
cd ../xz_build && make distclean
CI: Test musl libc builds on Ubuntu runner.
2023-11-22 14:20:12 +01:00
# musl libc has some slight differences compared to glibc, including
# the lack of ifunc support. This tests if the ifunc detection
# functions properly since musl-gcc can compile with ifunc support,
# but will fail at runtime.
- name: Build with musl libc
if: ${{ matrix.os == 'ubuntu-latest'}}
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -p build -m "/usr/bin/musl-gcc"
- name: Test with musl libc
if: ${{ matrix.os == 'ubuntu-latest'}}
run: |
./build-aux/ci_build.sh -b ${{ matrix.build_system }} -p test -m "/usr/bin/musl-gcc"
- name: Clean up musl libc run
if: ${{ matrix.os == 'ubuntu-latest' && matrix.build_system == 'autotools' }}
run: cd ../xz_build && make distclean
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build with full features
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test with full features
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -p test -n full_features
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without encoders
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d encoders,shared -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without encoders
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d encoders,shared -p test -n no_encoders
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without decoders
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d decoders,shared -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without decoders
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d decoders,shared -p test -n no_decoders
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without threads
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d threads,shared -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without threads
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d threads,shared -p test -n no_threads
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without BCJ filters
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d bcj,shared,nls -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without BCJ filters
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d bcj,shared,nls -p test -n no_bcj
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without Delta filters
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d delta,shared,nls -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without Delta filters
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d delta,shared,nls -p test -n no_delta
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without sha256 check
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -c crc32,crc64 -d shared,nls -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without sha256 check
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -c crc32,crc64 -d shared,nls -p test -n no_sha256
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Build without crc64 check
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -c crc32,sha256 -d shared,nls -p build
CI/CD: Reduce job runners to 4 instead of using matrix strategy. The old version used too many runners that resulted in unnecessary dependency downloads. Now, the runners are reused for the different configurations for each OS and build system.
2023-01-07 04:16:55 +01:00
- name: Test without crc64 check
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -c crc32,sha256 -d shared,nls -p test -n no_crc64
CI/CD: Create initial version of CI/CD workflow. The CI/CD workflow will only execute on Ubuntu and MacOS latest version. The workflow will attempt to build with autotools and CMake and execute the tests. The workflow will run for all pull requests and pushes done to the master branch.
2022-12-22 17:34:48 +01:00
CI: Adds a build and test for small configuration.
2023-04-25 14:06:15 +02:00
- name: Build small
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d small -p build
- name: Test small
run: ./build-aux/ci_build.sh -b ${{ matrix.build_system }} -d small -p test -n small
CI: Upload test logs as artifacts if a test fails.
2023-02-01 14:36:22 +01:00
# Attempt to upload the test logs as artifacts if any step has failed
CI: Update Upload Artifact Action.
2023-12-15 09:56:31 +01:00
- uses: actions/upload-artifact@c7d193f32edcb7bfad88892161225aeda64e9392 #v4.0.0
CI: Upload test logs as artifacts if a test fails.
2023-02-01 14:36:22 +01:00
if: ${{ failure() }}
with:
CI: Runs CMake feature tests. Now, CMake will run similar feature disable tests that the Autotools version did before. In order to do this without repeating lines in ci.yml, it now makes sense to use the GitHub Workflow matrix to create a loop.
2023-03-24 16:05:48 +01:00
name: ${{ matrix.os }} ${{ matrix.build_system }} Test Logs
CI: Upload test logs as artifacts if a test fails.
2023-02-01 14:36:22 +01:00
path: build-aux/artifacts
Copy permalink