llvm-premerge-checks/scripts/llvm-dependencies.yaml

# This mapping is only used to determine which projects need to be rebuild.
# E.g. all builds are still in-tree, so 'llvm' will always be included in the
# built projects.

dependencies:
  llvm: []
  bolt:
    - llvm
  clang:
    - llvm
  clang-tools-extra:
    - clang
    - llvm
  # FIXME: "compiler-rt" depends on "llvm" only for configuration, right?
  #        it means we can miss breakages in configuration changes.
  #        Same for libcxx, libc and other projects that don't have 'llvm'
  #        as a dependency.
  compiler-rt:
    - clang
  flang:
    - llvm
    - mlir
    - clang
  libc:
    - clang
    - clang-tools-extra
  # FIXME: not sure about 'libcxx' and 'libcxxabi'
  libcxx: []
  libcxxabi: []
  libclc: []
  libunwind: []
  lld:
    - llvm
  lldb:
    - clang
    - llvm
  mlir:
    - llvm
  openmp:
    - clang
  polly:
    - llvm
  pstl: []
  cross-project-tests:
    - clang
    - lld

# List of all projects in the LLVM monorepository. This list is taken from
# llvm/CMakeLists.txt in "set(LLVM_ALL_PROJECTS ..."
# The value for all project is the list of ninja targets to run.
allprojects:
  bolt: ["check-bolt"]
  clang: ["check-clang"]
  clang-tools-extra: ["check-clang-tools"]
  compiler-rt: ["check-all"]  # check-compiler-rt seems to exist only in standalone builds.
  cross-project-tests: ["check-cross-project"]
  flang: ["check-flang"]
  libc: ["check-libc"]
  libclc: ["check-all"] # There does not seem to be a more specific target.
  libcxx: ["check-cxx"]
  libcxxabi: ["check-cxxabi"]
  libunwind: ["check-unwind"]
  lld: ["check-lld"]
  lldb: ["check-all"] # FIXME: `check-lldb` may not include every lldb tests?
  mlir: ["check-mlir"]
  openmp: ["check-openmp"]
  polly: ["check-polly"]
  pstl: ["check-all"] # There does not seem to be a more specific target.
  llvm: ["check-llvm"]

# projects excluded from automatic configuration as they could not be built
excludedProjects:
  windows:
    - bolt # tests are not supported yet
    - lldb # failing tests
    - libunwind # no windows support
    - libcxx  # no windows support
    - libcxxabi  # no windows support
    - libc # no windows support
    - openmp # TODO: check: kuhnel has trouble with the Perl installation
    - cross-project-tests # test failing
    - check-cxxabi
    # test stuck, needs to be killed manually: instrprof-multiprocess.test
    - compiler-rt
  linux:
    - libcxx  # has custom checks
    - libcxxabi  # has custom checks
    - cross-project-tests # tests failing
    - lldb # tests failing
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`# This mapping is only used to determine which projects need to be rebuild.`
			`# E.g. all builds are still in-tree, so 'llvm' will always be included in the`
			`# built projects.`

			`dependencies:`
			`llvm: []`
enable bolt premerge checks 2022-01-26 18:40:18 +01:00			`bolt:`
			`- llvm`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`clang:`
			`- llvm`
			`clang-tools-extra:`
			`- clang`
			`- llvm`
			`# FIXME: "compiler-rt" depends on "llvm" only for configuration, right?`
			`# it means we can miss breakages in configuration changes.`
			`# Same for libcxx, libc and other projects that don't have 'llvm'`
			`# as a dependency.`
added missing dependency 2020-05-11 16:55:20 +02:00			`compiler-rt:`
update windows setup 2021-03-12 12:08:36 +01:00			`- clang`
added flang to automatic project selection based on #159, this will enable flang for beta testers 2020-04-15 17:59:02 +02:00			`flang:`
add clang to flang deps related to #271: clang-tidy cannot find gtest/gtest 2021-01-11 15:46:45 +01:00			`- llvm`
			`- mlir`
			`- clang`
added missing dependencies to libc 2020-05-20 06:10:28 +02:00			`libc:`
fix project resolutions and some of the typing issues found by mypy 2021-10-04 16:07:06 +02:00			`- clang`
			`- clang-tools-extra`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`# FIXME: not sure about 'libcxx' and 'libcxxabi'`
			`libcxx: []`
			`libcxxabi: []`
			`libclc: []`
			`libunwind: []`
disable check-libc and check-cxxabi 2021-09-29 11:15:54 +02:00			`lld:`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`- llvm`
disable check-libc and check-cxxabi 2021-09-29 11:15:54 +02:00			`lldb:`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`- clang`
			`- llvm`
disable check-libc and check-cxxabi 2021-09-29 11:15:54 +02:00			`mlir:`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`- llvm`
fixed problems with configuring projects on Windows 2020-01-31 18:29:47 +01:00			`openmp:`
			`- clang`
disable check-libc and check-cxxabi 2021-09-29 11:15:54 +02:00			`polly:`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`- llvm`
			`pstl: []`
Fix llvm-dependencies.yaml: the debuginfo-tests has been renamed into cross-project-tests 2021-09-17 02:17:57 +02:00			`cross-project-tests:`
fixed problems with configuring projects on Windows 2020-01-31 18:29:47 +01:00			`- clang`
			`- lld`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00
			`# List of all projects in the LLVM monorepository. This list is taken from`
			`# llvm/CMakeLists.txt in "set(LLVM_ALL_PROJECTS ..."`
fix project resolutions and some of the typing issues found by mypy 2021-10-04 16:07:06 +02:00			`# The value for all project is the list of ninja targets to run.`
detect projects affected by a change (#113) first proposal for affected projects detection 2020-01-28 16:39:53 +01:00			`allprojects:`
enable bolt premerge checks 2022-01-26 18:40:18 +01:00			`bolt: ["check-bolt"]`
Change the premerge checks to only check the affected projects The current setup is configuring the "affected projects" as well as their dependencies, and run `ninja all` followed by `ninja check-all`. This is quite a pessimization for leaf project which don't need to build and run the tests for their dependencies. For example a patch affecting only MLIR shouldn't need to build and run LLVM and clang tests. This patch changes this by running checks only for the affected project. For example a patch touching `mlir` is affecting `mlir` and `flang`. However `flang` depends on `clang`. So the list of projects to configure is `mlir;flang;clang;llvm;`, but we want to test only mlir and flang ; we'll run only `ninja check-mlir check-flang`. In practice in this example running `ninja all` builds 5658 targets and `ninja check-all` after that adds 716 more targets. On the other hands `ninja check-flang check-mlir` results in 3997 targets total. Concretely the contract with premerge_checks.py is changed so that the expected argument for the --projects flag is only the list of affected project, dependencies are automatically added. 2021-09-17 22:31:15 +02:00			`clang: ["check-clang"]`
			`clang-tools-extra: ["check-clang-tools"]`
			`compiler-rt: ["check-all"] # check-compiler-rt seems to exist only in standalone builds.`
			`cross-project-tests: ["check-cross-project"]`
			`flang: ["check-flang"]`
			`libc: ["check-libc"]`
			`libclc: ["check-all"] # There does not seem to be a more specific target.`
			`libcxx: ["check-cxx"]`
			`libcxxabi: ["check-cxxabi"]`
			`libunwind: ["check-unwind"]`
			`lld: ["check-lld"]`
			lldb: ["check-all"] # FIXME: `check-lldb` may not include every lldb tests?
			`mlir: ["check-mlir"]`
fix environment assignment and update check- definitions 2021-10-04 16:36:02 +02:00			`openmp: ["check-openmp"]`
cleanup deps 2021-10-04 19:19:38 +02:00			`polly: ["check-polly"]`
Change the premerge checks to only check the affected projects The current setup is configuring the "affected projects" as well as their dependencies, and run `ninja all` followed by `ninja check-all`. This is quite a pessimization for leaf project which don't need to build and run the tests for their dependencies. For example a patch affecting only MLIR shouldn't need to build and run LLVM and clang tests. This patch changes this by running checks only for the affected project. For example a patch touching `mlir` is affecting `mlir` and `flang`. However `flang` depends on `clang`. So the list of projects to configure is `mlir;flang;clang;llvm;`, but we want to test only mlir and flang ; we'll run only `ninja check-mlir check-flang`. In practice in this example running `ninja all` builds 5658 targets and `ninja check-all` after that adds 716 more targets. On the other hands `ninja check-flang check-mlir` results in 3997 targets total. Concretely the contract with premerge_checks.py is changed so that the expected argument for the --projects flag is only the list of affected project, dependencies are automatically added. 2021-09-17 22:31:15 +02:00			`pstl: ["check-all"] # There does not seem to be a more specific target.`
			`llvm: ["check-llvm"]`
fixed problems with configuring projects on Windows 2020-01-31 18:29:47 +01:00
			`# projects excluded from automatic configuration as they could not be built`
			`excludedProjects:`
migrate scripts to python (#148) * run_cmake.py working locally on Linux * added os detection of choose_projects * cmake works on windows * run_ninja works on windows * fixed newline characters 2020-03-23 09:03:24 +01:00			`windows:`
enable bolt premerge checks 2022-01-26 18:40:18 +01:00			`- bolt # tests are not supported yet`
cleanup deps 2021-10-04 19:19:38 +02:00			`- lldb # failing tests`
			`- libunwind # no windows support`
get libcxx steps from sh output 2020-10-09 11:05:19 +02:00			`- libcxx # no windows support`
			`- libcxxabi # no windows support`
Mark libc as unsupported on Windows 2021-09-27 17:52:05 +02:00			`- libc # no windows support`
get libcxx steps from sh output 2020-10-09 11:05:19 +02:00			`- openmp # TODO: check: kuhnel has trouble with the Perl installation`
Fix llvm-dependencies.yaml: the debuginfo-tests has been renamed into cross-project-tests 2021-09-17 02:17:57 +02:00			`- cross-project-tests # test failing`
disable check-libc and check-cxxabi 2021-09-29 11:15:54 +02:00			`- check-cxxabi`
disabled compiler-rt 2020-04-24 13:56:28 +02:00			`# test stuck, needs to be killed manually: instrprof-multiprocess.test`
			`- compiler-rt`
excluding debuginfo-tests as tests are failing 2020-03-27 14:19:52 +01:00			`linux:`
get libcxx steps from sh output 2020-10-09 11:05:19 +02:00			`- libcxx # has custom checks`
			`- libcxxabi # has custom checks`
cleanup deps 2021-10-04 19:19:38 +02:00			`- cross-project-tests # tests failing`
			`- lldb # tests failing`