a47751ebe8
* added cmake parameters for sccache * added sccache * removed stray debug output * starting sccache with VS environment * added container for Visual Studio 2019 * fixed comments * considering WIndows version * updated to vs2019 * using MS install method * snapshot of VS2019 experiments * using --installRecommended * cleanup of dockerfile * updated path * fixed dockerfile * dumped version number * exclude for virus scan * added testing option this does not start the agent * write results on failures * added timeouts for pipelines * moving master pipelines to python scripts * added flang to automatic project selection based on #159, this will enable flang for beta testers * added persistent workspace for testing containers * added secure delete function * added better log message * deleting read-only files * checking existence before setting flags * using unlink * deleting recursively * using pathlib for chmod * using custom workspace * fixed drive * separate handling of single files * simplified read-only handling again * removed vsdevcmd calls as it's already set in the docker Entrypoint * renamed container folders * windows version not needed any more * bumped version number * bumped version number * script cleanup * added cmake parameters for sccache * added sccache * starting sccache with VS environment * added container for Visual Studio 2019 * fixed comments * considering WIndows version * updated to vs2019 * using MS install method * snapshot of VS2019 experiments * using --installRecommended * cleanup of dockerfile * updated path * fixed dockerfile * dumped version number * removed vsdevcmd calls as it's already set in the docker Entrypoint * renamed container folders * windows version not needed any more * bumped version number * bumped version number * script cleanup * removed sccache from vs2017 * making windows image configurable * added versioning * created windows BETA pipeline * added Jenkins label for vs2019 |
||
|---|---|---|
| .github/ISSUE_TEMPLATE | ||
| containers | ||
| docs | ||
| Jenkins | ||
| kubernetes | ||
| scripts | ||
| .gitignore | ||
| k8s_config | ||
| LICENSE | ||
| local_setup.sh | ||
| README.md | ||
Overview
This repository contains the configuration files for the pre-merge checks for the LLVM project. This github project contains the documentation and the server configuration cluster of build machines that are used to check all incoming commits to the LLVM project.
User documentation
See docs/user_doc.md
Pre-merge check vision for end of 2019
Maria is a developer working on a new idea for the LLVM project. When she submits a new diff to Phabricator (or updates an existing diff), the pre-merge checks are triggered automatically in the cloud. The pre-merge checks run in one configuration (amd64, Debian Testing, clang8) and comprise these steps:
- run CMake
- compile and link
- run check-all
- run clang-format and clang-tidy
Once a check is completed, the results are attached to the Diff in Phabricator so that Maria is notified automatically with the results. Now she can check if the pre-merge checks passed and fix things as required. This way she does not have to run all checks on her local machine by hand. The first results are available within 2 hours of a change, but typically within 30 minutes.
As the pre-merge check cover the easy parts, a human reviewer can focus on the parts that the machine cannot cover. The pre-merge checks are optional, so a reviewer can also decide to ignore them if they do not work, take too long, or do not make sense. The build bots are still in place as they cover a much wider range of checks on the different platforms. So after Maria’s change has landed, the build bots might still find more bugs that were not found in the pre-merge checks. The number should be lower than what we have today though.
Roadmap
During the LLVM developer meeting in October 2019, this was the roadmap we discussed:
- Until mid of November: preparation of the infrastructure for the beta testing
- Mid of November:
- Announcement of the public beta testing phase on the LLVM mailing list.
- Interested users are white-listed on the Herald rule.
- Until January: Beta testing for interested users.
- In January:
- Based on the feedback so far: enable pre-merge tests for all users.
- Users can opt-out via a black-list in the Herald rule.
- Start discussion with LLVM foundation on a permanent setup/maintenance for the pre-merge tests.
This roadmap is also reflected in the Milestones.
Cluster overview
The cluster consists of these services:
- Jenkins build server: http://jenkins.llvm-merge-guard.org
- a set of Jenkins agents running the builds
- an nginx server with the build results/logs http://results.llvm-merge-guard.org
Jenkins-Phabricator integration
The Jenkins-Phabricator is based on the instructions provided with the Phabricator-Jenkins Plugin.
On the Phabricator side these things were configured:
- the Harbormaster build plan
- the Herald rule
- the merge_guards_bot user writing the comments
On the Jenkins side:
- in the Jenkins configuration page as explained in the instrucitons
- in the build job
- The Phabricator pluging is not used, as it's not flexible enough. Rather Phabricator just triggers the build via an HTTP request. The
arc patchoperations by scripts. The build feedback is also uploaded by scripts via the harbormaster.sendmessage and differential.revision.edit APIs.
There is no backup of the credentials. If you need to change it, generate a new one and update it in Jenkins and Phabricator.
Additional Information
- Playbooks for installing/upgrading
- User documentation
License
This project is licensed unter the "Apache 2.0 with LLVM Exception" license. See LICENSE for details.