1
0
Fork 0
Commit graph

93 commits

Author SHA1 Message Date
Mikhail Goncharov
7f0564d978 remove obsolete code
most of the scripts were used for Phabricator integration that is now disabled and current scripts are located in `llvm-project/.ci` . Also removed obsolete playbooks and scripts that were not used and likely no longer work. Updated wording and minor typos.

I have tried to look through potential references to the scripts and disabled some of buildkite pipelines that referred to them. That is not a guarantee that this will not break anything as I have not tried to rebuild containers and redeploy cluster.
2024-02-20 10:07:48 +01:00
Mikhail Goncharov
157418a00d doc current setup 2023-09-11 11:49:14 +02:00
Mikhail Goncharov
609ed91cc6 update agent-windows-buildkite
add comment on images
2023-03-28 13:35:04 +02:00
Mikhail Goncharov
ed757c3d37 Updates to certificate issuer / load balancer 2022-09-23 10:40:52 +02:00
ChristianKuehnel
2b9971ffc5
Update monitoring_main_branch.md
fixed link
2022-02-07 09:59:29 +01:00
ChristianKuehnel
1444797003
Update monitoring_main_branch.md
fixed formatting, spelled out the background/problem statement
2022-02-07 09:57:51 +01:00
Christian Kühnel
6b71310c73 Design for buildbot worker to check main branch.
This document proposes a design to improve the stability of the LLVM main branch
for use in pre-merge testing.
2022-02-04 07:11:49 +01:00
Mikhail Goncharov
f3ac1b41dd enable bolt premerge checks 2022-02-01 18:37:17 +01:00
Mikhail Goncharov
cec188edc4 Add openmp deps and update toolchain to 13 2021-12-14 11:39:17 +01:00
Mikhail Goncharov
6d3e0a965d examples of refspec 2021-09-21 14:29:29 +02:00
Mikhail Goncharov
6c2410440e Run bazel builds in premerge
if user is a member of "bazel_build" https://reviews.llvm.org/project/view/107/
or modified /utils/bazel/*

For #328
2021-07-28 16:01:44 +02:00
Mikhail Goncharov
fc8187c649
Update playbooks.md 2021-05-20 11:24:12 +02:00
Mikhail Goncharov
e703a856cb Add graceful termination period for linux agents
Now builds will not be dropped on cluster upgrades. That requires
container updates.
2021-05-14 14:56:18 +02:00
Mikhail Goncharov
58e13f22d1 inrease timeout for win, minor doc 2021-04-23 12:28:01 +02:00
Mikhail Goncharov
f53c519843 updated docs on windows dev, new setting to skip generated steps 2021-03-19 09:22:21 +01:00
Mikhail Goncharov
637056379c update windows setup 2021-03-12 15:31:06 +01:00
Mikhail Goncharov
65fa122f0e update windows setup 2021-03-12 12:10:43 +01:00
Mikhail Goncharov
e83da03b17 add clang to flang deps
related to #271: clang-tidy cannot find gtest/gtest
2021-01-18 11:04:33 +01:00
Mikhail Goncharov
99e43a8d9a rename master to main branch following LLVM 2020-12-10 09:29:24 +01:00
Mikhail Goncharov
681fbbe2cf Process results and unit-test output of libcxx
Now "report" step combines result in a uniform way and processes unit test
results XML output. It works for sub-builds only started from the 'premerge'
pipeline, i.e. non-recursive. One downside is that now one has to wait until
all jobs have finished.

- Add instructions to setup python environment

- added option to do full report cycle but not call Phabricator

- use "annotations" to show build status. That lifts the need to filter ninja
  and other output (thus `ph_no_filter_output` param removed) and output
  everything. That is nice as script failures no longer lead to loss of logs.

- improved annotate() usability

- misc fixes
2020-11-25 15:29:50 +01:00
Mikhail Goncharov
ab1b8d5ae2 Use buildkite API instead of passing stat via files
Previous approach had drawbacks:

- every step had to implement exporting of results in fixed format

- if step failed then failure will not be detected

Now report step will fetch results directly from Buildkite.
Agents have to be updated to have BUILDKITE_API_TOKEN env.
2020-10-08 14:40:57 +02:00
Mikhail Goncharov
5cd16dde45 Don't fail if phabricator target is not specified
That is useful when testing pipelines
2020-10-05 13:33:19 +02:00
Mikhail Goncharov
c082f1aa9b Organize scripts
Move all .py that are supposed to be run as __main__ under ./scripts
so there is no need to manipulate sys.path to import modules.

Runby cleanup
2020-10-02 14:18:22 +02:00
Mikhail Goncharov
405643a089 Allow other refspecs to be used.
That gives us a way to test e.g. pull requests by specifying
ph_scripts_refspec="pull/123/head"

Also keep "ph_" prefix to remove confusion we had between
"scripts_branch" and "ph_scripts_branch" before.

Update docs and moved "testing" sections up.
2020-09-29 17:57:33 +02:00
Mikhail Goncharov
381b1bf1a6 Update nginx configuration to capture all traffic to the static IP
Right now we have only one service we need to serve.

I kept cert manager config for now in the case we want to get a hostname
in the near future.

Updated doc + minor doc / setup fixes.

fixes #242
2020-09-29 11:44:12 +02:00
Mikhail Goncharov
8b36ff5888 remove jenkins configs and scrips
- moved linux agents to a new node pool (basically renamed old one)

- removed some out of date scripts or moved them to playlists

- removed shell scrips invoked from jenkins

- minor docs updates

Some python classes methods are not used anymore and will be cleaned up
separately.
2020-09-01 09:51:49 +02:00
Mikhail Goncharov
5380ea63b4 docs about machine config and ingress 2020-08-28 13:08:40 +02:00
Mikhail Goncharov
5610d8d02f review fixes 2 2020-08-27 15:30:03 +02:00
Mikhail Goncharov
33947bdd1f review fixes, formatted text 2020-08-27 15:30:03 +02:00
Mikhail Goncharov
056e5cdbaa update docs
- move "user_doc" to "README" as it's publicly facing page visible when one opens repo
- move developer docs to "development"
- update docs to reflect current buildkite setup (not completely)
- grammar
2020-08-27 15:30:03 +02:00
Mikhail Goncharov
3f7d29b49d
Merge branch 'master' into playbook-test-branch-changes 2020-07-30 09:40:47 +02:00
Mikhail Goncharov
cb41bb38dd reset before checking out master 2020-07-30 09:32:50 +02:00
Mikhail Goncharov
36612d77aa
Update playbooks.md
Described testing changes with branches
2020-07-28 15:26:43 +02:00
Mikhail Goncharov
e41afba72d update docs 2020-07-27 19:16:33 +02:00
Mikhail Goncharov
d4e5126090 Update docs on ssd disk initialization
+ change number of linux agents

+ removed outputs in job analysis

+ updated windows image
2020-07-21 10:40:26 +02:00
Mikhail Goncharov
42d7237491 Add step to schedule agent restart on windows 2020-07-17 18:37:29 +02:00
Mikhail Goncharov
6f69b1a108
Merge pull request #204 from mtrofin/patch-1
blacklist -> ignorelist
2020-07-07 15:12:23 +02:00
Mikhail Goncharov
4241d6b53e Doc update 2020-06-29 10:56:21 +02:00
Mircea Trofin
c7047d46ed
blacklist -> ignorelist 2020-06-22 08:49:19 -07:00
Mikhail Goncharov
44b870c144 Update agents name to be short
long names causes some tests to fail due to windows limitation
2020-06-17 10:20:34 +02:00
Mikhail Goncharov
ffaba986c1 Deployment changes
do not restart win docker as it makes it impossible to stop agent from
buildkite UI for maintenance
2020-06-17 09:46:42 +02:00
Mikhail Goncharov
4c3cd1b6f5 Use os in queue name
That is useful for metrics collection as buildkite metrics only reports
per queue metrics
2020-06-16 10:30:24 +02:00
Mikhail Goncharov
5d97109795 how to setup buildkite metrics 2020-06-15 16:59:15 +02:00
Mikhail Goncharov
770f6726bc Add new pipeline to build a master branch 2020-06-04 08:40:04 +02:00
Mikhail Goncharov
017ca44a75 Add windows build
- configured sccache on buildkite windows machines
- final result is sent to phabricator from "summary.py" that waits for both builds to complete
- extracted "add_url_artifact" to a runnable script
- reorganized code and fixed some of TODOs
2020-06-03 13:40:22 +02:00
Mikhail Goncharov
afed3a7898 Update docs and script for installing win machines
I have tried to install new windows machine for buildkite and updated
some scrips and docs on along the way.

- Updated base image for k8s agent installation as it gave a warning that
previous version was old.

- Now buildkite secret is configured in a powershell script along with
tags (and possible other parameters).

- Split "windows_agent_start.ps1" to "..jenkins" and "..buildkite" as
  some parameters are different.

- Created a "windows-development" machine in GCP stat can be resumed
  to build docker images / expriment.
2020-05-27 15:41:49 +02:00
ChristianKuehnel
57a2668479
explained docker containers 2020-05-12 09:02:20 +02:00
ChristianKuehnel
e357d584d7
Update user_doc.md 2020-05-11 11:38:01 +02:00
ChristianKuehnel
6f9fdcec4e
updated diagram 2020-05-11 10:23:04 +02:00
Christian Kühnel
4c48379707 improved windows agent creation 2020-05-08 13:19:04 +02:00