1
0
Fork 0
Commit graph

75 commits

Author SHA1 Message Date
Mikhail Goncharov
99e43a8d9a rename master to main branch following LLVM 2020-12-10 09:29:24 +01:00
Mikhail Goncharov
681fbbe2cf Process results and unit-test output of libcxx
Now "report" step combines result in a uniform way and processes unit test
results XML output. It works for sub-builds only started from the 'premerge'
pipeline, i.e. non-recursive. One downside is that now one has to wait until
all jobs have finished.

- Add instructions to setup python environment

- added option to do full report cycle but not call Phabricator

- use "annotations" to show build status. That lifts the need to filter ninja
  and other output (thus `ph_no_filter_output` param removed) and output
  everything. That is nice as script failures no longer lead to loss of logs.

- improved annotate() usability

- misc fixes
2020-11-25 15:29:50 +01:00
Mikhail Goncharov
ab1b8d5ae2 Use buildkite API instead of passing stat via files
Previous approach had drawbacks:

- every step had to implement exporting of results in fixed format

- if step failed then failure will not be detected

Now report step will fetch results directly from Buildkite.
Agents have to be updated to have BUILDKITE_API_TOKEN env.
2020-10-08 14:40:57 +02:00
Mikhail Goncharov
5cd16dde45 Don't fail if phabricator target is not specified
That is useful when testing pipelines
2020-10-05 13:33:19 +02:00
Mikhail Goncharov
c082f1aa9b Organize scripts
Move all .py that are supposed to be run as __main__ under ./scripts
so there is no need to manipulate sys.path to import modules.

Runby cleanup
2020-10-02 14:18:22 +02:00
Mikhail Goncharov
405643a089 Allow other refspecs to be used.
That gives us a way to test e.g. pull requests by specifying
ph_scripts_refspec="pull/123/head"

Also keep "ph_" prefix to remove confusion we had between
"scripts_branch" and "ph_scripts_branch" before.

Update docs and moved "testing" sections up.
2020-09-29 17:57:33 +02:00
Mikhail Goncharov
381b1bf1a6 Update nginx configuration to capture all traffic to the static IP
Right now we have only one service we need to serve.

I kept cert manager config for now in the case we want to get a hostname
in the near future.

Updated doc + minor doc / setup fixes.

fixes #242
2020-09-29 11:44:12 +02:00
Mikhail Goncharov
8b36ff5888 remove jenkins configs and scrips
- moved linux agents to a new node pool (basically renamed old one)

- removed some out of date scripts or moved them to playlists

- removed shell scrips invoked from jenkins

- minor docs updates

Some python classes methods are not used anymore and will be cleaned up
separately.
2020-09-01 09:51:49 +02:00
Mikhail Goncharov
5380ea63b4 docs about machine config and ingress 2020-08-28 13:08:40 +02:00
Mikhail Goncharov
5610d8d02f review fixes 2 2020-08-27 15:30:03 +02:00
Mikhail Goncharov
33947bdd1f review fixes, formatted text 2020-08-27 15:30:03 +02:00
Mikhail Goncharov
056e5cdbaa update docs
- move "user_doc" to "README" as it's publicly facing page visible when one opens repo
- move developer docs to "development"
- update docs to reflect current buildkite setup (not completely)
- grammar
2020-08-27 15:30:03 +02:00
Mikhail Goncharov
3f7d29b49d
Merge branch 'master' into playbook-test-branch-changes 2020-07-30 09:40:47 +02:00
Mikhail Goncharov
cb41bb38dd reset before checking out master 2020-07-30 09:32:50 +02:00
Mikhail Goncharov
36612d77aa
Update playbooks.md
Described testing changes with branches
2020-07-28 15:26:43 +02:00
Mikhail Goncharov
e41afba72d update docs 2020-07-27 19:16:33 +02:00
Mikhail Goncharov
d4e5126090 Update docs on ssd disk initialization
+ change number of linux agents

+ removed outputs in job analysis

+ updated windows image
2020-07-21 10:40:26 +02:00
Mikhail Goncharov
42d7237491 Add step to schedule agent restart on windows 2020-07-17 18:37:29 +02:00
Mikhail Goncharov
6f69b1a108
Merge pull request #204 from mtrofin/patch-1
blacklist -> ignorelist
2020-07-07 15:12:23 +02:00
Mikhail Goncharov
4241d6b53e Doc update 2020-06-29 10:56:21 +02:00
Mircea Trofin
c7047d46ed
blacklist -> ignorelist 2020-06-22 08:49:19 -07:00
Mikhail Goncharov
44b870c144 Update agents name to be short
long names causes some tests to fail due to windows limitation
2020-06-17 10:20:34 +02:00
Mikhail Goncharov
ffaba986c1 Deployment changes
do not restart win docker as it makes it impossible to stop agent from
buildkite UI for maintenance
2020-06-17 09:46:42 +02:00
Mikhail Goncharov
4c3cd1b6f5 Use os in queue name
That is useful for metrics collection as buildkite metrics only reports
per queue metrics
2020-06-16 10:30:24 +02:00
Mikhail Goncharov
5d97109795 how to setup buildkite metrics 2020-06-15 16:59:15 +02:00
Mikhail Goncharov
770f6726bc Add new pipeline to build a master branch 2020-06-04 08:40:04 +02:00
Mikhail Goncharov
017ca44a75 Add windows build
- configured sccache on buildkite windows machines
- final result is sent to phabricator from "summary.py" that waits for both builds to complete
- extracted "add_url_artifact" to a runnable script
- reorganized code and fixed some of TODOs
2020-06-03 13:40:22 +02:00
Mikhail Goncharov
afed3a7898 Update docs and script for installing win machines
I have tried to install new windows machine for buildkite and updated
some scrips and docs on along the way.

- Updated base image for k8s agent installation as it gave a warning that
previous version was old.

- Now buildkite secret is configured in a powershell script along with
tags (and possible other parameters).

- Split "windows_agent_start.ps1" to "..jenkins" and "..buildkite" as
  some parameters are different.

- Created a "windows-development" machine in GCP stat can be resumed
  to build docker images / expriment.
2020-05-27 15:41:49 +02:00
ChristianKuehnel
57a2668479
explained docker containers 2020-05-12 09:02:20 +02:00
ChristianKuehnel
e357d584d7
Update user_doc.md 2020-05-11 11:38:01 +02:00
ChristianKuehnel
6f9fdcec4e
updated diagram 2020-05-11 10:23:04 +02:00
Christian Kühnel
4c48379707 improved windows agent creation 2020-05-08 13:19:04 +02:00
ChristianKuehnel
5011b8bfdb
Updated docs after rollout of apply_patch stage 2020-05-06 14:16:23 +02:00
ChristianKuehnel
2451e00559
fixed more typos in commands 2020-04-24 10:51:26 +02:00
ChristianKuehnel
1d2b7a0f41
Added instructions for copying credentials 2020-04-24 10:46:55 +02:00
ChristianKuehnel
e5366d5bc6
fixed instructions for new WIndows agent 2020-04-24 10:31:51 +02:00
Mikhail Goncharov
33fb028630
Update buildkite.md 2020-04-21 10:49:40 +02:00
Mikhail Goncharov
24bb71763a
buildkite proposal 2020-04-17 13:42:29 +02:00
ChristianKuehnel
4afcd84e56
updated documentation for public rollout (#139) 2020-02-26 15:46:15 +01:00
ChristianKuehnel
b5d0ad3445
Update user_doc.md 2020-02-10 15:19:29 +01:00
Christian Kühnel
3f52cf22b7 lessonsn learned from next agent 2020-02-03 15:25:08 +01:00
Christian Kühnel
1ffa004dae fixed line breaks 2020-02-03 15:10:42 +01:00
Jan Kratochvil
bc971e0016
Fixed some doc typos. (#116) 2020-02-03 09:41:15 +01:00
Mikhail Goncharov
e13822f0f5 Use llvm-10 on phabricator agent
- removed 'clang8' from the image name;

- added --no-cache to ./build_deploy.sh to make sure that image will use
  most recent packages.

Tested locally
2020-01-23 16:17:19 +01:00
Mikhail Goncharov
6394a86514 fix doc links 2020-01-23 14:17:33 +01:00
Mikhail Goncharov
c28326f797 fix doc links 2020-01-23 14:16:42 +01:00
Mikhail Goncharov
a3f6610df2 Update bot report
- add links to join beta and report issue
- add link "not useful" to clang-tidy warning
- clang-tidy comment in report now tells how many inline comments were
  added
2020-01-23 13:35:40 +01:00
Mikhail Goncharov
403973a356 Line endings, docs 2020-01-22 19:04:13 +01:00
Christian Kühnel
275c2f81b1 Updated boot strapping of windows agents 2020-01-22 17:02:05 +01:00
Mikhail Goncharov
16dce5f668 update path to script 2020-01-21 15:46:17 +01:00