1
0
Fork 0
Commit graph

53 commits

Author SHA1 Message Date
Mikhail Goncharov
58e13f22d1 inrease timeout for win, minor doc 2021-04-23 12:28:01 +02:00
Mikhail Goncharov
f53c519843 updated docs on windows dev, new setting to skip generated steps 2021-03-19 09:22:21 +01:00
Mikhail Goncharov
637056379c update windows setup 2021-03-12 15:31:06 +01:00
Mikhail Goncharov
65fa122f0e update windows setup 2021-03-12 12:10:43 +01:00
Mikhail Goncharov
e83da03b17 add clang to flang deps
related to #271: clang-tidy cannot find gtest/gtest
2021-01-18 11:04:33 +01:00
Mikhail Goncharov
99e43a8d9a rename master to main branch following LLVM 2020-12-10 09:29:24 +01:00
Mikhail Goncharov
681fbbe2cf Process results and unit-test output of libcxx
Now "report" step combines result in a uniform way and processes unit test
results XML output. It works for sub-builds only started from the 'premerge'
pipeline, i.e. non-recursive. One downside is that now one has to wait until
all jobs have finished.

- Add instructions to setup python environment

- added option to do full report cycle but not call Phabricator

- use "annotations" to show build status. That lifts the need to filter ninja
  and other output (thus `ph_no_filter_output` param removed) and output
  everything. That is nice as script failures no longer lead to loss of logs.

- improved annotate() usability

- misc fixes
2020-11-25 15:29:50 +01:00
Mikhail Goncharov
ab1b8d5ae2 Use buildkite API instead of passing stat via files
Previous approach had drawbacks:

- every step had to implement exporting of results in fixed format

- if step failed then failure will not be detected

Now report step will fetch results directly from Buildkite.
Agents have to be updated to have BUILDKITE_API_TOKEN env.
2020-10-08 14:40:57 +02:00
Mikhail Goncharov
5cd16dde45 Don't fail if phabricator target is not specified
That is useful when testing pipelines
2020-10-05 13:33:19 +02:00
Mikhail Goncharov
c082f1aa9b Organize scripts
Move all .py that are supposed to be run as __main__ under ./scripts
so there is no need to manipulate sys.path to import modules.

Runby cleanup
2020-10-02 14:18:22 +02:00
Mikhail Goncharov
405643a089 Allow other refspecs to be used.
That gives us a way to test e.g. pull requests by specifying
ph_scripts_refspec="pull/123/head"

Also keep "ph_" prefix to remove confusion we had between
"scripts_branch" and "ph_scripts_branch" before.

Update docs and moved "testing" sections up.
2020-09-29 17:57:33 +02:00
Mikhail Goncharov
8b36ff5888 remove jenkins configs and scrips
- moved linux agents to a new node pool (basically renamed old one)

- removed some out of date scripts or moved them to playlists

- removed shell scrips invoked from jenkins

- minor docs updates

Some python classes methods are not used anymore and will be cleaned up
separately.
2020-09-01 09:51:49 +02:00
Mikhail Goncharov
5380ea63b4 docs about machine config and ingress 2020-08-28 13:08:40 +02:00
Mikhail Goncharov
5610d8d02f review fixes 2 2020-08-27 15:30:03 +02:00
Mikhail Goncharov
056e5cdbaa update docs
- move "user_doc" to "README" as it's publicly facing page visible when one opens repo
- move developer docs to "development"
- update docs to reflect current buildkite setup (not completely)
- grammar
2020-08-27 15:30:03 +02:00
Mikhail Goncharov
3f7d29b49d
Merge branch 'master' into playbook-test-branch-changes 2020-07-30 09:40:47 +02:00
Mikhail Goncharov
cb41bb38dd reset before checking out master 2020-07-30 09:32:50 +02:00
Mikhail Goncharov
36612d77aa
Update playbooks.md
Described testing changes with branches
2020-07-28 15:26:43 +02:00
Mikhail Goncharov
e41afba72d update docs 2020-07-27 19:16:33 +02:00
Mikhail Goncharov
d4e5126090 Update docs on ssd disk initialization
+ change number of linux agents

+ removed outputs in job analysis

+ updated windows image
2020-07-21 10:40:26 +02:00
Mikhail Goncharov
42d7237491 Add step to schedule agent restart on windows 2020-07-17 18:37:29 +02:00
Mikhail Goncharov
4241d6b53e Doc update 2020-06-29 10:56:21 +02:00
Mikhail Goncharov
44b870c144 Update agents name to be short
long names causes some tests to fail due to windows limitation
2020-06-17 10:20:34 +02:00
Mikhail Goncharov
ffaba986c1 Deployment changes
do not restart win docker as it makes it impossible to stop agent from
buildkite UI for maintenance
2020-06-17 09:46:42 +02:00
Mikhail Goncharov
4c3cd1b6f5 Use os in queue name
That is useful for metrics collection as buildkite metrics only reports
per queue metrics
2020-06-16 10:30:24 +02:00
Mikhail Goncharov
5d97109795 how to setup buildkite metrics 2020-06-15 16:59:15 +02:00
Mikhail Goncharov
770f6726bc Add new pipeline to build a master branch 2020-06-04 08:40:04 +02:00
Mikhail Goncharov
017ca44a75 Add windows build
- configured sccache on buildkite windows machines
- final result is sent to phabricator from "summary.py" that waits for both builds to complete
- extracted "add_url_artifact" to a runnable script
- reorganized code and fixed some of TODOs
2020-06-03 13:40:22 +02:00
Mikhail Goncharov
afed3a7898 Update docs and script for installing win machines
I have tried to install new windows machine for buildkite and updated
some scrips and docs on along the way.

- Updated base image for k8s agent installation as it gave a warning that
previous version was old.

- Now buildkite secret is configured in a powershell script along with
tags (and possible other parameters).

- Split "windows_agent_start.ps1" to "..jenkins" and "..buildkite" as
  some parameters are different.

- Created a "windows-development" machine in GCP stat can be resumed
  to build docker images / expriment.
2020-05-27 15:41:49 +02:00
Christian Kühnel
4c48379707 improved windows agent creation 2020-05-08 13:19:04 +02:00
ChristianKuehnel
2451e00559
fixed more typos in commands 2020-04-24 10:51:26 +02:00
ChristianKuehnel
1d2b7a0f41
Added instructions for copying credentials 2020-04-24 10:46:55 +02:00
ChristianKuehnel
e5366d5bc6
fixed instructions for new WIndows agent 2020-04-24 10:31:51 +02:00
ChristianKuehnel
4afcd84e56
updated documentation for public rollout (#139) 2020-02-26 15:46:15 +01:00
Christian Kühnel
3f52cf22b7 lessonsn learned from next agent 2020-02-03 15:25:08 +01:00
Christian Kühnel
1ffa004dae fixed line breaks 2020-02-03 15:10:42 +01:00
Mikhail Goncharov
e13822f0f5 Use llvm-10 on phabricator agent
- removed 'clang8' from the image name;

- added --no-cache to ./build_deploy.sh to make sure that image will use
  most recent packages.

Tested locally
2020-01-23 16:17:19 +01:00
Mikhail Goncharov
403973a356 Line endings, docs 2020-01-22 19:04:13 +01:00
Christian Kühnel
275c2f81b1 Updated boot strapping of windows agents 2020-01-22 17:02:05 +01:00
Mikhail Goncharov
16dce5f668 update path to script 2020-01-21 15:46:17 +01:00
Christian Kühnel
a4fc963f43 added detailed install commands 2019-12-18 15:07:34 +00:00
Christian Kühnel
951c5dbe2d moving to docker enterprise 2019-12-18 10:24:31 +01:00
Christian Kühnel
14733b9f04 fixed typos 2019-12-16 17:46:09 +01:00
Christian Kühnel
9dbeaa82ef added section von ssh 2019-12-16 14:42:29 +00:00
Christian Kühnel
84737cb49b updated intallation for Windows image builder 2019-12-13 18:30:08 +01:00
Mikhail Goncharov
8d390ff370 Refactor Phabricator report construction
Now report is constructed by adding more data from several stages and
represents internal structure rather what API expects.

+ Made all function that don't interact with phabricator free standing
+ Now links list all files in results directory
+ Status icons

Example comment: https://reviews.llvm.org/D71197#1779176 (links don't work).
2019-12-11 14:36:20 +01:00
Mikhail Goncharov
7faaec98e7 Attach diffs produced by git-clang-format as lint messages.
E.g.: https://reviews.llvm.org/D71197?id=233029
Will add a link to file and code to apply the patch in the next PR.

+ don't create TARGET_DIR in scripts;
+ updated section about local build;
+ partially specified inputs / outputs of scripts so it's more transparent what are the results;
+ added symlink to compile_command.json (clang-tidy will need it);
+ add IDEA files to .gitignore.
2019-12-11 08:55:38 +01:00
Mikhail Goncharov
650ed9c274 Add section about local changes (#73)
For now only describing how to get an conduit API token
2019-12-09 10:59:08 +01:00
Christian Kühnel
5e00207580 improved documentation 2019-12-02 12:50:33 +01:00
Christian Kühnel
740b143def added docu: spwaning windows agents 2019-12-02 12:49:01 +01:00