1
0
Fork 0
Commit graph

143 commits

Author SHA1 Message Date
Christian Kühnel
d6e9b1f6c4 manual commands for vs config 2020-05-04 14:23:02 +00:00
Mikhail Goncharov
39667898a7 use env variables 2020-04-24 15:43:09 +02:00
Mikhail Goncharov
e860c29a47 Checkout scripts and define pipeline in python 2020-04-24 14:47:00 +02:00
Mikhail Goncharov
8f2cc6f5b4
Merge pull request #166 from google/update-image-pipeline-bootstrap
Forked docker image for premerge
2020-04-24 12:30:36 +02:00
Mikhail Goncharov
27ab5abd0a Forked docker image for premerge
- added simple script to define pipeline, it will check out from this
  repo later

- refactored docker container, e.g. merged most of the RUN steps into
  one and moved steps that are likely to change closer to the end. That
  should improve rebuild / upload speed.

Sample run: https://buildkite.com/llvm-project/premerge/builds/14
2020-04-24 12:29:44 +02:00
Christian Kühnel
8039b8a6f7 changed the way sccache is started 2020-04-24 09:54:36 +00:00
Christian Kühnel
7a87f7d453 fixed version file path 2020-04-24 09:54:36 +00:00
Christian Kühnel
d8a19b36e4 fixed vs code target architecture 2020-04-24 09:54:36 +00:00
Christian Kühnel
b9f8ce9f20 bumped version numbers 2020-04-23 09:47:47 +00:00
Mikhail Goncharov
eca78eb366 Add new deployment for agent that will do premerge checks
maybe we will later use same agents for everything but for now I don't
want to modify working build much. But I have updated deployment of
release agent to use correct docker image (there were renamed a while
ago) and pass tags and agent token via env variables.

Have not deployed new deployment for release yet.
2020-04-22 12:11:23 +02:00
ChristianKuehnel
a47751ebe8
Upgrade Windows agents to Visual Studio 2019 and sccache (#162)
* added cmake parameters for sccache

* added sccache

* removed stray debug output

* starting sccache with VS environment

* added container for Visual Studio 2019

* fixed comments

* considering WIndows version

* updated to vs2019

* using MS install method

* snapshot of VS2019 experiments

* using --installRecommended

* cleanup of dockerfile

* updated path

* fixed dockerfile

* dumped version number

* exclude for virus scan

* added testing option

this does not start the agent

* write results on failures

* added timeouts for pipelines

* moving master pipelines to python scripts

* added flang to automatic project selection

based on #159, this will enable flang for beta testers

* added persistent workspace for testing containers

* added secure delete function

* added better log message

* deleting read-only files

* checking existence before setting flags

* using unlink

* deleting recursively

* using pathlib for chmod

* using custom workspace

* fixed drive

* separate handling of single files

* simplified read-only handling again

* removed vsdevcmd calls

as it's already set in the docker Entrypoint

* renamed container folders

* windows version not needed any more

* bumped version number

* bumped version number

* script cleanup

* added cmake parameters for sccache

* added sccache

* starting sccache with VS environment

* added container for Visual Studio 2019

* fixed comments

* considering WIndows version

* updated to vs2019

* using MS install method

* snapshot of VS2019 experiments

* using --installRecommended

* cleanup of dockerfile

* updated path

* fixed dockerfile

* dumped version number

* removed vsdevcmd calls

as it's already set in the docker Entrypoint

* renamed container folders

* windows version not needed any more

* bumped version number

* bumped version number

* script cleanup

* removed sccache from vs2017

* making windows image configurable

* added versioning

* created windows BETA pipeline

* added Jenkins label for vs2019
2020-04-21 11:46:41 +02:00
Christian Kühnel
b36a7733de fixed jeninkins version
To avoid upgrade to later version with mandatory CSRF enabled.
This did break the Phabricator integration in #163.
2020-04-20 21:52:07 +02:00
Christian Kühnel
651bf69a89 added persistent workspace for testing containers 2020-04-15 18:00:53 +02:00
Christian Kühnel
2899b93c16 added gdb
fixed python bdist_wheel warning
2020-03-27 13:51:54 +01:00
Christian Kühnel
24e751f6ec updated container and deployment to store ssh keys for github uploads 2020-03-23 15:34:23 +01:00
Christian Kühnel
9b2e225461 addd buildbot installation 2020-03-19 14:53:19 +01:00
Christian Kühnel
f182e84f1a Docker build toolchain working 2020-03-19 14:21:32 +01:00
Christian Kühnel
e18bd6fca7 incremented version number 2020-02-24 15:28:59 +00:00
Christian Kühnel
d00cd053e1 tagging and pushing "latest" 2020-02-20 16:45:04 +00:00
Christian Kühnel
548e07d5d4 added versioning to windows docker containers 2020-02-20 15:18:26 +00:00
Christian Kühnel
a0f676dfba set fixed windows version number 2020-02-20 09:15:11 +00:00
Christian Kühnel
dd375f71db using upstream jenkins image 2020-02-17 10:50:37 +01:00
Christian Kühnel
a4e320ac04 Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-02-06 14:08:26 +00:00
Christian Kühnel
66a653578b changed way of authenticating gsutil 2020-02-06 14:07:51 +00:00
Christian Kühnel
5e0b5873a9 changing authentication for gsutil 2020-02-06 14:26:46 +01:00
Christian Kühnel
39319ab89d named the buildkite windows agents 2020-02-06 14:05:46 +01:00
Christian Kühnel
9e431d4ab9 added comment on host names 2020-02-06 13:32:26 +01:00
Christian Kühnel
e8a9d7bf17 removing perl
messes up the entire build toolchain
2020-02-04 15:46:47 +00:00
Christian Kühnel
1f7eff3c41 Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-02-04 10:14:36 +00:00
Christian Kühnel
7cceab06d9 using push/pop-location 2020-02-04 11:14:22 +01:00
Christian Kühnel
dc132819d6 removed perl from the path 2020-02-04 08:58:35 +00:00
Christian Kühnel
69ebbaa3f7 moved temp to SSD 2020-02-03 10:46:29 +00:00
Christian Kühnel
87c591d6b2 added perl for OpenMP 2020-01-31 13:19:07 +00:00
Christian Kühnel
64e18e7f85 changed path to requirements.txt 2020-01-28 16:40:08 +01:00
Mikhail Goncharov
ed0fb93e67 updated buildkite to llvm-10 2020-01-24 10:06:42 +01:00
Mikhail Goncharov
caef6c8238 fix build 2020-01-23 17:55:56 +01:00
Mikhail Goncharov
e13822f0f5 Use llvm-10 on phabricator agent
- removed 'clang8' from the image name;

- added --no-cache to ./build_deploy.sh to make sure that image will use
  most recent packages.

Tested locally
2020-01-23 16:17:19 +01:00
Mikhail Goncharov
403973a356 Line endings, docs 2020-01-22 19:04:13 +01:00
Christian Kühnel
da4237c666 buildkite not running as root anymore 2020-01-20 10:07:54 +01:00
Christian Kühnel
06826a8310 using command line arguments 2020-01-17 15:50:52 +01:00
Christian Kühnel
f2170f4955 updated buildkite windows 2020-01-17 11:52:31 +00:00
Christian Kühnel
ae519e1887 set of flag 2020-01-17 12:51:51 +01:00
Christian Kühnel
8d6af88016 moved build path to SSD 2020-01-17 11:42:27 +01:00
Christian Kühnel
c350bec730 config files to run buildkite for Linux 2020-01-17 10:33:08 +01:00
Christian Kühnel
a62a99f0d3 added pip to windows image 2020-01-16 14:19:47 +00:00
Christian Kühnel
4f4bcc7f65 installed gsutils in container 2019-12-20 11:07:09 +00:00
Christian Kühnel
67f6d1d48d migrated to python3 2019-12-20 08:47:39 +00:00
Christian Kühnel
4d6362b377 cleanup of powershell invocations 2019-12-20 08:21:46 +00:00
Christian Kühnel
451671cd88 tweaks for docker on windows 2019-12-18 17:29:21 +00:00
Christian Kühnel
ffb70a2922 cleanup 2019-12-16 16:38:04 +00:00
Christian Kühnel
f05a4240f2 fixed error handling 2019-12-16 10:02:28 +00:00
Christian Kühnel
250e527cf1 added access to result storage 2019-12-13 15:08:41 +00:00
Christian Kühnel
eba636aa6c moved workspace to SSD 2019-12-13 14:58:56 +00:00
Mikhail Goncharov
8e5db1e6bd Update image to use default clang package
+ add jq to parse conduit responses later
2019-12-11 15:58:00 +01:00
Mikhail Goncharov
7faaec98e7 Attach diffs produced by git-clang-format as lint messages.
E.g.: https://reviews.llvm.org/D71197?id=233029
Will add a link to file and code to apply the patch in the next PR.

+ don't create TARGET_DIR in scripts;
+ updated section about local build;
+ partially specified inputs / outputs of scripts so it's more transparent what are the results;
+ added symlink to compile_command.json (clang-tidy will need it);
+ add IDEA files to .gitignore.
2019-12-11 08:55:38 +01:00
Christian Kühnel
2751c9e1b7 creating workspace folder 2019-12-02 13:42:14 +01:00
Christian Kühnel
0cb11591ea changes jenkins URL 2019-12-02 09:49:09 +01:00
Christian Kühnel
355111c0a0 shortened workspace name 2019-11-29 14:46:33 +00:00
Christian Kühnel
d67bf80b16 fixed mkdir and variables 2019-11-29 12:41:49 +00:00
Christian Kühnel
d2be5e1011 created windows agent container 2019-11-29 12:23:45 +00:00
Christian Kühnel
804d0ab083 removed redundant settings 2019-11-29 11:32:53 +00:00
Christian Kühnel
29bcd2dc53 naming the docker container 2019-11-27 15:01:10 +00:00
Christian Kühnel
736af1d894 shortened path names 2019-11-27 10:53:19 +00:00
Christian Kühnel
f3c2fa91a4 basing build-kite image on agent-windows 2019-11-26 16:41:51 +00:00
ChristianKuehnel
de34fb9572
Create docker container for Windows build (#52)
* first steps towards windows builds #25

* added build scripts for windows

* moved from powershell to CMD

* script cleanup

* set up jenkins swarm plugin

* added deployment script for windows

* first draft of jenkins file for windows

* first shot at windows pods

* first draft for buildkite agent

* added call to run_cmake.bat

* added call to run_ninja.bat

* added new buildkite script

* added Dockerfile for buildkite agent

* fixed userprofile path

* added /IncludeOptional for VS

I hope that includes all required libraries

* moved work folder to W:

* added git config for long file names

* added more CMake flags

* setting x64 bit arch in a different way

* and yet another way to set 64bit

* merged buildkite changes to jenkins scripts

* hiding license in batch script runs

* running release build

* added test xml log

* compilation is working, but not all tests

* cmake is in patch now

* updated the dependencies from buildkite config

* dockerfile cleanup

* change how git handles line endings

* updated comment

* performance improvment for volume

* changed workdir folder

* using gnuwin package

split installation into separate layers to speed up incremental changes
2019-11-26 17:10:30 +01:00
Christian Kühnel
806e0dd9d2 upgraded to python3, added dependencies for more projects 2019-11-13 18:13:14 +01:00
Christian Kühnel
08e062f1e5 added optional 2nd parameter to select which command to run 2019-11-13 17:50:49 +01:00
Christian Kühnel
11f4c9c525 added label for linux container 2019-11-04 14:12:11 +01:00
Christian Kühnel
18cc8b90b5 removed redundant entry 2019-10-24 05:39:30 -07:00
Christian Kühnel
6e59354f42 set locale in docker container 2019-10-23 20:33:23 +02:00
Christian Kühnel
580a6ebae0 removing trailing slash from inputs 2019-10-16 12:06:27 +02:00
Christian Kühnel
8de4cb0e2e changed jenkins agent root folder 2019-10-16 12:02:41 +02:00
Christian Kühnel
f08402be35 added pip and phabtalk packages to agent container 2019-10-16 09:47:17 +02:00
Christian Kühnel
6d831f8601 removed deprecated ssh parts 2019-10-14 18:14:19 +02:00
Christian Kühnel
da30407385 agent now running as user jeknins 2019-10-14 18:13:46 +02:00
Christian Kühnel
a88e8f2ce0 agents now connect through swarm plugin 2019-10-14 18:03:21 +02:00
Christian Kühnel
4cb862a908 backup for github launch 2019-10-14 09:07:34 +02:00
Christian Kühnel
90e82aee20 added clang to package dependencies, moved ccache to ssd 2019-10-07 19:52:29 +02:00
Christian Kühnel
83b34ae1b5 added custom script to report results 2019-10-07 15:32:25 +02:00
Christian Kühnel
24951b27f2 added license 2019-10-07 15:32:12 +02:00
Christian Kühnel
d5d538f9bf Add now machines with integrated SSD
This might speed up the builds significantly
2019-10-07 14:08:34 +02:00
Christian Kühnel
cb992309de fixed typo 2019-10-07 11:47:26 +02:00
Christian Kühnel
2440f2583d added license text 2019-10-07 11:46:49 +02:00
Christian Kühnel
03816ce119 removed index.html from nginx 2019-10-07 09:39:35 +02:00
Christian Kühnel
5023373403 added zip to agent 2019-10-07 09:39:25 +02:00
Christian Kühnel
511a828ca2 added cleanup of build folders 2019-10-05 12:15:16 +02:00
Christian Kühnel
8b96eaa7b0 build results are published to nfs 2019-10-05 11:33:39 +02:00
Christian Kühnel
cc1b61309a added NFS server to share files 2019-10-05 10:35:32 +02:00
Christian Kühnel
639ce6447a empty deployment of nginx 2019-10-05 08:48:31 +02:00
Christian Kühnel
c1cff30245 moved scripts one folder up 2019-10-05 08:43:17 +02:00
Christian Kühnel
6c99e22efc repo cleanup 2019-10-04 14:35:05 +02:00
Christian Kühnel
63d7054b20 added license 2019-10-04 14:31:57 +02:00
Christian Kühnel
dd96ebb61d initial import of configuration files 2019-10-04 10:26:20 +02:00