- configured sccache on buildkite windows machines
- final result is sent to phabricator from "summary.py" that waits for both builds to complete
- extracted "add_url_artifact" to a runnable script
- reorganized code and fixed some of TODOs
I have tried to install new windows machine for buildkite and updated
some scrips and docs on along the way.
- Updated base image for k8s agent installation as it gave a warning that
previous version was old.
- Now buildkite secret is configured in a powershell script along with
tags (and possible other parameters).
- Split "windows_agent_start.ps1" to "..jenkins" and "..buildkite" as
some parameters are different.
- Created a "windows-development" machine in GCP stat can be resumed
to build docker images / expriment.
Harbormaster can send a request in url encoded form while buildkite
expects a POST request with json. Instead of modifying harbormastar or
buildkite this adds a simple proxy that accepts url encoded form and
creates a request that buildkite expects. To avoid potential abuse,
nginx asks for simple http auth credentials stored in harbormaster.
All build parameters passed by proxy are put into build metadata and as
ph_* env variables available during the build.
Secrets involved:
- harbormastert knows http-auth to proxy (stored in privatly and in k8
buildkite/http-auth as auth file);
- proxy knows buildkite api token (mine atm);
- build agent knows conduit API token (mine atm),
and SSH key of llvm-premerge-tests-bot (in k8 buildkite/github-ssh).
Sample build: https://reviews.llvm.org/harbormaster/build/64828/8/https://buildkite.com/llvm-project/premerge/builds/48
- added simple script to define pipeline, it will check out from this
repo later
- refactored docker container, e.g. merged most of the RUN steps into
one and moved steps that are likely to change closer to the end. That
should improve rebuild / upload speed.
Sample run: https://buildkite.com/llvm-project/premerge/builds/14
maybe we will later use same agents for everything but for now I don't
want to modify working build much. But I have updated deployment of
release agent to use correct docker image (there were renamed a while
ago) and pass tags and agent token via env variables.
Have not deployed new deployment for release yet.
* first steps towards windows builds #25
* added build scripts for windows
* moved from powershell to CMD
* script cleanup
* set up jenkins swarm plugin
* added deployment script for windows
* first draft of jenkins file for windows
* first shot at windows pods
* first draft for buildkite agent
* added call to run_cmake.bat
* added call to run_ninja.bat
* added new buildkite script
* added Dockerfile for buildkite agent
* fixed userprofile path
* added /IncludeOptional for VS
I hope that includes all required libraries
* moved work folder to W:
* added git config for long file names
* added more CMake flags
* setting x64 bit arch in a different way
* and yet another way to set 64bit
* merged buildkite changes to jenkins scripts
* hiding license in batch script runs
* running release build
* added test xml log
* compilation is working, but not all tests
* cmake is in patch now
* updated the dependencies from buildkite config
* dockerfile cleanup
* change how git handles line endings
* updated comment
* performance improvment for volume
* changed workdir folder
* using gnuwin package
split installation into separate layers to speed up incremental changes
