revi-archive/llvm-premerge-checks
1
0
Fork 0
Code Activity
1102 commits 20 branches 1 tag 1.7 MiB
Commit graph

560 commits

Author SHA1 Message Date
Christian Kühnel
856ce4b148 added missing dependencies to libc 2020-05-20 06:10:28 +02:00
Mikhail Goncharov
1505cfb635 build 2020-05-14 12:57:38 +02:00
Mikhail Goncharov
a152d97e3c Simple service to integrate harbormaster w/ buildkite 
Harbormaster can send a request in url encoded form while buildkite
expects a POST request with json. Instead of modifying harbormastar or
buildkite this adds a simple proxy that accepts url encoded form and
creates a request that buildkite expects. To avoid potential abuse,
nginx asks for simple http auth credentials stored in harbormaster.

All build parameters passed by proxy are put into build metadata and as
ph_* env variables available during the build.

Secrets involved:
- harbormastert knows http-auth to proxy (stored in privatly and in k8
  buildkite/http-auth as auth file);
- proxy knows buildkite api token (mine atm);
- build agent knows conduit API token (mine atm),
  and SSH key of llvm-premerge-tests-bot (in k8 buildkite/github-ssh).

Sample build: https://reviews.llvm.org/harbormaster/build/64828/8/
https://buildkite.com/llvm-project/premerge/builds/48
 2020-05-13 13:13:33 +02:00
Christian Kühnel
169744c617 extended log scan preiod to 90 days 
fixes #181
 2020-05-12 08:46:24 +02:00
Christian Kühnel
514a87aa4f added missing dependency 2020-05-11 16:55:20 +02:00
Christian Kühnel
2264ff6c41 fix issue as 'all' can't be built 2020-05-11 16:09:27 +02:00
Christian Kühnel
07404db9a2 disabling lldb again 2020-05-11 09:18:57 +02:00
Christian Kühnel
da722d3e40 continuing after failures 2020-05-08 16:24:16 +02:00
Christian Kühnel
510ed904f8 adding flush after every print 
so it appears in the Jenkins logs
 2020-05-08 15:36:13 +02:00
Christian Kühnel
8ea2a3b846 using different way for deleting remote branches 2020-05-08 15:33:45 +02:00
Christian Kühnel
d48ff97d0d only push if we deleted something 2020-05-08 15:27:09 +02:00
Christian Kühnel
45b28dd0df first version of repo cleanup script 2020-05-08 15:23:10 +02:00
Christian Kühnel
4c48379707 improved windows agent creation 2020-05-08 13:19:04 +02:00
Christian Kühnel
f9a9fb2be0 lldb tests were fixed, re-enabling it 2020-05-07 17:27:07 +02:00
Christian Kühnel
795d8270f7 fixed report writing 2020-05-06 17:24:26 +02:00
Christian Kühnel
10454dfba8 improved error handling for agent identification 2020-05-06 13:11:28 +02:00
Christian Kühnel
0e12d53def added agent detection 2020-05-06 12:43:35 +02:00
Christian Kühnel
971d4b8b74 fixes #175 2020-05-06 12:41:58 +02:00
Christian Kühnel
d55096bb7c getting workflow stages 2020-05-06 12:06:40 +02:00
Christian Kühnel
27da151340 creating tmp dir as needed 2020-05-05 16:54:08 +02:00
Christian Kühnel
9fabda9800 wiping sccache on timeouts 2020-05-04 14:22:49 +00:00
Christian Kühnel
b819a22205 added --dryrun 2020-05-04 14:16:50 +00:00
Christian Kühnel
5fd70b614d disabled lldb because of failing tests 
see https://results.llvm-merge-guard.org/master_debian_clang8-2152/console-log.txt
 2020-04-29 12:17:52 +02:00
Christian Kühnel
9841a13bbf re-enabled lldb 
after failing test was fixed
 2020-04-29 11:46:26 +02:00
Mikhail Goncharov
39667898a7 use env variables 2020-04-24 15:43:09 +02:00
Mikhail Goncharov
1a3952afc4
Merge pull request #171 from google/run-bootstrap-from-scripts 
Checkout scripts and define pipeline in python
 2020-04-24 14:48:09 +02:00
Mikhail Goncharov
e860c29a47 Checkout scripts and define pipeline in python 2020-04-24 14:47:00 +02:00
Christian Kühnel
9db1fd9654 disabled compiler-rt 2020-04-24 13:56:28 +02:00
Christian Kühnel
cd7f06c58d removed lldb 2020-04-24 11:59:37 +02:00
Christian Kühnel
6e2d4d612a disabled lldb 
test keeps failing, problem with lack of IPv6 networking on Kubernetes:
lldb-unit :: Host/./HostTests/ConnectionFileDescriptorTest.TCPGetURIv6
 2020-04-24 09:29:56 +02:00
Christian Kühnel
184d216b24 Flush stdout 
So that the log output appears in the Jenkins logs before the cmake output.
 2020-04-23 15:07:54 +02:00
Christian Kühnel
58ce45a053 Revert "added -DCMAKE_BUILD_TYPE=RelWithDebInfo for Windows builds" 
This reverts commit 963a5abc7f.
 2020-04-23 11:45:52 +02:00
Christian Kühnel
d1a1896933 excluding flang on Windows 2020-04-23 11:40:40 +02:00
Christian Kühnel
963a5abc7f added -DCMAKE_BUILD_TYPE=RelWithDebInfo for Windows builds 2020-04-23 11:31:38 +02:00
Christian Kühnel
71144d1922 By default: building all enabled projects. 
This is the fallback solution in case the project detection fails for
whatever reason. This is also used for building the master branches.
 2020-04-23 11:22:31 +02:00
ChristianKuehnel
a47751ebe8
Upgrade Windows agents to Visual Studio 2019 and sccache (#162) 
* added cmake parameters for sccache

* added sccache

* removed stray debug output

* starting sccache with VS environment

* added container for Visual Studio 2019

* fixed comments

* considering WIndows version

* updated to vs2019

* using MS install method

* snapshot of VS2019 experiments

* using --installRecommended

* cleanup of dockerfile

* updated path

* fixed dockerfile

* dumped version number

* exclude for virus scan

* added testing option

this does not start the agent

* write results on failures

* added timeouts for pipelines

* moving master pipelines to python scripts

* added flang to automatic project selection

based on #159, this will enable flang for beta testers

* added persistent workspace for testing containers

* added secure delete function

* added better log message

* deleting read-only files

* checking existence before setting flags

* using unlink

* deleting recursively

* using pathlib for chmod

* using custom workspace

* fixed drive

* separate handling of single files

* simplified read-only handling again

* removed vsdevcmd calls

as it's already set in the docker Entrypoint

* renamed container folders

* windows version not needed any more

* bumped version number

* bumped version number

* script cleanup

* added cmake parameters for sccache

* added sccache

* starting sccache with VS environment

* added container for Visual Studio 2019

* fixed comments

* considering WIndows version

* updated to vs2019

* using MS install method

* snapshot of VS2019 experiments

* using --installRecommended

* cleanup of dockerfile

* updated path

* fixed dockerfile

* dumped version number

* removed vsdevcmd calls

as it's already set in the docker Entrypoint

* renamed container folders

* windows version not needed any more

* bumped version number

* bumped version number

* script cleanup

* removed sccache from vs2017

* making windows image configurable

* added versioning

* created windows BETA pipeline

* added Jenkins label for vs2019
 2020-04-21 11:46:41 +02:00
Christian Kühnel
ba3e9c29da added lldb 2020-04-21 09:27:59 +02:00
Christian Kühnel
f4f6f5881c removed redundant backslashes 2020-04-17 16:33:51 +02:00
Christian Kühnel
7b90806189 removing --ignore-whitespace --whitespace=fix from git apply 
Now patches are applies as they are with whatever white space changes
they contain.

fixes #147
 2020-04-17 16:33:26 +02:00
Christian Kühnel
140d9f6f59 changed Error to Info 
fixes #155
 2020-04-17 16:25:27 +02:00
Mehdi Amini
aea569d4c8
Add flang to the list of project to test (#159) 
Co-authored-by: ChristianKuehnel <kuhnel@google.com>
 2020-04-17 14:30:18 +02:00
Christian Kühnel
bf0fb3fc68 simplified read-only handling again 2020-04-16 13:54:50 +02:00
Christian Kühnel
620945da3c separate handling of single files 2020-04-16 13:52:08 +02:00
Christian Kühnel
8e45e65375 using pathlib for chmod 2020-04-16 10:25:24 +00:00
Christian Kühnel
e3b384dc7f deleting recursively 2020-04-16 11:23:02 +02:00
Christian Kühnel
2850e18a47 using unlink 2020-04-16 11:15:40 +02:00
Christian Kühnel
66444f4952 checking existence before setting flags 2020-04-16 11:06:26 +02:00
Christian Kühnel
7521aeeda1 deleting read-only files 2020-04-16 10:30:39 +02:00
Christian Kühnel
b2c68fa9be added better log message 2020-04-16 10:12:57 +02:00
Christian Kühnel
eaa931da8c added secure delete function 2020-04-15 18:16:41 +02:00
Christian Kühnel
b8dcbcb273 added flang to automatic project selection 
based on #159, this will enable flang for beta testers
 2020-04-15 17:59:02 +02:00
Christian Kühnel
e1a8db6108 removed stray print statement 2020-04-15 17:54:18 +02:00
Christian Kühnel
e77f46914c write results on failures 2020-04-02 09:44:13 +02:00
Christian Kühnel
ace846991e added testing option 
this does not start the agent
 2020-04-02 08:42:08 +02:00
Christian Kühnel
2f25035eb7 exclude for virus scan 2020-04-01 17:36:03 +02:00
Christian Kühnel
6d9b38c62a wait for folder to be deleted 
should fix issues with existing folder on windows
 2020-04-01 16:29:19 +02:00
Christian Kühnel
0a7b6daabf added dryrun flag 2020-04-01 14:17:49 +02:00
Christian Kühnel
0e84fd14bb gettig stats from buildbots 2020-03-31 16:56:35 +02:00
Christian Kühnel
51e01caa5d excluding debuginfo-tests as tests are failing 2020-03-27 14:19:52 +01:00
Christian Kühnel
4465b0fc52 changed output paths of lint.sh 2020-03-26 10:19:20 +01:00
Christian Kühnel
580d4ba63c fixed linter script 
now support staging area and HEAD~1
 2020-03-26 09:47:45 +01:00
Christian Kühnel
3f81b7fb2a changed startup type for docker 2020-03-25 16:12:31 +01:00
Christian Kühnel
8fd5aa6550 SSD seems to have a new name... 2020-03-25 16:00:57 +01:00
Christian Kühnel
248a27b2c2 fixed ordering of commands to test git pull 2020-03-25 12:42:03 +00:00
Christian Kühnel
1df9edbd78 logging more data 2020-03-25 12:34:22 +00:00
Christian Kühnel
9a1988fece simplified benchmark steps 2020-03-25 11:40:51 +01:00
Christian Kühnel
188cb427f9 using default cmake targets 2020-03-25 11:21:45 +01:00
Christian Kühnel
9d17569b80 Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-03-25 09:51:02 +00:00
Christian Kühnel
b212480d76 added missing cmake steps 2020-03-25 09:50:58 +00:00
Christian Kühnel
ff730bd3a4 removed unused benchmark.ps1 2020-03-25 10:41:39 +01:00
Christian Kühnel
ad685d68d5 using own Remove command 
Shutil failed on windows
 2020-03-25 09:41:19 +00:00
Christian Kühnel
cc3a1ffb57 added remove steps 2020-03-25 09:25:50 +00:00
Christian Kühnel
c0879efea1 first draft of benchmark script 
to be used for performance tuning Windows builds
 2020-03-25 09:07:28 +01:00
Christian Kühnel
06ca090e8c fixes #149 2020-03-25 07:37:25 +01:00
Christian Kühnel
67a9698557 printing CMake arguments before execution. 
Should help analyzing problems.
 2020-03-25 07:35:03 +01:00
Christian Kühnel
9f41b8768b added log output 
To get more data to analyze #149
 2020-03-25 07:26:55 +01:00
Christian Kühnel
2b3d0e127b Handle problems when unable to push to origin/master 2020-03-25 07:09:31 +01:00
Christian Kühnel
7023688d1b fixxed choose_project for legagacy usage 2020-03-24 08:27:43 +00:00
Christian Kühnel
4492534331 creating symlink for compile_commands.json 2020-03-23 17:46:21 +01:00
Christian Kühnel
fe92469ae0 create branch for every diff 
This should be compatible with the current pipelines.
 2020-03-23 10:39:49 +01:00
ChristianKuehnel
a638dd5342
migrate scripts to python (#148) 
* run_cmake.py working locally on Linux

* added os detection of choose_projects

* cmake works on windows

* run_ninja works on windows

* fixed newline characters
 2020-03-23 09:03:24 +01:00
Christian Kühnel
5f2b26d44c added raw data export 2020-03-19 09:44:41 +01:00
Christian Kühnel
bfdf97e10a added reviews per path 2020-03-18 14:18:07 +01:00
Christian Kühnel
02493d440d fine tuning of metrics 2020-03-17 11:22:55 +01:00
Christian Kühnel
75d432e913 added documentation, fixed constructor 2020-03-13 16:58:12 +01:00
Christian Kühnel
5f4983f824 Extended documentation of status quo. 2020-03-13 16:57:37 +01:00
Christian Kühnel
cc0058c17e Improved sync script to consider individual diffs. 2020-03-13 13:50:30 +01:00
Christian Kühnel
1d171c0252 creating pull requests works 2020-03-13 13:50:30 +01:00
Christian Kühnel
4aed7decc3 creating branches working 2020-03-13 13:50:30 +01:00
Christian Kühnel
bed16617e7 cloning repo works 2020-03-13 13:50:30 +01:00
Christian Kühnel
0861e0ed25 added outline of the idea 2020-03-13 13:50:30 +01:00
Mikhail Goncharov
814517c89e add link to a full diff 2020-03-10 14:28:56 +01:00
Mikhail Goncharov
3ee08f18bc Ignore 'No relevant changes found.' text 2020-03-10 13:46:49 +01:00
Mikhail Goncharov
2fc3174a5c fix empty line removal for clang-tidy #136 2020-03-10 13:21:12 +01:00
Mikhail Goncharov
3bf868ec83 add link to build log 2020-03-10 13:07:26 +01:00
Mikhail Goncharov
dee5385784 Truncate clang-format comments 
If clang format diff is longer that 11 lines only show first 10 and add
note about omitted ones.

for #144
 2020-03-10 11:59:25 +01:00
Christian Kühnel
7131ef705c ignoring case in emails 2020-03-09 09:34:52 +01:00
Christian Kühnel
2975323644 added statistic on committer domains 2020-03-09 09:31:25 +01:00
Christian Kühnel
2eedd55b2b first jenkins statistics 2020-02-28 11:31:14 +01:00
Christian Kühnel
d1029befcc added first statistics for Jenkins 2020-02-27 23:54:54 +01:00
Alex Brachet
b8a3b31b48
Add libc to Pre-merge checks (#140) 2020-02-27 00:52:06 +01:00
Christian Kühnel
289d1c1205 added diffs 2020-02-24 17:54:11 +01:00
Christian Kühnel
c3c8f039cf try fixing whitespaces 2020-02-24 17:25:47 +01:00
Christian Kühnel
56d9ec34ab implemented Phabricator metrics 2020-02-24 16:38:29 +01:00
Christian Kühnel
14aaab86b1 upgrade gitpython to 3.0.6 
fixed #137
 2020-02-24 15:04:46 +00:00
Christian Kühnel
655f151bb8 first shot at getting build data from Phabricator 2020-02-21 13:20:33 +01:00
Christian Kühnel
814cd775bc script to get statistics from git repo 2020-02-21 13:19:11 +01:00
Christian Kühnel
3d3de17eb0 first version of git history evaluation 2020-02-20 19:04:34 +01:00
Christian Kühnel
3debb3046c code cleanup 2020-02-20 19:04:34 +01:00
Christian Kühnel
7fe1682620 start in background 2020-02-20 16:44:47 +00:00
Christian Kühnel
ee2d99ebd2 made master allow version numbers 2020-02-20 15:25:23 +00:00
Christian Kühnel
d91c7b653a flag to pick master 2020-02-20 15:24:09 +00:00
Mikhail Goncharov
70df407e0e Add name of build agent to summary 2020-02-19 17:48:51 +01:00
Mikhail Goncharov
c1396546e5 Remove empty lines at the end of clang-tidy report 2020-02-19 16:17:50 +01:00
Christian Kühnel
63ad2d1be6 retrying on phab.update_interfaces() 2020-02-19 12:08:18 +01:00
Christian Kühnel
b17bd93438 fixed division by zero problem 2020-02-18 13:37:13 +01:00
Christian Kühnel
22ce8e9632 handling broken XML files 2020-02-18 09:55:30 +01:00
Christian Kühnel
71240e7473 fixed types 2020-02-17 16:42:41 +00:00
Christian Kühnel
3b593e36cf no error message when no clang-tidy/format files given 2020-02-17 16:34:00 +00:00
Christian Kühnel
1c53d6ee86 added number of reviewed commits 2020-02-17 16:18:58 +01:00
Christian Kühnel
a2973f0f79 gathering data for reverts 2020-02-17 15:30:10 +01:00
Christian Kühnel
29c4333033 fixed initialisation 2020-02-17 14:55:10 +01:00
Christian Kühnel
ad0ad7ccc5 counting failed builds on buildbots 
storing results on Stackdriver
 2020-02-17 14:27:59 +01:00
ChristianKuehnel
16952faa46
Proposal for metrics (#127) 
* First draft for metrics
 2020-02-17 10:39:53 +01:00
ChristianKuehnel
f6ad5451a1
Improving phabtalk (#128) 
* enabled dryrun for add_artifact
 2020-02-17 10:23:47 +01:00
Christian Kühnel
2c36c12b93 remove llgo 2020-02-17 09:19:55 +00:00
Christian Kühnel
2da32a0cdf using git apply 
fixes problems for failing windows builds
 2020-02-17 09:08:34 +00:00
Christian Kühnel
a5f6516d71 re-enabled mlir 2020-02-11 11:54:22 +00:00
Christian Kühnel
64c68f1671 blacklisted more failing tests 2020-02-11 09:23:24 +01:00
Christian Kühnel
c7608ce4df blacklisting mlir 2020-02-10 18:14:51 +01:00
Christian Kühnel
f588cdf43d changing git diff after changes were committed 2020-02-10 16:28:41 +01:00
Mikhail Goncharov
fd5c753c69 small style fixes 2020-02-07 14:50:47 +01:00
Mikhail Goncharov
6b6558e22c Add reason of failure on top of summary 2020-02-07 12:30:39 +01:00
Mikhail Goncharov
41581c95be format failed tests results 2020-02-07 09:04:41 +01:00
Mikhail Goncharov
6012e873b5 ignore successfull 4 byte clang tidy report 2020-02-07 08:16:35 +01:00
Mikhail Goncharov
490939a4b7 also retry 'update_indterfaces' 2020-02-07 08:12:51 +01:00
Mikhail Goncharov
1859a7d4d3 trying to fix partial test XML 2020-02-06 17:48:36 +01:00
Mikhail Goncharov
144354bc04 Generate HTML summary instead of adding comment 
+ reworked phab-talk, now it's a class instead of free functions
 2020-02-06 16:49:42 +01:00
Mikhail Goncharov
0519b5a4e3 Attach artifacts to build 
Generate test summary HTML
 2020-02-06 14:24:31 +01:00
Mikhail Goncharov
f06f2e2f30 stage patch 2020-02-06 12:57:50 +01:00
Mikhail Goncharov
9cc6ccd98d fix filename 2020-02-06 12:02:09 +01:00
Mikhail Goncharov
48934a35ed Retry API calls 2020-02-06 11:28:30 +01:00
Mikhail Goncharov
b7c2b82685 debugging of test-results.xml parsing 2020-02-06 11:19:16 +01:00
Christian Kühnel
80c544a820 added quotes 2020-02-05 14:27:08 +01:00
Christian Kühnel
abb35c5f85 removed compiler-rt 2020-02-05 10:49:12 +00:00
Mikhail Goncharov
7ba1fd18ac Updates to apply-patch 
- use other commit then master as a base

- recursively find dependent commits

- commit dependent changes before applying main diff
 2020-02-05 10:01:13 +01:00
Christian Kühnel
ee420f2911 added comment 2020-02-04 15:55:24 +00:00
Christian Kühnel
25f69e6646 enabled more projects again 2020-02-04 15:55:04 +00:00
Christian Kühnel
1c8f5b3af3 removed defualt projects 
as it's not used
 2020-02-04 15:47:35 +00:00
Christian Kühnel
dfce0a7e0f Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-02-04 15:46:28 +00:00
Christian Kühnel
f6c03178a8 blacklisting openmp 2020-02-04 15:45:59 +00:00
Christian Kühnel
e6f4f6be25 casting diff_id to str 2020-02-04 16:36:42 +01:00
Mikhail Goncharov
a56698da78 Pass commit argument 2020-02-04 14:24:07 +01:00
Mikhail Goncharov
cf69866178 Allow specifying base commit in apply_patch2 
+ formatting changes and IDE warnings about types (e.g. str <-> int)
 2020-02-04 14:19:45 +01:00
Mikhail Goncharov
7e51fbcd8f
Merge pull request #117 from google/apply-patch 
Manually specify commit to base patch
 2020-02-04 13:45:02 +01:00
Christian Kühnel
227fc437ca reduced projects for diagnosis 2020-02-04 10:52:13 +00:00
Christian Kühnel
72d19f028d Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-02-04 07:51:56 +00:00
Christian Kühnel
c044513366 added missing quotes 2020-02-04 07:51:52 +00:00
Christian Kühnel
9519489e51 hard coded vs compiler 2020-02-04 07:49:00 +00:00
Christian Kühnel
d7a15da853 fixed comment 2020-02-04 08:31:03 +01:00
Christian Kühnel
50c20dc029 removed libcxx 2020-02-04 08:29:43 +01:00
Christian Kühnel
e653549be4 removed libc 2020-02-04 07:57:13 +01:00
Christian Kühnel
9a97377a5a reduced projects for windows 2020-02-04 07:33:06 +01:00
Christian Kühnel
3f52cf22b7 lessonsn learned from next agent 2020-02-03 15:25:08 +01:00
Christian Kühnel
ec0bd27c97 creating folder on empty SSD 2020-02-03 14:30:34 +01:00
Mikhail Goncharov
0e3a315ca9 Manualy specify commit to base patch 
useful for debugging
 2020-02-03 14:21:57 +01:00
Christian Kühnel
1bd9c4c4a9 removed print statement 2020-02-03 14:19:23 +01:00
Christian Kühnel
4f4f60cfe4 Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-02-03 13:10:06 +00:00
Christian Kühnel
a112bff1a0 added libcxxabi to excludes 2020-02-03 13:09:55 +00:00
Christian Kühnel
ed886a7da2 adding dependencies to project selector 2020-02-03 13:42:19 +01:00
Christian Kühnel
96e82e4354 blacklisted libunwind 2020-02-03 10:38:49 +00:00
Christian Kühnel
c7d2686251 fixed problems with configuring projects on Windows 2020-01-31 17:29:47 +00:00
Christian Kühnel
df79c3c6a6 added flag to select projects 2020-01-31 11:56:34 +00:00
Christian Kühnel
1af59cc965 added logging 2020-01-31 10:53:51 +00:00
Christian Kühnel
84a39ba079 added missing projects to windows build 2020-01-31 11:34:09 +01:00
Christian Kühnel
d75abdd172 fixed type errors 2020-01-30 17:45:57 +01:00
Christian Kühnel
64e18e7f85 changed path to requirements.txt 2020-01-28 16:40:08 +01:00
ChristianKuehnel
0272b27c28
detect projects affected by a change (#113) 
first proposal for affected projects detection
 2020-01-28 16:39:53 +01:00
Christian Kühnel
683ee1371b Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-01-27 15:43:43 +00:00
Christian Kühnel
ce5b4d462a improved benchmark script 
We should probably do this in python so we can use it cross-platform...
 2020-01-27 15:43:32 +00:00
Mikhail Goncharov
563a115006 fix git diff #108 2020-01-24 09:06:40 +01:00
Mikhail Goncharov
562adb1b90 fix format string 2020-01-23 18:01:07 +01:00
Mikhail Goncharov
46978536f0 remove compile_commands.json before creating a new 2020-01-23 16:27:28 +01:00
Mikhail Goncharov
241c1d7146 Fix requirements.txt 2020-01-23 15:43:21 +01:00
Mikhail Goncharov
429c70ddc9 fix links 2020-01-23 14:13:42 +01:00
Mikhail Goncharov
ce74784e48
Merge pull request #104 from google/bot-text 
Update bot report
 2020-01-23 13:36:20 +01:00
Mikhail Goncharov
a3f6610df2 Update bot report 
- add links to join beta and report issue
- add link "not useful" to clang-tidy warning
- clang-tidy comment in report now tells how many inline comments were
  added
 2020-01-23 13:35:40 +01:00
Christian Kühnel
b8872caaa6 fixed container start script 2020-01-23 13:07:30 +01:00
Christian Kühnel
ebdda6fdc6 updated start script 2020-01-23 10:33:56 +01:00
Christian Kühnel
9f3db2cc48 handling base revision not found 
using master instead
 2020-01-23 09:47:59 +01:00
Mikhail Goncharov
bf98f92a3d print current git commit info on checkout and while applying patch 2020-01-23 09:32:45 +01:00
Mikhail Goncharov
276978ff1f Ignore selected paths for clang-format and clang-tidy 
Now clang-format report will skip files matching `clang-format.ignore`.
For now it's empty.

clang-tidy will not receive diffs for `clang-tidy.ignore` (it still can
produce warnings for these files).
In addition build bot will not will not post comments for files
that are matched by `clang-tidy-comments.ignore`. Now project/file should
be whitelisted to receive inline comments from clang-tidy.

Added all /test directories to `clang-tidy.ignore`.

Other alternatives considered:

- using 'compile_commands.json': does not contain header files.
- specifying -regex option to 'clang-tidy-diff': probably not the best
  experience of providing multiple rules and maintaining a single regex.
 2020-01-22 19:05:36 +01:00
Mikhail Goncharov
f998580ba2 fix requirements.txt 2020-01-22 18:27:04 +01:00
Mikhail Goncharov
7e54c937c8 Add pathspec pip package. 2020-01-22 18:04:18 +01:00
Christian Kühnel
275c2f81b1 Updated boot strapping of windows agents 2020-01-22 17:02:05 +01:00
Christian Kühnel
6dfeb6a728 using patch instead of "git apply" 2020-01-22 13:21:02 +01:00
Christian Kühnel
d99d32bdaa added git reset 2020-01-22 12:08:51 +00:00
Christian Kühnel
4bb77853ca Merge branch 'master' of ssh://github.com/google/llvm-premerge-checks 2020-01-22 10:39:47 +00:00
Christian Kühnel
83e9732126 using given base revision 2020-01-22 11:39:20 +01:00
Mikhail Goncharov
82c469fc69 Use default style for clang-format 
It correctly picks up .clang-format settings.

For issue #92 and related.
 2020-01-21 15:44:35 +01:00
Christian Kühnel
c6083e3cf4 added "done" to comd output 2020-01-20 13:16:45 +00:00
Christian Kühnel
398656cc7e using patch command 2020-01-20 13:14:29 +00:00
Christian Kühnel
a3ed6589f4 added git-clean 2020-01-20 13:04:09 +00:00
Christian Kühnel
677b7fbe89 removed uplicate entry 2020-01-20 12:32:17 +00:00
Christian Kühnel
1fc40ffedd fixed bug when diff has no dependencies 2020-01-20 13:29:58 +01:00
Christian Kühnel
7228ab9fdc fixed variable 2020-01-20 12:45:07 +01:00
Christian Kühnel
a61428e5bb added missing self 2020-01-20 12:37:49 +01:00
Christian Kühnel
b4ac626be6 added retry library 
to be used for retrying on phabricator interaction
 2020-01-20 12:07:19 +01:00
Christian Kühnel
fe615f19bb calling update_interfaces 2020-01-20 12:06:57 +01:00
Christian Kühnel
b1086e3914 changed error action 2020-01-17 15:56:23 +01:00
Christian Kühnel
4bf3b126ee changed ninja ErrorAction 2020-01-17 15:51:06 +01:00
Christian Kühnel
7d2766304e setting targetdir 2020-01-17 10:25:24 +01:00
Christian Kühnel
ed4ea89ea5 fixed BUILD_DIR 2020-01-17 10:22:12 +01:00
Christian Kühnel
8824b8f2f8 using pwd as workspace dir 2020-01-17 10:20:32 +01:00
Christian Kühnel
1886dec556 creating a clean build folder 2020-01-17 10:18:28 +01:00
Christian Kühnel
640a80b4c2 setting workspace variable 2020-01-17 10:16:13 +01:00
Christian Kühnel
6f1e93ae3a made script executable 2020-01-17 10:13:52 +01:00
Christian Kühnel
5117d31607 added script to run from buildkite 2020-01-17 10:07:18 +01:00
Christian Kühnel
3fd0d02cd0 added missing dependency 2020-01-16 14:21:13 +00:00
Christian Kühnel
b0263dd926 Created new apply_patch script 
Should handle landed diffs better.
 2020-01-15 17:40:32 +01:00
Mikhail Goncharov
cac68d0d60 temporary disable clang-tidy 2020-01-13 11:05:24 +01:00
Mehdi Amini
8aafb5fd5c Add mlir to the premerge tests 2019-12-26 17:25:25 +00:00
Christian Kühnel
bf1bcb951f removed git checkout script 
on the SSD Jenkins is fast enough
 2019-12-20 09:07:05 +00:00
Christian Kühnel
451671cd88 tweaks for docker on windows 2019-12-18 17:29:21 +00:00
Christian Kühnel
3a170a2af6 added gcloud auth 2019-12-18 12:07:23 +00:00
Christian Kühnel
1923516328 fixed SSD name 2019-12-17 15:11:23 +00:00
Mikhail Goncharov
b845be0b70
Merge pull request #81 from google/clang-tidy 
Run clang-tidy and parse message
 2019-12-17 11:01:36 +01:00
Mikhail Goncharov
453aa2ae84 Run clang-tidy and parse message 
+ don't assume that clang-format has passed if there is no file.
  If linters didn't run at all file will be missing.
+ add "gray" icon for the result if it's unknown.
+ assume whole build is failed if clang-format or clang-tidy found something.
+ combine multiple lint messages per line.
 2019-12-17 11:00:30 +01:00
Christian Kühnel
b1d2dfed6f using host name to name agent 2019-12-17 08:25:57 +00:00
Christian Kühnel
adf51c6551 update of scripts for native windows agent 2019-12-16 18:56:02 +00:00
Christian Kühnel
404fcf9138 fixed more windows weirdness 2019-12-16 10:09:47 +00:00
Christian Kühnel
09327f289e git pull -q 2019-12-16 10:03:59 +00:00
Christian Kühnel
f05a4240f2 fixed error handling 2019-12-16 10:02:28 +00:00
Christian Kühnel
c3fd873495 code formatting 2019-12-16 09:47:02 +00:00
Christian Kühnel
7ab62f2aea removed tracing 2019-12-16 09:46:47 +00:00
Christian Kühnel
5b0d53313d fixed git checkout script 2019-12-16 09:19:33 +00:00
Christian Kühnel
1a2f1e2108 another shot at redirecting stderr 2019-12-13 18:59:35 +01:00
Christian Kühnel
e382e0f720 fix clone path 2019-12-13 16:31:36 +00:00
Christian Kühnel
a98d723977 another shot at wrapping stdout 2019-12-13 16:23:10 +00:00
Christian Kühnel
eb8690b8dc silencing git clone 2019-12-13 16:21:07 +00:00
Christian Kühnel
a695983f76 added tracing 2019-12-13 16:20:09 +00:00
Christian Kühnel
1d289d2417 rediriecting stderr 2019-12-13 16:17:43 +00:00
Christian Kühnel
f6c1fadc95 running my own git checkout script 2019-12-13 16:11:54 +00:00
Christian Kühnel
966a9b93fc redirecting stderr 2019-12-13 15:58:35 +00:00
Christian Kühnel
3623086912 removing wrapper code 2019-12-13 15:14:48 +00:00
Christian Kühnel
30f6cc9b90 added more line wraps 2019-12-13 14:28:57 +00:00
Mikhail Goncharov
cff541258d
Merge pull request #78 from google/update-images 
Update image to use default version
 2019-12-11 18:07:05 +01:00
Christian Kühnel
43299bb04b another test run 2019-12-11 17:05:58 +00:00
Christian Kühnel
78d6dd6d2a Merge branch 'master' of github.com:google/llvm-premerge-checks 2019-12-11 16:48:28 +00:00
Christian Kühnel
4ca85190ea merged command into one line to see if that was the issue 2019-12-11 16:48:16 +00:00
Mikhail Goncharov
8e5db1e6bd Update image to use default clang package 
+ add jq to parse conduit responses later
 2019-12-11 15:58:00 +01:00
Mikhail Goncharov
8d390ff370 Refactor Phabricator report construction 
Now report is constructed by adding more data from several stages and
represents internal structure rather what API expects.

+ Made all function that don't interact with phabricator free standing
+ Now links list all files in results directory
+ Status icons

Example comment: https://reviews.llvm.org/D71197#1779176 (links don't work).
 2019-12-11 14:36:20 +01:00
Mikhail Goncharov
7faaec98e7 Attach diffs produced by git-clang-format as lint messages. 
E.g.: https://reviews.llvm.org/D71197?id=233029
Will add a link to file and code to apply the patch in the next PR.

+ don't create TARGET_DIR in scripts;
+ updated section about local build;
+ partially specified inputs / outputs of scripts so it's more transparent what are the results;
+ added symlink to compile_command.json (clang-tidy will need it);
+ add IDEA files to .gitignore.
 2019-12-11 08:55:38 +01:00
Christian Kühnel
27730f4d35 added debugging info 2019-12-02 15:40:10 +01:00
Christian Kühnel
bac89cc03a reduced scope of build job 2019-12-02 14:43:46 +01:00
Christian Kühnel
d009a3bb22 removing build folder before running cmake 2019-11-29 12:36:29 +00:00
Christian Kühnel
6ce0cd1512 using ${PSScriptRoot} 2019-11-27 15:45:11 +00:00
Christian Kühnel
7700a2f8d0 converted batch to ps1 2019-11-27 15:41:51 +00:00
Christian Kühnel
79ccb8b846 fixed echo statements 2019-11-27 14:41:21 +00:00
Christian Kühnel
e3b28cace0 fixed pushd calls 2019-11-27 14:39:59 +00:00
Christian Kühnel
06bae8f9a3 improved logging and error handling 2019-11-27 12:11:50 +00:00
Christian Kühnel
6c89adda38 removed md/cd commands 2019-11-27 10:03:07 +00:00
Christian Kühnel
7d14909448 using absolute paths 2019-11-27 09:01:07 +00:00
Christian Kühnel
83a6eca803 changed buildkite script to call other scripts 2019-11-27 08:53:28 +00:00
Christian Kühnel
871810ad7e added LLVM_ENABLE_DIA_SDK=OFF 2019-11-27 08:53:08 +00:00
ChristianKuehnel
de34fb9572
Create docker container for Windows build (#52) 
* first steps towards windows builds #25

* added build scripts for windows

* moved from powershell to CMD

* script cleanup

* set up jenkins swarm plugin

* added deployment script for windows

* first draft of jenkins file for windows

* first shot at windows pods

* first draft for buildkite agent

* added call to run_cmake.bat

* added call to run_ninja.bat

* added new buildkite script

* added Dockerfile for buildkite agent

* fixed userprofile path

* added /IncludeOptional for VS

I hope that includes all required libraries

* moved work folder to W:

* added git config for long file names

* added more CMake flags

* setting x64 bit arch in a different way

* and yet another way to set 64bit

* merged buildkite changes to jenkins scripts

* hiding license in batch script runs

* running release build

* added test xml log

* compilation is working, but not all tests

* cmake is in patch now

* updated the dependencies from buildkite config

* dockerfile cleanup

* change how git handles line endings

* updated comment

* performance improvment for volume

* changed workdir folder

* using gnuwin package

split installation into separate layers to speed up incremental changes
 2019-11-26 17:10:30 +01:00
Christian Kühnel
59e5bb8ed2 improved logging 2019-11-22 11:03:05 +01:00
Christian Kühnel
6708a6a900 Improved error messages for apply_patch 
fixes #56
 2019-11-22 10:42:51 +01:00
Christian Kühnel
0be0498203 fix handling of compile errors 
addresses #63
 2019-11-21 15:04:39 +01:00
Christian Kühnel
3c0461255c changed type of exception 2019-11-21 15:00:48 +01:00
Christian Kühnel
4d4ea1fffb removed unused log statements 2019-11-21 10:37:18 +01:00
Christian Kühnel
617f0db570 do not fail if log can't be crated 2019-11-18 17:19:13 +01:00
Christian Kühnel
8f72543819 printing message if patch successful 2019-11-18 17:07:31 +01:00
Christian Kühnel
65a9b864d2 running arc patch with --force 2019-11-18 17:02:24 +01:00
Christian Kühnel
b53b2110ef fixed raise statement 2019-11-18 16:41:44 +01:00
Christian Kühnel
f8eaba6cf1 fixed bug in subprocess.run 2019-11-18 16:38:55 +01:00
Christian Kühnel
d028ac35b1 improved error handling for arc patch 2019-11-18 16:36:23 +01:00
Christian Kühnel
db831d4c0e only posting non-empty comments 2019-11-18 16:22:43 +01:00
Christian Kühnel
c96a2d158c making feedback upload more relaxed if files are missing 2019-11-18 16:00:14 +01:00
Christian Kühnel
cbf1bee7da fixed imports 2019-11-18 12:17:06 +01:00
Christian Kühnel
1be0187f5e fixed json output 2019-11-18 12:06:22 +01:00
Christian Kühnel
4ebb7edb11 fixed typo in var name 2019-11-18 11:51:10 +01:00
Christian Kühnel
b1dde01ac0 added phid to log output 2019-11-18 11:46:57 +01:00
Christian Kühnel
124b7fd445 fix issues in apply_patch.py 
to fix #56
 2019-11-18 11:45:08 +01:00
Christian Kühnel
7d1d74394b removed unused script 2019-11-13 11:45:22 +01:00
Christian Kühnel
1151a91dc9 added libunwind to project configuration 2019-11-11 09:05:17 +01:00
Christian Kühnel
48567c02fe added retry on errors 2019-11-05 09:31:43 +01:00
Christian Kühnel
b99d01165e fixed bug in git checkout script 2019-10-31 11:33:23 +01:00
ChristianKuehnel
c90819c53d
Merge pull request #34 from google/print-shell-commands 
Use set -x to output commands running
 2019-10-28 09:25:31 -07:00
Christian Kühnel
ba0f07ffb4 added status output 2019-10-24 09:41:19 -07:00
Christian Kühnel
a6abec98d4 handling missing test result file as failted build 2019-10-24 04:41:57 -07:00
Christian Kühnel
8b05fe5ef9 setting the right build result 2019-10-23 12:06:22 -07:00
Christian Kühnel
3cb057bc8f LIT verbose enabled in CMake 2019-10-23 07:16:54 -07:00
Christian Kühnel
3c19ae0ea3 added new run_ninja.sh script 2019-10-23 06:40:21 -07:00
Christian Kühnel
e59db9cbcd added error handling to patch script 2019-10-23 06:39:24 -07:00
Christian Kühnel
86c9d08007 aded 'git clean' to the pipelines 2019-10-21 22:47:25 +02:00
Christian Kühnel
dddf48b57b added fallback for applying patch 2019-10-21 22:41:37 +02:00
Christian Kühnel
7aa09fd26e added configuration of enabled projects 2019-10-21 22:06:47 +02:00
Mikhail Goncharov
e405c5b496 Use set -x to output commands running 
That is helpful to debug builds
 2019-10-18 18:24:09 +02:00
Christian Kühnel
195b9aaaab removed quotes 2019-10-18 15:28:43 +02:00