1
0
Fork 0
Commit graph

913 commits

Author SHA1 Message Date
Kostya Serebryany
587255bfb4 Update clang-tidy.ignore
Extend the wildcard to match more .inc files in sanitizer_common.
2021-08-23 14:11:36 +02:00
Anders Waldenborg
1d9dbf5568 make clang_tidy_report handle diffs text files with invalid utf-8
"git diff" handles text files encoded that is not valid UTF-8 (e.g
using ISO-8859-1) as text files and produces a diff of those (rather
saying "Binary files a/x and b/x differ").

This means that the diff output may contain such characters. Files
that did would cause clang_tidy_report.py do hit an UnicodeDecodeError
when reading the diff, including if it was on removed lines and
regardless if it was in the ignore file.

By specifying errors mode "replace" for decode() method the bytes
that are not a valid utf-8 encoding are replaced with the unicode
replacement question mark (U+FFFD). When parsing the diff
clang-tidy-diff is only looking at filenames and line numbers of the
diff, so this shouldn't be a problem if it doesn't get the exact same
byte sequence inside the actual change.
2021-08-17 14:18:39 +02:00
Anders Waldenborg
d41a6769fc fix "clang-format/tidy" mixup in doc comment [NFC] 2021-08-17 14:18:39 +02:00
Mikhail Goncharov
49be688a27 script to sync fork llvm-premerge-tests/llvm-project
- uniformly append env variables

- resolve current HEAD and pass it as BUILDKITE_COMMIT to script
generators. Add it as ph_commit_sha.
2021-08-11 16:25:29 +02:00
Geoffrey Martin-Noble
8bc6bb7d5d Switch Bazel premerge checks to use llvm-bazel-premerge queue
I created a new queue for the pre-merge checks so that they won't compete for resources
with the post-merge build already running. Obviously that creates some inefficiency, but is
a simple way to make sure neither build gets starved (in particular, we know that the
current setup of 4 agents running on a single 32-core VM is enough to handle the commit
traffic on the main branch whereas pre-merge testing volume is likely to be more
unpredictable.
2021-07-29 17:57:11 +02:00
Geoffrey Martin-Noble
c47e555d0f Correctly skip project classification for utils/
`project` is a list here, not a string.
2021-07-29 10:42:12 +02:00
Mikhail Goncharov
0522d2b402 Revert "Disable openmp tests"
This reverts commit 6d1a03c400.

Offending https://reviews.llvm.org/D105719 was reverted upstream.
2021-07-28 17:28:28 +02:00
Mikhail Goncharov
6c2410440e Run bazel builds in premerge
if user is a member of "bazel_build" https://reviews.llvm.org/project/view/107/
or modified /utils/bazel/*

For #328
2021-07-28 16:01:44 +02:00
Mikhail Goncharov
f7058aaa51 add post-checkout to run git prune
fix #321
2021-07-27 18:16:40 +02:00
Nikita Popov
6d1a03c400 Disable openmp tests
libarcher tests (part of openmp) have been broken for the past few weeks, and nobody seems to care. As such, disable the openmp project. I hope this is the right place to do so.
2021-07-26 09:55:29 +02:00
Mikhail Goncharov
c1b5c95071 Ignore changes in 'utils'
Blaze build check should be done via separate pipeline

For #325
2021-07-23 09:35:22 +02:00
Mikhail Goncharov
1b116862e6 Fix modified projects resolution when there are unmapped changes
for #325
2021-07-23 09:30:53 +02:00
Thomas Lively
75ca275b10 Ignore clang/lib/Headers/wasm_simd128.h
See https://reviews.llvm.org/D106500 for an example of the spurious positives I would like to ignore.
2021-07-22 16:23:11 +02:00
Mikhail Goncharov
4ec41ed8a8 enable flang 2021-06-30 15:44:56 +02:00
Mikhail Goncharov
ff4e998ef4 update buildkite monitoring 2021-06-28 10:16:36 +02:00
Mikhail Goncharov
19e290d0cb store builds in runnings state and check them later
That removes a wrong assumption that everything interesting is
located within first few pages. Should also reduce API load a bit (as we
will not load additional 5+ pages just in case.
2021-06-24 17:09:42 +02:00
Mikhail Goncharov
a6c2eb7f23 set BUILDKITE_BUILD_PATH for service agents 2021-06-18 12:32:07 +02:00
Mikhail Goncharov
d11188e407 use same db for all tables 2021-06-18 12:21:41 +02:00
Mikhail Goncharov
8e156990fc dont pass 'testing' parameter from startup 2021-06-01 17:37:20 +02:00
Mikhail Goncharov
530c8bd77c debugging container start 2021-06-01 17:32:09 +02:00
Mikhail Goncharov
8960ff7dc9 Pre-checkout for windows
Kill all running processes in BUILDKITE_BUILD_PATH and force unlock git
folder.
2021-06-01 15:26:23 +02:00
Mikhail Goncharov
7ca96eee86 use main branch 2021-05-31 15:59:27 +02:00
Mikhail Goncharov
a44473098c cron jobs for buildbot and phab monitoring
+ fix phabricator / buildbot uptime monitoring

+ data is stored in separate databases
2021-05-20 21:44:19 +02:00
Christian Kühnel
46b7b8d8b7 fixed handling of empty responses 2021-05-20 17:35:19 +02:00
Christian Kühnel
915e8076d6 storing builder information 2021-05-20 17:35:19 +02:00
Christian Kühnel
3a8be70f79 speedup of build import 2021-05-20 17:35:19 +02:00
Christian Kühnel
b6d3986660 fixed import speed for buildsets 2021-05-20 17:35:19 +02:00
Christian Kühnel
9aefaf40cc profiling the slow database import 2021-05-20 17:35:19 +02:00
Christian Kühnel
37e38a6891 changed buildbot monitoring URL 2021-05-20 17:35:19 +02:00
Christian Kühnel
c0081cadb2 added TODOs 2021-05-20 17:35:19 +02:00
Christian Kühnel
ed838f6169 importing buildbot builds 2021-05-20 17:35:19 +02:00
Christian Kühnel
60abbd46ab storing worker information 2021-05-20 17:35:19 +02:00
Christian Kühnel
b79cedb325 Monitor buildbot status 2021-05-20 17:35:19 +02:00
Mikhail Goncharov
6b2003a664 Cron job to load BK data to DB 2021-05-20 17:30:43 +02:00
Mikhail Goncharov
26ffea31dd don't install nuget on new win agents 2021-05-20 12:18:18 +02:00
Mikhail Goncharov
10da060717 increase number of linux agents 2021-05-20 12:18:17 +02:00
Mikhail Goncharov
fc8187c649
Update playbooks.md 2021-05-20 11:24:12 +02:00
Mikhail Goncharov
f0d1cc6ab3 update linux node pool (machines w/ no external ssd)
updated llvm version to 12 with relevant fixes in scrips
2021-05-17 10:06:54 +02:00
Mikhail Goncharov
1b603e884a migrage linux-agents to a new pool 2021-05-15 10:58:23 +02:00
Mikhail Goncharov
e703a856cb Add graceful termination period for linux agents
Now builds will not be dropped on cluster upgrades. That requires
container updates.
2021-05-14 14:56:18 +02:00
Christian Kühnel
134ca4b801 repo_hist_db now using postgres DB
Instead of a local database, this script now imports the data
into the shared postgres database. this way the data can be used
for other queries as well.

feel free to extend the data model if you
need additional columns.
2021-05-11 10:09:51 +02:00
Louis Dionne
668e50298c Remove requirement added in 1f2c851 to try to fix diff-checks
This is a wild attempt to fix the pre-commit CI which has been failing
for a few hours. I think the authors of 1f2c851 are not available right
now, so I'm taking the freedom to try this out. I hope I'm not overstepping
any boundary.
2021-05-04 16:22:40 -04:00
Christian Kühnel
1f2c851799 script to log the status of phabricator to a DB 2021-05-04 20:09:14 +02:00
Mikhail Goncharov
1c04f70eb9 cancel previous builds for the same revisions
using metadata tags set in #298 finds and cancels existing builds before
starting a new one.

One caveat is that no result is reported back to Phabricator for the
cancelled build. That should not be an issue in the normal usecase.

For #278
2021-05-04 11:27:09 +02:00
Mikhail Goncharov
6b731dc4d5 set build info in metadata 2021-05-03 21:07:30 +02:00
Louis Dionne
980db3f06f Add a script to cancel previously started builds for the same review
Fixes #278
2021-05-03 19:55:58 +02:00
Mikhail Goncharov
aeba5401d1 remove gnuwin and cmake
relanding #290
also apparently vs cmake was always used, removing seaprate installation
2021-04-27 16:58:37 +00:00
ChristianKuehnel
31cbc77e38
improved git metrics script (#295)
* simplified database schema

* added generic CSV export

* scripts are generating first charts

* dumping entire DB into CSV file

* added more stats
2021-04-27 16:42:38 +02:00
Mikhail Goncharov
ac4f2bcb82 update python packages
mostly to bump phabricator plugin as 0.7 has issues with SSL
2021-04-27 16:01:18 +02:00
Mikhail Goncharov
7aebf9d969 invoke phabtalk standalone 2021-04-27 11:59:00 +02:00