revi-archive/llvm-premerge-checks
1
0
Fork 0
Code Activity
894 commits 20 branches 1 tag 1.7 MiB
Commit graph

48 commits

Author SHA1 Message Date
Mikhail Goncharov
a44473098c cron jobs for buildbot and phab monitoring 
+ fix phabricator / buildbot uptime monitoring

+ data is stored in separate databases
 2021-05-20 21:44:19 +02:00
Christian Kühnel
46b7b8d8b7 fixed handling of empty responses 2021-05-20 17:35:19 +02:00
Christian Kühnel
915e8076d6 storing builder information 2021-05-20 17:35:19 +02:00
Christian Kühnel
3a8be70f79 speedup of build import 2021-05-20 17:35:19 +02:00
Christian Kühnel
b6d3986660 fixed import speed for buildsets 2021-05-20 17:35:19 +02:00
Christian Kühnel
9aefaf40cc profiling the slow database import 2021-05-20 17:35:19 +02:00
Christian Kühnel
37e38a6891 changed buildbot monitoring URL 2021-05-20 17:35:19 +02:00
Christian Kühnel
c0081cadb2 added TODOs 2021-05-20 17:35:19 +02:00
Christian Kühnel
ed838f6169 importing buildbot builds 2021-05-20 17:35:19 +02:00
Christian Kühnel
60abbd46ab storing worker information 2021-05-20 17:35:19 +02:00
Christian Kühnel
b79cedb325 Monitor buildbot status 2021-05-20 17:35:19 +02:00
Mikhail Goncharov
6b2003a664 Cron job to load BK data to DB 2021-05-20 17:30:43 +02:00
Christian Kühnel
134ca4b801 repo_hist_db now using postgres DB 
Instead of a local database, this script now imports the data
into the shared postgres database. this way the data can be used
for other queries as well.

feel free to extend the data model if you
need additional columns.
 2021-05-11 10:09:51 +02:00
Christian Kühnel
1f2c851799 script to log the status of phabricator to a DB 2021-05-04 20:09:14 +02:00
ChristianKuehnel
31cbc77e38
improved git metrics script (#295) 
* simplified database schema

* added generic CSV export

* scripts are generating first charts

* dumping entire DB into CSV file

* added more stats
 2021-04-27 16:42:38 +02:00
Christian Kühnel
06c97f1dc5 first query on DB working 2021-04-27 11:56:10 +02:00
Mikhail Goncharov
99e43a8d9a rename master to main branch following LLVM 2020-12-10 09:29:24 +01:00
Mikhail Goncharov
c350101a23 Allow projects to define custom steps 
Now it's possible to allow sub-projects to define own checks and skip
"generic" ones.

To properly accomodate affected projects that might not have special
treatment we:

1. extend the set of affected projecs with dependent (e.g. add 'libc' if
'clang' was modified)

2. add custom steps for projects that define own workflow. At the moment
it's only libcxx and it has a custom trigger pipeline so it's noop.

3. add dependent projects and run generic check on them.

To illustrate: imagine that we have a dependency graph:

llvm -> clang -> openmp

and only clang was modified in a diff; also clang defines own checks.
Thus list of affected projects will be [clang, openmp].
After adding custom checks and removing their projecst: [openmp].
After adding dependencies: [llvm, clang, openmp]. Generic linux /
windows checks will be run on thouse 3 projects.
So as you can see in some scenarios projects with custom checks will
still go through generic checks.

Note that clang-format and clang-tidy checks are run only for "generic"
checks at the moment.
 2020-10-02 16:19:57 +02:00
Mikhail Goncharov
c082f1aa9b Organize scripts 
Move all .py that are supposed to be run as __main__ under ./scripts
so there is no need to manipulate sys.path to import modules.

Runby cleanup
 2020-10-02 14:18:22 +02:00
Christian Kühnel
afb8c84bde added more phabricator metrics 2020-08-13 13:14:54 +02:00
Christian Kühnel
0cb0fd670e extended metrics for phabricator 2020-08-12 13:42:14 +02:00
Christian Kühnel
e5a7ae4b36 improved stability of data download 2020-08-07 17:18:22 +02:00
Christian Kühnel
c75649476d simple report on master failues 2020-08-07 10:11:31 +02:00
Christian Kühnel
795d8270f7 fixed report writing 2020-05-06 17:24:26 +02:00
Christian Kühnel
10454dfba8 improved error handling for agent identification 2020-05-06 13:11:28 +02:00
Christian Kühnel
0e12d53def added agent detection 2020-05-06 12:43:35 +02:00
Christian Kühnel
d55096bb7c getting workflow stages 2020-05-06 12:06:40 +02:00
Christian Kühnel
27da151340 creating tmp dir as needed 2020-05-05 16:54:08 +02:00
Christian Kühnel
0e84fd14bb gettig stats from buildbots 2020-03-31 16:56:35 +02:00
Christian Kühnel
5f2b26d44c added raw data export 2020-03-19 09:44:41 +01:00
Christian Kühnel
bfdf97e10a added reviews per path 2020-03-18 14:18:07 +01:00
Christian Kühnel
02493d440d fine tuning of metrics 2020-03-17 11:22:55 +01:00
Christian Kühnel
7131ef705c ignoring case in emails 2020-03-09 09:34:52 +01:00
Christian Kühnel
2975323644 added statistic on committer domains 2020-03-09 09:31:25 +01:00
Christian Kühnel
2eedd55b2b first jenkins statistics 2020-02-28 11:31:14 +01:00
Christian Kühnel
d1029befcc added first statistics for Jenkins 2020-02-27 23:54:54 +01:00
Christian Kühnel
289d1c1205 added diffs 2020-02-24 17:54:11 +01:00
Christian Kühnel
56d9ec34ab implemented Phabricator metrics 2020-02-24 16:38:29 +01:00
Christian Kühnel
655f151bb8 first shot at getting build data from Phabricator 2020-02-21 13:20:33 +01:00
Christian Kühnel
814cd775bc script to get statistics from git repo 2020-02-21 13:19:11 +01:00
Christian Kühnel
3d3de17eb0 first version of git history evaluation 2020-02-20 19:04:34 +01:00
Christian Kühnel
3debb3046c code cleanup 2020-02-20 19:04:34 +01:00
Christian Kühnel
b17bd93438 fixed division by zero problem 2020-02-18 13:37:13 +01:00
Christian Kühnel
1c53d6ee86 added number of reviewed commits 2020-02-17 16:18:58 +01:00
Christian Kühnel
a2973f0f79 gathering data for reverts 2020-02-17 15:30:10 +01:00
Christian Kühnel
29c4333033 fixed initialisation 2020-02-17 14:55:10 +01:00
Christian Kühnel
ad0ad7ccc5 counting failed builds on buildbots 
storing results on Stackdriver
 2020-02-17 14:27:59 +01:00
ChristianKuehnel
16952faa46
Proposal for metrics (#127) 
* First draft for metrics
 2020-02-17 10:39:53 +01:00