dependabot[bot]
517994c41c
Bump lxml from 4.6.5 to 4.9.1 in /scripts/metrics
...
Bumps [lxml](https://github.com/lxml/lxml ) from 4.6.5 to 4.9.1.
- [Release notes](https://github.com/lxml/lxml/releases )
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt )
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.6.5...lxml-4.9.1 )
---
updated-dependencies:
- dependency-name: lxml
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-07-26 10:46:50 +02:00
Christian Kühnel
54fa9b1556
added more queries
2021-12-14 11:40:34 +01:00
Christian Kühnel
4ae48e963d
added buildbot daily success rates
2021-12-14 11:40:34 +01:00
Christian Kühnel
c2526bc84c
moved queries to subfolder
2021-12-14 11:40:34 +01:00
Christian Kühnel
0beb4a43ff
added sql statemet for bulidbot view
...
This statement adds a VIEW "buildbot_overview" containing all relevant
information for a build. I plan to extend this file with additional
views when needed.
2021-12-14 11:40:34 +01:00
dependabot[bot]
96653261f3
Bump lxml from 4.6.3 to 4.6.5 in /scripts/metrics
...
Bumps [lxml](https://github.com/lxml/lxml ) from 4.6.3 to 4.6.5.
- [Release notes](https://github.com/lxml/lxml/releases )
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt )
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.6.3...lxml-4.6.5 )
---
updated-dependencies:
- dependency-name: lxml
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-12-14 11:40:06 +01:00
dependabot[bot]
eb5f0871c9
Bump urllib3 from 1.26.4 to 1.26.5 in /scripts/metrics
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.26.4 to 1.26.5.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.4...1.26.5 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-09-21 13:13:48 +02:00
Mikhail Goncharov
ff4e998ef4
update buildkite monitoring
2021-06-28 10:16:36 +02:00
Mikhail Goncharov
19e290d0cb
store builds in runnings state and check them later
...
That removes a wrong assumption that everything interesting is
located within first few pages. Should also reduce API load a bit (as we
will not load additional 5+ pages just in case.
2021-06-24 17:09:42 +02:00
Mikhail Goncharov
d11188e407
use same db for all tables
2021-06-18 12:21:41 +02:00
Mikhail Goncharov
a44473098c
cron jobs for buildbot and phab monitoring
...
+ fix phabricator / buildbot uptime monitoring
+ data is stored in separate databases
2021-05-20 21:44:19 +02:00
Christian Kühnel
46b7b8d8b7
fixed handling of empty responses
2021-05-20 17:35:19 +02:00
Christian Kühnel
915e8076d6
storing builder information
2021-05-20 17:35:19 +02:00
Christian Kühnel
3a8be70f79
speedup of build import
2021-05-20 17:35:19 +02:00
Christian Kühnel
b6d3986660
fixed import speed for buildsets
2021-05-20 17:35:19 +02:00
Christian Kühnel
9aefaf40cc
profiling the slow database import
2021-05-20 17:35:19 +02:00
Christian Kühnel
37e38a6891
changed buildbot monitoring URL
2021-05-20 17:35:19 +02:00
Christian Kühnel
c0081cadb2
added TODOs
2021-05-20 17:35:19 +02:00
Christian Kühnel
ed838f6169
importing buildbot builds
2021-05-20 17:35:19 +02:00
Christian Kühnel
60abbd46ab
storing worker information
2021-05-20 17:35:19 +02:00
Christian Kühnel
b79cedb325
Monitor buildbot status
2021-05-20 17:35:19 +02:00
Mikhail Goncharov
6b2003a664
Cron job to load BK data to DB
2021-05-20 17:30:43 +02:00
Christian Kühnel
134ca4b801
repo_hist_db now using postgres DB
...
Instead of a local database, this script now imports the data
into the shared postgres database. this way the data can be used
for other queries as well.
feel free to extend the data model if you
need additional columns.
2021-05-11 10:09:51 +02:00
Christian Kühnel
1f2c851799
script to log the status of phabricator to a DB
2021-05-04 20:09:14 +02:00
ChristianKuehnel
31cbc77e38
improved git metrics script ( #295 )
...
* simplified database schema
* added generic CSV export
* scripts are generating first charts
* dumping entire DB into CSV file
* added more stats
2021-04-27 16:42:38 +02:00
Christian Kühnel
06c97f1dc5
first query on DB working
2021-04-27 11:56:10 +02:00
Mikhail Goncharov
99e43a8d9a
rename master to main branch following LLVM
2020-12-10 09:29:24 +01:00
Mikhail Goncharov
c350101a23
Allow projects to define custom steps
...
Now it's possible to allow sub-projects to define own checks and skip
"generic" ones.
To properly accomodate affected projects that might not have special
treatment we:
1. extend the set of affected projecs with dependent (e.g. add 'libc' if
'clang' was modified)
2. add custom steps for projects that define own workflow. At the moment
it's only libcxx and it has a custom trigger pipeline so it's noop.
3. add dependent projects and run generic check on them.
To illustrate: imagine that we have a dependency graph:
llvm -> clang -> openmp
and only clang was modified in a diff; also clang defines own checks.
Thus list of affected projects will be [clang, openmp].
After adding custom checks and removing their projecst: [openmp].
After adding dependencies: [llvm, clang, openmp]. Generic linux /
windows checks will be run on thouse 3 projects.
So as you can see in some scenarios projects with custom checks will
still go through generic checks.
Note that clang-format and clang-tidy checks are run only for "generic"
checks at the moment.
2020-10-02 16:19:57 +02:00
Mikhail Goncharov
c082f1aa9b
Organize scripts
...
Move all .py that are supposed to be run as __main__ under ./scripts
so there is no need to manipulate sys.path to import modules.
Runby cleanup
2020-10-02 14:18:22 +02:00
Christian Kühnel
afb8c84bde
added more phabricator metrics
2020-08-13 13:14:54 +02:00
Christian Kühnel
0cb0fd670e
extended metrics for phabricator
2020-08-12 13:42:14 +02:00
Christian Kühnel
e5a7ae4b36
improved stability of data download
2020-08-07 17:18:22 +02:00
Christian Kühnel
c75649476d
simple report on master failues
2020-08-07 10:11:31 +02:00
Christian Kühnel
795d8270f7
fixed report writing
2020-05-06 17:24:26 +02:00
Christian Kühnel
10454dfba8
improved error handling for agent identification
2020-05-06 13:11:28 +02:00
Christian Kühnel
0e12d53def
added agent detection
2020-05-06 12:43:35 +02:00
Christian Kühnel
d55096bb7c
getting workflow stages
2020-05-06 12:06:40 +02:00
Christian Kühnel
27da151340
creating tmp dir as needed
2020-05-05 16:54:08 +02:00
Christian Kühnel
0e84fd14bb
gettig stats from buildbots
2020-03-31 16:56:35 +02:00
Christian Kühnel
5f2b26d44c
added raw data export
2020-03-19 09:44:41 +01:00
Christian Kühnel
bfdf97e10a
added reviews per path
2020-03-18 14:18:07 +01:00
Christian Kühnel
02493d440d
fine tuning of metrics
2020-03-17 11:22:55 +01:00
Christian Kühnel
7131ef705c
ignoring case in emails
2020-03-09 09:34:52 +01:00
Christian Kühnel
2975323644
added statistic on committer domains
2020-03-09 09:31:25 +01:00
Christian Kühnel
2eedd55b2b
first jenkins statistics
2020-02-28 11:31:14 +01:00
Christian Kühnel
d1029befcc
added first statistics for Jenkins
2020-02-27 23:54:54 +01:00
Christian Kühnel
289d1c1205
added diffs
2020-02-24 17:54:11 +01:00
Christian Kühnel
56d9ec34ab
implemented Phabricator metrics
2020-02-24 16:38:29 +01:00
Christian Kühnel
655f151bb8
first shot at getting build data from Phabricator
2020-02-21 13:20:33 +01:00
Christian Kühnel
814cd775bc
script to get statistics from git repo
2020-02-21 13:19:11 +01:00