mirror of
https://we.phorge.it/source/phorge.git
synced 2024-12-21 21:10:56 +01:00
Treat "skipped" unit tests as less interesting than "passed"
Summary: Ref T10457. Skipped tests are almost always well-behaved (e.g., `testWindows()`, but the test is running on Linux) and not interesting, and we do not expect well-written, solid systems to necessarily have 0 skips. Although skips //could// indicate that you have missing dependencies on a build server, and thus be a bit interesting, I think they almost always indicate that a particular test is not expected to run in the current environment. If we wanted to tackle this problem in granular detail, we could eventually add a "Missing" status or similar which would serve as "a skip you //could// reasonably fix in this environment", but I don't think that's too interesting. Test Plan: Here's an example of a build result with skips: B10875 {F1136511} I think this is clearer as "Passed", as this is the expected production state of the build. Locally, looked at some builds. Reviewers: chad Reviewed By: chad Maniphest Tasks: T10457 Differential Revision: https://secure.phabricator.com/D15369
This commit is contained in:
parent
58cea0714b
commit
8240e0f727
1 changed files with 9 additions and 8 deletions
|
@ -43,10 +43,10 @@ final class HarbormasterUnitStatus
|
|||
return pht('%s Broken Test(s)', $count);
|
||||
case ArcanistUnitTestResult::RESULT_UNSOUND:
|
||||
return pht('%s Unsound Test(s)', $count);
|
||||
case ArcanistUnitTestResult::RESULT_SKIP:
|
||||
return pht('%s Skipped Test(s)', $count);
|
||||
case ArcanistUnitTestResult::RESULT_PASS:
|
||||
return pht('%s Passed Test(s)', $count);
|
||||
case ArcanistUnitTestResult::RESULT_SKIP:
|
||||
return pht('%s Skipped Test(s)', $count);
|
||||
}
|
||||
|
||||
return pht('%s Other Test(s)', $count);
|
||||
|
@ -72,16 +72,17 @@ final class HarbormasterUnitStatus
|
|||
'color' => 'yellow',
|
||||
'sort' => 'C',
|
||||
),
|
||||
ArcanistUnitTestResult::RESULT_SKIP => array(
|
||||
'label' => pht('Skipped'),
|
||||
'icon' => 'fa-fast-forward',
|
||||
'color' => 'blue',
|
||||
),
|
||||
ArcanistUnitTestResult::RESULT_PASS => array(
|
||||
'label' => pht('Passed'),
|
||||
'icon' => 'fa-check',
|
||||
'color' => 'green',
|
||||
'sort' => 'Z',
|
||||
'sort' => 'D',
|
||||
),
|
||||
ArcanistUnitTestResult::RESULT_SKIP => array(
|
||||
'label' => pht('Skipped'),
|
||||
'icon' => 'fa-fast-forward',
|
||||
'color' => 'blue',
|
||||
'sort' => 'E',
|
||||
),
|
||||
);
|
||||
}
|
||||
|
|
Loading…
Reference in a new issue