Show PR on all pages
On the main workflow page, there is no link to the PR. On individual step pages, there are links to the PR. Would be nice to see that everywhere.
Slow tests not accurate
Last time I checked we had tests that take more than a minute to run, yet circleci says our slowest test has a p95 duration of 87ms. I am extremely skeptical of this number. For example look at https://app.circleci.com/pipelines/github/15five/fifteen5/53312/workflows/fe9af02a-5998-498c-86d4-7d27938be85f/jobs/337208 - "Ran 203 tests in 253.766s" - that means on average a test took more than 1 second, far above the 87ms "slowest" time.
Top 10 slowest tests per Job
I'd like to see Top 10 slowest tests per Job. Right now it's show Top 10 slowest tests of all Jobs which made it useless because each Job runs a different set of tests (different frameworks and amount). Example: Job 1 has only 10 test and each runs for 10s; Job 2 has 100 tests and each runs for 1s. The current Tests insights will always show 10 slowest tests from Job 1 but I am interested in Job 2's tests too.
Sort all tests by failure rate
We are using the tests insights feature to analyze our "quarantined" flaky tests. If a test has 100% success rate, it should be taken out of quarantine. In order to do this, we need to be able to list all tests which have a 100% success rate.
Insights: Option to filter on multiple branches
Currently, both the Insights UI and API, can only retrieve statistics filtered on a single branch. However, it is very limited if the exact same workflows are run on multiple branches. It would be great to have filter that can filter on multiple branches and all branches,
Insights by Job
We use a monorepo in which insights by Job (historical, graphs) is just as essential as insights by Workflow and Repo.
Include class name in most failed/slowest tests
Redundancy in test names alone can cause some confusion, where the class name is needed to disambiguate. (For example, abstract test classes that are subclassed many times to test different cases)
Filter test insight by time range
It will be super useful to filter top 10 failing test based on time range. as global view doesn't necessarily reflect the current state. for example, if a fix was made to flaky test you want to see it improving in the next days.
Configurable Time Range
Select a start and end date for the data displaying on the dashboard.