Metrics
⬇ CSVActive tests
32
Runs
225
Pass rate
93%
209 passed · 16 failed
Avg duration
11s
p95 1m 14s
Total test time
40m 32s
Failing now
0
Failures grouped by cause the same message across tests usually means ONE bug, not many
| times | what went wrong | tests affected | last seen | |
|---|---|---|---|---|
| 2 | AssertionError: SPRING10 should take 10% off the $117.62 subtotal ($11.76), but the quote… | DEMO-011 | Sep 24 22:04 | example |
| 2 | AssertionError: WCAG 2.1 AA: 4 rule(s) broken (details: a11y-report.html) | DEMO-022 | Sep 24 20:41 | example |
| 2 | AssertionError: saving a note failed: 'The notes service is busy -- try again' | DEMO-013 | Sep 24 18:57 | example |
| 2 | AssertionError: session fixation: the session id did not change at sign-in, so anyone who… | DEMO-012 | Sep 24 22:04 | example |
| 2 | AssertionError: the API broke its promises: | DEMO-020 | Sep 24 19:46 | example |
| 1 | 1 of 1 test(s) failed: a domestic quote prices the promo code correctly -- SPRING10 shoul… | DEMO-T11 | Sep 25 00:23 | example |
| 1 | 1 of 1 test(s) failed: a password reset works through the email -- exactly once -- the re… | DEMO-T16 | Sep 25 00:23 | example |
| 1 | 1 of 1 test(s) failed: the public API keeps its promises -- 3 problems: | DEMO-T13 | Sep 25 00:23 | example |
Runs per day
Pass rate per day
Slowest tests average and p95 seconds
Flakiest tests how often adjacent runs flip pass↔fail
Outcomes by target version
What starts the runs
Slowest individual steps across every test — where the time actually goes
When failures happen last 30 days, hub timezone — a stripe means an environment problem, not a test problem
| 00-06 | 06-09 | 09-12 | 12-15 | 15-18 | 18-24 | |
|---|---|---|---|---|---|---|
| Mon | · | · | · | · | · | · |
| Tue | · | · | · | · | · | · |
| Wed | · | · | · | · | · | · |
| Thu | · | · | · | · | · | 12/131 |
| Fri | 4/84 | 0/10 | · | · | · | · |
| Sat | · | · | · | · | · | · |
| Sun | · | · | · | · | · | · |
Cell = failures / total runs started in that slot; darker = more failures.
Suite health is the test set itself rotting?
| Active tests | 32 |
| Never run | none |
| Not run in 14+ days | none |
| Disabled | none |
Per-test summary 30-day window ⬇ CSV
| Test | Runs | Pass rate | Avg (s) | p95 (s) | Flakiness | Last |
|---|---|---|---|---|---|---|
| DEMO-001 Homepage loads | 5 | 100% | 0.9 | 1.1 | 0.00 | passed |
| DEMO-002 Form round-trip | 4 | 100% | 1.2 | 1.4 | 0.00 | passed |
| DEMO-003 Delayed content appears | 4 | 100% | 2.3 | 2.4 | 0.00 | passed |
| DEMO-004 Work, wait, then results | 3 | 100% | 21.3 | 21.4 | 0.00 | passed |
| DEMO-005 Visual comparison (screenshot vs baseline) | 3 | 100% | 1.5 | 1.7 | 0.00 | passed |
| DEMO-006 Long job: wait without recording the wait | 2 | 100% | 121.8 | 121.8 | 0.00 | passed |
| DEMO-007 Load subject: form round trip | 3 | 100% | 1.2 | 1.3 | 0.00 | passed |
| DEMO-008 Authenticated flow + session checks | 3 | 100% | 1.6 | 1.6 | 0.00 | passed |
| DEMO-009 shared library | 3 | 100% | 1.4 | 1.5 | 0.00 | passed |
| DEMO-010 Freight: home page and tracking | 20 | 100% | 2.4 | 3.1 | 0.00 | passed |
| DEMO-011 Freight: quote with a promo code | 16 | 88% | 2.8 | 3.5 | 0.27 | passed |
| DEMO-012 Freight: staff sign-in security checks | 15 | 87% | 1.8 | 2.1 | 0.29 | passed |
| DEMO-013 Freight: find a shipment and add a note | 18 | 89% | 3.0 | 3.6 | 0.24 | passed |
| DEMO-014 Freight: optimize delivery routes (slow job) | 7 | 100% | 28.1 | 46.0 | 0.00 | passed |
| DEMO-015 Freight: import a manifest (upload + download) | 7 | 100% | 5.6 | 6.3 | 0.00 | passed |
| DEMO-016 Freight: monthly report (long wait) | 8 | 100% | 104.9 | 116.4 | 0.00 | passed |
| DEMO-017 Freight: visual check of the home page | 9 | 89% | 2.1 | 2.6 | 0.25 | passed |
| DEMO-018 Freight: load subject (public tracking) | 2 | 100% | 1.7 | 1.9 | 0.00 | passed |
| DEMO-019 Freight: wait for a truck on the live map | 7 | 100% | 35.4 | 57.7 | 0.00 | passed |
| DEMO-020 Freight: public API contract, auth and limits | 8 | 75% | 1.3 | 1.7 | 0.29 | passed |
| DEMO-021 Freight: dock schedule by drag-and-drop | 8 | 100% | 4.2 | 4.9 | 0.00 | passed |
| DEMO-022 Freight: accessibility scan (WCAG 2.1 AA) | 6 | 67% | 6.2 | 6.5 | 0.40 | passed |
| DEMO-023 Freight: password reset through the email | 7 | 86% | 9.8 | 11.2 | 0.33 | passed |
| DEMO-024 Freight: shipping label -- new tab, barcode, PDF | 7 | 100% | 2.7 | 3.2 | 0.00 | passed |
| DEMO-100 Slow marathon (kill-me demo) | 2 | 100% | 76.6 | 76.6 | 0.00 | passed |
| DEMO-T10 TypeScript demo (node engine) | 5 | 100% | 3.7 | 3.8 | 0.00 | passed |
| DEMO-T11 Freight: quote in TypeScript (node engine) | 8 | 88% | 4.1 | 4.4 | 0.29 | passed |
| DEMO-T12 Freight: tracking in TypeScript | 7 | 100% | 4.0 | 4.2 | 0.00 | passed |
| DEMO-T13 Freight: public API in TypeScript | 7 | 71% | 3.1 | 3.7 | 0.33 | passed |
| DEMO-T14 Freight: dock drag-and-drop in TypeScript | 7 | 100% | 5.3 | 5.6 | 0.00 | passed |
| DEMO-T15 Freight: shipping label in TypeScript | 7 | 100% | 4.2 | 4.4 | 0.00 | passed |
| DEMO-T16 Freight: password reset through email, in TypeScript | 7 | 86% | 11.4 | 15.1 | 0.33 | passed |