Release console
Acme Freight ships in five releases. Deploy one, run your tests, deploy the next: the Test Hub records which release every run tested, and its Analytics page compares them. Each release changes something a tester should notice — open “What the Test Hub should notice” for spoilers.
The Test Hub stamps new runs with release 3.0.0.
Incident simulator
Break the site on purpose and watch the hub notice: take it down, or make every page slow, then run the Freight smoke group. Not a release — a condition, the kind a scheduled run catches at 3 a.m. Runs made during an incident count against the deployed release, as they would on a real site: end it before you compare releases on Analytics.
Right now: no incident — all systems normal
-
1.0.0 “Launch”
The first release: public tracking and quotes, plus the staff portal.
- Track any shipment by its AF- number, on a map
- Instant quotes, with promo codes
- Staff portal: dashboard, shipment search, route optimizer, manifest import and monthly reports
What the Test Hub should notice
What changed Where the hub shows it Nothing is broken -- this is the baseline Run the Freight regression group once: every test passes, and every later version is compared against these numbers -
1.1.0 “Faster search”
Search, tracking and manifest import got a lot faster.
- Shipment search is up to 3x faster (new database index)
- Manifest import processes rows about 50% faster
What the Test Hub should notice
What changed Where the hub shows it Search, tracking and imports really are faster Analytics speed table and the per-step trend charts: durations drop for DEMO-010, DEMO-013 and DEMO-015 -
2.0.0 “The redesign”
A brand-new look, four new hubs, and customs details for international quotes.
- A fresh new design across the whole site
- New hubs: Johannesburg, Lagos, Istanbul and Seoul
- International quotes now collect customs details up front
What the Test Hub should notice
What changed Where the hub shows it Every page looks different DEMO-017 (visual comparison) fails until you re-bless its baseline -- delete DEMO-017__baseline.png in the tests folder The route optimizer quietly got about 2x slower Analytics speed table + DEMO-014's 'route optimization' step-timing trend Saving a note fails every third time (HTTP 503) DEMO-013 fails some runs but not others: its pass rate drops -- the flaky-test signal on Metrics and Analytics The public API renamed 'eta' to 'estimated_delivery' -- a breaking change nobody announced DEMO-020 (API contract) fails: every client reading 'eta' would break Accessibility went backwards: the pages lose their language, the skip link is hidden from screen readers, the map loses its text alternative and the hint text is too faint to read DEMO-022 (accessibility scan) fails, naming each broken WCAG rule per page; its full report is saved with the run -
2.1.0 “Hotfix”
Fixes the slow optimizer and the note errors from 2.0 -- and adds usage analytics.
- The route optimizer is fast again
- Notes save reliably again
- Password-reset emails arrive faster
- New: usage analytics on every page
What the Test Hub should notice
What changed Where the hub shows it Sign-in no longer rotates the session id (session fixation) DEMO-012's authenticated checks fail; the Security page lists it The Content-Security-Policy and X-Frame-Options headers were dropped Security page: missing-header findings on every page The 'usage analytics' script calls analytics.acme-metrics.invalid Security page: external-request, HIGH -- on an air gap that is both a broken page and a path out of the network Promo codes are applied twice (20% off instead of 10%) DEMO-011 fails, and its message names both amounts -- the API quotes (DEMO-020) are wrong the same way The public API's rate limiter was switched off DEMO-020 lists it with the other API problems: six calls in a row, no HTTP 429 The faster reset emails skipped a step: a password-reset link keeps working after it has been used DEMO-023 fails: any old reset email is still a key to the account 2.0's accessibility problems are all still there DEMO-022 still fails -
3.0.0 “Stable”
LiveEverything from 2.x fixed, and the fastest Acme Freight yet.
- Security fixes: session handling, headers, no third-party scripts, single-use reset links
- Accessibility fixes: WCAG 2.1 AA across the site again
- Correct promo pricing
- Fastest route optimizer, search and reports so far
What the Test Hub should notice
What changed Where the hub shows it Every planted problem is fixed The whole Freight regression group is green again (after DEMO-017's baseline was re-blessed for the new design) The optimizer is ~30% faster than 1.0, search the fastest yet Analytics speed table: 'faster' across the board The API sends BOTH 'eta' and 'estimated_delivery' (eta deprecated) DEMO-020 green again: old clients keep working, new ones migrate Accessibility and single-use reset links are fixed DEMO-022 and DEMO-023 green again
Deploy & incident history
| When | What | By |
|---|---|---|
| Sep 25, 00:23:39 | Deployed 3.0.0 | terminal |
| Sep 25, 00:23:07 | Deployed 2.1.0 | terminal |
| Sep 25, 00:22:38 | Deployed 2.0.0 | terminal |
| Sep 25, 00:22:11 | Deployed 1.1.0 | terminal |
| Sep 25, 00:21:42 | Deployed 1.0.0 | terminal |
| Sep 25, 00:21:42 | Incident cleared | terminal |
| Sep 24, 22:04:29 | Deployed 3.0.0 | terminal |
| Sep 24, 22:04:20 | Deployed 2.1.0 | terminal |
| Sep 24, 22:04:20 | Incident cleared | terminal |
| Sep 24, 20:41:18 | Deployed 3.0.0 | terminal |
| Sep 24, 20:41:03 | Deployed 2.1.0 | terminal |
| Sep 24, 20:40:48 | Deployed 2.0.0 | terminal |