Acme Freight
v3.0.0

Release console

Acme Freight ships in five releases. Deploy one, run your tests, deploy the next: the Test Hub records which release every run tested, and its Analytics page compares them. Each release changes something a tester should notice — open “What the Test Hub should notice” for spoilers.

The Test Hub stamps new runs with release 3.0.0.

Incident simulator

Break the site on purpose and watch the hub notice: take it down, or make every page slow, then run the Freight smoke group. Not a release — a condition, the kind a scheduled run catches at 3 a.m. Runs made during an incident count against the deployed release, as they would on a real site: end it before you compare releases on Analytics.

Right now: no incident — all systems normal

  1. 1.0.0 “Launch”

    The first release: public tracking and quotes, plus the staff portal.

    • Track any shipment by its AF- number, on a map
    • Instant quotes, with promo codes
    • Staff portal: dashboard, shipment search, route optimizer, manifest import and monthly reports
    What the Test Hub should notice
    What changedWhere the hub shows it
    Nothing is broken -- this is the baselineRun the Freight regression group once: every test passes, and every later version is compared against these numbers
  2. 1.1.0 “Faster search”

    Search, tracking and manifest import got a lot faster.

    • Shipment search is up to 3x faster (new database index)
    • Manifest import processes rows about 50% faster
    What the Test Hub should notice
    What changedWhere the hub shows it
    Search, tracking and imports really are fasterAnalytics speed table and the per-step trend charts: durations drop for DEMO-010, DEMO-013 and DEMO-015
  3. 2.0.0 “The redesign”

    A brand-new look, four new hubs, and customs details for international quotes.

    • A fresh new design across the whole site
    • New hubs: Johannesburg, Lagos, Istanbul and Seoul
    • International quotes now collect customs details up front
    What the Test Hub should notice
    What changedWhere the hub shows it
    Every page looks differentDEMO-017 (visual comparison) fails until you re-bless its baseline -- delete DEMO-017__baseline.png in the tests folder
    The route optimizer quietly got about 2x slowerAnalytics speed table + DEMO-014's 'route optimization' step-timing trend
    Saving a note fails every third time (HTTP 503)DEMO-013 fails some runs but not others: its pass rate drops -- the flaky-test signal on Metrics and Analytics
    The public API renamed 'eta' to 'estimated_delivery' -- a breaking change nobody announcedDEMO-020 (API contract) fails: every client reading 'eta' would break
    Accessibility went backwards: the pages lose their language, the skip link is hidden from screen readers, the map loses its text alternative and the hint text is too faint to readDEMO-022 (accessibility scan) fails, naming each broken WCAG rule per page; its full report is saved with the run
  4. 2.1.0 “Hotfix”

    Fixes the slow optimizer and the note errors from 2.0 -- and adds usage analytics.

    • The route optimizer is fast again
    • Notes save reliably again
    • Password-reset emails arrive faster
    • New: usage analytics on every page
    What the Test Hub should notice
    What changedWhere the hub shows it
    Sign-in no longer rotates the session id (session fixation)DEMO-012's authenticated checks fail; the Security page lists it
    The Content-Security-Policy and X-Frame-Options headers were droppedSecurity page: missing-header findings on every page
    The 'usage analytics' script calls analytics.acme-metrics.invalidSecurity page: external-request, HIGH -- on an air gap that is both a broken page and a path out of the network
    Promo codes are applied twice (20% off instead of 10%)DEMO-011 fails, and its message names both amounts -- the API quotes (DEMO-020) are wrong the same way
    The public API's rate limiter was switched offDEMO-020 lists it with the other API problems: six calls in a row, no HTTP 429
    The faster reset emails skipped a step: a password-reset link keeps working after it has been usedDEMO-023 fails: any old reset email is still a key to the account
    2.0's accessibility problems are all still thereDEMO-022 still fails
  5. 3.0.0 “Stable”

    Live

    Everything from 2.x fixed, and the fastest Acme Freight yet.

    • Security fixes: session handling, headers, no third-party scripts, single-use reset links
    • Accessibility fixes: WCAG 2.1 AA across the site again
    • Correct promo pricing
    • Fastest route optimizer, search and reports so far
    What the Test Hub should notice
    What changedWhere the hub shows it
    Every planted problem is fixedThe whole Freight regression group is green again (after DEMO-017's baseline was re-blessed for the new design)
    The optimizer is ~30% faster than 1.0, search the fastest yetAnalytics speed table: 'faster' across the board
    The API sends BOTH 'eta' and 'estimated_delivery' (eta deprecated)DEMO-020 green again: old clients keep working, new ones migrate
    Accessibility and single-use reset links are fixedDEMO-022 and DEMO-023 green again

Deploy & incident history

WhenWhatBy
Sep 25, 00:23:39 Deployed 3.0.0 terminal
Sep 25, 00:23:07 Deployed 2.1.0 terminal
Sep 25, 00:22:38 Deployed 2.0.0 terminal
Sep 25, 00:22:11 Deployed 1.1.0 terminal
Sep 25, 00:21:42 Deployed 1.0.0 terminal
Sep 25, 00:21:42 Incident cleared terminal
Sep 24, 22:04:29 Deployed 3.0.0 terminal
Sep 24, 22:04:20 Deployed 2.1.0 terminal
Sep 24, 22:04:20 Incident cleared terminal
Sep 24, 20:41:18 Deployed 3.0.0 terminal
Sep 24, 20:41:03 Deployed 2.1.0 terminal
Sep 24, 20:40:48 Deployed 2.0.0 terminal