Test run report — DEMO-017 FAILED
Freight: visual check of the home page
run #294 · 2026-09-24 18:55:40 ·
duration 2s ·
target version 2.0.0 · browser chromium ·
started by: cli-adopted
report generated 2026-09-25 11:39:53 — self-contained file, safe to attach anywhere
What went wrong
AssertionError: the home page looks different: similarity 0.6117 (min 0.97), 46.4% of pixels changed (max 2%). 02-what-changed.png in this run's screenshots marks it in red. If the change is intended, delete DEMO-017__baseline.png to re-bless the new look.
Step timings
| at | step | ms |
|---|
| +1.02s | goto http://127.0.0.1:8000/demo/freight/ | 271.1 |
| +1.47s | wait_for_load_state networkidle | 444.3 |
| +1.63s | screenshot | 163.4 |
Full technical error
AssertionError: the home page looks different: similarity 0.6117 (min 0.97), 46.4% of pixels changed (max 2%). 02-what-changed.png in this run's screenshots marks it in red. If the change is intended, delete DEMO-017__baseline.png to re-bless the new look.
Traceback (most recent call last):
File "/opt/pw-testhub/app/core/harness/run_test.py", line 737, in main
module.run(TimedPage(page, ctx), ctx)
File "/opt/pw-testhub/data/tests/DEMO-017__freight_visual_check.py", line 51, in run
assert score >= SSIM_MIN and changed <= DIFF_MAX, (
AssertionError: the home page looks different: similarity 0.6117 (min 0.97), 46.4% of pixels changed (max 2%). 02-what-changed.png in this run's screenshots marks it in red. If the change is intended, delete DEMO-017__baseline.png to re-bless the new look.
Video and Playwright trace stay on the hub:
results/DEMO-017/20260924-185541-r294/ — open the run page for the replay.