WORK-409
ID:WORK-409Status:pending

Visual-regression harness

A shared Playwright harness that photographs the generated gallery + layout fixtures into per-theme golden baselines, image-diffed on every PR. This closes the AI iteration loop and — critically — gives the v0.23.0 skeleton/skin extraction its "diff must be empty" proof. No screenshot testing exists in the repo today; this is greenfield.

Priority:highComplexity:moderateMilestone:v0.22.0Source:SPEC-094
claude/work-416-gallery-behaviors View source

Criteria completion

Criteria completion: 0 of 4 (0%) checked; tracking started on Jun 12, no incremental history yet0%25%50%75%100%Jun 12Jun 15

Tracking started Jun 12 — check back for trends.

Relationships

Implements 1
Related 9
Branches 4
claude/work-416-gallery-behaviors current pending
claude/work-409-local-baseline donemain doneclaude/work-409-visual-regression-harness pendingclaude/v0.22.0-theme-foundations pending
History 1
  1. 406471d
    Created (pending)by bjornolofandersson

Scope

  • Reusable Playwright config + snapshot test ("load artifact → await document.fonts.ready → disable animation → snapshot"), living once as a shared harness package/config — not copy-pasted per theme.
  • Rune gallery: per-data-gallery-cell element clips (a diff localises to the rune). Layout fixtures: whole-page shots per viewport.
  • Lumina wires it in with thin glue only: a playwright.config.ts, committed baselines (packages/lumina/gallery/__screenshots__/), an npm script. --update-snapshots to refresh.
  • Runs in a pinned container (Playwright's official image) for deterministic anti-aliasing / font hinting.
  • Distribution: opt-in, separately-installed package — Playwright / browser binaries must not enter the core install path.

Acceptance Criteria

  • A shared harness snapshots both subjects (rune clips per mode; layout pages per viewport) into committed per-theme baselines.
  • Lumina has baseline coverage for all runes and the four existing layouts; the suite runs in CI in a pinned container.
  • A second theme could adopt it with config + baselines + script only (no logic copy).
  • The harness ships as an opt-in package; the core CLI / runtime install pulls no browser binaries.

Dependencies

  • Requires WORK-407 and WORK-408 (the subjects to photograph).
  • The gallery now inlines behaviors (WORK-416), so the harness must wait for behaviors to settle before shooting and exclude the network-dependent runes (map tiles, sandbox external iframe/CDN) from deterministic baselines (stub/skip). Synchronous runes (PE runes, diagram, chart, nav) baseline fine after settle.

References

  • SPEC-094 · Playwright · packages/lumina/.