Files
summercms/.planning/phases/20-demo-instance-with-every-shared-plugin/20-VALIDATION.md

3.4 KiB

phase, slug, status, nyquist_compliant, wave_0_complete, created
phase slug status nyquist_compliant wave_0_complete created
20 demo-instance-with-every-shared-plugin draft false false 2026-10-28

Phase 20 — Validation Strategy

Per-phase validation contract for feedback sampling during execution.


Test Infrastructure

Property Value
Framework go test (plugins, sm-demo-app; testcontainers Postgres on full runs); vitest 3.2.7 (vue-demo-app, vue-chat-layer); node --test or vitest (other layers)
Config file ../sm-demo-app/vue-demo-app/vitest.config.ts; new layers: none — Wave 0 installs
Quick run command go vet ./... && go test -short ./... in the touched Go repo; pnpm test in the touched layer
Full suite command cd ../sm-demo-app && scripts/check-all.sh
Estimated runtime ~30 seconds quick, ~300 seconds full

Sampling Rate

  • After every task commit: Run the quick run command of the repo touched
  • After every plan wave: Run sm-demo-app go test ./... (Docker) + pnpm --dir vue-demo-app test + scripts/check-pins.sh
  • Before /msd-verify-work: Full suite must be green
  • Max feedback latency: 60 seconds

Per-Task Verification Map

Filled by the planner from the plans; source map in 20-RESEARCH.md § Validation Architecture.

Task ID Plan Wave Requirement Threat Ref Secure Behavior Test Type Automated Command File Exists Status
20-xx-xx — — SC-1..SC-4, D-01..D-18 — see RESEARCH Security Domain unit/integration/live see RESEARCH test map ❌ W0 ⬜ pending

Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky


Wave 0 Requirements

  • sm-demo-app/seed_chat_test.go, chat_test.go (context, channel adapter, resolvers, DM-only calls, bootstrap JSON)
  • sm-chat-plugin and sm-forum-plugin pre-save seam tests
  • sm-moderation-plugin package and tests (new repo)
  • vue-chat-layer vitest config and ported bm chat tests (composable store setup)
  • vue-chatvideo-layer, vue-forum-layer, vue-userfriends-layer tests/*.test.ts
  • scripts/dev.sh local livekit-server; scripts/check-local.sh chat

Manual-Only Verifications

Behavior Requirement Why Manual Test Instructions
Two-browser chat realtime and a DM video call on the live demo SC-2, D-13 Real media over NAT'd browsers and the rome firewall Two accounts on https://demo.summercms.io: send a message, see it arrive live; start a DM call, see and hear both tiles, mute, leave
Vuurmuur firewall rule on rome D-10 Shared production host change Apply with the user's go-ahead; confirm with /livekit/rtc/validate and a call

Validation Sign-Off

  • All tasks have <automated> verify or Wave 0 dependencies
  • Sampling continuity: no 3 consecutive tasks without automated verify
  • Wave 0 covers all MISSING references
  • No watch-mode flags
  • Feedback latency < 60s
  • nyquist_compliant: true set in frontmatter

Approval: pending