3.4 KiB
3.4 KiB
phase, slug, status, nyquist_compliant, wave_0_complete, created
| phase | slug | status | nyquist_compliant | wave_0_complete | created |
|---|---|---|---|---|---|
| 20 | demo-instance-with-every-shared-plugin | draft | false | false | 2026-10-28 |
Phase 20 — Validation Strategy
Per-phase validation contract for feedback sampling during execution.
Test Infrastructure
| Property | Value |
|---|---|
| Framework | go test (plugins, sm-demo-app; testcontainers Postgres on full runs); vitest 3.2.7 (vue-demo-app, vue-chat-layer); node --test or vitest (other layers) |
| Config file | ../sm-demo-app/vue-demo-app/vitest.config.ts; new layers: none — Wave 0 installs |
| Quick run command | go vet ./... && go test -short ./... in the touched Go repo; pnpm test in the touched layer |
| Full suite command | cd ../sm-demo-app && scripts/check-all.sh |
| Estimated runtime | ~30 seconds quick, ~300 seconds full |
Sampling Rate
- After every task commit: Run the quick run command of the repo touched
- After every plan wave: Run sm-demo-app
go test ./...(Docker) +pnpm --dir vue-demo-app test+scripts/check-pins.sh - Before
/msd-verify-work: Full suite must be green - Max feedback latency: 60 seconds
Per-Task Verification Map
Filled by the planner from the plans; source map in 20-RESEARCH.md § Validation Architecture.
| Task ID | Plan | Wave | Requirement | Threat Ref | Secure Behavior | Test Type | Automated Command | File Exists | Status |
|---|---|---|---|---|---|---|---|---|---|
| 20-xx-xx | — | — | SC-1..SC-4, D-01..D-18 | — | see RESEARCH Security Domain | unit/integration/live | see RESEARCH test map | ❌ W0 | ⬜ pending |
Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky
Wave 0 Requirements
sm-demo-app/seed_chat_test.go,chat_test.go(context, channel adapter, resolvers, DM-only calls, bootstrap JSON)sm-chat-pluginandsm-forum-pluginpre-save seam testssm-moderation-pluginpackage and tests (new repo)vue-chat-layervitest config and ported bm chat tests (composable store setup)vue-chatvideo-layer,vue-forum-layer,vue-userfriends-layertests/*.test.tsscripts/dev.shlocal livekit-server;scripts/check-local.sh chat
Manual-Only Verifications
| Behavior | Requirement | Why Manual | Test Instructions |
|---|---|---|---|
| Two-browser chat realtime and a DM video call on the live demo | SC-2, D-13 | Real media over NAT'd browsers and the rome firewall | Two accounts on https://demo.summercms.io: send a message, see it arrive live; start a DM call, see and hear both tiles, mute, leave |
| Vuurmuur firewall rule on rome | D-10 | Shared production host change | Apply with the user's go-ahead; confirm with /livekit/rtc/validate and a call |
Validation Sign-Off
- All tasks have
<automated>verify or Wave 0 dependencies - Sampling continuity: no 3 consecutive tasks without automated verify
- Wave 0 covers all MISSING references
- No watch-mode flags
- Feedback latency < 60s
nyquist_compliant: trueset in frontmatter
Approval: pending