docs(#2665): document the two live-config-guard env vars
The changeset for this PR is typed `Added`, and CONTRIBUTING requires a docs/ change for that type. The only docs/ file in the diff was CONTEXT-INDEX.json -- a GENERATED index -- so the Docs Required gate passed while no human-readable documentation existed for either new variable. A gate satisfied by a generated artifact is satisfied vacuously. docs/TESTING-SUITES.md now carries a section on the guard: what it watches and why it is ownership-scoped rather than whole-root, the two env vars in a table, why the default is report-only and what the promotion condition is, and what each violation label means (including that UNVERIFIED is not clean). GSD_SKIP_LIVE_CONFIG_GUARD is named explicitly because it is a bypass on a safety check. An undocumented bypass is one people eventually set without knowing what they turned off. A test asserts both variables appear in that doc -- checked as permitted by local/no-source-grep before writing it, rather than assumed forbidden. It fails when the section is removed, so the doc cannot rot back to the state the review found. Addresses review finding: Major 4.
This commit is contained in:
@@ -219,6 +219,47 @@ disagree, trust (and fix) the rule table.
|
||||
|
||||
Unknown suites exit non-zero with the list of valid suites. Empty suites (e.g. `--suite security` before any security-tagged file exists) exit `0` with a `no tests in suite "..."` notice on stderr so CI lanes don't go red while a suite is being populated.
|
||||
|
||||
## The live-config hermeticity guard
|
||||
|
||||
Every `run-tests.cjs` invocation snapshots GSD's own install footprint in each
|
||||
live runtime config directory before the suite and re-checks it afterwards. It
|
||||
exists because the failure it catches is silent by construction: a test that
|
||||
resolves a config directory from the ambient environment instead of a sandbox
|
||||
writes into *your real* `~/.claude` (or `$GSD_HOME/.gsd`, or a Kimi
|
||||
`config.toml`), and nothing reports it. CI cannot catch this class at all —
|
||||
CI never has `CLAUDE_CONFIG_DIR` and friends set.
|
||||
|
||||
The guard watches only what GSD unambiguously owns — its top-level install
|
||||
footprint plus `gsd-`-prefixed children of directories shared with the host
|
||||
agent — never whole config roots, because a host agent legitimately writing
|
||||
`history.jsonl` mid-run would make the guard cry wolf, and a guard that cries
|
||||
wolf gets switched off.
|
||||
|
||||
Two environment variables control it:
|
||||
|
||||
| Variable | Effect |
|
||||
|---|---|
|
||||
| `GSD_STRICT_LIVE_CONFIG_GUARD=1` | A detected write **fails the run**. Set on the Linux/macOS lanes of every CI job that runs the suite. |
|
||||
| `GSD_SKIP_LIVE_CONFIG_GUARD=1` | Skips the check entirely. |
|
||||
|
||||
Unset, the guard **reports and does not fail** — deliberately, not timidly. On
|
||||
its first CI run it surfaced pre-existing leaks on the Windows lane, where
|
||||
`os.homedir()` reads `USERPROFILE` and ~190 test sites sandbox `HOME` alone.
|
||||
Those are real and worth fixing, but they are a different defect class, and a
|
||||
brand-new gate that instantly reds an unrelated lane gets reverted rather than
|
||||
obeyed. Windows lanes therefore stay report-only until that sweep lands; this
|
||||
repo has the pattern already, in the `local/no-source-grep` ESLint rule that
|
||||
shipped at `warn` and was promoted to `error` after its cleanup (ADR 452).
|
||||
|
||||
`GSD_SKIP_LIVE_CONFIG_GUARD` is a bypass on a safety check, so it is documented
|
||||
here rather than left to be discovered in the source: an undocumented bypass is
|
||||
one people eventually set without knowing what they turned off. If you need it
|
||||
routinely, that is a bug report, not a workflow.
|
||||
|
||||
Reported paths are labelled `CREATED`, `MODIFIED`, `DELETED`, or `UNVERIFIED`.
|
||||
`UNVERIFIED` means a scan bound was hit and the path could not be attested
|
||||
either way — it is never the same as clean.
|
||||
|
||||
## CI matrix
|
||||
|
||||
The `Tests` workflow runs every PR through a scoped gate generated by
|
||||
|
||||
Reference in New Issue
Block a user