enhance(#3717): make the edge probe's shape cues language-aware via an optional text_en field (#4156)

* test(#3717): add failing-first coverage for text_en language-aware classification

Adds unit tests for the not-yet-implemented text_en field on Requirement
(fallback selection, empty/whitespace/non-string rejection, shapes-override
precedence), a SHAPE_CUES/VALID_SHAPES parity guard (RULESET.GENERATIVE-FIX),
and workflow-prose contract tests asserting spec-phase.md Step 5.5 documents
populating text_en for response_language projects. All new tests are RED
until src/edge-probe.cts and the workflow docs are updated.

* feat(#3717): make edge-probe shape classification read an optional text_en field

Requirement gains an optional text_en; classifyShape's own signature stays
untouched (a locked, directly-tested export), and the text_en ?? text
selection is pushed to proposeEdges' single call site instead. text_en is
validated fail-closed: an empty or whitespace-only value throws rather than
silently winning the ?? fallback and degrading classification to zero shapes.

This makes the #2773 doc-only translation convention an explicit,
validatable field instead of an invisible instruction, per the approved
Form-1 scope on #3717.

* docs(#3717): document the text_en field across spec-phase, reference and how-to docs

Updates Step 5.5's response_language instructions, the edge-probe reference
Inputs contract, the FEATURES.md fragment, and the non-English how-to guide
to describe the new text_en field: text keeps the requirement's own wording
in all cases, text_en (when populated) is the engine-only English rendering
the classifier prefers.

* docs(#3717): record the text_en locked-surface change in CONTEXT.md and ADR-550

Updates the Edge Probe Module glossary entry to describe the text_en field
and its fail-closed validation, and appends an ADR-550 amendment recording
why this is additive and does not re-open the #652 LLM-classifier rejection
(text_en is a plain field read by the existing deterministic regex
classifier, not a new model-dependent surface).

* docs(#3717): add changeset fragment and regenerate FEATURES.md

pr:0 placeholder — backfilled with the real PR number after the PR opens.

* docs(#3717): attribute the text_en machine check to engine-level validation, not prose tests

Code-review (Spec axis) finding: the workflow-prose contract tests and the
ADR-550 amendment overclaimed themselves as "the machine check the #2773
doc-only stopgap lacked." That check is actually engine-level
(validateRequirement/classifyShape, covered in tests/edge-probe.test.cjs) —
the prose tests are the same style of assertion #2773 already used. Reworded
both to attribute the claim correctly.

* fix(#3717): rewrap spec-phase.md so the id-unchanged sentence stays on one line

The #3717 rewrite of Step 5.5's response_language paragraph moved a line
break so "requirement `id`s" ended one physical line and "are never
translated" started the next. The pre-existing #2773 regression test
(tests/edge-probe-spec-phase-contract.test.cjs) asserts id + "never
translated" on the SAME line (no \n in between, matching git's own
line-oriented prose), so the reflow silently broke it. Rewrapped so the
sentence lands on one line again, verified against every #2773/#3717
regex assertion in that test file.

Emitted-Drift-Ack-Growth: spec-phase.md — #3717 adds text_en documentation to Step 5.5 (response_language paragraph + REQS_JSON heredoc comment); this growth is this PR's own diff, not incidental drift.

* chore(#3717): backfill changeset PR number

pr:0 -> pr:4156 now that the PR exists.

---------

Co-authored-by: sim <sim@local>
This commit is contained in:
Tom Boucher
2026-09-01 21:39:53 -04:00
committed by GitHub
parent 4dfc46bbe7
commit bf4485ada2
11 changed files with 286 additions and 44 deletions

View File

@@ -504,3 +504,59 @@ test('#2773: no Step 5.5 exit path leaks the $REQS_JSON temp file', () => {
`every exit between the mktemp and the unconditional cleanup must rm -f "$REQS_JSON" first; leaking exits: ${JSON.stringify(leaks)}`,
);
});
// ─── #3717: durable text_en field (follow-up to the #2773 doc-only stopgap) ───
//
// #2773 shipped a documented convention: for a response_language project, Step 5.5's `text`
// field silently carried the English TRANSLATION rather than the SPEC's own requirement
// prose. #3717 (approved scope: Form 1 only, `text_en` field) makes this an explicit,
// validatable field: `text` goes back to meaning "the requirement's own text" (in
// response_language, when set), and `text_en` carries the translation the classifier reads.
//
// These three tests only check the WORKFLOW PROSE instructs populating text_en correctly —
// the same prose-assertion pattern the #2773 tests above already use for Step 5.5, not a new
// testing technique. The actual machine check the #2773 doc-only stopgap lacked is
// ENGINE-level, not workflow-level: text_en is now a real, validated Requirement field —
// validateRequirement fail-closes on an empty value, and classifyShape/proposeEdges
// demonstrably prefer it over text — a property the #2773 prose-only convention had no way
// to enforce. See tests/edge-probe.test.cjs for that engine-level coverage.
test('#3717: Step 5.5 documents populating text_en for response_language projects', () => {
const block = extractStep55Block(readSpecPhase());
assert.ok(block.length > 0, 'Step 5.5 block must be extractable from spec-phase.md');
assert.match(
block,
/text_en/,
'Step 5.5 must name the text_en field — the durable #3717 fix for non-English requirement classification',
);
assert.match(
block,
/response_language/,
'Step 5.5 must still name response_language as the setting that triggers populating text_en',
);
});
test('#3717: Step 5.5 documents that text stays the original SPEC-language requirement text', () => {
const block = extractStep55Block(readSpecPhase());
assert.ok(block.length > 0, 'Step 5.5 block must be extractable from spec-phase.md');
// The #2773-era stopgap had `text` secretly carry the English translation. The #3717
// durable fix keeps `text` meaning the requirement's own text (original language) and
// moves the translation into the new text_en field — this must be documented, not just
// implemented, or the next reader re-introduces the #2773 overload by habit.
assert.match(
block,
/`?text`?[^\n]*(original language|SPEC's own|requirement's own|unchanged)|(original language)[^\n]*`?text`?/i,
'Step 5.5 must state that text carries the SPEC requirement in its own (original) language — not the translation',
);
});
test('#3717: the edge-probe reference documents the text_en field', () => {
const ref = fs.readFileSync(EDGE_PROBE_REF_PATH, 'utf8');
assert.match(
ref,
/text_en/,
'the edge-probe reference `## Inputs` contract must document the optional text_en field and its text_en ?? text fallback',
);
});