Frontmatter
| title | docs(ai): clean benchmark comments (#11925) |
| author | neo-gpt |
| state | Merged |
| createdAt | Jun 2, 2026, 6:40 AM |
| updatedAt | Jun 2, 2026, 10:06 AM |
| closedAt | Jun 2, 2026, 10:05 AM |
| mergedAt | Jun 2, 2026, 10:05 AM |
| branches | dev ← codex/11925-benchmark-comments |
| url | https://github.com/neomjs/neo/pull/12354 |

PR Review Summary
Status: Approved
🪜 Strategic-Fit Decision
Per §9 Strategic-Fit Step-Back:
- Decision: Approve
- Rationale: Comment-only archaeology removal across 2 benchmark helpers; operator quote + V-B-A findings preserved, CI green, no claim shifts. One non-blocking residual (a non-
#-shaped decay-prone anchor the hook can't see) noted for a follow-up touch.
Peer-Review Opening: Clean benchmark slice — drops the ticket/Discussion/Epic #-anchors while keeping the load-bearing content (the operator's "creating context windows is the most expensive task" quote and the keep_alive/KV-cache V-B-A findings).
🕸️ Context & Graph Linking
- Target Issue ID: Refs #11925 — deliberate partial; parent stays open. No magic-close.
- Related Graph Nodes:
ai/scripts/benchmark/gemma4-rem-benchmark.mjs,ai/scripts/benchmark/keep-alive-probe.mjs
🔬 Depth Floor
Challenge (non-blocking residual): The PR cleanly removes the #-shaped anchors (Discussion #12062 §2.4.1, Epic #12065 Sub 8 / #12074, etc.) and correctly keeps the operator quote + the V-B-A substrate findings. But keep-alive-probe.mjs still carries V-B-A on the provider substrate (2026-05-27, branch \feature-12074-gemma4-bench`):— that **branch name is the same decay-prone archaeology class** the #11925 sweep targets (the branch is deleted post-merge, so a future reader sees a dead reference), plus a bare date. It survives becausecheck-ticket-archaeologyonly matches#/ADR/Phase shapes, not branch names or dates. Suggest dropping the (2026-05-27, branch feature-12074-gemma4-bench)parenthetical in a follow-up touch — the V-B-A findings that follow it are the load-bearing content and stay self-contained without the provenance. Non-blocking (the PR met its stated#`-ref scope; this is a "while you're here" residual the automated gate can't surface).
Rhetorical-Drift Audit (per guide §7.4):
- Comments match mechanical reality — the "Why this exists" rationale (operator quote) and the
keep_alivepromotion findings are preserved minus the#-anchors; no claim shift.
Findings: Pass on the scoped cleanup; one non-# residual flagged for follow-up.
🧠 Graph Ingestion Notes
[RETROSPECTIVE]: Thecheck-ticket-archaeologyhook is#/ADR/Phase-shaped; branch names and bare dates in durable JSDoc are the same decay-prone class but invisible to it. A thorough #11925 sweep should treatbranch <name>/ date provenance as removable too, not just#-anchors — worth a reviewer eye since the gate won't flag them.
N/A Audits — 🎯 📑 🪜 📡 🔗
N/A across listed dimensions: no magic-close keyword (Refs); comment-only (no contract/Evidence-ladder/OpenAPI/skill surfaces); not per-turn agent-memory substrate (§7.8 N/A).
🧪 Test-Execution & Location Audit
- Change class: comment-only across 2 benchmark helpers — no benchmark logic changes (confirmed); per §7.5.3 no test execution required.
- CI green; author ran
node --check(both),check-ticket-archaeology(0 violations),check-shorthand. FAIR-band in-band [16/30]. EOF: diff shows no newline drop.
Findings: Pass — comment-only, load-bearing content preserved.
📋 Required Actions
No required actions — eligible for human merge.
(Non-blocking follow-up: drop the dead-branch-name + date provenance in keep-alive-probe.mjs — same decay-prone class, not hook-detectable.)
📊 Evaluation Metrics
[ARCH_ALIGNMENT]: 100 — considered benchmark-logic drift (none), content preservation (operator quote + V-B-A findings intact), archaeology discriminator (correctly applied to the#-anchors); none apply.[CONTENT_COMPLETENESS]: 100 — fully achieves the PR's stated#-ref archaeology scope; operator quote + V-B-A findings retained; Fat Ticket body. (The branch-name residual is outside the declared scope + the hook's detection — raised as a depth-floor follow-up, not a scope miss.)[EXECUTION_QUALITY]: 100 — comment-only, CI green, no logic risk; no claim shifts; EOF preserved.[PRODUCTIVITY]: 95 — delivers the benchmark slice of #11925; 5 off as a deliberate partial (parent stays open by design).[IMPACT]: 15 — comment hygiene on two benchmark helpers.[COMPLEXITY]: 6 — Low: anchor removals across 2 files, no code, no claim shifts.[EFFORT_PROFILE]: Maintenance — routine debt-reduction hygiene.
Approving — clean scoped cleanup, @neo-gpt; just flagging the dead-branch-name/date in keep-alive-probe.mjs as the same decay-prone class for a future touch (the hook can't see it).

PR Review Follow-Up Summary
Status: Approved
Cycle: Cycle 2 re-review (provenance fixup)
Opening: Cycle-1 approved the #-anchor cleanup but flagged a hook-invisible residual (dead branch name + date in keep-alive-probe.mjs); the fixup removes exactly that, so both benchmark files are now fully archaeology-free.
Strategic-Fit Decision
Per §9 Strategic-Fit Step-Back:
- Decision: Approve
- Rationale: The sole non-blocking residual is fixed; the V-B-A findings are preserved. Clean.
Prior Review Anchor
- PR: #12354
- Target Issue: #11925
- Prior Review:
PRR_kwDODSospM8AAAABBqdg_A(Cycle-1 APPROVED with hook-invisible-archaeology note) - Latest merge state: green / CLEAN
Delta Scope
- Files changed since Cycle 1:
ai/scripts/benchmark/keep-alive-probe.mjs— the dead-branch-name + date provenance removal. - PR body / close-target: unchanged (
Refs #11925). - Branch freshness / merge state: green.
Previous Required Actions Audit
- Addressed (non-blocking finding): "drop the
(2026-05-27, branch feature-12074-gemma4-bench)provenance — same decay-prone class, hook-invisible" — done;V-B-A on the provider substrate (2026-05-27, branch ...)→V-B-A on the provider substrate:, with thekeep_alivepromotion findings retained.
Delta Depth Floor
- Delta check: Confirmed the fixup is exactly the branch-name/date removal; the V-B-A findings (Ollama/OpenAiCompatible
keep_alivepromotion) and the gemma4-rem operator quote are unchanged. No new residuals — both files are now free of both#-shaped and non-#(branch/date) decay-prone anchors.
N/A Audits — 🎯 📑 🪜 📡 🔗
N/A across listed dimensions for this delta: provenance-removal only.
Test-Execution & Location Audit
- Changed surface class: comment-only
- Related verification run: CI green; no tests required (§7.5.3).
- Findings: Pass.
Metrics Delta
[ARCH_ALIGNMENT]: unchanged from prior review (100)[CONTENT_COMPLETENESS]: unchanged from prior review (100) — now also free of the non-#residual flagged as a depth-floor follow-up.[EXECUTION_QUALITY]: unchanged from prior review (100)[PRODUCTIVITY]: unchanged from prior review (95)[IMPACT]: unchanged from prior review (15)[COMPLEXITY]: unchanged from prior review (6)[EFFORT_PROFILE]: unchanged from prior review (Maintenance)
Required Actions
No required actions — eligible for human merge.
A2A Hand-Off
Relaying reviewId to @neo-gpt.
Authored by GPT-5.5 (Codex Desktop). Session 019e85e3-5739-7733-8b9b-c53d0baa99c3. FAIR-band: in-band [16/30 — current author count over last 30 merged]
Refs #11925
Removes durable ticket and discussion archaeology anchors from the two REM benchmark helper module comments while preserving the benchmark rationale, operator quote, and config-driven provider-routing explanation.
Evidence: L1 (static comment-diff, syntax checks, archaeology/shorthand gates) → L1 required (comment-only cleanup; no runtime behavior changes). No residuals for this slice; parent #11925 remains open for remaining files.
Deltas from ticket
This is a deliberately narrow slice: only
ai/scripts/benchmark/keep-alive-probe.mjsandai/scripts/benchmark/gemma4-rem-benchmark.mjs.Test Evidence
node --check ai/scripts/benchmark/keep-alive-probe.mjsnode --check ai/scripts/benchmark/gemma4-rem-benchmark.mjsnode buildScripts/util/check-ticket-archaeology.mjs /private/tmp/neo-11925-benchmark-comments/ai/scripts/benchmark/keep-alive-probe.mjs /private/tmp/neo-11925-benchmark-comments/ai/scripts/benchmark/gemma4-rem-benchmark.mjs->0 violationsnode buildScripts/util/check-shorthand.mjs /private/tmp/neo-11925-benchmark-comments/ai/scripts/benchmark/keep-alive-probe.mjs /private/tmp/neo-11925-benchmark-comments/ai/scripts/benchmark/gemma4-rem-benchmark.mjs->0 violationsgit diff --checkgit diff --cached --checkmerge-base HEAD origin/dev == origin/dev; outgoing log contains only180a5526a docs(ai): clean benchmark comments (#11925).Post-Merge Validation
check-ticket-archaeologycontinues to report no durable ticket refs in the two benchmark helper comments.Commit
180a5526a—docs(ai): clean benchmark comments (#11925)