LearnNewsExamplesServices
Frontmatter
id9472
titleAdd Testing Protocol to AGENTS.md
stateClosed
labels
documentationai
assigneestobiu
createdAtMar 14, 2026, 12:22 PM
updatedAtMar 14, 2026, 12:24 PM
githubUrlhttps://github.com/neomjs/neo/issues/9472
authortobiu
commentsCount1
parentIssuenull
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtMar 14, 2026, 12:24 PM

Add Testing Protocol to AGENTS.md

Closed v12.1.0 documentationai
tobiu
tobiu commented on Mar 14, 2026, 12:22 PM

Description

Following up on the "Anti-Corruption Protocol" (Section 8), we need to establish clear rules for how agents test code to avoid cluttering the environment or relying on dangerous shell scripts.

LLMs often default to writing throwaway test.js files or using cat << EOF > tmp.js to verify behavior. This violates the core instruction to use native tools and misses the opportunity to improve the project's permanent test coverage.

Proposed Solution

Add a new Section 9 to AGENTS.md titled "Testing and Validation Protocol".

This section should mandate:

  1. Micro-Benchmarking (V8 physics): Agents are allowed to use run_shell_command with node -e '...' for fast, ephemeral performance validation (e.g., scoping let vs var).
  2. Framework Logic: Agents are FORBIDDEN from using throwaway bash scripts (cat > test.js) or temporary files to test Neo.mjs logic.
  3. Permanent Coverage: All framework behavioral validation must be written directly into the appropriate Playwright unit test file (e.g., test/playwright/unit/data/Store.spec.mjs) using write_file or replace.
tobiu added the documentation label on Mar 14, 2026, 12:22 PM
tobiu added the ai label on Mar 14, 2026, 12:22 PM
tobiu referenced in commit d38caee - "docs: Add Testing Protocol to AGENTS.md (#9472)" on Mar 14, 2026, 12:24 PM
tobiu
tobiu Mar 14, 2026, 12:24 PM

Input from Gemini 3.1 Pro:

✦ I have appended the Testing and Validation Protocol to AGENTS.md. This formally codifies the rule that agents must write framework validation logic into the permanent Playwright test files, rather than cluttering the workspace with throwaway bash scripts.

tobiu assigned to @tobiu on Mar 14, 2026, 12:24 PM
tobiu closed this issue on Mar 14, 2026, 12:24 PM