LearnNewsExamplesServices
Frontmatter
id10018
titleAutonomous Healthcheck Workflow for Frontier Model Agents
stateClosed
labels
enhancementaiarchitecture
assigneestobiu
createdAtApr 14, 2026, 8:19 PM
updatedAtApr 16, 2026, 8:38 PM
githubUrlhttps://github.com/neomjs/neo/issues/10018
authortobiu
commentsCount0
parentIssue9950
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtApr 16, 2026, 8:38 PM

Autonomous Healthcheck Workflow for Frontier Model Agents

Closed v13.0.0/archive-v13-0-0-chunk-4 enhancementaiarchitecture
tobiu
tobiu commented on Apr 14, 2026, 8:19 PM

Objective

Create a .agent/workflows/healthcheck/ protocol that frontier model agents (Antigravity, Gemini CLI, Claude Code) execute periodically (daily/weekly) to diagnose and treat system-level degradation across the Agent OS infrastructure.

Rationale

The Neo.mjs Agent OS currently has no mechanism for detecting "silent degradation" — scenarios where the system appears functional but delivers fundamentally wrong context (e.g., stale session summaries, unreachable ChromaDB, corrupt graph topology). Historical evidence shows that every infrastructure recovery required human pattern recognition and manual intervention (the "doctor visit" pattern observed across 10 sessions in 30 hours, April 12-14 2026).

This workflow bridges the gap between "healing sessions" (human-directed) and "self-healing" (autonomous). A frontier model has the reasoning capacity to correlate cross-system anomalies, write targeted Playwright tests, fix source code, and verify the fix — all capabilities an SLM cannot reliably perform.

Design

Scope

This is a .agent/workflows/ artifact (not a Neo agent profile or npm run script). It is a Markdown protocol that a frontier model reads and follows, similar to .agent/skills/.

Protocol Phases

Phase 1: Infrastructure Pulse

  • healthcheck() all 4 MCP servers (KB, Memory Core, Neural Link, GitHub Workflow)
  • Verify ChromaDB collection counts and accessibility
  • Check SQLite graph node/edge counts + last modification timestamp
  • Verify DreamService last successful run

Phase 2: Pipeline Freshness

  • Read sandman_handoff.md — is the data current?
  • Check summarization backlog (total sessions vs. summarized count)
  • Verify latest session summary timestamp vs. current time (staleness detection)
  • Confirm Golden Path recommendations reference open tickets (not closed/stale)

Phase 3: Data Quality Audit

  • Sample 5 recent session summaries — do quality scores and content make sense?
  • Query graph for orphaned nodes (nodes with 0 edges)
  • Check embedding model consistency across collections
  • Validate that get_context_frontier returns relevant, recent context

Phase 4: Treatment (if issues detected)

  • For code-level bugs: write a failing Playwright test (per unit-test skill), fix the source, verify the test passes, open PR
  • For data-level issues: execute surgical cleanup scripts via services.mjs SDK
  • For issues beyond autonomous resolution: create a GitHub issue with full diagnostic context and signal BLOCKED state

Phase 5: Report

  • Generate a structured health report in sandman_handoff.md or a dedicated artifact
  • Flag anomalies with severity (CRITICAL / WARNING / INFO)
  • Save diagnostic session to Memory Core for future reference

Key Constraint

This workflow MUST be executable by a frontier model agent (Antigravity, Gemini CLI, Claude Code) using their native tool access. It must NOT depend on npm run or Neo agent infrastructure, since those components may themselves be the failure point.

Acceptance Criteria

  • .agent/workflows/healthcheck/WORKFLOW.md protocol document exists
  • Protocol covers all 5 phases with explicit tool invocation sequences
  • At least one real diagnostic scenario is documented with expected tool calls
  • Workflow is referenced in AGENTS_STARTUP.md for discoverability

Origin Session ID: 69b726ca-97c8-406c-9106-c63b6642c4c0

tobiu added the enhancement label on Apr 14, 2026, 8:19 PM
tobiu added the ai label on Apr 14, 2026, 8:19 PM
tobiu added the architecture label on Apr 14, 2026, 8:19 PM
tobiu added parent issue #9950 on Apr 14, 2026, 8:57 PM
tobiu assigned to @tobiu on Apr 16, 2026, 6:36 PM
tobiu referenced in commit f1aadf5 - "feat: Add Autonomous Healthcheck Skill (#10018)" on Apr 16, 2026, 8:10 PM
tobiu cross-referenced by PR #10045 on Apr 16, 2026, 8:10 PM
tobiu referenced in commit 174a9a7 - "feat: Add Autonomous Self-Repair Skill (#10018) (#10045) on Apr 16, 2026, 8:38 PM
tobiu closed this issue on Apr 16, 2026, 8:38 PM