LearnNewsExamplesServices
Frontmatter
id7385
title''Sighted'' Agent - Chrome DevTools Integration
stateClosed
labels
help wantedgood first issueepicstalehacktoberfestai
assigneestobiu
createdAtOct 6, 2025, 11:03 AM
updatedAtJan 9, 2026, 1:57 AM
githubUrlhttps://github.com/neomjs/neo/issues/7385
authortobiu
commentsCount2
parentIssuenull
subIssues
7386 Configure MCP Server for Project
7387 Create Guide for Chrome DevTools MCP Server
7388 Define the "Sighted" Development Workflow
7389 Investigate Worker Console Access with MCP
7390 Create a "Sighted" Development Demo
subIssuesCompleted5
subIssuesTotal5
blockedBy[]
blocking[]
closedAtJan 9, 2026, 1:57 AM

'Sighted' Agent - Chrome DevTools Integration

Closed v11.19.0 help wantedgood first issueepicstalehacktoberfestai
tobiu
tobiu commented on Oct 6, 2025, 11:03 AM

This epic covers the integration of the Chrome DevTools Model Context Protocol (MCP) server into the neo.mjs development workflow. The primary goal is to give the AI agent 'sight' by allowing it to programmatically interact with a live browser instance. This will enable a new, interactive development workflow where the agent can:

  • Continuously verify UI changes: Inspect the DOM and CSS in real-time during component development.
  • Generate meaningful Playwright tests: Leverage its understanding of the UI to create robust Playwright tests.
  • Debug multi-threaded applications: Investigate worker and shared worker console access for comprehensive debugging.
  • Analyze performance and automate user flows: Utilize advanced DevTools capabilities for performance analysis and UI automation.

This initiative is a critical step towards building a more powerful and autonomous AI-native development environment, transforming the agent from a 'blind' code generator into a 'sighted' development partner.

Top-Level Items & Implementation Phases

Phase 1: Initial Integration & Verification

  • Goal: Configure the MCP server and verify basic connectivity and functionality.

Phase 2: 'Sighted' Development Workflow

  • Goal: Integrate browser-based verification into the agent's core development and PR review workflows.

Sub-Tasks

Phase 1: Initial Integration & Verification

  • Done: ticket-configure-mcp-server.md
  • To Do: ticket-create-mcp-server-guide.md

Phase 2: 'Sighted' Development Workflow

  • To Do: ticket-define-sighted-development-workflow.md
  • To Do: ticket-investigate-worker-console-access-with-mcp.md
  • To Do: ticket-create-sighted-development-demo.md
tobiu assigned to @tobiu on Oct 6, 2025, 11:03 AM
tobiu added the epic label on Oct 6, 2025, 11:03 AM
tobiu added the ai label on Oct 6, 2025, 11:03 AM
tobiu added sub-issue #7386 on Oct 6, 2025, 11:04 AM
tobiu added sub-issue #7387 on Oct 6, 2025, 12:29 PM
tobiu added the help wanted label on Oct 6, 2025, 12:32 PM
tobiu added the good first issue label on Oct 6, 2025, 12:32 PM
tobiu added the hacktoberfest label on Oct 6, 2025, 12:32 PM
tobiu added sub-issue #7388 on Oct 6, 2025, 12:34 PM
tobiu added sub-issue #7389 on Oct 6, 2025, 12:36 PM
tobiu added sub-issue #7390 on Oct 6, 2025, 12:38 PM
tobiu referenced in commit d071c95 - "#7385 ticket md files" on Oct 6, 2025, 12:41 PM
tobiu
tobiu Jan 9, 2026, 1:57 AM

Input from Gemini 3 Pro:

Status Update: Obsolete

This initiative has been superseded by the Neural Link architecture introduced in v11.18.0 and matured in v11.19.0.

Rationale: The original goal was to give agents "sight" via the generic Chrome DevTools protocol. However, we found that a native, engine-aware introspection layer (Neural Link) provides vastly superior capabilities:

  1. Scene Graph Awareness: The Neural Link understands Neo.component.Base instances, not just DOM nodes.
  2. State Mutation: Agents can modify runtime state directly, which DevTools cannot do safely.
  3. Cross-Context: The Neural Link bridges the Worker boundary natively.

As of v11.19.0, we have officially removed the Chrome DevTools MCP server from our default configuration in favor of the Neural Link.

Action: Closing as superseded.

tobiu closed this issue on Jan 9, 2026, 1:57 AM