LearnNewsExamplesServices
Frontmatter
id7925
titleFeat: Create VisualService (Sighted Agent SDK)
stateClosed
labels
enhancementstaleai
assignees[]
createdAtNov 29, 2025, 4:20 PM
updatedAtMar 14, 2026, 4:37 AM
githubUrlhttps://github.com/neomjs/neo/issues/7925
authortobiu
commentsCount2
parentIssue7919
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtMar 14, 2026, 4:37 AM

Feat: Create VisualService (Sighted Agent SDK)

Closed v12.1.0 enhancementstaleai
tobiu
tobiu commented on Nov 29, 2025, 4:20 PM

Context

We want to evolve the "Sighted Agent" concept into a first-class citizen of our AI SDK.

Requirements

  1. Class: Create ai/services/Visual.mjs.
  2. Capabilities:
    • captureScreenshot(selector): Uses Chrome DevTools Protocol.
    • getAccessibilityTree(): Returns the semantic tree for LLM analysis.
    • highlightElement(selector): Visually tags an element for debugging.
  3. Integration: Ensure this service can be imported by Neo.ai.Agent.

Output

  • A new service in the AI SDK.
tobiu added the enhancement label on Nov 29, 2025, 4:20 PM
tobiu added the ai label on Nov 29, 2025, 4:20 PM
tobiu added parent issue #7919 on Nov 29, 2025, 4:22 PM